Jun 15 04:25:24.372714 ip-10-0-140-86 systemd[1]: Starting Kubernetes Kubelet... Jun 15 04:25:24.684375 ip-10-0-140-86 kubenswrapper[2561]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 15 04:25:24.684375 ip-10-0-140-86 kubenswrapper[2561]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 15 04:25:24.684375 ip-10-0-140-86 kubenswrapper[2561]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 15 04:25:24.684375 ip-10-0-140-86 kubenswrapper[2561]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 15 04:25:24.684375 ip-10-0-140-86 kubenswrapper[2561]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 15 04:25:24.686064 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.685977 2561 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 15 04:25:24.690463 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690427 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 15 04:25:24.690463 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690462 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 15 04:25:24.690541 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690468 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 15 04:25:24.690541 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690472 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 15 04:25:24.690541 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690475 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 15 04:25:24.690541 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690478 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 15 04:25:24.690541 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690481 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 15 04:25:24.690541 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690485 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 15 04:25:24.690541 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690487 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 15 04:25:24.690541 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690490 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 15 04:25:24.690541 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690494 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 15 04:25:24.690541 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690498 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 15 04:25:24.690541 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690502 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 15 04:25:24.690541 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690505 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 15 04:25:24.690541 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690508 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 15 04:25:24.690541 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690511 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 15 04:25:24.690541 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690514 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 15 04:25:24.690541 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690517 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 15 04:25:24.690541 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690519 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 15 04:25:24.690541 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690522 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 15 04:25:24.690541 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690525 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 15 04:25:24.691022 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690527 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 15 04:25:24.691022 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690530 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 15 04:25:24.691022 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690533 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 15 04:25:24.691022 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690535 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 15 04:25:24.691022 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690538 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 15 04:25:24.691022 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690541 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 15 04:25:24.691022 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690543 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 15 04:25:24.691022 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690546 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 15 04:25:24.691022 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690550 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 15 04:25:24.691022 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690553 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 15 04:25:24.691022 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690556 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 15 04:25:24.691022 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690559 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 15 04:25:24.691022 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690561 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 15 04:25:24.691022 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690564 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 15 04:25:24.691022 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690567 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 15 04:25:24.691022 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690569 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 15 04:25:24.691022 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690572 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 15 04:25:24.691022 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690575 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 15 04:25:24.691022 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690577 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 15 04:25:24.691495 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690580 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 15 04:25:24.691495 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690583 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 15 04:25:24.691495 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690585 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 15 04:25:24.691495 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690588 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 15 04:25:24.691495 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690590 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 15 04:25:24.691495 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690593 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 15 04:25:24.691495 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690595 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 15 04:25:24.691495 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690605 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 15 04:25:24.691495 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690607 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 15 04:25:24.691495 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690610 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 15 04:25:24.691495 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690612 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 15 04:25:24.691495 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690615 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 15 04:25:24.691495 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690617 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 15 04:25:24.691495 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690620 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 15 04:25:24.691495 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690623 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 15 04:25:24.691495 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690626 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 15 04:25:24.691495 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690629 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 15 04:25:24.691495 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690631 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 15 04:25:24.691495 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690634 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 15 04:25:24.691495 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690636 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 15 04:25:24.691982 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690639 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 15 04:25:24.691982 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690641 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 15 04:25:24.691982 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690644 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 15 04:25:24.691982 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690647 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 15 04:25:24.691982 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690649 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 15 04:25:24.691982 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690652 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 15 04:25:24.691982 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690654 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 15 04:25:24.691982 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690657 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 15 04:25:24.691982 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690659 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 15 04:25:24.691982 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690661 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 15 04:25:24.691982 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690664 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 15 04:25:24.691982 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690667 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 15 04:25:24.691982 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690670 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 15 04:25:24.691982 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690673 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 15 04:25:24.691982 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690675 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 15 04:25:24.691982 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690678 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 15 04:25:24.691982 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690680 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 15 04:25:24.691982 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690684 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 15 04:25:24.691982 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690686 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 15 04:25:24.692448 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690689 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 15 04:25:24.692448 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690691 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 15 04:25:24.692448 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690694 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 15 04:25:24.692448 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690696 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 15 04:25:24.692448 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690699 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 15 04:25:24.692448 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690701 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 15 04:25:24.692448 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690705 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 15 04:25:24.692448 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690708 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 15 04:25:24.692448 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690711 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 15 04:25:24.692448 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690714 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 15 04:25:24.692448 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690716 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 15 04:25:24.692448 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690720 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 15 04:25:24.692448 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690722 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 15 04:25:24.692448 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690724 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 15 04:25:24.692448 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690727 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 15 04:25:24.692448 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690730 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 15 04:25:24.692448 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690732 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 15 04:25:24.692448 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690735 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 15 04:25:24.692448 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690739 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 15 04:25:24.692448 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.690742 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 15 04:25:24.692938 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691459 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 15 04:25:24.692938 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691466 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 15 04:25:24.692938 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691469 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 15 04:25:24.692938 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691472 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 15 04:25:24.692938 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691475 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 15 04:25:24.692938 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691479 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 15 04:25:24.692938 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691482 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 15 04:25:24.692938 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691484 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 15 04:25:24.692938 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691487 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 15 04:25:24.692938 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691489 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 15 04:25:24.692938 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691492 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 15 04:25:24.692938 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691495 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 15 04:25:24.692938 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691498 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 15 04:25:24.692938 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691500 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 15 04:25:24.692938 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691503 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 15 04:25:24.692938 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691505 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 15 04:25:24.692938 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691508 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 15 04:25:24.692938 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691511 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 15 04:25:24.692938 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691513 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 15 04:25:24.692938 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691517 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 15 04:25:24.693430 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691520 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 15 04:25:24.693430 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691522 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 15 04:25:24.693430 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691525 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 15 04:25:24.693430 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691528 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 15 04:25:24.693430 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691530 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 15 04:25:24.693430 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691533 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 15 04:25:24.693430 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691536 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 15 04:25:24.693430 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691538 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 15 04:25:24.693430 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691541 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 15 04:25:24.693430 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691543 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 15 04:25:24.693430 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691546 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 15 04:25:24.693430 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691548 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 15 04:25:24.693430 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691551 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 15 04:25:24.693430 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691554 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 15 04:25:24.693430 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691556 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 15 04:25:24.693430 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691559 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 15 04:25:24.693430 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691561 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 15 04:25:24.693430 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691564 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 15 04:25:24.693430 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691568 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 15 04:25:24.693430 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691570 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 15 04:25:24.693928 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691572 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 15 04:25:24.693928 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691575 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 15 04:25:24.693928 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691577 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 15 04:25:24.693928 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691580 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 15 04:25:24.693928 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691584 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 15 04:25:24.693928 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691588 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 15 04:25:24.693928 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691591 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 15 04:25:24.693928 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691593 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 15 04:25:24.693928 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691596 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 15 04:25:24.693928 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691599 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 15 04:25:24.693928 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691601 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 15 04:25:24.693928 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691605 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 15 04:25:24.693928 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691608 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 15 04:25:24.693928 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691610 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 15 04:25:24.693928 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691613 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 15 04:25:24.693928 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691615 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 15 04:25:24.693928 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691618 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 15 04:25:24.693928 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691622 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 15 04:25:24.693928 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691624 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 15 04:25:24.694399 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691627 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 15 04:25:24.694399 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691630 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 15 04:25:24.694399 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691632 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 15 04:25:24.694399 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691635 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 15 04:25:24.694399 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691637 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 15 04:25:24.694399 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691640 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 15 04:25:24.694399 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691643 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 15 04:25:24.694399 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691646 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 15 04:25:24.694399 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691648 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 15 04:25:24.694399 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691652 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 15 04:25:24.694399 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691656 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 15 04:25:24.694399 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691658 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 15 04:25:24.694399 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691662 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 15 04:25:24.694399 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691665 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 15 04:25:24.694399 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691668 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 15 04:25:24.694399 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691670 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 15 04:25:24.694399 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691673 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 15 04:25:24.694399 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691676 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 15 04:25:24.694399 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691678 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 15 04:25:24.694909 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691681 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 15 04:25:24.694909 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691683 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 15 04:25:24.694909 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691686 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 15 04:25:24.694909 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691689 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 15 04:25:24.694909 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691691 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 15 04:25:24.694909 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691695 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 15 04:25:24.694909 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691697 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 15 04:25:24.694909 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691700 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 15 04:25:24.694909 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691703 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 15 04:25:24.694909 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691705 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 15 04:25:24.694909 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691708 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 15 04:25:24.694909 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691710 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 15 04:25:24.694909 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691713 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 15 04:25:24.694909 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691715 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 15 04:25:24.694909 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691718 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 15 04:25:24.694909 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691721 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 15 04:25:24.694909 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691723 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 15 04:25:24.694909 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691726 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 15 04:25:24.694909 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691728 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 15 04:25:24.694909 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691731 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 15 04:25:24.695381 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.691733 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 15 04:25:24.695381 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692111 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 15 04:25:24.695381 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692115 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 15 04:25:24.695381 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692118 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 15 04:25:24.695381 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692121 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 15 04:25:24.695381 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692124 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 15 04:25:24.695381 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692127 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 15 04:25:24.695381 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692130 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 15 04:25:24.695381 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692133 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 15 04:25:24.695381 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692136 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 15 04:25:24.695381 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692138 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 15 04:25:24.695381 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692142 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 15 04:25:24.695381 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692144 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 15 04:25:24.695381 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692147 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 15 04:25:24.695381 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692150 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 15 04:25:24.695381 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692153 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 15 04:25:24.695381 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692155 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 15 04:25:24.695381 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692158 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 15 04:25:24.695381 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692160 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 15 04:25:24.695381 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692163 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 15 04:25:24.695887 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692165 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 15 04:25:24.695887 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692168 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 15 04:25:24.695887 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692170 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 15 04:25:24.695887 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692173 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 15 04:25:24.695887 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692175 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 15 04:25:24.695887 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692178 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 15 04:25:24.695887 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692180 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 15 04:25:24.695887 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692183 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 15 04:25:24.695887 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692186 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 15 04:25:24.695887 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692188 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 15 04:25:24.695887 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692191 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 15 04:25:24.695887 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692193 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 15 04:25:24.695887 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692196 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 15 04:25:24.695887 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692200 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 15 04:25:24.695887 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692203 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 15 04:25:24.695887 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692205 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 15 04:25:24.695887 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692208 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 15 04:25:24.695887 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692210 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 15 04:25:24.695887 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692213 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 15 04:25:24.695887 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692216 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 15 04:25:24.696397 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692219 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 15 04:25:24.696397 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692223 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 15 04:25:24.696397 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692225 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 15 04:25:24.696397 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692228 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 15 04:25:24.696397 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692231 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 15 04:25:24.696397 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692233 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 15 04:25:24.696397 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692236 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 15 04:25:24.696397 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692238 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 15 04:25:24.696397 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692241 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 15 04:25:24.696397 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692243 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 15 04:25:24.696397 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692246 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 15 04:25:24.696397 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692248 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 15 04:25:24.696397 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692251 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 15 04:25:24.696397 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692253 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 15 04:25:24.696397 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692256 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 15 04:25:24.696397 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692258 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 15 04:25:24.696397 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692261 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 15 04:25:24.696397 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692264 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 15 04:25:24.696397 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692266 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 15 04:25:24.696397 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692269 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 15 04:25:24.696926 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692272 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 15 04:25:24.696926 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692274 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 15 04:25:24.696926 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692277 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 15 04:25:24.696926 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692279 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 15 04:25:24.696926 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692281 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 15 04:25:24.696926 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692284 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 15 04:25:24.696926 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692286 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 15 04:25:24.696926 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692289 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 15 04:25:24.696926 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692291 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 15 04:25:24.696926 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692297 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 15 04:25:24.696926 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692300 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 15 04:25:24.696926 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692306 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 15 04:25:24.696926 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692309 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 15 04:25:24.696926 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692311 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 15 04:25:24.696926 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692319 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 15 04:25:24.696926 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692321 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 15 04:25:24.696926 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692324 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 15 04:25:24.696926 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692326 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 15 04:25:24.696926 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692329 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 15 04:25:24.697417 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692332 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 15 04:25:24.697417 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692334 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 15 04:25:24.697417 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692337 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 15 04:25:24.697417 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692340 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 15 04:25:24.697417 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692342 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 15 04:25:24.697417 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692345 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 15 04:25:24.697417 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692348 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 15 04:25:24.697417 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692350 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 15 04:25:24.697417 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692353 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 15 04:25:24.697417 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692356 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 15 04:25:24.697417 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692358 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 15 04:25:24.697417 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692361 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 15 04:25:24.697417 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692363 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 15 04:25:24.697417 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692367 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 15 04:25:24.697417 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692371 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 15 04:25:24.697417 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692374 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 15 04:25:24.697417 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692377 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 15 04:25:24.697417 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692380 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 15 04:25:24.697417 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692382 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 15 04:25:24.697417 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692385 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 15 04:25:24.697908 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.692388 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 15 04:25:24.697908 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692484 2561 flags.go:64] FLAG: --address="0.0.0.0" Jun 15 04:25:24.697908 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692493 2561 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 15 04:25:24.697908 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692501 2561 flags.go:64] FLAG: --anonymous-auth="true" Jun 15 04:25:24.697908 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692505 2561 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 15 04:25:24.697908 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692509 2561 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 15 04:25:24.697908 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692513 2561 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 15 04:25:24.697908 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692518 2561 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 15 04:25:24.697908 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692522 2561 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 15 04:25:24.697908 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692525 2561 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 15 04:25:24.697908 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692528 2561 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 15 04:25:24.697908 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692531 2561 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 15 04:25:24.697908 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692535 2561 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 15 04:25:24.697908 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692537 2561 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 15 04:25:24.697908 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692543 2561 flags.go:64] FLAG: --cgroup-root="" Jun 15 04:25:24.697908 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692546 2561 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 15 04:25:24.697908 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692549 2561 flags.go:64] FLAG: --client-ca-file="" Jun 15 04:25:24.697908 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692552 2561 flags.go:64] FLAG: --cloud-provider="external" Jun 15 04:25:24.697908 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692555 2561 flags.go:64] FLAG: --cluster-dns="[]" Jun 15 04:25:24.697908 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692559 2561 flags.go:64] FLAG: --cluster-domain="" Jun 15 04:25:24.697908 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692562 2561 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 15 04:25:24.697908 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692564 2561 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 15 04:25:24.697908 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692568 2561 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 15 04:25:24.697908 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692571 2561 flags.go:64] FLAG: --container-log-max-files="5" Jun 15 04:25:24.698517 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692574 2561 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 15 04:25:24.698517 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692577 2561 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 15 04:25:24.698517 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692580 2561 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 15 04:25:24.698517 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692584 2561 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 15 04:25:24.698517 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692587 2561 flags.go:64] FLAG: --contention-profiling="false" Jun 15 04:25:24.698517 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692590 2561 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 15 04:25:24.698517 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692593 2561 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 15 04:25:24.698517 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692596 2561 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 15 04:25:24.698517 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692599 2561 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 15 04:25:24.698517 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692603 2561 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 15 04:25:24.698517 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692606 2561 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 15 04:25:24.698517 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692609 2561 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 15 04:25:24.698517 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692611 2561 flags.go:64] FLAG: --enable-load-reader="false" Jun 15 04:25:24.698517 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692614 2561 flags.go:64] FLAG: --enable-server="true" Jun 15 04:25:24.698517 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692618 2561 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 15 04:25:24.698517 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692623 2561 flags.go:64] FLAG: --event-burst="100" Jun 15 04:25:24.698517 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692626 2561 flags.go:64] FLAG: --event-qps="50" Jun 15 04:25:24.698517 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692630 2561 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 15 04:25:24.698517 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692633 2561 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 15 04:25:24.698517 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692636 2561 flags.go:64] FLAG: --eviction-hard="" Jun 15 04:25:24.698517 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692640 2561 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 15 04:25:24.698517 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692643 2561 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 15 04:25:24.698517 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692647 2561 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 15 04:25:24.698517 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692650 2561 flags.go:64] FLAG: --eviction-soft="" Jun 15 04:25:24.698517 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692654 2561 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 15 04:25:24.699122 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692656 2561 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 15 04:25:24.699122 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692659 2561 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 15 04:25:24.699122 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692662 2561 flags.go:64] FLAG: --experimental-mounter-path="" Jun 15 04:25:24.699122 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692665 2561 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 15 04:25:24.699122 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692668 2561 flags.go:64] FLAG: --fail-swap-on="true" Jun 15 04:25:24.699122 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692671 2561 flags.go:64] FLAG: --feature-gates="" Jun 15 04:25:24.699122 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692675 2561 flags.go:64] FLAG: --file-check-frequency="20s" Jun 15 04:25:24.699122 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692678 2561 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 15 04:25:24.699122 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692681 2561 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 15 04:25:24.699122 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692684 2561 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 15 04:25:24.699122 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692687 2561 flags.go:64] FLAG: --healthz-port="10248" Jun 15 04:25:24.699122 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692690 2561 flags.go:64] FLAG: --help="false" Jun 15 04:25:24.699122 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692693 2561 flags.go:64] FLAG: --hostname-override="ip-10-0-140-86.ec2.internal" Jun 15 04:25:24.699122 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692696 2561 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 15 04:25:24.699122 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692699 2561 flags.go:64] FLAG: --http-check-frequency="20s" Jun 15 04:25:24.699122 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692702 2561 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 15 04:25:24.699122 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692705 2561 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 15 04:25:24.699122 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692709 2561 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 15 04:25:24.699122 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692712 2561 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 15 04:25:24.699122 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692715 2561 flags.go:64] FLAG: --image-service-endpoint="" Jun 15 04:25:24.699122 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692718 2561 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 15 04:25:24.699122 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692721 2561 flags.go:64] FLAG: --kube-api-burst="100" Jun 15 04:25:24.699122 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692725 2561 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 15 04:25:24.699744 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692728 2561 flags.go:64] FLAG: --kube-api-qps="50" Jun 15 04:25:24.699744 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692731 2561 flags.go:64] FLAG: --kube-reserved="" Jun 15 04:25:24.699744 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692734 2561 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 15 04:25:24.699744 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692737 2561 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 15 04:25:24.699744 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692740 2561 flags.go:64] FLAG: --kubelet-cgroups="" Jun 15 04:25:24.699744 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692743 2561 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 15 04:25:24.699744 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692747 2561 flags.go:64] FLAG: --lock-file="" Jun 15 04:25:24.699744 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692749 2561 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 15 04:25:24.699744 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692752 2561 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 15 04:25:24.699744 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692755 2561 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 15 04:25:24.699744 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692761 2561 flags.go:64] FLAG: --log-json-split-stream="false" Jun 15 04:25:24.699744 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692764 2561 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 15 04:25:24.699744 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692767 2561 flags.go:64] FLAG: --log-text-split-stream="false" Jun 15 04:25:24.699744 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692770 2561 flags.go:64] FLAG: --logging-format="text" Jun 15 04:25:24.699744 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692772 2561 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 15 04:25:24.699744 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692776 2561 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 15 04:25:24.699744 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692779 2561 flags.go:64] FLAG: --manifest-url="" Jun 15 04:25:24.699744 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692781 2561 flags.go:64] FLAG: --manifest-url-header="" Jun 15 04:25:24.699744 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692786 2561 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 15 04:25:24.699744 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692789 2561 flags.go:64] FLAG: --max-open-files="1000000" Jun 15 04:25:24.699744 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692793 2561 flags.go:64] FLAG: --max-pods="110" Jun 15 04:25:24.699744 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692796 2561 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 15 04:25:24.699744 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692799 2561 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 15 04:25:24.699744 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692802 2561 flags.go:64] FLAG: --memory-manager-policy="None" Jun 15 04:25:24.699744 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692805 2561 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 15 04:25:24.700349 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692808 2561 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 15 04:25:24.700349 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692811 2561 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 15 04:25:24.700349 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692814 2561 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 15 04:25:24.700349 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692821 2561 flags.go:64] FLAG: --node-status-max-images="50" Jun 15 04:25:24.700349 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692824 2561 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 15 04:25:24.700349 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692827 2561 flags.go:64] FLAG: --oom-score-adj="-999" Jun 15 04:25:24.700349 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692830 2561 flags.go:64] FLAG: --pod-cidr="" Jun 15 04:25:24.700349 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692833 2561 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 15 04:25:24.700349 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692839 2561 flags.go:64] FLAG: --pod-manifest-path="" Jun 15 04:25:24.700349 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692841 2561 flags.go:64] FLAG: --pod-max-pids="-1" Jun 15 04:25:24.700349 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692844 2561 flags.go:64] FLAG: --pods-per-core="0" Jun 15 04:25:24.700349 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692847 2561 flags.go:64] FLAG: --port="10250" Jun 15 04:25:24.700349 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692850 2561 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 15 04:25:24.700349 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692857 2561 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-09960563367af5630" Jun 15 04:25:24.700349 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692860 2561 flags.go:64] FLAG: --qos-reserved="" Jun 15 04:25:24.700349 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692863 2561 flags.go:64] FLAG: --read-only-port="10255" Jun 15 04:25:24.700349 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692866 2561 flags.go:64] FLAG: --register-node="true" Jun 15 04:25:24.700349 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692869 2561 flags.go:64] FLAG: --register-with-taints="" Jun 15 04:25:24.700349 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692873 2561 flags.go:64] FLAG: --registry-burst="10" Jun 15 04:25:24.700349 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692876 2561 flags.go:64] FLAG: --registry-qps="5" Jun 15 04:25:24.700349 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692879 2561 flags.go:64] FLAG: --reserved-cpus="" Jun 15 04:25:24.700349 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692881 2561 flags.go:64] FLAG: --reserved-memory="" Jun 15 04:25:24.700349 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692885 2561 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 15 04:25:24.700349 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692888 2561 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 15 04:25:24.700349 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692891 2561 flags.go:64] FLAG: --rotate-certificates="false" Jun 15 04:25:24.701211 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692894 2561 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 15 04:25:24.701211 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692897 2561 flags.go:64] FLAG: --runonce="false" Jun 15 04:25:24.701211 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692900 2561 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 15 04:25:24.701211 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692902 2561 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 15 04:25:24.701211 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692905 2561 flags.go:64] FLAG: --seccomp-default="false" Jun 15 04:25:24.701211 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692908 2561 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 15 04:25:24.701211 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692911 2561 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 15 04:25:24.701211 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692914 2561 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 15 04:25:24.701211 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692917 2561 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 15 04:25:24.701211 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692920 2561 flags.go:64] FLAG: --storage-driver-password="root" Jun 15 04:25:24.701211 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692922 2561 flags.go:64] FLAG: --storage-driver-secure="false" Jun 15 04:25:24.701211 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692925 2561 flags.go:64] FLAG: --storage-driver-table="stats" Jun 15 04:25:24.701211 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692929 2561 flags.go:64] FLAG: --storage-driver-user="root" Jun 15 04:25:24.701211 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692932 2561 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 15 04:25:24.701211 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692935 2561 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 15 04:25:24.701211 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692939 2561 flags.go:64] FLAG: --system-cgroups="" Jun 15 04:25:24.701211 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692942 2561 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 15 04:25:24.701211 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692947 2561 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 15 04:25:24.701211 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692950 2561 flags.go:64] FLAG: --tls-cert-file="" Jun 15 04:25:24.701211 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692953 2561 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 15 04:25:24.701211 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692959 2561 flags.go:64] FLAG: --tls-min-version="" Jun 15 04:25:24.701211 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692962 2561 flags.go:64] FLAG: --tls-private-key-file="" Jun 15 04:25:24.701211 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692964 2561 flags.go:64] FLAG: --topology-manager-policy="none" Jun 15 04:25:24.701211 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692967 2561 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 15 04:25:24.701211 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692970 2561 flags.go:64] FLAG: --topology-manager-scope="container" Jun 15 04:25:24.702099 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692973 2561 flags.go:64] FLAG: --v="2" Jun 15 04:25:24.702099 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692977 2561 flags.go:64] FLAG: --version="false" Jun 15 04:25:24.702099 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692981 2561 flags.go:64] FLAG: --vmodule="" Jun 15 04:25:24.702099 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692985 2561 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 15 04:25:24.702099 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.692988 2561 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 15 04:25:24.702099 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693103 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 15 04:25:24.702099 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693106 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 15 04:25:24.702099 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693109 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 15 04:25:24.702099 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693112 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 15 04:25:24.702099 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693114 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 15 04:25:24.702099 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693117 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 15 04:25:24.702099 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693120 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 15 04:25:24.702099 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693122 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 15 04:25:24.702099 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693125 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 15 04:25:24.702099 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693128 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 15 04:25:24.702099 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693130 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 15 04:25:24.702099 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693133 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 15 04:25:24.702099 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693136 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 15 04:25:24.702099 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693138 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 15 04:25:24.702099 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693142 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 15 04:25:24.702099 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693145 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 15 04:25:24.702704 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693148 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 15 04:25:24.702704 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693150 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 15 04:25:24.702704 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693153 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 15 04:25:24.702704 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693156 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 15 04:25:24.702704 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693159 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 15 04:25:24.702704 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693161 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 15 04:25:24.702704 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693165 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 15 04:25:24.702704 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693168 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 15 04:25:24.702704 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693171 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 15 04:25:24.702704 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693173 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 15 04:25:24.702704 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693176 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 15 04:25:24.702704 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693178 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 15 04:25:24.702704 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693181 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 15 04:25:24.702704 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693183 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 15 04:25:24.702704 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693186 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 15 04:25:24.702704 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693188 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 15 04:25:24.702704 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693191 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 15 04:25:24.702704 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693193 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 15 04:25:24.702704 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693196 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 15 04:25:24.703171 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693199 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 15 04:25:24.703171 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693201 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 15 04:25:24.703171 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693204 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 15 04:25:24.703171 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693206 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 15 04:25:24.703171 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693209 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 15 04:25:24.703171 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693212 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 15 04:25:24.703171 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693214 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 15 04:25:24.703171 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693217 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 15 04:25:24.703171 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693219 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 15 04:25:24.703171 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693222 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 15 04:25:24.703171 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693224 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 15 04:25:24.703171 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693229 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 15 04:25:24.703171 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693231 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 15 04:25:24.703171 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693234 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 15 04:25:24.703171 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693236 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 15 04:25:24.703171 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693239 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 15 04:25:24.703171 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693242 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 15 04:25:24.703171 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693246 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 15 04:25:24.703171 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693249 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 15 04:25:24.703670 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693253 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 15 04:25:24.703670 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693256 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 15 04:25:24.703670 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693258 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 15 04:25:24.703670 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693261 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 15 04:25:24.703670 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693263 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 15 04:25:24.703670 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693266 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 15 04:25:24.703670 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693269 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 15 04:25:24.703670 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693272 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 15 04:25:24.703670 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693276 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 15 04:25:24.703670 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693279 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 15 04:25:24.703670 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693282 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 15 04:25:24.703670 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693285 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 15 04:25:24.703670 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693288 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 15 04:25:24.703670 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693291 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 15 04:25:24.703670 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693294 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 15 04:25:24.703670 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693297 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 15 04:25:24.703670 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693300 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 15 04:25:24.703670 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693303 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 15 04:25:24.703670 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693305 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 15 04:25:24.704131 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693308 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 15 04:25:24.704131 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693310 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 15 04:25:24.704131 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693313 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 15 04:25:24.704131 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693315 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 15 04:25:24.704131 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693318 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 15 04:25:24.704131 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693322 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 15 04:25:24.704131 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693325 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 15 04:25:24.704131 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693327 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 15 04:25:24.704131 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693330 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 15 04:25:24.704131 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693332 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 15 04:25:24.704131 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693335 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 15 04:25:24.704131 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693337 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 15 04:25:24.704131 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693340 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 15 04:25:24.704131 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693344 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 15 04:25:24.704131 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693347 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 15 04:25:24.704131 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693349 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 15 04:25:24.704131 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693352 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 15 04:25:24.704131 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693354 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 15 04:25:24.704131 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693357 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 15 04:25:24.704131 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693359 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 15 04:25:24.704627 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693362 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 15 04:25:24.704627 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693364 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 15 04:25:24.704627 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693367 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 15 04:25:24.704627 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693371 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 15 04:25:24.704627 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693374 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 15 04:25:24.704627 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.693377 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 15 04:25:24.704627 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.693785 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 15 04:25:24.704627 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.699939 2561 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 15 04:25:24.704627 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.699955 2561 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 15 04:25:24.704627 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.699975 2561 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 15 04:25:24.704627 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.699981 2561 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 15 04:25:24.704627 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700037 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 15 04:25:24.704627 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700041 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 15 04:25:24.704627 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700045 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 15 04:25:24.704627 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700048 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 15 04:25:24.705001 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700051 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 15 04:25:24.705001 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700054 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 15 04:25:24.705001 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700058 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 15 04:25:24.705001 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700063 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 15 04:25:24.705001 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700066 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 15 04:25:24.705001 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700069 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 15 04:25:24.705001 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700073 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 15 04:25:24.705001 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700076 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 15 04:25:24.705001 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700079 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 15 04:25:24.705001 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700083 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 15 04:25:24.705001 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700086 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 15 04:25:24.705001 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700089 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 15 04:25:24.705001 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700091 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 15 04:25:24.705001 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700094 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 15 04:25:24.705001 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700097 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 15 04:25:24.705001 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700100 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 15 04:25:24.705001 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700103 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 15 04:25:24.705001 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700106 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 15 04:25:24.705001 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700108 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 15 04:25:24.705486 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700111 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 15 04:25:24.705486 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700114 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 15 04:25:24.705486 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700116 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 15 04:25:24.705486 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700119 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 15 04:25:24.705486 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700122 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 15 04:25:24.705486 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700125 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 15 04:25:24.705486 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700129 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 15 04:25:24.705486 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700132 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 15 04:25:24.705486 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700134 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 15 04:25:24.705486 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700137 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 15 04:25:24.705486 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700140 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 15 04:25:24.705486 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700142 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 15 04:25:24.705486 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700145 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 15 04:25:24.705486 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700147 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 15 04:25:24.705486 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700150 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 15 04:25:24.705486 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700153 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 15 04:25:24.705486 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700155 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 15 04:25:24.705486 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700159 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 15 04:25:24.705486 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700163 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 15 04:25:24.705960 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700166 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 15 04:25:24.705960 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700170 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 15 04:25:24.705960 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700173 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 15 04:25:24.705960 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700177 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 15 04:25:24.705960 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700179 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 15 04:25:24.705960 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700182 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 15 04:25:24.705960 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700185 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 15 04:25:24.705960 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700187 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 15 04:25:24.705960 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700190 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 15 04:25:24.705960 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700192 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 15 04:25:24.705960 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700195 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 15 04:25:24.705960 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700198 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 15 04:25:24.705960 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700201 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 15 04:25:24.705960 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700204 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 15 04:25:24.705960 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700206 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 15 04:25:24.705960 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700209 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 15 04:25:24.705960 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700212 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 15 04:25:24.705960 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700214 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 15 04:25:24.705960 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700217 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 15 04:25:24.706448 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700220 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 15 04:25:24.706448 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700224 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 15 04:25:24.706448 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700226 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 15 04:25:24.706448 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700229 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 15 04:25:24.706448 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700231 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 15 04:25:24.706448 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700234 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 15 04:25:24.706448 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700237 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 15 04:25:24.706448 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700239 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 15 04:25:24.706448 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700242 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 15 04:25:24.706448 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700245 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 15 04:25:24.706448 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700247 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 15 04:25:24.706448 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700250 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 15 04:25:24.706448 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700252 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 15 04:25:24.706448 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700255 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 15 04:25:24.706448 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700258 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 15 04:25:24.706448 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700260 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 15 04:25:24.706448 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700263 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 15 04:25:24.706448 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700265 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 15 04:25:24.706448 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700268 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 15 04:25:24.706448 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700270 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 15 04:25:24.706950 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700273 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 15 04:25:24.706950 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700275 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 15 04:25:24.706950 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700278 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 15 04:25:24.706950 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700280 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 15 04:25:24.706950 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700283 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 15 04:25:24.706950 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700286 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 15 04:25:24.706950 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700288 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 15 04:25:24.706950 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700291 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 15 04:25:24.706950 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700293 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 15 04:25:24.706950 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700296 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 15 04:25:24.706950 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700298 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 15 04:25:24.706950 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700301 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 15 04:25:24.706950 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700304 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 15 04:25:24.706950 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700307 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 15 04:25:24.706950 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700310 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 15 04:25:24.706950 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700312 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 15 04:25:24.706950 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700315 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 15 04:25:24.706950 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700318 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 15 04:25:24.707538 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.700323 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 15 04:25:24.707538 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700453 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 15 04:25:24.707538 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700459 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 15 04:25:24.707538 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700463 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 15 04:25:24.707538 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700466 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 15 04:25:24.707538 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700469 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 15 04:25:24.707538 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700472 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 15 04:25:24.707538 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700475 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 15 04:25:24.707538 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700478 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 15 04:25:24.707538 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700481 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 15 04:25:24.707538 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700484 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 15 04:25:24.707538 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700487 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 15 04:25:24.707538 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700490 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 15 04:25:24.707538 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700493 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 15 04:25:24.707538 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700495 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 15 04:25:24.707910 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700498 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 15 04:25:24.707910 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700501 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 15 04:25:24.707910 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700503 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 15 04:25:24.707910 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700506 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 15 04:25:24.707910 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700509 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 15 04:25:24.707910 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700512 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 15 04:25:24.707910 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700515 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 15 04:25:24.707910 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700517 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 15 04:25:24.707910 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700520 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 15 04:25:24.707910 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700522 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 15 04:25:24.707910 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700525 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 15 04:25:24.707910 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700528 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 15 04:25:24.707910 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700530 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 15 04:25:24.707910 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700533 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 15 04:25:24.707910 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700536 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 15 04:25:24.707910 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700612 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 15 04:25:24.707910 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700618 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 15 04:25:24.707910 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700621 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 15 04:25:24.707910 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700623 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 15 04:25:24.707910 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700626 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 15 04:25:24.708400 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700629 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 15 04:25:24.708400 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700632 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 15 04:25:24.708400 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700634 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 15 04:25:24.708400 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700638 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 15 04:25:24.708400 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700642 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 15 04:25:24.708400 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.700648 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 15 04:25:24.708400 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.701178 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 15 04:25:24.708400 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.701189 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 15 04:25:24.708400 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.701195 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 15 04:25:24.708400 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.701201 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 15 04:25:24.708400 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.701206 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 15 04:25:24.708400 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.701211 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 15 04:25:24.708400 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.701216 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 15 04:25:24.708400 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.701221 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 15 04:25:24.708400 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.701225 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 15 04:25:24.708400 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.701233 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 15 04:25:24.708400 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.701240 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 15 04:25:24.708400 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.701252 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 15 04:25:24.708400 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.701258 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 15 04:25:24.708879 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.701262 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 15 04:25:24.708879 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.701266 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 15 04:25:24.708879 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.701271 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 15 04:25:24.708879 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.701275 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 15 04:25:24.708879 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.701280 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 15 04:25:24.708879 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.701284 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 15 04:25:24.708879 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.701288 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 15 04:25:24.708879 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.701292 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 15 04:25:24.708879 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.701296 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 15 04:25:24.708879 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.701300 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 15 04:25:24.708879 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.701304 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 15 04:25:24.708879 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.701313 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 15 04:25:24.708879 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.701317 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 15 04:25:24.708879 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.701321 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 15 04:25:24.708879 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.701325 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 15 04:25:24.708879 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.701330 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 15 04:25:24.708879 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.701335 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 15 04:25:24.708879 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.701339 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 15 04:25:24.708879 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.701343 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 15 04:25:24.708879 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.701347 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 15 04:25:24.709365 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.701353 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 15 04:25:24.709365 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.701358 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 15 04:25:24.709365 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.701363 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 15 04:25:24.709365 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.701367 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 15 04:25:24.709365 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.701375 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 15 04:25:24.709365 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.701379 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 15 04:25:24.709365 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.701383 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 15 04:25:24.709365 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.701388 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 15 04:25:24.709365 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.701392 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 15 04:25:24.709365 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.701396 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 15 04:25:24.709365 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.701401 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 15 04:25:24.709365 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.701405 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 15 04:25:24.709365 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.701409 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 15 04:25:24.709365 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.701413 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 15 04:25:24.709365 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.701417 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 15 04:25:24.709365 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.701421 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 15 04:25:24.709365 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.701430 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 15 04:25:24.709365 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.701452 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 15 04:25:24.709365 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.701457 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 15 04:25:24.709365 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.701461 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 15 04:25:24.709883 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.701465 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 15 04:25:24.709883 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.701469 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 15 04:25:24.709883 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.701473 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 15 04:25:24.709883 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.701478 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 15 04:25:24.709883 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.701482 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 15 04:25:24.709883 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:24.701487 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 15 04:25:24.709883 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.701495 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 15 04:25:24.709883 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.701779 2561 server.go:962] "Client rotation is on, will bootstrap in background" Jun 15 04:25:24.709883 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.703757 2561 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 15 04:25:24.709883 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.704827 2561 server.go:1019] "Starting client certificate rotation" Jun 15 04:25:24.709883 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.704924 2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 15 04:25:24.709883 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.704960 2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 15 04:25:24.709883 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.706954 2561 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 15 04:25:24.710223 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.708129 2561 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 15 04:25:24.716789 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.716770 2561 log.go:25] "Validated CRI v1 runtime API" Jun 15 04:25:24.720324 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.720308 2561 log.go:25] "Validated CRI v1 image API" Jun 15 04:25:24.721099 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.721087 2561 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 15 04:25:24.723243 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.723220 2561 fs.go:135] Filesystem UUIDs: map[20cd4413-2997-42ed-88f7-afeef1ec7549:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 9fd9fa44-ce3b-44a2-b034-1437abe8fdb6:/dev/nvme0n1p3] Jun 15 04:25:24.723335 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.723240 2561 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 15 04:25:24.728598 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.728489 2561 manager.go:216] Machine: {Timestamp:2026-06-15 04:25:24.727533584 +0000 UTC m=+0.255524480 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3097862 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a39c9f379449cef829c08ae65975d SystemUUID:ec2a39c9-f379-449c-ef82-9c08ae65975d BootID:fda0fbd8-cfdb-450d-8f53-092f0865ce38 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f2:bc:69:4f:8f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f2:bc:69:4f:8f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:2a:65:ec:30:4c:e9 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 15 04:25:24.728598 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.728591 2561 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 15 04:25:24.728756 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.728725 2561 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 15 04:25:24.729593 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.729565 2561 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 15 04:25:24.729727 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.729595 2561 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-86.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 15 04:25:24.730193 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.730183 2561 topology_manager.go:138] "Creating topology manager with none policy" Jun 15 04:25:24.730231 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.730196 2561 container_manager_linux.go:309] "Creating device plugin manager" Jun 15 04:25:24.730231 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.730203 2561 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 15 04:25:24.730665 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.730654 2561 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 15 04:25:24.731775 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.731765 2561 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 15 04:25:24.734041 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.734021 2561 state_mem.go:36] "Initialized new in-memory state store" Jun 15 04:25:24.734159 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.734150 2561 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 15 04:25:24.734189 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.734178 2561 kubelet.go:486] "Attempting to sync node with API server" Jun 15 04:25:24.734216 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.734197 2561 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 15 04:25:24.734216 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.734208 2561 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 15 04:25:24.734273 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.734222 2561 kubelet.go:398] "Adding apiserver pod source" Jun 15 04:25:24.734273 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.734234 2561 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 15 04:25:24.734828 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.734809 2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 15 04:25:24.734913 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.734836 2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 15 04:25:24.735901 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.735874 2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 15 04:25:24.737796 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.737777 2561 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 15 04:25:24.739512 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.739487 2561 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 15 04:25:24.739580 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.739528 2561 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 15 04:25:24.740082 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.740070 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 15 04:25:24.740118 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.740086 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 15 04:25:24.740118 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.740093 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 15 04:25:24.740118 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.740098 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 15 04:25:24.740118 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.740107 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 15 04:25:24.740118 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.740112 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 15 04:25:24.740253 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.740121 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 15 04:25:24.740253 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.740126 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 15 04:25:24.740253 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.740133 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 15 04:25:24.740253 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.740139 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 15 04:25:24.740253 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.740148 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 15 04:25:24.740253 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.740153 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 15 04:25:24.740647 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.740635 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 15 04:25:24.740647 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.740648 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 15 04:25:24.744323 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.744307 2561 server.go:1268] "Started kubelet" Jun 15 04:25:24.744449 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.744384 2561 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 15 04:25:24.744519 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.744480 2561 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 15 04:25:24.744567 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.744508 2561 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 15 04:25:24.744897 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:24.744873 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-86.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 15 04:25:24.745024 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:24.744936 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 15 04:25:24.745125 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.745099 2561 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-86.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 15 04:25:24.745376 ip-10-0-140-86 systemd[1]: Started Kubernetes Kubelet. Jun 15 04:25:24.746703 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.746688 2561 server.go:310] "Adding debug handlers to kubelet server" Jun 15 04:25:24.748923 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.748905 2561 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 15 04:25:24.750449 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:24.750410 2561 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 15 04:25:24.752051 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:24.751377 2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-86.ec2.internal.18b9268f5a9ec6ff default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-86.ec2.internal,UID:ip-10-0-140-86.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-86.ec2.internal,},FirstTimestamp:2026-06-15 04:25:24.744275711 +0000 UTC m=+0.272266608,LastTimestamp:2026-06-15 04:25:24.744275711 +0000 UTC m=+0.272266608,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-86.ec2.internal,}" Jun 15 04:25:24.752810 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.752797 2561 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 15 04:25:24.752886 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:24.752874 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-86.ec2.internal\" not found" Jun 15 04:25:24.753134 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.752993 2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 15 04:25:24.753303 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.753284 2561 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 15 04:25:24.753379 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.753287 2561 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 15 04:25:24.753379 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.753317 2561 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 15 04:25:24.753499 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.753433 2561 reconstruct.go:97] "Volume reconstruction finished" Jun 15 04:25:24.753499 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.753471 2561 reconciler.go:29] "Reconciler: start to sync state" Jun 15 04:25:24.753697 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.753681 2561 factory.go:55] Registering systemd factory Jun 15 04:25:24.753697 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.753700 2561 factory.go:223] Registration of the systemd container factory successfully Jun 15 04:25:24.753906 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.753888 2561 factory.go:153] Registering CRI-O factory Jun 15 04:25:24.753906 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.753907 2561 factory.go:223] Registration of the crio container factory successfully Jun 15 04:25:24.754053 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.753957 2561 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 15 04:25:24.754053 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.753977 2561 factory.go:103] Registering Raw factory Jun 15 04:25:24.754053 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.753990 2561 manager.go:1196] Started watching for new ooms in manager Jun 15 04:25:24.754391 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.754379 2561 manager.go:349] Starting recovery of all containers Jun 15 04:25:24.754744 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:24.754715 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 15 04:25:24.754850 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:24.754826 2561 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-86.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 15 04:25:24.754999 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.754978 2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9gk24" Jun 15 04:25:24.759738 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.759633 2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9gk24" Jun 15 04:25:24.767268 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.767100 2561 manager.go:354] Recovery completed Jun 15 04:25:24.771994 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.771981 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 04:25:24.774080 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.774063 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-86.ec2.internal" event="NodeHasSufficientMemory" Jun 15 04:25:24.774144 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.774092 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-86.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 04:25:24.774144 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.774103 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-86.ec2.internal" event="NodeHasSufficientPID" Jun 15 04:25:24.774729 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.774715 2561 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 15 04:25:24.774729 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.774725 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 04:25:24.774729 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.774730 2561 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 15 04:25:24.774900 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.774748 2561 state_mem.go:36] "Initialized new in-memory state store" Jun 15 04:25:24.775365 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.775351 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-86.ec2.internal" event="NodeHasSufficientMemory" Jun 15 04:25:24.775426 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.775375 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-86.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 04:25:24.775426 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.775386 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-86.ec2.internal" event="NodeHasSufficientPID" Jun 15 04:25:24.775949 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.775936 2561 policy_none.go:49] "None policy: Start" Jun 15 04:25:24.776009 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.775953 2561 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 15 04:25:24.776009 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.775963 2561 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 15 04:25:24.776914 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.776904 2561 policy_none.go:47] "Start" Jun 15 04:25:24.831039 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.816974 2561 manager.go:337] "Starting Device Plugin manager" Jun 15 04:25:24.831039 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:24.817009 2561 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 15 04:25:24.831039 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.817022 2561 server.go:87] "Starting device plugin registration server" Jun 15 04:25:24.831039 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.817273 2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 15 04:25:24.831039 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.817288 2561 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 15 04:25:24.831039 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.817299 2561 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 15 04:25:24.831039 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.817400 2561 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 15 04:25:24.831039 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.817509 2561 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 15 04:25:24.831039 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.817517 2561 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 15 04:25:24.831039 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:24.818143 2561 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 15 04:25:24.831039 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:24.818232 2561 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-86.ec2.internal\" not found" Jun 15 04:25:24.831039 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.818837 2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 15 04:25:24.831039 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.818870 2561 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 15 04:25:24.831039 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.818889 2561 kubelet.go:2448] "Starting kubelet main sync loop" Jun 15 04:25:24.831039 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:24.818917 2561 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 15 04:25:24.831039 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.821249 2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 15 04:25:24.917673 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.917646 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 04:25:24.919023 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.919001 2561 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-86.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-86.ec2.internal"] Jun 15 04:25:24.919097 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.919078 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 04:25:24.919404 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.919385 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-86.ec2.internal" event="NodeHasSufficientMemory" Jun 15 04:25:24.919512 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.919412 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-86.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 04:25:24.919512 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.919455 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-86.ec2.internal" event="NodeHasSufficientPID" Jun 15 04:25:24.919512 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.919487 2561 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-86.ec2.internal" Jun 15 04:25:24.919934 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.919915 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-86.ec2.internal" event="NodeHasSufficientMemory" Jun 15 04:25:24.920057 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.919940 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-86.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 04:25:24.920057 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.919949 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-86.ec2.internal" event="NodeHasSufficientPID" Jun 15 04:25:24.922314 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.922301 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 04:25:24.922472 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.922457 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-86.ec2.internal" Jun 15 04:25:24.922507 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.922492 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 04:25:24.923070 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.923056 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-86.ec2.internal" event="NodeHasSufficientMemory" Jun 15 04:25:24.923070 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.923062 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-86.ec2.internal" event="NodeHasSufficientMemory" Jun 15 04:25:24.923182 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.923079 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-86.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 04:25:24.923182 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.923080 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-86.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 04:25:24.923182 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.923087 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-86.ec2.internal" event="NodeHasSufficientPID" Jun 15 04:25:24.923182 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.923107 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-86.ec2.internal" event="NodeHasSufficientPID" Jun 15 04:25:24.925360 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.925344 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-86.ec2.internal" Jun 15 04:25:24.925468 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.925367 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 04:25:24.925540 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.925489 2561 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-86.ec2.internal" Jun 15 04:25:24.925540 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:24.925503 2561 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-86.ec2.internal\": node \"ip-10-0-140-86.ec2.internal\" not found" Jun 15 04:25:24.933549 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.933535 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-86.ec2.internal" event="NodeHasSufficientMemory" Jun 15 04:25:24.933629 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.933558 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-86.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 04:25:24.933629 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.933567 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-86.ec2.internal" event="NodeHasSufficientPID" Jun 15 04:25:24.938920 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:24.938882 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-86.ec2.internal\" not found" Jun 15 04:25:24.945022 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:24.945006 2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-86.ec2.internal\" not found" node="ip-10-0-140-86.ec2.internal" Jun 15 04:25:24.950871 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:24.950857 2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-86.ec2.internal\" not found" node="ip-10-0-140-86.ec2.internal" Jun 15 04:25:24.955053 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.955028 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bc443d1de53648cc2bff6103f22bd3b8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-86.ec2.internal\" (UID: \"bc443d1de53648cc2bff6103f22bd3b8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-86.ec2.internal" Jun 15 04:25:24.955131 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.955076 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e70cbef6b93985193b629bb99223d30c-config\") pod \"kube-apiserver-proxy-ip-10-0-140-86.ec2.internal\" (UID: \"e70cbef6b93985193b629bb99223d30c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-86.ec2.internal" Jun 15 04:25:24.955131 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:24.955115 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bc443d1de53648cc2bff6103f22bd3b8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-86.ec2.internal\" (UID: \"bc443d1de53648cc2bff6103f22bd3b8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-86.ec2.internal" Jun 15 04:25:25.039944 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:25.039914 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-86.ec2.internal\" not found" Jun 15 04:25:25.056126 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:25.056099 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bc443d1de53648cc2bff6103f22bd3b8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-86.ec2.internal\" (UID: \"bc443d1de53648cc2bff6103f22bd3b8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-86.ec2.internal" Jun 15 04:25:25.056241 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:25.056136 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bc443d1de53648cc2bff6103f22bd3b8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-86.ec2.internal\" (UID: \"bc443d1de53648cc2bff6103f22bd3b8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-86.ec2.internal" Jun 15 04:25:25.056241 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:25.056153 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e70cbef6b93985193b629bb99223d30c-config\") pod \"kube-apiserver-proxy-ip-10-0-140-86.ec2.internal\" (UID: \"e70cbef6b93985193b629bb99223d30c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-86.ec2.internal" Jun 15 04:25:25.056241 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:25.056209 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bc443d1de53648cc2bff6103f22bd3b8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-86.ec2.internal\" (UID: \"bc443d1de53648cc2bff6103f22bd3b8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-86.ec2.internal" Jun 15 04:25:25.056388 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:25.056238 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bc443d1de53648cc2bff6103f22bd3b8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-86.ec2.internal\" (UID: \"bc443d1de53648cc2bff6103f22bd3b8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-86.ec2.internal" Jun 15 04:25:25.056388 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:25.056217 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e70cbef6b93985193b629bb99223d30c-config\") pod \"kube-apiserver-proxy-ip-10-0-140-86.ec2.internal\" (UID: \"e70cbef6b93985193b629bb99223d30c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-86.ec2.internal" Jun 15 04:25:25.140660 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:25.140628 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-86.ec2.internal\" not found" Jun 15 04:25:25.241478 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:25.241392 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-86.ec2.internal\" not found" Jun 15 04:25:25.247580 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:25.247563 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-86.ec2.internal" Jun 15 04:25:25.253155 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:25.253134 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-86.ec2.internal" Jun 15 04:25:25.342400 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:25.342369 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-86.ec2.internal\" not found" Jun 15 04:25:25.442881 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:25.442855 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-86.ec2.internal\" not found" Jun 15 04:25:25.543380 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:25.543307 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-86.ec2.internal\" not found" Jun 15 04:25:25.643845 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:25.643809 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-86.ec2.internal\" not found" Jun 15 04:25:25.704253 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:25.704226 2561 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 15 04:25:25.704933 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:25.704389 2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 15 04:25:25.732213 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:25.732183 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc443d1de53648cc2bff6103f22bd3b8.slice/crio-48a721152b23132c47cd95470af717de7aa5b862c214d4518c778a048a2eca86 WatchSource:0}: Error finding container 48a721152b23132c47cd95470af717de7aa5b862c214d4518c778a048a2eca86: Status 404 returned error can't find the container with id 48a721152b23132c47cd95470af717de7aa5b862c214d4518c778a048a2eca86 Jun 15 04:25:25.732513 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:25.732491 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode70cbef6b93985193b629bb99223d30c.slice/crio-72c7dc03d5bb286e984ca1e50ec7a55e53b2a3a6e2b51d5a14daadb5b33fe787 WatchSource:0}: Error finding container 72c7dc03d5bb286e984ca1e50ec7a55e53b2a3a6e2b51d5a14daadb5b33fe787: Status 404 returned error can't find the container with id 72c7dc03d5bb286e984ca1e50ec7a55e53b2a3a6e2b51d5a14daadb5b33fe787 Jun 15 04:25:25.735813 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:25.735793 2561 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 15 04:25:25.739249 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:25.739233 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 15 04:25:25.743935 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:25.743918 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-86.ec2.internal\" not found" Jun 15 04:25:25.764849 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:25.764820 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-14 04:20:24 +0000 UTC" deadline="2028-02-06 10:49:43.808192609 +0000 UTC" Jun 15 04:25:25.764849 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:25.764843 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14430h24m18.043351978s" Jun 15 04:25:25.823485 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:25.823379 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-86.ec2.internal" event={"ID":"bc443d1de53648cc2bff6103f22bd3b8","Type":"ContainerStarted","Data":"48a721152b23132c47cd95470af717de7aa5b862c214d4518c778a048a2eca86"} Jun 15 04:25:25.824367 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:25.824345 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-86.ec2.internal" event={"ID":"e70cbef6b93985193b629bb99223d30c","Type":"ContainerStarted","Data":"72c7dc03d5bb286e984ca1e50ec7a55e53b2a3a6e2b51d5a14daadb5b33fe787"} Jun 15 04:25:25.825481 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:25.825467 2561 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 15 04:25:25.853925 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:25.853904 2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-86.ec2.internal" Jun 15 04:25:25.864409 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:25.864387 2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 15 04:25:25.865220 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:25.865206 2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-86.ec2.internal" Jun 15 04:25:25.873334 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:25.873316 2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 15 04:25:26.089906 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.089828 2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 15 04:25:26.735509 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.735478 2561 apiserver.go:52] "Watching apiserver" Jun 15 04:25:26.740971 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.740949 2561 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 15 04:25:26.742024 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.741995 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-4vqz4","openshift-network-diagnostics/network-check-target-qwgsn","openshift-ovn-kubernetes/ovnkube-node-8fqkk","kube-system/kube-apiserver-proxy-ip-10-0-140-86.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8vqzk","openshift-cluster-node-tuning-operator/tuned-5d7nq","openshift-image-registry/node-ca-96sfm","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-86.ec2.internal","openshift-multus/multus-dtzbz","openshift-network-operator/iptables-alerter-kfmj5","kube-system/global-pull-secret-syncer-ng2rb","kube-system/konnectivity-agent-jpvfh","openshift-dns/node-resolver-4znw7","openshift-multus/multus-additional-cni-plugins-b8vpm"] Jun 15 04:25:26.744526 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.744504 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-96sfm" Jun 15 04:25:26.746401 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.746378 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 15 04:25:26.746516 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.746451 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 15 04:25:26.746516 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.746458 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-dltqv\"" Jun 15 04:25:26.746617 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.746382 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 15 04:25:26.746742 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.746723 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qwgsn" Jun 15 04:25:26.746844 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:26.746793 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qwgsn" podUID="990077c4-c49d-4ae5-b011-c77744e70ea9" Jun 15 04:25:26.748943 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.748923 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-b8vpm" Jun 15 04:25:26.751017 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.750971 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 15 04:25:26.751278 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.751235 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vqz4" Jun 15 04:25:26.751372 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:26.751301 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vqz4" podUID="87abfa61-f00e-4746-9e96-f6940cbec767" Jun 15 04:25:26.751607 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.751586 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 15 04:25:26.751705 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.751623 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 15 04:25:26.751765 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.751739 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-xfr75\"" Jun 15 04:25:26.752109 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.751781 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 15 04:25:26.752109 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.751879 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 15 04:25:26.753805 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.753776 2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 15 04:25:26.753896 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.753863 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8vqzk" Jun 15 04:25:26.755536 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.755507 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 15 04:25:26.755630 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.755581 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 15 04:25:26.755630 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.755610 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 15 04:25:26.755738 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.755585 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-kpwvd\"" Jun 15 04:25:26.755962 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.755947 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jpvfh" Jun 15 04:25:26.757822 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.757805 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 15 04:25:26.757907 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.757865 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-mz9pd\"" Jun 15 04:25:26.757971 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.757945 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 15 04:25:26.758228 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.758211 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dtzbz" Jun 15 04:25:26.759902 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.759847 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-lgsvr\"" Jun 15 04:25:26.760583 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.760143 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 15 04:25:26.761484 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.761466 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kfmj5" Jun 15 04:25:26.764175 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.763867 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 15 04:25:26.765280 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.764566 2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 15 04:25:26.765280 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.764611 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-5q4x9\"" Jun 15 04:25:26.765280 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.764718 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ng2rb" Jun 15 04:25:26.765280 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.764748 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 15 04:25:26.765280 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.764760 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/73584bd0-85a5-4723-9271-4bca267f7b7a-etc-selinux\") pod \"aws-ebs-csi-driver-node-8vqzk\" (UID: \"73584bd0-85a5-4723-9271-4bca267f7b7a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8vqzk" Jun 15 04:25:26.765280 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:26.764781 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ng2rb" podUID="78c7be15-9916-443f-8d76-29dc1412a6ce" Jun 15 04:25:26.765280 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.764814 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8djqm\" (UniqueName: \"kubernetes.io/projected/73584bd0-85a5-4723-9271-4bca267f7b7a-kube-api-access-8djqm\") pod \"aws-ebs-csi-driver-node-8vqzk\" (UID: \"73584bd0-85a5-4723-9271-4bca267f7b7a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8vqzk" Jun 15 04:25:26.765280 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.764846 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbsgq\" (UniqueName: \"kubernetes.io/projected/90fa004f-1d43-402a-8a68-a5147aea49e6-kube-api-access-wbsgq\") pod \"node-ca-96sfm\" (UID: \"90fa004f-1d43-402a-8a68-a5147aea49e6\") " pod="openshift-image-registry/node-ca-96sfm" Jun 15 04:25:26.765280 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.764860 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 15 04:25:26.765280 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.764880 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5zjq\" (UniqueName: \"kubernetes.io/projected/990077c4-c49d-4ae5-b011-c77744e70ea9-kube-api-access-l5zjq\") pod \"network-check-target-qwgsn\" (UID: \"990077c4-c49d-4ae5-b011-c77744e70ea9\") " pod="openshift-network-diagnostics/network-check-target-qwgsn" Jun 15 04:25:26.765280 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.764915 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/89608486-9c9e-4aa2-a842-ac5c48544dd0-system-cni-dir\") pod \"multus-additional-cni-plugins-b8vpm\" (UID: \"89608486-9c9e-4aa2-a842-ac5c48544dd0\") " pod="openshift-multus/multus-additional-cni-plugins-b8vpm" Jun 15 04:25:26.765280 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.764954 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/89608486-9c9e-4aa2-a842-ac5c48544dd0-os-release\") pod \"multus-additional-cni-plugins-b8vpm\" (UID: \"89608486-9c9e-4aa2-a842-ac5c48544dd0\") " pod="openshift-multus/multus-additional-cni-plugins-b8vpm" Jun 15 04:25:26.765280 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.764979 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l74cp\" (UniqueName: \"kubernetes.io/projected/87abfa61-f00e-4746-9e96-f6940cbec767-kube-api-access-l74cp\") pod \"network-metrics-daemon-4vqz4\" (UID: \"87abfa61-f00e-4746-9e96-f6940cbec767\") " pod="openshift-multus/network-metrics-daemon-4vqz4" Jun 15 04:25:26.765280 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.765137 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/73584bd0-85a5-4723-9271-4bca267f7b7a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8vqzk\" (UID: \"73584bd0-85a5-4723-9271-4bca267f7b7a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8vqzk" Jun 15 04:25:26.765280 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.765186 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/73584bd0-85a5-4723-9271-4bca267f7b7a-sys-fs\") pod \"aws-ebs-csi-driver-node-8vqzk\" (UID: \"73584bd0-85a5-4723-9271-4bca267f7b7a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8vqzk" Jun 15 04:25:26.765280 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.765215 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/89608486-9c9e-4aa2-a842-ac5c48544dd0-cni-binary-copy\") pod \"multus-additional-cni-plugins-b8vpm\" (UID: \"89608486-9c9e-4aa2-a842-ac5c48544dd0\") " pod="openshift-multus/multus-additional-cni-plugins-b8vpm" Jun 15 04:25:26.765280 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.765251 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c58gr\" (UniqueName: \"kubernetes.io/projected/89608486-9c9e-4aa2-a842-ac5c48544dd0-kube-api-access-c58gr\") pod \"multus-additional-cni-plugins-b8vpm\" (UID: \"89608486-9c9e-4aa2-a842-ac5c48544dd0\") " pod="openshift-multus/multus-additional-cni-plugins-b8vpm" Jun 15 04:25:26.766214 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.765283 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87abfa61-f00e-4746-9e96-f6940cbec767-metrics-certs\") pod \"network-metrics-daemon-4vqz4\" (UID: \"87abfa61-f00e-4746-9e96-f6940cbec767\") " pod="openshift-multus/network-metrics-daemon-4vqz4" Jun 15 04:25:26.766214 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.765349 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/73584bd0-85a5-4723-9271-4bca267f7b7a-socket-dir\") pod \"aws-ebs-csi-driver-node-8vqzk\" (UID: \"73584bd0-85a5-4723-9271-4bca267f7b7a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8vqzk" Jun 15 04:25:26.766214 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.765422 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/73584bd0-85a5-4723-9271-4bca267f7b7a-registration-dir\") pod \"aws-ebs-csi-driver-node-8vqzk\" (UID: \"73584bd0-85a5-4723-9271-4bca267f7b7a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8vqzk" Jun 15 04:25:26.766214 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.765512 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/73584bd0-85a5-4723-9271-4bca267f7b7a-device-dir\") pod \"aws-ebs-csi-driver-node-8vqzk\" (UID: \"73584bd0-85a5-4723-9271-4bca267f7b7a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8vqzk" Jun 15 04:25:26.766214 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.765543 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/90fa004f-1d43-402a-8a68-a5147aea49e6-serviceca\") pod \"node-ca-96sfm\" (UID: \"90fa004f-1d43-402a-8a68-a5147aea49e6\") " pod="openshift-image-registry/node-ca-96sfm" Jun 15 04:25:26.766214 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.765565 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/89608486-9c9e-4aa2-a842-ac5c48544dd0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-b8vpm\" (UID: \"89608486-9c9e-4aa2-a842-ac5c48544dd0\") " pod="openshift-multus/multus-additional-cni-plugins-b8vpm" Jun 15 04:25:26.766214 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.765611 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/89608486-9c9e-4aa2-a842-ac5c48544dd0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-b8vpm\" (UID: \"89608486-9c9e-4aa2-a842-ac5c48544dd0\") " pod="openshift-multus/multus-additional-cni-plugins-b8vpm" Jun 15 04:25:26.766214 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.765670 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/89608486-9c9e-4aa2-a842-ac5c48544dd0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-b8vpm\" (UID: \"89608486-9c9e-4aa2-a842-ac5c48544dd0\") " pod="openshift-multus/multus-additional-cni-plugins-b8vpm" Jun 15 04:25:26.766214 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.765701 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/90fa004f-1d43-402a-8a68-a5147aea49e6-host\") pod \"node-ca-96sfm\" (UID: \"90fa004f-1d43-402a-8a68-a5147aea49e6\") " pod="openshift-image-registry/node-ca-96sfm" Jun 15 04:25:26.766214 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.765735 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/89608486-9c9e-4aa2-a842-ac5c48544dd0-cnibin\") pod \"multus-additional-cni-plugins-b8vpm\" (UID: \"89608486-9c9e-4aa2-a842-ac5c48544dd0\") " pod="openshift-multus/multus-additional-cni-plugins-b8vpm" Jun 15 04:25:26.767837 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.767817 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5d7nq" Jun 15 04:25:26.769713 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.769695 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-8wmnt\"" Jun 15 04:25:26.769805 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.769786 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 15 04:25:26.770182 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.770168 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4znw7" Jun 15 04:25:26.770720 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.770700 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 15 04:25:26.772057 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.772037 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 15 04:25:26.772165 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.772104 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 15 04:25:26.772232 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.772186 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-s2w6c\"" Jun 15 04:25:26.772621 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.772604 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8fqkk" Jun 15 04:25:26.774146 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.774128 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 15 04:25:26.774563 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.774543 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 15 04:25:26.774687 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.774666 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-jbxbj\"" Jun 15 04:25:26.774792 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.774545 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 15 04:25:26.774858 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.774616 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 15 04:25:26.774941 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.774877 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 15 04:25:26.774941 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.774608 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 15 04:25:26.782754 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.782737 2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-bmzdh" Jun 15 04:25:26.789683 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.789655 2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-bmzdh" Jun 15 04:25:26.854518 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.854491 2561 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 15 04:25:26.866329 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.866298 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/60d517e2-146b-40e3-899a-9ed192a41a96-multus-conf-dir\") pod \"multus-dtzbz\" (UID: \"60d517e2-146b-40e3-899a-9ed192a41a96\") " pod="openshift-multus/multus-dtzbz" Jun 15 04:25:26.866491 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.866337 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/73584bd0-85a5-4723-9271-4bca267f7b7a-sys-fs\") pod \"aws-ebs-csi-driver-node-8vqzk\" (UID: \"73584bd0-85a5-4723-9271-4bca267f7b7a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8vqzk" Jun 15 04:25:26.866491 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.866362 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c58gr\" (UniqueName: \"kubernetes.io/projected/89608486-9c9e-4aa2-a842-ac5c48544dd0-kube-api-access-c58gr\") pod \"multus-additional-cni-plugins-b8vpm\" (UID: \"89608486-9c9e-4aa2-a842-ac5c48544dd0\") " pod="openshift-multus/multus-additional-cni-plugins-b8vpm" Jun 15 04:25:26.866491 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.866386 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f345d023-5952-44c4-800e-69cf4dba39a3-ovnkube-config\") pod \"ovnkube-node-8fqkk\" (UID: \"f345d023-5952-44c4-800e-69cf4dba39a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fqkk" Jun 15 04:25:26.866491 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.866410 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f345d023-5952-44c4-800e-69cf4dba39a3-ovnkube-script-lib\") pod \"ovnkube-node-8fqkk\" (UID: \"f345d023-5952-44c4-800e-69cf4dba39a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fqkk" Jun 15 04:25:26.866491 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.866448 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qlks\" (UniqueName: \"kubernetes.io/projected/f345d023-5952-44c4-800e-69cf4dba39a3-kube-api-access-5qlks\") pod \"ovnkube-node-8fqkk\" (UID: \"f345d023-5952-44c4-800e-69cf4dba39a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fqkk" Jun 15 04:25:26.866491 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.866465 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/73584bd0-85a5-4723-9271-4bca267f7b7a-sys-fs\") pod \"aws-ebs-csi-driver-node-8vqzk\" (UID: \"73584bd0-85a5-4723-9271-4bca267f7b7a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8vqzk" Jun 15 04:25:26.866491 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.866473 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/be43e236-891d-432a-834c-bc8ee5a8b117-agent-certs\") pod \"konnectivity-agent-jpvfh\" (UID: \"be43e236-891d-432a-834c-bc8ee5a8b117\") " pod="kube-system/konnectivity-agent-jpvfh" Jun 15 04:25:26.866780 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.866545 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/65679bf4-dd91-40a3-ba20-8a86fccc1f29-etc-systemd\") pod \"tuned-5d7nq\" (UID: \"65679bf4-dd91-40a3-ba20-8a86fccc1f29\") " pod="openshift-cluster-node-tuning-operator/tuned-5d7nq" Jun 15 04:25:26.866780 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.866586 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cnwp\" (UniqueName: \"kubernetes.io/projected/fd16b391-af84-45b8-bbaf-e042e8a2c1e4-kube-api-access-8cnwp\") pod \"node-resolver-4znw7\" (UID: \"fd16b391-af84-45b8-bbaf-e042e8a2c1e4\") " pod="openshift-dns/node-resolver-4znw7" Jun 15 04:25:26.866780 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.866618 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/73584bd0-85a5-4723-9271-4bca267f7b7a-socket-dir\") pod \"aws-ebs-csi-driver-node-8vqzk\" (UID: \"73584bd0-85a5-4723-9271-4bca267f7b7a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8vqzk" Jun 15 04:25:26.866780 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.866658 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/73584bd0-85a5-4723-9271-4bca267f7b7a-device-dir\") pod \"aws-ebs-csi-driver-node-8vqzk\" (UID: \"73584bd0-85a5-4723-9271-4bca267f7b7a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8vqzk" Jun 15 04:25:26.866780 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.866690 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f345d023-5952-44c4-800e-69cf4dba39a3-host-run-netns\") pod \"ovnkube-node-8fqkk\" (UID: \"f345d023-5952-44c4-800e-69cf4dba39a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fqkk" Jun 15 04:25:26.866780 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.866754 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/73584bd0-85a5-4723-9271-4bca267f7b7a-socket-dir\") pod \"aws-ebs-csi-driver-node-8vqzk\" (UID: \"73584bd0-85a5-4723-9271-4bca267f7b7a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8vqzk" Jun 15 04:25:26.866780 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.866754 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/73584bd0-85a5-4723-9271-4bca267f7b7a-device-dir\") pod \"aws-ebs-csi-driver-node-8vqzk\" (UID: \"73584bd0-85a5-4723-9271-4bca267f7b7a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8vqzk" Jun 15 04:25:26.866780 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.866749 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f345d023-5952-44c4-800e-69cf4dba39a3-env-overrides\") pod \"ovnkube-node-8fqkk\" (UID: \"f345d023-5952-44c4-800e-69cf4dba39a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fqkk" Jun 15 04:25:26.867135 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.866800 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f345d023-5952-44c4-800e-69cf4dba39a3-ovn-node-metrics-cert\") pod \"ovnkube-node-8fqkk\" (UID: \"f345d023-5952-44c4-800e-69cf4dba39a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fqkk" Jun 15 04:25:26.867135 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.866824 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/60d517e2-146b-40e3-899a-9ed192a41a96-system-cni-dir\") pod \"multus-dtzbz\" (UID: \"60d517e2-146b-40e3-899a-9ed192a41a96\") " pod="openshift-multus/multus-dtzbz" Jun 15 04:25:26.867135 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.866850 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/60d517e2-146b-40e3-899a-9ed192a41a96-multus-cni-dir\") pod \"multus-dtzbz\" (UID: \"60d517e2-146b-40e3-899a-9ed192a41a96\") " pod="openshift-multus/multus-dtzbz" Jun 15 04:25:26.867135 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.866871 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/60d517e2-146b-40e3-899a-9ed192a41a96-os-release\") pod \"multus-dtzbz\" (UID: \"60d517e2-146b-40e3-899a-9ed192a41a96\") " pod="openshift-multus/multus-dtzbz" Jun 15 04:25:26.867135 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.866893 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f345d023-5952-44c4-800e-69cf4dba39a3-log-socket\") pod \"ovnkube-node-8fqkk\" (UID: \"f345d023-5952-44c4-800e-69cf4dba39a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fqkk" Jun 15 04:25:26.867135 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.866910 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/65679bf4-dd91-40a3-ba20-8a86fccc1f29-etc-sysctl-conf\") pod \"tuned-5d7nq\" (UID: \"65679bf4-dd91-40a3-ba20-8a86fccc1f29\") " pod="openshift-cluster-node-tuning-operator/tuned-5d7nq" Jun 15 04:25:26.867135 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.866992 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/65679bf4-dd91-40a3-ba20-8a86fccc1f29-tmp\") pod \"tuned-5d7nq\" (UID: \"65679bf4-dd91-40a3-ba20-8a86fccc1f29\") " pod="openshift-cluster-node-tuning-operator/tuned-5d7nq" Jun 15 04:25:26.867135 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.867018 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/60d517e2-146b-40e3-899a-9ed192a41a96-host-run-k8s-cni-cncf-io\") pod \"multus-dtzbz\" (UID: \"60d517e2-146b-40e3-899a-9ed192a41a96\") " pod="openshift-multus/multus-dtzbz" Jun 15 04:25:26.867135 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.867041 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrzzl\" (UniqueName: \"kubernetes.io/projected/96ea42c2-0ad9-491c-b53c-b5efdff90674-kube-api-access-nrzzl\") pod \"iptables-alerter-kfmj5\" (UID: \"96ea42c2-0ad9-491c-b53c-b5efdff90674\") " pod="openshift-network-operator/iptables-alerter-kfmj5" Jun 15 04:25:26.867135 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.867067 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/73584bd0-85a5-4723-9271-4bca267f7b7a-etc-selinux\") pod \"aws-ebs-csi-driver-node-8vqzk\" (UID: \"73584bd0-85a5-4723-9271-4bca267f7b7a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8vqzk" Jun 15 04:25:26.867531 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.867092 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5zjq\" (UniqueName: \"kubernetes.io/projected/990077c4-c49d-4ae5-b011-c77744e70ea9-kube-api-access-l5zjq\") pod \"network-check-target-qwgsn\" (UID: \"990077c4-c49d-4ae5-b011-c77744e70ea9\") " pod="openshift-network-diagnostics/network-check-target-qwgsn" Jun 15 04:25:26.867617 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.867601 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f345d023-5952-44c4-800e-69cf4dba39a3-host-run-ovn-kubernetes\") pod \"ovnkube-node-8fqkk\" (UID: \"f345d023-5952-44c4-800e-69cf4dba39a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fqkk" Jun 15 04:25:26.867653 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.867634 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f345d023-5952-44c4-800e-69cf4dba39a3-host-cni-bin\") pod \"ovnkube-node-8fqkk\" (UID: \"f345d023-5952-44c4-800e-69cf4dba39a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fqkk" Jun 15 04:25:26.867684 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.867656 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/60d517e2-146b-40e3-899a-9ed192a41a96-host-var-lib-kubelet\") pod \"multus-dtzbz\" (UID: \"60d517e2-146b-40e3-899a-9ed192a41a96\") " pod="openshift-multus/multus-dtzbz" Jun 15 04:25:26.867715 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.867686 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/60d517e2-146b-40e3-899a-9ed192a41a96-etc-kubernetes\") pod \"multus-dtzbz\" (UID: \"60d517e2-146b-40e3-899a-9ed192a41a96\") " pod="openshift-multus/multus-dtzbz" Jun 15 04:25:26.867745 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.867665 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/73584bd0-85a5-4723-9271-4bca267f7b7a-etc-selinux\") pod \"aws-ebs-csi-driver-node-8vqzk\" (UID: \"73584bd0-85a5-4723-9271-4bca267f7b7a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8vqzk" Jun 15 04:25:26.867745 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.867738 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwsfx\" (UniqueName: \"kubernetes.io/projected/60d517e2-146b-40e3-899a-9ed192a41a96-kube-api-access-kwsfx\") pod \"multus-dtzbz\" (UID: \"60d517e2-146b-40e3-899a-9ed192a41a96\") " pod="openshift-multus/multus-dtzbz" Jun 15 04:25:26.867959 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.867905 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l74cp\" (UniqueName: \"kubernetes.io/projected/87abfa61-f00e-4746-9e96-f6940cbec767-kube-api-access-l74cp\") pod \"network-metrics-daemon-4vqz4\" (UID: \"87abfa61-f00e-4746-9e96-f6940cbec767\") " pod="openshift-multus/network-metrics-daemon-4vqz4" Jun 15 04:25:26.868072 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.868008 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/65679bf4-dd91-40a3-ba20-8a86fccc1f29-etc-sysctl-d\") pod \"tuned-5d7nq\" (UID: \"65679bf4-dd91-40a3-ba20-8a86fccc1f29\") " pod="openshift-cluster-node-tuning-operator/tuned-5d7nq" Jun 15 04:25:26.868072 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.868043 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/65679bf4-dd91-40a3-ba20-8a86fccc1f29-lib-modules\") pod \"tuned-5d7nq\" (UID: \"65679bf4-dd91-40a3-ba20-8a86fccc1f29\") " pod="openshift-cluster-node-tuning-operator/tuned-5d7nq" Jun 15 04:25:26.868170 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.868074 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/65679bf4-dd91-40a3-ba20-8a86fccc1f29-host\") pod \"tuned-5d7nq\" (UID: \"65679bf4-dd91-40a3-ba20-8a86fccc1f29\") " pod="openshift-cluster-node-tuning-operator/tuned-5d7nq" Jun 15 04:25:26.868170 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.868110 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcw68\" (UniqueName: \"kubernetes.io/projected/65679bf4-dd91-40a3-ba20-8a86fccc1f29-kube-api-access-mcw68\") pod \"tuned-5d7nq\" (UID: \"65679bf4-dd91-40a3-ba20-8a86fccc1f29\") " pod="openshift-cluster-node-tuning-operator/tuned-5d7nq" Jun 15 04:25:26.868170 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.868141 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd16b391-af84-45b8-bbaf-e042e8a2c1e4-tmp-dir\") pod \"node-resolver-4znw7\" (UID: \"fd16b391-af84-45b8-bbaf-e042e8a2c1e4\") " pod="openshift-dns/node-resolver-4znw7" Jun 15 04:25:26.868304 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.868196 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/60d517e2-146b-40e3-899a-9ed192a41a96-multus-daemon-config\") pod \"multus-dtzbz\" (UID: \"60d517e2-146b-40e3-899a-9ed192a41a96\") " pod="openshift-multus/multus-dtzbz" Jun 15 04:25:26.868304 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.868225 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/96ea42c2-0ad9-491c-b53c-b5efdff90674-host-slash\") pod \"iptables-alerter-kfmj5\" (UID: \"96ea42c2-0ad9-491c-b53c-b5efdff90674\") " pod="openshift-network-operator/iptables-alerter-kfmj5" Jun 15 04:25:26.868304 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.868271 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/89608486-9c9e-4aa2-a842-ac5c48544dd0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-b8vpm\" (UID: \"89608486-9c9e-4aa2-a842-ac5c48544dd0\") " pod="openshift-multus/multus-additional-cni-plugins-b8vpm" Jun 15 04:25:26.868304 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.868300 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f345d023-5952-44c4-800e-69cf4dba39a3-run-systemd\") pod \"ovnkube-node-8fqkk\" (UID: \"f345d023-5952-44c4-800e-69cf4dba39a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fqkk" Jun 15 04:25:26.868614 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.868328 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/60d517e2-146b-40e3-899a-9ed192a41a96-host-var-lib-cni-multus\") pod \"multus-dtzbz\" (UID: \"60d517e2-146b-40e3-899a-9ed192a41a96\") " pod="openshift-multus/multus-dtzbz" Jun 15 04:25:26.868614 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.868428 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f345d023-5952-44c4-800e-69cf4dba39a3-systemd-units\") pod \"ovnkube-node-8fqkk\" (UID: \"f345d023-5952-44c4-800e-69cf4dba39a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fqkk" Jun 15 04:25:26.868614 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.868519 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f345d023-5952-44c4-800e-69cf4dba39a3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8fqkk\" (UID: \"f345d023-5952-44c4-800e-69cf4dba39a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fqkk" Jun 15 04:25:26.868614 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.868563 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/60d517e2-146b-40e3-899a-9ed192a41a96-multus-socket-dir-parent\") pod \"multus-dtzbz\" (UID: \"60d517e2-146b-40e3-899a-9ed192a41a96\") " pod="openshift-multus/multus-dtzbz" Jun 15 04:25:26.868614 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.868604 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/60d517e2-146b-40e3-899a-9ed192a41a96-host-run-netns\") pod \"multus-dtzbz\" (UID: \"60d517e2-146b-40e3-899a-9ed192a41a96\") " pod="openshift-multus/multus-dtzbz" Jun 15 04:25:26.868864 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.868638 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/96ea42c2-0ad9-491c-b53c-b5efdff90674-iptables-alerter-script\") pod \"iptables-alerter-kfmj5\" (UID: \"96ea42c2-0ad9-491c-b53c-b5efdff90674\") " pod="openshift-network-operator/iptables-alerter-kfmj5" Jun 15 04:25:26.868864 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.868690 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/78c7be15-9916-443f-8d76-29dc1412a6ce-kubelet-config\") pod \"global-pull-secret-syncer-ng2rb\" (UID: \"78c7be15-9916-443f-8d76-29dc1412a6ce\") " pod="kube-system/global-pull-secret-syncer-ng2rb" Jun 15 04:25:26.868864 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.868736 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/78c7be15-9916-443f-8d76-29dc1412a6ce-original-pull-secret\") pod \"global-pull-secret-syncer-ng2rb\" (UID: \"78c7be15-9916-443f-8d76-29dc1412a6ce\") " pod="kube-system/global-pull-secret-syncer-ng2rb" Jun 15 04:25:26.868864 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.868788 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/89608486-9c9e-4aa2-a842-ac5c48544dd0-os-release\") pod \"multus-additional-cni-plugins-b8vpm\" (UID: \"89608486-9c9e-4aa2-a842-ac5c48544dd0\") " pod="openshift-multus/multus-additional-cni-plugins-b8vpm" Jun 15 04:25:26.868864 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.868841 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f345d023-5952-44c4-800e-69cf4dba39a3-etc-openvswitch\") pod \"ovnkube-node-8fqkk\" (UID: \"f345d023-5952-44c4-800e-69cf4dba39a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fqkk" Jun 15 04:25:26.869075 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.868874 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/65679bf4-dd91-40a3-ba20-8a86fccc1f29-etc-tuned\") pod \"tuned-5d7nq\" (UID: \"65679bf4-dd91-40a3-ba20-8a86fccc1f29\") " pod="openshift-cluster-node-tuning-operator/tuned-5d7nq" Jun 15 04:25:26.869075 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.868911 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fd16b391-af84-45b8-bbaf-e042e8a2c1e4-hosts-file\") pod \"node-resolver-4znw7\" (UID: \"fd16b391-af84-45b8-bbaf-e042e8a2c1e4\") " pod="openshift-dns/node-resolver-4znw7" Jun 15 04:25:26.869075 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.868932 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/89608486-9c9e-4aa2-a842-ac5c48544dd0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-b8vpm\" (UID: \"89608486-9c9e-4aa2-a842-ac5c48544dd0\") " pod="openshift-multus/multus-additional-cni-plugins-b8vpm" Jun 15 04:25:26.869075 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.868956 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/89608486-9c9e-4aa2-a842-ac5c48544dd0-os-release\") pod \"multus-additional-cni-plugins-b8vpm\" (UID: \"89608486-9c9e-4aa2-a842-ac5c48544dd0\") " pod="openshift-multus/multus-additional-cni-plugins-b8vpm" Jun 15 04:25:26.869075 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.868959 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/73584bd0-85a5-4723-9271-4bca267f7b7a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8vqzk\" (UID: \"73584bd0-85a5-4723-9271-4bca267f7b7a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8vqzk" Jun 15 04:25:26.869075 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.869012 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/65679bf4-dd91-40a3-ba20-8a86fccc1f29-etc-modprobe-d\") pod \"tuned-5d7nq\" (UID: \"65679bf4-dd91-40a3-ba20-8a86fccc1f29\") " pod="openshift-cluster-node-tuning-operator/tuned-5d7nq" Jun 15 04:25:26.869075 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.869012 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/73584bd0-85a5-4723-9271-4bca267f7b7a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8vqzk\" (UID: \"73584bd0-85a5-4723-9271-4bca267f7b7a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8vqzk" Jun 15 04:25:26.869075 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.869049 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/65679bf4-dd91-40a3-ba20-8a86fccc1f29-etc-sysconfig\") pod \"tuned-5d7nq\" (UID: \"65679bf4-dd91-40a3-ba20-8a86fccc1f29\") " pod="openshift-cluster-node-tuning-operator/tuned-5d7nq" Jun 15 04:25:26.869407 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.869111 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/65679bf4-dd91-40a3-ba20-8a86fccc1f29-run\") pod \"tuned-5d7nq\" (UID: \"65679bf4-dd91-40a3-ba20-8a86fccc1f29\") " pod="openshift-cluster-node-tuning-operator/tuned-5d7nq" Jun 15 04:25:26.869407 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.869159 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87abfa61-f00e-4746-9e96-f6940cbec767-metrics-certs\") pod \"network-metrics-daemon-4vqz4\" (UID: \"87abfa61-f00e-4746-9e96-f6940cbec767\") " pod="openshift-multus/network-metrics-daemon-4vqz4" Jun 15 04:25:26.869407 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.869253 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/89608486-9c9e-4aa2-a842-ac5c48544dd0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-b8vpm\" (UID: \"89608486-9c9e-4aa2-a842-ac5c48544dd0\") " pod="openshift-multus/multus-additional-cni-plugins-b8vpm" Jun 15 04:25:26.869407 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.869317 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/89608486-9c9e-4aa2-a842-ac5c48544dd0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-b8vpm\" (UID: \"89608486-9c9e-4aa2-a842-ac5c48544dd0\") " pod="openshift-multus/multus-additional-cni-plugins-b8vpm" Jun 15 04:25:26.869407 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.869385 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f345d023-5952-44c4-800e-69cf4dba39a3-var-lib-openvswitch\") pod \"ovnkube-node-8fqkk\" (UID: \"f345d023-5952-44c4-800e-69cf4dba39a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fqkk" Jun 15 04:25:26.869644 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.869415 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f345d023-5952-44c4-800e-69cf4dba39a3-run-ovn\") pod \"ovnkube-node-8fqkk\" (UID: \"f345d023-5952-44c4-800e-69cf4dba39a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fqkk" Jun 15 04:25:26.869644 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.869522 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/65679bf4-dd91-40a3-ba20-8a86fccc1f29-var-lib-kubelet\") pod \"tuned-5d7nq\" (UID: \"65679bf4-dd91-40a3-ba20-8a86fccc1f29\") " pod="openshift-cluster-node-tuning-operator/tuned-5d7nq" Jun 15 04:25:26.869644 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.869555 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8djqm\" (UniqueName: \"kubernetes.io/projected/73584bd0-85a5-4723-9271-4bca267f7b7a-kube-api-access-8djqm\") pod \"aws-ebs-csi-driver-node-8vqzk\" (UID: \"73584bd0-85a5-4723-9271-4bca267f7b7a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8vqzk" Jun 15 04:25:26.869644 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.869601 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbsgq\" (UniqueName: \"kubernetes.io/projected/90fa004f-1d43-402a-8a68-a5147aea49e6-kube-api-access-wbsgq\") pod \"node-ca-96sfm\" (UID: \"90fa004f-1d43-402a-8a68-a5147aea49e6\") " pod="openshift-image-registry/node-ca-96sfm" Jun 15 04:25:26.869819 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.869627 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/89608486-9c9e-4aa2-a842-ac5c48544dd0-system-cni-dir\") pod \"multus-additional-cni-plugins-b8vpm\" (UID: \"89608486-9c9e-4aa2-a842-ac5c48544dd0\") " pod="openshift-multus/multus-additional-cni-plugins-b8vpm" Jun 15 04:25:26.869819 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.869692 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/89608486-9c9e-4aa2-a842-ac5c48544dd0-cni-binary-copy\") pod \"multus-additional-cni-plugins-b8vpm\" (UID: \"89608486-9c9e-4aa2-a842-ac5c48544dd0\") " pod="openshift-multus/multus-additional-cni-plugins-b8vpm" Jun 15 04:25:26.869912 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.869825 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f345d023-5952-44c4-800e-69cf4dba39a3-run-openvswitch\") pod \"ovnkube-node-8fqkk\" (UID: \"f345d023-5952-44c4-800e-69cf4dba39a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fqkk" Jun 15 04:25:26.869912 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.869869 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f345d023-5952-44c4-800e-69cf4dba39a3-host-cni-netd\") pod \"ovnkube-node-8fqkk\" (UID: \"f345d023-5952-44c4-800e-69cf4dba39a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fqkk" Jun 15 04:25:26.870150 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.870114 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/be43e236-891d-432a-834c-bc8ee5a8b117-konnectivity-ca\") pod \"konnectivity-agent-jpvfh\" (UID: \"be43e236-891d-432a-834c-bc8ee5a8b117\") " pod="kube-system/konnectivity-agent-jpvfh" Jun 15 04:25:26.870222 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.870151 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/65679bf4-dd91-40a3-ba20-8a86fccc1f29-etc-kubernetes\") pod \"tuned-5d7nq\" (UID: \"65679bf4-dd91-40a3-ba20-8a86fccc1f29\") " pod="openshift-cluster-node-tuning-operator/tuned-5d7nq" Jun 15 04:25:26.870222 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.870177 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/65679bf4-dd91-40a3-ba20-8a86fccc1f29-sys\") pod \"tuned-5d7nq\" (UID: \"65679bf4-dd91-40a3-ba20-8a86fccc1f29\") " pod="openshift-cluster-node-tuning-operator/tuned-5d7nq" Jun 15 04:25:26.870222 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.870199 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/60d517e2-146b-40e3-899a-9ed192a41a96-cnibin\") pod \"multus-dtzbz\" (UID: \"60d517e2-146b-40e3-899a-9ed192a41a96\") " pod="openshift-multus/multus-dtzbz" Jun 15 04:25:26.870354 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.870226 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/60d517e2-146b-40e3-899a-9ed192a41a96-host-var-lib-cni-bin\") pod \"multus-dtzbz\" (UID: \"60d517e2-146b-40e3-899a-9ed192a41a96\") " pod="openshift-multus/multus-dtzbz" Jun 15 04:25:26.870354 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.870299 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/60d517e2-146b-40e3-899a-9ed192a41a96-hostroot\") pod \"multus-dtzbz\" (UID: \"60d517e2-146b-40e3-899a-9ed192a41a96\") " pod="openshift-multus/multus-dtzbz" Jun 15 04:25:26.870462 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.870351 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/78c7be15-9916-443f-8d76-29dc1412a6ce-dbus\") pod \"global-pull-secret-syncer-ng2rb\" (UID: \"78c7be15-9916-443f-8d76-29dc1412a6ce\") " pod="kube-system/global-pull-secret-syncer-ng2rb" Jun 15 04:25:26.870462 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.870408 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/73584bd0-85a5-4723-9271-4bca267f7b7a-registration-dir\") pod \"aws-ebs-csi-driver-node-8vqzk\" (UID: \"73584bd0-85a5-4723-9271-4bca267f7b7a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8vqzk" Jun 15 04:25:26.870462 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.870455 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/90fa004f-1d43-402a-8a68-a5147aea49e6-serviceca\") pod \"node-ca-96sfm\" (UID: \"90fa004f-1d43-402a-8a68-a5147aea49e6\") " pod="openshift-image-registry/node-ca-96sfm" Jun 15 04:25:26.870602 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.870513 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f345d023-5952-44c4-800e-69cf4dba39a3-node-log\") pod \"ovnkube-node-8fqkk\" (UID: \"f345d023-5952-44c4-800e-69cf4dba39a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fqkk" Jun 15 04:25:26.870648 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.870623 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/90fa004f-1d43-402a-8a68-a5147aea49e6-host\") pod \"node-ca-96sfm\" (UID: \"90fa004f-1d43-402a-8a68-a5147aea49e6\") " pod="openshift-image-registry/node-ca-96sfm" Jun 15 04:25:26.870696 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.870666 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/89608486-9c9e-4aa2-a842-ac5c48544dd0-cnibin\") pod \"multus-additional-cni-plugins-b8vpm\" (UID: \"89608486-9c9e-4aa2-a842-ac5c48544dd0\") " pod="openshift-multus/multus-additional-cni-plugins-b8vpm" Jun 15 04:25:26.870743 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.870695 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/60d517e2-146b-40e3-899a-9ed192a41a96-host-run-multus-certs\") pod \"multus-dtzbz\" (UID: \"60d517e2-146b-40e3-899a-9ed192a41a96\") " pod="openshift-multus/multus-dtzbz" Jun 15 04:25:26.870792 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.870737 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f345d023-5952-44c4-800e-69cf4dba39a3-host-kubelet\") pod \"ovnkube-node-8fqkk\" (UID: \"f345d023-5952-44c4-800e-69cf4dba39a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fqkk" Jun 15 04:25:26.870963 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.870915 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/90fa004f-1d43-402a-8a68-a5147aea49e6-host\") pod \"node-ca-96sfm\" (UID: \"90fa004f-1d43-402a-8a68-a5147aea49e6\") " pod="openshift-image-registry/node-ca-96sfm" Jun 15 04:25:26.870963 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.870929 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f345d023-5952-44c4-800e-69cf4dba39a3-host-slash\") pod \"ovnkube-node-8fqkk\" (UID: \"f345d023-5952-44c4-800e-69cf4dba39a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fqkk" Jun 15 04:25:26.871114 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.870979 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/89608486-9c9e-4aa2-a842-ac5c48544dd0-cnibin\") pod \"multus-additional-cni-plugins-b8vpm\" (UID: \"89608486-9c9e-4aa2-a842-ac5c48544dd0\") " pod="openshift-multus/multus-additional-cni-plugins-b8vpm" Jun 15 04:25:26.871114 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.871047 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/60d517e2-146b-40e3-899a-9ed192a41a96-cni-binary-copy\") pod \"multus-dtzbz\" (UID: \"60d517e2-146b-40e3-899a-9ed192a41a96\") " pod="openshift-multus/multus-dtzbz" Jun 15 04:25:26.871114 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.871064 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/73584bd0-85a5-4723-9271-4bca267f7b7a-registration-dir\") pod \"aws-ebs-csi-driver-node-8vqzk\" (UID: \"73584bd0-85a5-4723-9271-4bca267f7b7a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8vqzk" Jun 15 04:25:26.871114 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:26.871114 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 04:25:26.871349 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.871257 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/89608486-9c9e-4aa2-a842-ac5c48544dd0-system-cni-dir\") pod \"multus-additional-cni-plugins-b8vpm\" (UID: \"89608486-9c9e-4aa2-a842-ac5c48544dd0\") " pod="openshift-multus/multus-additional-cni-plugins-b8vpm" Jun 15 04:25:26.871791 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.871623 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/90fa004f-1d43-402a-8a68-a5147aea49e6-serviceca\") pod \"node-ca-96sfm\" (UID: \"90fa004f-1d43-402a-8a68-a5147aea49e6\") " pod="openshift-image-registry/node-ca-96sfm" Jun 15 04:25:26.871879 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:26.871831 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87abfa61-f00e-4746-9e96-f6940cbec767-metrics-certs podName:87abfa61-f00e-4746-9e96-f6940cbec767 nodeName:}" failed. No retries permitted until 2026-06-15 04:25:27.371804808 +0000 UTC m=+2.899795702 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/87abfa61-f00e-4746-9e96-f6940cbec767-metrics-certs") pod "network-metrics-daemon-4vqz4" (UID: "87abfa61-f00e-4746-9e96-f6940cbec767") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 04:25:26.871879 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.871833 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/89608486-9c9e-4aa2-a842-ac5c48544dd0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-b8vpm\" (UID: \"89608486-9c9e-4aa2-a842-ac5c48544dd0\") " pod="openshift-multus/multus-additional-cni-plugins-b8vpm" Jun 15 04:25:26.871879 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.871868 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/89608486-9c9e-4aa2-a842-ac5c48544dd0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-b8vpm\" (UID: \"89608486-9c9e-4aa2-a842-ac5c48544dd0\") " pod="openshift-multus/multus-additional-cni-plugins-b8vpm" Jun 15 04:25:26.872034 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.872004 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/89608486-9c9e-4aa2-a842-ac5c48544dd0-cni-binary-copy\") pod \"multus-additional-cni-plugins-b8vpm\" (UID: \"89608486-9c9e-4aa2-a842-ac5c48544dd0\") " pod="openshift-multus/multus-additional-cni-plugins-b8vpm" Jun 15 04:25:26.872488 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.872433 2561 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 15 04:25:26.876164 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.876113 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c58gr\" (UniqueName: \"kubernetes.io/projected/89608486-9c9e-4aa2-a842-ac5c48544dd0-kube-api-access-c58gr\") pod \"multus-additional-cni-plugins-b8vpm\" (UID: \"89608486-9c9e-4aa2-a842-ac5c48544dd0\") " pod="openshift-multus/multus-additional-cni-plugins-b8vpm" Jun 15 04:25:26.879085 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:26.879064 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 04:25:26.879180 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:26.879090 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 04:25:26.879180 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:26.879103 2561 projected.go:196] Error preparing data for projected volume kube-api-access-l5zjq for pod openshift-network-diagnostics/network-check-target-qwgsn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 04:25:26.879180 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:26.879151 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/990077c4-c49d-4ae5-b011-c77744e70ea9-kube-api-access-l5zjq podName:990077c4-c49d-4ae5-b011-c77744e70ea9 nodeName:}" failed. No retries permitted until 2026-06-15 04:25:27.379135941 +0000 UTC m=+2.907126838 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-l5zjq" (UniqueName: "kubernetes.io/projected/990077c4-c49d-4ae5-b011-c77744e70ea9-kube-api-access-l5zjq") pod "network-check-target-qwgsn" (UID: "990077c4-c49d-4ae5-b011-c77744e70ea9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 04:25:26.882335 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.882308 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8djqm\" (UniqueName: \"kubernetes.io/projected/73584bd0-85a5-4723-9271-4bca267f7b7a-kube-api-access-8djqm\") pod \"aws-ebs-csi-driver-node-8vqzk\" (UID: \"73584bd0-85a5-4723-9271-4bca267f7b7a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8vqzk" Jun 15 04:25:26.882417 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.882309 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbsgq\" (UniqueName: \"kubernetes.io/projected/90fa004f-1d43-402a-8a68-a5147aea49e6-kube-api-access-wbsgq\") pod \"node-ca-96sfm\" (UID: \"90fa004f-1d43-402a-8a68-a5147aea49e6\") " pod="openshift-image-registry/node-ca-96sfm" Jun 15 04:25:26.882670 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.882648 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l74cp\" (UniqueName: \"kubernetes.io/projected/87abfa61-f00e-4746-9e96-f6940cbec767-kube-api-access-l74cp\") pod \"network-metrics-daemon-4vqz4\" (UID: \"87abfa61-f00e-4746-9e96-f6940cbec767\") " pod="openshift-multus/network-metrics-daemon-4vqz4" Jun 15 04:25:26.912554 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.912530 2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 15 04:25:26.971935 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.971908 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f345d023-5952-44c4-800e-69cf4dba39a3-host-cni-bin\") pod \"ovnkube-node-8fqkk\" (UID: \"f345d023-5952-44c4-800e-69cf4dba39a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fqkk" Jun 15 04:25:26.971935 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.971937 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/60d517e2-146b-40e3-899a-9ed192a41a96-host-var-lib-kubelet\") pod \"multus-dtzbz\" (UID: \"60d517e2-146b-40e3-899a-9ed192a41a96\") " pod="openshift-multus/multus-dtzbz" Jun 15 04:25:26.972142 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.971957 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/60d517e2-146b-40e3-899a-9ed192a41a96-etc-kubernetes\") pod \"multus-dtzbz\" (UID: \"60d517e2-146b-40e3-899a-9ed192a41a96\") " pod="openshift-multus/multus-dtzbz" Jun 15 04:25:26.972142 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.971990 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwsfx\" (UniqueName: \"kubernetes.io/projected/60d517e2-146b-40e3-899a-9ed192a41a96-kube-api-access-kwsfx\") pod \"multus-dtzbz\" (UID: \"60d517e2-146b-40e3-899a-9ed192a41a96\") " pod="openshift-multus/multus-dtzbz" Jun 15 04:25:26.972142 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.972011 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/65679bf4-dd91-40a3-ba20-8a86fccc1f29-etc-sysctl-d\") pod \"tuned-5d7nq\" (UID: \"65679bf4-dd91-40a3-ba20-8a86fccc1f29\") " pod="openshift-cluster-node-tuning-operator/tuned-5d7nq" Jun 15 04:25:26.972142 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.972014 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/60d517e2-146b-40e3-899a-9ed192a41a96-host-var-lib-kubelet\") pod \"multus-dtzbz\" (UID: \"60d517e2-146b-40e3-899a-9ed192a41a96\") " pod="openshift-multus/multus-dtzbz" Jun 15 04:25:26.972142 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.972033 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/65679bf4-dd91-40a3-ba20-8a86fccc1f29-lib-modules\") pod \"tuned-5d7nq\" (UID: \"65679bf4-dd91-40a3-ba20-8a86fccc1f29\") " pod="openshift-cluster-node-tuning-operator/tuned-5d7nq" Jun 15 04:25:26.972142 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.972048 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/60d517e2-146b-40e3-899a-9ed192a41a96-etc-kubernetes\") pod \"multus-dtzbz\" (UID: \"60d517e2-146b-40e3-899a-9ed192a41a96\") " pod="openshift-multus/multus-dtzbz" Jun 15 04:25:26.972142 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.972014 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f345d023-5952-44c4-800e-69cf4dba39a3-host-cni-bin\") pod \"ovnkube-node-8fqkk\" (UID: \"f345d023-5952-44c4-800e-69cf4dba39a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fqkk" Jun 15 04:25:26.972142 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.972071 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/65679bf4-dd91-40a3-ba20-8a86fccc1f29-host\") pod \"tuned-5d7nq\" (UID: \"65679bf4-dd91-40a3-ba20-8a86fccc1f29\") " pod="openshift-cluster-node-tuning-operator/tuned-5d7nq" Jun 15 04:25:26.972142 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.972100 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcw68\" (UniqueName: \"kubernetes.io/projected/65679bf4-dd91-40a3-ba20-8a86fccc1f29-kube-api-access-mcw68\") pod \"tuned-5d7nq\" (UID: \"65679bf4-dd91-40a3-ba20-8a86fccc1f29\") " pod="openshift-cluster-node-tuning-operator/tuned-5d7nq" Jun 15 04:25:26.972142 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.972137 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd16b391-af84-45b8-bbaf-e042e8a2c1e4-tmp-dir\") pod \"node-resolver-4znw7\" (UID: \"fd16b391-af84-45b8-bbaf-e042e8a2c1e4\") " pod="openshift-dns/node-resolver-4znw7" Jun 15 04:25:26.972716 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.972162 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/65679bf4-dd91-40a3-ba20-8a86fccc1f29-lib-modules\") pod \"tuned-5d7nq\" (UID: \"65679bf4-dd91-40a3-ba20-8a86fccc1f29\") " pod="openshift-cluster-node-tuning-operator/tuned-5d7nq" Jun 15 04:25:26.972716 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.972181 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/65679bf4-dd91-40a3-ba20-8a86fccc1f29-etc-sysctl-d\") pod \"tuned-5d7nq\" (UID: \"65679bf4-dd91-40a3-ba20-8a86fccc1f29\") " pod="openshift-cluster-node-tuning-operator/tuned-5d7nq" Jun 15 04:25:26.972716 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.972191 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/65679bf4-dd91-40a3-ba20-8a86fccc1f29-host\") pod \"tuned-5d7nq\" (UID: \"65679bf4-dd91-40a3-ba20-8a86fccc1f29\") " pod="openshift-cluster-node-tuning-operator/tuned-5d7nq" Jun 15 04:25:26.972716 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.972227 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/60d517e2-146b-40e3-899a-9ed192a41a96-multus-daemon-config\") pod \"multus-dtzbz\" (UID: \"60d517e2-146b-40e3-899a-9ed192a41a96\") " pod="openshift-multus/multus-dtzbz" Jun 15 04:25:26.972716 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.972256 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/96ea42c2-0ad9-491c-b53c-b5efdff90674-host-slash\") pod \"iptables-alerter-kfmj5\" (UID: \"96ea42c2-0ad9-491c-b53c-b5efdff90674\") " pod="openshift-network-operator/iptables-alerter-kfmj5" Jun 15 04:25:26.972716 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.972279 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f345d023-5952-44c4-800e-69cf4dba39a3-run-systemd\") pod \"ovnkube-node-8fqkk\" (UID: \"f345d023-5952-44c4-800e-69cf4dba39a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fqkk" Jun 15 04:25:26.972716 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.972300 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/96ea42c2-0ad9-491c-b53c-b5efdff90674-host-slash\") pod \"iptables-alerter-kfmj5\" (UID: \"96ea42c2-0ad9-491c-b53c-b5efdff90674\") " pod="openshift-network-operator/iptables-alerter-kfmj5" Jun 15 04:25:26.972716 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.972305 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/60d517e2-146b-40e3-899a-9ed192a41a96-host-var-lib-cni-multus\") pod \"multus-dtzbz\" (UID: \"60d517e2-146b-40e3-899a-9ed192a41a96\") " pod="openshift-multus/multus-dtzbz" Jun 15 04:25:26.972716 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.972340 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f345d023-5952-44c4-800e-69cf4dba39a3-run-systemd\") pod \"ovnkube-node-8fqkk\" (UID: \"f345d023-5952-44c4-800e-69cf4dba39a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fqkk" Jun 15 04:25:26.972716 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.972346 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/60d517e2-146b-40e3-899a-9ed192a41a96-host-var-lib-cni-multus\") pod \"multus-dtzbz\" (UID: \"60d517e2-146b-40e3-899a-9ed192a41a96\") " pod="openshift-multus/multus-dtzbz" Jun 15 04:25:26.972716 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.972371 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f345d023-5952-44c4-800e-69cf4dba39a3-systemd-units\") pod \"ovnkube-node-8fqkk\" (UID: \"f345d023-5952-44c4-800e-69cf4dba39a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fqkk" Jun 15 04:25:26.972716 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.972425 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f345d023-5952-44c4-800e-69cf4dba39a3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8fqkk\" (UID: \"f345d023-5952-44c4-800e-69cf4dba39a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fqkk" Jun 15 04:25:26.972716 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.972467 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd16b391-af84-45b8-bbaf-e042e8a2c1e4-tmp-dir\") pod \"node-resolver-4znw7\" (UID: \"fd16b391-af84-45b8-bbaf-e042e8a2c1e4\") " pod="openshift-dns/node-resolver-4znw7" Jun 15 04:25:26.972716 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.972477 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/60d517e2-146b-40e3-899a-9ed192a41a96-multus-socket-dir-parent\") pod \"multus-dtzbz\" (UID: \"60d517e2-146b-40e3-899a-9ed192a41a96\") " pod="openshift-multus/multus-dtzbz" Jun 15 04:25:26.972716 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.972481 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f345d023-5952-44c4-800e-69cf4dba39a3-systemd-units\") pod \"ovnkube-node-8fqkk\" (UID: \"f345d023-5952-44c4-800e-69cf4dba39a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fqkk" Jun 15 04:25:26.972716 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.972490 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f345d023-5952-44c4-800e-69cf4dba39a3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8fqkk\" (UID: \"f345d023-5952-44c4-800e-69cf4dba39a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fqkk" Jun 15 04:25:26.972716 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.972520 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/60d517e2-146b-40e3-899a-9ed192a41a96-host-run-netns\") pod \"multus-dtzbz\" (UID: \"60d517e2-146b-40e3-899a-9ed192a41a96\") " pod="openshift-multus/multus-dtzbz" Jun 15 04:25:26.972716 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.972539 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/60d517e2-146b-40e3-899a-9ed192a41a96-multus-socket-dir-parent\") pod \"multus-dtzbz\" (UID: \"60d517e2-146b-40e3-899a-9ed192a41a96\") " pod="openshift-multus/multus-dtzbz" Jun 15 04:25:26.973526 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.972547 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/96ea42c2-0ad9-491c-b53c-b5efdff90674-iptables-alerter-script\") pod \"iptables-alerter-kfmj5\" (UID: \"96ea42c2-0ad9-491c-b53c-b5efdff90674\") " pod="openshift-network-operator/iptables-alerter-kfmj5" Jun 15 04:25:26.973526 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.972571 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/78c7be15-9916-443f-8d76-29dc1412a6ce-kubelet-config\") pod \"global-pull-secret-syncer-ng2rb\" (UID: \"78c7be15-9916-443f-8d76-29dc1412a6ce\") " pod="kube-system/global-pull-secret-syncer-ng2rb" Jun 15 04:25:26.973526 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.972584 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/60d517e2-146b-40e3-899a-9ed192a41a96-host-run-netns\") pod \"multus-dtzbz\" (UID: \"60d517e2-146b-40e3-899a-9ed192a41a96\") " pod="openshift-multus/multus-dtzbz" Jun 15 04:25:26.973526 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.972618 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/78c7be15-9916-443f-8d76-29dc1412a6ce-kubelet-config\") pod \"global-pull-secret-syncer-ng2rb\" (UID: \"78c7be15-9916-443f-8d76-29dc1412a6ce\") " pod="kube-system/global-pull-secret-syncer-ng2rb" Jun 15 04:25:26.973526 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.972680 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/78c7be15-9916-443f-8d76-29dc1412a6ce-original-pull-secret\") pod \"global-pull-secret-syncer-ng2rb\" (UID: \"78c7be15-9916-443f-8d76-29dc1412a6ce\") " pod="kube-system/global-pull-secret-syncer-ng2rb" Jun 15 04:25:26.973526 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.972715 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f345d023-5952-44c4-800e-69cf4dba39a3-etc-openvswitch\") pod \"ovnkube-node-8fqkk\" (UID: \"f345d023-5952-44c4-800e-69cf4dba39a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fqkk" Jun 15 04:25:26.973526 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.972740 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/65679bf4-dd91-40a3-ba20-8a86fccc1f29-etc-tuned\") pod \"tuned-5d7nq\" (UID: \"65679bf4-dd91-40a3-ba20-8a86fccc1f29\") " pod="openshift-cluster-node-tuning-operator/tuned-5d7nq" Jun 15 04:25:26.973526 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.972765 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fd16b391-af84-45b8-bbaf-e042e8a2c1e4-hosts-file\") pod \"node-resolver-4znw7\" (UID: \"fd16b391-af84-45b8-bbaf-e042e8a2c1e4\") " pod="openshift-dns/node-resolver-4znw7" Jun 15 04:25:26.973526 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.972775 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f345d023-5952-44c4-800e-69cf4dba39a3-etc-openvswitch\") pod \"ovnkube-node-8fqkk\" (UID: \"f345d023-5952-44c4-800e-69cf4dba39a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fqkk" Jun 15 04:25:26.973526 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.972789 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/65679bf4-dd91-40a3-ba20-8a86fccc1f29-etc-modprobe-d\") pod \"tuned-5d7nq\" (UID: \"65679bf4-dd91-40a3-ba20-8a86fccc1f29\") " pod="openshift-cluster-node-tuning-operator/tuned-5d7nq" Jun 15 04:25:26.973526 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:26.972810 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 04:25:26.973526 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.972815 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/65679bf4-dd91-40a3-ba20-8a86fccc1f29-etc-sysconfig\") pod \"tuned-5d7nq\" (UID: \"65679bf4-dd91-40a3-ba20-8a86fccc1f29\") " pod="openshift-cluster-node-tuning-operator/tuned-5d7nq" Jun 15 04:25:26.973526 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.972841 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/65679bf4-dd91-40a3-ba20-8a86fccc1f29-run\") pod \"tuned-5d7nq\" (UID: \"65679bf4-dd91-40a3-ba20-8a86fccc1f29\") " pod="openshift-cluster-node-tuning-operator/tuned-5d7nq" Jun 15 04:25:26.973526 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.972840 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/60d517e2-146b-40e3-899a-9ed192a41a96-multus-daemon-config\") pod \"multus-dtzbz\" (UID: \"60d517e2-146b-40e3-899a-9ed192a41a96\") " pod="openshift-multus/multus-dtzbz" Jun 15 04:25:26.973526 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:26.972867 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78c7be15-9916-443f-8d76-29dc1412a6ce-original-pull-secret podName:78c7be15-9916-443f-8d76-29dc1412a6ce nodeName:}" failed. No retries permitted until 2026-06-15 04:25:27.472849359 +0000 UTC m=+3.000840259 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/78c7be15-9916-443f-8d76-29dc1412a6ce-original-pull-secret") pod "global-pull-secret-syncer-ng2rb" (UID: "78c7be15-9916-443f-8d76-29dc1412a6ce") : object "kube-system"/"original-pull-secret" not registered Jun 15 04:25:26.973526 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.972900 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/65679bf4-dd91-40a3-ba20-8a86fccc1f29-etc-sysconfig\") pod \"tuned-5d7nq\" (UID: \"65679bf4-dd91-40a3-ba20-8a86fccc1f29\") " pod="openshift-cluster-node-tuning-operator/tuned-5d7nq" Jun 15 04:25:26.973526 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.972921 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/65679bf4-dd91-40a3-ba20-8a86fccc1f29-etc-modprobe-d\") pod \"tuned-5d7nq\" (UID: \"65679bf4-dd91-40a3-ba20-8a86fccc1f29\") " pod="openshift-cluster-node-tuning-operator/tuned-5d7nq" Jun 15 04:25:26.974392 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.972922 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fd16b391-af84-45b8-bbaf-e042e8a2c1e4-hosts-file\") pod \"node-resolver-4znw7\" (UID: \"fd16b391-af84-45b8-bbaf-e042e8a2c1e4\") " pod="openshift-dns/node-resolver-4znw7" Jun 15 04:25:26.974392 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.972942 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/65679bf4-dd91-40a3-ba20-8a86fccc1f29-run\") pod \"tuned-5d7nq\" (UID: \"65679bf4-dd91-40a3-ba20-8a86fccc1f29\") " pod="openshift-cluster-node-tuning-operator/tuned-5d7nq" Jun 15 04:25:26.974392 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.972978 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f345d023-5952-44c4-800e-69cf4dba39a3-var-lib-openvswitch\") pod \"ovnkube-node-8fqkk\" (UID: \"f345d023-5952-44c4-800e-69cf4dba39a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fqkk" Jun 15 04:25:26.974392 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.973003 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f345d023-5952-44c4-800e-69cf4dba39a3-run-ovn\") pod \"ovnkube-node-8fqkk\" (UID: \"f345d023-5952-44c4-800e-69cf4dba39a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fqkk" Jun 15 04:25:26.974392 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.973025 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/65679bf4-dd91-40a3-ba20-8a86fccc1f29-var-lib-kubelet\") pod \"tuned-5d7nq\" (UID: \"65679bf4-dd91-40a3-ba20-8a86fccc1f29\") " pod="openshift-cluster-node-tuning-operator/tuned-5d7nq" Jun 15 04:25:26.974392 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.973056 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f345d023-5952-44c4-800e-69cf4dba39a3-run-openvswitch\") pod \"ovnkube-node-8fqkk\" (UID: \"f345d023-5952-44c4-800e-69cf4dba39a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fqkk" Jun 15 04:25:26.974392 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.973056 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f345d023-5952-44c4-800e-69cf4dba39a3-var-lib-openvswitch\") pod \"ovnkube-node-8fqkk\" (UID: \"f345d023-5952-44c4-800e-69cf4dba39a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fqkk" Jun 15 04:25:26.974392 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.973068 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/96ea42c2-0ad9-491c-b53c-b5efdff90674-iptables-alerter-script\") pod \"iptables-alerter-kfmj5\" (UID: \"96ea42c2-0ad9-491c-b53c-b5efdff90674\") " pod="openshift-network-operator/iptables-alerter-kfmj5" Jun 15 04:25:26.974392 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.973116 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f345d023-5952-44c4-800e-69cf4dba39a3-host-cni-netd\") pod \"ovnkube-node-8fqkk\" (UID: \"f345d023-5952-44c4-800e-69cf4dba39a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fqkk" Jun 15 04:25:26.974392 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.973082 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f345d023-5952-44c4-800e-69cf4dba39a3-run-ovn\") pod \"ovnkube-node-8fqkk\" (UID: \"f345d023-5952-44c4-800e-69cf4dba39a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fqkk" Jun 15 04:25:26.974392 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.973137 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/be43e236-891d-432a-834c-bc8ee5a8b117-konnectivity-ca\") pod \"konnectivity-agent-jpvfh\" (UID: \"be43e236-891d-432a-834c-bc8ee5a8b117\") " pod="kube-system/konnectivity-agent-jpvfh" Jun 15 04:25:26.974392 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.973097 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f345d023-5952-44c4-800e-69cf4dba39a3-run-openvswitch\") pod \"ovnkube-node-8fqkk\" (UID: \"f345d023-5952-44c4-800e-69cf4dba39a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fqkk" Jun 15 04:25:26.974392 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.973165 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/65679bf4-dd91-40a3-ba20-8a86fccc1f29-etc-kubernetes\") pod \"tuned-5d7nq\" (UID: \"65679bf4-dd91-40a3-ba20-8a86fccc1f29\") " pod="openshift-cluster-node-tuning-operator/tuned-5d7nq" Jun 15 04:25:26.974392 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.973169 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f345d023-5952-44c4-800e-69cf4dba39a3-host-cni-netd\") pod \"ovnkube-node-8fqkk\" (UID: \"f345d023-5952-44c4-800e-69cf4dba39a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fqkk" Jun 15 04:25:26.974392 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.973164 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/65679bf4-dd91-40a3-ba20-8a86fccc1f29-var-lib-kubelet\") pod \"tuned-5d7nq\" (UID: \"65679bf4-dd91-40a3-ba20-8a86fccc1f29\") " pod="openshift-cluster-node-tuning-operator/tuned-5d7nq" Jun 15 04:25:26.974392 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.973189 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/65679bf4-dd91-40a3-ba20-8a86fccc1f29-sys\") pod \"tuned-5d7nq\" (UID: \"65679bf4-dd91-40a3-ba20-8a86fccc1f29\") " pod="openshift-cluster-node-tuning-operator/tuned-5d7nq" Jun 15 04:25:26.974392 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.973208 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/65679bf4-dd91-40a3-ba20-8a86fccc1f29-etc-kubernetes\") pod \"tuned-5d7nq\" (UID: \"65679bf4-dd91-40a3-ba20-8a86fccc1f29\") " pod="openshift-cluster-node-tuning-operator/tuned-5d7nq" Jun 15 04:25:26.974392 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.973212 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/60d517e2-146b-40e3-899a-9ed192a41a96-cnibin\") pod \"multus-dtzbz\" (UID: \"60d517e2-146b-40e3-899a-9ed192a41a96\") " pod="openshift-multus/multus-dtzbz" Jun 15 04:25:26.975108 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.973244 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/60d517e2-146b-40e3-899a-9ed192a41a96-host-var-lib-cni-bin\") pod \"multus-dtzbz\" (UID: \"60d517e2-146b-40e3-899a-9ed192a41a96\") " pod="openshift-multus/multus-dtzbz" Jun 15 04:25:26.975108 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.973257 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/60d517e2-146b-40e3-899a-9ed192a41a96-cnibin\") pod \"multus-dtzbz\" (UID: \"60d517e2-146b-40e3-899a-9ed192a41a96\") " pod="openshift-multus/multus-dtzbz" Jun 15 04:25:26.975108 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.973271 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/60d517e2-146b-40e3-899a-9ed192a41a96-hostroot\") pod \"multus-dtzbz\" (UID: \"60d517e2-146b-40e3-899a-9ed192a41a96\") " pod="openshift-multus/multus-dtzbz" Jun 15 04:25:26.975108 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.973293 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/65679bf4-dd91-40a3-ba20-8a86fccc1f29-sys\") pod \"tuned-5d7nq\" (UID: \"65679bf4-dd91-40a3-ba20-8a86fccc1f29\") " pod="openshift-cluster-node-tuning-operator/tuned-5d7nq" Jun 15 04:25:26.975108 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.973294 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/78c7be15-9916-443f-8d76-29dc1412a6ce-dbus\") pod \"global-pull-secret-syncer-ng2rb\" (UID: \"78c7be15-9916-443f-8d76-29dc1412a6ce\") " pod="kube-system/global-pull-secret-syncer-ng2rb" Jun 15 04:25:26.975108 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.973326 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/60d517e2-146b-40e3-899a-9ed192a41a96-hostroot\") pod \"multus-dtzbz\" (UID: \"60d517e2-146b-40e3-899a-9ed192a41a96\") " pod="openshift-multus/multus-dtzbz" Jun 15 04:25:26.975108 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.973296 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/60d517e2-146b-40e3-899a-9ed192a41a96-host-var-lib-cni-bin\") pod \"multus-dtzbz\" (UID: \"60d517e2-146b-40e3-899a-9ed192a41a96\") " pod="openshift-multus/multus-dtzbz" Jun 15 04:25:26.975108 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.973355 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f345d023-5952-44c4-800e-69cf4dba39a3-node-log\") pod \"ovnkube-node-8fqkk\" (UID: \"f345d023-5952-44c4-800e-69cf4dba39a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fqkk" Jun 15 04:25:26.975108 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.973383 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/60d517e2-146b-40e3-899a-9ed192a41a96-host-run-multus-certs\") pod \"multus-dtzbz\" (UID: \"60d517e2-146b-40e3-899a-9ed192a41a96\") " pod="openshift-multus/multus-dtzbz" Jun 15 04:25:26.975108 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.973386 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/78c7be15-9916-443f-8d76-29dc1412a6ce-dbus\") pod \"global-pull-secret-syncer-ng2rb\" (UID: \"78c7be15-9916-443f-8d76-29dc1412a6ce\") " pod="kube-system/global-pull-secret-syncer-ng2rb" Jun 15 04:25:26.975108 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.973421 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f345d023-5952-44c4-800e-69cf4dba39a3-host-kubelet\") pod \"ovnkube-node-8fqkk\" (UID: \"f345d023-5952-44c4-800e-69cf4dba39a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fqkk" Jun 15 04:25:26.975108 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.973427 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f345d023-5952-44c4-800e-69cf4dba39a3-node-log\") pod \"ovnkube-node-8fqkk\" (UID: \"f345d023-5952-44c4-800e-69cf4dba39a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fqkk" Jun 15 04:25:26.975108 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.973429 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/60d517e2-146b-40e3-899a-9ed192a41a96-host-run-multus-certs\") pod \"multus-dtzbz\" (UID: \"60d517e2-146b-40e3-899a-9ed192a41a96\") " pod="openshift-multus/multus-dtzbz" Jun 15 04:25:26.975108 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.973461 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f345d023-5952-44c4-800e-69cf4dba39a3-host-slash\") pod \"ovnkube-node-8fqkk\" (UID: \"f345d023-5952-44c4-800e-69cf4dba39a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fqkk" Jun 15 04:25:26.975108 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.973484 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f345d023-5952-44c4-800e-69cf4dba39a3-host-kubelet\") pod \"ovnkube-node-8fqkk\" (UID: \"f345d023-5952-44c4-800e-69cf4dba39a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fqkk" Jun 15 04:25:26.975108 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.973506 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/60d517e2-146b-40e3-899a-9ed192a41a96-cni-binary-copy\") pod \"multus-dtzbz\" (UID: \"60d517e2-146b-40e3-899a-9ed192a41a96\") " pod="openshift-multus/multus-dtzbz" Jun 15 04:25:26.975108 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.973522 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f345d023-5952-44c4-800e-69cf4dba39a3-host-slash\") pod \"ovnkube-node-8fqkk\" (UID: \"f345d023-5952-44c4-800e-69cf4dba39a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fqkk" Jun 15 04:25:26.975108 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.973529 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/60d517e2-146b-40e3-899a-9ed192a41a96-multus-conf-dir\") pod \"multus-dtzbz\" (UID: \"60d517e2-146b-40e3-899a-9ed192a41a96\") " pod="openshift-multus/multus-dtzbz" Jun 15 04:25:26.975794 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.973565 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/60d517e2-146b-40e3-899a-9ed192a41a96-multus-conf-dir\") pod \"multus-dtzbz\" (UID: \"60d517e2-146b-40e3-899a-9ed192a41a96\") " pod="openshift-multus/multus-dtzbz" Jun 15 04:25:26.975794 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.973569 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f345d023-5952-44c4-800e-69cf4dba39a3-ovnkube-config\") pod \"ovnkube-node-8fqkk\" (UID: \"f345d023-5952-44c4-800e-69cf4dba39a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fqkk" Jun 15 04:25:26.975794 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.973595 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f345d023-5952-44c4-800e-69cf4dba39a3-ovnkube-script-lib\") pod \"ovnkube-node-8fqkk\" (UID: \"f345d023-5952-44c4-800e-69cf4dba39a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fqkk" Jun 15 04:25:26.975794 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.973624 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qlks\" (UniqueName: \"kubernetes.io/projected/f345d023-5952-44c4-800e-69cf4dba39a3-kube-api-access-5qlks\") pod \"ovnkube-node-8fqkk\" (UID: \"f345d023-5952-44c4-800e-69cf4dba39a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fqkk" Jun 15 04:25:26.975794 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.973647 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/be43e236-891d-432a-834c-bc8ee5a8b117-agent-certs\") pod \"konnectivity-agent-jpvfh\" (UID: \"be43e236-891d-432a-834c-bc8ee5a8b117\") " pod="kube-system/konnectivity-agent-jpvfh" Jun 15 04:25:26.975794 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.973676 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/be43e236-891d-432a-834c-bc8ee5a8b117-konnectivity-ca\") pod \"konnectivity-agent-jpvfh\" (UID: \"be43e236-891d-432a-834c-bc8ee5a8b117\") " pod="kube-system/konnectivity-agent-jpvfh" Jun 15 04:25:26.975794 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.973680 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/65679bf4-dd91-40a3-ba20-8a86fccc1f29-etc-systemd\") pod \"tuned-5d7nq\" (UID: \"65679bf4-dd91-40a3-ba20-8a86fccc1f29\") " pod="openshift-cluster-node-tuning-operator/tuned-5d7nq" Jun 15 04:25:26.975794 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.973704 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cnwp\" (UniqueName: \"kubernetes.io/projected/fd16b391-af84-45b8-bbaf-e042e8a2c1e4-kube-api-access-8cnwp\") pod \"node-resolver-4znw7\" (UID: \"fd16b391-af84-45b8-bbaf-e042e8a2c1e4\") " pod="openshift-dns/node-resolver-4znw7" Jun 15 04:25:26.975794 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.973730 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f345d023-5952-44c4-800e-69cf4dba39a3-host-run-netns\") pod \"ovnkube-node-8fqkk\" (UID: \"f345d023-5952-44c4-800e-69cf4dba39a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fqkk" Jun 15 04:25:26.975794 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.973752 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f345d023-5952-44c4-800e-69cf4dba39a3-env-overrides\") pod \"ovnkube-node-8fqkk\" (UID: \"f345d023-5952-44c4-800e-69cf4dba39a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fqkk" Jun 15 04:25:26.975794 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.973777 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f345d023-5952-44c4-800e-69cf4dba39a3-ovn-node-metrics-cert\") pod \"ovnkube-node-8fqkk\" (UID: \"f345d023-5952-44c4-800e-69cf4dba39a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fqkk" Jun 15 04:25:26.975794 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.973782 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/65679bf4-dd91-40a3-ba20-8a86fccc1f29-etc-systemd\") pod \"tuned-5d7nq\" (UID: \"65679bf4-dd91-40a3-ba20-8a86fccc1f29\") " pod="openshift-cluster-node-tuning-operator/tuned-5d7nq" Jun 15 04:25:26.975794 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.973799 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/60d517e2-146b-40e3-899a-9ed192a41a96-system-cni-dir\") pod \"multus-dtzbz\" (UID: \"60d517e2-146b-40e3-899a-9ed192a41a96\") " pod="openshift-multus/multus-dtzbz" Jun 15 04:25:26.975794 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.973825 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/60d517e2-146b-40e3-899a-9ed192a41a96-multus-cni-dir\") pod \"multus-dtzbz\" (UID: \"60d517e2-146b-40e3-899a-9ed192a41a96\") " pod="openshift-multus/multus-dtzbz" Jun 15 04:25:26.975794 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.973849 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/60d517e2-146b-40e3-899a-9ed192a41a96-os-release\") pod \"multus-dtzbz\" (UID: \"60d517e2-146b-40e3-899a-9ed192a41a96\") " pod="openshift-multus/multus-dtzbz" Jun 15 04:25:26.975794 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.973873 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f345d023-5952-44c4-800e-69cf4dba39a3-log-socket\") pod \"ovnkube-node-8fqkk\" (UID: \"f345d023-5952-44c4-800e-69cf4dba39a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fqkk" Jun 15 04:25:26.975794 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.973895 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/65679bf4-dd91-40a3-ba20-8a86fccc1f29-etc-sysctl-conf\") pod \"tuned-5d7nq\" (UID: \"65679bf4-dd91-40a3-ba20-8a86fccc1f29\") " pod="openshift-cluster-node-tuning-operator/tuned-5d7nq" Jun 15 04:25:26.975794 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.974023 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/65679bf4-dd91-40a3-ba20-8a86fccc1f29-etc-sysctl-conf\") pod \"tuned-5d7nq\" (UID: \"65679bf4-dd91-40a3-ba20-8a86fccc1f29\") " pod="openshift-cluster-node-tuning-operator/tuned-5d7nq" Jun 15 04:25:26.976501 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.974053 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/60d517e2-146b-40e3-899a-9ed192a41a96-cni-binary-copy\") pod \"multus-dtzbz\" (UID: \"60d517e2-146b-40e3-899a-9ed192a41a96\") " pod="openshift-multus/multus-dtzbz" Jun 15 04:25:26.976501 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.974075 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/60d517e2-146b-40e3-899a-9ed192a41a96-multus-cni-dir\") pod \"multus-dtzbz\" (UID: \"60d517e2-146b-40e3-899a-9ed192a41a96\") " pod="openshift-multus/multus-dtzbz" Jun 15 04:25:26.976501 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.974092 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/60d517e2-146b-40e3-899a-9ed192a41a96-os-release\") pod \"multus-dtzbz\" (UID: \"60d517e2-146b-40e3-899a-9ed192a41a96\") " pod="openshift-multus/multus-dtzbz" Jun 15 04:25:26.976501 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.974119 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f345d023-5952-44c4-800e-69cf4dba39a3-log-socket\") pod \"ovnkube-node-8fqkk\" (UID: \"f345d023-5952-44c4-800e-69cf4dba39a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fqkk" Jun 15 04:25:26.976501 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.974136 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f345d023-5952-44c4-800e-69cf4dba39a3-host-run-netns\") pod \"ovnkube-node-8fqkk\" (UID: \"f345d023-5952-44c4-800e-69cf4dba39a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fqkk" Jun 15 04:25:26.976501 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.974139 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/60d517e2-146b-40e3-899a-9ed192a41a96-system-cni-dir\") pod \"multus-dtzbz\" (UID: \"60d517e2-146b-40e3-899a-9ed192a41a96\") " pod="openshift-multus/multus-dtzbz" Jun 15 04:25:26.976501 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.974191 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f345d023-5952-44c4-800e-69cf4dba39a3-ovnkube-config\") pod \"ovnkube-node-8fqkk\" (UID: \"f345d023-5952-44c4-800e-69cf4dba39a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fqkk" Jun 15 04:25:26.976501 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.974238 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/65679bf4-dd91-40a3-ba20-8a86fccc1f29-tmp\") pod \"tuned-5d7nq\" (UID: \"65679bf4-dd91-40a3-ba20-8a86fccc1f29\") " pod="openshift-cluster-node-tuning-operator/tuned-5d7nq" Jun 15 04:25:26.976501 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.974268 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/60d517e2-146b-40e3-899a-9ed192a41a96-host-run-k8s-cni-cncf-io\") pod \"multus-dtzbz\" (UID: \"60d517e2-146b-40e3-899a-9ed192a41a96\") " pod="openshift-multus/multus-dtzbz" Jun 15 04:25:26.976501 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.974274 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f345d023-5952-44c4-800e-69cf4dba39a3-ovnkube-script-lib\") pod \"ovnkube-node-8fqkk\" (UID: \"f345d023-5952-44c4-800e-69cf4dba39a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fqkk" Jun 15 04:25:26.976501 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.974294 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrzzl\" (UniqueName: \"kubernetes.io/projected/96ea42c2-0ad9-491c-b53c-b5efdff90674-kube-api-access-nrzzl\") pod \"iptables-alerter-kfmj5\" (UID: \"96ea42c2-0ad9-491c-b53c-b5efdff90674\") " pod="openshift-network-operator/iptables-alerter-kfmj5" Jun 15 04:25:26.976501 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.974330 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/60d517e2-146b-40e3-899a-9ed192a41a96-host-run-k8s-cni-cncf-io\") pod \"multus-dtzbz\" (UID: \"60d517e2-146b-40e3-899a-9ed192a41a96\") " pod="openshift-multus/multus-dtzbz" Jun 15 04:25:26.976501 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.974336 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f345d023-5952-44c4-800e-69cf4dba39a3-host-run-ovn-kubernetes\") pod \"ovnkube-node-8fqkk\" (UID: \"f345d023-5952-44c4-800e-69cf4dba39a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fqkk" Jun 15 04:25:26.976501 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.974376 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f345d023-5952-44c4-800e-69cf4dba39a3-host-run-ovn-kubernetes\") pod \"ovnkube-node-8fqkk\" (UID: \"f345d023-5952-44c4-800e-69cf4dba39a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fqkk" Jun 15 04:25:26.976501 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.974540 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f345d023-5952-44c4-800e-69cf4dba39a3-env-overrides\") pod \"ovnkube-node-8fqkk\" (UID: \"f345d023-5952-44c4-800e-69cf4dba39a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fqkk" Jun 15 04:25:26.976501 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.976211 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/65679bf4-dd91-40a3-ba20-8a86fccc1f29-etc-tuned\") pod \"tuned-5d7nq\" (UID: \"65679bf4-dd91-40a3-ba20-8a86fccc1f29\") " pod="openshift-cluster-node-tuning-operator/tuned-5d7nq" Jun 15 04:25:26.976501 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.976490 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/be43e236-891d-432a-834c-bc8ee5a8b117-agent-certs\") pod \"konnectivity-agent-jpvfh\" (UID: \"be43e236-891d-432a-834c-bc8ee5a8b117\") " pod="kube-system/konnectivity-agent-jpvfh" Jun 15 04:25:26.977087 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.976696 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/65679bf4-dd91-40a3-ba20-8a86fccc1f29-tmp\") pod \"tuned-5d7nq\" (UID: \"65679bf4-dd91-40a3-ba20-8a86fccc1f29\") " pod="openshift-cluster-node-tuning-operator/tuned-5d7nq" Jun 15 04:25:26.977087 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.976849 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f345d023-5952-44c4-800e-69cf4dba39a3-ovn-node-metrics-cert\") pod \"ovnkube-node-8fqkk\" (UID: \"f345d023-5952-44c4-800e-69cf4dba39a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fqkk" Jun 15 04:25:26.979455 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.979418 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcw68\" (UniqueName: \"kubernetes.io/projected/65679bf4-dd91-40a3-ba20-8a86fccc1f29-kube-api-access-mcw68\") pod \"tuned-5d7nq\" (UID: \"65679bf4-dd91-40a3-ba20-8a86fccc1f29\") " pod="openshift-cluster-node-tuning-operator/tuned-5d7nq" Jun 15 04:25:26.979565 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.979546 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwsfx\" (UniqueName: \"kubernetes.io/projected/60d517e2-146b-40e3-899a-9ed192a41a96-kube-api-access-kwsfx\") pod \"multus-dtzbz\" (UID: \"60d517e2-146b-40e3-899a-9ed192a41a96\") " pod="openshift-multus/multus-dtzbz" Jun 15 04:25:26.985942 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.985893 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrzzl\" (UniqueName: \"kubernetes.io/projected/96ea42c2-0ad9-491c-b53c-b5efdff90674-kube-api-access-nrzzl\") pod \"iptables-alerter-kfmj5\" (UID: \"96ea42c2-0ad9-491c-b53c-b5efdff90674\") " pod="openshift-network-operator/iptables-alerter-kfmj5" Jun 15 04:25:26.986321 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.986302 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cnwp\" (UniqueName: \"kubernetes.io/projected/fd16b391-af84-45b8-bbaf-e042e8a2c1e4-kube-api-access-8cnwp\") pod \"node-resolver-4znw7\" (UID: \"fd16b391-af84-45b8-bbaf-e042e8a2c1e4\") " pod="openshift-dns/node-resolver-4znw7" Jun 15 04:25:26.986421 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:26.986314 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qlks\" (UniqueName: \"kubernetes.io/projected/f345d023-5952-44c4-800e-69cf4dba39a3-kube-api-access-5qlks\") pod \"ovnkube-node-8fqkk\" (UID: \"f345d023-5952-44c4-800e-69cf4dba39a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-8fqkk" Jun 15 04:25:27.055240 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:27.055203 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-96sfm" Jun 15 04:25:27.065611 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:27.065588 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-b8vpm" Jun 15 04:25:27.074250 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:27.074217 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8vqzk" Jun 15 04:25:27.079974 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:27.079950 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jpvfh" Jun 15 04:25:27.087600 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:27.087581 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dtzbz" Jun 15 04:25:27.095204 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:27.095178 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kfmj5" Jun 15 04:25:27.102833 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:27.102807 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5d7nq" Jun 15 04:25:27.108383 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:27.108365 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4znw7" Jun 15 04:25:27.113113 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:27.113096 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8fqkk" Jun 15 04:25:27.377020 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:27.376934 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87abfa61-f00e-4746-9e96-f6940cbec767-metrics-certs\") pod \"network-metrics-daemon-4vqz4\" (UID: \"87abfa61-f00e-4746-9e96-f6940cbec767\") " pod="openshift-multus/network-metrics-daemon-4vqz4" Jun 15 04:25:27.377158 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:27.377081 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 04:25:27.377158 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:27.377137 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87abfa61-f00e-4746-9e96-f6940cbec767-metrics-certs podName:87abfa61-f00e-4746-9e96-f6940cbec767 nodeName:}" failed. No retries permitted until 2026-06-15 04:25:28.377123487 +0000 UTC m=+3.905114371 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/87abfa61-f00e-4746-9e96-f6940cbec767-metrics-certs") pod "network-metrics-daemon-4vqz4" (UID: "87abfa61-f00e-4746-9e96-f6940cbec767") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 04:25:27.477589 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:27.477562 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5zjq\" (UniqueName: \"kubernetes.io/projected/990077c4-c49d-4ae5-b011-c77744e70ea9-kube-api-access-l5zjq\") pod \"network-check-target-qwgsn\" (UID: \"990077c4-c49d-4ae5-b011-c77744e70ea9\") " pod="openshift-network-diagnostics/network-check-target-qwgsn" Jun 15 04:25:27.477754 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:27.477602 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/78c7be15-9916-443f-8d76-29dc1412a6ce-original-pull-secret\") pod \"global-pull-secret-syncer-ng2rb\" (UID: \"78c7be15-9916-443f-8d76-29dc1412a6ce\") " pod="kube-system/global-pull-secret-syncer-ng2rb" Jun 15 04:25:27.477754 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:27.477706 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 04:25:27.477754 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:27.477725 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 04:25:27.477754 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:27.477743 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 04:25:27.477754 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:27.477753 2561 projected.go:196] Error preparing data for projected volume kube-api-access-l5zjq for pod openshift-network-diagnostics/network-check-target-qwgsn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 04:25:27.477918 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:27.477754 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78c7be15-9916-443f-8d76-29dc1412a6ce-original-pull-secret podName:78c7be15-9916-443f-8d76-29dc1412a6ce nodeName:}" failed. No retries permitted until 2026-06-15 04:25:28.477740659 +0000 UTC m=+4.005731542 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/78c7be15-9916-443f-8d76-29dc1412a6ce-original-pull-secret") pod "global-pull-secret-syncer-ng2rb" (UID: "78c7be15-9916-443f-8d76-29dc1412a6ce") : object "kube-system"/"original-pull-secret" not registered Jun 15 04:25:27.477918 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:27.477814 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/990077c4-c49d-4ae5-b011-c77744e70ea9-kube-api-access-l5zjq podName:990077c4-c49d-4ae5-b011-c77744e70ea9 nodeName:}" failed. No retries permitted until 2026-06-15 04:25:28.477797456 +0000 UTC m=+4.005788344 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-l5zjq" (UniqueName: "kubernetes.io/projected/990077c4-c49d-4ae5-b011-c77744e70ea9-kube-api-access-l5zjq") pod "network-check-target-qwgsn" (UID: "990077c4-c49d-4ae5-b011-c77744e70ea9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 04:25:27.578453 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:27.578412 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90fa004f_1d43_402a_8a68_a5147aea49e6.slice/crio-fdf42cee36dc51da84d46d59aee4bc5c1985bbb1bbb12a21a8415974d6903e09 WatchSource:0}: Error finding container fdf42cee36dc51da84d46d59aee4bc5c1985bbb1bbb12a21a8415974d6903e09: Status 404 returned error can't find the container with id fdf42cee36dc51da84d46d59aee4bc5c1985bbb1bbb12a21a8415974d6903e09 Jun 15 04:25:27.579219 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:27.579191 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89608486_9c9e_4aa2_a842_ac5c48544dd0.slice/crio-b0fc0b6d56473d754818e79548d29d39991d40e508bfdd5d72aac59287497a43 WatchSource:0}: Error finding container b0fc0b6d56473d754818e79548d29d39991d40e508bfdd5d72aac59287497a43: Status 404 returned error can't find the container with id b0fc0b6d56473d754818e79548d29d39991d40e508bfdd5d72aac59287497a43 Jun 15 04:25:27.583571 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:27.583552 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe43e236_891d_432a_834c_bc8ee5a8b117.slice/crio-d0fee44d84e430b486e35cddba3da4835f6673e2cd605bd7b22fd68a98a989bf WatchSource:0}: Error finding container d0fee44d84e430b486e35cddba3da4835f6673e2cd605bd7b22fd68a98a989bf: Status 404 returned error can't find the container with id d0fee44d84e430b486e35cddba3da4835f6673e2cd605bd7b22fd68a98a989bf Jun 15 04:25:27.584490 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:27.584465 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96ea42c2_0ad9_491c_b53c_b5efdff90674.slice/crio-c582e2b0941973da429343e6c41aa064d05b9bb5b144add9fc0ea37f254c2cd3 WatchSource:0}: Error finding container c582e2b0941973da429343e6c41aa064d05b9bb5b144add9fc0ea37f254c2cd3: Status 404 returned error can't find the container with id c582e2b0941973da429343e6c41aa064d05b9bb5b144add9fc0ea37f254c2cd3 Jun 15 04:25:27.585222 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:27.585206 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd16b391_af84_45b8_bbaf_e042e8a2c1e4.slice/crio-6877206ddb87b48dd164f7000e829aaf4a10972999b840136a585de3f052f0d4 WatchSource:0}: Error finding container 6877206ddb87b48dd164f7000e829aaf4a10972999b840136a585de3f052f0d4: Status 404 returned error can't find the container with id 6877206ddb87b48dd164f7000e829aaf4a10972999b840136a585de3f052f0d4 Jun 15 04:25:27.613392 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:27.613368 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf345d023_5952_44c4_800e_69cf4dba39a3.slice/crio-3d80167d3e47f781cfa8455e7c778c7504571577b00894f6fc39c80c15b69ed1 WatchSource:0}: Error finding container 3d80167d3e47f781cfa8455e7c778c7504571577b00894f6fc39c80c15b69ed1: Status 404 returned error can't find the container with id 3d80167d3e47f781cfa8455e7c778c7504571577b00894f6fc39c80c15b69ed1 Jun 15 04:25:27.614216 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:27.614184 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60d517e2_146b_40e3_899a_9ed192a41a96.slice/crio-50eb40b3bca0519ff294a9dc2175064f11b4bf704a106d3707754527c99b1255 WatchSource:0}: Error finding container 50eb40b3bca0519ff294a9dc2175064f11b4bf704a106d3707754527c99b1255: Status 404 returned error can't find the container with id 50eb40b3bca0519ff294a9dc2175064f11b4bf704a106d3707754527c99b1255 Jun 15 04:25:27.615834 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:27.615603 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65679bf4_dd91_40a3_ba20_8a86fccc1f29.slice/crio-ab13baa7a4c8bc4b83df7f0ea620222c89290618bf041d5ac034b3346086cd15 WatchSource:0}: Error finding container ab13baa7a4c8bc4b83df7f0ea620222c89290618bf041d5ac034b3346086cd15: Status 404 returned error can't find the container with id ab13baa7a4c8bc4b83df7f0ea620222c89290618bf041d5ac034b3346086cd15 Jun 15 04:25:27.616106 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:27.616085 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73584bd0_85a5_4723_9271_4bca267f7b7a.slice/crio-73832532492a5e6727c82f9cc3d486b9e85f849e1c73b62cd865a172907a1429 WatchSource:0}: Error finding container 73832532492a5e6727c82f9cc3d486b9e85f849e1c73b62cd865a172907a1429: Status 404 returned error can't find the container with id 73832532492a5e6727c82f9cc3d486b9e85f849e1c73b62cd865a172907a1429 Jun 15 04:25:27.793165 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:27.792935 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-14 04:20:26 +0000 UTC" deadline="2027-11-21 08:35:03.167868114 +0000 UTC" Jun 15 04:25:27.793615 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:27.793172 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12580h9m35.374705914s" Jun 15 04:25:27.828816 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:27.828778 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5d7nq" event={"ID":"65679bf4-dd91-40a3-ba20-8a86fccc1f29","Type":"ContainerStarted","Data":"ab13baa7a4c8bc4b83df7f0ea620222c89290618bf041d5ac034b3346086cd15"} Jun 15 04:25:27.829753 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:27.829730 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dtzbz" event={"ID":"60d517e2-146b-40e3-899a-9ed192a41a96","Type":"ContainerStarted","Data":"50eb40b3bca0519ff294a9dc2175064f11b4bf704a106d3707754527c99b1255"} Jun 15 04:25:27.830700 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:27.830682 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8fqkk" event={"ID":"f345d023-5952-44c4-800e-69cf4dba39a3","Type":"ContainerStarted","Data":"3d80167d3e47f781cfa8455e7c778c7504571577b00894f6fc39c80c15b69ed1"} Jun 15 04:25:27.831673 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:27.831653 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4znw7" event={"ID":"fd16b391-af84-45b8-bbaf-e042e8a2c1e4","Type":"ContainerStarted","Data":"6877206ddb87b48dd164f7000e829aaf4a10972999b840136a585de3f052f0d4"} Jun 15 04:25:27.832516 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:27.832499 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jpvfh" event={"ID":"be43e236-891d-432a-834c-bc8ee5a8b117","Type":"ContainerStarted","Data":"d0fee44d84e430b486e35cddba3da4835f6673e2cd605bd7b22fd68a98a989bf"} Jun 15 04:25:27.833299 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:27.833276 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-96sfm" event={"ID":"90fa004f-1d43-402a-8a68-a5147aea49e6","Type":"ContainerStarted","Data":"fdf42cee36dc51da84d46d59aee4bc5c1985bbb1bbb12a21a8415974d6903e09"} Jun 15 04:25:27.835162 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:27.835140 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-86.ec2.internal" event={"ID":"e70cbef6b93985193b629bb99223d30c","Type":"ContainerStarted","Data":"0a63f0f70ac13e5463eb3da3c8dc9f336ed5e40d77f119bf73dc6c8777fc8c9f"} Jun 15 04:25:27.836122 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:27.836103 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8vqzk" event={"ID":"73584bd0-85a5-4723-9271-4bca267f7b7a","Type":"ContainerStarted","Data":"73832532492a5e6727c82f9cc3d486b9e85f849e1c73b62cd865a172907a1429"} Jun 15 04:25:27.837025 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:27.837004 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kfmj5" event={"ID":"96ea42c2-0ad9-491c-b53c-b5efdff90674","Type":"ContainerStarted","Data":"c582e2b0941973da429343e6c41aa064d05b9bb5b144add9fc0ea37f254c2cd3"} Jun 15 04:25:27.838079 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:27.838052 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b8vpm" event={"ID":"89608486-9c9e-4aa2-a842-ac5c48544dd0","Type":"ContainerStarted","Data":"b0fc0b6d56473d754818e79548d29d39991d40e508bfdd5d72aac59287497a43"} Jun 15 04:25:27.846991 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:27.846951 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-86.ec2.internal" podStartSLOduration=2.84693509 podStartE2EDuration="2.84693509s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 04:25:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:25:27.846427198 +0000 UTC m=+3.374418313" watchObservedRunningTime="2026-06-15 04:25:27.84693509 +0000 UTC m=+3.374925994" Jun 15 04:25:28.385288 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:28.385249 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87abfa61-f00e-4746-9e96-f6940cbec767-metrics-certs\") pod \"network-metrics-daemon-4vqz4\" (UID: \"87abfa61-f00e-4746-9e96-f6940cbec767\") " pod="openshift-multus/network-metrics-daemon-4vqz4" Jun 15 04:25:28.385492 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:28.385392 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 04:25:28.385492 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:28.385468 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87abfa61-f00e-4746-9e96-f6940cbec767-metrics-certs podName:87abfa61-f00e-4746-9e96-f6940cbec767 nodeName:}" failed. No retries permitted until 2026-06-15 04:25:30.385449522 +0000 UTC m=+5.913440419 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/87abfa61-f00e-4746-9e96-f6940cbec767-metrics-certs") pod "network-metrics-daemon-4vqz4" (UID: "87abfa61-f00e-4746-9e96-f6940cbec767") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 04:25:28.486406 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:28.486368 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5zjq\" (UniqueName: \"kubernetes.io/projected/990077c4-c49d-4ae5-b011-c77744e70ea9-kube-api-access-l5zjq\") pod \"network-check-target-qwgsn\" (UID: \"990077c4-c49d-4ae5-b011-c77744e70ea9\") " pod="openshift-network-diagnostics/network-check-target-qwgsn" Jun 15 04:25:28.486586 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:28.486447 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/78c7be15-9916-443f-8d76-29dc1412a6ce-original-pull-secret\") pod \"global-pull-secret-syncer-ng2rb\" (UID: \"78c7be15-9916-443f-8d76-29dc1412a6ce\") " pod="kube-system/global-pull-secret-syncer-ng2rb" Jun 15 04:25:28.486586 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:28.486583 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 04:25:28.486704 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:28.486644 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78c7be15-9916-443f-8d76-29dc1412a6ce-original-pull-secret podName:78c7be15-9916-443f-8d76-29dc1412a6ce nodeName:}" failed. No retries permitted until 2026-06-15 04:25:30.486624609 +0000 UTC m=+6.014615499 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/78c7be15-9916-443f-8d76-29dc1412a6ce-original-pull-secret") pod "global-pull-secret-syncer-ng2rb" (UID: "78c7be15-9916-443f-8d76-29dc1412a6ce") : object "kube-system"/"original-pull-secret" not registered Jun 15 04:25:28.487119 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:28.487096 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 04:25:28.487216 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:28.487140 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 04:25:28.487216 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:28.487154 2561 projected.go:196] Error preparing data for projected volume kube-api-access-l5zjq for pod openshift-network-diagnostics/network-check-target-qwgsn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 04:25:28.487322 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:28.487215 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/990077c4-c49d-4ae5-b011-c77744e70ea9-kube-api-access-l5zjq podName:990077c4-c49d-4ae5-b011-c77744e70ea9 nodeName:}" failed. No retries permitted until 2026-06-15 04:25:30.487200374 +0000 UTC m=+6.015191272 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-l5zjq" (UniqueName: "kubernetes.io/projected/990077c4-c49d-4ae5-b011-c77744e70ea9-kube-api-access-l5zjq") pod "network-check-target-qwgsn" (UID: "990077c4-c49d-4ae5-b011-c77744e70ea9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 04:25:28.794455 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:28.794325 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-14 04:20:26 +0000 UTC" deadline="2027-11-21 02:26:41.875309467 +0000 UTC" Jun 15 04:25:28.794455 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:28.794367 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12574h1m13.080947906s" Jun 15 04:25:28.823004 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:28.820122 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vqz4" Jun 15 04:25:28.823004 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:28.820256 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vqz4" podUID="87abfa61-f00e-4746-9e96-f6940cbec767" Jun 15 04:25:28.823004 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:28.820680 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qwgsn" Jun 15 04:25:28.823004 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:28.820766 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qwgsn" podUID="990077c4-c49d-4ae5-b011-c77744e70ea9" Jun 15 04:25:28.823004 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:28.820823 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ng2rb" Jun 15 04:25:28.823004 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:28.820892 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ng2rb" podUID="78c7be15-9916-443f-8d76-29dc1412a6ce" Jun 15 04:25:28.852975 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:28.852933 2561 generic.go:356] "Generic (PLEG): container finished" podID="bc443d1de53648cc2bff6103f22bd3b8" containerID="6220393f7092e8574b44ef3e0d2ddfc5768433ac028162d3ed8a9d0086f53cf9" exitCode=0 Jun 15 04:25:28.853510 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:28.853487 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-86.ec2.internal" event={"ID":"bc443d1de53648cc2bff6103f22bd3b8","Type":"ContainerDied","Data":"6220393f7092e8574b44ef3e0d2ddfc5768433ac028162d3ed8a9d0086f53cf9"} Jun 15 04:25:29.878881 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:29.878841 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-86.ec2.internal" event={"ID":"bc443d1de53648cc2bff6103f22bd3b8","Type":"ContainerStarted","Data":"a52ea4537bb4b182c9795253f7b4d7cb5b93af405ce1dd9cf30a96334d4ee3d8"} Jun 15 04:25:29.894180 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:29.894125 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-86.ec2.internal" podStartSLOduration=4.894104511 podStartE2EDuration="4.894104511s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 04:25:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:25:29.893112974 +0000 UTC m=+5.421103872" watchObservedRunningTime="2026-06-15 04:25:29.894104511 +0000 UTC m=+5.422095419" Jun 15 04:25:30.402543 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:30.402494 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87abfa61-f00e-4746-9e96-f6940cbec767-metrics-certs\") pod \"network-metrics-daemon-4vqz4\" (UID: \"87abfa61-f00e-4746-9e96-f6940cbec767\") " pod="openshift-multus/network-metrics-daemon-4vqz4" Jun 15 04:25:30.402722 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:30.402647 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 04:25:30.402722 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:30.402709 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87abfa61-f00e-4746-9e96-f6940cbec767-metrics-certs podName:87abfa61-f00e-4746-9e96-f6940cbec767 nodeName:}" failed. No retries permitted until 2026-06-15 04:25:34.402690402 +0000 UTC m=+9.930681292 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/87abfa61-f00e-4746-9e96-f6940cbec767-metrics-certs") pod "network-metrics-daemon-4vqz4" (UID: "87abfa61-f00e-4746-9e96-f6940cbec767") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 04:25:30.503862 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:30.503823 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5zjq\" (UniqueName: \"kubernetes.io/projected/990077c4-c49d-4ae5-b011-c77744e70ea9-kube-api-access-l5zjq\") pod \"network-check-target-qwgsn\" (UID: \"990077c4-c49d-4ae5-b011-c77744e70ea9\") " pod="openshift-network-diagnostics/network-check-target-qwgsn" Jun 15 04:25:30.504043 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:30.503885 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/78c7be15-9916-443f-8d76-29dc1412a6ce-original-pull-secret\") pod \"global-pull-secret-syncer-ng2rb\" (UID: \"78c7be15-9916-443f-8d76-29dc1412a6ce\") " pod="kube-system/global-pull-secret-syncer-ng2rb" Jun 15 04:25:30.504043 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:30.504034 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 04:25:30.504152 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:30.504096 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78c7be15-9916-443f-8d76-29dc1412a6ce-original-pull-secret podName:78c7be15-9916-443f-8d76-29dc1412a6ce nodeName:}" failed. No retries permitted until 2026-06-15 04:25:34.504078652 +0000 UTC m=+10.032069541 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/78c7be15-9916-443f-8d76-29dc1412a6ce-original-pull-secret") pod "global-pull-secret-syncer-ng2rb" (UID: "78c7be15-9916-443f-8d76-29dc1412a6ce") : object "kube-system"/"original-pull-secret" not registered Jun 15 04:25:30.504558 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:30.504540 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 04:25:30.504666 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:30.504562 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 04:25:30.504666 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:30.504575 2561 projected.go:196] Error preparing data for projected volume kube-api-access-l5zjq for pod openshift-network-diagnostics/network-check-target-qwgsn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 04:25:30.504666 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:30.504622 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/990077c4-c49d-4ae5-b011-c77744e70ea9-kube-api-access-l5zjq podName:990077c4-c49d-4ae5-b011-c77744e70ea9 nodeName:}" failed. No retries permitted until 2026-06-15 04:25:34.504607405 +0000 UTC m=+10.032598304 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-l5zjq" (UniqueName: "kubernetes.io/projected/990077c4-c49d-4ae5-b011-c77744e70ea9-kube-api-access-l5zjq") pod "network-check-target-qwgsn" (UID: "990077c4-c49d-4ae5-b011-c77744e70ea9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 04:25:30.819588 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:30.819504 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vqz4" Jun 15 04:25:30.819588 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:30.819527 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qwgsn" Jun 15 04:25:30.819800 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:30.819504 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ng2rb" Jun 15 04:25:30.819800 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:30.819663 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vqz4" podUID="87abfa61-f00e-4746-9e96-f6940cbec767" Jun 15 04:25:30.819800 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:30.819758 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ng2rb" podUID="78c7be15-9916-443f-8d76-29dc1412a6ce" Jun 15 04:25:30.819953 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:30.819836 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qwgsn" podUID="990077c4-c49d-4ae5-b011-c77744e70ea9" Jun 15 04:25:32.819647 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:32.819133 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qwgsn" Jun 15 04:25:32.819647 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:32.819168 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vqz4" Jun 15 04:25:32.819647 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:32.819133 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ng2rb" Jun 15 04:25:32.819647 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:32.819270 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qwgsn" podUID="990077c4-c49d-4ae5-b011-c77744e70ea9" Jun 15 04:25:32.819647 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:32.819357 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ng2rb" podUID="78c7be15-9916-443f-8d76-29dc1412a6ce" Jun 15 04:25:32.819647 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:32.819466 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vqz4" podUID="87abfa61-f00e-4746-9e96-f6940cbec767" Jun 15 04:25:34.439494 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:34.439386 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87abfa61-f00e-4746-9e96-f6940cbec767-metrics-certs\") pod \"network-metrics-daemon-4vqz4\" (UID: \"87abfa61-f00e-4746-9e96-f6940cbec767\") " pod="openshift-multus/network-metrics-daemon-4vqz4" Jun 15 04:25:34.440120 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:34.439546 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 04:25:34.440120 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:34.439642 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87abfa61-f00e-4746-9e96-f6940cbec767-metrics-certs podName:87abfa61-f00e-4746-9e96-f6940cbec767 nodeName:}" failed. No retries permitted until 2026-06-15 04:25:42.439621023 +0000 UTC m=+17.967611911 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/87abfa61-f00e-4746-9e96-f6940cbec767-metrics-certs") pod "network-metrics-daemon-4vqz4" (UID: "87abfa61-f00e-4746-9e96-f6940cbec767") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 04:25:34.540448 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:34.540399 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5zjq\" (UniqueName: \"kubernetes.io/projected/990077c4-c49d-4ae5-b011-c77744e70ea9-kube-api-access-l5zjq\") pod \"network-check-target-qwgsn\" (UID: \"990077c4-c49d-4ae5-b011-c77744e70ea9\") " pod="openshift-network-diagnostics/network-check-target-qwgsn" Jun 15 04:25:34.540627 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:34.540482 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/78c7be15-9916-443f-8d76-29dc1412a6ce-original-pull-secret\") pod \"global-pull-secret-syncer-ng2rb\" (UID: \"78c7be15-9916-443f-8d76-29dc1412a6ce\") " pod="kube-system/global-pull-secret-syncer-ng2rb" Jun 15 04:25:34.540627 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:34.540575 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 04:25:34.540627 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:34.540578 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 04:25:34.540786 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:34.540639 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78c7be15-9916-443f-8d76-29dc1412a6ce-original-pull-secret podName:78c7be15-9916-443f-8d76-29dc1412a6ce nodeName:}" failed. No retries permitted until 2026-06-15 04:25:42.540621298 +0000 UTC m=+18.068612196 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/78c7be15-9916-443f-8d76-29dc1412a6ce-original-pull-secret") pod "global-pull-secret-syncer-ng2rb" (UID: "78c7be15-9916-443f-8d76-29dc1412a6ce") : object "kube-system"/"original-pull-secret" not registered Jun 15 04:25:34.540786 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:34.540647 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 04:25:34.540786 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:34.540662 2561 projected.go:196] Error preparing data for projected volume kube-api-access-l5zjq for pod openshift-network-diagnostics/network-check-target-qwgsn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 04:25:34.540786 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:34.540700 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/990077c4-c49d-4ae5-b011-c77744e70ea9-kube-api-access-l5zjq podName:990077c4-c49d-4ae5-b011-c77744e70ea9 nodeName:}" failed. No retries permitted until 2026-06-15 04:25:42.540688461 +0000 UTC m=+18.068679357 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-l5zjq" (UniqueName: "kubernetes.io/projected/990077c4-c49d-4ae5-b011-c77744e70ea9-kube-api-access-l5zjq") pod "network-check-target-qwgsn" (UID: "990077c4-c49d-4ae5-b011-c77744e70ea9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 04:25:34.821083 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:34.820950 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qwgsn" Jun 15 04:25:34.821083 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:34.821065 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qwgsn" podUID="990077c4-c49d-4ae5-b011-c77744e70ea9" Jun 15 04:25:34.821277 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:34.821096 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ng2rb" Jun 15 04:25:34.821277 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:34.821114 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vqz4" Jun 15 04:25:34.821277 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:34.821164 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ng2rb" podUID="78c7be15-9916-443f-8d76-29dc1412a6ce" Jun 15 04:25:34.822196 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:34.822126 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vqz4" podUID="87abfa61-f00e-4746-9e96-f6940cbec767" Jun 15 04:25:36.819652 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:36.819617 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ng2rb" Jun 15 04:25:36.820088 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:36.819758 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ng2rb" podUID="78c7be15-9916-443f-8d76-29dc1412a6ce" Jun 15 04:25:36.820088 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:36.819623 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qwgsn" Jun 15 04:25:36.820088 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:36.819844 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qwgsn" podUID="990077c4-c49d-4ae5-b011-c77744e70ea9" Jun 15 04:25:36.820088 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:36.819623 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vqz4" Jun 15 04:25:36.820088 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:36.819932 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vqz4" podUID="87abfa61-f00e-4746-9e96-f6940cbec767" Jun 15 04:25:38.820152 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:38.820109 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ng2rb" Jun 15 04:25:38.820560 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:38.820110 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vqz4" Jun 15 04:25:38.820560 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:38.820238 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ng2rb" podUID="78c7be15-9916-443f-8d76-29dc1412a6ce" Jun 15 04:25:38.820560 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:38.820110 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qwgsn" Jun 15 04:25:38.820560 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:38.820328 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vqz4" podUID="87abfa61-f00e-4746-9e96-f6940cbec767" Jun 15 04:25:38.820560 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:38.820428 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qwgsn" podUID="990077c4-c49d-4ae5-b011-c77744e70ea9" Jun 15 04:25:40.819341 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:40.819312 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qwgsn" Jun 15 04:25:40.819341 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:40.819328 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vqz4" Jun 15 04:25:40.819856 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:40.819454 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qwgsn" podUID="990077c4-c49d-4ae5-b011-c77744e70ea9" Jun 15 04:25:40.819856 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:40.819527 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vqz4" podUID="87abfa61-f00e-4746-9e96-f6940cbec767" Jun 15 04:25:40.819856 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:40.819561 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ng2rb" Jun 15 04:25:40.819856 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:40.819664 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ng2rb" podUID="78c7be15-9916-443f-8d76-29dc1412a6ce" Jun 15 04:25:42.503596 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:42.503559 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87abfa61-f00e-4746-9e96-f6940cbec767-metrics-certs\") pod \"network-metrics-daemon-4vqz4\" (UID: \"87abfa61-f00e-4746-9e96-f6940cbec767\") " pod="openshift-multus/network-metrics-daemon-4vqz4" Jun 15 04:25:42.503997 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:42.503728 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 04:25:42.503997 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:42.503804 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87abfa61-f00e-4746-9e96-f6940cbec767-metrics-certs podName:87abfa61-f00e-4746-9e96-f6940cbec767 nodeName:}" failed. No retries permitted until 2026-06-15 04:25:58.50378852 +0000 UTC m=+34.031779404 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/87abfa61-f00e-4746-9e96-f6940cbec767-metrics-certs") pod "network-metrics-daemon-4vqz4" (UID: "87abfa61-f00e-4746-9e96-f6940cbec767") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 04:25:42.604239 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:42.604203 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5zjq\" (UniqueName: \"kubernetes.io/projected/990077c4-c49d-4ae5-b011-c77744e70ea9-kube-api-access-l5zjq\") pod \"network-check-target-qwgsn\" (UID: \"990077c4-c49d-4ae5-b011-c77744e70ea9\") " pod="openshift-network-diagnostics/network-check-target-qwgsn" Jun 15 04:25:42.604404 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:42.604252 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/78c7be15-9916-443f-8d76-29dc1412a6ce-original-pull-secret\") pod \"global-pull-secret-syncer-ng2rb\" (UID: \"78c7be15-9916-443f-8d76-29dc1412a6ce\") " pod="kube-system/global-pull-secret-syncer-ng2rb" Jun 15 04:25:42.604404 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:42.604370 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 04:25:42.604404 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:42.604394 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 04:25:42.604583 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:42.604421 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 04:25:42.604583 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:42.604434 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78c7be15-9916-443f-8d76-29dc1412a6ce-original-pull-secret podName:78c7be15-9916-443f-8d76-29dc1412a6ce nodeName:}" failed. No retries permitted until 2026-06-15 04:25:58.604417717 +0000 UTC m=+34.132408604 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/78c7be15-9916-443f-8d76-29dc1412a6ce-original-pull-secret") pod "global-pull-secret-syncer-ng2rb" (UID: "78c7be15-9916-443f-8d76-29dc1412a6ce") : object "kube-system"/"original-pull-secret" not registered Jun 15 04:25:42.604583 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:42.604449 2561 projected.go:196] Error preparing data for projected volume kube-api-access-l5zjq for pod openshift-network-diagnostics/network-check-target-qwgsn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 04:25:42.604583 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:42.604510 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/990077c4-c49d-4ae5-b011-c77744e70ea9-kube-api-access-l5zjq podName:990077c4-c49d-4ae5-b011-c77744e70ea9 nodeName:}" failed. No retries permitted until 2026-06-15 04:25:58.60449425 +0000 UTC m=+34.132485148 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-l5zjq" (UniqueName: "kubernetes.io/projected/990077c4-c49d-4ae5-b011-c77744e70ea9-kube-api-access-l5zjq") pod "network-check-target-qwgsn" (UID: "990077c4-c49d-4ae5-b011-c77744e70ea9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 04:25:42.819788 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:42.819710 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ng2rb" Jun 15 04:25:42.819963 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:42.819713 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vqz4" Jun 15 04:25:42.819963 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:42.819828 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ng2rb" podUID="78c7be15-9916-443f-8d76-29dc1412a6ce" Jun 15 04:25:42.819963 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:42.819846 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qwgsn" Jun 15 04:25:42.819963 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:42.819936 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vqz4" podUID="87abfa61-f00e-4746-9e96-f6940cbec767" Jun 15 04:25:42.820148 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:42.820024 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qwgsn" podUID="990077c4-c49d-4ae5-b011-c77744e70ea9" Jun 15 04:25:44.819987 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:44.819948 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vqz4" Jun 15 04:25:44.820462 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:44.820065 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qwgsn" Jun 15 04:25:44.820462 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:44.820068 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vqz4" podUID="87abfa61-f00e-4746-9e96-f6940cbec767" Jun 15 04:25:44.820462 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:44.820195 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qwgsn" podUID="990077c4-c49d-4ae5-b011-c77744e70ea9" Jun 15 04:25:44.820462 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:44.820230 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ng2rb" Jun 15 04:25:44.820462 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:44.820330 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ng2rb" podUID="78c7be15-9916-443f-8d76-29dc1412a6ce" Jun 15 04:25:46.820125 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:46.819887 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vqz4" Jun 15 04:25:46.821086 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:46.819882 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ng2rb" Jun 15 04:25:46.821086 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:46.819904 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qwgsn" Jun 15 04:25:46.821086 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:46.820257 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vqz4" podUID="87abfa61-f00e-4746-9e96-f6940cbec767" Jun 15 04:25:46.821086 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:46.820330 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ng2rb" podUID="78c7be15-9916-443f-8d76-29dc1412a6ce" Jun 15 04:25:46.821086 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:46.820390 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qwgsn" podUID="990077c4-c49d-4ae5-b011-c77744e70ea9" Jun 15 04:25:46.926652 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:46.926612 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8vqzk" event={"ID":"73584bd0-85a5-4723-9271-4bca267f7b7a","Type":"ContainerStarted","Data":"8bb94411c255d9562c17bf84ddd0415e2aea5b5d45058900620408a5fd89a10b"} Jun 15 04:25:46.928948 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:46.928915 2561 generic.go:356] "Generic (PLEG): container finished" podID="89608486-9c9e-4aa2-a842-ac5c48544dd0" containerID="e066cf4df1216a41acb376b4394e2f69470bf495380ac827db86ba7b06c8963d" exitCode=0 Jun 15 04:25:46.929083 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:46.929008 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b8vpm" event={"ID":"89608486-9c9e-4aa2-a842-ac5c48544dd0","Type":"ContainerDied","Data":"e066cf4df1216a41acb376b4394e2f69470bf495380ac827db86ba7b06c8963d"} Jun 15 04:25:46.934511 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:46.934472 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5d7nq" event={"ID":"65679bf4-dd91-40a3-ba20-8a86fccc1f29","Type":"ContainerStarted","Data":"415fb3a4300b38ce4c3eb428bb10f8aacc324090bc93b310699fba1410668cab"} Jun 15 04:25:46.936149 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:46.936125 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dtzbz" event={"ID":"60d517e2-146b-40e3-899a-9ed192a41a96","Type":"ContainerStarted","Data":"a8c73606a6534c0d5e7819aa41824a7de9e14f8c9b6cf2cd46913f737ff0d1d2"} Jun 15 04:25:46.939670 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:46.939652 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8fqkk_f345d023-5952-44c4-800e-69cf4dba39a3/ovn-acl-logging/0.log" Jun 15 04:25:46.940021 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:46.940002 2561 generic.go:356] "Generic (PLEG): container finished" podID="f345d023-5952-44c4-800e-69cf4dba39a3" containerID="accd6cd3b7740cd32daeb7d97cdfad56c4d88ba8d56415b3cc1378cc851ec0aa" exitCode=1 Jun 15 04:25:46.940096 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:46.940069 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8fqkk" event={"ID":"f345d023-5952-44c4-800e-69cf4dba39a3","Type":"ContainerStarted","Data":"a91b59331c6017aea72d7bb2244a3941728de214d610620c4fe6c920a74fbc74"} Jun 15 04:25:46.940146 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:46.940122 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8fqkk" event={"ID":"f345d023-5952-44c4-800e-69cf4dba39a3","Type":"ContainerStarted","Data":"36469aa3d92dd7735fb88f243cfeee376b5355e7066f92095b9d7da2eceaa8d9"} Jun 15 04:25:46.940198 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:46.940170 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8fqkk" event={"ID":"f345d023-5952-44c4-800e-69cf4dba39a3","Type":"ContainerStarted","Data":"c7882fd8a99d19d1d1f7e00a653d033b948a2d5b9d6d3d3173c4ceefb185bd62"} Jun 15 04:25:46.940247 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:46.940210 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8fqkk" event={"ID":"f345d023-5952-44c4-800e-69cf4dba39a3","Type":"ContainerStarted","Data":"da55807f4631caabf1e8848c18978d1243f6e0d63bbcfdab7fb54308e31a0810"} Jun 15 04:25:46.940247 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:46.940238 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8fqkk" event={"ID":"f345d023-5952-44c4-800e-69cf4dba39a3","Type":"ContainerDied","Data":"accd6cd3b7740cd32daeb7d97cdfad56c4d88ba8d56415b3cc1378cc851ec0aa"} Jun 15 04:25:46.940333 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:46.940268 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8fqkk" event={"ID":"f345d023-5952-44c4-800e-69cf4dba39a3","Type":"ContainerStarted","Data":"96167ca5b7c358380a8e04a16fc16c5df186a55706bcb8e3900753789d3ef066"} Jun 15 04:25:46.941601 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:46.941584 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4znw7" event={"ID":"fd16b391-af84-45b8-bbaf-e042e8a2c1e4","Type":"ContainerStarted","Data":"e772030a1855e2710930434bff7b445733607a5757eabb3253cd85fb10451ee2"} Jun 15 04:25:46.943053 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:46.943037 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jpvfh" event={"ID":"be43e236-891d-432a-834c-bc8ee5a8b117","Type":"ContainerStarted","Data":"d35feb707a8317b984e362ac4809b07388c5d20ce0eb7616243c24d3aab6c02a"} Jun 15 04:25:46.944954 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:46.944913 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-96sfm" event={"ID":"90fa004f-1d43-402a-8a68-a5147aea49e6","Type":"ContainerStarted","Data":"66d110eea4ad55c4e0bd04d8d948a754809cd797d00c457bcf660aca921f3a8b"} Jun 15 04:25:46.964092 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:46.964043 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-96sfm" podStartSLOduration=4.59400292 podStartE2EDuration="22.964025113s" totalImagesPullingTime="18.370022193s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 04:25:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:25:46.963465139 +0000 UTC m=+22.491456048" watchObservedRunningTime="2026-06-15 04:25:46.964025113 +0000 UTC m=+22.492016019" Jun 15 04:25:46.989724 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:46.989628 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-dtzbz" podStartSLOduration=3.618275485 podStartE2EDuration="21.989594922s" totalImagesPullingTime="18.371319437s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 04:25:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:25:46.989171289 +0000 UTC m=+22.517162193" watchObservedRunningTime="2026-06-15 04:25:46.989594922 +0000 UTC m=+22.517585826" Jun 15 04:25:46.989861 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:46.989811 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-jpvfh" podStartSLOduration=9.342812457 podStartE2EDuration="22.989802782s" totalImagesPullingTime="13.646990325s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 04:25:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:25:46.975037297 +0000 UTC m=+22.503028204" watchObservedRunningTime="2026-06-15 04:25:46.989802782 +0000 UTC m=+22.517793687" Jun 15 04:25:47.002967 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:47.002920 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-5d7nq" podStartSLOduration=3.670654393 podStartE2EDuration="22.002902621s" totalImagesPullingTime="18.332248228s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 04:25:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:25:47.002586224 +0000 UTC m=+22.530577147" watchObservedRunningTime="2026-06-15 04:25:47.002902621 +0000 UTC m=+22.530893527" Jun 15 04:25:47.015208 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:47.015168 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-4znw7" podStartSLOduration=3.676246551 podStartE2EDuration="22.015152069s" totalImagesPullingTime="18.338905518s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 04:25:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:25:47.015091192 +0000 UTC m=+22.543082098" watchObservedRunningTime="2026-06-15 04:25:47.015152069 +0000 UTC m=+22.543142974" Jun 15 04:25:47.631829 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:47.631804 2561 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 15 04:25:47.833885 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:47.833696 2561 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-15T04:25:47.631823564Z","UUID":"26b105d5-d9d0-4e9c-a154-78d2723e8334","Handler":null,"Name":"","Endpoint":""} Jun 15 04:25:47.835548 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:47.835524 2561 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 15 04:25:47.835675 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:47.835560 2561 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 15 04:25:47.950046 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:47.950011 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8vqzk" event={"ID":"73584bd0-85a5-4723-9271-4bca267f7b7a","Type":"ContainerStarted","Data":"b74a618b5245c20fd8dcd253d688c64ee4a2415544a2c2d57356071d11740e33"} Jun 15 04:25:47.951634 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:47.951555 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kfmj5" event={"ID":"96ea42c2-0ad9-491c-b53c-b5efdff90674","Type":"ContainerStarted","Data":"aa4937137549ec20149d6a9c878a157a9d8634d05befa974cc0671ae6e15894b"} Jun 15 04:25:47.965656 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:47.965601 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-kfmj5" podStartSLOduration=9.318560139 podStartE2EDuration="22.965586644s" totalImagesPullingTime="13.647026505s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 04:25:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:25:47.96509759 +0000 UTC m=+23.493088496" watchObservedRunningTime="2026-06-15 04:25:47.965586644 +0000 UTC m=+23.493577549" Jun 15 04:25:48.569711 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:48.569673 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-jpvfh" Jun 15 04:25:48.570402 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:48.570378 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-jpvfh" Jun 15 04:25:48.820165 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:48.820103 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qwgsn" Jun 15 04:25:48.820165 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:48.820122 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ng2rb" Jun 15 04:25:48.820306 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:48.820234 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vqz4" Jun 15 04:25:48.820306 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:48.820237 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qwgsn" podUID="990077c4-c49d-4ae5-b011-c77744e70ea9" Jun 15 04:25:48.820722 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:48.820536 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vqz4" podUID="87abfa61-f00e-4746-9e96-f6940cbec767" Jun 15 04:25:48.821006 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:48.820972 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ng2rb" podUID="78c7be15-9916-443f-8d76-29dc1412a6ce" Jun 15 04:25:48.956452 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:48.956400 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8vqzk" event={"ID":"73584bd0-85a5-4723-9271-4bca267f7b7a","Type":"ContainerStarted","Data":"88bd9c7e40275277f0b7f00ea4b8c686f37d8e6c2f293bd00f0c096fb70b0249"} Jun 15 04:25:48.957056 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:48.957013 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-jpvfh" Jun 15 04:25:48.957298 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:48.957280 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-jpvfh" Jun 15 04:25:48.971677 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:48.971637 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8vqzk" podStartSLOduration=4.374601604 podStartE2EDuration="24.971623375s" totalImagesPullingTime="20.597021771s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 04:25:24 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:25:48.971224441 +0000 UTC m=+24.499215346" watchObservedRunningTime="2026-06-15 04:25:48.971623375 +0000 UTC m=+24.499614281" Jun 15 04:25:49.962316 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:49.962146 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8fqkk_f345d023-5952-44c4-800e-69cf4dba39a3/ovn-acl-logging/0.log" Jun 15 04:25:49.962781 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:49.962751 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8fqkk" event={"ID":"f345d023-5952-44c4-800e-69cf4dba39a3","Type":"ContainerStarted","Data":"4685719cf1afc6166f0158ac0a5244e2f34b9e0da6d5b21803489bec098b7a52"} Jun 15 04:25:50.819451 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:50.819403 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vqz4" Jun 15 04:25:50.819672 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:50.819457 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ng2rb" Jun 15 04:25:50.819672 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:50.819403 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qwgsn" Jun 15 04:25:50.819672 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:50.819546 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vqz4" podUID="87abfa61-f00e-4746-9e96-f6940cbec767" Jun 15 04:25:50.819672 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:50.819621 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qwgsn" podUID="990077c4-c49d-4ae5-b011-c77744e70ea9" Jun 15 04:25:50.819882 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:50.819692 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ng2rb" podUID="78c7be15-9916-443f-8d76-29dc1412a6ce" Jun 15 04:25:51.969372 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:51.969186 2561 generic.go:356] "Generic (PLEG): container finished" podID="89608486-9c9e-4aa2-a842-ac5c48544dd0" containerID="c3a47360473ada8b5c851f73297ebf50a3f912848c5bd0b765780c2ce519945c" exitCode=0 Jun 15 04:25:51.970119 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:51.969271 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b8vpm" event={"ID":"89608486-9c9e-4aa2-a842-ac5c48544dd0","Type":"ContainerDied","Data":"c3a47360473ada8b5c851f73297ebf50a3f912848c5bd0b765780c2ce519945c"} Jun 15 04:25:51.976217 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:51.976194 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8fqkk_f345d023-5952-44c4-800e-69cf4dba39a3/ovn-acl-logging/0.log" Jun 15 04:25:51.976549 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:51.976529 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8fqkk" event={"ID":"f345d023-5952-44c4-800e-69cf4dba39a3","Type":"ContainerStarted","Data":"09755101919d9b64d5ca04dd3b3ed2f1ecd77a5bc3fc2fd0b21f464a60392299"} Jun 15 04:25:51.976765 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:51.976736 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8fqkk" Jun 15 04:25:51.976867 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:51.976814 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8fqkk" Jun 15 04:25:51.976867 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:51.976862 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8fqkk" Jun 15 04:25:51.976976 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:51.976926 2561 scope.go:117] "RemoveContainer" containerID="accd6cd3b7740cd32daeb7d97cdfad56c4d88ba8d56415b3cc1378cc851ec0aa" Jun 15 04:25:51.993552 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:51.993531 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8fqkk" Jun 15 04:25:51.993999 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:51.993982 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8fqkk" Jun 15 04:25:52.819944 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:52.819915 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qwgsn" Jun 15 04:25:52.820101 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:52.819920 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ng2rb" Jun 15 04:25:52.820101 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:52.820020 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qwgsn" podUID="990077c4-c49d-4ae5-b011-c77744e70ea9" Jun 15 04:25:52.820101 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:52.820048 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vqz4" Jun 15 04:25:52.820204 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:52.820153 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ng2rb" podUID="78c7be15-9916-443f-8d76-29dc1412a6ce" Jun 15 04:25:52.820266 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:52.820247 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vqz4" podUID="87abfa61-f00e-4746-9e96-f6940cbec767" Jun 15 04:25:52.981021 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:52.980986 2561 generic.go:356] "Generic (PLEG): container finished" podID="89608486-9c9e-4aa2-a842-ac5c48544dd0" containerID="22a89671f882b2066f88cf6eb0458127026c491f378f76d5a59c6cfe0170b38b" exitCode=0 Jun 15 04:25:52.981403 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:52.981068 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b8vpm" event={"ID":"89608486-9c9e-4aa2-a842-ac5c48544dd0","Type":"ContainerDied","Data":"22a89671f882b2066f88cf6eb0458127026c491f378f76d5a59c6cfe0170b38b"} Jun 15 04:25:52.984890 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:52.984875 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8fqkk_f345d023-5952-44c4-800e-69cf4dba39a3/ovn-acl-logging/0.log" Jun 15 04:25:52.985212 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:52.985194 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8fqkk" event={"ID":"f345d023-5952-44c4-800e-69cf4dba39a3","Type":"ContainerStarted","Data":"b7ee1fdfa4b75f5f83c2992fc5d27f22d33a1c744b215a1a165db9d4ef30e770"} Jun 15 04:25:53.029886 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:53.029839 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-8fqkk" podStartSLOduration=9.591275047 podStartE2EDuration="28.029826112s" totalImagesPullingTime="18.438551065s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 04:25:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:25:53.028774133 +0000 UTC m=+28.556765052" watchObservedRunningTime="2026-06-15 04:25:53.029826112 +0000 UTC m=+28.557817017" Jun 15 04:25:53.133730 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:53.133701 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ng2rb"] Jun 15 04:25:53.133878 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:53.133842 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ng2rb" Jun 15 04:25:53.133941 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:53.133922 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ng2rb" podUID="78c7be15-9916-443f-8d76-29dc1412a6ce" Jun 15 04:25:53.134285 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:53.134265 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qwgsn"] Jun 15 04:25:53.134355 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:53.134345 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qwgsn" Jun 15 04:25:53.134426 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:53.134409 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qwgsn" podUID="990077c4-c49d-4ae5-b011-c77744e70ea9" Jun 15 04:25:53.135847 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:53.135826 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4vqz4"] Jun 15 04:25:53.135965 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:53.135909 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vqz4" Jun 15 04:25:53.136025 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:53.135976 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vqz4" podUID="87abfa61-f00e-4746-9e96-f6940cbec767" Jun 15 04:25:53.990160 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:53.989957 2561 generic.go:356] "Generic (PLEG): container finished" podID="89608486-9c9e-4aa2-a842-ac5c48544dd0" containerID="629226ddaa769b148a2c16c33b8cddbd23faa235416fe4d900bca596a515e531" exitCode=0 Jun 15 04:25:53.990628 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:53.990033 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b8vpm" event={"ID":"89608486-9c9e-4aa2-a842-ac5c48544dd0","Type":"ContainerDied","Data":"629226ddaa769b148a2c16c33b8cddbd23faa235416fe4d900bca596a515e531"} Jun 15 04:25:54.820136 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:54.820095 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ng2rb" Jun 15 04:25:54.820320 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:54.820203 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ng2rb" podUID="78c7be15-9916-443f-8d76-29dc1412a6ce" Jun 15 04:25:54.820320 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:54.820218 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vqz4" Jun 15 04:25:54.820431 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:54.820377 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vqz4" podUID="87abfa61-f00e-4746-9e96-f6940cbec767" Jun 15 04:25:54.820431 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:54.820398 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qwgsn" Jun 15 04:25:54.820551 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:54.820482 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qwgsn" podUID="990077c4-c49d-4ae5-b011-c77744e70ea9" Jun 15 04:25:56.819531 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:56.819492 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ng2rb" Jun 15 04:25:56.819531 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:56.819525 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qwgsn" Jun 15 04:25:56.820220 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:56.819495 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vqz4" Jun 15 04:25:56.820220 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:56.819619 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ng2rb" podUID="78c7be15-9916-443f-8d76-29dc1412a6ce" Jun 15 04:25:56.820220 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:56.819707 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vqz4" podUID="87abfa61-f00e-4746-9e96-f6940cbec767" Jun 15 04:25:56.820220 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:56.819789 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qwgsn" podUID="990077c4-c49d-4ae5-b011-c77744e70ea9" Jun 15 04:25:58.528691 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:58.528612 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87abfa61-f00e-4746-9e96-f6940cbec767-metrics-certs\") pod \"network-metrics-daemon-4vqz4\" (UID: \"87abfa61-f00e-4746-9e96-f6940cbec767\") " pod="openshift-multus/network-metrics-daemon-4vqz4" Jun 15 04:25:58.529086 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:58.528721 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 04:25:58.529086 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:58.528769 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87abfa61-f00e-4746-9e96-f6940cbec767-metrics-certs podName:87abfa61-f00e-4746-9e96-f6940cbec767 nodeName:}" failed. No retries permitted until 2026-06-15 04:26:30.528756608 +0000 UTC m=+66.056747492 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/87abfa61-f00e-4746-9e96-f6940cbec767-metrics-certs") pod "network-metrics-daemon-4vqz4" (UID: "87abfa61-f00e-4746-9e96-f6940cbec767") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 04:25:58.629843 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:58.629808 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5zjq\" (UniqueName: \"kubernetes.io/projected/990077c4-c49d-4ae5-b011-c77744e70ea9-kube-api-access-l5zjq\") pod \"network-check-target-qwgsn\" (UID: \"990077c4-c49d-4ae5-b011-c77744e70ea9\") " pod="openshift-network-diagnostics/network-check-target-qwgsn" Jun 15 04:25:58.629993 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:58.629855 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/78c7be15-9916-443f-8d76-29dc1412a6ce-original-pull-secret\") pod \"global-pull-secret-syncer-ng2rb\" (UID: \"78c7be15-9916-443f-8d76-29dc1412a6ce\") " pod="kube-system/global-pull-secret-syncer-ng2rb" Jun 15 04:25:58.629993 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:58.629973 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 04:25:58.630072 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:58.630029 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78c7be15-9916-443f-8d76-29dc1412a6ce-original-pull-secret podName:78c7be15-9916-443f-8d76-29dc1412a6ce nodeName:}" failed. No retries permitted until 2026-06-15 04:26:30.630016303 +0000 UTC m=+66.158007190 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/78c7be15-9916-443f-8d76-29dc1412a6ce-original-pull-secret") pod "global-pull-secret-syncer-ng2rb" (UID: "78c7be15-9916-443f-8d76-29dc1412a6ce") : object "kube-system"/"original-pull-secret" not registered Jun 15 04:25:58.630072 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:58.629975 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 04:25:58.630166 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:58.630085 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 04:25:58.630166 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:58.630101 2561 projected.go:196] Error preparing data for projected volume kube-api-access-l5zjq for pod openshift-network-diagnostics/network-check-target-qwgsn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 04:25:58.630166 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:58.630145 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/990077c4-c49d-4ae5-b011-c77744e70ea9-kube-api-access-l5zjq podName:990077c4-c49d-4ae5-b011-c77744e70ea9 nodeName:}" failed. No retries permitted until 2026-06-15 04:26:30.630132908 +0000 UTC m=+66.158123805 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-l5zjq" (UniqueName: "kubernetes.io/projected/990077c4-c49d-4ae5-b011-c77744e70ea9-kube-api-access-l5zjq") pod "network-check-target-qwgsn" (UID: "990077c4-c49d-4ae5-b011-c77744e70ea9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 04:25:58.819420 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:58.819346 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qwgsn" Jun 15 04:25:58.819565 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:58.819350 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ng2rb" Jun 15 04:25:58.819565 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:58.819481 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qwgsn" podUID="990077c4-c49d-4ae5-b011-c77744e70ea9" Jun 15 04:25:58.819565 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:58.819358 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vqz4" Jun 15 04:25:58.819565 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:58.819538 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ng2rb" podUID="78c7be15-9916-443f-8d76-29dc1412a6ce" Jun 15 04:25:58.819758 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:58.819615 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4vqz4" podUID="87abfa61-f00e-4746-9e96-f6940cbec767" Jun 15 04:25:59.004585 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:59.004551 2561 generic.go:356] "Generic (PLEG): container finished" podID="89608486-9c9e-4aa2-a842-ac5c48544dd0" containerID="a00cd4280ad3690a38f4c71df6f5e7c47b651c6b767673cd9fae44e8ea146c3c" exitCode=0 Jun 15 04:25:59.004745 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:59.004599 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b8vpm" event={"ID":"89608486-9c9e-4aa2-a842-ac5c48544dd0","Type":"ContainerDied","Data":"a00cd4280ad3690a38f4c71df6f5e7c47b651c6b767673cd9fae44e8ea146c3c"} Jun 15 04:25:59.293935 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:59.293910 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-86.ec2.internal" event="NodeReady" Jun 15 04:25:59.294066 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:59.294034 2561 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 15 04:25:59.333533 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:59.333467 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-7xnm7"] Jun 15 04:25:59.349499 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:59.349473 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-fjpd5"] Jun 15 04:25:59.349631 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:59.349541 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7xnm7" Jun 15 04:25:59.351368 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:59.351339 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 15 04:25:59.351368 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:59.351348 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zvtcp\"" Jun 15 04:25:59.351547 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:59.351414 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 15 04:25:59.363982 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:59.363958 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7xnm7"] Jun 15 04:25:59.364076 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:59.363990 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fjpd5"] Jun 15 04:25:59.364076 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:59.364056 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fjpd5" Jun 15 04:25:59.365915 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:59.365892 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 15 04:25:59.366023 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:59.365931 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 15 04:25:59.366023 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:59.365990 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-kc4cf\"" Jun 15 04:25:59.366126 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:59.366041 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 15 04:25:59.436198 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:59.436159 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9bfaab4-82a7-48b0-8da5-3c0253207235-tmp-dir\") pod \"dns-default-7xnm7\" (UID: \"f9bfaab4-82a7-48b0-8da5-3c0253207235\") " pod="openshift-dns/dns-default-7xnm7" Jun 15 04:25:59.436367 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:59.436223 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f9bfaab4-82a7-48b0-8da5-3c0253207235-config-volume\") pod \"dns-default-7xnm7\" (UID: \"f9bfaab4-82a7-48b0-8da5-3c0253207235\") " pod="openshift-dns/dns-default-7xnm7" Jun 15 04:25:59.436367 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:59.436243 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9bfaab4-82a7-48b0-8da5-3c0253207235-metrics-tls\") pod \"dns-default-7xnm7\" (UID: \"f9bfaab4-82a7-48b0-8da5-3c0253207235\") " pod="openshift-dns/dns-default-7xnm7" Jun 15 04:25:59.436367 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:59.436324 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flx69\" (UniqueName: \"kubernetes.io/projected/f9bfaab4-82a7-48b0-8da5-3c0253207235-kube-api-access-flx69\") pod \"dns-default-7xnm7\" (UID: \"f9bfaab4-82a7-48b0-8da5-3c0253207235\") " pod="openshift-dns/dns-default-7xnm7" Jun 15 04:25:59.537524 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:59.537488 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/36d7d24f-8986-48c6-adc6-0a26989040fb-cert\") pod \"ingress-canary-fjpd5\" (UID: \"36d7d24f-8986-48c6-adc6-0a26989040fb\") " pod="openshift-ingress-canary/ingress-canary-fjpd5" Jun 15 04:25:59.538093 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:59.537547 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9bfaab4-82a7-48b0-8da5-3c0253207235-tmp-dir\") pod \"dns-default-7xnm7\" (UID: \"f9bfaab4-82a7-48b0-8da5-3c0253207235\") " pod="openshift-dns/dns-default-7xnm7" Jun 15 04:25:59.538093 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:59.537695 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f9bfaab4-82a7-48b0-8da5-3c0253207235-config-volume\") pod \"dns-default-7xnm7\" (UID: \"f9bfaab4-82a7-48b0-8da5-3c0253207235\") " pod="openshift-dns/dns-default-7xnm7" Jun 15 04:25:59.538093 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:59.537724 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9bfaab4-82a7-48b0-8da5-3c0253207235-metrics-tls\") pod \"dns-default-7xnm7\" (UID: \"f9bfaab4-82a7-48b0-8da5-3c0253207235\") " pod="openshift-dns/dns-default-7xnm7" Jun 15 04:25:59.538093 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:59.537756 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxrz5\" (UniqueName: \"kubernetes.io/projected/36d7d24f-8986-48c6-adc6-0a26989040fb-kube-api-access-gxrz5\") pod \"ingress-canary-fjpd5\" (UID: \"36d7d24f-8986-48c6-adc6-0a26989040fb\") " pod="openshift-ingress-canary/ingress-canary-fjpd5" Jun 15 04:25:59.538093 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:59.537855 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 04:25:59.538093 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:25:59.537911 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9bfaab4-82a7-48b0-8da5-3c0253207235-metrics-tls podName:f9bfaab4-82a7-48b0-8da5-3c0253207235 nodeName:}" failed. No retries permitted until 2026-06-15 04:26:00.037895183 +0000 UTC m=+35.565886069 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f9bfaab4-82a7-48b0-8da5-3c0253207235-metrics-tls") pod "dns-default-7xnm7" (UID: "f9bfaab4-82a7-48b0-8da5-3c0253207235") : secret "dns-default-metrics-tls" not found Jun 15 04:25:59.538093 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:59.537857 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flx69\" (UniqueName: \"kubernetes.io/projected/f9bfaab4-82a7-48b0-8da5-3c0253207235-kube-api-access-flx69\") pod \"dns-default-7xnm7\" (UID: \"f9bfaab4-82a7-48b0-8da5-3c0253207235\") " pod="openshift-dns/dns-default-7xnm7" Jun 15 04:25:59.538093 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:59.537858 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9bfaab4-82a7-48b0-8da5-3c0253207235-tmp-dir\") pod \"dns-default-7xnm7\" (UID: \"f9bfaab4-82a7-48b0-8da5-3c0253207235\") " pod="openshift-dns/dns-default-7xnm7" Jun 15 04:25:59.538479 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:59.538267 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f9bfaab4-82a7-48b0-8da5-3c0253207235-config-volume\") pod \"dns-default-7xnm7\" (UID: \"f9bfaab4-82a7-48b0-8da5-3c0253207235\") " pod="openshift-dns/dns-default-7xnm7" Jun 15 04:25:59.547348 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:59.547327 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-flx69\" (UniqueName: \"kubernetes.io/projected/f9bfaab4-82a7-48b0-8da5-3c0253207235-kube-api-access-flx69\") pod \"dns-default-7xnm7\" (UID: \"f9bfaab4-82a7-48b0-8da5-3c0253207235\") " pod="openshift-dns/dns-default-7xnm7" Jun 15 04:25:59.638312 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:59.638228 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/36d7d24f-8986-48c6-adc6-0a26989040fb-cert\") pod \"ingress-canary-fjpd5\" (UID: \"36d7d24f-8986-48c6-adc6-0a26989040fb\") " pod="openshift-ingress-canary/ingress-canary-fjpd5" Jun 15 04:25:59.638473 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:59.638348 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxrz5\" (UniqueName: \"kubernetes.io/projected/36d7d24f-8986-48c6-adc6-0a26989040fb-kube-api-access-gxrz5\") pod \"ingress-canary-fjpd5\" (UID: \"36d7d24f-8986-48c6-adc6-0a26989040fb\") " pod="openshift-ingress-canary/ingress-canary-fjpd5" Jun 15 04:25:59.640733 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:59.640710 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/36d7d24f-8986-48c6-adc6-0a26989040fb-cert\") pod \"ingress-canary-fjpd5\" (UID: \"36d7d24f-8986-48c6-adc6-0a26989040fb\") " pod="openshift-ingress-canary/ingress-canary-fjpd5" Jun 15 04:25:59.645477 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:59.645456 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxrz5\" (UniqueName: \"kubernetes.io/projected/36d7d24f-8986-48c6-adc6-0a26989040fb-kube-api-access-gxrz5\") pod \"ingress-canary-fjpd5\" (UID: \"36d7d24f-8986-48c6-adc6-0a26989040fb\") " pod="openshift-ingress-canary/ingress-canary-fjpd5" Jun 15 04:25:59.671485 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:59.671454 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fjpd5" Jun 15 04:25:59.878366 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:25:59.878050 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fjpd5"] Jun 15 04:25:59.880956 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:25:59.880930 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36d7d24f_8986_48c6_adc6_0a26989040fb.slice/crio-f3e953d6c13d6a90c3cd4e6fdd90017fe8a3081df2d8c181bbfb1c046e8639e9 WatchSource:0}: Error finding container f3e953d6c13d6a90c3cd4e6fdd90017fe8a3081df2d8c181bbfb1c046e8639e9: Status 404 returned error can't find the container with id f3e953d6c13d6a90c3cd4e6fdd90017fe8a3081df2d8c181bbfb1c046e8639e9 Jun 15 04:26:00.008033 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:26:00.007994 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fjpd5" event={"ID":"36d7d24f-8986-48c6-adc6-0a26989040fb","Type":"ContainerStarted","Data":"f3e953d6c13d6a90c3cd4e6fdd90017fe8a3081df2d8c181bbfb1c046e8639e9"} Jun 15 04:26:00.010874 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:26:00.010849 2561 generic.go:356] "Generic (PLEG): container finished" podID="89608486-9c9e-4aa2-a842-ac5c48544dd0" containerID="b37ef1ccee29fe60473570611db0c2f944a079e52dae4f75ca6d2e6dd9bcd732" exitCode=0 Jun 15 04:26:00.010999 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:26:00.010880 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b8vpm" event={"ID":"89608486-9c9e-4aa2-a842-ac5c48544dd0","Type":"ContainerDied","Data":"b37ef1ccee29fe60473570611db0c2f944a079e52dae4f75ca6d2e6dd9bcd732"} Jun 15 04:26:00.040228 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:26:00.040198 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9bfaab4-82a7-48b0-8da5-3c0253207235-metrics-tls\") pod \"dns-default-7xnm7\" (UID: \"f9bfaab4-82a7-48b0-8da5-3c0253207235\") " pod="openshift-dns/dns-default-7xnm7" Jun 15 04:26:00.040373 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:26:00.040349 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 04:26:00.040528 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:26:00.040406 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9bfaab4-82a7-48b0-8da5-3c0253207235-metrics-tls podName:f9bfaab4-82a7-48b0-8da5-3c0253207235 nodeName:}" failed. No retries permitted until 2026-06-15 04:26:01.040391829 +0000 UTC m=+36.568382718 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f9bfaab4-82a7-48b0-8da5-3c0253207235-metrics-tls") pod "dns-default-7xnm7" (UID: "f9bfaab4-82a7-48b0-8da5-3c0253207235") : secret "dns-default-metrics-tls" not found Jun 15 04:26:00.819907 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:26:00.819866 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ng2rb" Jun 15 04:26:00.820454 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:26:00.819875 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vqz4" Jun 15 04:26:00.820454 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:26:00.820071 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qwgsn" Jun 15 04:26:00.822314 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:26:00.822288 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 15 04:26:00.822458 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:26:00.822294 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 15 04:26:00.822840 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:26:00.822810 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fjm9q\"" Jun 15 04:26:00.822840 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:26:00.822821 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8s6z2\"" Jun 15 04:26:00.823085 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:26:00.823059 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 15 04:26:00.823085 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:26:00.823085 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 15 04:26:01.016186 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:26:01.016156 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b8vpm" event={"ID":"89608486-9c9e-4aa2-a842-ac5c48544dd0","Type":"ContainerStarted","Data":"198141f90bf6c32b78ac7e7ef088b9b5a528b3c7ca529fc142a81ae52f84e61d"} Jun 15 04:26:01.035713 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:26:01.035665 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-b8vpm" podStartSLOduration=9.023044146 podStartE2EDuration="37.035639802s" totalImagesPullingTime="28.012595656s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 04:25:24 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:26:01.034751037 +0000 UTC m=+36.562741954" watchObservedRunningTime="2026-06-15 04:26:01.035639802 +0000 UTC m=+36.563630703" Jun 15 04:26:01.046693 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:26:01.046670 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9bfaab4-82a7-48b0-8da5-3c0253207235-metrics-tls\") pod \"dns-default-7xnm7\" (UID: \"f9bfaab4-82a7-48b0-8da5-3c0253207235\") " pod="openshift-dns/dns-default-7xnm7" Jun 15 04:26:01.046847 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:26:01.046831 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 04:26:01.046915 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:26:01.046907 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9bfaab4-82a7-48b0-8da5-3c0253207235-metrics-tls podName:f9bfaab4-82a7-48b0-8da5-3c0253207235 nodeName:}" failed. No retries permitted until 2026-06-15 04:26:03.046887867 +0000 UTC m=+38.574878751 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f9bfaab4-82a7-48b0-8da5-3c0253207235-metrics-tls") pod "dns-default-7xnm7" (UID: "f9bfaab4-82a7-48b0-8da5-3c0253207235") : secret "dns-default-metrics-tls" not found Jun 15 04:26:02.019964 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:26:02.019928 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fjpd5" event={"ID":"36d7d24f-8986-48c6-adc6-0a26989040fb","Type":"ContainerStarted","Data":"9a947edbeff9f8e85036ed1e4d300de3f392a1da777f383187687e7fba864958"} Jun 15 04:26:02.035181 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:26:02.035128 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-fjpd5" podStartSLOduration=1.0796478999999999 podStartE2EDuration="3.035113159s" totalImagesPullingTime="1.955465259s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 04:25:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:26:02.034796334 +0000 UTC m=+37.562787238" watchObservedRunningTime="2026-06-15 04:26:02.035113159 +0000 UTC m=+37.563104063" Jun 15 04:26:03.061993 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:26:03.061901 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9bfaab4-82a7-48b0-8da5-3c0253207235-metrics-tls\") pod \"dns-default-7xnm7\" (UID: \"f9bfaab4-82a7-48b0-8da5-3c0253207235\") " pod="openshift-dns/dns-default-7xnm7" Jun 15 04:26:03.062431 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:26:03.062047 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 04:26:03.062431 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:26:03.062107 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9bfaab4-82a7-48b0-8da5-3c0253207235-metrics-tls podName:f9bfaab4-82a7-48b0-8da5-3c0253207235 nodeName:}" failed. No retries permitted until 2026-06-15 04:26:07.062092459 +0000 UTC m=+42.590083343 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f9bfaab4-82a7-48b0-8da5-3c0253207235-metrics-tls") pod "dns-default-7xnm7" (UID: "f9bfaab4-82a7-48b0-8da5-3c0253207235") : secret "dns-default-metrics-tls" not found Jun 15 04:26:07.087454 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:26:07.087416 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9bfaab4-82a7-48b0-8da5-3c0253207235-metrics-tls\") pod \"dns-default-7xnm7\" (UID: \"f9bfaab4-82a7-48b0-8da5-3c0253207235\") " pod="openshift-dns/dns-default-7xnm7" Jun 15 04:26:07.087885 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:26:07.087572 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 04:26:07.087885 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:26:07.087632 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9bfaab4-82a7-48b0-8da5-3c0253207235-metrics-tls podName:f9bfaab4-82a7-48b0-8da5-3c0253207235 nodeName:}" failed. No retries permitted until 2026-06-15 04:26:15.087616832 +0000 UTC m=+50.615607715 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f9bfaab4-82a7-48b0-8da5-3c0253207235-metrics-tls") pod "dns-default-7xnm7" (UID: "f9bfaab4-82a7-48b0-8da5-3c0253207235") : secret "dns-default-metrics-tls" not found Jun 15 04:26:15.141310 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:26:15.141266 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9bfaab4-82a7-48b0-8da5-3c0253207235-metrics-tls\") pod \"dns-default-7xnm7\" (UID: \"f9bfaab4-82a7-48b0-8da5-3c0253207235\") " pod="openshift-dns/dns-default-7xnm7" Jun 15 04:26:15.141914 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:26:15.141467 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 04:26:15.141914 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:26:15.141556 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9bfaab4-82a7-48b0-8da5-3c0253207235-metrics-tls podName:f9bfaab4-82a7-48b0-8da5-3c0253207235 nodeName:}" failed. No retries permitted until 2026-06-15 04:26:31.141531026 +0000 UTC m=+66.669521923 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f9bfaab4-82a7-48b0-8da5-3c0253207235-metrics-tls") pod "dns-default-7xnm7" (UID: "f9bfaab4-82a7-48b0-8da5-3c0253207235") : secret "dns-default-metrics-tls" not found Jun 15 04:26:24.001038 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:26:24.001011 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8fqkk" Jun 15 04:26:30.540398 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:26:30.540356 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87abfa61-f00e-4746-9e96-f6940cbec767-metrics-certs\") pod \"network-metrics-daemon-4vqz4\" (UID: \"87abfa61-f00e-4746-9e96-f6940cbec767\") " pod="openshift-multus/network-metrics-daemon-4vqz4" Jun 15 04:26:30.542622 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:26:30.542602 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 15 04:26:30.551177 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:26:30.551161 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 15 04:26:30.551258 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:26:30.551218 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87abfa61-f00e-4746-9e96-f6940cbec767-metrics-certs podName:87abfa61-f00e-4746-9e96-f6940cbec767 nodeName:}" failed. No retries permitted until 2026-06-15 04:27:34.551200088 +0000 UTC m=+130.079190985 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/87abfa61-f00e-4746-9e96-f6940cbec767-metrics-certs") pod "network-metrics-daemon-4vqz4" (UID: "87abfa61-f00e-4746-9e96-f6940cbec767") : secret "metrics-daemon-secret" not found Jun 15 04:26:30.641401 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:26:30.641366 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5zjq\" (UniqueName: \"kubernetes.io/projected/990077c4-c49d-4ae5-b011-c77744e70ea9-kube-api-access-l5zjq\") pod \"network-check-target-qwgsn\" (UID: \"990077c4-c49d-4ae5-b011-c77744e70ea9\") " pod="openshift-network-diagnostics/network-check-target-qwgsn" Jun 15 04:26:30.641401 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:26:30.641410 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/78c7be15-9916-443f-8d76-29dc1412a6ce-original-pull-secret\") pod \"global-pull-secret-syncer-ng2rb\" (UID: \"78c7be15-9916-443f-8d76-29dc1412a6ce\") " pod="kube-system/global-pull-secret-syncer-ng2rb" Jun 15 04:26:30.643803 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:26:30.643783 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 15 04:26:30.643872 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:26:30.643810 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 15 04:26:30.653586 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:26:30.653560 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 15 04:26:30.655303 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:26:30.655285 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/78c7be15-9916-443f-8d76-29dc1412a6ce-original-pull-secret\") pod \"global-pull-secret-syncer-ng2rb\" (UID: \"78c7be15-9916-443f-8d76-29dc1412a6ce\") " pod="kube-system/global-pull-secret-syncer-ng2rb" Jun 15 04:26:30.664513 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:26:30.664491 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5zjq\" (UniqueName: \"kubernetes.io/projected/990077c4-c49d-4ae5-b011-c77744e70ea9-kube-api-access-l5zjq\") pod \"network-check-target-qwgsn\" (UID: \"990077c4-c49d-4ae5-b011-c77744e70ea9\") " pod="openshift-network-diagnostics/network-check-target-qwgsn" Jun 15 04:26:30.831548 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:26:30.831475 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ng2rb" Jun 15 04:26:30.846778 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:26:30.846752 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fjm9q\"" Jun 15 04:26:30.855143 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:26:30.855125 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qwgsn" Jun 15 04:26:31.017101 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:26:31.017035 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ng2rb"] Jun 15 04:26:31.021150 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:26:31.021124 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78c7be15_9916_443f_8d76_29dc1412a6ce.slice/crio-0112c2dee458e2692eaeadd19b51000d2c0dd20d1afce12d92ee4942d93cd3de WatchSource:0}: Error finding container 0112c2dee458e2692eaeadd19b51000d2c0dd20d1afce12d92ee4942d93cd3de: Status 404 returned error can't find the container with id 0112c2dee458e2692eaeadd19b51000d2c0dd20d1afce12d92ee4942d93cd3de Jun 15 04:26:31.033922 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:26:31.033896 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qwgsn"] Jun 15 04:26:31.036785 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:26:31.036753 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod990077c4_c49d_4ae5_b011_c77744e70ea9.slice/crio-086d47e2e85d2cac0444a4bff4208f3b5e77d38c9b2e7c61db9d3c3cbd7b5c7b WatchSource:0}: Error finding container 086d47e2e85d2cac0444a4bff4208f3b5e77d38c9b2e7c61db9d3c3cbd7b5c7b: Status 404 returned error can't find the container with id 086d47e2e85d2cac0444a4bff4208f3b5e77d38c9b2e7c61db9d3c3cbd7b5c7b Jun 15 04:26:31.089326 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:26:31.089246 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qwgsn" event={"ID":"990077c4-c49d-4ae5-b011-c77744e70ea9","Type":"ContainerStarted","Data":"086d47e2e85d2cac0444a4bff4208f3b5e77d38c9b2e7c61db9d3c3cbd7b5c7b"} Jun 15 04:26:31.090311 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:26:31.090283 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ng2rb" event={"ID":"78c7be15-9916-443f-8d76-29dc1412a6ce","Type":"ContainerStarted","Data":"0112c2dee458e2692eaeadd19b51000d2c0dd20d1afce12d92ee4942d93cd3de"} Jun 15 04:26:31.147419 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:26:31.147388 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9bfaab4-82a7-48b0-8da5-3c0253207235-metrics-tls\") pod \"dns-default-7xnm7\" (UID: \"f9bfaab4-82a7-48b0-8da5-3c0253207235\") " pod="openshift-dns/dns-default-7xnm7" Jun 15 04:26:31.147586 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:26:31.147534 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 04:26:31.147626 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:26:31.147593 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9bfaab4-82a7-48b0-8da5-3c0253207235-metrics-tls podName:f9bfaab4-82a7-48b0-8da5-3c0253207235 nodeName:}" failed. No retries permitted until 2026-06-15 04:27:03.147577365 +0000 UTC m=+98.675568251 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f9bfaab4-82a7-48b0-8da5-3c0253207235-metrics-tls") pod "dns-default-7xnm7" (UID: "f9bfaab4-82a7-48b0-8da5-3c0253207235") : secret "dns-default-metrics-tls" not found Jun 15 04:26:36.104945 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:26:36.104907 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ng2rb" event={"ID":"78c7be15-9916-443f-8d76-29dc1412a6ce","Type":"ContainerStarted","Data":"666224e44bce0a06ae1f9527cf0c9995fe66e3b01ab6eebb847695585474ba2b"} Jun 15 04:26:36.106309 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:26:36.106280 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qwgsn" event={"ID":"990077c4-c49d-4ae5-b011-c77744e70ea9","Type":"ContainerStarted","Data":"34b6c08d7ab6b27fc35c2b0b3183436c26001e06b50a8d8971dcf18deec80ea9"} Jun 15 04:26:36.106411 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:26:36.106398 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-qwgsn" Jun 15 04:26:36.117694 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:26:36.117642 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-ng2rb" podStartSLOduration=66.671929764 podStartE2EDuration="1m11.117629388s" totalImagesPullingTime="4.445699624s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 04:25:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:26:36.11724175 +0000 UTC m=+71.645232655" watchObservedRunningTime="2026-06-15 04:26:36.117629388 +0000 UTC m=+71.645620290" Jun 15 04:26:36.129969 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:26:36.129930 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-qwgsn" podStartSLOduration=67.704366841 podStartE2EDuration="1m12.129918113s" totalImagesPullingTime="4.425551272s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 04:25:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:26:36.129246947 +0000 UTC m=+71.657237849" watchObservedRunningTime="2026-06-15 04:26:36.129918113 +0000 UTC m=+71.657909008" Jun 15 04:27:03.164573 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:27:03.164543 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9bfaab4-82a7-48b0-8da5-3c0253207235-metrics-tls\") pod \"dns-default-7xnm7\" (UID: \"f9bfaab4-82a7-48b0-8da5-3c0253207235\") " pod="openshift-dns/dns-default-7xnm7" Jun 15 04:27:03.164988 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:27:03.164676 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 04:27:03.164988 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:27:03.164736 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9bfaab4-82a7-48b0-8da5-3c0253207235-metrics-tls podName:f9bfaab4-82a7-48b0-8da5-3c0253207235 nodeName:}" failed. No retries permitted until 2026-06-15 04:28:07.164722853 +0000 UTC m=+162.692713739 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f9bfaab4-82a7-48b0-8da5-3c0253207235-metrics-tls") pod "dns-default-7xnm7" (UID: "f9bfaab4-82a7-48b0-8da5-3c0253207235") : secret "dns-default-metrics-tls" not found Jun 15 04:27:07.111262 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:27:07.111237 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-qwgsn" Jun 15 04:27:34.568093 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:27:34.568022 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87abfa61-f00e-4746-9e96-f6940cbec767-metrics-certs\") pod \"network-metrics-daemon-4vqz4\" (UID: \"87abfa61-f00e-4746-9e96-f6940cbec767\") " pod="openshift-multus/network-metrics-daemon-4vqz4" Jun 15 04:27:34.568604 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:27:34.568176 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 15 04:27:34.568604 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:27:34.568244 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87abfa61-f00e-4746-9e96-f6940cbec767-metrics-certs podName:87abfa61-f00e-4746-9e96-f6940cbec767 nodeName:}" failed. No retries permitted until 2026-06-15 04:29:36.568227638 +0000 UTC m=+252.096218521 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/87abfa61-f00e-4746-9e96-f6940cbec767-metrics-certs") pod "network-metrics-daemon-4vqz4" (UID: "87abfa61-f00e-4746-9e96-f6940cbec767") : secret "metrics-daemon-secret" not found Jun 15 04:28:02.359010 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:28:02.358965 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-7xnm7" podUID="f9bfaab4-82a7-48b0-8da5-3c0253207235" Jun 15 04:28:03.302942 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:28:03.302910 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7xnm7" Jun 15 04:28:03.839616 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:28:03.839565 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-4vqz4" podUID="87abfa61-f00e-4746-9e96-f6940cbec767" Jun 15 04:28:07.179826 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:28:07.179781 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9bfaab4-82a7-48b0-8da5-3c0253207235-metrics-tls\") pod \"dns-default-7xnm7\" (UID: \"f9bfaab4-82a7-48b0-8da5-3c0253207235\") " pod="openshift-dns/dns-default-7xnm7" Jun 15 04:28:07.180259 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:28:07.179912 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 04:28:07.180259 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:28:07.179973 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9bfaab4-82a7-48b0-8da5-3c0253207235-metrics-tls podName:f9bfaab4-82a7-48b0-8da5-3c0253207235 nodeName:}" failed. No retries permitted until 2026-06-15 04:30:09.179957949 +0000 UTC m=+284.707948832 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f9bfaab4-82a7-48b0-8da5-3c0253207235-metrics-tls") pod "dns-default-7xnm7" (UID: "f9bfaab4-82a7-48b0-8da5-3c0253207235") : secret "dns-default-metrics-tls" not found Jun 15 04:28:16.820058 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:28:16.820026 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vqz4" Jun 15 04:29:02.112848 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:02.112804 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-vftjx"] Jun 15 04:29:02.115776 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:02.115752 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7dccd94c8f-rbvhf"] Jun 15 04:29:02.115913 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:02.115874 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-vftjx" Jun 15 04:29:02.118138 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:02.118119 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 15 04:29:02.118255 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:02.118141 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-gmzx9\"" Jun 15 04:29:02.118255 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:02.118143 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 15 04:29:02.118255 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:02.118164 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 15 04:29:02.118500 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:02.118485 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7dccd94c8f-rbvhf" Jun 15 04:29:02.120498 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:02.120477 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 15 04:29:02.120498 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:02.120488 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-8jjd9\"" Jun 15 04:29:02.120765 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:02.120744 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 15 04:29:02.121184 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:02.121164 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 15 04:29:02.125298 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:02.125279 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-vftjx"] Jun 15 04:29:02.127419 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:02.127402 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 15 04:29:02.136870 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:02.136663 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7dccd94c8f-rbvhf"] Jun 15 04:29:02.148778 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:02.148756 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/95e71c9a-91b3-441d-a762-b90057fa6ac1-registry-tls\") pod \"image-registry-7dccd94c8f-rbvhf\" (UID: \"95e71c9a-91b3-441d-a762-b90057fa6ac1\") " pod="openshift-image-registry/image-registry-7dccd94c8f-rbvhf" Jun 15 04:29:02.148892 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:02.148788 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gsbqp\" (UniqueName: \"kubernetes.io/projected/95e71c9a-91b3-441d-a762-b90057fa6ac1-kube-api-access-gsbqp\") pod \"image-registry-7dccd94c8f-rbvhf\" (UID: \"95e71c9a-91b3-441d-a762-b90057fa6ac1\") " pod="openshift-image-registry/image-registry-7dccd94c8f-rbvhf" Jun 15 04:29:02.148892 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:02.148824 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/95e71c9a-91b3-441d-a762-b90057fa6ac1-bound-sa-token\") pod \"image-registry-7dccd94c8f-rbvhf\" (UID: \"95e71c9a-91b3-441d-a762-b90057fa6ac1\") " pod="openshift-image-registry/image-registry-7dccd94c8f-rbvhf" Jun 15 04:29:02.148967 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:02.148922 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/95e71c9a-91b3-441d-a762-b90057fa6ac1-installation-pull-secrets\") pod \"image-registry-7dccd94c8f-rbvhf\" (UID: \"95e71c9a-91b3-441d-a762-b90057fa6ac1\") " pod="openshift-image-registry/image-registry-7dccd94c8f-rbvhf" Jun 15 04:29:02.148967 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:02.148949 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1afb59b4-9a11-44a4-b887-787a31d4d906-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-vftjx\" (UID: \"1afb59b4-9a11-44a4-b887-787a31d4d906\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-vftjx" Jun 15 04:29:02.149056 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:02.148965 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smtqt\" (UniqueName: \"kubernetes.io/projected/1afb59b4-9a11-44a4-b887-787a31d4d906-kube-api-access-smtqt\") pod \"cluster-samples-operator-9547488fd-vftjx\" (UID: \"1afb59b4-9a11-44a4-b887-787a31d4d906\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-vftjx" Jun 15 04:29:02.149056 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:02.148996 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/95e71c9a-91b3-441d-a762-b90057fa6ac1-image-registry-private-configuration\") pod \"image-registry-7dccd94c8f-rbvhf\" (UID: \"95e71c9a-91b3-441d-a762-b90057fa6ac1\") " pod="openshift-image-registry/image-registry-7dccd94c8f-rbvhf" Jun 15 04:29:02.149056 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:02.149029 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/95e71c9a-91b3-441d-a762-b90057fa6ac1-ca-trust-extracted\") pod \"image-registry-7dccd94c8f-rbvhf\" (UID: \"95e71c9a-91b3-441d-a762-b90057fa6ac1\") " pod="openshift-image-registry/image-registry-7dccd94c8f-rbvhf" Jun 15 04:29:02.149154 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:02.149081 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/95e71c9a-91b3-441d-a762-b90057fa6ac1-trusted-ca\") pod \"image-registry-7dccd94c8f-rbvhf\" (UID: \"95e71c9a-91b3-441d-a762-b90057fa6ac1\") " pod="openshift-image-registry/image-registry-7dccd94c8f-rbvhf" Jun 15 04:29:02.149154 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:02.149110 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/95e71c9a-91b3-441d-a762-b90057fa6ac1-registry-certificates\") pod \"image-registry-7dccd94c8f-rbvhf\" (UID: \"95e71c9a-91b3-441d-a762-b90057fa6ac1\") " pod="openshift-image-registry/image-registry-7dccd94c8f-rbvhf" Jun 15 04:29:02.210648 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:02.210610 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-7rsjb"] Jun 15 04:29:02.213428 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:02.213413 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-7rsjb" Jun 15 04:29:02.215308 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:02.215279 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 15 04:29:02.215591 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:02.215574 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 15 04:29:02.215676 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:02.215658 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 15 04:29:02.215733 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:02.215680 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-qnkfr\"" Jun 15 04:29:02.215733 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:02.215697 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 15 04:29:02.224242 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:02.224221 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-7rsjb"] Jun 15 04:29:02.249383 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:02.249351 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xttbv\" (UniqueName: \"kubernetes.io/projected/a865e14d-8cfa-4465-bd6e-56ac84b2f7cd-kube-api-access-xttbv\") pod \"kube-storage-version-migrator-operator-7c578b78fc-7rsjb\" (UID: \"a865e14d-8cfa-4465-bd6e-56ac84b2f7cd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-7rsjb" Jun 15 04:29:02.249560 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:02.249398 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/95e71c9a-91b3-441d-a762-b90057fa6ac1-installation-pull-secrets\") pod \"image-registry-7dccd94c8f-rbvhf\" (UID: \"95e71c9a-91b3-441d-a762-b90057fa6ac1\") " pod="openshift-image-registry/image-registry-7dccd94c8f-rbvhf" Jun 15 04:29:02.249560 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:02.249427 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1afb59b4-9a11-44a4-b887-787a31d4d906-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-vftjx\" (UID: \"1afb59b4-9a11-44a4-b887-787a31d4d906\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-vftjx" Jun 15 04:29:02.249560 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:02.249467 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smtqt\" (UniqueName: \"kubernetes.io/projected/1afb59b4-9a11-44a4-b887-787a31d4d906-kube-api-access-smtqt\") pod \"cluster-samples-operator-9547488fd-vftjx\" (UID: \"1afb59b4-9a11-44a4-b887-787a31d4d906\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-vftjx" Jun 15 04:29:02.249560 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:02.249510 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/95e71c9a-91b3-441d-a762-b90057fa6ac1-image-registry-private-configuration\") pod \"image-registry-7dccd94c8f-rbvhf\" (UID: \"95e71c9a-91b3-441d-a762-b90057fa6ac1\") " pod="openshift-image-registry/image-registry-7dccd94c8f-rbvhf" Jun 15 04:29:02.249560 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:02.249535 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/95e71c9a-91b3-441d-a762-b90057fa6ac1-ca-trust-extracted\") pod \"image-registry-7dccd94c8f-rbvhf\" (UID: \"95e71c9a-91b3-441d-a762-b90057fa6ac1\") " pod="openshift-image-registry/image-registry-7dccd94c8f-rbvhf" Jun 15 04:29:02.249560 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:02.249557 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/95e71c9a-91b3-441d-a762-b90057fa6ac1-trusted-ca\") pod \"image-registry-7dccd94c8f-rbvhf\" (UID: \"95e71c9a-91b3-441d-a762-b90057fa6ac1\") " pod="openshift-image-registry/image-registry-7dccd94c8f-rbvhf" Jun 15 04:29:02.249844 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:29:02.249561 2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 15 04:29:02.249844 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:02.249582 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/95e71c9a-91b3-441d-a762-b90057fa6ac1-registry-certificates\") pod \"image-registry-7dccd94c8f-rbvhf\" (UID: \"95e71c9a-91b3-441d-a762-b90057fa6ac1\") " pod="openshift-image-registry/image-registry-7dccd94c8f-rbvhf" Jun 15 04:29:02.249844 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:02.249614 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a865e14d-8cfa-4465-bd6e-56ac84b2f7cd-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-7rsjb\" (UID: \"a865e14d-8cfa-4465-bd6e-56ac84b2f7cd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-7rsjb" Jun 15 04:29:02.249844 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:29:02.249647 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1afb59b4-9a11-44a4-b887-787a31d4d906-samples-operator-tls podName:1afb59b4-9a11-44a4-b887-787a31d4d906 nodeName:}" failed. No retries permitted until 2026-06-15 04:29:02.749627243 +0000 UTC m=+218.277618126 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1afb59b4-9a11-44a4-b887-787a31d4d906-samples-operator-tls") pod "cluster-samples-operator-9547488fd-vftjx" (UID: "1afb59b4-9a11-44a4-b887-787a31d4d906") : secret "samples-operator-tls" not found Jun 15 04:29:02.249844 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:02.249751 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/95e71c9a-91b3-441d-a762-b90057fa6ac1-registry-tls\") pod \"image-registry-7dccd94c8f-rbvhf\" (UID: \"95e71c9a-91b3-441d-a762-b90057fa6ac1\") " pod="openshift-image-registry/image-registry-7dccd94c8f-rbvhf" Jun 15 04:29:02.249844 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:02.249779 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gsbqp\" (UniqueName: \"kubernetes.io/projected/95e71c9a-91b3-441d-a762-b90057fa6ac1-kube-api-access-gsbqp\") pod \"image-registry-7dccd94c8f-rbvhf\" (UID: \"95e71c9a-91b3-441d-a762-b90057fa6ac1\") " pod="openshift-image-registry/image-registry-7dccd94c8f-rbvhf" Jun 15 04:29:02.249844 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:02.249820 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/95e71c9a-91b3-441d-a762-b90057fa6ac1-bound-sa-token\") pod \"image-registry-7dccd94c8f-rbvhf\" (UID: \"95e71c9a-91b3-441d-a762-b90057fa6ac1\") " pod="openshift-image-registry/image-registry-7dccd94c8f-rbvhf" Jun 15 04:29:02.250173 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:02.249846 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a865e14d-8cfa-4465-bd6e-56ac84b2f7cd-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-7rsjb\" (UID: \"a865e14d-8cfa-4465-bd6e-56ac84b2f7cd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-7rsjb" Jun 15 04:29:02.250173 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:29:02.249902 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 15 04:29:02.250173 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:29:02.249919 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7dccd94c8f-rbvhf: secret "image-registry-tls" not found Jun 15 04:29:02.250173 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:29:02.249964 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/95e71c9a-91b3-441d-a762-b90057fa6ac1-registry-tls podName:95e71c9a-91b3-441d-a762-b90057fa6ac1 nodeName:}" failed. No retries permitted until 2026-06-15 04:29:02.749947283 +0000 UTC m=+218.277938369 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/95e71c9a-91b3-441d-a762-b90057fa6ac1-registry-tls") pod "image-registry-7dccd94c8f-rbvhf" (UID: "95e71c9a-91b3-441d-a762-b90057fa6ac1") : secret "image-registry-tls" not found Jun 15 04:29:02.250310 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:02.250271 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/95e71c9a-91b3-441d-a762-b90057fa6ac1-registry-certificates\") pod \"image-registry-7dccd94c8f-rbvhf\" (UID: \"95e71c9a-91b3-441d-a762-b90057fa6ac1\") " pod="openshift-image-registry/image-registry-7dccd94c8f-rbvhf" Jun 15 04:29:02.250455 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:02.250417 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/95e71c9a-91b3-441d-a762-b90057fa6ac1-ca-trust-extracted\") pod \"image-registry-7dccd94c8f-rbvhf\" (UID: \"95e71c9a-91b3-441d-a762-b90057fa6ac1\") " pod="openshift-image-registry/image-registry-7dccd94c8f-rbvhf" Jun 15 04:29:02.250751 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:02.250731 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/95e71c9a-91b3-441d-a762-b90057fa6ac1-trusted-ca\") pod \"image-registry-7dccd94c8f-rbvhf\" (UID: \"95e71c9a-91b3-441d-a762-b90057fa6ac1\") " pod="openshift-image-registry/image-registry-7dccd94c8f-rbvhf" Jun 15 04:29:02.251906 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:02.251887 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/95e71c9a-91b3-441d-a762-b90057fa6ac1-installation-pull-secrets\") pod \"image-registry-7dccd94c8f-rbvhf\" (UID: \"95e71c9a-91b3-441d-a762-b90057fa6ac1\") " pod="openshift-image-registry/image-registry-7dccd94c8f-rbvhf" Jun 15 04:29:02.252155 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:02.252136 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/95e71c9a-91b3-441d-a762-b90057fa6ac1-image-registry-private-configuration\") pod \"image-registry-7dccd94c8f-rbvhf\" (UID: \"95e71c9a-91b3-441d-a762-b90057fa6ac1\") " pod="openshift-image-registry/image-registry-7dccd94c8f-rbvhf" Jun 15 04:29:02.257538 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:02.257519 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsbqp\" (UniqueName: \"kubernetes.io/projected/95e71c9a-91b3-441d-a762-b90057fa6ac1-kube-api-access-gsbqp\") pod \"image-registry-7dccd94c8f-rbvhf\" (UID: \"95e71c9a-91b3-441d-a762-b90057fa6ac1\") " pod="openshift-image-registry/image-registry-7dccd94c8f-rbvhf" Jun 15 04:29:02.257632 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:02.257560 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/95e71c9a-91b3-441d-a762-b90057fa6ac1-bound-sa-token\") pod \"image-registry-7dccd94c8f-rbvhf\" (UID: \"95e71c9a-91b3-441d-a762-b90057fa6ac1\") " pod="openshift-image-registry/image-registry-7dccd94c8f-rbvhf" Jun 15 04:29:02.257776 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:02.257753 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-smtqt\" (UniqueName: \"kubernetes.io/projected/1afb59b4-9a11-44a4-b887-787a31d4d906-kube-api-access-smtqt\") pod \"cluster-samples-operator-9547488fd-vftjx\" (UID: \"1afb59b4-9a11-44a4-b887-787a31d4d906\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-vftjx" Jun 15 04:29:02.304741 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:02.304707 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-sgvbt"] Jun 15 04:29:02.308617 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:02.308602 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-867b76cb74-sgvbt" Jun 15 04:29:02.310689 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:02.310664 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 15 04:29:02.310689 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:02.310681 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-xmrxd\"" Jun 15 04:29:02.310854 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:02.310693 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 15 04:29:02.316077 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:02.316038 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-sgvbt"] Jun 15 04:29:02.350921 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:02.350893 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xttbv\" (UniqueName: \"kubernetes.io/projected/a865e14d-8cfa-4465-bd6e-56ac84b2f7cd-kube-api-access-xttbv\") pod \"kube-storage-version-migrator-operator-7c578b78fc-7rsjb\" (UID: \"a865e14d-8cfa-4465-bd6e-56ac84b2f7cd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-7rsjb" Jun 15 04:29:02.351087 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:02.350934 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6c21d099-af2c-41fc-aca7-dac74c4dee06-nginx-conf\") pod \"networking-console-plugin-867b76cb74-sgvbt\" (UID: \"6c21d099-af2c-41fc-aca7-dac74c4dee06\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-sgvbt" Jun 15 04:29:02.351087 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:02.350979 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6c21d099-af2c-41fc-aca7-dac74c4dee06-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-sgvbt\" (UID: \"6c21d099-af2c-41fc-aca7-dac74c4dee06\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-sgvbt" Jun 15 04:29:02.351087 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:02.350999 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a865e14d-8cfa-4465-bd6e-56ac84b2f7cd-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-7rsjb\" (UID: \"a865e14d-8cfa-4465-bd6e-56ac84b2f7cd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-7rsjb" Jun 15 04:29:02.351087 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:02.351047 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a865e14d-8cfa-4465-bd6e-56ac84b2f7cd-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-7rsjb\" (UID: \"a865e14d-8cfa-4465-bd6e-56ac84b2f7cd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-7rsjb" Jun 15 04:29:02.351587 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:02.351560 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a865e14d-8cfa-4465-bd6e-56ac84b2f7cd-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-7rsjb\" (UID: \"a865e14d-8cfa-4465-bd6e-56ac84b2f7cd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-7rsjb" Jun 15 04:29:02.353265 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:02.353242 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a865e14d-8cfa-4465-bd6e-56ac84b2f7cd-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-7rsjb\" (UID: \"a865e14d-8cfa-4465-bd6e-56ac84b2f7cd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-7rsjb" Jun 15 04:29:02.358137 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:02.358107 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xttbv\" (UniqueName: \"kubernetes.io/projected/a865e14d-8cfa-4465-bd6e-56ac84b2f7cd-kube-api-access-xttbv\") pod \"kube-storage-version-migrator-operator-7c578b78fc-7rsjb\" (UID: \"a865e14d-8cfa-4465-bd6e-56ac84b2f7cd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-7rsjb" Jun 15 04:29:02.451329 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:02.451299 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6c21d099-af2c-41fc-aca7-dac74c4dee06-nginx-conf\") pod \"networking-console-plugin-867b76cb74-sgvbt\" (UID: \"6c21d099-af2c-41fc-aca7-dac74c4dee06\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-sgvbt" Jun 15 04:29:02.451543 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:02.451345 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6c21d099-af2c-41fc-aca7-dac74c4dee06-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-sgvbt\" (UID: \"6c21d099-af2c-41fc-aca7-dac74c4dee06\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-sgvbt" Jun 15 04:29:02.451543 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:29:02.451434 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 15 04:29:02.451543 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:29:02.451514 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c21d099-af2c-41fc-aca7-dac74c4dee06-networking-console-plugin-cert podName:6c21d099-af2c-41fc-aca7-dac74c4dee06 nodeName:}" failed. No retries permitted until 2026-06-15 04:29:02.951495566 +0000 UTC m=+218.479486450 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6c21d099-af2c-41fc-aca7-dac74c4dee06-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-sgvbt" (UID: "6c21d099-af2c-41fc-aca7-dac74c4dee06") : secret "networking-console-plugin-cert" not found Jun 15 04:29:02.452005 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:02.451982 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6c21d099-af2c-41fc-aca7-dac74c4dee06-nginx-conf\") pod \"networking-console-plugin-867b76cb74-sgvbt\" (UID: \"6c21d099-af2c-41fc-aca7-dac74c4dee06\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-sgvbt" Jun 15 04:29:02.523413 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:02.523376 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-7rsjb" Jun 15 04:29:02.635998 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:02.635961 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-7rsjb"] Jun 15 04:29:02.638960 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:29:02.638936 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda865e14d_8cfa_4465_bd6e_56ac84b2f7cd.slice/crio-edae714044c06095db8ef0973af3cf9b58871a812e63b3bd6ce09b052a39f1cf WatchSource:0}: Error finding container edae714044c06095db8ef0973af3cf9b58871a812e63b3bd6ce09b052a39f1cf: Status 404 returned error can't find the container with id edae714044c06095db8ef0973af3cf9b58871a812e63b3bd6ce09b052a39f1cf Jun 15 04:29:02.754142 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:02.754063 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/95e71c9a-91b3-441d-a762-b90057fa6ac1-registry-tls\") pod \"image-registry-7dccd94c8f-rbvhf\" (UID: \"95e71c9a-91b3-441d-a762-b90057fa6ac1\") " pod="openshift-image-registry/image-registry-7dccd94c8f-rbvhf" Jun 15 04:29:02.754142 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:02.754138 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1afb59b4-9a11-44a4-b887-787a31d4d906-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-vftjx\" (UID: \"1afb59b4-9a11-44a4-b887-787a31d4d906\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-vftjx" Jun 15 04:29:02.754331 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:29:02.754241 2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 15 04:29:02.754331 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:29:02.754246 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 15 04:29:02.754331 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:29:02.754268 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7dccd94c8f-rbvhf: secret "image-registry-tls" not found Jun 15 04:29:02.754331 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:29:02.754293 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1afb59b4-9a11-44a4-b887-787a31d4d906-samples-operator-tls podName:1afb59b4-9a11-44a4-b887-787a31d4d906 nodeName:}" failed. No retries permitted until 2026-06-15 04:29:03.754276543 +0000 UTC m=+219.282267433 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1afb59b4-9a11-44a4-b887-787a31d4d906-samples-operator-tls") pod "cluster-samples-operator-9547488fd-vftjx" (UID: "1afb59b4-9a11-44a4-b887-787a31d4d906") : secret "samples-operator-tls" not found Jun 15 04:29:02.754331 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:29:02.754321 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/95e71c9a-91b3-441d-a762-b90057fa6ac1-registry-tls podName:95e71c9a-91b3-441d-a762-b90057fa6ac1 nodeName:}" failed. No retries permitted until 2026-06-15 04:29:03.754301138 +0000 UTC m=+219.282292026 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/95e71c9a-91b3-441d-a762-b90057fa6ac1-registry-tls") pod "image-registry-7dccd94c8f-rbvhf" (UID: "95e71c9a-91b3-441d-a762-b90057fa6ac1") : secret "image-registry-tls" not found Jun 15 04:29:02.955052 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:02.955021 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6c21d099-af2c-41fc-aca7-dac74c4dee06-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-sgvbt\" (UID: \"6c21d099-af2c-41fc-aca7-dac74c4dee06\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-sgvbt" Jun 15 04:29:02.955209 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:29:02.955165 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 15 04:29:02.955249 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:29:02.955231 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c21d099-af2c-41fc-aca7-dac74c4dee06-networking-console-plugin-cert podName:6c21d099-af2c-41fc-aca7-dac74c4dee06 nodeName:}" failed. No retries permitted until 2026-06-15 04:29:03.955212991 +0000 UTC m=+219.483203874 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6c21d099-af2c-41fc-aca7-dac74c4dee06-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-sgvbt" (UID: "6c21d099-af2c-41fc-aca7-dac74c4dee06") : secret "networking-console-plugin-cert" not found Jun 15 04:29:03.443899 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:03.443854 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-7rsjb" event={"ID":"a865e14d-8cfa-4465-bd6e-56ac84b2f7cd","Type":"ContainerStarted","Data":"edae714044c06095db8ef0973af3cf9b58871a812e63b3bd6ce09b052a39f1cf"} Jun 15 04:29:03.761603 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:03.761510 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1afb59b4-9a11-44a4-b887-787a31d4d906-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-vftjx\" (UID: \"1afb59b4-9a11-44a4-b887-787a31d4d906\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-vftjx" Jun 15 04:29:03.761603 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:03.761581 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/95e71c9a-91b3-441d-a762-b90057fa6ac1-registry-tls\") pod \"image-registry-7dccd94c8f-rbvhf\" (UID: \"95e71c9a-91b3-441d-a762-b90057fa6ac1\") " pod="openshift-image-registry/image-registry-7dccd94c8f-rbvhf" Jun 15 04:29:03.761803 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:29:03.761660 2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 15 04:29:03.761803 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:29:03.761686 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 15 04:29:03.761803 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:29:03.761696 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7dccd94c8f-rbvhf: secret "image-registry-tls" not found Jun 15 04:29:03.761803 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:29:03.761724 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1afb59b4-9a11-44a4-b887-787a31d4d906-samples-operator-tls podName:1afb59b4-9a11-44a4-b887-787a31d4d906 nodeName:}" failed. No retries permitted until 2026-06-15 04:29:05.761708275 +0000 UTC m=+221.289699157 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1afb59b4-9a11-44a4-b887-787a31d4d906-samples-operator-tls") pod "cluster-samples-operator-9547488fd-vftjx" (UID: "1afb59b4-9a11-44a4-b887-787a31d4d906") : secret "samples-operator-tls" not found Jun 15 04:29:03.761803 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:29:03.761738 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/95e71c9a-91b3-441d-a762-b90057fa6ac1-registry-tls podName:95e71c9a-91b3-441d-a762-b90057fa6ac1 nodeName:}" failed. No retries permitted until 2026-06-15 04:29:05.761731867 +0000 UTC m=+221.289722749 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/95e71c9a-91b3-441d-a762-b90057fa6ac1-registry-tls") pod "image-registry-7dccd94c8f-rbvhf" (UID: "95e71c9a-91b3-441d-a762-b90057fa6ac1") : secret "image-registry-tls" not found Jun 15 04:29:03.963011 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:03.962975 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6c21d099-af2c-41fc-aca7-dac74c4dee06-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-sgvbt\" (UID: \"6c21d099-af2c-41fc-aca7-dac74c4dee06\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-sgvbt" Jun 15 04:29:03.963210 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:29:03.963137 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 15 04:29:03.963283 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:29:03.963216 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c21d099-af2c-41fc-aca7-dac74c4dee06-networking-console-plugin-cert podName:6c21d099-af2c-41fc-aca7-dac74c4dee06 nodeName:}" failed. No retries permitted until 2026-06-15 04:29:05.963194799 +0000 UTC m=+221.491185703 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6c21d099-af2c-41fc-aca7-dac74c4dee06-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-sgvbt" (UID: "6c21d099-af2c-41fc-aca7-dac74c4dee06") : secret "networking-console-plugin-cert" not found Jun 15 04:29:05.450382 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:05.450345 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-7rsjb" event={"ID":"a865e14d-8cfa-4465-bd6e-56ac84b2f7cd","Type":"ContainerStarted","Data":"3382a747342f45df6ab4ce6c88558afd111bde085966375424beaaa07c3dc86c"} Jun 15 04:29:05.464108 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:05.464051 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-7rsjb" podStartSLOduration=1.542838552 podStartE2EDuration="3.464035434s" totalImagesPullingTime="1.921196882s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 04:29:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:29:05.463501744 +0000 UTC m=+220.991492649" watchObservedRunningTime="2026-06-15 04:29:05.464035434 +0000 UTC m=+220.992026342" Jun 15 04:29:05.778752 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:05.778656 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/95e71c9a-91b3-441d-a762-b90057fa6ac1-registry-tls\") pod \"image-registry-7dccd94c8f-rbvhf\" (UID: \"95e71c9a-91b3-441d-a762-b90057fa6ac1\") " pod="openshift-image-registry/image-registry-7dccd94c8f-rbvhf" Jun 15 04:29:05.778752 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:05.778747 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1afb59b4-9a11-44a4-b887-787a31d4d906-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-vftjx\" (UID: \"1afb59b4-9a11-44a4-b887-787a31d4d906\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-vftjx" Jun 15 04:29:05.778943 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:29:05.778816 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 15 04:29:05.778943 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:29:05.778834 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7dccd94c8f-rbvhf: secret "image-registry-tls" not found Jun 15 04:29:05.778943 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:29:05.778856 2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 15 04:29:05.778943 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:29:05.778901 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/95e71c9a-91b3-441d-a762-b90057fa6ac1-registry-tls podName:95e71c9a-91b3-441d-a762-b90057fa6ac1 nodeName:}" failed. No retries permitted until 2026-06-15 04:29:09.778880186 +0000 UTC m=+225.306871162 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/95e71c9a-91b3-441d-a762-b90057fa6ac1-registry-tls") pod "image-registry-7dccd94c8f-rbvhf" (UID: "95e71c9a-91b3-441d-a762-b90057fa6ac1") : secret "image-registry-tls" not found Jun 15 04:29:05.778943 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:29:05.778917 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1afb59b4-9a11-44a4-b887-787a31d4d906-samples-operator-tls podName:1afb59b4-9a11-44a4-b887-787a31d4d906 nodeName:}" failed. No retries permitted until 2026-06-15 04:29:09.778910915 +0000 UTC m=+225.306901800 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1afb59b4-9a11-44a4-b887-787a31d4d906-samples-operator-tls") pod "cluster-samples-operator-9547488fd-vftjx" (UID: "1afb59b4-9a11-44a4-b887-787a31d4d906") : secret "samples-operator-tls" not found Jun 15 04:29:05.979858 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:05.979821 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6c21d099-af2c-41fc-aca7-dac74c4dee06-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-sgvbt\" (UID: \"6c21d099-af2c-41fc-aca7-dac74c4dee06\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-sgvbt" Jun 15 04:29:05.980034 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:29:05.979958 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 15 04:29:05.980091 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:29:05.980034 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c21d099-af2c-41fc-aca7-dac74c4dee06-networking-console-plugin-cert podName:6c21d099-af2c-41fc-aca7-dac74c4dee06 nodeName:}" failed. No retries permitted until 2026-06-15 04:29:09.980018363 +0000 UTC m=+225.508009248 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6c21d099-af2c-41fc-aca7-dac74c4dee06-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-sgvbt" (UID: "6c21d099-af2c-41fc-aca7-dac74c4dee06") : secret "networking-console-plugin-cert" not found Jun 15 04:29:06.089082 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:06.089006 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d4bcd4867-rktt4"] Jun 15 04:29:06.092009 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:06.091987 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-rktt4" Jun 15 04:29:06.094302 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:06.094261 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 15 04:29:06.094412 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:06.094298 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 15 04:29:06.094596 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:06.094582 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-289sb\"" Jun 15 04:29:06.098195 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:06.098171 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d4bcd4867-rktt4"] Jun 15 04:29:06.182567 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:06.182535 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bglv\" (UniqueName: \"kubernetes.io/projected/ad42f712-062f-47f0-8ab0-31d97605da00-kube-api-access-7bglv\") pod \"migrator-d4bcd4867-rktt4\" (UID: \"ad42f712-062f-47f0-8ab0-31d97605da00\") " pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-rktt4" Jun 15 04:29:06.283283 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:06.283249 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bglv\" (UniqueName: \"kubernetes.io/projected/ad42f712-062f-47f0-8ab0-31d97605da00-kube-api-access-7bglv\") pod \"migrator-d4bcd4867-rktt4\" (UID: \"ad42f712-062f-47f0-8ab0-31d97605da00\") " pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-rktt4" Jun 15 04:29:06.290228 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:06.290199 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bglv\" (UniqueName: \"kubernetes.io/projected/ad42f712-062f-47f0-8ab0-31d97605da00-kube-api-access-7bglv\") pod \"migrator-d4bcd4867-rktt4\" (UID: \"ad42f712-062f-47f0-8ab0-31d97605da00\") " pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-rktt4" Jun 15 04:29:06.401894 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:06.401801 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-rktt4" Jun 15 04:29:06.468489 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:06.468421 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-fvvjk"] Jun 15 04:29:06.471886 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:06.471861 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fvvjk" Jun 15 04:29:06.473839 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:06.473814 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 15 04:29:06.473961 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:06.473824 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 15 04:29:06.473961 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:06.473849 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-2v5qj\"" Jun 15 04:29:06.474054 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:06.473967 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 15 04:29:06.474131 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:06.474117 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 15 04:29:06.482734 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:06.482668 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fvvjk"] Jun 15 04:29:06.526951 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:06.526922 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d4bcd4867-rktt4"] Jun 15 04:29:06.531235 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:29:06.531201 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad42f712_062f_47f0_8ab0_31d97605da00.slice/crio-240f252f8431f984b6a55387a54cae9c2eff26ed537b44e4eba46f106eedd738 WatchSource:0}: Error finding container 240f252f8431f984b6a55387a54cae9c2eff26ed537b44e4eba46f106eedd738: Status 404 returned error can't find the container with id 240f252f8431f984b6a55387a54cae9c2eff26ed537b44e4eba46f106eedd738 Jun 15 04:29:06.586114 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:06.586083 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a64a069b-6288-41dd-a2b4-844b5a0e0a6a-data-volume\") pod \"insights-runtime-extractor-fvvjk\" (UID: \"a64a069b-6288-41dd-a2b4-844b5a0e0a6a\") " pod="openshift-insights/insights-runtime-extractor-fvvjk" Jun 15 04:29:06.586309 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:06.586142 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a64a069b-6288-41dd-a2b4-844b5a0e0a6a-crio-socket\") pod \"insights-runtime-extractor-fvvjk\" (UID: \"a64a069b-6288-41dd-a2b4-844b5a0e0a6a\") " pod="openshift-insights/insights-runtime-extractor-fvvjk" Jun 15 04:29:06.586309 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:06.586183 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a64a069b-6288-41dd-a2b4-844b5a0e0a6a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fvvjk\" (UID: \"a64a069b-6288-41dd-a2b4-844b5a0e0a6a\") " pod="openshift-insights/insights-runtime-extractor-fvvjk" Jun 15 04:29:06.586309 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:06.586236 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a64a069b-6288-41dd-a2b4-844b5a0e0a6a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fvvjk\" (UID: \"a64a069b-6288-41dd-a2b4-844b5a0e0a6a\") " pod="openshift-insights/insights-runtime-extractor-fvvjk" Jun 15 04:29:06.586309 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:06.586274 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgg4t\" (UniqueName: \"kubernetes.io/projected/a64a069b-6288-41dd-a2b4-844b5a0e0a6a-kube-api-access-tgg4t\") pod \"insights-runtime-extractor-fvvjk\" (UID: \"a64a069b-6288-41dd-a2b4-844b5a0e0a6a\") " pod="openshift-insights/insights-runtime-extractor-fvvjk" Jun 15 04:29:06.687002 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:06.686956 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a64a069b-6288-41dd-a2b4-844b5a0e0a6a-crio-socket\") pod \"insights-runtime-extractor-fvvjk\" (UID: \"a64a069b-6288-41dd-a2b4-844b5a0e0a6a\") " pod="openshift-insights/insights-runtime-extractor-fvvjk" Jun 15 04:29:06.687002 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:06.687009 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a64a069b-6288-41dd-a2b4-844b5a0e0a6a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fvvjk\" (UID: \"a64a069b-6288-41dd-a2b4-844b5a0e0a6a\") " pod="openshift-insights/insights-runtime-extractor-fvvjk" Jun 15 04:29:06.687210 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:29:06.687083 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 15 04:29:06.687210 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:06.687090 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a64a069b-6288-41dd-a2b4-844b5a0e0a6a-crio-socket\") pod \"insights-runtime-extractor-fvvjk\" (UID: \"a64a069b-6288-41dd-a2b4-844b5a0e0a6a\") " pod="openshift-insights/insights-runtime-extractor-fvvjk" Jun 15 04:29:06.687210 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:29:06.687145 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a64a069b-6288-41dd-a2b4-844b5a0e0a6a-kube-rbac-proxy-cm podName:a64a069b-6288-41dd-a2b4-844b5a0e0a6a nodeName:}" failed. No retries permitted until 2026-06-15 04:29:07.187124787 +0000 UTC m=+222.715115671 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a64a069b-6288-41dd-a2b4-844b5a0e0a6a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fvvjk" (UID: "a64a069b-6288-41dd-a2b4-844b5a0e0a6a") : configmap "kube-rbac-proxy" not found Jun 15 04:29:06.687210 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:06.687173 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a64a069b-6288-41dd-a2b4-844b5a0e0a6a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fvvjk\" (UID: \"a64a069b-6288-41dd-a2b4-844b5a0e0a6a\") " pod="openshift-insights/insights-runtime-extractor-fvvjk" Jun 15 04:29:06.687210 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:06.687193 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgg4t\" (UniqueName: \"kubernetes.io/projected/a64a069b-6288-41dd-a2b4-844b5a0e0a6a-kube-api-access-tgg4t\") pod \"insights-runtime-extractor-fvvjk\" (UID: \"a64a069b-6288-41dd-a2b4-844b5a0e0a6a\") " pod="openshift-insights/insights-runtime-extractor-fvvjk" Jun 15 04:29:06.687421 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:06.687251 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a64a069b-6288-41dd-a2b4-844b5a0e0a6a-data-volume\") pod \"insights-runtime-extractor-fvvjk\" (UID: \"a64a069b-6288-41dd-a2b4-844b5a0e0a6a\") " pod="openshift-insights/insights-runtime-extractor-fvvjk" Jun 15 04:29:06.687421 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:29:06.687320 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 15 04:29:06.687421 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:29:06.687370 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a64a069b-6288-41dd-a2b4-844b5a0e0a6a-insights-runtime-extractor-tls podName:a64a069b-6288-41dd-a2b4-844b5a0e0a6a nodeName:}" failed. No retries permitted until 2026-06-15 04:29:07.187357113 +0000 UTC m=+222.715347996 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a64a069b-6288-41dd-a2b4-844b5a0e0a6a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fvvjk" (UID: "a64a069b-6288-41dd-a2b4-844b5a0e0a6a") : secret "insights-runtime-extractor-tls" not found Jun 15 04:29:06.687588 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:06.687567 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a64a069b-6288-41dd-a2b4-844b5a0e0a6a-data-volume\") pod \"insights-runtime-extractor-fvvjk\" (UID: \"a64a069b-6288-41dd-a2b4-844b5a0e0a6a\") " pod="openshift-insights/insights-runtime-extractor-fvvjk" Jun 15 04:29:06.694738 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:06.694720 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgg4t\" (UniqueName: \"kubernetes.io/projected/a64a069b-6288-41dd-a2b4-844b5a0e0a6a-kube-api-access-tgg4t\") pod \"insights-runtime-extractor-fvvjk\" (UID: \"a64a069b-6288-41dd-a2b4-844b5a0e0a6a\") " pod="openshift-insights/insights-runtime-extractor-fvvjk" Jun 15 04:29:07.191842 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:07.191807 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a64a069b-6288-41dd-a2b4-844b5a0e0a6a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fvvjk\" (UID: \"a64a069b-6288-41dd-a2b4-844b5a0e0a6a\") " pod="openshift-insights/insights-runtime-extractor-fvvjk" Jun 15 04:29:07.192048 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:07.191930 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a64a069b-6288-41dd-a2b4-844b5a0e0a6a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fvvjk\" (UID: \"a64a069b-6288-41dd-a2b4-844b5a0e0a6a\") " pod="openshift-insights/insights-runtime-extractor-fvvjk" Jun 15 04:29:07.192048 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:29:07.191971 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 15 04:29:07.192048 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:29:07.192009 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 15 04:29:07.192194 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:29:07.192056 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a64a069b-6288-41dd-a2b4-844b5a0e0a6a-insights-runtime-extractor-tls podName:a64a069b-6288-41dd-a2b4-844b5a0e0a6a nodeName:}" failed. No retries permitted until 2026-06-15 04:29:08.192040858 +0000 UTC m=+223.720031759 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a64a069b-6288-41dd-a2b4-844b5a0e0a6a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fvvjk" (UID: "a64a069b-6288-41dd-a2b4-844b5a0e0a6a") : secret "insights-runtime-extractor-tls" not found Jun 15 04:29:07.192194 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:29:07.192071 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a64a069b-6288-41dd-a2b4-844b5a0e0a6a-kube-rbac-proxy-cm podName:a64a069b-6288-41dd-a2b4-844b5a0e0a6a nodeName:}" failed. No retries permitted until 2026-06-15 04:29:08.192065303 +0000 UTC m=+223.720056186 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a64a069b-6288-41dd-a2b4-844b5a0e0a6a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fvvjk" (UID: "a64a069b-6288-41dd-a2b4-844b5a0e0a6a") : configmap "kube-rbac-proxy" not found Jun 15 04:29:07.457329 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:07.457252 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-rktt4" event={"ID":"ad42f712-062f-47f0-8ab0-31d97605da00","Type":"ContainerStarted","Data":"240f252f8431f984b6a55387a54cae9c2eff26ed537b44e4eba46f106eedd738"} Jun 15 04:29:08.201845 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:08.201811 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a64a069b-6288-41dd-a2b4-844b5a0e0a6a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fvvjk\" (UID: \"a64a069b-6288-41dd-a2b4-844b5a0e0a6a\") " pod="openshift-insights/insights-runtime-extractor-fvvjk" Jun 15 04:29:08.202216 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:08.201868 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a64a069b-6288-41dd-a2b4-844b5a0e0a6a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fvvjk\" (UID: \"a64a069b-6288-41dd-a2b4-844b5a0e0a6a\") " pod="openshift-insights/insights-runtime-extractor-fvvjk" Jun 15 04:29:08.202216 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:29:08.201922 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 15 04:29:08.202216 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:29:08.201982 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a64a069b-6288-41dd-a2b4-844b5a0e0a6a-kube-rbac-proxy-cm podName:a64a069b-6288-41dd-a2b4-844b5a0e0a6a nodeName:}" failed. No retries permitted until 2026-06-15 04:29:10.20196784 +0000 UTC m=+225.729958726 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a64a069b-6288-41dd-a2b4-844b5a0e0a6a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fvvjk" (UID: "a64a069b-6288-41dd-a2b4-844b5a0e0a6a") : configmap "kube-rbac-proxy" not found Jun 15 04:29:08.202216 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:29:08.202002 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 15 04:29:08.202216 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:29:08.202043 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a64a069b-6288-41dd-a2b4-844b5a0e0a6a-insights-runtime-extractor-tls podName:a64a069b-6288-41dd-a2b4-844b5a0e0a6a nodeName:}" failed. No retries permitted until 2026-06-15 04:29:10.202028381 +0000 UTC m=+225.730019264 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a64a069b-6288-41dd-a2b4-844b5a0e0a6a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fvvjk" (UID: "a64a069b-6288-41dd-a2b4-844b5a0e0a6a") : secret "insights-runtime-extractor-tls" not found Jun 15 04:29:08.463298 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:08.463209 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-rktt4" event={"ID":"ad42f712-062f-47f0-8ab0-31d97605da00","Type":"ContainerStarted","Data":"7ecfa4246f7d7fb5aa874c0dbf1618ec96a959a6f6f1a2282a04b7db4b7c1d5b"} Jun 15 04:29:08.463298 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:08.463259 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-rktt4" event={"ID":"ad42f712-062f-47f0-8ab0-31d97605da00","Type":"ContainerStarted","Data":"404e39193bfa1c265e191b167ea938a67a1f480dbc7731988228e984a78a4f2a"} Jun 15 04:29:08.476905 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:08.476856 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-rktt4" podStartSLOduration=1.30727389 podStartE2EDuration="2.476841864s" totalImagesPullingTime="1.169567974s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 04:29:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:29:08.476130038 +0000 UTC m=+224.004120955" watchObservedRunningTime="2026-06-15 04:29:08.476841864 +0000 UTC m=+224.004832824" Jun 15 04:29:09.050711 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:09.050684 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4znw7_fd16b391-af84-45b8-bbaf-e042e8a2c1e4/dns-node-resolver/0.log" Jun 15 04:29:09.238065 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:09.238028 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-7jfpx"] Jun 15 04:29:09.240973 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:09.240958 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7b994bc59-7jfpx" Jun 15 04:29:09.242957 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:09.242934 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-bwqjg\"" Jun 15 04:29:09.243096 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:09.242971 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 15 04:29:09.243096 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:09.242975 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 15 04:29:09.243497 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:09.243480 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 15 04:29:09.243575 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:09.243557 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 15 04:29:09.247649 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:09.247478 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-7jfpx"] Jun 15 04:29:09.310933 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:09.310853 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e7c9ec00-5ed0-42c6-a566-c9036f60527c-signing-key\") pod \"service-ca-7b994bc59-7jfpx\" (UID: \"e7c9ec00-5ed0-42c6-a566-c9036f60527c\") " pod="openshift-service-ca/service-ca-7b994bc59-7jfpx" Jun 15 04:29:09.310933 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:09.310903 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7sl8t\" (UniqueName: \"kubernetes.io/projected/e7c9ec00-5ed0-42c6-a566-c9036f60527c-kube-api-access-7sl8t\") pod \"service-ca-7b994bc59-7jfpx\" (UID: \"e7c9ec00-5ed0-42c6-a566-c9036f60527c\") " pod="openshift-service-ca/service-ca-7b994bc59-7jfpx" Jun 15 04:29:09.311101 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:09.310960 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e7c9ec00-5ed0-42c6-a566-c9036f60527c-signing-cabundle\") pod \"service-ca-7b994bc59-7jfpx\" (UID: \"e7c9ec00-5ed0-42c6-a566-c9036f60527c\") " pod="openshift-service-ca/service-ca-7b994bc59-7jfpx" Jun 15 04:29:09.412152 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:09.412106 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e7c9ec00-5ed0-42c6-a566-c9036f60527c-signing-cabundle\") pod \"service-ca-7b994bc59-7jfpx\" (UID: \"e7c9ec00-5ed0-42c6-a566-c9036f60527c\") " pod="openshift-service-ca/service-ca-7b994bc59-7jfpx" Jun 15 04:29:09.412322 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:09.412175 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e7c9ec00-5ed0-42c6-a566-c9036f60527c-signing-key\") pod \"service-ca-7b994bc59-7jfpx\" (UID: \"e7c9ec00-5ed0-42c6-a566-c9036f60527c\") " pod="openshift-service-ca/service-ca-7b994bc59-7jfpx" Jun 15 04:29:09.412322 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:09.412226 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7sl8t\" (UniqueName: \"kubernetes.io/projected/e7c9ec00-5ed0-42c6-a566-c9036f60527c-kube-api-access-7sl8t\") pod \"service-ca-7b994bc59-7jfpx\" (UID: \"e7c9ec00-5ed0-42c6-a566-c9036f60527c\") " pod="openshift-service-ca/service-ca-7b994bc59-7jfpx" Jun 15 04:29:09.412795 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:09.412772 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e7c9ec00-5ed0-42c6-a566-c9036f60527c-signing-cabundle\") pod \"service-ca-7b994bc59-7jfpx\" (UID: \"e7c9ec00-5ed0-42c6-a566-c9036f60527c\") " pod="openshift-service-ca/service-ca-7b994bc59-7jfpx" Jun 15 04:29:09.414575 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:09.414553 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e7c9ec00-5ed0-42c6-a566-c9036f60527c-signing-key\") pod \"service-ca-7b994bc59-7jfpx\" (UID: \"e7c9ec00-5ed0-42c6-a566-c9036f60527c\") " pod="openshift-service-ca/service-ca-7b994bc59-7jfpx" Jun 15 04:29:09.419739 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:09.419717 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7sl8t\" (UniqueName: \"kubernetes.io/projected/e7c9ec00-5ed0-42c6-a566-c9036f60527c-kube-api-access-7sl8t\") pod \"service-ca-7b994bc59-7jfpx\" (UID: \"e7c9ec00-5ed0-42c6-a566-c9036f60527c\") " pod="openshift-service-ca/service-ca-7b994bc59-7jfpx" Jun 15 04:29:09.550704 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:09.550675 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7b994bc59-7jfpx" Jun 15 04:29:09.665908 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:09.665774 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-7jfpx"] Jun 15 04:29:09.668309 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:29:09.668282 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7c9ec00_5ed0_42c6_a566_c9036f60527c.slice/crio-c1281dbfcf0fce01dd5beaa981b821358ded7e4e38053adc0d93ac71cd02f746 WatchSource:0}: Error finding container c1281dbfcf0fce01dd5beaa981b821358ded7e4e38053adc0d93ac71cd02f746: Status 404 returned error can't find the container with id c1281dbfcf0fce01dd5beaa981b821358ded7e4e38053adc0d93ac71cd02f746 Jun 15 04:29:09.815096 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:09.815061 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/95e71c9a-91b3-441d-a762-b90057fa6ac1-registry-tls\") pod \"image-registry-7dccd94c8f-rbvhf\" (UID: \"95e71c9a-91b3-441d-a762-b90057fa6ac1\") " pod="openshift-image-registry/image-registry-7dccd94c8f-rbvhf" Jun 15 04:29:09.815288 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:09.815118 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1afb59b4-9a11-44a4-b887-787a31d4d906-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-vftjx\" (UID: \"1afb59b4-9a11-44a4-b887-787a31d4d906\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-vftjx" Jun 15 04:29:09.815288 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:29:09.815212 2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 15 04:29:09.815288 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:29:09.815227 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 15 04:29:09.815288 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:29:09.815246 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7dccd94c8f-rbvhf: secret "image-registry-tls" not found Jun 15 04:29:09.815288 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:29:09.815270 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1afb59b4-9a11-44a4-b887-787a31d4d906-samples-operator-tls podName:1afb59b4-9a11-44a4-b887-787a31d4d906 nodeName:}" failed. No retries permitted until 2026-06-15 04:29:17.815256332 +0000 UTC m=+233.343247215 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1afb59b4-9a11-44a4-b887-787a31d4d906-samples-operator-tls") pod "cluster-samples-operator-9547488fd-vftjx" (UID: "1afb59b4-9a11-44a4-b887-787a31d4d906") : secret "samples-operator-tls" not found Jun 15 04:29:09.815288 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:29:09.815292 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/95e71c9a-91b3-441d-a762-b90057fa6ac1-registry-tls podName:95e71c9a-91b3-441d-a762-b90057fa6ac1 nodeName:}" failed. No retries permitted until 2026-06-15 04:29:17.815276729 +0000 UTC m=+233.343267612 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/95e71c9a-91b3-441d-a762-b90057fa6ac1-registry-tls") pod "image-registry-7dccd94c8f-rbvhf" (UID: "95e71c9a-91b3-441d-a762-b90057fa6ac1") : secret "image-registry-tls" not found Jun 15 04:29:10.017115 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:10.017074 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6c21d099-af2c-41fc-aca7-dac74c4dee06-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-sgvbt\" (UID: \"6c21d099-af2c-41fc-aca7-dac74c4dee06\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-sgvbt" Jun 15 04:29:10.017277 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:29:10.017230 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 15 04:29:10.017318 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:29:10.017297 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c21d099-af2c-41fc-aca7-dac74c4dee06-networking-console-plugin-cert podName:6c21d099-af2c-41fc-aca7-dac74c4dee06 nodeName:}" failed. No retries permitted until 2026-06-15 04:29:18.017281906 +0000 UTC m=+233.545272790 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6c21d099-af2c-41fc-aca7-dac74c4dee06-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-sgvbt" (UID: "6c21d099-af2c-41fc-aca7-dac74c4dee06") : secret "networking-console-plugin-cert" not found Jun 15 04:29:10.054075 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:10.054048 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-96sfm_90fa004f-1d43-402a-8a68-a5147aea49e6/node-ca/0.log" Jun 15 04:29:10.218341 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:10.218303 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a64a069b-6288-41dd-a2b4-844b5a0e0a6a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fvvjk\" (UID: \"a64a069b-6288-41dd-a2b4-844b5a0e0a6a\") " pod="openshift-insights/insights-runtime-extractor-fvvjk" Jun 15 04:29:10.218553 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:10.218379 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a64a069b-6288-41dd-a2b4-844b5a0e0a6a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fvvjk\" (UID: \"a64a069b-6288-41dd-a2b4-844b5a0e0a6a\") " pod="openshift-insights/insights-runtime-extractor-fvvjk" Jun 15 04:29:10.218553 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:29:10.218452 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 15 04:29:10.218553 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:29:10.218540 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 15 04:29:10.218701 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:29:10.218570 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a64a069b-6288-41dd-a2b4-844b5a0e0a6a-kube-rbac-proxy-cm podName:a64a069b-6288-41dd-a2b4-844b5a0e0a6a nodeName:}" failed. No retries permitted until 2026-06-15 04:29:14.218512084 +0000 UTC m=+229.746502980 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a64a069b-6288-41dd-a2b4-844b5a0e0a6a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fvvjk" (UID: "a64a069b-6288-41dd-a2b4-844b5a0e0a6a") : configmap "kube-rbac-proxy" not found Jun 15 04:29:10.218701 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:29:10.218592 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a64a069b-6288-41dd-a2b4-844b5a0e0a6a-insights-runtime-extractor-tls podName:a64a069b-6288-41dd-a2b4-844b5a0e0a6a nodeName:}" failed. No retries permitted until 2026-06-15 04:29:14.218582452 +0000 UTC m=+229.746573335 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a64a069b-6288-41dd-a2b4-844b5a0e0a6a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fvvjk" (UID: "a64a069b-6288-41dd-a2b4-844b5a0e0a6a") : secret "insights-runtime-extractor-tls" not found Jun 15 04:29:10.470067 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:10.470017 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7b994bc59-7jfpx" event={"ID":"e7c9ec00-5ed0-42c6-a566-c9036f60527c","Type":"ContainerStarted","Data":"c1281dbfcf0fce01dd5beaa981b821358ded7e4e38053adc0d93ac71cd02f746"} Jun 15 04:29:11.250672 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:11.250651 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fjpd5_36d7d24f-8986-48c6-adc6-0a26989040fb/serve-healthcheck-canary/0.log" Jun 15 04:29:11.451191 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:11.451163 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d4bcd4867-rktt4_ad42f712-062f-47f0-8ab0-31d97605da00/migrator/0.log" Jun 15 04:29:11.474553 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:11.474523 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7b994bc59-7jfpx" event={"ID":"e7c9ec00-5ed0-42c6-a566-c9036f60527c","Type":"ContainerStarted","Data":"85898eaaa00187ed4e6e9523d5e946251d90785cdf78d16b2ac942aa253f24a2"} Jun 15 04:29:11.488134 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:11.487901 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7b994bc59-7jfpx" podStartSLOduration=0.914195944 podStartE2EDuration="2.487882546s" totalImagesPullingTime="1.573686602s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 04:29:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:29:11.487529952 +0000 UTC m=+227.015520870" watchObservedRunningTime="2026-06-15 04:29:11.487882546 +0000 UTC m=+227.015873452" Jun 15 04:29:11.651691 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:11.651617 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d4bcd4867-rktt4_ad42f712-062f-47f0-8ab0-31d97605da00/graceful-termination/0.log" Jun 15 04:29:11.852347 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:11.852317 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7c578b78fc-7rsjb_a865e14d-8cfa-4465-bd6e-56ac84b2f7cd/kube-storage-version-migrator-operator/0.log" Jun 15 04:29:14.250048 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:14.250011 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a64a069b-6288-41dd-a2b4-844b5a0e0a6a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fvvjk\" (UID: \"a64a069b-6288-41dd-a2b4-844b5a0e0a6a\") " pod="openshift-insights/insights-runtime-extractor-fvvjk" Jun 15 04:29:14.250530 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:14.250120 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a64a069b-6288-41dd-a2b4-844b5a0e0a6a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fvvjk\" (UID: \"a64a069b-6288-41dd-a2b4-844b5a0e0a6a\") " pod="openshift-insights/insights-runtime-extractor-fvvjk" Jun 15 04:29:14.250530 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:29:14.250177 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 15 04:29:14.250530 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:29:14.250191 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 15 04:29:14.250530 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:29:14.250241 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a64a069b-6288-41dd-a2b4-844b5a0e0a6a-insights-runtime-extractor-tls podName:a64a069b-6288-41dd-a2b4-844b5a0e0a6a nodeName:}" failed. No retries permitted until 2026-06-15 04:29:22.250227601 +0000 UTC m=+237.778218489 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a64a069b-6288-41dd-a2b4-844b5a0e0a6a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fvvjk" (UID: "a64a069b-6288-41dd-a2b4-844b5a0e0a6a") : secret "insights-runtime-extractor-tls" not found Jun 15 04:29:14.250530 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:29:14.250256 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a64a069b-6288-41dd-a2b4-844b5a0e0a6a-kube-rbac-proxy-cm podName:a64a069b-6288-41dd-a2b4-844b5a0e0a6a nodeName:}" failed. No retries permitted until 2026-06-15 04:29:22.250250355 +0000 UTC m=+237.778241238 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a64a069b-6288-41dd-a2b4-844b5a0e0a6a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fvvjk" (UID: "a64a069b-6288-41dd-a2b4-844b5a0e0a6a") : configmap "kube-rbac-proxy" not found Jun 15 04:29:17.881605 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:17.881563 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/95e71c9a-91b3-441d-a762-b90057fa6ac1-registry-tls\") pod \"image-registry-7dccd94c8f-rbvhf\" (UID: \"95e71c9a-91b3-441d-a762-b90057fa6ac1\") " pod="openshift-image-registry/image-registry-7dccd94c8f-rbvhf" Jun 15 04:29:17.881982 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:17.881629 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1afb59b4-9a11-44a4-b887-787a31d4d906-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-vftjx\" (UID: \"1afb59b4-9a11-44a4-b887-787a31d4d906\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-vftjx" Jun 15 04:29:17.883979 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:17.883957 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1afb59b4-9a11-44a4-b887-787a31d4d906-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-vftjx\" (UID: \"1afb59b4-9a11-44a4-b887-787a31d4d906\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-vftjx" Jun 15 04:29:17.884101 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:17.884077 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/95e71c9a-91b3-441d-a762-b90057fa6ac1-registry-tls\") pod \"image-registry-7dccd94c8f-rbvhf\" (UID: \"95e71c9a-91b3-441d-a762-b90057fa6ac1\") " pod="openshift-image-registry/image-registry-7dccd94c8f-rbvhf" Jun 15 04:29:18.027288 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:18.027249 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-vftjx" Jun 15 04:29:18.033265 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:18.033242 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7dccd94c8f-rbvhf" Jun 15 04:29:18.083956 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:18.082818 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6c21d099-af2c-41fc-aca7-dac74c4dee06-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-sgvbt\" (UID: \"6c21d099-af2c-41fc-aca7-dac74c4dee06\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-sgvbt" Jun 15 04:29:18.083956 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:29:18.083071 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 15 04:29:18.083956 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:29:18.083144 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c21d099-af2c-41fc-aca7-dac74c4dee06-networking-console-plugin-cert podName:6c21d099-af2c-41fc-aca7-dac74c4dee06 nodeName:}" failed. No retries permitted until 2026-06-15 04:29:34.083123269 +0000 UTC m=+249.611114158 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6c21d099-af2c-41fc-aca7-dac74c4dee06-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-sgvbt" (UID: "6c21d099-af2c-41fc-aca7-dac74c4dee06") : secret "networking-console-plugin-cert" not found Jun 15 04:29:18.166983 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:18.166956 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7dccd94c8f-rbvhf"] Jun 15 04:29:18.168818 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:29:18.168788 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95e71c9a_91b3_441d_a762_b90057fa6ac1.slice/crio-31800c21108d795106c12cd411d171a268104f23f5c36c3e6418f9e3fc0a9161 WatchSource:0}: Error finding container 31800c21108d795106c12cd411d171a268104f23f5c36c3e6418f9e3fc0a9161: Status 404 returned error can't find the container with id 31800c21108d795106c12cd411d171a268104f23f5c36c3e6418f9e3fc0a9161 Jun 15 04:29:18.178108 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:18.178085 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-vftjx"] Jun 15 04:29:18.498715 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:18.498681 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-vftjx" event={"ID":"1afb59b4-9a11-44a4-b887-787a31d4d906","Type":"ContainerStarted","Data":"04d75bace92d65cccb79e00c7d95b937154a72534551d87d87a7a668587a837f"} Jun 15 04:29:18.500339 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:18.500304 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7dccd94c8f-rbvhf" event={"ID":"95e71c9a-91b3-441d-a762-b90057fa6ac1","Type":"ContainerStarted","Data":"69bdbfc996cc90b8aa1d9fe924dd3843323cdee0878202d15f8d1e12c6feb4ff"} Jun 15 04:29:18.500483 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:18.500353 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7dccd94c8f-rbvhf" event={"ID":"95e71c9a-91b3-441d-a762-b90057fa6ac1","Type":"ContainerStarted","Data":"31800c21108d795106c12cd411d171a268104f23f5c36c3e6418f9e3fc0a9161"} Jun 15 04:29:18.500483 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:18.500407 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7dccd94c8f-rbvhf" Jun 15 04:29:18.520516 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:18.520468 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7dccd94c8f-rbvhf" podStartSLOduration=16.520452868 podStartE2EDuration="16.520452868s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 04:29:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:29:18.519895208 +0000 UTC m=+234.047886112" watchObservedRunningTime="2026-06-15 04:29:18.520452868 +0000 UTC m=+234.048443775" Jun 15 04:29:20.508860 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:20.508822 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-vftjx" event={"ID":"1afb59b4-9a11-44a4-b887-787a31d4d906","Type":"ContainerStarted","Data":"c9c872c5314a8f55bff7f52a776e67c748c123759a7091588fceadba9b8d046e"} Jun 15 04:29:20.509228 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:20.508927 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-vftjx" event={"ID":"1afb59b4-9a11-44a4-b887-787a31d4d906","Type":"ContainerStarted","Data":"281fe8180626230866b6204339df59655305467da9377781798d83cedaf41229"} Jun 15 04:29:20.523191 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:20.523143 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-vftjx" podStartSLOduration=16.811157402 podStartE2EDuration="18.52312833s" totalImagesPullingTime="1.711970928s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 04:29:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:29:20.521790128 +0000 UTC m=+236.049781034" watchObservedRunningTime="2026-06-15 04:29:20.52312833 +0000 UTC m=+236.051119235" Jun 15 04:29:22.321621 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:22.321580 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a64a069b-6288-41dd-a2b4-844b5a0e0a6a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fvvjk\" (UID: \"a64a069b-6288-41dd-a2b4-844b5a0e0a6a\") " pod="openshift-insights/insights-runtime-extractor-fvvjk" Jun 15 04:29:22.322094 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:22.321725 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a64a069b-6288-41dd-a2b4-844b5a0e0a6a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fvvjk\" (UID: \"a64a069b-6288-41dd-a2b4-844b5a0e0a6a\") " pod="openshift-insights/insights-runtime-extractor-fvvjk" Jun 15 04:29:22.322279 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:22.322258 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a64a069b-6288-41dd-a2b4-844b5a0e0a6a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fvvjk\" (UID: \"a64a069b-6288-41dd-a2b4-844b5a0e0a6a\") " pod="openshift-insights/insights-runtime-extractor-fvvjk" Jun 15 04:29:22.323808 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:22.323788 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a64a069b-6288-41dd-a2b4-844b5a0e0a6a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fvvjk\" (UID: \"a64a069b-6288-41dd-a2b4-844b5a0e0a6a\") " pod="openshift-insights/insights-runtime-extractor-fvvjk" Jun 15 04:29:22.382995 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:22.382954 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fvvjk" Jun 15 04:29:22.504692 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:22.504660 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fvvjk"] Jun 15 04:29:22.507491 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:29:22.507464 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda64a069b_6288_41dd_a2b4_844b5a0e0a6a.slice/crio-d9b36e2318f1bc2ed528d7b5afc30fab9004fb223e8dd6114ff0ba4b32e3b28c WatchSource:0}: Error finding container d9b36e2318f1bc2ed528d7b5afc30fab9004fb223e8dd6114ff0ba4b32e3b28c: Status 404 returned error can't find the container with id d9b36e2318f1bc2ed528d7b5afc30fab9004fb223e8dd6114ff0ba4b32e3b28c Jun 15 04:29:22.518128 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:22.518104 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fvvjk" event={"ID":"a64a069b-6288-41dd-a2b4-844b5a0e0a6a","Type":"ContainerStarted","Data":"d9b36e2318f1bc2ed528d7b5afc30fab9004fb223e8dd6114ff0ba4b32e3b28c"} Jun 15 04:29:26.532912 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:26.532870 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fvvjk" event={"ID":"a64a069b-6288-41dd-a2b4-844b5a0e0a6a","Type":"ContainerStarted","Data":"b358b2598771e03484dc63bb0e8a7329cfa83e63684581edefa6160ad2b7a3e4"} Jun 15 04:29:27.537622 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:27.537579 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fvvjk" event={"ID":"a64a069b-6288-41dd-a2b4-844b5a0e0a6a","Type":"ContainerStarted","Data":"4385fc2f86b3ff0d12b8f2d85d16ff143f9596cef9754c21da79c39cb62b08c8"} Jun 15 04:29:29.545973 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:29.545940 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fvvjk" event={"ID":"a64a069b-6288-41dd-a2b4-844b5a0e0a6a","Type":"ContainerStarted","Data":"7895df5abea1b769f906c71c25570359719265f3439c5221d443995d95ba0fc3"} Jun 15 04:29:29.562244 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:29.562198 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-fvvjk" podStartSLOduration=17.542399847 podStartE2EDuration="23.562184485s" totalImagesPullingTime="6.019784638s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 04:29:06 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:29:29.561375346 +0000 UTC m=+245.089366275" watchObservedRunningTime="2026-06-15 04:29:29.562184485 +0000 UTC m=+245.090175389" Jun 15 04:29:30.851744 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:30.851706 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7dccd94c8f-rbvhf"] Jun 15 04:29:34.115772 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:34.115685 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6c21d099-af2c-41fc-aca7-dac74c4dee06-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-sgvbt\" (UID: \"6c21d099-af2c-41fc-aca7-dac74c4dee06\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-sgvbt" Jun 15 04:29:34.118160 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:34.118135 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6c21d099-af2c-41fc-aca7-dac74c4dee06-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-sgvbt\" (UID: \"6c21d099-af2c-41fc-aca7-dac74c4dee06\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-sgvbt" Jun 15 04:29:34.419273 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:34.419243 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-xmrxd\"" Jun 15 04:29:34.427896 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:34.427876 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-867b76cb74-sgvbt" Jun 15 04:29:34.548767 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:34.548740 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-sgvbt"] Jun 15 04:29:34.551099 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:29:34.551070 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c21d099_af2c_41fc_aca7_dac74c4dee06.slice/crio-ef80b0d8b5ca79c06ded7525c152819312b2f9a596e8b3abac9d7fb8e10137ad WatchSource:0}: Error finding container ef80b0d8b5ca79c06ded7525c152819312b2f9a596e8b3abac9d7fb8e10137ad: Status 404 returned error can't find the container with id ef80b0d8b5ca79c06ded7525c152819312b2f9a596e8b3abac9d7fb8e10137ad Jun 15 04:29:34.561587 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:34.561560 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-867b76cb74-sgvbt" event={"ID":"6c21d099-af2c-41fc-aca7-dac74c4dee06","Type":"ContainerStarted","Data":"ef80b0d8b5ca79c06ded7525c152819312b2f9a596e8b3abac9d7fb8e10137ad"} Jun 15 04:29:36.076040 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:36.076003 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-8gjqv"] Jun 15 04:29:36.079245 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:36.079226 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-8gjqv" Jun 15 04:29:36.081162 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:36.081140 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 15 04:29:36.081271 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:36.081163 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-6fzpr\"" Jun 15 04:29:36.085935 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:36.085914 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-8gjqv"] Jun 15 04:29:36.232431 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:36.232394 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f137ce52-a220-46de-a6c6-f9c648fc8005-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-8gjqv\" (UID: \"f137ce52-a220-46de-a6c6-f9c648fc8005\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-8gjqv" Jun 15 04:29:36.333408 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:36.333320 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f137ce52-a220-46de-a6c6-f9c648fc8005-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-8gjqv\" (UID: \"f137ce52-a220-46de-a6c6-f9c648fc8005\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-8gjqv" Jun 15 04:29:36.335862 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:36.335842 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f137ce52-a220-46de-a6c6-f9c648fc8005-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-8gjqv\" (UID: \"f137ce52-a220-46de-a6c6-f9c648fc8005\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-8gjqv" Jun 15 04:29:36.388834 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:36.388796 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-8gjqv" Jun 15 04:29:36.506060 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:36.506024 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-8gjqv"] Jun 15 04:29:36.509505 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:29:36.509476 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf137ce52_a220_46de_a6c6_f9c648fc8005.slice/crio-2477b6e69cfb10c15092d5612bc55cde2c6af6fdc1e3d4789d342b3d65554718 WatchSource:0}: Error finding container 2477b6e69cfb10c15092d5612bc55cde2c6af6fdc1e3d4789d342b3d65554718: Status 404 returned error can't find the container with id 2477b6e69cfb10c15092d5612bc55cde2c6af6fdc1e3d4789d342b3d65554718 Jun 15 04:29:36.572244 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:36.572207 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-867b76cb74-sgvbt" event={"ID":"6c21d099-af2c-41fc-aca7-dac74c4dee06","Type":"ContainerStarted","Data":"354ac906cadfda99c45a2ab34c60ec25a9791fa95087f4eaa6a8d93e98fe874b"} Jun 15 04:29:36.573350 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:36.573324 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-8gjqv" event={"ID":"f137ce52-a220-46de-a6c6-f9c648fc8005","Type":"ContainerStarted","Data":"2477b6e69cfb10c15092d5612bc55cde2c6af6fdc1e3d4789d342b3d65554718"} Jun 15 04:29:36.587135 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:36.587053 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-867b76cb74-sgvbt" podStartSLOduration=33.534216668 podStartE2EDuration="34.587040362s" totalImagesPullingTime="1.052823694s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 04:29:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:29:36.585995602 +0000 UTC m=+252.113986517" watchObservedRunningTime="2026-06-15 04:29:36.587040362 +0000 UTC m=+252.115031291" Jun 15 04:29:36.635290 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:36.635257 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87abfa61-f00e-4746-9e96-f6940cbec767-metrics-certs\") pod \"network-metrics-daemon-4vqz4\" (UID: \"87abfa61-f00e-4746-9e96-f6940cbec767\") " pod="openshift-multus/network-metrics-daemon-4vqz4" Jun 15 04:29:36.637547 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:36.637517 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87abfa61-f00e-4746-9e96-f6940cbec767-metrics-certs\") pod \"network-metrics-daemon-4vqz4\" (UID: \"87abfa61-f00e-4746-9e96-f6940cbec767\") " pod="openshift-multus/network-metrics-daemon-4vqz4" Jun 15 04:29:36.923552 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:36.923511 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8s6z2\"" Jun 15 04:29:36.931398 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:36.931375 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4vqz4" Jun 15 04:29:37.088809 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:37.088756 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4vqz4"] Jun 15 04:29:37.091009 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:29:37.090977 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87abfa61_f00e_4746_9e96_f6940cbec767.slice/crio-3600051e0777fe0e2830b5dd1a2ab9189b8ee9b1104991304ff265ca71f36446 WatchSource:0}: Error finding container 3600051e0777fe0e2830b5dd1a2ab9189b8ee9b1104991304ff265ca71f36446: Status 404 returned error can't find the container with id 3600051e0777fe0e2830b5dd1a2ab9189b8ee9b1104991304ff265ca71f36446 Jun 15 04:29:37.578461 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:37.578405 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4vqz4" event={"ID":"87abfa61-f00e-4746-9e96-f6940cbec767","Type":"ContainerStarted","Data":"3600051e0777fe0e2830b5dd1a2ab9189b8ee9b1104991304ff265ca71f36446"} Jun 15 04:29:37.580119 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:37.580080 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-8gjqv" event={"ID":"f137ce52-a220-46de-a6c6-f9c648fc8005","Type":"ContainerStarted","Data":"667f33a8253b31ad8c7fac606d060e9607dc481ed33bec9f749f841bc4ebe9cc"} Jun 15 04:29:37.580406 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:37.580367 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-8gjqv" Jun 15 04:29:37.585982 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:37.585961 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-8gjqv" Jun 15 04:29:37.593744 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:37.593703 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-8gjqv" podStartSLOduration=0.686775963 podStartE2EDuration="1.593687095s" totalImagesPullingTime="906.911132ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 04:29:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:29:37.593003282 +0000 UTC m=+253.120994192" watchObservedRunningTime="2026-06-15 04:29:37.593687095 +0000 UTC m=+253.121678000" Jun 15 04:29:38.585591 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:38.585555 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4vqz4" event={"ID":"87abfa61-f00e-4746-9e96-f6940cbec767","Type":"ContainerStarted","Data":"166f1fe5a568c69725f8330c7460838b4880dcb18633304f076a73fc631c3bbe"} Jun 15 04:29:38.585981 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:38.585608 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4vqz4" event={"ID":"87abfa61-f00e-4746-9e96-f6940cbec767","Type":"ContainerStarted","Data":"25f74b79adbe0ee0426b9d019110759eb413d76578a6531a2a58b49566b00c84"} Jun 15 04:29:38.600820 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:38.600776 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-4vqz4" podStartSLOduration=253.76714833 podStartE2EDuration="4m14.60076069s" totalImagesPullingTime="833.61236ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 04:25:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:29:38.599634811 +0000 UTC m=+254.127625739" watchObservedRunningTime="2026-06-15 04:29:38.60076069 +0000 UTC m=+254.128751595" Jun 15 04:29:40.856938 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:40.856902 2561 patch_prober.go:28] interesting pod/image-registry-7dccd94c8f-rbvhf container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 15 04:29:40.857299 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:40.856954 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7dccd94c8f-rbvhf" podUID="95e71c9a-91b3-441d-a762-b90057fa6ac1" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 15 04:29:42.457501 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:42.457466 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-9pgrx"] Jun 15 04:29:42.623878 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:42.623841 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-84nz8"] Jun 15 04:29:42.624038 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:42.623983 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-9pgrx" Jun 15 04:29:42.626205 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:42.626176 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 15 04:29:42.626530 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:42.626514 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 15 04:29:42.626621 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:42.626565 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 15 04:29:42.626726 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:42.626711 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 15 04:29:42.626791 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:42.626724 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-v76fl\"" Jun 15 04:29:42.626857 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:42.626841 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 15 04:29:42.645095 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:42.645077 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-t97gc"] Jun 15 04:29:42.645214 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:42.645190 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-678bc549d7-84nz8" Jun 15 04:29:42.647285 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:42.647265 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 15 04:29:42.647379 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:42.647285 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 15 04:29:42.647577 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:42.647543 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-zjtcr\"" Jun 15 04:29:42.647683 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:42.647605 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 15 04:29:42.663142 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:42.663123 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-9pgrx"] Jun 15 04:29:42.663259 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:42.663158 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-84nz8"] Jun 15 04:29:42.663259 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:42.663247 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-t97gc" Jun 15 04:29:42.665596 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:42.665577 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 15 04:29:42.665795 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:42.665582 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 15 04:29:42.665795 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:42.665604 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-z6bg8\"" Jun 15 04:29:42.665932 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:42.665610 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 15 04:29:42.784555 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:42.784475 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/af51b2a9-d67b-49dd-9cf7-6c1ed7363a2b-sys\") pod \"node-exporter-t97gc\" (UID: \"af51b2a9-d67b-49dd-9cf7-6c1ed7363a2b\") " pod="openshift-monitoring/node-exporter-t97gc" Jun 15 04:29:42.784555 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:42.784512 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/af51b2a9-d67b-49dd-9cf7-6c1ed7363a2b-node-exporter-wtmp\") pod \"node-exporter-t97gc\" (UID: \"af51b2a9-d67b-49dd-9cf7-6c1ed7363a2b\") " pod="openshift-monitoring/node-exporter-t97gc" Jun 15 04:29:42.784555 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:42.784555 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/55950e9e-522b-4792-b22d-c3a5cdaa61c9-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-84nz8\" (UID: \"55950e9e-522b-4792-b22d-c3a5cdaa61c9\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-84nz8" Jun 15 04:29:42.784826 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:42.784583 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/af51b2a9-d67b-49dd-9cf7-6c1ed7363a2b-metrics-client-ca\") pod \"node-exporter-t97gc\" (UID: \"af51b2a9-d67b-49dd-9cf7-6c1ed7363a2b\") " pod="openshift-monitoring/node-exporter-t97gc" Jun 15 04:29:42.784826 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:42.784608 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/af51b2a9-d67b-49dd-9cf7-6c1ed7363a2b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-t97gc\" (UID: \"af51b2a9-d67b-49dd-9cf7-6c1ed7363a2b\") " pod="openshift-monitoring/node-exporter-t97gc" Jun 15 04:29:42.784826 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:42.784629 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkf5n\" (UniqueName: \"kubernetes.io/projected/af51b2a9-d67b-49dd-9cf7-6c1ed7363a2b-kube-api-access-dkf5n\") pod \"node-exporter-t97gc\" (UID: \"af51b2a9-d67b-49dd-9cf7-6c1ed7363a2b\") " pod="openshift-monitoring/node-exporter-t97gc" Jun 15 04:29:42.784826 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:42.784656 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/382a07e2-0ef4-421e-8167-568ab4be9a73-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-9pgrx\" (UID: \"382a07e2-0ef4-421e-8167-568ab4be9a73\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-9pgrx" Jun 15 04:29:42.784826 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:42.784697 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/382a07e2-0ef4-421e-8167-568ab4be9a73-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-9pgrx\" (UID: \"382a07e2-0ef4-421e-8167-568ab4be9a73\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-9pgrx" Jun 15 04:29:42.784826 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:42.784720 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/55950e9e-522b-4792-b22d-c3a5cdaa61c9-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-84nz8\" (UID: \"55950e9e-522b-4792-b22d-c3a5cdaa61c9\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-84nz8" Jun 15 04:29:42.784826 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:42.784745 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/55950e9e-522b-4792-b22d-c3a5cdaa61c9-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-84nz8\" (UID: \"55950e9e-522b-4792-b22d-c3a5cdaa61c9\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-84nz8" Jun 15 04:29:42.784826 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:42.784785 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/55950e9e-522b-4792-b22d-c3a5cdaa61c9-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-84nz8\" (UID: \"55950e9e-522b-4792-b22d-c3a5cdaa61c9\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-84nz8" Jun 15 04:29:42.785067 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:42.784853 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/af51b2a9-d67b-49dd-9cf7-6c1ed7363a2b-node-exporter-accelerators-collector-config\") pod \"node-exporter-t97gc\" (UID: \"af51b2a9-d67b-49dd-9cf7-6c1ed7363a2b\") " pod="openshift-monitoring/node-exporter-t97gc" Jun 15 04:29:42.785067 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:42.784884 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kh2j\" (UniqueName: \"kubernetes.io/projected/55950e9e-522b-4792-b22d-c3a5cdaa61c9-kube-api-access-8kh2j\") pod \"kube-state-metrics-678bc549d7-84nz8\" (UID: \"55950e9e-522b-4792-b22d-c3a5cdaa61c9\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-84nz8" Jun 15 04:29:42.785067 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:42.784929 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/af51b2a9-d67b-49dd-9cf7-6c1ed7363a2b-root\") pod \"node-exporter-t97gc\" (UID: \"af51b2a9-d67b-49dd-9cf7-6c1ed7363a2b\") " pod="openshift-monitoring/node-exporter-t97gc" Jun 15 04:29:42.785067 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:42.784969 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sr5m5\" (UniqueName: \"kubernetes.io/projected/382a07e2-0ef4-421e-8167-568ab4be9a73-kube-api-access-sr5m5\") pod \"openshift-state-metrics-6b8d965dd5-9pgrx\" (UID: \"382a07e2-0ef4-421e-8167-568ab4be9a73\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-9pgrx" Jun 15 04:29:42.785067 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:42.784997 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/382a07e2-0ef4-421e-8167-568ab4be9a73-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-9pgrx\" (UID: \"382a07e2-0ef4-421e-8167-568ab4be9a73\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-9pgrx" Jun 15 04:29:42.785067 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:42.785024 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/af51b2a9-d67b-49dd-9cf7-6c1ed7363a2b-node-exporter-tls\") pod \"node-exporter-t97gc\" (UID: \"af51b2a9-d67b-49dd-9cf7-6c1ed7363a2b\") " pod="openshift-monitoring/node-exporter-t97gc" Jun 15 04:29:42.785297 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:42.785085 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/55950e9e-522b-4792-b22d-c3a5cdaa61c9-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-84nz8\" (UID: \"55950e9e-522b-4792-b22d-c3a5cdaa61c9\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-84nz8" Jun 15 04:29:42.785297 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:42.785116 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/af51b2a9-d67b-49dd-9cf7-6c1ed7363a2b-node-exporter-textfile\") pod \"node-exporter-t97gc\" (UID: \"af51b2a9-d67b-49dd-9cf7-6c1ed7363a2b\") " pod="openshift-monitoring/node-exporter-t97gc" Jun 15 04:29:42.886031 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:42.885998 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/382a07e2-0ef4-421e-8167-568ab4be9a73-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-9pgrx\" (UID: \"382a07e2-0ef4-421e-8167-568ab4be9a73\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-9pgrx" Jun 15 04:29:42.886031 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:42.886031 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/55950e9e-522b-4792-b22d-c3a5cdaa61c9-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-84nz8\" (UID: \"55950e9e-522b-4792-b22d-c3a5cdaa61c9\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-84nz8" Jun 15 04:29:42.886288 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:42.886049 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/55950e9e-522b-4792-b22d-c3a5cdaa61c9-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-84nz8\" (UID: \"55950e9e-522b-4792-b22d-c3a5cdaa61c9\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-84nz8" Jun 15 04:29:42.886288 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:42.886075 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/55950e9e-522b-4792-b22d-c3a5cdaa61c9-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-84nz8\" (UID: \"55950e9e-522b-4792-b22d-c3a5cdaa61c9\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-84nz8" Jun 15 04:29:42.886288 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:42.886098 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/af51b2a9-d67b-49dd-9cf7-6c1ed7363a2b-node-exporter-accelerators-collector-config\") pod \"node-exporter-t97gc\" (UID: \"af51b2a9-d67b-49dd-9cf7-6c1ed7363a2b\") " pod="openshift-monitoring/node-exporter-t97gc" Jun 15 04:29:42.886288 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:42.886125 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kh2j\" (UniqueName: \"kubernetes.io/projected/55950e9e-522b-4792-b22d-c3a5cdaa61c9-kube-api-access-8kh2j\") pod \"kube-state-metrics-678bc549d7-84nz8\" (UID: \"55950e9e-522b-4792-b22d-c3a5cdaa61c9\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-84nz8" Jun 15 04:29:42.886288 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:42.886149 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/af51b2a9-d67b-49dd-9cf7-6c1ed7363a2b-root\") pod \"node-exporter-t97gc\" (UID: \"af51b2a9-d67b-49dd-9cf7-6c1ed7363a2b\") " pod="openshift-monitoring/node-exporter-t97gc" Jun 15 04:29:42.886288 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:42.886176 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sr5m5\" (UniqueName: \"kubernetes.io/projected/382a07e2-0ef4-421e-8167-568ab4be9a73-kube-api-access-sr5m5\") pod \"openshift-state-metrics-6b8d965dd5-9pgrx\" (UID: \"382a07e2-0ef4-421e-8167-568ab4be9a73\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-9pgrx" Jun 15 04:29:42.886288 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:42.886200 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/382a07e2-0ef4-421e-8167-568ab4be9a73-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-9pgrx\" (UID: \"382a07e2-0ef4-421e-8167-568ab4be9a73\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-9pgrx" Jun 15 04:29:42.886288 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:42.886219 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/af51b2a9-d67b-49dd-9cf7-6c1ed7363a2b-node-exporter-tls\") pod \"node-exporter-t97gc\" (UID: \"af51b2a9-d67b-49dd-9cf7-6c1ed7363a2b\") " pod="openshift-monitoring/node-exporter-t97gc" Jun 15 04:29:42.886288 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:42.886244 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/55950e9e-522b-4792-b22d-c3a5cdaa61c9-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-84nz8\" (UID: \"55950e9e-522b-4792-b22d-c3a5cdaa61c9\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-84nz8" Jun 15 04:29:42.886288 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:42.886274 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/af51b2a9-d67b-49dd-9cf7-6c1ed7363a2b-node-exporter-textfile\") pod \"node-exporter-t97gc\" (UID: \"af51b2a9-d67b-49dd-9cf7-6c1ed7363a2b\") " pod="openshift-monitoring/node-exporter-t97gc" Jun 15 04:29:42.886834 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:42.886319 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/af51b2a9-d67b-49dd-9cf7-6c1ed7363a2b-sys\") pod \"node-exporter-t97gc\" (UID: \"af51b2a9-d67b-49dd-9cf7-6c1ed7363a2b\") " pod="openshift-monitoring/node-exporter-t97gc" Jun 15 04:29:42.886834 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:42.886341 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/af51b2a9-d67b-49dd-9cf7-6c1ed7363a2b-node-exporter-wtmp\") pod \"node-exporter-t97gc\" (UID: \"af51b2a9-d67b-49dd-9cf7-6c1ed7363a2b\") " pod="openshift-monitoring/node-exporter-t97gc" Jun 15 04:29:42.886834 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:42.886385 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/55950e9e-522b-4792-b22d-c3a5cdaa61c9-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-84nz8\" (UID: \"55950e9e-522b-4792-b22d-c3a5cdaa61c9\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-84nz8" Jun 15 04:29:42.886834 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:29:42.886394 2561 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jun 15 04:29:42.886834 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:42.886417 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/af51b2a9-d67b-49dd-9cf7-6c1ed7363a2b-metrics-client-ca\") pod \"node-exporter-t97gc\" (UID: \"af51b2a9-d67b-49dd-9cf7-6c1ed7363a2b\") " pod="openshift-monitoring/node-exporter-t97gc" Jun 15 04:29:42.886834 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:42.886458 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/af51b2a9-d67b-49dd-9cf7-6c1ed7363a2b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-t97gc\" (UID: \"af51b2a9-d67b-49dd-9cf7-6c1ed7363a2b\") " pod="openshift-monitoring/node-exporter-t97gc" Jun 15 04:29:42.886834 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:29:42.886495 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55950e9e-522b-4792-b22d-c3a5cdaa61c9-kube-state-metrics-tls podName:55950e9e-522b-4792-b22d-c3a5cdaa61c9 nodeName:}" failed. No retries permitted until 2026-06-15 04:29:43.386474145 +0000 UTC m=+258.914465027 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/55950e9e-522b-4792-b22d-c3a5cdaa61c9-kube-state-metrics-tls") pod "kube-state-metrics-678bc549d7-84nz8" (UID: "55950e9e-522b-4792-b22d-c3a5cdaa61c9") : secret "kube-state-metrics-tls" not found Jun 15 04:29:42.886834 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:42.886508 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/55950e9e-522b-4792-b22d-c3a5cdaa61c9-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-84nz8\" (UID: \"55950e9e-522b-4792-b22d-c3a5cdaa61c9\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-84nz8" Jun 15 04:29:42.886834 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:42.886520 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkf5n\" (UniqueName: \"kubernetes.io/projected/af51b2a9-d67b-49dd-9cf7-6c1ed7363a2b-kube-api-access-dkf5n\") pod \"node-exporter-t97gc\" (UID: \"af51b2a9-d67b-49dd-9cf7-6c1ed7363a2b\") " pod="openshift-monitoring/node-exporter-t97gc" Jun 15 04:29:42.886834 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:42.886566 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/382a07e2-0ef4-421e-8167-568ab4be9a73-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-9pgrx\" (UID: \"382a07e2-0ef4-421e-8167-568ab4be9a73\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-9pgrx" Jun 15 04:29:42.886834 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:42.886564 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/af51b2a9-d67b-49dd-9cf7-6c1ed7363a2b-root\") pod \"node-exporter-t97gc\" (UID: \"af51b2a9-d67b-49dd-9cf7-6c1ed7363a2b\") " pod="openshift-monitoring/node-exporter-t97gc" Jun 15 04:29:42.886834 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:42.886684 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/af51b2a9-d67b-49dd-9cf7-6c1ed7363a2b-node-exporter-wtmp\") pod \"node-exporter-t97gc\" (UID: \"af51b2a9-d67b-49dd-9cf7-6c1ed7363a2b\") " pod="openshift-monitoring/node-exporter-t97gc" Jun 15 04:29:42.886834 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:42.886736 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/af51b2a9-d67b-49dd-9cf7-6c1ed7363a2b-node-exporter-accelerators-collector-config\") pod \"node-exporter-t97gc\" (UID: \"af51b2a9-d67b-49dd-9cf7-6c1ed7363a2b\") " pod="openshift-monitoring/node-exporter-t97gc" Jun 15 04:29:42.887567 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:42.886950 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/af51b2a9-d67b-49dd-9cf7-6c1ed7363a2b-node-exporter-textfile\") pod \"node-exporter-t97gc\" (UID: \"af51b2a9-d67b-49dd-9cf7-6c1ed7363a2b\") " pod="openshift-monitoring/node-exporter-t97gc" Jun 15 04:29:42.887567 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:42.887011 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/af51b2a9-d67b-49dd-9cf7-6c1ed7363a2b-sys\") pod \"node-exporter-t97gc\" (UID: \"af51b2a9-d67b-49dd-9cf7-6c1ed7363a2b\") " pod="openshift-monitoring/node-exporter-t97gc" Jun 15 04:29:42.887567 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:42.887177 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/55950e9e-522b-4792-b22d-c3a5cdaa61c9-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-84nz8\" (UID: \"55950e9e-522b-4792-b22d-c3a5cdaa61c9\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-84nz8" Jun 15 04:29:42.887567 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:42.887393 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/55950e9e-522b-4792-b22d-c3a5cdaa61c9-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-84nz8\" (UID: \"55950e9e-522b-4792-b22d-c3a5cdaa61c9\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-84nz8" Jun 15 04:29:42.887567 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:42.887540 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/af51b2a9-d67b-49dd-9cf7-6c1ed7363a2b-metrics-client-ca\") pod \"node-exporter-t97gc\" (UID: \"af51b2a9-d67b-49dd-9cf7-6c1ed7363a2b\") " pod="openshift-monitoring/node-exporter-t97gc" Jun 15 04:29:42.887878 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:42.887853 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/382a07e2-0ef4-421e-8167-568ab4be9a73-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-9pgrx\" (UID: \"382a07e2-0ef4-421e-8167-568ab4be9a73\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-9pgrx" Jun 15 04:29:42.888866 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:42.888835 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/af51b2a9-d67b-49dd-9cf7-6c1ed7363a2b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-t97gc\" (UID: \"af51b2a9-d67b-49dd-9cf7-6c1ed7363a2b\") " pod="openshift-monitoring/node-exporter-t97gc" Jun 15 04:29:42.888968 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:42.888918 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/af51b2a9-d67b-49dd-9cf7-6c1ed7363a2b-node-exporter-tls\") pod \"node-exporter-t97gc\" (UID: \"af51b2a9-d67b-49dd-9cf7-6c1ed7363a2b\") " pod="openshift-monitoring/node-exporter-t97gc" Jun 15 04:29:42.889189 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:42.889161 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/382a07e2-0ef4-421e-8167-568ab4be9a73-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-9pgrx\" (UID: \"382a07e2-0ef4-421e-8167-568ab4be9a73\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-9pgrx" Jun 15 04:29:42.889496 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:42.889478 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/382a07e2-0ef4-421e-8167-568ab4be9a73-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-9pgrx\" (UID: \"382a07e2-0ef4-421e-8167-568ab4be9a73\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-9pgrx" Jun 15 04:29:42.889846 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:42.889827 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/55950e9e-522b-4792-b22d-c3a5cdaa61c9-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-84nz8\" (UID: \"55950e9e-522b-4792-b22d-c3a5cdaa61c9\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-84nz8" Jun 15 04:29:42.894581 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:42.894563 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkf5n\" (UniqueName: \"kubernetes.io/projected/af51b2a9-d67b-49dd-9cf7-6c1ed7363a2b-kube-api-access-dkf5n\") pod \"node-exporter-t97gc\" (UID: \"af51b2a9-d67b-49dd-9cf7-6c1ed7363a2b\") " pod="openshift-monitoring/node-exporter-t97gc" Jun 15 04:29:42.894665 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:42.894581 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sr5m5\" (UniqueName: \"kubernetes.io/projected/382a07e2-0ef4-421e-8167-568ab4be9a73-kube-api-access-sr5m5\") pod \"openshift-state-metrics-6b8d965dd5-9pgrx\" (UID: \"382a07e2-0ef4-421e-8167-568ab4be9a73\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-9pgrx" Jun 15 04:29:42.894805 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:42.894785 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kh2j\" (UniqueName: \"kubernetes.io/projected/55950e9e-522b-4792-b22d-c3a5cdaa61c9-kube-api-access-8kh2j\") pod \"kube-state-metrics-678bc549d7-84nz8\" (UID: \"55950e9e-522b-4792-b22d-c3a5cdaa61c9\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-84nz8" Jun 15 04:29:42.935247 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:42.935221 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-9pgrx" Jun 15 04:29:42.972127 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:42.972106 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-t97gc" Jun 15 04:29:42.997120 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:29:42.997091 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf51b2a9_d67b_49dd_9cf7_6c1ed7363a2b.slice/crio-85d7bd11294b1df3fd3c04c53cf1799d692e919a663f0544cb9e3d99e32f23b7 WatchSource:0}: Error finding container 85d7bd11294b1df3fd3c04c53cf1799d692e919a663f0544cb9e3d99e32f23b7: Status 404 returned error can't find the container with id 85d7bd11294b1df3fd3c04c53cf1799d692e919a663f0544cb9e3d99e32f23b7 Jun 15 04:29:43.077825 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:43.077787 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-9pgrx"] Jun 15 04:29:43.079792 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:29:43.079764 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod382a07e2_0ef4_421e_8167_568ab4be9a73.slice/crio-d597621201abdba4ff548e881acf4cae6f482962621df1e19c35f484e5f33802 WatchSource:0}: Error finding container d597621201abdba4ff548e881acf4cae6f482962621df1e19c35f484e5f33802: Status 404 returned error can't find the container with id d597621201abdba4ff548e881acf4cae6f482962621df1e19c35f484e5f33802 Jun 15 04:29:43.390228 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:43.390150 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/55950e9e-522b-4792-b22d-c3a5cdaa61c9-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-84nz8\" (UID: \"55950e9e-522b-4792-b22d-c3a5cdaa61c9\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-84nz8" Jun 15 04:29:43.392629 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:43.392610 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/55950e9e-522b-4792-b22d-c3a5cdaa61c9-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-84nz8\" (UID: \"55950e9e-522b-4792-b22d-c3a5cdaa61c9\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-84nz8" Jun 15 04:29:43.554576 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:43.554547 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-678bc549d7-84nz8" Jun 15 04:29:43.606148 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:43.606105 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-9pgrx" event={"ID":"382a07e2-0ef4-421e-8167-568ab4be9a73","Type":"ContainerStarted","Data":"78529d94f9cc9da80c271a166d3cbe40a3faf12256606d3c46ec6d0c3b041dda"} Jun 15 04:29:43.606298 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:43.606181 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-9pgrx" event={"ID":"382a07e2-0ef4-421e-8167-568ab4be9a73","Type":"ContainerStarted","Data":"82aeaced8b505906c10a8b91e162cdccd0363a5f19787492274e44bde26fe484"} Jun 15 04:29:43.606298 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:43.606212 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-9pgrx" event={"ID":"382a07e2-0ef4-421e-8167-568ab4be9a73","Type":"ContainerStarted","Data":"d597621201abdba4ff548e881acf4cae6f482962621df1e19c35f484e5f33802"} Jun 15 04:29:43.607811 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:43.607785 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t97gc" event={"ID":"af51b2a9-d67b-49dd-9cf7-6c1ed7363a2b","Type":"ContainerStarted","Data":"85d7bd11294b1df3fd3c04c53cf1799d692e919a663f0544cb9e3d99e32f23b7"} Jun 15 04:29:43.705140 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:43.705049 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-84nz8"] Jun 15 04:29:43.907566 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:29:43.907529 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55950e9e_522b_4792_b22d_c3a5cdaa61c9.slice/crio-1149458eff97fd2959253ede6b30533b05c78e24e99b96936bd074c7e3d13ebb WatchSource:0}: Error finding container 1149458eff97fd2959253ede6b30533b05c78e24e99b96936bd074c7e3d13ebb: Status 404 returned error can't find the container with id 1149458eff97fd2959253ede6b30533b05c78e24e99b96936bd074c7e3d13ebb Jun 15 04:29:44.461579 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:44.461484 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6fd4d678b4-cnzlq"] Jun 15 04:29:44.465260 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:44.465238 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6fd4d678b4-cnzlq" Jun 15 04:29:44.467569 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:44.467548 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 15 04:29:44.467716 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:44.467574 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-bxq4c\"" Jun 15 04:29:44.467716 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:44.467594 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-69lt6jmi2ac5e\"" Jun 15 04:29:44.467716 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:44.467548 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 15 04:29:44.467716 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:44.467596 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 15 04:29:44.467987 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:44.467972 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 15 04:29:44.468091 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:44.468075 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 15 04:29:44.475140 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:44.475118 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6fd4d678b4-cnzlq"] Jun 15 04:29:44.603732 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:44.603697 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcf58\" (UniqueName: \"kubernetes.io/projected/148991d8-7720-4971-a969-f32a1b3a3662-kube-api-access-wcf58\") pod \"thanos-querier-6fd4d678b4-cnzlq\" (UID: \"148991d8-7720-4971-a969-f32a1b3a3662\") " pod="openshift-monitoring/thanos-querier-6fd4d678b4-cnzlq" Jun 15 04:29:44.604154 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:44.603754 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/148991d8-7720-4971-a969-f32a1b3a3662-secret-grpc-tls\") pod \"thanos-querier-6fd4d678b4-cnzlq\" (UID: \"148991d8-7720-4971-a969-f32a1b3a3662\") " pod="openshift-monitoring/thanos-querier-6fd4d678b4-cnzlq" Jun 15 04:29:44.604154 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:44.603855 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/148991d8-7720-4971-a969-f32a1b3a3662-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6fd4d678b4-cnzlq\" (UID: \"148991d8-7720-4971-a969-f32a1b3a3662\") " pod="openshift-monitoring/thanos-querier-6fd4d678b4-cnzlq" Jun 15 04:29:44.604154 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:44.603913 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/148991d8-7720-4971-a969-f32a1b3a3662-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6fd4d678b4-cnzlq\" (UID: \"148991d8-7720-4971-a969-f32a1b3a3662\") " pod="openshift-monitoring/thanos-querier-6fd4d678b4-cnzlq" Jun 15 04:29:44.604154 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:44.604027 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/148991d8-7720-4971-a969-f32a1b3a3662-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6fd4d678b4-cnzlq\" (UID: \"148991d8-7720-4971-a969-f32a1b3a3662\") " pod="openshift-monitoring/thanos-querier-6fd4d678b4-cnzlq" Jun 15 04:29:44.604154 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:44.604072 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/148991d8-7720-4971-a969-f32a1b3a3662-metrics-client-ca\") pod \"thanos-querier-6fd4d678b4-cnzlq\" (UID: \"148991d8-7720-4971-a969-f32a1b3a3662\") " pod="openshift-monitoring/thanos-querier-6fd4d678b4-cnzlq" Jun 15 04:29:44.604154 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:44.604098 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/148991d8-7720-4971-a969-f32a1b3a3662-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6fd4d678b4-cnzlq\" (UID: \"148991d8-7720-4971-a969-f32a1b3a3662\") " pod="openshift-monitoring/thanos-querier-6fd4d678b4-cnzlq" Jun 15 04:29:44.604154 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:44.604137 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/148991d8-7720-4971-a969-f32a1b3a3662-secret-thanos-querier-tls\") pod \"thanos-querier-6fd4d678b4-cnzlq\" (UID: \"148991d8-7720-4971-a969-f32a1b3a3662\") " pod="openshift-monitoring/thanos-querier-6fd4d678b4-cnzlq" Jun 15 04:29:44.613645 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:44.613616 2561 generic.go:356] "Generic (PLEG): container finished" podID="af51b2a9-d67b-49dd-9cf7-6c1ed7363a2b" containerID="ffd327fb8dead6186b4d1abc19d48f996213a1bf53ab55234df17778bbd8f2a0" exitCode=0 Jun 15 04:29:44.613776 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:44.613695 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t97gc" event={"ID":"af51b2a9-d67b-49dd-9cf7-6c1ed7363a2b","Type":"ContainerDied","Data":"ffd327fb8dead6186b4d1abc19d48f996213a1bf53ab55234df17778bbd8f2a0"} Jun 15 04:29:44.614960 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:44.614937 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-84nz8" event={"ID":"55950e9e-522b-4792-b22d-c3a5cdaa61c9","Type":"ContainerStarted","Data":"1149458eff97fd2959253ede6b30533b05c78e24e99b96936bd074c7e3d13ebb"} Jun 15 04:29:44.617326 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:44.617301 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-9pgrx" event={"ID":"382a07e2-0ef4-421e-8167-568ab4be9a73","Type":"ContainerStarted","Data":"f2420395cc5eab21687ea9bde50da77cc8b1f3812259cda9b323bc9d54c7c6cb"} Jun 15 04:29:44.643398 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:44.643349 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-9pgrx" podStartSLOduration=1.727527172 podStartE2EDuration="2.643333354s" totalImagesPullingTime="915.806182ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 04:29:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:29:44.642766159 +0000 UTC m=+260.170757065" watchObservedRunningTime="2026-06-15 04:29:44.643333354 +0000 UTC m=+260.171324258" Jun 15 04:29:44.705087 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:44.705060 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/148991d8-7720-4971-a969-f32a1b3a3662-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6fd4d678b4-cnzlq\" (UID: \"148991d8-7720-4971-a969-f32a1b3a3662\") " pod="openshift-monitoring/thanos-querier-6fd4d678b4-cnzlq" Jun 15 04:29:44.705199 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:44.705106 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/148991d8-7720-4971-a969-f32a1b3a3662-secret-thanos-querier-tls\") pod \"thanos-querier-6fd4d678b4-cnzlq\" (UID: \"148991d8-7720-4971-a969-f32a1b3a3662\") " pod="openshift-monitoring/thanos-querier-6fd4d678b4-cnzlq" Jun 15 04:29:44.705199 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:44.705137 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcf58\" (UniqueName: \"kubernetes.io/projected/148991d8-7720-4971-a969-f32a1b3a3662-kube-api-access-wcf58\") pod \"thanos-querier-6fd4d678b4-cnzlq\" (UID: \"148991d8-7720-4971-a969-f32a1b3a3662\") " pod="openshift-monitoring/thanos-querier-6fd4d678b4-cnzlq" Jun 15 04:29:44.705199 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:44.705168 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/148991d8-7720-4971-a969-f32a1b3a3662-secret-grpc-tls\") pod \"thanos-querier-6fd4d678b4-cnzlq\" (UID: \"148991d8-7720-4971-a969-f32a1b3a3662\") " pod="openshift-monitoring/thanos-querier-6fd4d678b4-cnzlq" Jun 15 04:29:44.705367 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:44.705200 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/148991d8-7720-4971-a969-f32a1b3a3662-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6fd4d678b4-cnzlq\" (UID: \"148991d8-7720-4971-a969-f32a1b3a3662\") " pod="openshift-monitoring/thanos-querier-6fd4d678b4-cnzlq" Jun 15 04:29:44.705367 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:44.705248 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/148991d8-7720-4971-a969-f32a1b3a3662-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6fd4d678b4-cnzlq\" (UID: \"148991d8-7720-4971-a969-f32a1b3a3662\") " pod="openshift-monitoring/thanos-querier-6fd4d678b4-cnzlq" Jun 15 04:29:44.705592 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:44.705558 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/148991d8-7720-4971-a969-f32a1b3a3662-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6fd4d678b4-cnzlq\" (UID: \"148991d8-7720-4971-a969-f32a1b3a3662\") " pod="openshift-monitoring/thanos-querier-6fd4d678b4-cnzlq" Jun 15 04:29:44.705662 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:44.705621 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/148991d8-7720-4971-a969-f32a1b3a3662-metrics-client-ca\") pod \"thanos-querier-6fd4d678b4-cnzlq\" (UID: \"148991d8-7720-4971-a969-f32a1b3a3662\") " pod="openshift-monitoring/thanos-querier-6fd4d678b4-cnzlq" Jun 15 04:29:44.706362 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:44.706338 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/148991d8-7720-4971-a969-f32a1b3a3662-metrics-client-ca\") pod \"thanos-querier-6fd4d678b4-cnzlq\" (UID: \"148991d8-7720-4971-a969-f32a1b3a3662\") " pod="openshift-monitoring/thanos-querier-6fd4d678b4-cnzlq" Jun 15 04:29:44.708291 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:44.708268 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/148991d8-7720-4971-a969-f32a1b3a3662-secret-thanos-querier-tls\") pod \"thanos-querier-6fd4d678b4-cnzlq\" (UID: \"148991d8-7720-4971-a969-f32a1b3a3662\") " pod="openshift-monitoring/thanos-querier-6fd4d678b4-cnzlq" Jun 15 04:29:44.708633 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:44.708605 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/148991d8-7720-4971-a969-f32a1b3a3662-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6fd4d678b4-cnzlq\" (UID: \"148991d8-7720-4971-a969-f32a1b3a3662\") " pod="openshift-monitoring/thanos-querier-6fd4d678b4-cnzlq" Jun 15 04:29:44.708997 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:44.708935 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/148991d8-7720-4971-a969-f32a1b3a3662-secret-grpc-tls\") pod \"thanos-querier-6fd4d678b4-cnzlq\" (UID: \"148991d8-7720-4971-a969-f32a1b3a3662\") " pod="openshift-monitoring/thanos-querier-6fd4d678b4-cnzlq" Jun 15 04:29:44.709414 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:44.709390 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/148991d8-7720-4971-a969-f32a1b3a3662-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6fd4d678b4-cnzlq\" (UID: \"148991d8-7720-4971-a969-f32a1b3a3662\") " pod="openshift-monitoring/thanos-querier-6fd4d678b4-cnzlq" Jun 15 04:29:44.709645 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:44.709622 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/148991d8-7720-4971-a969-f32a1b3a3662-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6fd4d678b4-cnzlq\" (UID: \"148991d8-7720-4971-a969-f32a1b3a3662\") " pod="openshift-monitoring/thanos-querier-6fd4d678b4-cnzlq" Jun 15 04:29:44.709825 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:44.709804 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/148991d8-7720-4971-a969-f32a1b3a3662-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6fd4d678b4-cnzlq\" (UID: \"148991d8-7720-4971-a969-f32a1b3a3662\") " pod="openshift-monitoring/thanos-querier-6fd4d678b4-cnzlq" Jun 15 04:29:44.712591 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:44.712532 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcf58\" (UniqueName: \"kubernetes.io/projected/148991d8-7720-4971-a969-f32a1b3a3662-kube-api-access-wcf58\") pod \"thanos-querier-6fd4d678b4-cnzlq\" (UID: \"148991d8-7720-4971-a969-f32a1b3a3662\") " pod="openshift-monitoring/thanos-querier-6fd4d678b4-cnzlq" Jun 15 04:29:44.777711 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:44.777650 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6fd4d678b4-cnzlq" Jun 15 04:29:45.157887 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:45.157863 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6fd4d678b4-cnzlq"] Jun 15 04:29:45.159137 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:29:45.159104 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod148991d8_7720_4971_a969_f32a1b3a3662.slice/crio-4a99a3677b6096f4567eae0c2e8a640d95bc63c848ae16aafa88519690153a95 WatchSource:0}: Error finding container 4a99a3677b6096f4567eae0c2e8a640d95bc63c848ae16aafa88519690153a95: Status 404 returned error can't find the container with id 4a99a3677b6096f4567eae0c2e8a640d95bc63c848ae16aafa88519690153a95 Jun 15 04:29:45.621972 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:45.621936 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6fd4d678b4-cnzlq" event={"ID":"148991d8-7720-4971-a969-f32a1b3a3662","Type":"ContainerStarted","Data":"4a99a3677b6096f4567eae0c2e8a640d95bc63c848ae16aafa88519690153a95"} Jun 15 04:29:45.623985 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:45.623961 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t97gc" event={"ID":"af51b2a9-d67b-49dd-9cf7-6c1ed7363a2b","Type":"ContainerStarted","Data":"c6d7abc4a731581e7d65cbadb4351cec32e2a57dfa8c58bbb118de316ee02040"} Jun 15 04:29:45.624120 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:45.624009 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t97gc" event={"ID":"af51b2a9-d67b-49dd-9cf7-6c1ed7363a2b","Type":"ContainerStarted","Data":"c03615dacd08bfe06431a9fe85db76f5496bd3e1e8b165730496448ea68a90ad"} Jun 15 04:29:45.625940 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:45.625915 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-84nz8" event={"ID":"55950e9e-522b-4792-b22d-c3a5cdaa61c9","Type":"ContainerStarted","Data":"e66510006909ba53289f36e67a14c3d43f7df5a3dcb5ce5c146ff6208fa4a941"} Jun 15 04:29:45.626003 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:45.625968 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-84nz8" event={"ID":"55950e9e-522b-4792-b22d-c3a5cdaa61c9","Type":"ContainerStarted","Data":"87c03050fd21d455a920088b6e849cfb63e339740ab7308c7b1baf0832d20c83"} Jun 15 04:29:45.626003 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:45.625994 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-84nz8" event={"ID":"55950e9e-522b-4792-b22d-c3a5cdaa61c9","Type":"ContainerStarted","Data":"804e1d0d986e4b2ddfa12c5a502b87b1df79108ef10d2f9b744fdf2050d25843"} Jun 15 04:29:45.641251 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:45.641207 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-t97gc" podStartSLOduration=2.623807819 podStartE2EDuration="3.641194752s" totalImagesPullingTime="944.573071ms" totalInitContainerRuntime="72.813862ms" isStatefulPod=true podCreationTimestamp="2026-06-15 04:29:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:29:45.639389057 +0000 UTC m=+261.167379961" watchObservedRunningTime="2026-06-15 04:29:45.641194752 +0000 UTC m=+261.169185682" Jun 15 04:29:45.655400 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:45.655362 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-678bc549d7-84nz8" podStartSLOduration=2.484583324 podStartE2EDuration="3.655347793s" totalImagesPullingTime="1.170764469s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 04:29:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:29:45.654456072 +0000 UTC m=+261.182446977" watchObservedRunningTime="2026-06-15 04:29:45.655347793 +0000 UTC m=+261.183338697" Jun 15 04:29:46.780470 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:46.780416 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-ff6b4fd97-vpsrh"] Jun 15 04:29:46.784201 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:46.784182 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-ff6b4fd97-vpsrh" Jun 15 04:29:46.786545 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:46.786522 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 15 04:29:46.786545 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:46.786549 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-mnc2q\"" Jun 15 04:29:46.786721 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:46.786527 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 15 04:29:46.786721 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:46.786657 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 15 04:29:46.786721 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:46.786696 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 15 04:29:46.786861 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:46.786723 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-c2nl5km9rc4lq\"" Jun 15 04:29:46.794358 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:46.794333 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-ff6b4fd97-vpsrh"] Jun 15 04:29:46.821667 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:46.821643 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/2adda7a5-05be-40bb-8beb-8b92f762bace-secret-metrics-server-tls\") pod \"metrics-server-ff6b4fd97-vpsrh\" (UID: \"2adda7a5-05be-40bb-8beb-8b92f762bace\") " pod="openshift-monitoring/metrics-server-ff6b4fd97-vpsrh" Jun 15 04:29:46.821792 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:46.821679 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2adda7a5-05be-40bb-8beb-8b92f762bace-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-ff6b4fd97-vpsrh\" (UID: \"2adda7a5-05be-40bb-8beb-8b92f762bace\") " pod="openshift-monitoring/metrics-server-ff6b4fd97-vpsrh" Jun 15 04:29:46.821792 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:46.821774 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2adda7a5-05be-40bb-8beb-8b92f762bace-client-ca-bundle\") pod \"metrics-server-ff6b4fd97-vpsrh\" (UID: \"2adda7a5-05be-40bb-8beb-8b92f762bace\") " pod="openshift-monitoring/metrics-server-ff6b4fd97-vpsrh" Jun 15 04:29:46.821890 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:46.821808 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/2adda7a5-05be-40bb-8beb-8b92f762bace-metrics-server-audit-profiles\") pod \"metrics-server-ff6b4fd97-vpsrh\" (UID: \"2adda7a5-05be-40bb-8beb-8b92f762bace\") " pod="openshift-monitoring/metrics-server-ff6b4fd97-vpsrh" Jun 15 04:29:46.821890 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:46.821847 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/2adda7a5-05be-40bb-8beb-8b92f762bace-audit-log\") pod \"metrics-server-ff6b4fd97-vpsrh\" (UID: \"2adda7a5-05be-40bb-8beb-8b92f762bace\") " pod="openshift-monitoring/metrics-server-ff6b4fd97-vpsrh" Jun 15 04:29:46.821890 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:46.821883 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mng7f\" (UniqueName: \"kubernetes.io/projected/2adda7a5-05be-40bb-8beb-8b92f762bace-kube-api-access-mng7f\") pod \"metrics-server-ff6b4fd97-vpsrh\" (UID: \"2adda7a5-05be-40bb-8beb-8b92f762bace\") " pod="openshift-monitoring/metrics-server-ff6b4fd97-vpsrh" Jun 15 04:29:46.822014 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:46.821934 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/2adda7a5-05be-40bb-8beb-8b92f762bace-secret-metrics-server-client-certs\") pod \"metrics-server-ff6b4fd97-vpsrh\" (UID: \"2adda7a5-05be-40bb-8beb-8b92f762bace\") " pod="openshift-monitoring/metrics-server-ff6b4fd97-vpsrh" Jun 15 04:29:46.922998 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:46.922971 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/2adda7a5-05be-40bb-8beb-8b92f762bace-secret-metrics-server-tls\") pod \"metrics-server-ff6b4fd97-vpsrh\" (UID: \"2adda7a5-05be-40bb-8beb-8b92f762bace\") " pod="openshift-monitoring/metrics-server-ff6b4fd97-vpsrh" Jun 15 04:29:46.923111 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:46.923005 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2adda7a5-05be-40bb-8beb-8b92f762bace-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-ff6b4fd97-vpsrh\" (UID: \"2adda7a5-05be-40bb-8beb-8b92f762bace\") " pod="openshift-monitoring/metrics-server-ff6b4fd97-vpsrh" Jun 15 04:29:46.923111 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:46.923053 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2adda7a5-05be-40bb-8beb-8b92f762bace-client-ca-bundle\") pod \"metrics-server-ff6b4fd97-vpsrh\" (UID: \"2adda7a5-05be-40bb-8beb-8b92f762bace\") " pod="openshift-monitoring/metrics-server-ff6b4fd97-vpsrh" Jun 15 04:29:46.923111 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:46.923080 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/2adda7a5-05be-40bb-8beb-8b92f762bace-metrics-server-audit-profiles\") pod \"metrics-server-ff6b4fd97-vpsrh\" (UID: \"2adda7a5-05be-40bb-8beb-8b92f762bace\") " pod="openshift-monitoring/metrics-server-ff6b4fd97-vpsrh" Jun 15 04:29:46.923271 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:46.923206 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/2adda7a5-05be-40bb-8beb-8b92f762bace-audit-log\") pod \"metrics-server-ff6b4fd97-vpsrh\" (UID: \"2adda7a5-05be-40bb-8beb-8b92f762bace\") " pod="openshift-monitoring/metrics-server-ff6b4fd97-vpsrh" Jun 15 04:29:46.923271 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:46.923239 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mng7f\" (UniqueName: \"kubernetes.io/projected/2adda7a5-05be-40bb-8beb-8b92f762bace-kube-api-access-mng7f\") pod \"metrics-server-ff6b4fd97-vpsrh\" (UID: \"2adda7a5-05be-40bb-8beb-8b92f762bace\") " pod="openshift-monitoring/metrics-server-ff6b4fd97-vpsrh" Jun 15 04:29:46.923415 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:46.923268 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/2adda7a5-05be-40bb-8beb-8b92f762bace-secret-metrics-server-client-certs\") pod \"metrics-server-ff6b4fd97-vpsrh\" (UID: \"2adda7a5-05be-40bb-8beb-8b92f762bace\") " pod="openshift-monitoring/metrics-server-ff6b4fd97-vpsrh" Jun 15 04:29:46.923692 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:46.923673 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/2adda7a5-05be-40bb-8beb-8b92f762bace-audit-log\") pod \"metrics-server-ff6b4fd97-vpsrh\" (UID: \"2adda7a5-05be-40bb-8beb-8b92f762bace\") " pod="openshift-monitoring/metrics-server-ff6b4fd97-vpsrh" Jun 15 04:29:46.924314 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:46.924291 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2adda7a5-05be-40bb-8beb-8b92f762bace-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-ff6b4fd97-vpsrh\" (UID: \"2adda7a5-05be-40bb-8beb-8b92f762bace\") " pod="openshift-monitoring/metrics-server-ff6b4fd97-vpsrh" Jun 15 04:29:46.924406 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:46.924356 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/2adda7a5-05be-40bb-8beb-8b92f762bace-metrics-server-audit-profiles\") pod \"metrics-server-ff6b4fd97-vpsrh\" (UID: \"2adda7a5-05be-40bb-8beb-8b92f762bace\") " pod="openshift-monitoring/metrics-server-ff6b4fd97-vpsrh" Jun 15 04:29:46.926035 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:46.926011 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/2adda7a5-05be-40bb-8beb-8b92f762bace-secret-metrics-server-client-certs\") pod \"metrics-server-ff6b4fd97-vpsrh\" (UID: \"2adda7a5-05be-40bb-8beb-8b92f762bace\") " pod="openshift-monitoring/metrics-server-ff6b4fd97-vpsrh" Jun 15 04:29:46.926244 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:46.926220 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/2adda7a5-05be-40bb-8beb-8b92f762bace-secret-metrics-server-tls\") pod \"metrics-server-ff6b4fd97-vpsrh\" (UID: \"2adda7a5-05be-40bb-8beb-8b92f762bace\") " pod="openshift-monitoring/metrics-server-ff6b4fd97-vpsrh" Jun 15 04:29:46.926902 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:46.926877 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2adda7a5-05be-40bb-8beb-8b92f762bace-client-ca-bundle\") pod \"metrics-server-ff6b4fd97-vpsrh\" (UID: \"2adda7a5-05be-40bb-8beb-8b92f762bace\") " pod="openshift-monitoring/metrics-server-ff6b4fd97-vpsrh" Jun 15 04:29:46.930762 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:46.930741 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mng7f\" (UniqueName: \"kubernetes.io/projected/2adda7a5-05be-40bb-8beb-8b92f762bace-kube-api-access-mng7f\") pod \"metrics-server-ff6b4fd97-vpsrh\" (UID: \"2adda7a5-05be-40bb-8beb-8b92f762bace\") " pod="openshift-monitoring/metrics-server-ff6b4fd97-vpsrh" Jun 15 04:29:47.095182 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:47.095155 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-ff6b4fd97-vpsrh" Jun 15 04:29:47.216872 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:47.216843 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-ff6b4fd97-vpsrh"] Jun 15 04:29:47.219534 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:29:47.219499 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2adda7a5_05be_40bb_8beb_8b92f762bace.slice/crio-0414290976e72269171afa00da9581ed8feac708c6a149060fe1d5d5ddc24ca3 WatchSource:0}: Error finding container 0414290976e72269171afa00da9581ed8feac708c6a149060fe1d5d5ddc24ca3: Status 404 returned error can't find the container with id 0414290976e72269171afa00da9581ed8feac708c6a149060fe1d5d5ddc24ca3 Jun 15 04:29:47.240960 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:47.240936 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-llqnw"] Jun 15 04:29:47.245222 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:47.245205 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-589576dfc7-llqnw" Jun 15 04:29:47.246997 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:47.246976 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 15 04:29:47.247097 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:47.247047 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-mm6mz\"" Jun 15 04:29:47.253361 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:47.253338 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-llqnw"] Jun 15 04:29:47.327511 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:47.327416 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8q8km\" (UniqueName: \"kubernetes.io/projected/7f9a5b26-2747-4de7-86f8-f46117b31143-kube-api-access-8q8km\") pod \"monitoring-plugin-589576dfc7-llqnw\" (UID: \"7f9a5b26-2747-4de7-86f8-f46117b31143\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-llqnw" Jun 15 04:29:47.327662 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:47.327539 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7f9a5b26-2747-4de7-86f8-f46117b31143-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-llqnw\" (UID: \"7f9a5b26-2747-4de7-86f8-f46117b31143\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-llqnw" Jun 15 04:29:47.428657 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:47.428621 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7f9a5b26-2747-4de7-86f8-f46117b31143-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-llqnw\" (UID: \"7f9a5b26-2747-4de7-86f8-f46117b31143\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-llqnw" Jun 15 04:29:47.428850 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:47.428687 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8q8km\" (UniqueName: \"kubernetes.io/projected/7f9a5b26-2747-4de7-86f8-f46117b31143-kube-api-access-8q8km\") pod \"monitoring-plugin-589576dfc7-llqnw\" (UID: \"7f9a5b26-2747-4de7-86f8-f46117b31143\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-llqnw" Jun 15 04:29:47.428850 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:29:47.428766 2561 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jun 15 04:29:47.428850 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:29:47.428829 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f9a5b26-2747-4de7-86f8-f46117b31143-monitoring-plugin-cert podName:7f9a5b26-2747-4de7-86f8-f46117b31143 nodeName:}" failed. No retries permitted until 2026-06-15 04:29:47.928812964 +0000 UTC m=+263.456803851 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/7f9a5b26-2747-4de7-86f8-f46117b31143-monitoring-plugin-cert") pod "monitoring-plugin-589576dfc7-llqnw" (UID: "7f9a5b26-2747-4de7-86f8-f46117b31143") : secret "monitoring-plugin-cert" not found Jun 15 04:29:47.438708 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:47.438684 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8q8km\" (UniqueName: \"kubernetes.io/projected/7f9a5b26-2747-4de7-86f8-f46117b31143-kube-api-access-8q8km\") pod \"monitoring-plugin-589576dfc7-llqnw\" (UID: \"7f9a5b26-2747-4de7-86f8-f46117b31143\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-llqnw" Jun 15 04:29:47.637192 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:47.637108 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-ff6b4fd97-vpsrh" event={"ID":"2adda7a5-05be-40bb-8beb-8b92f762bace","Type":"ContainerStarted","Data":"0414290976e72269171afa00da9581ed8feac708c6a149060fe1d5d5ddc24ca3"} Jun 15 04:29:47.639850 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:47.639798 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6fd4d678b4-cnzlq" event={"ID":"148991d8-7720-4971-a969-f32a1b3a3662","Type":"ContainerStarted","Data":"9392c542b62ef71c71c5cff2ba8ed921ae19b9b989b318c4639f938e0a2f42bc"} Jun 15 04:29:47.639974 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:47.639881 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6fd4d678b4-cnzlq" event={"ID":"148991d8-7720-4971-a969-f32a1b3a3662","Type":"ContainerStarted","Data":"a3f1476b59171dd20e34c21a3cbc2b5201911b6177c2fc1f51813dc31aa4ac6c"} Jun 15 04:29:47.639974 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:47.639929 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6fd4d678b4-cnzlq" event={"ID":"148991d8-7720-4971-a969-f32a1b3a3662","Type":"ContainerStarted","Data":"454f718f6923c9c0039473fbff022449d6e3065d3bc09b814038b478e141c3d1"} Jun 15 04:29:47.933537 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:47.933414 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7f9a5b26-2747-4de7-86f8-f46117b31143-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-llqnw\" (UID: \"7f9a5b26-2747-4de7-86f8-f46117b31143\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-llqnw" Jun 15 04:29:47.936274 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:47.936247 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7f9a5b26-2747-4de7-86f8-f46117b31143-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-llqnw\" (UID: \"7f9a5b26-2747-4de7-86f8-f46117b31143\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-llqnw" Jun 15 04:29:48.155109 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:48.155027 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-589576dfc7-llqnw" Jun 15 04:29:48.523591 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:48.523560 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-llqnw"] Jun 15 04:29:48.526965 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:29:48.526927 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f9a5b26_2747_4de7_86f8_f46117b31143.slice/crio-b412372410203738aaeac75267c9939dab490af240f09a0a4b2be731c46c1bbf WatchSource:0}: Error finding container b412372410203738aaeac75267c9939dab490af240f09a0a4b2be731c46c1bbf: Status 404 returned error can't find the container with id b412372410203738aaeac75267c9939dab490af240f09a0a4b2be731c46c1bbf Jun 15 04:29:48.647373 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:48.647337 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6fd4d678b4-cnzlq" event={"ID":"148991d8-7720-4971-a969-f32a1b3a3662","Type":"ContainerStarted","Data":"48ef443a90000062998a03c8fd240af10fe89fc3daceb10a9a868e7571f6b921"} Jun 15 04:29:48.647584 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:48.647418 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6fd4d678b4-cnzlq" event={"ID":"148991d8-7720-4971-a969-f32a1b3a3662","Type":"ContainerStarted","Data":"9ecf8804022b6ae2e18c74596f23fc8911f0b0283be9516a7deaf4564649c328"} Jun 15 04:29:48.647584 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:48.647490 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6fd4d678b4-cnzlq" event={"ID":"148991d8-7720-4971-a969-f32a1b3a3662","Type":"ContainerStarted","Data":"b863776f4ef5595ee846517d7800445d6e92580d61665300002e17fa5221afd5"} Jun 15 04:29:48.647584 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:48.647523 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6fd4d678b4-cnzlq" Jun 15 04:29:48.648983 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:48.648957 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-ff6b4fd97-vpsrh" event={"ID":"2adda7a5-05be-40bb-8beb-8b92f762bace","Type":"ContainerStarted","Data":"d5787922f5249714a77da53bcca7f285eef24f4ce50b870785948ffbd2d9937d"} Jun 15 04:29:48.650164 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:48.650144 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-589576dfc7-llqnw" event={"ID":"7f9a5b26-2747-4de7-86f8-f46117b31143","Type":"ContainerStarted","Data":"b412372410203738aaeac75267c9939dab490af240f09a0a4b2be731c46c1bbf"} Jun 15 04:29:48.668663 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:48.668619 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6fd4d678b4-cnzlq" podStartSLOduration=2.274381997 podStartE2EDuration="4.668565592s" totalImagesPullingTime="2.394183595s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 04:29:44 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:29:48.667369476 +0000 UTC m=+264.195360393" watchObservedRunningTime="2026-06-15 04:29:48.668565592 +0000 UTC m=+264.196556553" Jun 15 04:29:48.683454 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:48.683406 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-ff6b4fd97-vpsrh" podStartSLOduration=1.448434811 podStartE2EDuration="2.683393858s" totalImagesPullingTime="1.234959047s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 04:29:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:29:48.682683033 +0000 UTC m=+264.210673957" watchObservedRunningTime="2026-06-15 04:29:48.683393858 +0000 UTC m=+264.211384763" Jun 15 04:29:50.658852 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:50.658810 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-589576dfc7-llqnw" event={"ID":"7f9a5b26-2747-4de7-86f8-f46117b31143","Type":"ContainerStarted","Data":"4dce5719a355a93a44614c235e77d2559f28f19e9c5f13df705171e832d14e94"} Jun 15 04:29:50.659285 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:50.659030 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-589576dfc7-llqnw" Jun 15 04:29:50.663555 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:50.663531 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-589576dfc7-llqnw" Jun 15 04:29:50.672930 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:50.672885 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-589576dfc7-llqnw" podStartSLOduration=2.505150257 podStartE2EDuration="3.672870134s" totalImagesPullingTime="1.167719877s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 04:29:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:29:50.671756941 +0000 UTC m=+266.199747847" watchObservedRunningTime="2026-06-15 04:29:50.672870134 +0000 UTC m=+266.200861039" Jun 15 04:29:50.856575 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:50.856542 2561 patch_prober.go:28] interesting pod/image-registry-7dccd94c8f-rbvhf container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 15 04:29:50.856715 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:50.856599 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7dccd94c8f-rbvhf" podUID="95e71c9a-91b3-441d-a762-b90057fa6ac1" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 15 04:29:54.660018 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:54.659990 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6fd4d678b4-cnzlq" Jun 15 04:29:55.870546 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:55.870487 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7dccd94c8f-rbvhf" podUID="95e71c9a-91b3-441d-a762-b90057fa6ac1" containerName="registry" containerID="cri-o://69bdbfc996cc90b8aa1d9fe924dd3843323cdee0878202d15f8d1e12c6feb4ff" gracePeriod=30 Jun 15 04:29:56.107267 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:56.107244 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7dccd94c8f-rbvhf" Jun 15 04:29:56.198794 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:56.198766 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/95e71c9a-91b3-441d-a762-b90057fa6ac1-registry-tls\") pod \"95e71c9a-91b3-441d-a762-b90057fa6ac1\" (UID: \"95e71c9a-91b3-441d-a762-b90057fa6ac1\") " Jun 15 04:29:56.198947 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:56.198803 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/95e71c9a-91b3-441d-a762-b90057fa6ac1-registry-certificates\") pod \"95e71c9a-91b3-441d-a762-b90057fa6ac1\" (UID: \"95e71c9a-91b3-441d-a762-b90057fa6ac1\") " Jun 15 04:29:56.198947 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:56.198833 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/95e71c9a-91b3-441d-a762-b90057fa6ac1-installation-pull-secrets\") pod \"95e71c9a-91b3-441d-a762-b90057fa6ac1\" (UID: \"95e71c9a-91b3-441d-a762-b90057fa6ac1\") " Jun 15 04:29:56.198947 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:56.198852 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/95e71c9a-91b3-441d-a762-b90057fa6ac1-ca-trust-extracted\") pod \"95e71c9a-91b3-441d-a762-b90057fa6ac1\" (UID: \"95e71c9a-91b3-441d-a762-b90057fa6ac1\") " Jun 15 04:29:56.198947 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:56.198890 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/95e71c9a-91b3-441d-a762-b90057fa6ac1-image-registry-private-configuration\") pod \"95e71c9a-91b3-441d-a762-b90057fa6ac1\" (UID: \"95e71c9a-91b3-441d-a762-b90057fa6ac1\") " Jun 15 04:29:56.198947 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:56.198916 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/95e71c9a-91b3-441d-a762-b90057fa6ac1-trusted-ca\") pod \"95e71c9a-91b3-441d-a762-b90057fa6ac1\" (UID: \"95e71c9a-91b3-441d-a762-b90057fa6ac1\") " Jun 15 04:29:56.198947 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:56.198947 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/95e71c9a-91b3-441d-a762-b90057fa6ac1-bound-sa-token\") pod \"95e71c9a-91b3-441d-a762-b90057fa6ac1\" (UID: \"95e71c9a-91b3-441d-a762-b90057fa6ac1\") " Jun 15 04:29:56.199248 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:56.198971 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gsbqp\" (UniqueName: \"kubernetes.io/projected/95e71c9a-91b3-441d-a762-b90057fa6ac1-kube-api-access-gsbqp\") pod \"95e71c9a-91b3-441d-a762-b90057fa6ac1\" (UID: \"95e71c9a-91b3-441d-a762-b90057fa6ac1\") " Jun 15 04:29:56.199325 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:56.199301 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95e71c9a-91b3-441d-a762-b90057fa6ac1-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "95e71c9a-91b3-441d-a762-b90057fa6ac1" (UID: "95e71c9a-91b3-441d-a762-b90057fa6ac1"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 04:29:56.199403 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:56.199377 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95e71c9a-91b3-441d-a762-b90057fa6ac1-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "95e71c9a-91b3-441d-a762-b90057fa6ac1" (UID: "95e71c9a-91b3-441d-a762-b90057fa6ac1"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 04:29:56.201251 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:56.201221 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95e71c9a-91b3-441d-a762-b90057fa6ac1-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "95e71c9a-91b3-441d-a762-b90057fa6ac1" (UID: "95e71c9a-91b3-441d-a762-b90057fa6ac1"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 04:29:56.201412 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:56.201386 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95e71c9a-91b3-441d-a762-b90057fa6ac1-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "95e71c9a-91b3-441d-a762-b90057fa6ac1" (UID: "95e71c9a-91b3-441d-a762-b90057fa6ac1"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 04:29:56.201412 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:56.201397 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95e71c9a-91b3-441d-a762-b90057fa6ac1-kube-api-access-gsbqp" (OuterVolumeSpecName: "kube-api-access-gsbqp") pod "95e71c9a-91b3-441d-a762-b90057fa6ac1" (UID: "95e71c9a-91b3-441d-a762-b90057fa6ac1"). InnerVolumeSpecName "kube-api-access-gsbqp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 04:29:56.201567 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:56.201502 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95e71c9a-91b3-441d-a762-b90057fa6ac1-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "95e71c9a-91b3-441d-a762-b90057fa6ac1" (UID: "95e71c9a-91b3-441d-a762-b90057fa6ac1"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 04:29:56.201567 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:56.201528 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95e71c9a-91b3-441d-a762-b90057fa6ac1-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "95e71c9a-91b3-441d-a762-b90057fa6ac1" (UID: "95e71c9a-91b3-441d-a762-b90057fa6ac1"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 04:29:56.208292 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:56.208268 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95e71c9a-91b3-441d-a762-b90057fa6ac1-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "95e71c9a-91b3-441d-a762-b90057fa6ac1" (UID: "95e71c9a-91b3-441d-a762-b90057fa6ac1"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 04:29:56.300305 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:56.300265 2561 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/95e71c9a-91b3-441d-a762-b90057fa6ac1-image-registry-private-configuration\") on node \"ip-10-0-140-86.ec2.internal\" DevicePath \"\"" Jun 15 04:29:56.300305 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:56.300300 2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/95e71c9a-91b3-441d-a762-b90057fa6ac1-trusted-ca\") on node \"ip-10-0-140-86.ec2.internal\" DevicePath \"\"" Jun 15 04:29:56.300305 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:56.300312 2561 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/95e71c9a-91b3-441d-a762-b90057fa6ac1-bound-sa-token\") on node \"ip-10-0-140-86.ec2.internal\" DevicePath \"\"" Jun 15 04:29:56.300497 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:56.300321 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gsbqp\" (UniqueName: \"kubernetes.io/projected/95e71c9a-91b3-441d-a762-b90057fa6ac1-kube-api-access-gsbqp\") on node \"ip-10-0-140-86.ec2.internal\" DevicePath \"\"" Jun 15 04:29:56.300497 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:56.300330 2561 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/95e71c9a-91b3-441d-a762-b90057fa6ac1-registry-tls\") on node \"ip-10-0-140-86.ec2.internal\" DevicePath \"\"" Jun 15 04:29:56.300497 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:56.300338 2561 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/95e71c9a-91b3-441d-a762-b90057fa6ac1-registry-certificates\") on node \"ip-10-0-140-86.ec2.internal\" DevicePath \"\"" Jun 15 04:29:56.300497 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:56.300346 2561 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/95e71c9a-91b3-441d-a762-b90057fa6ac1-installation-pull-secrets\") on node \"ip-10-0-140-86.ec2.internal\" DevicePath \"\"" Jun 15 04:29:56.300497 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:56.300354 2561 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/95e71c9a-91b3-441d-a762-b90057fa6ac1-ca-trust-extracted\") on node \"ip-10-0-140-86.ec2.internal\" DevicePath \"\"" Jun 15 04:29:56.682576 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:56.682542 2561 generic.go:356] "Generic (PLEG): container finished" podID="95e71c9a-91b3-441d-a762-b90057fa6ac1" containerID="69bdbfc996cc90b8aa1d9fe924dd3843323cdee0878202d15f8d1e12c6feb4ff" exitCode=0 Jun 15 04:29:56.682709 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:56.682586 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7dccd94c8f-rbvhf" Jun 15 04:29:56.682709 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:56.682631 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7dccd94c8f-rbvhf" event={"ID":"95e71c9a-91b3-441d-a762-b90057fa6ac1","Type":"ContainerDied","Data":"69bdbfc996cc90b8aa1d9fe924dd3843323cdee0878202d15f8d1e12c6feb4ff"} Jun 15 04:29:56.682709 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:56.682705 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7dccd94c8f-rbvhf" event={"ID":"95e71c9a-91b3-441d-a762-b90057fa6ac1","Type":"ContainerDied","Data":"31800c21108d795106c12cd411d171a268104f23f5c36c3e6418f9e3fc0a9161"} Jun 15 04:29:56.682821 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:56.682726 2561 scope.go:117] "RemoveContainer" containerID="69bdbfc996cc90b8aa1d9fe924dd3843323cdee0878202d15f8d1e12c6feb4ff" Jun 15 04:29:56.694250 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:56.694226 2561 scope.go:117] "RemoveContainer" containerID="69bdbfc996cc90b8aa1d9fe924dd3843323cdee0878202d15f8d1e12c6feb4ff" Jun 15 04:29:56.694660 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:29:56.694640 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69bdbfc996cc90b8aa1d9fe924dd3843323cdee0878202d15f8d1e12c6feb4ff\": container with ID starting with 69bdbfc996cc90b8aa1d9fe924dd3843323cdee0878202d15f8d1e12c6feb4ff not found: ID does not exist" containerID="69bdbfc996cc90b8aa1d9fe924dd3843323cdee0878202d15f8d1e12c6feb4ff" Jun 15 04:29:56.694714 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:56.694668 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69bdbfc996cc90b8aa1d9fe924dd3843323cdee0878202d15f8d1e12c6feb4ff"} err="failed to get container status \"69bdbfc996cc90b8aa1d9fe924dd3843323cdee0878202d15f8d1e12c6feb4ff\": rpc error: code = NotFound desc = could not find container \"69bdbfc996cc90b8aa1d9fe924dd3843323cdee0878202d15f8d1e12c6feb4ff\": container with ID starting with 69bdbfc996cc90b8aa1d9fe924dd3843323cdee0878202d15f8d1e12c6feb4ff not found: ID does not exist" Jun 15 04:29:56.703122 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:56.703100 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7dccd94c8f-rbvhf"] Jun 15 04:29:56.707042 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:56.707022 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7dccd94c8f-rbvhf"] Jun 15 04:29:56.824488 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:56.824461 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95e71c9a-91b3-441d-a762-b90057fa6ac1" path="/var/lib/kubelet/pods/95e71c9a-91b3-441d-a762-b90057fa6ac1/volumes" Jun 15 04:29:58.419500 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:58.419464 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-694c955b9-ttp92"] Jun 15 04:29:58.419871 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:58.419775 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95e71c9a-91b3-441d-a762-b90057fa6ac1" containerName="registry" Jun 15 04:29:58.419871 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:58.419788 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="95e71c9a-91b3-441d-a762-b90057fa6ac1" containerName="registry" Jun 15 04:29:58.419871 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:58.419849 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="95e71c9a-91b3-441d-a762-b90057fa6ac1" containerName="registry" Jun 15 04:29:58.424668 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:58.424649 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-694c955b9-ttp92" Jun 15 04:29:58.426833 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:58.426814 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 15 04:29:58.426938 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:58.426854 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 15 04:29:58.426938 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:58.426912 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-b7xjl\"" Jun 15 04:29:58.431788 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:58.431768 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-694c955b9-ttp92"] Jun 15 04:29:58.517925 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:58.517893 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5phg4\" (UniqueName: \"kubernetes.io/projected/c692cf67-9f35-45fb-b965-4f4fd1b2be04-kube-api-access-5phg4\") pod \"downloads-694c955b9-ttp92\" (UID: \"c692cf67-9f35-45fb-b965-4f4fd1b2be04\") " pod="openshift-console/downloads-694c955b9-ttp92" Jun 15 04:29:58.618732 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:58.618702 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5phg4\" (UniqueName: \"kubernetes.io/projected/c692cf67-9f35-45fb-b965-4f4fd1b2be04-kube-api-access-5phg4\") pod \"downloads-694c955b9-ttp92\" (UID: \"c692cf67-9f35-45fb-b965-4f4fd1b2be04\") " pod="openshift-console/downloads-694c955b9-ttp92" Jun 15 04:29:58.626223 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:58.626199 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5phg4\" (UniqueName: \"kubernetes.io/projected/c692cf67-9f35-45fb-b965-4f4fd1b2be04-kube-api-access-5phg4\") pod \"downloads-694c955b9-ttp92\" (UID: \"c692cf67-9f35-45fb-b965-4f4fd1b2be04\") " pod="openshift-console/downloads-694c955b9-ttp92" Jun 15 04:29:58.734609 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:58.734532 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-694c955b9-ttp92" Jun 15 04:29:58.865134 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:58.865109 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-694c955b9-ttp92"] Jun 15 04:29:58.867624 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:29:58.867595 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc692cf67_9f35_45fb_b965_4f4fd1b2be04.slice/crio-cf846d7218fa4ce6993cef692f516caef7ef5526ab1c6d560f6c1a33237fb687 WatchSource:0}: Error finding container cf846d7218fa4ce6993cef692f516caef7ef5526ab1c6d560f6c1a33237fb687: Status 404 returned error can't find the container with id cf846d7218fa4ce6993cef692f516caef7ef5526ab1c6d560f6c1a33237fb687 Jun 15 04:29:59.696969 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:29:59.696932 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-694c955b9-ttp92" event={"ID":"c692cf67-9f35-45fb-b965-4f4fd1b2be04","Type":"ContainerStarted","Data":"cf846d7218fa4ce6993cef692f516caef7ef5526ab1c6d560f6c1a33237fb687"} Jun 15 04:30:03.322721 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:03.322686 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7ff884c9f9-r6ltk"] Jun 15 04:30:03.326479 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:03.326453 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7ff884c9f9-r6ltk" Jun 15 04:30:03.328673 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:03.328649 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 15 04:30:03.328784 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:03.328731 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 15 04:30:03.328847 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:03.328656 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 15 04:30:03.329186 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:03.329169 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-vbf2b\"" Jun 15 04:30:03.329288 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:03.329217 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 15 04:30:03.329288 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:03.329245 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 15 04:30:03.336254 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:03.336235 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7ff884c9f9-r6ltk"] Jun 15 04:30:03.362480 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:03.362432 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3f5d8ed6-050e-4792-b6ed-7ececf46de7f-service-ca\") pod \"console-7ff884c9f9-r6ltk\" (UID: \"3f5d8ed6-050e-4792-b6ed-7ececf46de7f\") " pod="openshift-console/console-7ff884c9f9-r6ltk" Jun 15 04:30:03.362616 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:03.362559 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3f5d8ed6-050e-4792-b6ed-7ececf46de7f-console-serving-cert\") pod \"console-7ff884c9f9-r6ltk\" (UID: \"3f5d8ed6-050e-4792-b6ed-7ececf46de7f\") " pod="openshift-console/console-7ff884c9f9-r6ltk" Jun 15 04:30:03.362680 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:03.362615 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3f5d8ed6-050e-4792-b6ed-7ececf46de7f-console-oauth-config\") pod \"console-7ff884c9f9-r6ltk\" (UID: \"3f5d8ed6-050e-4792-b6ed-7ececf46de7f\") " pod="openshift-console/console-7ff884c9f9-r6ltk" Jun 15 04:30:03.362735 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:03.362691 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3f5d8ed6-050e-4792-b6ed-7ececf46de7f-oauth-serving-cert\") pod \"console-7ff884c9f9-r6ltk\" (UID: \"3f5d8ed6-050e-4792-b6ed-7ececf46de7f\") " pod="openshift-console/console-7ff884c9f9-r6ltk" Jun 15 04:30:03.362735 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:03.362721 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3f5d8ed6-050e-4792-b6ed-7ececf46de7f-console-config\") pod \"console-7ff884c9f9-r6ltk\" (UID: \"3f5d8ed6-050e-4792-b6ed-7ececf46de7f\") " pod="openshift-console/console-7ff884c9f9-r6ltk" Jun 15 04:30:03.362812 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:03.362748 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clts8\" (UniqueName: \"kubernetes.io/projected/3f5d8ed6-050e-4792-b6ed-7ececf46de7f-kube-api-access-clts8\") pod \"console-7ff884c9f9-r6ltk\" (UID: \"3f5d8ed6-050e-4792-b6ed-7ececf46de7f\") " pod="openshift-console/console-7ff884c9f9-r6ltk" Jun 15 04:30:03.464100 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:03.464069 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3f5d8ed6-050e-4792-b6ed-7ececf46de7f-console-serving-cert\") pod \"console-7ff884c9f9-r6ltk\" (UID: \"3f5d8ed6-050e-4792-b6ed-7ececf46de7f\") " pod="openshift-console/console-7ff884c9f9-r6ltk" Jun 15 04:30:03.464270 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:03.464116 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3f5d8ed6-050e-4792-b6ed-7ececf46de7f-console-oauth-config\") pod \"console-7ff884c9f9-r6ltk\" (UID: \"3f5d8ed6-050e-4792-b6ed-7ececf46de7f\") " pod="openshift-console/console-7ff884c9f9-r6ltk" Jun 15 04:30:03.464270 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:03.464163 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3f5d8ed6-050e-4792-b6ed-7ececf46de7f-oauth-serving-cert\") pod \"console-7ff884c9f9-r6ltk\" (UID: \"3f5d8ed6-050e-4792-b6ed-7ececf46de7f\") " pod="openshift-console/console-7ff884c9f9-r6ltk" Jun 15 04:30:03.464270 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:03.464187 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3f5d8ed6-050e-4792-b6ed-7ececf46de7f-console-config\") pod \"console-7ff884c9f9-r6ltk\" (UID: \"3f5d8ed6-050e-4792-b6ed-7ececf46de7f\") " pod="openshift-console/console-7ff884c9f9-r6ltk" Jun 15 04:30:03.464270 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:03.464218 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clts8\" (UniqueName: \"kubernetes.io/projected/3f5d8ed6-050e-4792-b6ed-7ececf46de7f-kube-api-access-clts8\") pod \"console-7ff884c9f9-r6ltk\" (UID: \"3f5d8ed6-050e-4792-b6ed-7ececf46de7f\") " pod="openshift-console/console-7ff884c9f9-r6ltk" Jun 15 04:30:03.464517 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:03.464482 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3f5d8ed6-050e-4792-b6ed-7ececf46de7f-service-ca\") pod \"console-7ff884c9f9-r6ltk\" (UID: \"3f5d8ed6-050e-4792-b6ed-7ececf46de7f\") " pod="openshift-console/console-7ff884c9f9-r6ltk" Jun 15 04:30:03.465096 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:03.465067 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3f5d8ed6-050e-4792-b6ed-7ececf46de7f-console-config\") pod \"console-7ff884c9f9-r6ltk\" (UID: \"3f5d8ed6-050e-4792-b6ed-7ececf46de7f\") " pod="openshift-console/console-7ff884c9f9-r6ltk" Jun 15 04:30:03.465222 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:03.465074 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3f5d8ed6-050e-4792-b6ed-7ececf46de7f-service-ca\") pod \"console-7ff884c9f9-r6ltk\" (UID: \"3f5d8ed6-050e-4792-b6ed-7ececf46de7f\") " pod="openshift-console/console-7ff884c9f9-r6ltk" Jun 15 04:30:03.465222 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:03.465133 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3f5d8ed6-050e-4792-b6ed-7ececf46de7f-oauth-serving-cert\") pod \"console-7ff884c9f9-r6ltk\" (UID: \"3f5d8ed6-050e-4792-b6ed-7ececf46de7f\") " pod="openshift-console/console-7ff884c9f9-r6ltk" Jun 15 04:30:03.467100 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:03.467075 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3f5d8ed6-050e-4792-b6ed-7ececf46de7f-console-oauth-config\") pod \"console-7ff884c9f9-r6ltk\" (UID: \"3f5d8ed6-050e-4792-b6ed-7ececf46de7f\") " pod="openshift-console/console-7ff884c9f9-r6ltk" Jun 15 04:30:03.467210 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:03.467181 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3f5d8ed6-050e-4792-b6ed-7ececf46de7f-console-serving-cert\") pod \"console-7ff884c9f9-r6ltk\" (UID: \"3f5d8ed6-050e-4792-b6ed-7ececf46de7f\") " pod="openshift-console/console-7ff884c9f9-r6ltk" Jun 15 04:30:03.471681 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:03.471654 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-clts8\" (UniqueName: \"kubernetes.io/projected/3f5d8ed6-050e-4792-b6ed-7ececf46de7f-kube-api-access-clts8\") pod \"console-7ff884c9f9-r6ltk\" (UID: \"3f5d8ed6-050e-4792-b6ed-7ececf46de7f\") " pod="openshift-console/console-7ff884c9f9-r6ltk" Jun 15 04:30:03.638917 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:03.638839 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7ff884c9f9-r6ltk" Jun 15 04:30:03.780973 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:03.780937 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7ff884c9f9-r6ltk"] Jun 15 04:30:03.785389 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:30:03.785364 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f5d8ed6_050e_4792_b6ed_7ececf46de7f.slice/crio-56d2135b2ef29da27b15bc6d4f4c3d641804bdd57eb429929e8ea28e8f3db609 WatchSource:0}: Error finding container 56d2135b2ef29da27b15bc6d4f4c3d641804bdd57eb429929e8ea28e8f3db609: Status 404 returned error can't find the container with id 56d2135b2ef29da27b15bc6d4f4c3d641804bdd57eb429929e8ea28e8f3db609 Jun 15 04:30:04.722136 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:04.722095 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7ff884c9f9-r6ltk" event={"ID":"3f5d8ed6-050e-4792-b6ed-7ececf46de7f","Type":"ContainerStarted","Data":"56d2135b2ef29da27b15bc6d4f4c3d641804bdd57eb429929e8ea28e8f3db609"} Jun 15 04:30:06.304161 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:30:06.304098 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-7xnm7" podUID="f9bfaab4-82a7-48b0-8da5-3c0253207235" Jun 15 04:30:06.732415 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:06.732212 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7xnm7" Jun 15 04:30:07.095753 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:07.095669 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-ff6b4fd97-vpsrh" Jun 15 04:30:07.095753 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:07.095738 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-ff6b4fd97-vpsrh" Jun 15 04:30:07.739253 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:07.739214 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7ff884c9f9-r6ltk" event={"ID":"3f5d8ed6-050e-4792-b6ed-7ececf46de7f","Type":"ContainerStarted","Data":"9f81930c0514f90f1ea79576cc0bbcd50c6914204002c686f5b7c27ae97061f0"} Jun 15 04:30:07.755417 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:07.755357 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7ff884c9f9-r6ltk" podStartSLOduration=1.282445633 podStartE2EDuration="4.755341701s" totalImagesPullingTime="3.472896068s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 04:30:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:30:07.753898431 +0000 UTC m=+283.281889336" watchObservedRunningTime="2026-06-15 04:30:07.755341701 +0000 UTC m=+283.283332606" Jun 15 04:30:09.225777 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:09.225729 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9bfaab4-82a7-48b0-8da5-3c0253207235-metrics-tls\") pod \"dns-default-7xnm7\" (UID: \"f9bfaab4-82a7-48b0-8da5-3c0253207235\") " pod="openshift-dns/dns-default-7xnm7" Jun 15 04:30:09.228495 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:09.228469 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9bfaab4-82a7-48b0-8da5-3c0253207235-metrics-tls\") pod \"dns-default-7xnm7\" (UID: \"f9bfaab4-82a7-48b0-8da5-3c0253207235\") " pod="openshift-dns/dns-default-7xnm7" Jun 15 04:30:09.435744 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:09.435705 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zvtcp\"" Jun 15 04:30:09.444261 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:09.444231 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7xnm7" Jun 15 04:30:09.525220 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:09.525147 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-9d475d96d-mtmhg"] Jun 15 04:30:09.540288 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:09.540255 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9d475d96d-mtmhg"] Jun 15 04:30:09.540475 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:09.540379 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9d475d96d-mtmhg" Jun 15 04:30:09.546797 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:09.546771 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 15 04:30:09.629632 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:09.629593 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4cee897d-960a-4261-a974-7adaebc62280-oauth-serving-cert\") pod \"console-9d475d96d-mtmhg\" (UID: \"4cee897d-960a-4261-a974-7adaebc62280\") " pod="openshift-console/console-9d475d96d-mtmhg" Jun 15 04:30:09.629801 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:09.629652 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4cee897d-960a-4261-a974-7adaebc62280-service-ca\") pod \"console-9d475d96d-mtmhg\" (UID: \"4cee897d-960a-4261-a974-7adaebc62280\") " pod="openshift-console/console-9d475d96d-mtmhg" Jun 15 04:30:09.629801 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:09.629682 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4cee897d-960a-4261-a974-7adaebc62280-console-oauth-config\") pod \"console-9d475d96d-mtmhg\" (UID: \"4cee897d-960a-4261-a974-7adaebc62280\") " pod="openshift-console/console-9d475d96d-mtmhg" Jun 15 04:30:09.629801 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:09.629701 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6l8j8\" (UniqueName: \"kubernetes.io/projected/4cee897d-960a-4261-a974-7adaebc62280-kube-api-access-6l8j8\") pod \"console-9d475d96d-mtmhg\" (UID: \"4cee897d-960a-4261-a974-7adaebc62280\") " pod="openshift-console/console-9d475d96d-mtmhg" Jun 15 04:30:09.629801 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:09.629728 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4cee897d-960a-4261-a974-7adaebc62280-console-serving-cert\") pod \"console-9d475d96d-mtmhg\" (UID: \"4cee897d-960a-4261-a974-7adaebc62280\") " pod="openshift-console/console-9d475d96d-mtmhg" Jun 15 04:30:09.629979 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:09.629803 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4cee897d-960a-4261-a974-7adaebc62280-console-config\") pod \"console-9d475d96d-mtmhg\" (UID: \"4cee897d-960a-4261-a974-7adaebc62280\") " pod="openshift-console/console-9d475d96d-mtmhg" Jun 15 04:30:09.629979 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:09.629830 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4cee897d-960a-4261-a974-7adaebc62280-trusted-ca-bundle\") pod \"console-9d475d96d-mtmhg\" (UID: \"4cee897d-960a-4261-a974-7adaebc62280\") " pod="openshift-console/console-9d475d96d-mtmhg" Jun 15 04:30:09.730505 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:09.730470 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4cee897d-960a-4261-a974-7adaebc62280-console-config\") pod \"console-9d475d96d-mtmhg\" (UID: \"4cee897d-960a-4261-a974-7adaebc62280\") " pod="openshift-console/console-9d475d96d-mtmhg" Jun 15 04:30:09.730505 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:09.730513 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4cee897d-960a-4261-a974-7adaebc62280-trusted-ca-bundle\") pod \"console-9d475d96d-mtmhg\" (UID: \"4cee897d-960a-4261-a974-7adaebc62280\") " pod="openshift-console/console-9d475d96d-mtmhg" Jun 15 04:30:09.730734 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:09.730550 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4cee897d-960a-4261-a974-7adaebc62280-oauth-serving-cert\") pod \"console-9d475d96d-mtmhg\" (UID: \"4cee897d-960a-4261-a974-7adaebc62280\") " pod="openshift-console/console-9d475d96d-mtmhg" Jun 15 04:30:09.730734 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:09.730582 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4cee897d-960a-4261-a974-7adaebc62280-service-ca\") pod \"console-9d475d96d-mtmhg\" (UID: \"4cee897d-960a-4261-a974-7adaebc62280\") " pod="openshift-console/console-9d475d96d-mtmhg" Jun 15 04:30:09.730734 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:09.730608 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4cee897d-960a-4261-a974-7adaebc62280-console-oauth-config\") pod \"console-9d475d96d-mtmhg\" (UID: \"4cee897d-960a-4261-a974-7adaebc62280\") " pod="openshift-console/console-9d475d96d-mtmhg" Jun 15 04:30:09.730734 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:09.730664 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6l8j8\" (UniqueName: \"kubernetes.io/projected/4cee897d-960a-4261-a974-7adaebc62280-kube-api-access-6l8j8\") pod \"console-9d475d96d-mtmhg\" (UID: \"4cee897d-960a-4261-a974-7adaebc62280\") " pod="openshift-console/console-9d475d96d-mtmhg" Jun 15 04:30:09.730734 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:09.730712 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4cee897d-960a-4261-a974-7adaebc62280-console-serving-cert\") pod \"console-9d475d96d-mtmhg\" (UID: \"4cee897d-960a-4261-a974-7adaebc62280\") " pod="openshift-console/console-9d475d96d-mtmhg" Jun 15 04:30:09.731285 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:09.731234 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4cee897d-960a-4261-a974-7adaebc62280-console-config\") pod \"console-9d475d96d-mtmhg\" (UID: \"4cee897d-960a-4261-a974-7adaebc62280\") " pod="openshift-console/console-9d475d96d-mtmhg" Jun 15 04:30:09.731410 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:09.731390 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4cee897d-960a-4261-a974-7adaebc62280-trusted-ca-bundle\") pod \"console-9d475d96d-mtmhg\" (UID: \"4cee897d-960a-4261-a974-7adaebc62280\") " pod="openshift-console/console-9d475d96d-mtmhg" Jun 15 04:30:09.731605 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:09.731584 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4cee897d-960a-4261-a974-7adaebc62280-service-ca\") pod \"console-9d475d96d-mtmhg\" (UID: \"4cee897d-960a-4261-a974-7adaebc62280\") " pod="openshift-console/console-9d475d96d-mtmhg" Jun 15 04:30:09.731710 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:09.731685 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4cee897d-960a-4261-a974-7adaebc62280-oauth-serving-cert\") pod \"console-9d475d96d-mtmhg\" (UID: \"4cee897d-960a-4261-a974-7adaebc62280\") " pod="openshift-console/console-9d475d96d-mtmhg" Jun 15 04:30:09.733263 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:09.733242 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4cee897d-960a-4261-a974-7adaebc62280-console-oauth-config\") pod \"console-9d475d96d-mtmhg\" (UID: \"4cee897d-960a-4261-a974-7adaebc62280\") " pod="openshift-console/console-9d475d96d-mtmhg" Jun 15 04:30:09.733628 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:09.733607 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4cee897d-960a-4261-a974-7adaebc62280-console-serving-cert\") pod \"console-9d475d96d-mtmhg\" (UID: \"4cee897d-960a-4261-a974-7adaebc62280\") " pod="openshift-console/console-9d475d96d-mtmhg" Jun 15 04:30:09.739061 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:09.739041 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6l8j8\" (UniqueName: \"kubernetes.io/projected/4cee897d-960a-4261-a974-7adaebc62280-kube-api-access-6l8j8\") pod \"console-9d475d96d-mtmhg\" (UID: \"4cee897d-960a-4261-a974-7adaebc62280\") " pod="openshift-console/console-9d475d96d-mtmhg" Jun 15 04:30:09.852452 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:09.852352 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9d475d96d-mtmhg" Jun 15 04:30:13.638998 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:13.638960 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7ff884c9f9-r6ltk" Jun 15 04:30:13.639482 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:13.639022 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7ff884c9f9-r6ltk" Jun 15 04:30:13.640671 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:13.640644 2561 patch_prober.go:28] interesting pod/console-7ff884c9f9-r6ltk container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.22:8443/health\": dial tcp 10.133.0.22:8443: connect: connection refused" start-of-body= Jun 15 04:30:13.640783 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:13.640689 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-7ff884c9f9-r6ltk" podUID="3f5d8ed6-050e-4792-b6ed-7ececf46de7f" containerName="console" probeResult="failure" output="Get \"https://10.133.0.22:8443/health\": dial tcp 10.133.0.22:8443: connect: connection refused" Jun 15 04:30:15.027921 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:15.027892 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7xnm7"] Jun 15 04:30:15.029240 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:30:15.029212 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9bfaab4_82a7_48b0_8da5_3c0253207235.slice/crio-4a328e50781817f6b6cd0713a32097cae78247a09679c634176e22571a6234e6 WatchSource:0}: Error finding container 4a328e50781817f6b6cd0713a32097cae78247a09679c634176e22571a6234e6: Status 404 returned error can't find the container with id 4a328e50781817f6b6cd0713a32097cae78247a09679c634176e22571a6234e6 Jun 15 04:30:15.050939 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:15.050894 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9d475d96d-mtmhg"] Jun 15 04:30:15.053340 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:30:15.053313 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cee897d_960a_4261_a974_7adaebc62280.slice/crio-d1faba7b8ee377212b960b3a6322952e60642550d79bc8ef0cc52a2b66ea877c WatchSource:0}: Error finding container d1faba7b8ee377212b960b3a6322952e60642550d79bc8ef0cc52a2b66ea877c: Status 404 returned error can't find the container with id d1faba7b8ee377212b960b3a6322952e60642550d79bc8ef0cc52a2b66ea877c Jun 15 04:30:15.778905 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:15.778843 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9d475d96d-mtmhg" event={"ID":"4cee897d-960a-4261-a974-7adaebc62280","Type":"ContainerStarted","Data":"ced998db1999b7c3601a6d9d3f3d55a27ad335df693477ca367de19c403ecdd8"} Jun 15 04:30:15.779132 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:15.778912 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9d475d96d-mtmhg" event={"ID":"4cee897d-960a-4261-a974-7adaebc62280","Type":"ContainerStarted","Data":"d1faba7b8ee377212b960b3a6322952e60642550d79bc8ef0cc52a2b66ea877c"} Jun 15 04:30:15.781334 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:15.781056 2561 generic.go:356] "Generic (PLEG): container finished" podID="a865e14d-8cfa-4465-bd6e-56ac84b2f7cd" containerID="3382a747342f45df6ab4ce6c88558afd111bde085966375424beaaa07c3dc86c" exitCode=0 Jun 15 04:30:15.781334 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:15.781133 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-7rsjb" event={"ID":"a865e14d-8cfa-4465-bd6e-56ac84b2f7cd","Type":"ContainerDied","Data":"3382a747342f45df6ab4ce6c88558afd111bde085966375424beaaa07c3dc86c"} Jun 15 04:30:15.781855 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:15.781459 2561 scope.go:117] "RemoveContainer" containerID="3382a747342f45df6ab4ce6c88558afd111bde085966375424beaaa07c3dc86c" Jun 15 04:30:15.783952 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:15.783838 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-694c955b9-ttp92" event={"ID":"c692cf67-9f35-45fb-b965-4f4fd1b2be04","Type":"ContainerStarted","Data":"59e66b3b2e8e1961a37135de05daf1683d24087ccb6bf7498b504375444b383b"} Jun 15 04:30:15.784100 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:15.784066 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-694c955b9-ttp92" Jun 15 04:30:15.786629 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:15.786584 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7xnm7" event={"ID":"f9bfaab4-82a7-48b0-8da5-3c0253207235","Type":"ContainerStarted","Data":"4a328e50781817f6b6cd0713a32097cae78247a09679c634176e22571a6234e6"} Jun 15 04:30:15.796315 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:15.796144 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-694c955b9-ttp92" Jun 15 04:30:15.796609 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:15.796314 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-9d475d96d-mtmhg" podStartSLOduration=6.7962971 podStartE2EDuration="6.7962971s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 04:30:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:30:15.794800596 +0000 UTC m=+291.322791501" watchObservedRunningTime="2026-06-15 04:30:15.7962971 +0000 UTC m=+291.324288006" Jun 15 04:30:15.810296 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:15.810149 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-694c955b9-ttp92" podStartSLOduration=1.722679586 podStartE2EDuration="17.810129297s" totalImagesPullingTime="16.087449711s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 04:29:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:30:15.808922095 +0000 UTC m=+291.336912999" watchObservedRunningTime="2026-06-15 04:30:15.810129297 +0000 UTC m=+291.338120205" Jun 15 04:30:16.794246 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:16.794205 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-7rsjb" event={"ID":"a865e14d-8cfa-4465-bd6e-56ac84b2f7cd","Type":"ContainerStarted","Data":"93e9af00b19a2ea19be274697cff3ef24ef5a8b0dbfb6ca5530771b8e1bbdbbd"} Jun 15 04:30:17.802121 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:17.802076 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7xnm7" event={"ID":"f9bfaab4-82a7-48b0-8da5-3c0253207235","Type":"ContainerStarted","Data":"473d81452c17d14a53141b5504b7fd5ad079a22427c27d5ae1e48c0e4e6411e7"} Jun 15 04:30:17.802769 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:17.802188 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7xnm7" event={"ID":"f9bfaab4-82a7-48b0-8da5-3c0253207235","Type":"ContainerStarted","Data":"49e6b6ba24433a491a598640e5c4e533dfaa8950033e2ef3a5d66e391403a8b8"} Jun 15 04:30:17.817933 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:17.817880 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-7xnm7" podStartSLOduration=256.833857227 podStartE2EDuration="4m18.817861055s" totalImagesPullingTime="1.984003828s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 04:25:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:30:17.816895185 +0000 UTC m=+293.344886103" watchObservedRunningTime="2026-06-15 04:30:17.817861055 +0000 UTC m=+293.345851974" Jun 15 04:30:18.807270 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:18.807234 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-7xnm7" Jun 15 04:30:19.852957 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:19.852906 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-9d475d96d-mtmhg" Jun 15 04:30:19.853418 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:19.852977 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-9d475d96d-mtmhg" Jun 15 04:30:19.854569 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:19.854543 2561 patch_prober.go:28] interesting pod/console-9d475d96d-mtmhg container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.23:8443/health\": dial tcp 10.133.0.23:8443: connect: connection refused" start-of-body= Jun 15 04:30:19.854698 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:19.854605 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-9d475d96d-mtmhg" podUID="4cee897d-960a-4261-a974-7adaebc62280" containerName="console" probeResult="failure" output="Get \"https://10.133.0.23:8443/health\": dial tcp 10.133.0.23:8443: connect: connection refused" Jun 15 04:30:23.650096 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:23.650060 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7ff884c9f9-r6ltk" Jun 15 04:30:23.655221 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:23.655194 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7ff884c9f9-r6ltk" Jun 15 04:30:24.775420 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:24.775398 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8fqkk_f345d023-5952-44c4-800e-69cf4dba39a3/ovn-acl-logging/0.log" Jun 15 04:30:24.776674 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:24.776647 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8fqkk_f345d023-5952-44c4-800e-69cf4dba39a3/ovn-acl-logging/0.log" Jun 15 04:30:24.781724 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:24.781707 2561 kubelet.go:1648] "Image garbage collection succeeded" Jun 15 04:30:27.100862 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:27.100831 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-ff6b4fd97-vpsrh" Jun 15 04:30:27.132282 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:27.104703 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-ff6b4fd97-vpsrh" Jun 15 04:30:28.814571 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:28.814542 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-7xnm7" Jun 15 04:30:29.857187 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:29.857151 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-9d475d96d-mtmhg" Jun 15 04:30:29.861006 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:29.860987 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-9d475d96d-mtmhg" Jun 15 04:30:29.920433 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:29.920400 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7ff884c9f9-r6ltk"] Jun 15 04:30:37.629679 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:37.629648 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fjpd5_36d7d24f-8986-48c6-adc6-0a26989040fb/serve-healthcheck-canary/0.log" Jun 15 04:30:54.942033 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:54.941971 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7ff884c9f9-r6ltk" podUID="3f5d8ed6-050e-4792-b6ed-7ececf46de7f" containerName="console" containerID="cri-o://9f81930c0514f90f1ea79576cc0bbcd50c6914204002c686f5b7c27ae97061f0" gracePeriod=15 Jun 15 04:30:55.211911 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:55.211848 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7ff884c9f9-r6ltk" Jun 15 04:30:55.332514 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:55.332472 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3f5d8ed6-050e-4792-b6ed-7ececf46de7f-oauth-serving-cert\") pod \"3f5d8ed6-050e-4792-b6ed-7ececf46de7f\" (UID: \"3f5d8ed6-050e-4792-b6ed-7ececf46de7f\") " Jun 15 04:30:55.332702 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:55.332531 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3f5d8ed6-050e-4792-b6ed-7ececf46de7f-console-serving-cert\") pod \"3f5d8ed6-050e-4792-b6ed-7ececf46de7f\" (UID: \"3f5d8ed6-050e-4792-b6ed-7ececf46de7f\") " Jun 15 04:30:55.332702 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:55.332560 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3f5d8ed6-050e-4792-b6ed-7ececf46de7f-console-config\") pod \"3f5d8ed6-050e-4792-b6ed-7ececf46de7f\" (UID: \"3f5d8ed6-050e-4792-b6ed-7ececf46de7f\") " Jun 15 04:30:55.332702 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:55.332590 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3f5d8ed6-050e-4792-b6ed-7ececf46de7f-console-oauth-config\") pod \"3f5d8ed6-050e-4792-b6ed-7ececf46de7f\" (UID: \"3f5d8ed6-050e-4792-b6ed-7ececf46de7f\") " Jun 15 04:30:55.332702 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:55.332617 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3f5d8ed6-050e-4792-b6ed-7ececf46de7f-service-ca\") pod \"3f5d8ed6-050e-4792-b6ed-7ececf46de7f\" (UID: \"3f5d8ed6-050e-4792-b6ed-7ececf46de7f\") " Jun 15 04:30:55.332702 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:55.332695 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-clts8\" (UniqueName: \"kubernetes.io/projected/3f5d8ed6-050e-4792-b6ed-7ececf46de7f-kube-api-access-clts8\") pod \"3f5d8ed6-050e-4792-b6ed-7ececf46de7f\" (UID: \"3f5d8ed6-050e-4792-b6ed-7ececf46de7f\") " Jun 15 04:30:55.332982 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:55.332947 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f5d8ed6-050e-4792-b6ed-7ececf46de7f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3f5d8ed6-050e-4792-b6ed-7ececf46de7f" (UID: "3f5d8ed6-050e-4792-b6ed-7ececf46de7f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 04:30:55.332982 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:55.332950 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f5d8ed6-050e-4792-b6ed-7ececf46de7f-console-config" (OuterVolumeSpecName: "console-config") pod "3f5d8ed6-050e-4792-b6ed-7ececf46de7f" (UID: "3f5d8ed6-050e-4792-b6ed-7ececf46de7f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 04:30:55.333111 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:55.333009 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f5d8ed6-050e-4792-b6ed-7ececf46de7f-service-ca" (OuterVolumeSpecName: "service-ca") pod "3f5d8ed6-050e-4792-b6ed-7ececf46de7f" (UID: "3f5d8ed6-050e-4792-b6ed-7ececf46de7f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 04:30:55.334930 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:55.334890 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f5d8ed6-050e-4792-b6ed-7ececf46de7f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3f5d8ed6-050e-4792-b6ed-7ececf46de7f" (UID: "3f5d8ed6-050e-4792-b6ed-7ececf46de7f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 04:30:55.335061 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:55.334968 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f5d8ed6-050e-4792-b6ed-7ececf46de7f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3f5d8ed6-050e-4792-b6ed-7ececf46de7f" (UID: "3f5d8ed6-050e-4792-b6ed-7ececf46de7f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 04:30:55.335061 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:55.334972 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f5d8ed6-050e-4792-b6ed-7ececf46de7f-kube-api-access-clts8" (OuterVolumeSpecName: "kube-api-access-clts8") pod "3f5d8ed6-050e-4792-b6ed-7ececf46de7f" (UID: "3f5d8ed6-050e-4792-b6ed-7ececf46de7f"). InnerVolumeSpecName "kube-api-access-clts8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 04:30:55.434096 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:55.434053 2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3f5d8ed6-050e-4792-b6ed-7ececf46de7f-oauth-serving-cert\") on node \"ip-10-0-140-86.ec2.internal\" DevicePath \"\"" Jun 15 04:30:55.434096 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:55.434084 2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3f5d8ed6-050e-4792-b6ed-7ececf46de7f-console-serving-cert\") on node \"ip-10-0-140-86.ec2.internal\" DevicePath \"\"" Jun 15 04:30:55.434096 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:55.434095 2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3f5d8ed6-050e-4792-b6ed-7ececf46de7f-console-config\") on node \"ip-10-0-140-86.ec2.internal\" DevicePath \"\"" Jun 15 04:30:55.434096 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:55.434104 2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3f5d8ed6-050e-4792-b6ed-7ececf46de7f-console-oauth-config\") on node \"ip-10-0-140-86.ec2.internal\" DevicePath \"\"" Jun 15 04:30:55.434354 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:55.434114 2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3f5d8ed6-050e-4792-b6ed-7ececf46de7f-service-ca\") on node \"ip-10-0-140-86.ec2.internal\" DevicePath \"\"" Jun 15 04:30:55.434354 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:55.434123 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-clts8\" (UniqueName: \"kubernetes.io/projected/3f5d8ed6-050e-4792-b6ed-7ececf46de7f-kube-api-access-clts8\") on node \"ip-10-0-140-86.ec2.internal\" DevicePath \"\"" Jun 15 04:30:55.969651 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:55.969610 2561 generic.go:356] "Generic (PLEG): container finished" podID="3f5d8ed6-050e-4792-b6ed-7ececf46de7f" containerID="9f81930c0514f90f1ea79576cc0bbcd50c6914204002c686f5b7c27ae97061f0" exitCode=0 Jun 15 04:30:55.970120 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:55.969660 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7ff884c9f9-r6ltk" Jun 15 04:30:55.970120 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:55.969700 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7ff884c9f9-r6ltk" event={"ID":"3f5d8ed6-050e-4792-b6ed-7ececf46de7f","Type":"ContainerDied","Data":"9f81930c0514f90f1ea79576cc0bbcd50c6914204002c686f5b7c27ae97061f0"} Jun 15 04:30:55.970120 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:55.969762 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7ff884c9f9-r6ltk" event={"ID":"3f5d8ed6-050e-4792-b6ed-7ececf46de7f","Type":"ContainerDied","Data":"56d2135b2ef29da27b15bc6d4f4c3d641804bdd57eb429929e8ea28e8f3db609"} Jun 15 04:30:55.970120 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:55.969793 2561 scope.go:117] "RemoveContainer" containerID="9f81930c0514f90f1ea79576cc0bbcd50c6914204002c686f5b7c27ae97061f0" Jun 15 04:30:55.978718 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:55.978700 2561 scope.go:117] "RemoveContainer" containerID="9f81930c0514f90f1ea79576cc0bbcd50c6914204002c686f5b7c27ae97061f0" Jun 15 04:30:55.978958 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:30:55.978941 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f81930c0514f90f1ea79576cc0bbcd50c6914204002c686f5b7c27ae97061f0\": container with ID starting with 9f81930c0514f90f1ea79576cc0bbcd50c6914204002c686f5b7c27ae97061f0 not found: ID does not exist" containerID="9f81930c0514f90f1ea79576cc0bbcd50c6914204002c686f5b7c27ae97061f0" Jun 15 04:30:55.979007 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:55.978966 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f81930c0514f90f1ea79576cc0bbcd50c6914204002c686f5b7c27ae97061f0"} err="failed to get container status \"9f81930c0514f90f1ea79576cc0bbcd50c6914204002c686f5b7c27ae97061f0\": rpc error: code = NotFound desc = could not find container \"9f81930c0514f90f1ea79576cc0bbcd50c6914204002c686f5b7c27ae97061f0\": container with ID starting with 9f81930c0514f90f1ea79576cc0bbcd50c6914204002c686f5b7c27ae97061f0 not found: ID does not exist" Jun 15 04:30:55.988984 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:55.988961 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7ff884c9f9-r6ltk"] Jun 15 04:30:55.992421 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:55.992398 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7ff884c9f9-r6ltk"] Jun 15 04:30:56.823903 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:30:56.823869 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f5d8ed6-050e-4792-b6ed-7ececf46de7f" path="/var/lib/kubelet/pods/3f5d8ed6-050e-4792-b6ed-7ececf46de7f/volumes" Jun 15 04:31:06.679453 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:06.679417 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-66bd4f964b-967ck"] Jun 15 04:31:06.679866 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:06.679776 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f5d8ed6-050e-4792-b6ed-7ececf46de7f" containerName="console" Jun 15 04:31:06.679866 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:06.679789 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f5d8ed6-050e-4792-b6ed-7ececf46de7f" containerName="console" Jun 15 04:31:06.679866 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:06.679852 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f5d8ed6-050e-4792-b6ed-7ececf46de7f" containerName="console" Jun 15 04:31:06.681632 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:06.681614 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-66bd4f964b-967ck" Jun 15 04:31:06.683696 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:06.683677 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 15 04:31:06.684333 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:06.684314 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-q77gx\"" Jun 15 04:31:06.684876 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:06.684855 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 15 04:31:06.684981 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:06.684965 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 15 04:31:06.685047 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:06.685019 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 15 04:31:06.685102 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:06.685064 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 15 04:31:06.689044 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:06.689022 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 15 04:31:06.697424 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:06.697406 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-66bd4f964b-967ck"] Jun 15 04:31:06.829883 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:06.829854 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1e28875a-fa68-4877-842a-7fd898b5257f-telemeter-client-tls\") pod \"telemeter-client-66bd4f964b-967ck\" (UID: \"1e28875a-fa68-4877-842a-7fd898b5257f\") " pod="openshift-monitoring/telemeter-client-66bd4f964b-967ck" Jun 15 04:31:06.829883 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:06.829885 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1e28875a-fa68-4877-842a-7fd898b5257f-metrics-client-ca\") pod \"telemeter-client-66bd4f964b-967ck\" (UID: \"1e28875a-fa68-4877-842a-7fd898b5257f\") " pod="openshift-monitoring/telemeter-client-66bd4f964b-967ck" Jun 15 04:31:06.830078 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:06.829910 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e28875a-fa68-4877-842a-7fd898b5257f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-66bd4f964b-967ck\" (UID: \"1e28875a-fa68-4877-842a-7fd898b5257f\") " pod="openshift-monitoring/telemeter-client-66bd4f964b-967ck" Jun 15 04:31:06.830078 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:06.829940 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1e28875a-fa68-4877-842a-7fd898b5257f-secret-telemeter-client\") pod \"telemeter-client-66bd4f964b-967ck\" (UID: \"1e28875a-fa68-4877-842a-7fd898b5257f\") " pod="openshift-monitoring/telemeter-client-66bd4f964b-967ck" Jun 15 04:31:06.830078 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:06.829985 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1e28875a-fa68-4877-842a-7fd898b5257f-federate-client-tls\") pod \"telemeter-client-66bd4f964b-967ck\" (UID: \"1e28875a-fa68-4877-842a-7fd898b5257f\") " pod="openshift-monitoring/telemeter-client-66bd4f964b-967ck" Jun 15 04:31:06.830078 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:06.830051 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e28875a-fa68-4877-842a-7fd898b5257f-serving-certs-ca-bundle\") pod \"telemeter-client-66bd4f964b-967ck\" (UID: \"1e28875a-fa68-4877-842a-7fd898b5257f\") " pod="openshift-monitoring/telemeter-client-66bd4f964b-967ck" Jun 15 04:31:06.830203 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:06.830087 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1e28875a-fa68-4877-842a-7fd898b5257f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-66bd4f964b-967ck\" (UID: \"1e28875a-fa68-4877-842a-7fd898b5257f\") " pod="openshift-monitoring/telemeter-client-66bd4f964b-967ck" Jun 15 04:31:06.830203 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:06.830111 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsfnh\" (UniqueName: \"kubernetes.io/projected/1e28875a-fa68-4877-842a-7fd898b5257f-kube-api-access-fsfnh\") pod \"telemeter-client-66bd4f964b-967ck\" (UID: \"1e28875a-fa68-4877-842a-7fd898b5257f\") " pod="openshift-monitoring/telemeter-client-66bd4f964b-967ck" Jun 15 04:31:06.931048 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:06.930971 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e28875a-fa68-4877-842a-7fd898b5257f-serving-certs-ca-bundle\") pod \"telemeter-client-66bd4f964b-967ck\" (UID: \"1e28875a-fa68-4877-842a-7fd898b5257f\") " pod="openshift-monitoring/telemeter-client-66bd4f964b-967ck" Jun 15 04:31:06.931048 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:06.931013 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1e28875a-fa68-4877-842a-7fd898b5257f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-66bd4f964b-967ck\" (UID: \"1e28875a-fa68-4877-842a-7fd898b5257f\") " pod="openshift-monitoring/telemeter-client-66bd4f964b-967ck" Jun 15 04:31:06.931048 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:06.931048 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsfnh\" (UniqueName: \"kubernetes.io/projected/1e28875a-fa68-4877-842a-7fd898b5257f-kube-api-access-fsfnh\") pod \"telemeter-client-66bd4f964b-967ck\" (UID: \"1e28875a-fa68-4877-842a-7fd898b5257f\") " pod="openshift-monitoring/telemeter-client-66bd4f964b-967ck" Jun 15 04:31:06.931308 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:06.931163 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1e28875a-fa68-4877-842a-7fd898b5257f-telemeter-client-tls\") pod \"telemeter-client-66bd4f964b-967ck\" (UID: \"1e28875a-fa68-4877-842a-7fd898b5257f\") " pod="openshift-monitoring/telemeter-client-66bd4f964b-967ck" Jun 15 04:31:06.931308 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:06.931204 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1e28875a-fa68-4877-842a-7fd898b5257f-metrics-client-ca\") pod \"telemeter-client-66bd4f964b-967ck\" (UID: \"1e28875a-fa68-4877-842a-7fd898b5257f\") " pod="openshift-monitoring/telemeter-client-66bd4f964b-967ck" Jun 15 04:31:06.931308 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:06.931256 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e28875a-fa68-4877-842a-7fd898b5257f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-66bd4f964b-967ck\" (UID: \"1e28875a-fa68-4877-842a-7fd898b5257f\") " pod="openshift-monitoring/telemeter-client-66bd4f964b-967ck" Jun 15 04:31:06.931308 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:06.931294 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1e28875a-fa68-4877-842a-7fd898b5257f-secret-telemeter-client\") pod \"telemeter-client-66bd4f964b-967ck\" (UID: \"1e28875a-fa68-4877-842a-7fd898b5257f\") " pod="openshift-monitoring/telemeter-client-66bd4f964b-967ck" Jun 15 04:31:06.931545 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:06.931344 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1e28875a-fa68-4877-842a-7fd898b5257f-federate-client-tls\") pod \"telemeter-client-66bd4f964b-967ck\" (UID: \"1e28875a-fa68-4877-842a-7fd898b5257f\") " pod="openshift-monitoring/telemeter-client-66bd4f964b-967ck" Jun 15 04:31:06.931869 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:06.931842 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e28875a-fa68-4877-842a-7fd898b5257f-serving-certs-ca-bundle\") pod \"telemeter-client-66bd4f964b-967ck\" (UID: \"1e28875a-fa68-4877-842a-7fd898b5257f\") " pod="openshift-monitoring/telemeter-client-66bd4f964b-967ck" Jun 15 04:31:06.931965 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:06.931907 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1e28875a-fa68-4877-842a-7fd898b5257f-metrics-client-ca\") pod \"telemeter-client-66bd4f964b-967ck\" (UID: \"1e28875a-fa68-4877-842a-7fd898b5257f\") " pod="openshift-monitoring/telemeter-client-66bd4f964b-967ck" Jun 15 04:31:06.932111 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:06.932091 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e28875a-fa68-4877-842a-7fd898b5257f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-66bd4f964b-967ck\" (UID: \"1e28875a-fa68-4877-842a-7fd898b5257f\") " pod="openshift-monitoring/telemeter-client-66bd4f964b-967ck" Jun 15 04:31:06.933664 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:06.933631 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1e28875a-fa68-4877-842a-7fd898b5257f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-66bd4f964b-967ck\" (UID: \"1e28875a-fa68-4877-842a-7fd898b5257f\") " pod="openshift-monitoring/telemeter-client-66bd4f964b-967ck" Jun 15 04:31:06.933664 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:06.933658 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1e28875a-fa68-4877-842a-7fd898b5257f-telemeter-client-tls\") pod \"telemeter-client-66bd4f964b-967ck\" (UID: \"1e28875a-fa68-4877-842a-7fd898b5257f\") " pod="openshift-monitoring/telemeter-client-66bd4f964b-967ck" Jun 15 04:31:06.933917 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:06.933900 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1e28875a-fa68-4877-842a-7fd898b5257f-federate-client-tls\") pod \"telemeter-client-66bd4f964b-967ck\" (UID: \"1e28875a-fa68-4877-842a-7fd898b5257f\") " pod="openshift-monitoring/telemeter-client-66bd4f964b-967ck" Jun 15 04:31:06.933955 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:06.933922 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1e28875a-fa68-4877-842a-7fd898b5257f-secret-telemeter-client\") pod \"telemeter-client-66bd4f964b-967ck\" (UID: \"1e28875a-fa68-4877-842a-7fd898b5257f\") " pod="openshift-monitoring/telemeter-client-66bd4f964b-967ck" Jun 15 04:31:06.938200 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:06.938176 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsfnh\" (UniqueName: \"kubernetes.io/projected/1e28875a-fa68-4877-842a-7fd898b5257f-kube-api-access-fsfnh\") pod \"telemeter-client-66bd4f964b-967ck\" (UID: \"1e28875a-fa68-4877-842a-7fd898b5257f\") " pod="openshift-monitoring/telemeter-client-66bd4f964b-967ck" Jun 15 04:31:06.991377 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:06.991346 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-66bd4f964b-967ck" Jun 15 04:31:07.120103 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:07.120074 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-66bd4f964b-967ck"] Jun 15 04:31:07.124523 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:31:07.124495 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e28875a_fa68_4877_842a_7fd898b5257f.slice/crio-658e771854768eee1f77273e17730ead28c2944942b8adc03b73c08d02d3f083 WatchSource:0}: Error finding container 658e771854768eee1f77273e17730ead28c2944942b8adc03b73c08d02d3f083: Status 404 returned error can't find the container with id 658e771854768eee1f77273e17730ead28c2944942b8adc03b73c08d02d3f083 Jun 15 04:31:07.126999 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:07.126977 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 15 04:31:08.023386 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:08.023348 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-66bd4f964b-967ck" event={"ID":"1e28875a-fa68-4877-842a-7fd898b5257f","Type":"ContainerStarted","Data":"658e771854768eee1f77273e17730ead28c2944942b8adc03b73c08d02d3f083"} Jun 15 04:31:10.033482 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:10.033450 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-66bd4f964b-967ck" event={"ID":"1e28875a-fa68-4877-842a-7fd898b5257f","Type":"ContainerStarted","Data":"bbd1118dc688e8fac713329614b23526dd5871f22508db3983ad2c922055554f"} Jun 15 04:31:10.033788 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:10.033527 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-66bd4f964b-967ck" event={"ID":"1e28875a-fa68-4877-842a-7fd898b5257f","Type":"ContainerStarted","Data":"beb3c6d3f785dbb89caf7b89a4730b5f16278af67d17e2f161fe538033a7c6b0"} Jun 15 04:31:11.039328 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:11.039294 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-66bd4f964b-967ck" event={"ID":"1e28875a-fa68-4877-842a-7fd898b5257f","Type":"ContainerStarted","Data":"2d3bf144ab47e7dcce2fec395b55e0b7d735467cbe8f11f3d82450b643aaca61"} Jun 15 04:31:11.059573 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:11.059522 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-66bd4f964b-967ck" podStartSLOduration=2.268139214 podStartE2EDuration="5.059508023s" totalImagesPullingTime="2.791368809s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 04:31:06 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:31:11.057398445 +0000 UTC m=+346.585389361" watchObservedRunningTime="2026-06-15 04:31:11.059508023 +0000 UTC m=+346.587498927" Jun 15 04:31:11.836233 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:11.836197 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-676d4d8c69-g2bfj"] Jun 15 04:31:11.838200 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:11.838185 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-676d4d8c69-g2bfj" Jun 15 04:31:11.850697 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:11.850667 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-676d4d8c69-g2bfj"] Jun 15 04:31:11.873307 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:11.873274 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b30d6f0e-a439-47ab-acf0-272a28077a07-console-serving-cert\") pod \"console-676d4d8c69-g2bfj\" (UID: \"b30d6f0e-a439-47ab-acf0-272a28077a07\") " pod="openshift-console/console-676d4d8c69-g2bfj" Jun 15 04:31:11.873508 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:11.873369 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b30d6f0e-a439-47ab-acf0-272a28077a07-trusted-ca-bundle\") pod \"console-676d4d8c69-g2bfj\" (UID: \"b30d6f0e-a439-47ab-acf0-272a28077a07\") " pod="openshift-console/console-676d4d8c69-g2bfj" Jun 15 04:31:11.873508 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:11.873399 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b30d6f0e-a439-47ab-acf0-272a28077a07-console-oauth-config\") pod \"console-676d4d8c69-g2bfj\" (UID: \"b30d6f0e-a439-47ab-acf0-272a28077a07\") " pod="openshift-console/console-676d4d8c69-g2bfj" Jun 15 04:31:11.873508 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:11.873427 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b30d6f0e-a439-47ab-acf0-272a28077a07-service-ca\") pod \"console-676d4d8c69-g2bfj\" (UID: \"b30d6f0e-a439-47ab-acf0-272a28077a07\") " pod="openshift-console/console-676d4d8c69-g2bfj" Jun 15 04:31:11.873508 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:11.873471 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b30d6f0e-a439-47ab-acf0-272a28077a07-console-config\") pod \"console-676d4d8c69-g2bfj\" (UID: \"b30d6f0e-a439-47ab-acf0-272a28077a07\") " pod="openshift-console/console-676d4d8c69-g2bfj" Jun 15 04:31:11.873688 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:11.873527 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b30d6f0e-a439-47ab-acf0-272a28077a07-oauth-serving-cert\") pod \"console-676d4d8c69-g2bfj\" (UID: \"b30d6f0e-a439-47ab-acf0-272a28077a07\") " pod="openshift-console/console-676d4d8c69-g2bfj" Jun 15 04:31:11.873688 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:11.873554 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggtl4\" (UniqueName: \"kubernetes.io/projected/b30d6f0e-a439-47ab-acf0-272a28077a07-kube-api-access-ggtl4\") pod \"console-676d4d8c69-g2bfj\" (UID: \"b30d6f0e-a439-47ab-acf0-272a28077a07\") " pod="openshift-console/console-676d4d8c69-g2bfj" Jun 15 04:31:11.974785 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:11.974743 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b30d6f0e-a439-47ab-acf0-272a28077a07-service-ca\") pod \"console-676d4d8c69-g2bfj\" (UID: \"b30d6f0e-a439-47ab-acf0-272a28077a07\") " pod="openshift-console/console-676d4d8c69-g2bfj" Jun 15 04:31:11.974785 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:11.974788 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b30d6f0e-a439-47ab-acf0-272a28077a07-console-config\") pod \"console-676d4d8c69-g2bfj\" (UID: \"b30d6f0e-a439-47ab-acf0-272a28077a07\") " pod="openshift-console/console-676d4d8c69-g2bfj" Jun 15 04:31:11.975037 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:11.974815 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b30d6f0e-a439-47ab-acf0-272a28077a07-oauth-serving-cert\") pod \"console-676d4d8c69-g2bfj\" (UID: \"b30d6f0e-a439-47ab-acf0-272a28077a07\") " pod="openshift-console/console-676d4d8c69-g2bfj" Jun 15 04:31:11.975037 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:11.974923 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggtl4\" (UniqueName: \"kubernetes.io/projected/b30d6f0e-a439-47ab-acf0-272a28077a07-kube-api-access-ggtl4\") pod \"console-676d4d8c69-g2bfj\" (UID: \"b30d6f0e-a439-47ab-acf0-272a28077a07\") " pod="openshift-console/console-676d4d8c69-g2bfj" Jun 15 04:31:11.975037 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:11.974965 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b30d6f0e-a439-47ab-acf0-272a28077a07-console-serving-cert\") pod \"console-676d4d8c69-g2bfj\" (UID: \"b30d6f0e-a439-47ab-acf0-272a28077a07\") " pod="openshift-console/console-676d4d8c69-g2bfj" Jun 15 04:31:11.975197 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:11.975151 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b30d6f0e-a439-47ab-acf0-272a28077a07-trusted-ca-bundle\") pod \"console-676d4d8c69-g2bfj\" (UID: \"b30d6f0e-a439-47ab-acf0-272a28077a07\") " pod="openshift-console/console-676d4d8c69-g2bfj" Jun 15 04:31:11.975197 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:11.975186 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b30d6f0e-a439-47ab-acf0-272a28077a07-console-oauth-config\") pod \"console-676d4d8c69-g2bfj\" (UID: \"b30d6f0e-a439-47ab-acf0-272a28077a07\") " pod="openshift-console/console-676d4d8c69-g2bfj" Jun 15 04:31:11.975579 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:11.975552 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b30d6f0e-a439-47ab-acf0-272a28077a07-oauth-serving-cert\") pod \"console-676d4d8c69-g2bfj\" (UID: \"b30d6f0e-a439-47ab-acf0-272a28077a07\") " pod="openshift-console/console-676d4d8c69-g2bfj" Jun 15 04:31:11.975753 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:11.975642 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b30d6f0e-a439-47ab-acf0-272a28077a07-service-ca\") pod \"console-676d4d8c69-g2bfj\" (UID: \"b30d6f0e-a439-47ab-acf0-272a28077a07\") " pod="openshift-console/console-676d4d8c69-g2bfj" Jun 15 04:31:11.975753 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:11.975666 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b30d6f0e-a439-47ab-acf0-272a28077a07-console-config\") pod \"console-676d4d8c69-g2bfj\" (UID: \"b30d6f0e-a439-47ab-acf0-272a28077a07\") " pod="openshift-console/console-676d4d8c69-g2bfj" Jun 15 04:31:11.976193 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:11.976173 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b30d6f0e-a439-47ab-acf0-272a28077a07-trusted-ca-bundle\") pod \"console-676d4d8c69-g2bfj\" (UID: \"b30d6f0e-a439-47ab-acf0-272a28077a07\") " pod="openshift-console/console-676d4d8c69-g2bfj" Jun 15 04:31:11.977428 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:11.977404 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b30d6f0e-a439-47ab-acf0-272a28077a07-console-serving-cert\") pod \"console-676d4d8c69-g2bfj\" (UID: \"b30d6f0e-a439-47ab-acf0-272a28077a07\") " pod="openshift-console/console-676d4d8c69-g2bfj" Jun 15 04:31:11.977538 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:11.977475 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b30d6f0e-a439-47ab-acf0-272a28077a07-console-oauth-config\") pod \"console-676d4d8c69-g2bfj\" (UID: \"b30d6f0e-a439-47ab-acf0-272a28077a07\") " pod="openshift-console/console-676d4d8c69-g2bfj" Jun 15 04:31:11.981736 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:11.981716 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggtl4\" (UniqueName: \"kubernetes.io/projected/b30d6f0e-a439-47ab-acf0-272a28077a07-kube-api-access-ggtl4\") pod \"console-676d4d8c69-g2bfj\" (UID: \"b30d6f0e-a439-47ab-acf0-272a28077a07\") " pod="openshift-console/console-676d4d8c69-g2bfj" Jun 15 04:31:12.146697 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:12.146598 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-676d4d8c69-g2bfj" Jun 15 04:31:12.269627 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:12.269590 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-676d4d8c69-g2bfj"] Jun 15 04:31:12.271363 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:31:12.271337 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb30d6f0e_a439_47ab_acf0_272a28077a07.slice/crio-f0f6b172f0ef3b8e9094ff8078f651b9755d7ffc870d705679245cdbfcc2eacb WatchSource:0}: Error finding container f0f6b172f0ef3b8e9094ff8078f651b9755d7ffc870d705679245cdbfcc2eacb: Status 404 returned error can't find the container with id f0f6b172f0ef3b8e9094ff8078f651b9755d7ffc870d705679245cdbfcc2eacb Jun 15 04:31:13.051539 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:13.051494 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-676d4d8c69-g2bfj" event={"ID":"b30d6f0e-a439-47ab-acf0-272a28077a07","Type":"ContainerStarted","Data":"cb24d5f634bc209c6dcd8e2bfd13d4b95f489578bcd7c1d9f89905ae2d5f7ef5"} Jun 15 04:31:13.051539 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:13.051545 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-676d4d8c69-g2bfj" event={"ID":"b30d6f0e-a439-47ab-acf0-272a28077a07","Type":"ContainerStarted","Data":"f0f6b172f0ef3b8e9094ff8078f651b9755d7ffc870d705679245cdbfcc2eacb"} Jun 15 04:31:13.068354 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:13.068300 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-676d4d8c69-g2bfj" podStartSLOduration=2.06828614 podStartE2EDuration="2.06828614s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 04:31:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:31:13.066621194 +0000 UTC m=+348.594612096" watchObservedRunningTime="2026-06-15 04:31:13.06828614 +0000 UTC m=+348.596277044" Jun 15 04:31:22.147337 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:22.147301 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-676d4d8c69-g2bfj" Jun 15 04:31:22.147745 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:22.147361 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-676d4d8c69-g2bfj" Jun 15 04:31:22.152338 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:22.152316 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-676d4d8c69-g2bfj" Jun 15 04:31:23.098328 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:23.098297 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-676d4d8c69-g2bfj" Jun 15 04:31:23.144855 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:23.144819 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-9d475d96d-mtmhg"] Jun 15 04:31:48.166572 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:48.166534 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-9d475d96d-mtmhg" podUID="4cee897d-960a-4261-a974-7adaebc62280" containerName="console" containerID="cri-o://ced998db1999b7c3601a6d9d3f3d55a27ad335df693477ca367de19c403ecdd8" gracePeriod=15 Jun 15 04:31:48.405601 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:48.405573 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9d475d96d-mtmhg" Jun 15 04:31:48.580629 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:48.580542 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4cee897d-960a-4261-a974-7adaebc62280-console-config\") pod \"4cee897d-960a-4261-a974-7adaebc62280\" (UID: \"4cee897d-960a-4261-a974-7adaebc62280\") " Jun 15 04:31:48.580629 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:48.580602 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6l8j8\" (UniqueName: \"kubernetes.io/projected/4cee897d-960a-4261-a974-7adaebc62280-kube-api-access-6l8j8\") pod \"4cee897d-960a-4261-a974-7adaebc62280\" (UID: \"4cee897d-960a-4261-a974-7adaebc62280\") " Jun 15 04:31:48.580629 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:48.580629 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4cee897d-960a-4261-a974-7adaebc62280-console-oauth-config\") pod \"4cee897d-960a-4261-a974-7adaebc62280\" (UID: \"4cee897d-960a-4261-a974-7adaebc62280\") " Jun 15 04:31:48.580897 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:48.580654 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4cee897d-960a-4261-a974-7adaebc62280-service-ca\") pod \"4cee897d-960a-4261-a974-7adaebc62280\" (UID: \"4cee897d-960a-4261-a974-7adaebc62280\") " Jun 15 04:31:48.580897 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:48.580676 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4cee897d-960a-4261-a974-7adaebc62280-console-serving-cert\") pod \"4cee897d-960a-4261-a974-7adaebc62280\" (UID: \"4cee897d-960a-4261-a974-7adaebc62280\") " Jun 15 04:31:48.580897 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:48.580710 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4cee897d-960a-4261-a974-7adaebc62280-trusted-ca-bundle\") pod \"4cee897d-960a-4261-a974-7adaebc62280\" (UID: \"4cee897d-960a-4261-a974-7adaebc62280\") " Jun 15 04:31:48.580897 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:48.580732 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4cee897d-960a-4261-a974-7adaebc62280-oauth-serving-cert\") pod \"4cee897d-960a-4261-a974-7adaebc62280\" (UID: \"4cee897d-960a-4261-a974-7adaebc62280\") " Jun 15 04:31:48.581128 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:48.581097 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4cee897d-960a-4261-a974-7adaebc62280-service-ca" (OuterVolumeSpecName: "service-ca") pod "4cee897d-960a-4261-a974-7adaebc62280" (UID: "4cee897d-960a-4261-a974-7adaebc62280"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 04:31:48.581242 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:48.581216 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4cee897d-960a-4261-a974-7adaebc62280-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4cee897d-960a-4261-a974-7adaebc62280" (UID: "4cee897d-960a-4261-a974-7adaebc62280"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 04:31:48.581351 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:48.581312 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4cee897d-960a-4261-a974-7adaebc62280-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4cee897d-960a-4261-a974-7adaebc62280" (UID: "4cee897d-960a-4261-a974-7adaebc62280"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 04:31:48.581407 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:48.581358 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4cee897d-960a-4261-a974-7adaebc62280-console-config" (OuterVolumeSpecName: "console-config") pod "4cee897d-960a-4261-a974-7adaebc62280" (UID: "4cee897d-960a-4261-a974-7adaebc62280"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 04:31:48.582843 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:48.582819 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4cee897d-960a-4261-a974-7adaebc62280-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4cee897d-960a-4261-a974-7adaebc62280" (UID: "4cee897d-960a-4261-a974-7adaebc62280"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 04:31:48.583176 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:48.583157 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4cee897d-960a-4261-a974-7adaebc62280-kube-api-access-6l8j8" (OuterVolumeSpecName: "kube-api-access-6l8j8") pod "4cee897d-960a-4261-a974-7adaebc62280" (UID: "4cee897d-960a-4261-a974-7adaebc62280"). InnerVolumeSpecName "kube-api-access-6l8j8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 04:31:48.583219 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:48.583171 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4cee897d-960a-4261-a974-7adaebc62280-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4cee897d-960a-4261-a974-7adaebc62280" (UID: "4cee897d-960a-4261-a974-7adaebc62280"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 04:31:48.681734 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:48.681703 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6l8j8\" (UniqueName: \"kubernetes.io/projected/4cee897d-960a-4261-a974-7adaebc62280-kube-api-access-6l8j8\") on node \"ip-10-0-140-86.ec2.internal\" DevicePath \"\"" Jun 15 04:31:48.681734 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:48.681731 2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4cee897d-960a-4261-a974-7adaebc62280-console-oauth-config\") on node \"ip-10-0-140-86.ec2.internal\" DevicePath \"\"" Jun 15 04:31:48.681896 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:48.681742 2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4cee897d-960a-4261-a974-7adaebc62280-service-ca\") on node \"ip-10-0-140-86.ec2.internal\" DevicePath \"\"" Jun 15 04:31:48.681896 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:48.681750 2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4cee897d-960a-4261-a974-7adaebc62280-console-serving-cert\") on node \"ip-10-0-140-86.ec2.internal\" DevicePath \"\"" Jun 15 04:31:48.681896 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:48.681758 2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4cee897d-960a-4261-a974-7adaebc62280-trusted-ca-bundle\") on node \"ip-10-0-140-86.ec2.internal\" DevicePath \"\"" Jun 15 04:31:48.681896 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:48.681766 2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4cee897d-960a-4261-a974-7adaebc62280-oauth-serving-cert\") on node \"ip-10-0-140-86.ec2.internal\" DevicePath \"\"" Jun 15 04:31:48.681896 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:48.681775 2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4cee897d-960a-4261-a974-7adaebc62280-console-config\") on node \"ip-10-0-140-86.ec2.internal\" DevicePath \"\"" Jun 15 04:31:49.198973 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:49.198940 2561 generic.go:356] "Generic (PLEG): container finished" podID="4cee897d-960a-4261-a974-7adaebc62280" containerID="ced998db1999b7c3601a6d9d3f3d55a27ad335df693477ca367de19c403ecdd8" exitCode=0 Jun 15 04:31:49.199428 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:49.198991 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9d475d96d-mtmhg" Jun 15 04:31:49.199428 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:49.199028 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9d475d96d-mtmhg" event={"ID":"4cee897d-960a-4261-a974-7adaebc62280","Type":"ContainerDied","Data":"ced998db1999b7c3601a6d9d3f3d55a27ad335df693477ca367de19c403ecdd8"} Jun 15 04:31:49.199428 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:49.199085 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9d475d96d-mtmhg" event={"ID":"4cee897d-960a-4261-a974-7adaebc62280","Type":"ContainerDied","Data":"d1faba7b8ee377212b960b3a6322952e60642550d79bc8ef0cc52a2b66ea877c"} Jun 15 04:31:49.199428 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:49.199117 2561 scope.go:117] "RemoveContainer" containerID="ced998db1999b7c3601a6d9d3f3d55a27ad335df693477ca367de19c403ecdd8" Jun 15 04:31:49.207107 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:49.207092 2561 scope.go:117] "RemoveContainer" containerID="ced998db1999b7c3601a6d9d3f3d55a27ad335df693477ca367de19c403ecdd8" Jun 15 04:31:49.207346 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:31:49.207328 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ced998db1999b7c3601a6d9d3f3d55a27ad335df693477ca367de19c403ecdd8\": container with ID starting with ced998db1999b7c3601a6d9d3f3d55a27ad335df693477ca367de19c403ecdd8 not found: ID does not exist" containerID="ced998db1999b7c3601a6d9d3f3d55a27ad335df693477ca367de19c403ecdd8" Jun 15 04:31:49.207406 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:49.207351 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ced998db1999b7c3601a6d9d3f3d55a27ad335df693477ca367de19c403ecdd8"} err="failed to get container status \"ced998db1999b7c3601a6d9d3f3d55a27ad335df693477ca367de19c403ecdd8\": rpc error: code = NotFound desc = could not find container \"ced998db1999b7c3601a6d9d3f3d55a27ad335df693477ca367de19c403ecdd8\": container with ID starting with ced998db1999b7c3601a6d9d3f3d55a27ad335df693477ca367de19c403ecdd8 not found: ID does not exist" Jun 15 04:31:49.213819 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:49.213798 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-9d475d96d-mtmhg"] Jun 15 04:31:49.216800 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:49.216779 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-9d475d96d-mtmhg"] Jun 15 04:31:50.824613 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:31:50.824573 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4cee897d-960a-4261-a974-7adaebc62280" path="/var/lib/kubelet/pods/4cee897d-960a-4261-a974-7adaebc62280/volumes" Jun 15 04:32:43.661382 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:32:43.661350 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7cbfd949db-rpg2j"] Jun 15 04:32:43.661868 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:32:43.661669 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4cee897d-960a-4261-a974-7adaebc62280" containerName="console" Jun 15 04:32:43.661868 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:32:43.661681 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="4cee897d-960a-4261-a974-7adaebc62280" containerName="console" Jun 15 04:32:43.661868 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:32:43.661754 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="4cee897d-960a-4261-a974-7adaebc62280" containerName="console" Jun 15 04:32:43.664618 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:32:43.664603 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cbfd949db-rpg2j" Jun 15 04:32:43.676124 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:32:43.676100 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7cbfd949db-rpg2j"] Jun 15 04:32:43.718598 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:32:43.718574 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0527aca7-d878-4a6c-8e91-3686bd5244c4-console-oauth-config\") pod \"console-7cbfd949db-rpg2j\" (UID: \"0527aca7-d878-4a6c-8e91-3686bd5244c4\") " pod="openshift-console/console-7cbfd949db-rpg2j" Jun 15 04:32:43.718760 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:32:43.718601 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0527aca7-d878-4a6c-8e91-3686bd5244c4-oauth-serving-cert\") pod \"console-7cbfd949db-rpg2j\" (UID: \"0527aca7-d878-4a6c-8e91-3686bd5244c4\") " pod="openshift-console/console-7cbfd949db-rpg2j" Jun 15 04:32:43.718760 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:32:43.718630 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0527aca7-d878-4a6c-8e91-3686bd5244c4-trusted-ca-bundle\") pod \"console-7cbfd949db-rpg2j\" (UID: \"0527aca7-d878-4a6c-8e91-3686bd5244c4\") " pod="openshift-console/console-7cbfd949db-rpg2j" Jun 15 04:32:43.718887 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:32:43.718767 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0527aca7-d878-4a6c-8e91-3686bd5244c4-service-ca\") pod \"console-7cbfd949db-rpg2j\" (UID: \"0527aca7-d878-4a6c-8e91-3686bd5244c4\") " pod="openshift-console/console-7cbfd949db-rpg2j" Jun 15 04:32:43.718887 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:32:43.718802 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0527aca7-d878-4a6c-8e91-3686bd5244c4-console-config\") pod \"console-7cbfd949db-rpg2j\" (UID: \"0527aca7-d878-4a6c-8e91-3686bd5244c4\") " pod="openshift-console/console-7cbfd949db-rpg2j" Jun 15 04:32:43.718887 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:32:43.718830 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2lv8\" (UniqueName: \"kubernetes.io/projected/0527aca7-d878-4a6c-8e91-3686bd5244c4-kube-api-access-t2lv8\") pod \"console-7cbfd949db-rpg2j\" (UID: \"0527aca7-d878-4a6c-8e91-3686bd5244c4\") " pod="openshift-console/console-7cbfd949db-rpg2j" Jun 15 04:32:43.718887 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:32:43.718866 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0527aca7-d878-4a6c-8e91-3686bd5244c4-console-serving-cert\") pod \"console-7cbfd949db-rpg2j\" (UID: \"0527aca7-d878-4a6c-8e91-3686bd5244c4\") " pod="openshift-console/console-7cbfd949db-rpg2j" Jun 15 04:32:43.819199 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:32:43.819171 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0527aca7-d878-4a6c-8e91-3686bd5244c4-service-ca\") pod \"console-7cbfd949db-rpg2j\" (UID: \"0527aca7-d878-4a6c-8e91-3686bd5244c4\") " pod="openshift-console/console-7cbfd949db-rpg2j" Jun 15 04:32:43.819199 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:32:43.819203 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0527aca7-d878-4a6c-8e91-3686bd5244c4-console-config\") pod \"console-7cbfd949db-rpg2j\" (UID: \"0527aca7-d878-4a6c-8e91-3686bd5244c4\") " pod="openshift-console/console-7cbfd949db-rpg2j" Jun 15 04:32:43.819398 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:32:43.819218 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2lv8\" (UniqueName: \"kubernetes.io/projected/0527aca7-d878-4a6c-8e91-3686bd5244c4-kube-api-access-t2lv8\") pod \"console-7cbfd949db-rpg2j\" (UID: \"0527aca7-d878-4a6c-8e91-3686bd5244c4\") " pod="openshift-console/console-7cbfd949db-rpg2j" Jun 15 04:32:43.819398 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:32:43.819238 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0527aca7-d878-4a6c-8e91-3686bd5244c4-console-serving-cert\") pod \"console-7cbfd949db-rpg2j\" (UID: \"0527aca7-d878-4a6c-8e91-3686bd5244c4\") " pod="openshift-console/console-7cbfd949db-rpg2j" Jun 15 04:32:43.819398 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:32:43.819364 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0527aca7-d878-4a6c-8e91-3686bd5244c4-console-oauth-config\") pod \"console-7cbfd949db-rpg2j\" (UID: \"0527aca7-d878-4a6c-8e91-3686bd5244c4\") " pod="openshift-console/console-7cbfd949db-rpg2j" Jun 15 04:32:43.819398 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:32:43.819395 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0527aca7-d878-4a6c-8e91-3686bd5244c4-oauth-serving-cert\") pod \"console-7cbfd949db-rpg2j\" (UID: \"0527aca7-d878-4a6c-8e91-3686bd5244c4\") " pod="openshift-console/console-7cbfd949db-rpg2j" Jun 15 04:32:43.819629 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:32:43.819559 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0527aca7-d878-4a6c-8e91-3686bd5244c4-trusted-ca-bundle\") pod \"console-7cbfd949db-rpg2j\" (UID: \"0527aca7-d878-4a6c-8e91-3686bd5244c4\") " pod="openshift-console/console-7cbfd949db-rpg2j" Jun 15 04:32:43.820088 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:32:43.820061 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0527aca7-d878-4a6c-8e91-3686bd5244c4-service-ca\") pod \"console-7cbfd949db-rpg2j\" (UID: \"0527aca7-d878-4a6c-8e91-3686bd5244c4\") " pod="openshift-console/console-7cbfd949db-rpg2j" Jun 15 04:32:43.820273 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:32:43.820102 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0527aca7-d878-4a6c-8e91-3686bd5244c4-oauth-serving-cert\") pod \"console-7cbfd949db-rpg2j\" (UID: \"0527aca7-d878-4a6c-8e91-3686bd5244c4\") " pod="openshift-console/console-7cbfd949db-rpg2j" Jun 15 04:32:43.820273 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:32:43.820100 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0527aca7-d878-4a6c-8e91-3686bd5244c4-console-config\") pod \"console-7cbfd949db-rpg2j\" (UID: \"0527aca7-d878-4a6c-8e91-3686bd5244c4\") " pod="openshift-console/console-7cbfd949db-rpg2j" Jun 15 04:32:43.820480 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:32:43.820365 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0527aca7-d878-4a6c-8e91-3686bd5244c4-trusted-ca-bundle\") pod \"console-7cbfd949db-rpg2j\" (UID: \"0527aca7-d878-4a6c-8e91-3686bd5244c4\") " pod="openshift-console/console-7cbfd949db-rpg2j" Jun 15 04:32:43.821948 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:32:43.821928 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0527aca7-d878-4a6c-8e91-3686bd5244c4-console-serving-cert\") pod \"console-7cbfd949db-rpg2j\" (UID: \"0527aca7-d878-4a6c-8e91-3686bd5244c4\") " pod="openshift-console/console-7cbfd949db-rpg2j" Jun 15 04:32:43.822036 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:32:43.821945 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0527aca7-d878-4a6c-8e91-3686bd5244c4-console-oauth-config\") pod \"console-7cbfd949db-rpg2j\" (UID: \"0527aca7-d878-4a6c-8e91-3686bd5244c4\") " pod="openshift-console/console-7cbfd949db-rpg2j" Jun 15 04:32:43.827534 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:32:43.827518 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2lv8\" (UniqueName: \"kubernetes.io/projected/0527aca7-d878-4a6c-8e91-3686bd5244c4-kube-api-access-t2lv8\") pod \"console-7cbfd949db-rpg2j\" (UID: \"0527aca7-d878-4a6c-8e91-3686bd5244c4\") " pod="openshift-console/console-7cbfd949db-rpg2j" Jun 15 04:32:43.973918 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:32:43.973845 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cbfd949db-rpg2j" Jun 15 04:32:44.101114 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:32:44.101080 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7cbfd949db-rpg2j"] Jun 15 04:32:44.105082 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:32:44.105055 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0527aca7_d878_4a6c_8e91_3686bd5244c4.slice/crio-0eb196a93da7634dfd7e0fc469c24b027f8c6e6e8920f5ad36c9627a4d5a650b WatchSource:0}: Error finding container 0eb196a93da7634dfd7e0fc469c24b027f8c6e6e8920f5ad36c9627a4d5a650b: Status 404 returned error can't find the container with id 0eb196a93da7634dfd7e0fc469c24b027f8c6e6e8920f5ad36c9627a4d5a650b Jun 15 04:32:44.422416 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:32:44.422383 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cbfd949db-rpg2j" event={"ID":"0527aca7-d878-4a6c-8e91-3686bd5244c4","Type":"ContainerStarted","Data":"128da59ca17be89457019f2bad73bd91d3db70d368bd8949553c1b47a99b7430"} Jun 15 04:32:44.422617 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:32:44.422433 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cbfd949db-rpg2j" event={"ID":"0527aca7-d878-4a6c-8e91-3686bd5244c4","Type":"ContainerStarted","Data":"0eb196a93da7634dfd7e0fc469c24b027f8c6e6e8920f5ad36c9627a4d5a650b"} Jun 15 04:32:44.438713 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:32:44.438641 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7cbfd949db-rpg2j" podStartSLOduration=1.438621333 podStartE2EDuration="1.438621333s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 04:32:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:32:44.437984522 +0000 UTC m=+439.965975428" watchObservedRunningTime="2026-06-15 04:32:44.438621333 +0000 UTC m=+439.966612241" Jun 15 04:32:53.974362 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:32:53.974329 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7cbfd949db-rpg2j" Jun 15 04:32:53.974767 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:32:53.974456 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7cbfd949db-rpg2j" Jun 15 04:32:53.979027 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:32:53.979006 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7cbfd949db-rpg2j" Jun 15 04:32:54.465543 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:32:54.465518 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7cbfd949db-rpg2j" Jun 15 04:32:54.506505 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:32:54.506474 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-676d4d8c69-g2bfj"] Jun 15 04:33:11.861281 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:11.861249 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg5w7r"] Jun 15 04:33:11.864656 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:11.864640 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg5w7r" Jun 15 04:33:11.866668 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:11.866645 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 15 04:33:11.866787 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:11.866737 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-vpc82\"" Jun 15 04:33:11.867388 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:11.867375 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 15 04:33:11.871221 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:11.871199 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg5w7r"] Jun 15 04:33:11.953408 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:11.953375 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/60bdc6dc-c837-4e5d-961a-8e04f8382cec-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg5w7r\" (UID: \"60bdc6dc-c837-4e5d-961a-8e04f8382cec\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg5w7r" Jun 15 04:33:11.953616 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:11.953426 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zg4x2\" (UniqueName: \"kubernetes.io/projected/60bdc6dc-c837-4e5d-961a-8e04f8382cec-kube-api-access-zg4x2\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg5w7r\" (UID: \"60bdc6dc-c837-4e5d-961a-8e04f8382cec\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg5w7r" Jun 15 04:33:11.953616 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:11.953535 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/60bdc6dc-c837-4e5d-961a-8e04f8382cec-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg5w7r\" (UID: \"60bdc6dc-c837-4e5d-961a-8e04f8382cec\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg5w7r" Jun 15 04:33:12.054498 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:12.054462 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/60bdc6dc-c837-4e5d-961a-8e04f8382cec-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg5w7r\" (UID: \"60bdc6dc-c837-4e5d-961a-8e04f8382cec\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg5w7r" Jun 15 04:33:12.054691 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:12.054523 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zg4x2\" (UniqueName: \"kubernetes.io/projected/60bdc6dc-c837-4e5d-961a-8e04f8382cec-kube-api-access-zg4x2\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg5w7r\" (UID: \"60bdc6dc-c837-4e5d-961a-8e04f8382cec\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg5w7r" Jun 15 04:33:12.054691 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:12.054578 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/60bdc6dc-c837-4e5d-961a-8e04f8382cec-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg5w7r\" (UID: \"60bdc6dc-c837-4e5d-961a-8e04f8382cec\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg5w7r" Jun 15 04:33:12.054874 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:12.054853 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/60bdc6dc-c837-4e5d-961a-8e04f8382cec-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg5w7r\" (UID: \"60bdc6dc-c837-4e5d-961a-8e04f8382cec\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg5w7r" Jun 15 04:33:12.054931 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:12.054878 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/60bdc6dc-c837-4e5d-961a-8e04f8382cec-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg5w7r\" (UID: \"60bdc6dc-c837-4e5d-961a-8e04f8382cec\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg5w7r" Jun 15 04:33:12.062117 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:12.062089 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zg4x2\" (UniqueName: \"kubernetes.io/projected/60bdc6dc-c837-4e5d-961a-8e04f8382cec-kube-api-access-zg4x2\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg5w7r\" (UID: \"60bdc6dc-c837-4e5d-961a-8e04f8382cec\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg5w7r" Jun 15 04:33:12.175235 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:12.175204 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg5w7r" Jun 15 04:33:12.307618 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:12.307555 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg5w7r"] Jun 15 04:33:12.309906 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:33:12.309879 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60bdc6dc_c837_4e5d_961a_8e04f8382cec.slice/crio-8c1cb8cb74b0e88ab99ab6b26700f08ff4c990e2a0b0a88f8b7cfaf12911e99c WatchSource:0}: Error finding container 8c1cb8cb74b0e88ab99ab6b26700f08ff4c990e2a0b0a88f8b7cfaf12911e99c: Status 404 returned error can't find the container with id 8c1cb8cb74b0e88ab99ab6b26700f08ff4c990e2a0b0a88f8b7cfaf12911e99c Jun 15 04:33:12.534160 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:12.534049 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg5w7r" event={"ID":"60bdc6dc-c837-4e5d-961a-8e04f8382cec","Type":"ContainerStarted","Data":"8c1cb8cb74b0e88ab99ab6b26700f08ff4c990e2a0b0a88f8b7cfaf12911e99c"} Jun 15 04:33:19.526795 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:19.526749 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-676d4d8c69-g2bfj" podUID="b30d6f0e-a439-47ab-acf0-272a28077a07" containerName="console" containerID="cri-o://cb24d5f634bc209c6dcd8e2bfd13d4b95f489578bcd7c1d9f89905ae2d5f7ef5" gracePeriod=15 Jun 15 04:33:19.564735 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:19.564706 2561 generic.go:356] "Generic (PLEG): container finished" podID="60bdc6dc-c837-4e5d-961a-8e04f8382cec" containerID="e31dd6e033424d326fc2419a5fd50bccdb0c7fc95ea400337af78c6766b3a8fe" exitCode=0 Jun 15 04:33:19.564866 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:19.564784 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg5w7r" event={"ID":"60bdc6dc-c837-4e5d-961a-8e04f8382cec","Type":"ContainerDied","Data":"e31dd6e033424d326fc2419a5fd50bccdb0c7fc95ea400337af78c6766b3a8fe"} Jun 15 04:33:19.767991 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:19.767963 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-676d4d8c69-g2bfj" Jun 15 04:33:19.819051 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:19.818956 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b30d6f0e-a439-47ab-acf0-272a28077a07-console-oauth-config\") pod \"b30d6f0e-a439-47ab-acf0-272a28077a07\" (UID: \"b30d6f0e-a439-47ab-acf0-272a28077a07\") " Jun 15 04:33:19.819051 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:19.818991 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b30d6f0e-a439-47ab-acf0-272a28077a07-oauth-serving-cert\") pod \"b30d6f0e-a439-47ab-acf0-272a28077a07\" (UID: \"b30d6f0e-a439-47ab-acf0-272a28077a07\") " Jun 15 04:33:19.819051 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:19.819055 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b30d6f0e-a439-47ab-acf0-272a28077a07-console-config\") pod \"b30d6f0e-a439-47ab-acf0-272a28077a07\" (UID: \"b30d6f0e-a439-47ab-acf0-272a28077a07\") " Jun 15 04:33:19.819327 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:19.819073 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b30d6f0e-a439-47ab-acf0-272a28077a07-service-ca\") pod \"b30d6f0e-a439-47ab-acf0-272a28077a07\" (UID: \"b30d6f0e-a439-47ab-acf0-272a28077a07\") " Jun 15 04:33:19.819327 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:19.819114 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ggtl4\" (UniqueName: \"kubernetes.io/projected/b30d6f0e-a439-47ab-acf0-272a28077a07-kube-api-access-ggtl4\") pod \"b30d6f0e-a439-47ab-acf0-272a28077a07\" (UID: \"b30d6f0e-a439-47ab-acf0-272a28077a07\") " Jun 15 04:33:19.819327 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:19.819143 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b30d6f0e-a439-47ab-acf0-272a28077a07-console-serving-cert\") pod \"b30d6f0e-a439-47ab-acf0-272a28077a07\" (UID: \"b30d6f0e-a439-47ab-acf0-272a28077a07\") " Jun 15 04:33:19.819327 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:19.819168 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b30d6f0e-a439-47ab-acf0-272a28077a07-trusted-ca-bundle\") pod \"b30d6f0e-a439-47ab-acf0-272a28077a07\" (UID: \"b30d6f0e-a439-47ab-acf0-272a28077a07\") " Jun 15 04:33:19.819589 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:19.819480 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b30d6f0e-a439-47ab-acf0-272a28077a07-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b30d6f0e-a439-47ab-acf0-272a28077a07" (UID: "b30d6f0e-a439-47ab-acf0-272a28077a07"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 04:33:19.819589 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:19.819571 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b30d6f0e-a439-47ab-acf0-272a28077a07-console-config" (OuterVolumeSpecName: "console-config") pod "b30d6f0e-a439-47ab-acf0-272a28077a07" (UID: "b30d6f0e-a439-47ab-acf0-272a28077a07"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 04:33:19.819694 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:19.819592 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b30d6f0e-a439-47ab-acf0-272a28077a07-service-ca" (OuterVolumeSpecName: "service-ca") pod "b30d6f0e-a439-47ab-acf0-272a28077a07" (UID: "b30d6f0e-a439-47ab-acf0-272a28077a07"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 04:33:19.819747 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:19.819693 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b30d6f0e-a439-47ab-acf0-272a28077a07-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b30d6f0e-a439-47ab-acf0-272a28077a07" (UID: "b30d6f0e-a439-47ab-acf0-272a28077a07"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 04:33:19.821151 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:19.821129 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b30d6f0e-a439-47ab-acf0-272a28077a07-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b30d6f0e-a439-47ab-acf0-272a28077a07" (UID: "b30d6f0e-a439-47ab-acf0-272a28077a07"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 04:33:19.821362 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:19.821343 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b30d6f0e-a439-47ab-acf0-272a28077a07-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b30d6f0e-a439-47ab-acf0-272a28077a07" (UID: "b30d6f0e-a439-47ab-acf0-272a28077a07"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 04:33:19.821433 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:19.821354 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b30d6f0e-a439-47ab-acf0-272a28077a07-kube-api-access-ggtl4" (OuterVolumeSpecName: "kube-api-access-ggtl4") pod "b30d6f0e-a439-47ab-acf0-272a28077a07" (UID: "b30d6f0e-a439-47ab-acf0-272a28077a07"). InnerVolumeSpecName "kube-api-access-ggtl4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 04:33:19.920585 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:19.920539 2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b30d6f0e-a439-47ab-acf0-272a28077a07-console-config\") on node \"ip-10-0-140-86.ec2.internal\" DevicePath \"\"" Jun 15 04:33:19.920585 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:19.920576 2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b30d6f0e-a439-47ab-acf0-272a28077a07-service-ca\") on node \"ip-10-0-140-86.ec2.internal\" DevicePath \"\"" Jun 15 04:33:19.920585 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:19.920585 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ggtl4\" (UniqueName: \"kubernetes.io/projected/b30d6f0e-a439-47ab-acf0-272a28077a07-kube-api-access-ggtl4\") on node \"ip-10-0-140-86.ec2.internal\" DevicePath \"\"" Jun 15 04:33:19.920585 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:19.920595 2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b30d6f0e-a439-47ab-acf0-272a28077a07-console-serving-cert\") on node \"ip-10-0-140-86.ec2.internal\" DevicePath \"\"" Jun 15 04:33:19.920585 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:19.920604 2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b30d6f0e-a439-47ab-acf0-272a28077a07-trusted-ca-bundle\") on node \"ip-10-0-140-86.ec2.internal\" DevicePath \"\"" Jun 15 04:33:19.920982 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:19.920612 2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b30d6f0e-a439-47ab-acf0-272a28077a07-console-oauth-config\") on node \"ip-10-0-140-86.ec2.internal\" DevicePath \"\"" Jun 15 04:33:19.920982 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:19.920620 2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b30d6f0e-a439-47ab-acf0-272a28077a07-oauth-serving-cert\") on node \"ip-10-0-140-86.ec2.internal\" DevicePath \"\"" Jun 15 04:33:20.570123 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:20.570084 2561 generic.go:356] "Generic (PLEG): container finished" podID="b30d6f0e-a439-47ab-acf0-272a28077a07" containerID="cb24d5f634bc209c6dcd8e2bfd13d4b95f489578bcd7c1d9f89905ae2d5f7ef5" exitCode=0 Jun 15 04:33:20.570586 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:20.570145 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-676d4d8c69-g2bfj" Jun 15 04:33:20.570586 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:20.570174 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-676d4d8c69-g2bfj" event={"ID":"b30d6f0e-a439-47ab-acf0-272a28077a07","Type":"ContainerDied","Data":"cb24d5f634bc209c6dcd8e2bfd13d4b95f489578bcd7c1d9f89905ae2d5f7ef5"} Jun 15 04:33:20.570586 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:20.570231 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-676d4d8c69-g2bfj" event={"ID":"b30d6f0e-a439-47ab-acf0-272a28077a07","Type":"ContainerDied","Data":"f0f6b172f0ef3b8e9094ff8078f651b9755d7ffc870d705679245cdbfcc2eacb"} Jun 15 04:33:20.570586 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:20.570257 2561 scope.go:117] "RemoveContainer" containerID="cb24d5f634bc209c6dcd8e2bfd13d4b95f489578bcd7c1d9f89905ae2d5f7ef5" Jun 15 04:33:20.580259 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:20.580231 2561 scope.go:117] "RemoveContainer" containerID="cb24d5f634bc209c6dcd8e2bfd13d4b95f489578bcd7c1d9f89905ae2d5f7ef5" Jun 15 04:33:20.580634 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:33:20.580605 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb24d5f634bc209c6dcd8e2bfd13d4b95f489578bcd7c1d9f89905ae2d5f7ef5\": container with ID starting with cb24d5f634bc209c6dcd8e2bfd13d4b95f489578bcd7c1d9f89905ae2d5f7ef5 not found: ID does not exist" containerID="cb24d5f634bc209c6dcd8e2bfd13d4b95f489578bcd7c1d9f89905ae2d5f7ef5" Jun 15 04:33:20.580723 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:20.580644 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb24d5f634bc209c6dcd8e2bfd13d4b95f489578bcd7c1d9f89905ae2d5f7ef5"} err="failed to get container status \"cb24d5f634bc209c6dcd8e2bfd13d4b95f489578bcd7c1d9f89905ae2d5f7ef5\": rpc error: code = NotFound desc = could not find container \"cb24d5f634bc209c6dcd8e2bfd13d4b95f489578bcd7c1d9f89905ae2d5f7ef5\": container with ID starting with cb24d5f634bc209c6dcd8e2bfd13d4b95f489578bcd7c1d9f89905ae2d5f7ef5 not found: ID does not exist" Jun 15 04:33:20.592206 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:20.592141 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-676d4d8c69-g2bfj"] Jun 15 04:33:20.594115 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:20.594093 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-676d4d8c69-g2bfj"] Jun 15 04:33:20.825368 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:20.825297 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b30d6f0e-a439-47ab-acf0-272a28077a07" path="/var/lib/kubelet/pods/b30d6f0e-a439-47ab-acf0-272a28077a07/volumes" Jun 15 04:33:21.576456 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:21.576398 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg5w7r" event={"ID":"60bdc6dc-c837-4e5d-961a-8e04f8382cec","Type":"ContainerStarted","Data":"b620e1101f1bbed63f608f7ebe121f47b274ca19e46c0ae48498e70fb8be34ce"} Jun 15 04:33:22.582718 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:22.582683 2561 generic.go:356] "Generic (PLEG): container finished" podID="60bdc6dc-c837-4e5d-961a-8e04f8382cec" containerID="b620e1101f1bbed63f608f7ebe121f47b274ca19e46c0ae48498e70fb8be34ce" exitCode=0 Jun 15 04:33:22.583072 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:22.582764 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg5w7r" event={"ID":"60bdc6dc-c837-4e5d-961a-8e04f8382cec","Type":"ContainerDied","Data":"b620e1101f1bbed63f608f7ebe121f47b274ca19e46c0ae48498e70fb8be34ce"} Jun 15 04:33:29.618979 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:29.618941 2561 generic.go:356] "Generic (PLEG): container finished" podID="60bdc6dc-c837-4e5d-961a-8e04f8382cec" containerID="81ffe1b651aec3b10bcd70fe1dc8c7cced6f56320271c7fdefca892118b72bb4" exitCode=0 Jun 15 04:33:29.619393 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:29.618988 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg5w7r" event={"ID":"60bdc6dc-c837-4e5d-961a-8e04f8382cec","Type":"ContainerDied","Data":"81ffe1b651aec3b10bcd70fe1dc8c7cced6f56320271c7fdefca892118b72bb4"} Jun 15 04:33:30.748063 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:30.748038 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg5w7r" Jun 15 04:33:30.811714 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:30.811682 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/60bdc6dc-c837-4e5d-961a-8e04f8382cec-util\") pod \"60bdc6dc-c837-4e5d-961a-8e04f8382cec\" (UID: \"60bdc6dc-c837-4e5d-961a-8e04f8382cec\") " Jun 15 04:33:30.811881 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:30.811733 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/60bdc6dc-c837-4e5d-961a-8e04f8382cec-bundle\") pod \"60bdc6dc-c837-4e5d-961a-8e04f8382cec\" (UID: \"60bdc6dc-c837-4e5d-961a-8e04f8382cec\") " Jun 15 04:33:30.811881 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:30.811782 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zg4x2\" (UniqueName: \"kubernetes.io/projected/60bdc6dc-c837-4e5d-961a-8e04f8382cec-kube-api-access-zg4x2\") pod \"60bdc6dc-c837-4e5d-961a-8e04f8382cec\" (UID: \"60bdc6dc-c837-4e5d-961a-8e04f8382cec\") " Jun 15 04:33:30.812395 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:30.812368 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60bdc6dc-c837-4e5d-961a-8e04f8382cec-bundle" (OuterVolumeSpecName: "bundle") pod "60bdc6dc-c837-4e5d-961a-8e04f8382cec" (UID: "60bdc6dc-c837-4e5d-961a-8e04f8382cec"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 04:33:30.814008 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:30.813975 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60bdc6dc-c837-4e5d-961a-8e04f8382cec-kube-api-access-zg4x2" (OuterVolumeSpecName: "kube-api-access-zg4x2") pod "60bdc6dc-c837-4e5d-961a-8e04f8382cec" (UID: "60bdc6dc-c837-4e5d-961a-8e04f8382cec"). InnerVolumeSpecName "kube-api-access-zg4x2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 04:33:30.816653 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:30.816633 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60bdc6dc-c837-4e5d-961a-8e04f8382cec-util" (OuterVolumeSpecName: "util") pod "60bdc6dc-c837-4e5d-961a-8e04f8382cec" (UID: "60bdc6dc-c837-4e5d-961a-8e04f8382cec"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 04:33:30.913193 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:30.913164 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zg4x2\" (UniqueName: \"kubernetes.io/projected/60bdc6dc-c837-4e5d-961a-8e04f8382cec-kube-api-access-zg4x2\") on node \"ip-10-0-140-86.ec2.internal\" DevicePath \"\"" Jun 15 04:33:30.913193 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:30.913195 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/60bdc6dc-c837-4e5d-961a-8e04f8382cec-util\") on node \"ip-10-0-140-86.ec2.internal\" DevicePath \"\"" Jun 15 04:33:30.913371 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:30.913205 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/60bdc6dc-c837-4e5d-961a-8e04f8382cec-bundle\") on node \"ip-10-0-140-86.ec2.internal\" DevicePath \"\"" Jun 15 04:33:31.628909 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:31.628878 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg5w7r" Jun 15 04:33:31.628909 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:31.628898 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dg5w7r" event={"ID":"60bdc6dc-c837-4e5d-961a-8e04f8382cec","Type":"ContainerDied","Data":"8c1cb8cb74b0e88ab99ab6b26700f08ff4c990e2a0b0a88f8b7cfaf12911e99c"} Jun 15 04:33:31.629109 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:31.628944 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8c1cb8cb74b0e88ab99ab6b26700f08ff4c990e2a0b0a88f8b7cfaf12911e99c" Jun 15 04:33:34.529512 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:34.529479 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-fpvm6"] Jun 15 04:33:34.529917 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:34.529797 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60bdc6dc-c837-4e5d-961a-8e04f8382cec" containerName="extract" Jun 15 04:33:34.529917 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:34.529809 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="60bdc6dc-c837-4e5d-961a-8e04f8382cec" containerName="extract" Jun 15 04:33:34.529917 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:34.529818 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60bdc6dc-c837-4e5d-961a-8e04f8382cec" containerName="pull" Jun 15 04:33:34.529917 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:34.529824 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="60bdc6dc-c837-4e5d-961a-8e04f8382cec" containerName="pull" Jun 15 04:33:34.529917 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:34.529835 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60bdc6dc-c837-4e5d-961a-8e04f8382cec" containerName="util" Jun 15 04:33:34.529917 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:34.529841 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="60bdc6dc-c837-4e5d-961a-8e04f8382cec" containerName="util" Jun 15 04:33:34.529917 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:34.529849 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b30d6f0e-a439-47ab-acf0-272a28077a07" containerName="console" Jun 15 04:33:34.529917 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:34.529854 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b30d6f0e-a439-47ab-acf0-272a28077a07" containerName="console" Jun 15 04:33:34.529917 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:34.529907 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="b30d6f0e-a439-47ab-acf0-272a28077a07" containerName="console" Jun 15 04:33:34.529917 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:34.529916 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="60bdc6dc-c837-4e5d-961a-8e04f8382cec" containerName="extract" Jun 15 04:33:34.543350 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:34.543320 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-fpvm6" Jun 15 04:33:34.544427 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:34.544401 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-fpvm6"] Jun 15 04:33:34.545423 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:34.545400 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 15 04:33:34.545565 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:34.545515 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-x4n8s\"" Jun 15 04:33:34.545640 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:34.545515 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 15 04:33:34.644921 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:34.644883 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c4f183a6-c388-4dfb-b933-bafcea26ef8c-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-fpvm6\" (UID: \"c4f183a6-c388-4dfb-b933-bafcea26ef8c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-fpvm6" Jun 15 04:33:34.645111 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:34.644993 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcvgl\" (UniqueName: \"kubernetes.io/projected/c4f183a6-c388-4dfb-b933-bafcea26ef8c-kube-api-access-dcvgl\") pod \"cert-manager-operator-controller-manager-57757f7cfc-fpvm6\" (UID: \"c4f183a6-c388-4dfb-b933-bafcea26ef8c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-fpvm6" Jun 15 04:33:34.745960 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:34.745924 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c4f183a6-c388-4dfb-b933-bafcea26ef8c-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-fpvm6\" (UID: \"c4f183a6-c388-4dfb-b933-bafcea26ef8c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-fpvm6" Jun 15 04:33:34.746116 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:34.746003 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcvgl\" (UniqueName: \"kubernetes.io/projected/c4f183a6-c388-4dfb-b933-bafcea26ef8c-kube-api-access-dcvgl\") pod \"cert-manager-operator-controller-manager-57757f7cfc-fpvm6\" (UID: \"c4f183a6-c388-4dfb-b933-bafcea26ef8c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-fpvm6" Jun 15 04:33:34.746319 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:34.746300 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c4f183a6-c388-4dfb-b933-bafcea26ef8c-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-fpvm6\" (UID: \"c4f183a6-c388-4dfb-b933-bafcea26ef8c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-fpvm6" Jun 15 04:33:34.755404 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:34.755373 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcvgl\" (UniqueName: \"kubernetes.io/projected/c4f183a6-c388-4dfb-b933-bafcea26ef8c-kube-api-access-dcvgl\") pod \"cert-manager-operator-controller-manager-57757f7cfc-fpvm6\" (UID: \"c4f183a6-c388-4dfb-b933-bafcea26ef8c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-fpvm6" Jun 15 04:33:34.853279 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:34.853209 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-fpvm6" Jun 15 04:33:35.008570 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:35.008484 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-fpvm6"] Jun 15 04:33:35.011106 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:33:35.011077 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4f183a6_c388_4dfb_b933_bafcea26ef8c.slice/crio-e25fed11d05a300af87372f9468a9add485edd42d72955713d829924bda6bf9f WatchSource:0}: Error finding container e25fed11d05a300af87372f9468a9add485edd42d72955713d829924bda6bf9f: Status 404 returned error can't find the container with id e25fed11d05a300af87372f9468a9add485edd42d72955713d829924bda6bf9f Jun 15 04:33:35.647538 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:35.647490 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-fpvm6" event={"ID":"c4f183a6-c388-4dfb-b933-bafcea26ef8c","Type":"ContainerStarted","Data":"e25fed11d05a300af87372f9468a9add485edd42d72955713d829924bda6bf9f"} Jun 15 04:33:36.654528 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:36.654492 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-fpvm6" event={"ID":"c4f183a6-c388-4dfb-b933-bafcea26ef8c","Type":"ContainerStarted","Data":"bed36d824ff614f6a395f17bb6b54c5f953ad2ab3c386d2ca9d1a49a2b50823c"} Jun 15 04:33:36.677556 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:36.677465 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-fpvm6" podStartSLOduration=1.271667924 podStartE2EDuration="2.677434642s" totalImagesPullingTime="1.405766718s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 04:33:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:33:36.675893237 +0000 UTC m=+492.203884142" watchObservedRunningTime="2026-06-15 04:33:36.677434642 +0000 UTC m=+492.205425545" Jun 15 04:33:38.031767 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:38.031732 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f488qc"] Jun 15 04:33:38.034205 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:38.034186 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f488qc" Jun 15 04:33:38.036318 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:38.036294 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 15 04:33:38.036463 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:38.036356 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 15 04:33:38.036536 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:38.036470 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-vpc82\"" Jun 15 04:33:38.043676 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:38.043653 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f488qc"] Jun 15 04:33:38.074751 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:38.074727 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/79f32173-c098-4484-b1d7-4697b4d1d528-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f488qc\" (UID: \"79f32173-c098-4484-b1d7-4697b4d1d528\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f488qc" Jun 15 04:33:38.074854 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:38.074796 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/79f32173-c098-4484-b1d7-4697b4d1d528-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f488qc\" (UID: \"79f32173-c098-4484-b1d7-4697b4d1d528\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f488qc" Jun 15 04:33:38.074854 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:38.074820 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdccw\" (UniqueName: \"kubernetes.io/projected/79f32173-c098-4484-b1d7-4697b4d1d528-kube-api-access-sdccw\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f488qc\" (UID: \"79f32173-c098-4484-b1d7-4697b4d1d528\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f488qc" Jun 15 04:33:38.175286 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:38.175247 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/79f32173-c098-4484-b1d7-4697b4d1d528-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f488qc\" (UID: \"79f32173-c098-4484-b1d7-4697b4d1d528\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f488qc" Jun 15 04:33:38.175286 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:38.175290 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdccw\" (UniqueName: \"kubernetes.io/projected/79f32173-c098-4484-b1d7-4697b4d1d528-kube-api-access-sdccw\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f488qc\" (UID: \"79f32173-c098-4484-b1d7-4697b4d1d528\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f488qc" Jun 15 04:33:38.175517 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:38.175323 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/79f32173-c098-4484-b1d7-4697b4d1d528-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f488qc\" (UID: \"79f32173-c098-4484-b1d7-4697b4d1d528\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f488qc" Jun 15 04:33:38.175674 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:38.175659 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/79f32173-c098-4484-b1d7-4697b4d1d528-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f488qc\" (UID: \"79f32173-c098-4484-b1d7-4697b4d1d528\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f488qc" Jun 15 04:33:38.175709 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:38.175684 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/79f32173-c098-4484-b1d7-4697b4d1d528-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f488qc\" (UID: \"79f32173-c098-4484-b1d7-4697b4d1d528\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f488qc" Jun 15 04:33:38.189967 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:38.189938 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdccw\" (UniqueName: \"kubernetes.io/projected/79f32173-c098-4484-b1d7-4697b4d1d528-kube-api-access-sdccw\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f488qc\" (UID: \"79f32173-c098-4484-b1d7-4697b4d1d528\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f488qc" Jun 15 04:33:38.344622 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:38.344530 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f488qc" Jun 15 04:33:38.469400 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:38.469372 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f488qc"] Jun 15 04:33:38.664969 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:38.664936 2561 generic.go:356] "Generic (PLEG): container finished" podID="79f32173-c098-4484-b1d7-4697b4d1d528" containerID="7b7d01abdf861c432e60f83a6ee42d60abe1e8a78b94d69ee8eabca3eb78de0a" exitCode=0 Jun 15 04:33:38.665139 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:38.664986 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f488qc" event={"ID":"79f32173-c098-4484-b1d7-4697b4d1d528","Type":"ContainerDied","Data":"7b7d01abdf861c432e60f83a6ee42d60abe1e8a78b94d69ee8eabca3eb78de0a"} Jun 15 04:33:38.665139 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:38.665020 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f488qc" event={"ID":"79f32173-c098-4484-b1d7-4697b4d1d528","Type":"ContainerStarted","Data":"eb5b1fd14f69c258a9c9a10dfaad31da4912ee5b072b052e730f0ec58fc998a9"} Jun 15 04:33:38.811481 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:38.811433 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-lkfjf"] Jun 15 04:33:38.814126 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:38.814109 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-lkfjf" Jun 15 04:33:38.816391 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:38.816368 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 15 04:33:38.816566 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:38.816405 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-dhbs7\"" Jun 15 04:33:38.816566 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:38.816409 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 15 04:33:38.826519 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:38.826498 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-lkfjf"] Jun 15 04:33:38.881783 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:38.881755 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/39e079ec-6509-41d7-b01a-d2712e575e1b-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-lkfjf\" (UID: \"39e079ec-6509-41d7-b01a-d2712e575e1b\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-lkfjf" Jun 15 04:33:38.881968 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:38.881804 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4pln\" (UniqueName: \"kubernetes.io/projected/39e079ec-6509-41d7-b01a-d2712e575e1b-kube-api-access-l4pln\") pod \"cert-manager-webhook-7dc76cbb94-lkfjf\" (UID: \"39e079ec-6509-41d7-b01a-d2712e575e1b\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-lkfjf" Jun 15 04:33:38.982610 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:38.982534 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/39e079ec-6509-41d7-b01a-d2712e575e1b-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-lkfjf\" (UID: \"39e079ec-6509-41d7-b01a-d2712e575e1b\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-lkfjf" Jun 15 04:33:38.982610 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:38.982578 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4pln\" (UniqueName: \"kubernetes.io/projected/39e079ec-6509-41d7-b01a-d2712e575e1b-kube-api-access-l4pln\") pod \"cert-manager-webhook-7dc76cbb94-lkfjf\" (UID: \"39e079ec-6509-41d7-b01a-d2712e575e1b\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-lkfjf" Jun 15 04:33:38.989794 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:38.989769 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/39e079ec-6509-41d7-b01a-d2712e575e1b-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-lkfjf\" (UID: \"39e079ec-6509-41d7-b01a-d2712e575e1b\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-lkfjf" Jun 15 04:33:38.989915 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:38.989860 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4pln\" (UniqueName: \"kubernetes.io/projected/39e079ec-6509-41d7-b01a-d2712e575e1b-kube-api-access-l4pln\") pod \"cert-manager-webhook-7dc76cbb94-lkfjf\" (UID: \"39e079ec-6509-41d7-b01a-d2712e575e1b\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-lkfjf" Jun 15 04:33:39.130822 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:39.130786 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-lkfjf" Jun 15 04:33:39.258132 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:39.258086 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-lkfjf"] Jun 15 04:33:39.262319 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:33:39.262289 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod39e079ec_6509_41d7_b01a_d2712e575e1b.slice/crio-a80757be834af0dc92e9b798dcf274496c68d279058c09569217b7f9d75af61f WatchSource:0}: Error finding container a80757be834af0dc92e9b798dcf274496c68d279058c09569217b7f9d75af61f: Status 404 returned error can't find the container with id a80757be834af0dc92e9b798dcf274496c68d279058c09569217b7f9d75af61f Jun 15 04:33:39.672152 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:39.672116 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-lkfjf" event={"ID":"39e079ec-6509-41d7-b01a-d2712e575e1b","Type":"ContainerStarted","Data":"a80757be834af0dc92e9b798dcf274496c68d279058c09569217b7f9d75af61f"} Jun 15 04:33:40.781553 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:40.781528 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-xbnxv"] Jun 15 04:33:40.784734 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:40.784718 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-xbnxv" Jun 15 04:33:40.786970 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:40.786787 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-phhms\"" Jun 15 04:33:40.795748 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:40.795721 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-xbnxv"] Jun 15 04:33:40.900686 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:40.900651 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c014ebe3-4e57-4038-9d30-6b5a6dabb959-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-xbnxv\" (UID: \"c014ebe3-4e57-4038-9d30-6b5a6dabb959\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-xbnxv" Jun 15 04:33:40.900868 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:40.900695 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrhdr\" (UniqueName: \"kubernetes.io/projected/c014ebe3-4e57-4038-9d30-6b5a6dabb959-kube-api-access-jrhdr\") pod \"cert-manager-cainjector-5d99449ffd-xbnxv\" (UID: \"c014ebe3-4e57-4038-9d30-6b5a6dabb959\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-xbnxv" Jun 15 04:33:41.001602 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:41.001512 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c014ebe3-4e57-4038-9d30-6b5a6dabb959-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-xbnxv\" (UID: \"c014ebe3-4e57-4038-9d30-6b5a6dabb959\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-xbnxv" Jun 15 04:33:41.001602 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:41.001555 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrhdr\" (UniqueName: \"kubernetes.io/projected/c014ebe3-4e57-4038-9d30-6b5a6dabb959-kube-api-access-jrhdr\") pod \"cert-manager-cainjector-5d99449ffd-xbnxv\" (UID: \"c014ebe3-4e57-4038-9d30-6b5a6dabb959\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-xbnxv" Jun 15 04:33:41.009677 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:41.009642 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c014ebe3-4e57-4038-9d30-6b5a6dabb959-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-xbnxv\" (UID: \"c014ebe3-4e57-4038-9d30-6b5a6dabb959\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-xbnxv" Jun 15 04:33:41.010156 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:41.010134 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrhdr\" (UniqueName: \"kubernetes.io/projected/c014ebe3-4e57-4038-9d30-6b5a6dabb959-kube-api-access-jrhdr\") pod \"cert-manager-cainjector-5d99449ffd-xbnxv\" (UID: \"c014ebe3-4e57-4038-9d30-6b5a6dabb959\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-xbnxv" Jun 15 04:33:41.095862 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:41.095826 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-xbnxv" Jun 15 04:33:41.684076 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:41.684046 2561 generic.go:356] "Generic (PLEG): container finished" podID="79f32173-c098-4484-b1d7-4697b4d1d528" containerID="069e9f7c80d8a21286298526b8350fc3079cb4dfab9d56b36dea07d068c3764a" exitCode=0 Jun 15 04:33:41.684168 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:41.684110 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f488qc" event={"ID":"79f32173-c098-4484-b1d7-4697b4d1d528","Type":"ContainerDied","Data":"069e9f7c80d8a21286298526b8350fc3079cb4dfab9d56b36dea07d068c3764a"} Jun 15 04:33:41.742107 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:41.742080 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-xbnxv"] Jun 15 04:33:41.744405 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:33:41.744376 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc014ebe3_4e57_4038_9d30_6b5a6dabb959.slice/crio-f0b2ed2858a6f80c0927e29cb024946f560f6adac2d710df18563981adefeb9c WatchSource:0}: Error finding container f0b2ed2858a6f80c0927e29cb024946f560f6adac2d710df18563981adefeb9c: Status 404 returned error can't find the container with id f0b2ed2858a6f80c0927e29cb024946f560f6adac2d710df18563981adefeb9c Jun 15 04:33:42.690148 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:42.690111 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-xbnxv" event={"ID":"c014ebe3-4e57-4038-9d30-6b5a6dabb959","Type":"ContainerStarted","Data":"68fed0fe4e0137ebc64ec32821dee2c7c862ee4b47ae65215ac5d4ce74f1802b"} Jun 15 04:33:42.690578 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:42.690156 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-xbnxv" event={"ID":"c014ebe3-4e57-4038-9d30-6b5a6dabb959","Type":"ContainerStarted","Data":"f0b2ed2858a6f80c0927e29cb024946f560f6adac2d710df18563981adefeb9c"} Jun 15 04:33:42.692188 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:42.692162 2561 generic.go:356] "Generic (PLEG): container finished" podID="79f32173-c098-4484-b1d7-4697b4d1d528" containerID="bf5ac0a43e9e5bc425abd33c444eb4c2b02c1d4b90405d6590f4c0f3205707a4" exitCode=0 Jun 15 04:33:42.692294 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:42.692236 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f488qc" event={"ID":"79f32173-c098-4484-b1d7-4697b4d1d528","Type":"ContainerDied","Data":"bf5ac0a43e9e5bc425abd33c444eb4c2b02c1d4b90405d6590f4c0f3205707a4"} Jun 15 04:33:42.693672 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:42.693650 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-lkfjf" event={"ID":"39e079ec-6509-41d7-b01a-d2712e575e1b","Type":"ContainerStarted","Data":"29ac6bb80df634da362619d22429c8f693ad9878aab35f842484ce4aae8716c0"} Jun 15 04:33:42.693742 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:42.693710 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-lkfjf" Jun 15 04:33:42.703875 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:42.703837 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-xbnxv" podStartSLOduration=2.703824298 podStartE2EDuration="2.703824298s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 04:33:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:33:42.702697315 +0000 UTC m=+498.230688219" watchObservedRunningTime="2026-06-15 04:33:42.703824298 +0000 UTC m=+498.231815203" Jun 15 04:33:42.716390 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:42.716341 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-lkfjf" podStartSLOduration=2.30924017 podStartE2EDuration="4.716321679s" totalImagesPullingTime="2.407081509s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 04:33:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:33:42.715275992 +0000 UTC m=+498.243266898" watchObservedRunningTime="2026-06-15 04:33:42.716321679 +0000 UTC m=+498.244312722" Jun 15 04:33:43.823386 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:43.823358 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f488qc" Jun 15 04:33:43.928919 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:43.928891 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/79f32173-c098-4484-b1d7-4697b4d1d528-util\") pod \"79f32173-c098-4484-b1d7-4697b4d1d528\" (UID: \"79f32173-c098-4484-b1d7-4697b4d1d528\") " Jun 15 04:33:43.929104 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:43.928942 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sdccw\" (UniqueName: \"kubernetes.io/projected/79f32173-c098-4484-b1d7-4697b4d1d528-kube-api-access-sdccw\") pod \"79f32173-c098-4484-b1d7-4697b4d1d528\" (UID: \"79f32173-c098-4484-b1d7-4697b4d1d528\") " Jun 15 04:33:43.929104 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:43.928968 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/79f32173-c098-4484-b1d7-4697b4d1d528-bundle\") pod \"79f32173-c098-4484-b1d7-4697b4d1d528\" (UID: \"79f32173-c098-4484-b1d7-4697b4d1d528\") " Jun 15 04:33:43.929378 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:43.929354 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79f32173-c098-4484-b1d7-4697b4d1d528-bundle" (OuterVolumeSpecName: "bundle") pod "79f32173-c098-4484-b1d7-4697b4d1d528" (UID: "79f32173-c098-4484-b1d7-4697b4d1d528"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 04:33:43.930911 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:43.930891 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79f32173-c098-4484-b1d7-4697b4d1d528-kube-api-access-sdccw" (OuterVolumeSpecName: "kube-api-access-sdccw") pod "79f32173-c098-4484-b1d7-4697b4d1d528" (UID: "79f32173-c098-4484-b1d7-4697b4d1d528"). InnerVolumeSpecName "kube-api-access-sdccw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 04:33:43.934016 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:43.933995 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79f32173-c098-4484-b1d7-4697b4d1d528-util" (OuterVolumeSpecName: "util") pod "79f32173-c098-4484-b1d7-4697b4d1d528" (UID: "79f32173-c098-4484-b1d7-4697b4d1d528"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 04:33:44.030548 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:44.030477 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/79f32173-c098-4484-b1d7-4697b4d1d528-util\") on node \"ip-10-0-140-86.ec2.internal\" DevicePath \"\"" Jun 15 04:33:44.030548 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:44.030502 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sdccw\" (UniqueName: \"kubernetes.io/projected/79f32173-c098-4484-b1d7-4697b4d1d528-kube-api-access-sdccw\") on node \"ip-10-0-140-86.ec2.internal\" DevicePath \"\"" Jun 15 04:33:44.030548 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:44.030512 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/79f32173-c098-4484-b1d7-4697b4d1d528-bundle\") on node \"ip-10-0-140-86.ec2.internal\" DevicePath \"\"" Jun 15 04:33:44.706242 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:44.706214 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f488qc" Jun 15 04:33:44.706417 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:44.706213 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f488qc" event={"ID":"79f32173-c098-4484-b1d7-4697b4d1d528","Type":"ContainerDied","Data":"eb5b1fd14f69c258a9c9a10dfaad31da4912ee5b072b052e730f0ec58fc998a9"} Jun 15 04:33:44.706417 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:44.706357 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eb5b1fd14f69c258a9c9a10dfaad31da4912ee5b072b052e730f0ec58fc998a9" Jun 15 04:33:48.701421 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:48.701391 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-lkfjf" Jun 15 04:33:48.840072 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:48.840036 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-b768d"] Jun 15 04:33:48.840463 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:48.840418 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79f32173-c098-4484-b1d7-4697b4d1d528" containerName="pull" Jun 15 04:33:48.840463 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:48.840452 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="79f32173-c098-4484-b1d7-4697b4d1d528" containerName="pull" Jun 15 04:33:48.840611 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:48.840487 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79f32173-c098-4484-b1d7-4697b4d1d528" containerName="extract" Jun 15 04:33:48.840611 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:48.840496 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="79f32173-c098-4484-b1d7-4697b4d1d528" containerName="extract" Jun 15 04:33:48.840611 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:48.840510 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79f32173-c098-4484-b1d7-4697b4d1d528" containerName="util" Jun 15 04:33:48.840611 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:48.840519 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="79f32173-c098-4484-b1d7-4697b4d1d528" containerName="util" Jun 15 04:33:48.840790 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:48.840623 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="79f32173-c098-4484-b1d7-4697b4d1d528" containerName="extract" Jun 15 04:33:48.843859 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:48.843839 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-b768d" Jun 15 04:33:48.845675 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:48.845647 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 15 04:33:48.845775 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:48.845649 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 15 04:33:48.845775 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:48.845723 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-tqtwz\"" Jun 15 04:33:48.853475 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:48.853434 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-b768d"] Jun 15 04:33:48.975502 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:48.975387 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e1db8b1-9a53-4089-9506-7e902457db63-tmp\") pod \"openshift-lws-operator-fd8ccff4c-b768d\" (UID: \"1e1db8b1-9a53-4089-9506-7e902457db63\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-b768d" Jun 15 04:33:48.975659 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:48.975504 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kccs4\" (UniqueName: \"kubernetes.io/projected/1e1db8b1-9a53-4089-9506-7e902457db63-kube-api-access-kccs4\") pod \"openshift-lws-operator-fd8ccff4c-b768d\" (UID: \"1e1db8b1-9a53-4089-9506-7e902457db63\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-b768d" Jun 15 04:33:49.076194 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:49.076157 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e1db8b1-9a53-4089-9506-7e902457db63-tmp\") pod \"openshift-lws-operator-fd8ccff4c-b768d\" (UID: \"1e1db8b1-9a53-4089-9506-7e902457db63\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-b768d" Jun 15 04:33:49.076381 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:49.076216 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kccs4\" (UniqueName: \"kubernetes.io/projected/1e1db8b1-9a53-4089-9506-7e902457db63-kube-api-access-kccs4\") pod \"openshift-lws-operator-fd8ccff4c-b768d\" (UID: \"1e1db8b1-9a53-4089-9506-7e902457db63\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-b768d" Jun 15 04:33:49.076619 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:49.076595 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e1db8b1-9a53-4089-9506-7e902457db63-tmp\") pod \"openshift-lws-operator-fd8ccff4c-b768d\" (UID: \"1e1db8b1-9a53-4089-9506-7e902457db63\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-b768d" Jun 15 04:33:49.083822 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:49.083798 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kccs4\" (UniqueName: \"kubernetes.io/projected/1e1db8b1-9a53-4089-9506-7e902457db63-kube-api-access-kccs4\") pod \"openshift-lws-operator-fd8ccff4c-b768d\" (UID: \"1e1db8b1-9a53-4089-9506-7e902457db63\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-b768d" Jun 15 04:33:49.157701 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:49.157675 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-b768d" Jun 15 04:33:49.282748 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:49.282726 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-b768d"] Jun 15 04:33:49.284484 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:33:49.284432 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1e1db8b1_9a53_4089_9506_7e902457db63.slice/crio-af8ad269d5c8332af7f96f4199ca07671d26b28f45d8335993c76679c78b1902 WatchSource:0}: Error finding container af8ad269d5c8332af7f96f4199ca07671d26b28f45d8335993c76679c78b1902: Status 404 returned error can't find the container with id af8ad269d5c8332af7f96f4199ca07671d26b28f45d8335993c76679c78b1902 Jun 15 04:33:49.732695 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:49.732662 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-b768d" event={"ID":"1e1db8b1-9a53-4089-9506-7e902457db63","Type":"ContainerStarted","Data":"af8ad269d5c8332af7f96f4199ca07671d26b28f45d8335993c76679c78b1902"} Jun 15 04:33:51.744013 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:51.743977 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-b768d" event={"ID":"1e1db8b1-9a53-4089-9506-7e902457db63","Type":"ContainerStarted","Data":"72649432ed3fb4edd3b97c675ea4c12922c33307712f6005fa4be5e9a20ff2cd"} Jun 15 04:33:51.759858 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:51.759813 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-b768d" podStartSLOduration=1.885999468 podStartE2EDuration="3.759798279s" totalImagesPullingTime="1.873798811s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 04:33:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:33:51.758480373 +0000 UTC m=+507.286471278" watchObservedRunningTime="2026-06-15 04:33:51.759798279 +0000 UTC m=+507.287789184" Jun 15 04:33:54.065127 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:54.065095 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd568sj"] Jun 15 04:33:54.068729 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:54.068708 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd568sj" Jun 15 04:33:54.070977 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:54.070955 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 15 04:33:54.071057 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:54.071015 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 15 04:33:54.071664 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:54.071646 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-vpc82\"" Jun 15 04:33:54.077276 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:54.077258 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd568sj"] Jun 15 04:33:54.222856 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:54.222814 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hk8wd\" (UniqueName: \"kubernetes.io/projected/66530552-66c7-42bf-89ce-45d8a37f91db-kube-api-access-hk8wd\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd568sj\" (UID: \"66530552-66c7-42bf-89ce-45d8a37f91db\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd568sj" Jun 15 04:33:54.223035 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:54.222863 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/66530552-66c7-42bf-89ce-45d8a37f91db-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd568sj\" (UID: \"66530552-66c7-42bf-89ce-45d8a37f91db\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd568sj" Jun 15 04:33:54.223035 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:54.222929 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/66530552-66c7-42bf-89ce-45d8a37f91db-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd568sj\" (UID: \"66530552-66c7-42bf-89ce-45d8a37f91db\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd568sj" Jun 15 04:33:54.324402 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:54.324303 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hk8wd\" (UniqueName: \"kubernetes.io/projected/66530552-66c7-42bf-89ce-45d8a37f91db-kube-api-access-hk8wd\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd568sj\" (UID: \"66530552-66c7-42bf-89ce-45d8a37f91db\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd568sj" Jun 15 04:33:54.324402 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:54.324359 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/66530552-66c7-42bf-89ce-45d8a37f91db-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd568sj\" (UID: \"66530552-66c7-42bf-89ce-45d8a37f91db\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd568sj" Jun 15 04:33:54.324657 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:54.324405 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/66530552-66c7-42bf-89ce-45d8a37f91db-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd568sj\" (UID: \"66530552-66c7-42bf-89ce-45d8a37f91db\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd568sj" Jun 15 04:33:54.324838 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:54.324818 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/66530552-66c7-42bf-89ce-45d8a37f91db-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd568sj\" (UID: \"66530552-66c7-42bf-89ce-45d8a37f91db\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd568sj" Jun 15 04:33:54.324908 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:54.324854 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/66530552-66c7-42bf-89ce-45d8a37f91db-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd568sj\" (UID: \"66530552-66c7-42bf-89ce-45d8a37f91db\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd568sj" Jun 15 04:33:54.331915 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:54.331895 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hk8wd\" (UniqueName: \"kubernetes.io/projected/66530552-66c7-42bf-89ce-45d8a37f91db-kube-api-access-hk8wd\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd568sj\" (UID: \"66530552-66c7-42bf-89ce-45d8a37f91db\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd568sj" Jun 15 04:33:54.378376 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:54.378351 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd568sj" Jun 15 04:33:54.507879 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:54.507847 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd568sj"] Jun 15 04:33:54.510056 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:33:54.510027 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66530552_66c7_42bf_89ce_45d8a37f91db.slice/crio-3f65e4848f3ce063f649531c97d73d3ee4332e254aa6ecab010ff488efc66f28 WatchSource:0}: Error finding container 3f65e4848f3ce063f649531c97d73d3ee4332e254aa6ecab010ff488efc66f28: Status 404 returned error can't find the container with id 3f65e4848f3ce063f649531c97d73d3ee4332e254aa6ecab010ff488efc66f28 Jun 15 04:33:54.761033 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:54.760998 2561 generic.go:356] "Generic (PLEG): container finished" podID="66530552-66c7-42bf-89ce-45d8a37f91db" containerID="392fab4ab3151f9d51240ddf9a1e33f6a8ee2b88d12ea7adedd224cf1a3fc92e" exitCode=0 Jun 15 04:33:54.761230 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:54.761050 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd568sj" event={"ID":"66530552-66c7-42bf-89ce-45d8a37f91db","Type":"ContainerDied","Data":"392fab4ab3151f9d51240ddf9a1e33f6a8ee2b88d12ea7adedd224cf1a3fc92e"} Jun 15 04:33:54.761230 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:54.761095 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd568sj" event={"ID":"66530552-66c7-42bf-89ce-45d8a37f91db","Type":"ContainerStarted","Data":"3f65e4848f3ce063f649531c97d73d3ee4332e254aa6ecab010ff488efc66f28"} Jun 15 04:33:55.767728 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:55.767687 2561 generic.go:356] "Generic (PLEG): container finished" podID="66530552-66c7-42bf-89ce-45d8a37f91db" containerID="c8a12d5548a637c92b3996a8b61f1771ed24bca7e3f3f2d3299770c5a1c4cd35" exitCode=0 Jun 15 04:33:55.768201 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:55.767752 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd568sj" event={"ID":"66530552-66c7-42bf-89ce-45d8a37f91db","Type":"ContainerDied","Data":"c8a12d5548a637c92b3996a8b61f1771ed24bca7e3f3f2d3299770c5a1c4cd35"} Jun 15 04:33:56.774904 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:56.774865 2561 generic.go:356] "Generic (PLEG): container finished" podID="66530552-66c7-42bf-89ce-45d8a37f91db" containerID="cc3d55a6a634b8d86ef23ec0ff3c9eb051d79a2d3311bcc696ff2ceb739a853a" exitCode=0 Jun 15 04:33:56.775272 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:56.774947 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd568sj" event={"ID":"66530552-66c7-42bf-89ce-45d8a37f91db","Type":"ContainerDied","Data":"cc3d55a6a634b8d86ef23ec0ff3c9eb051d79a2d3311bcc696ff2ceb739a853a"} Jun 15 04:33:57.913940 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:57.913915 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd568sj" Jun 15 04:33:58.056064 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:58.055979 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/66530552-66c7-42bf-89ce-45d8a37f91db-util\") pod \"66530552-66c7-42bf-89ce-45d8a37f91db\" (UID: \"66530552-66c7-42bf-89ce-45d8a37f91db\") " Jun 15 04:33:58.056064 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:58.056046 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hk8wd\" (UniqueName: \"kubernetes.io/projected/66530552-66c7-42bf-89ce-45d8a37f91db-kube-api-access-hk8wd\") pod \"66530552-66c7-42bf-89ce-45d8a37f91db\" (UID: \"66530552-66c7-42bf-89ce-45d8a37f91db\") " Jun 15 04:33:58.056064 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:58.056063 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/66530552-66c7-42bf-89ce-45d8a37f91db-bundle\") pod \"66530552-66c7-42bf-89ce-45d8a37f91db\" (UID: \"66530552-66c7-42bf-89ce-45d8a37f91db\") " Jun 15 04:33:58.056980 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:58.056945 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66530552-66c7-42bf-89ce-45d8a37f91db-bundle" (OuterVolumeSpecName: "bundle") pod "66530552-66c7-42bf-89ce-45d8a37f91db" (UID: "66530552-66c7-42bf-89ce-45d8a37f91db"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 04:33:58.058217 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:58.058192 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66530552-66c7-42bf-89ce-45d8a37f91db-kube-api-access-hk8wd" (OuterVolumeSpecName: "kube-api-access-hk8wd") pod "66530552-66c7-42bf-89ce-45d8a37f91db" (UID: "66530552-66c7-42bf-89ce-45d8a37f91db"). InnerVolumeSpecName "kube-api-access-hk8wd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 04:33:58.061876 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:58.061857 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66530552-66c7-42bf-89ce-45d8a37f91db-util" (OuterVolumeSpecName: "util") pod "66530552-66c7-42bf-89ce-45d8a37f91db" (UID: "66530552-66c7-42bf-89ce-45d8a37f91db"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 04:33:58.157037 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:58.156994 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hk8wd\" (UniqueName: \"kubernetes.io/projected/66530552-66c7-42bf-89ce-45d8a37f91db-kube-api-access-hk8wd\") on node \"ip-10-0-140-86.ec2.internal\" DevicePath \"\"" Jun 15 04:33:58.157037 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:58.157028 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/66530552-66c7-42bf-89ce-45d8a37f91db-bundle\") on node \"ip-10-0-140-86.ec2.internal\" DevicePath \"\"" Jun 15 04:33:58.157037 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:58.157037 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/66530552-66c7-42bf-89ce-45d8a37f91db-util\") on node \"ip-10-0-140-86.ec2.internal\" DevicePath \"\"" Jun 15 04:33:58.784687 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:58.784655 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd568sj" event={"ID":"66530552-66c7-42bf-89ce-45d8a37f91db","Type":"ContainerDied","Data":"3f65e4848f3ce063f649531c97d73d3ee4332e254aa6ecab010ff488efc66f28"} Jun 15 04:33:58.784687 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:58.784685 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd568sj" Jun 15 04:33:58.784891 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:33:58.784729 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3f65e4848f3ce063f649531c97d73d3ee4332e254aa6ecab010ff488efc66f28" Jun 15 04:34:07.967708 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:07.967672 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-54bcdff745-sqckf"] Jun 15 04:34:07.968098 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:07.968016 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66530552-66c7-42bf-89ce-45d8a37f91db" containerName="util" Jun 15 04:34:07.968098 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:07.968028 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="66530552-66c7-42bf-89ce-45d8a37f91db" containerName="util" Jun 15 04:34:07.968098 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:07.968041 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66530552-66c7-42bf-89ce-45d8a37f91db" containerName="extract" Jun 15 04:34:07.968098 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:07.968047 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="66530552-66c7-42bf-89ce-45d8a37f91db" containerName="extract" Jun 15 04:34:07.968098 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:07.968054 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66530552-66c7-42bf-89ce-45d8a37f91db" containerName="pull" Jun 15 04:34:07.968098 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:07.968060 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="66530552-66c7-42bf-89ce-45d8a37f91db" containerName="pull" Jun 15 04:34:07.968271 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:07.968110 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="66530552-66c7-42bf-89ce-45d8a37f91db" containerName="extract" Jun 15 04:34:07.971066 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:07.971048 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-54bcdff745-sqckf" Jun 15 04:34:07.974637 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:07.974611 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 15 04:34:07.974780 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:07.974641 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 15 04:34:07.975041 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:07.975017 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 15 04:34:07.975114 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:07.975084 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 15 04:34:07.975114 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:07.975092 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-lnlct\"" Jun 15 04:34:07.985385 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:07.985361 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-54bcdff745-sqckf"] Jun 15 04:34:08.036105 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:08.036078 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ba04564a-566b-4020-9e43-ca8644dbbc67-tmp\") pod \"opendatahub-operator-controller-manager-54bcdff745-sqckf\" (UID: \"ba04564a-566b-4020-9e43-ca8644dbbc67\") " pod="opendatahub/opendatahub-operator-controller-manager-54bcdff745-sqckf" Jun 15 04:34:08.036262 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:08.036115 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ba04564a-566b-4020-9e43-ca8644dbbc67-manifests\") pod \"opendatahub-operator-controller-manager-54bcdff745-sqckf\" (UID: \"ba04564a-566b-4020-9e43-ca8644dbbc67\") " pod="opendatahub/opendatahub-operator-controller-manager-54bcdff745-sqckf" Jun 15 04:34:08.036262 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:08.036137 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ba04564a-566b-4020-9e43-ca8644dbbc67-webhook-cert\") pod \"opendatahub-operator-controller-manager-54bcdff745-sqckf\" (UID: \"ba04564a-566b-4020-9e43-ca8644dbbc67\") " pod="opendatahub/opendatahub-operator-controller-manager-54bcdff745-sqckf" Jun 15 04:34:08.036262 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:08.036205 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ba04564a-566b-4020-9e43-ca8644dbbc67-apiservice-cert\") pod \"opendatahub-operator-controller-manager-54bcdff745-sqckf\" (UID: \"ba04564a-566b-4020-9e43-ca8644dbbc67\") " pod="opendatahub/opendatahub-operator-controller-manager-54bcdff745-sqckf" Jun 15 04:34:08.036262 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:08.036235 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtgdf\" (UniqueName: \"kubernetes.io/projected/ba04564a-566b-4020-9e43-ca8644dbbc67-kube-api-access-mtgdf\") pod \"opendatahub-operator-controller-manager-54bcdff745-sqckf\" (UID: \"ba04564a-566b-4020-9e43-ca8644dbbc67\") " pod="opendatahub/opendatahub-operator-controller-manager-54bcdff745-sqckf" Jun 15 04:34:08.136629 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:08.136601 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ba04564a-566b-4020-9e43-ca8644dbbc67-tmp\") pod \"opendatahub-operator-controller-manager-54bcdff745-sqckf\" (UID: \"ba04564a-566b-4020-9e43-ca8644dbbc67\") " pod="opendatahub/opendatahub-operator-controller-manager-54bcdff745-sqckf" Jun 15 04:34:08.136792 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:08.136638 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ba04564a-566b-4020-9e43-ca8644dbbc67-manifests\") pod \"opendatahub-operator-controller-manager-54bcdff745-sqckf\" (UID: \"ba04564a-566b-4020-9e43-ca8644dbbc67\") " pod="opendatahub/opendatahub-operator-controller-manager-54bcdff745-sqckf" Jun 15 04:34:08.136792 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:08.136656 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ba04564a-566b-4020-9e43-ca8644dbbc67-webhook-cert\") pod \"opendatahub-operator-controller-manager-54bcdff745-sqckf\" (UID: \"ba04564a-566b-4020-9e43-ca8644dbbc67\") " pod="opendatahub/opendatahub-operator-controller-manager-54bcdff745-sqckf" Jun 15 04:34:08.136792 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:08.136708 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ba04564a-566b-4020-9e43-ca8644dbbc67-apiservice-cert\") pod \"opendatahub-operator-controller-manager-54bcdff745-sqckf\" (UID: \"ba04564a-566b-4020-9e43-ca8644dbbc67\") " pod="opendatahub/opendatahub-operator-controller-manager-54bcdff745-sqckf" Jun 15 04:34:08.136951 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:08.136866 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtgdf\" (UniqueName: \"kubernetes.io/projected/ba04564a-566b-4020-9e43-ca8644dbbc67-kube-api-access-mtgdf\") pod \"opendatahub-operator-controller-manager-54bcdff745-sqckf\" (UID: \"ba04564a-566b-4020-9e43-ca8644dbbc67\") " pod="opendatahub/opendatahub-operator-controller-manager-54bcdff745-sqckf" Jun 15 04:34:08.137130 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:08.137099 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ba04564a-566b-4020-9e43-ca8644dbbc67-manifests\") pod \"opendatahub-operator-controller-manager-54bcdff745-sqckf\" (UID: \"ba04564a-566b-4020-9e43-ca8644dbbc67\") " pod="opendatahub/opendatahub-operator-controller-manager-54bcdff745-sqckf" Jun 15 04:34:08.139153 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:08.139129 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ba04564a-566b-4020-9e43-ca8644dbbc67-tmp\") pod \"opendatahub-operator-controller-manager-54bcdff745-sqckf\" (UID: \"ba04564a-566b-4020-9e43-ca8644dbbc67\") " pod="opendatahub/opendatahub-operator-controller-manager-54bcdff745-sqckf" Jun 15 04:34:08.139250 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:08.139216 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ba04564a-566b-4020-9e43-ca8644dbbc67-webhook-cert\") pod \"opendatahub-operator-controller-manager-54bcdff745-sqckf\" (UID: \"ba04564a-566b-4020-9e43-ca8644dbbc67\") " pod="opendatahub/opendatahub-operator-controller-manager-54bcdff745-sqckf" Jun 15 04:34:08.139250 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:08.139241 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ba04564a-566b-4020-9e43-ca8644dbbc67-apiservice-cert\") pod \"opendatahub-operator-controller-manager-54bcdff745-sqckf\" (UID: \"ba04564a-566b-4020-9e43-ca8644dbbc67\") " pod="opendatahub/opendatahub-operator-controller-manager-54bcdff745-sqckf" Jun 15 04:34:08.144236 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:08.144215 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtgdf\" (UniqueName: \"kubernetes.io/projected/ba04564a-566b-4020-9e43-ca8644dbbc67-kube-api-access-mtgdf\") pod \"opendatahub-operator-controller-manager-54bcdff745-sqckf\" (UID: \"ba04564a-566b-4020-9e43-ca8644dbbc67\") " pod="opendatahub/opendatahub-operator-controller-manager-54bcdff745-sqckf" Jun 15 04:34:08.282317 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:08.282223 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-54bcdff745-sqckf" Jun 15 04:34:08.412994 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:08.412873 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-54bcdff745-sqckf"] Jun 15 04:34:08.416421 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:34:08.416392 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba04564a_566b_4020_9e43_ca8644dbbc67.slice/crio-be4135690fe81535184c8befd282293bfe26065c9066e0a018cf8973c75b92a8 WatchSource:0}: Error finding container be4135690fe81535184c8befd282293bfe26065c9066e0a018cf8973c75b92a8: Status 404 returned error can't find the container with id be4135690fe81535184c8befd282293bfe26065c9066e0a018cf8973c75b92a8 Jun 15 04:34:08.836181 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:08.836147 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-54bcdff745-sqckf" event={"ID":"ba04564a-566b-4020-9e43-ca8644dbbc67","Type":"ContainerStarted","Data":"be4135690fe81535184c8befd282293bfe26065c9066e0a018cf8973c75b92a8"} Jun 15 04:34:11.855053 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:11.855012 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-54bcdff745-sqckf" event={"ID":"ba04564a-566b-4020-9e43-ca8644dbbc67","Type":"ContainerStarted","Data":"eed8920202462fe1d98c9b552a7506ca564195b740195bd6abfac883807e7284"} Jun 15 04:34:12.861280 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:12.861244 2561 generic.go:356] "Generic (PLEG): container finished" podID="ba04564a-566b-4020-9e43-ca8644dbbc67" containerID="eed8920202462fe1d98c9b552a7506ca564195b740195bd6abfac883807e7284" exitCode=0 Jun 15 04:34:12.861689 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:12.861327 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-54bcdff745-sqckf" event={"ID":"ba04564a-566b-4020-9e43-ca8644dbbc67","Type":"ContainerDied","Data":"eed8920202462fe1d98c9b552a7506ca564195b740195bd6abfac883807e7284"} Jun 15 04:34:13.867794 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:13.867754 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-54bcdff745-sqckf" event={"ID":"ba04564a-566b-4020-9e43-ca8644dbbc67","Type":"ContainerStarted","Data":"7624d8863cbd1b6b9aadeb537427661be34caad09800d9c0d8a3eb482dbb6cbc"} Jun 15 04:34:13.868170 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:13.867922 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-54bcdff745-sqckf" Jun 15 04:34:13.889390 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:13.889336 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-54bcdff745-sqckf" podStartSLOduration=2.680704195 podStartE2EDuration="6.889315361s" totalImagesPullingTime="3.248299914s" totalInitContainerRuntime="960.311252ms" isStatefulPod=false podCreationTimestamp="2026-06-15 04:34:07 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:34:13.887055473 +0000 UTC m=+529.415046392" watchObservedRunningTime="2026-06-15 04:34:13.889315361 +0000 UTC m=+529.417306266" Jun 15 04:34:24.874732 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:24.874701 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-54bcdff745-sqckf" Jun 15 04:34:25.179393 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:25.179350 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-56698c95d7-qnplb"] Jun 15 04:34:25.192675 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:25.192643 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-56698c95d7-qnplb"] Jun 15 04:34:25.192839 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:25.192751 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-56698c95d7-qnplb" Jun 15 04:34:25.194687 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:25.194658 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 15 04:34:25.194800 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:25.194658 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 15 04:34:25.194800 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:25.194725 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-hw49l\"" Jun 15 04:34:25.194800 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:25.194725 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 15 04:34:25.290134 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:25.290083 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1eda4a6b-fa9c-44b8-b47a-c71d3904e3ca-metrics-cert\") pod \"lws-controller-manager-56698c95d7-qnplb\" (UID: \"1eda4a6b-fa9c-44b8-b47a-c71d3904e3ca\") " pod="openshift-lws-operator/lws-controller-manager-56698c95d7-qnplb" Jun 15 04:34:25.295292 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:25.290431 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1eda4a6b-fa9c-44b8-b47a-c71d3904e3ca-manager-config\") pod \"lws-controller-manager-56698c95d7-qnplb\" (UID: \"1eda4a6b-fa9c-44b8-b47a-c71d3904e3ca\") " pod="openshift-lws-operator/lws-controller-manager-56698c95d7-qnplb" Jun 15 04:34:25.295292 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:25.290538 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fksx9\" (UniqueName: \"kubernetes.io/projected/1eda4a6b-fa9c-44b8-b47a-c71d3904e3ca-kube-api-access-fksx9\") pod \"lws-controller-manager-56698c95d7-qnplb\" (UID: \"1eda4a6b-fa9c-44b8-b47a-c71d3904e3ca\") " pod="openshift-lws-operator/lws-controller-manager-56698c95d7-qnplb" Jun 15 04:34:25.295292 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:25.290587 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1eda4a6b-fa9c-44b8-b47a-c71d3904e3ca-cert\") pod \"lws-controller-manager-56698c95d7-qnplb\" (UID: \"1eda4a6b-fa9c-44b8-b47a-c71d3904e3ca\") " pod="openshift-lws-operator/lws-controller-manager-56698c95d7-qnplb" Jun 15 04:34:25.391173 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:25.391133 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1eda4a6b-fa9c-44b8-b47a-c71d3904e3ca-manager-config\") pod \"lws-controller-manager-56698c95d7-qnplb\" (UID: \"1eda4a6b-fa9c-44b8-b47a-c71d3904e3ca\") " pod="openshift-lws-operator/lws-controller-manager-56698c95d7-qnplb" Jun 15 04:34:25.391381 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:25.391189 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fksx9\" (UniqueName: \"kubernetes.io/projected/1eda4a6b-fa9c-44b8-b47a-c71d3904e3ca-kube-api-access-fksx9\") pod \"lws-controller-manager-56698c95d7-qnplb\" (UID: \"1eda4a6b-fa9c-44b8-b47a-c71d3904e3ca\") " pod="openshift-lws-operator/lws-controller-manager-56698c95d7-qnplb" Jun 15 04:34:25.391381 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:25.391217 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1eda4a6b-fa9c-44b8-b47a-c71d3904e3ca-cert\") pod \"lws-controller-manager-56698c95d7-qnplb\" (UID: \"1eda4a6b-fa9c-44b8-b47a-c71d3904e3ca\") " pod="openshift-lws-operator/lws-controller-manager-56698c95d7-qnplb" Jun 15 04:34:25.391381 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:25.391258 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1eda4a6b-fa9c-44b8-b47a-c71d3904e3ca-metrics-cert\") pod \"lws-controller-manager-56698c95d7-qnplb\" (UID: \"1eda4a6b-fa9c-44b8-b47a-c71d3904e3ca\") " pod="openshift-lws-operator/lws-controller-manager-56698c95d7-qnplb" Jun 15 04:34:25.391942 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:25.391916 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1eda4a6b-fa9c-44b8-b47a-c71d3904e3ca-manager-config\") pod \"lws-controller-manager-56698c95d7-qnplb\" (UID: \"1eda4a6b-fa9c-44b8-b47a-c71d3904e3ca\") " pod="openshift-lws-operator/lws-controller-manager-56698c95d7-qnplb" Jun 15 04:34:25.393782 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:25.393751 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1eda4a6b-fa9c-44b8-b47a-c71d3904e3ca-metrics-cert\") pod \"lws-controller-manager-56698c95d7-qnplb\" (UID: \"1eda4a6b-fa9c-44b8-b47a-c71d3904e3ca\") " pod="openshift-lws-operator/lws-controller-manager-56698c95d7-qnplb" Jun 15 04:34:25.393782 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:25.393762 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1eda4a6b-fa9c-44b8-b47a-c71d3904e3ca-cert\") pod \"lws-controller-manager-56698c95d7-qnplb\" (UID: \"1eda4a6b-fa9c-44b8-b47a-c71d3904e3ca\") " pod="openshift-lws-operator/lws-controller-manager-56698c95d7-qnplb" Jun 15 04:34:25.398549 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:25.398528 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fksx9\" (UniqueName: \"kubernetes.io/projected/1eda4a6b-fa9c-44b8-b47a-c71d3904e3ca-kube-api-access-fksx9\") pod \"lws-controller-manager-56698c95d7-qnplb\" (UID: \"1eda4a6b-fa9c-44b8-b47a-c71d3904e3ca\") " pod="openshift-lws-operator/lws-controller-manager-56698c95d7-qnplb" Jun 15 04:34:25.505291 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:25.505206 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-56698c95d7-qnplb" Jun 15 04:34:25.638002 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:25.637976 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-56698c95d7-qnplb"] Jun 15 04:34:25.639944 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:34:25.639920 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1eda4a6b_fa9c_44b8_b47a_c71d3904e3ca.slice/crio-78c6bf4593b70788422fe04c12258ef8fdeb923bfedd05eeb049d1be97388f6c WatchSource:0}: Error finding container 78c6bf4593b70788422fe04c12258ef8fdeb923bfedd05eeb049d1be97388f6c: Status 404 returned error can't find the container with id 78c6bf4593b70788422fe04c12258ef8fdeb923bfedd05eeb049d1be97388f6c Jun 15 04:34:25.926065 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:25.926030 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-56698c95d7-qnplb" event={"ID":"1eda4a6b-fa9c-44b8-b47a-c71d3904e3ca","Type":"ContainerStarted","Data":"78c6bf4593b70788422fe04c12258ef8fdeb923bfedd05eeb049d1be97388f6c"} Jun 15 04:34:27.940325 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:27.940286 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-56698c95d7-qnplb" event={"ID":"1eda4a6b-fa9c-44b8-b47a-c71d3904e3ca","Type":"ContainerStarted","Data":"922f68e26a2d12ccb073468840c876696e90b7777039933200f825777eb30dae"} Jun 15 04:34:27.940741 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:27.940395 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-56698c95d7-qnplb" Jun 15 04:34:27.958886 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:27.958835 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-56698c95d7-qnplb" podStartSLOduration=1.542948805 podStartE2EDuration="2.958820139s" totalImagesPullingTime="1.415871334s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 04:34:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:34:27.956799697 +0000 UTC m=+543.484790603" watchObservedRunningTime="2026-06-15 04:34:27.958820139 +0000 UTC m=+543.486811098" Jun 15 04:34:30.226640 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:30.226597 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06z77c6"] Jun 15 04:34:30.230740 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:30.230717 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06z77c6" Jun 15 04:34:30.232925 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:30.232901 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 15 04:34:30.233067 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:30.232935 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 15 04:34:30.233508 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:30.233487 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-vpc82\"" Jun 15 04:34:30.237717 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:30.237693 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06z77c6"] Jun 15 04:34:30.333369 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:30.333331 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d7093e11-c53f-432c-8af6-f1f90c2c4889-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06z77c6\" (UID: \"d7093e11-c53f-432c-8af6-f1f90c2c4889\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06z77c6" Jun 15 04:34:30.333369 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:30.333376 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d7093e11-c53f-432c-8af6-f1f90c2c4889-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06z77c6\" (UID: \"d7093e11-c53f-432c-8af6-f1f90c2c4889\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06z77c6" Jun 15 04:34:30.333594 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:30.333405 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdwng\" (UniqueName: \"kubernetes.io/projected/d7093e11-c53f-432c-8af6-f1f90c2c4889-kube-api-access-wdwng\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06z77c6\" (UID: \"d7093e11-c53f-432c-8af6-f1f90c2c4889\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06z77c6" Jun 15 04:34:30.434889 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:30.434848 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d7093e11-c53f-432c-8af6-f1f90c2c4889-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06z77c6\" (UID: \"d7093e11-c53f-432c-8af6-f1f90c2c4889\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06z77c6" Jun 15 04:34:30.434889 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:30.434893 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d7093e11-c53f-432c-8af6-f1f90c2c4889-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06z77c6\" (UID: \"d7093e11-c53f-432c-8af6-f1f90c2c4889\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06z77c6" Jun 15 04:34:30.435104 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:30.434915 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdwng\" (UniqueName: \"kubernetes.io/projected/d7093e11-c53f-432c-8af6-f1f90c2c4889-kube-api-access-wdwng\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06z77c6\" (UID: \"d7093e11-c53f-432c-8af6-f1f90c2c4889\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06z77c6" Jun 15 04:34:30.435355 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:30.435331 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d7093e11-c53f-432c-8af6-f1f90c2c4889-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06z77c6\" (UID: \"d7093e11-c53f-432c-8af6-f1f90c2c4889\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06z77c6" Jun 15 04:34:30.435392 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:30.435343 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d7093e11-c53f-432c-8af6-f1f90c2c4889-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06z77c6\" (UID: \"d7093e11-c53f-432c-8af6-f1f90c2c4889\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06z77c6" Jun 15 04:34:30.443743 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:30.443711 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdwng\" (UniqueName: \"kubernetes.io/projected/d7093e11-c53f-432c-8af6-f1f90c2c4889-kube-api-access-wdwng\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06z77c6\" (UID: \"d7093e11-c53f-432c-8af6-f1f90c2c4889\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06z77c6" Jun 15 04:34:30.544504 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:30.544385 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06z77c6" Jun 15 04:34:30.679561 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:30.679533 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06z77c6"] Jun 15 04:34:30.681912 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:34:30.681884 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7093e11_c53f_432c_8af6_f1f90c2c4889.slice/crio-6b84172695c84b87ec6c04b9ca8955e31e119777b939a83bc120f109c73a1098 WatchSource:0}: Error finding container 6b84172695c84b87ec6c04b9ca8955e31e119777b939a83bc120f109c73a1098: Status 404 returned error can't find the container with id 6b84172695c84b87ec6c04b9ca8955e31e119777b939a83bc120f109c73a1098 Jun 15 04:34:30.955923 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:30.955884 2561 generic.go:356] "Generic (PLEG): container finished" podID="d7093e11-c53f-432c-8af6-f1f90c2c4889" containerID="2e6576e692b12b002d16bc3f17dbef0877189c68c3b45a90bbf79fdefa46c139" exitCode=0 Jun 15 04:34:30.956085 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:30.955978 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06z77c6" event={"ID":"d7093e11-c53f-432c-8af6-f1f90c2c4889","Type":"ContainerDied","Data":"2e6576e692b12b002d16bc3f17dbef0877189c68c3b45a90bbf79fdefa46c139"} Jun 15 04:34:30.956085 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:30.956020 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06z77c6" event={"ID":"d7093e11-c53f-432c-8af6-f1f90c2c4889","Type":"ContainerStarted","Data":"6b84172695c84b87ec6c04b9ca8955e31e119777b939a83bc120f109c73a1098"} Jun 15 04:34:32.970454 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:32.970405 2561 generic.go:356] "Generic (PLEG): container finished" podID="d7093e11-c53f-432c-8af6-f1f90c2c4889" containerID="aef7d928a88f76f0bdb64febc81e2dee06eae08dff34636c8a8c496fb207d010" exitCode=0 Jun 15 04:34:32.970880 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:32.970486 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06z77c6" event={"ID":"d7093e11-c53f-432c-8af6-f1f90c2c4889","Type":"ContainerDied","Data":"aef7d928a88f76f0bdb64febc81e2dee06eae08dff34636c8a8c496fb207d010"} Jun 15 04:34:33.978842 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:33.978810 2561 generic.go:356] "Generic (PLEG): container finished" podID="d7093e11-c53f-432c-8af6-f1f90c2c4889" containerID="fafe93a2294d4a373c2d01f8abb6338109c9eab6ea1651869f2da183efe80917" exitCode=0 Jun 15 04:34:33.979305 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:33.978848 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06z77c6" event={"ID":"d7093e11-c53f-432c-8af6-f1f90c2c4889","Type":"ContainerDied","Data":"fafe93a2294d4a373c2d01f8abb6338109c9eab6ea1651869f2da183efe80917"} Jun 15 04:34:35.119849 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:35.119823 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06z77c6" Jun 15 04:34:35.275167 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:35.275079 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wdwng\" (UniqueName: \"kubernetes.io/projected/d7093e11-c53f-432c-8af6-f1f90c2c4889-kube-api-access-wdwng\") pod \"d7093e11-c53f-432c-8af6-f1f90c2c4889\" (UID: \"d7093e11-c53f-432c-8af6-f1f90c2c4889\") " Jun 15 04:34:35.275167 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:35.275133 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d7093e11-c53f-432c-8af6-f1f90c2c4889-util\") pod \"d7093e11-c53f-432c-8af6-f1f90c2c4889\" (UID: \"d7093e11-c53f-432c-8af6-f1f90c2c4889\") " Jun 15 04:34:35.275381 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:35.275196 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d7093e11-c53f-432c-8af6-f1f90c2c4889-bundle\") pod \"d7093e11-c53f-432c-8af6-f1f90c2c4889\" (UID: \"d7093e11-c53f-432c-8af6-f1f90c2c4889\") " Jun 15 04:34:35.276107 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:35.276078 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7093e11-c53f-432c-8af6-f1f90c2c4889-bundle" (OuterVolumeSpecName: "bundle") pod "d7093e11-c53f-432c-8af6-f1f90c2c4889" (UID: "d7093e11-c53f-432c-8af6-f1f90c2c4889"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 04:34:35.277155 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:35.277124 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7093e11-c53f-432c-8af6-f1f90c2c4889-kube-api-access-wdwng" (OuterVolumeSpecName: "kube-api-access-wdwng") pod "d7093e11-c53f-432c-8af6-f1f90c2c4889" (UID: "d7093e11-c53f-432c-8af6-f1f90c2c4889"). InnerVolumeSpecName "kube-api-access-wdwng". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 04:34:35.282937 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:35.282891 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7093e11-c53f-432c-8af6-f1f90c2c4889-util" (OuterVolumeSpecName: "util") pod "d7093e11-c53f-432c-8af6-f1f90c2c4889" (UID: "d7093e11-c53f-432c-8af6-f1f90c2c4889"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 04:34:35.376299 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:35.376257 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wdwng\" (UniqueName: \"kubernetes.io/projected/d7093e11-c53f-432c-8af6-f1f90c2c4889-kube-api-access-wdwng\") on node \"ip-10-0-140-86.ec2.internal\" DevicePath \"\"" Jun 15 04:34:35.376299 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:35.376292 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d7093e11-c53f-432c-8af6-f1f90c2c4889-util\") on node \"ip-10-0-140-86.ec2.internal\" DevicePath \"\"" Jun 15 04:34:35.376299 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:35.376306 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d7093e11-c53f-432c-8af6-f1f90c2c4889-bundle\") on node \"ip-10-0-140-86.ec2.internal\" DevicePath \"\"" Jun 15 04:34:35.994373 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:35.994329 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06z77c6" event={"ID":"d7093e11-c53f-432c-8af6-f1f90c2c4889","Type":"ContainerDied","Data":"6b84172695c84b87ec6c04b9ca8955e31e119777b939a83bc120f109c73a1098"} Jun 15 04:34:35.994373 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:35.994358 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06z77c6" Jun 15 04:34:35.994588 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:35.994388 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6b84172695c84b87ec6c04b9ca8955e31e119777b939a83bc120f109c73a1098" Jun 15 04:34:38.948052 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:38.948018 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-56698c95d7-qnplb" Jun 15 04:34:45.060597 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:45.060559 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahbgw6"] Jun 15 04:34:45.061160 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:45.060948 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7093e11-c53f-432c-8af6-f1f90c2c4889" containerName="util" Jun 15 04:34:45.061160 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:45.060965 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7093e11-c53f-432c-8af6-f1f90c2c4889" containerName="util" Jun 15 04:34:45.061160 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:45.060979 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7093e11-c53f-432c-8af6-f1f90c2c4889" containerName="pull" Jun 15 04:34:45.061160 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:45.060987 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7093e11-c53f-432c-8af6-f1f90c2c4889" containerName="pull" Jun 15 04:34:45.061160 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:45.060998 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7093e11-c53f-432c-8af6-f1f90c2c4889" containerName="extract" Jun 15 04:34:45.061160 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:45.061006 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7093e11-c53f-432c-8af6-f1f90c2c4889" containerName="extract" Jun 15 04:34:45.061160 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:45.061104 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7093e11-c53f-432c-8af6-f1f90c2c4889" containerName="extract" Jun 15 04:34:45.067155 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:45.067135 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahbgw6" Jun 15 04:34:45.069216 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:45.069194 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 15 04:34:45.069356 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:45.069194 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-vpc82\"" Jun 15 04:34:45.069552 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:45.069536 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 15 04:34:45.075218 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:45.075193 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahbgw6"] Jun 15 04:34:45.163024 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:45.162989 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6g9m\" (UniqueName: \"kubernetes.io/projected/1b02de0a-83dc-4683-add4-96553818fa81-kube-api-access-q6g9m\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahbgw6\" (UID: \"1b02de0a-83dc-4683-add4-96553818fa81\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahbgw6" Jun 15 04:34:45.163024 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:45.163030 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1b02de0a-83dc-4683-add4-96553818fa81-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahbgw6\" (UID: \"1b02de0a-83dc-4683-add4-96553818fa81\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahbgw6" Jun 15 04:34:45.163234 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:45.163106 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1b02de0a-83dc-4683-add4-96553818fa81-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahbgw6\" (UID: \"1b02de0a-83dc-4683-add4-96553818fa81\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahbgw6" Jun 15 04:34:45.263895 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:45.263860 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1b02de0a-83dc-4683-add4-96553818fa81-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahbgw6\" (UID: \"1b02de0a-83dc-4683-add4-96553818fa81\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahbgw6" Jun 15 04:34:45.264089 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:45.263941 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6g9m\" (UniqueName: \"kubernetes.io/projected/1b02de0a-83dc-4683-add4-96553818fa81-kube-api-access-q6g9m\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahbgw6\" (UID: \"1b02de0a-83dc-4683-add4-96553818fa81\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahbgw6" Jun 15 04:34:45.264089 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:45.263971 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1b02de0a-83dc-4683-add4-96553818fa81-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahbgw6\" (UID: \"1b02de0a-83dc-4683-add4-96553818fa81\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahbgw6" Jun 15 04:34:45.264266 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:45.264243 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1b02de0a-83dc-4683-add4-96553818fa81-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahbgw6\" (UID: \"1b02de0a-83dc-4683-add4-96553818fa81\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahbgw6" Jun 15 04:34:45.264330 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:45.264305 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1b02de0a-83dc-4683-add4-96553818fa81-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahbgw6\" (UID: \"1b02de0a-83dc-4683-add4-96553818fa81\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahbgw6" Jun 15 04:34:45.273297 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:45.273240 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6g9m\" (UniqueName: \"kubernetes.io/projected/1b02de0a-83dc-4683-add4-96553818fa81-kube-api-access-q6g9m\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahbgw6\" (UID: \"1b02de0a-83dc-4683-add4-96553818fa81\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahbgw6" Jun 15 04:34:45.379657 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:45.379571 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahbgw6" Jun 15 04:34:45.535586 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:45.535557 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahbgw6"] Jun 15 04:34:45.536992 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:34:45.536958 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b02de0a_83dc_4683_add4_96553818fa81.slice/crio-90e6acb92a09061a4c07b3e1dc3d062ee849e367f01b77938a8f623af7fb4e99 WatchSource:0}: Error finding container 90e6acb92a09061a4c07b3e1dc3d062ee849e367f01b77938a8f623af7fb4e99: Status 404 returned error can't find the container with id 90e6acb92a09061a4c07b3e1dc3d062ee849e367f01b77938a8f623af7fb4e99 Jun 15 04:34:46.044986 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:46.044957 2561 generic.go:356] "Generic (PLEG): container finished" podID="1b02de0a-83dc-4683-add4-96553818fa81" containerID="3730ce0578078bba8e95f5306d27c54861133160f8b78c9326c3e8d5c55f7f57" exitCode=0 Jun 15 04:34:46.045169 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:46.044998 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahbgw6" event={"ID":"1b02de0a-83dc-4683-add4-96553818fa81","Type":"ContainerDied","Data":"3730ce0578078bba8e95f5306d27c54861133160f8b78c9326c3e8d5c55f7f57"} Jun 15 04:34:46.045169 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:46.045030 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahbgw6" event={"ID":"1b02de0a-83dc-4683-add4-96553818fa81","Type":"ContainerStarted","Data":"90e6acb92a09061a4c07b3e1dc3d062ee849e367f01b77938a8f623af7fb4e99"} Jun 15 04:34:47.051337 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:47.051254 2561 generic.go:356] "Generic (PLEG): container finished" podID="1b02de0a-83dc-4683-add4-96553818fa81" containerID="42107e07e1894fef9f83c7aa28641e892606c8a22645f8c0792b1934237f23c7" exitCode=0 Jun 15 04:34:47.051755 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:47.051342 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahbgw6" event={"ID":"1b02de0a-83dc-4683-add4-96553818fa81","Type":"ContainerDied","Data":"42107e07e1894fef9f83c7aa28641e892606c8a22645f8c0792b1934237f23c7"} Jun 15 04:34:48.058556 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:48.058521 2561 generic.go:356] "Generic (PLEG): container finished" podID="1b02de0a-83dc-4683-add4-96553818fa81" containerID="21859168891e7e419a901bdb411ae908220d113cd4ee9af946a0f1ee1b941756" exitCode=0 Jun 15 04:34:48.058951 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:48.058603 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahbgw6" event={"ID":"1b02de0a-83dc-4683-add4-96553818fa81","Type":"ContainerDied","Data":"21859168891e7e419a901bdb411ae908220d113cd4ee9af946a0f1ee1b941756"} Jun 15 04:34:49.192414 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:49.192389 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahbgw6" Jun 15 04:34:49.297256 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:49.297216 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q6g9m\" (UniqueName: \"kubernetes.io/projected/1b02de0a-83dc-4683-add4-96553818fa81-kube-api-access-q6g9m\") pod \"1b02de0a-83dc-4683-add4-96553818fa81\" (UID: \"1b02de0a-83dc-4683-add4-96553818fa81\") " Jun 15 04:34:49.297429 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:49.297274 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1b02de0a-83dc-4683-add4-96553818fa81-util\") pod \"1b02de0a-83dc-4683-add4-96553818fa81\" (UID: \"1b02de0a-83dc-4683-add4-96553818fa81\") " Jun 15 04:34:49.297429 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:49.297298 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1b02de0a-83dc-4683-add4-96553818fa81-bundle\") pod \"1b02de0a-83dc-4683-add4-96553818fa81\" (UID: \"1b02de0a-83dc-4683-add4-96553818fa81\") " Jun 15 04:34:49.298521 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:49.298489 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b02de0a-83dc-4683-add4-96553818fa81-bundle" (OuterVolumeSpecName: "bundle") pod "1b02de0a-83dc-4683-add4-96553818fa81" (UID: "1b02de0a-83dc-4683-add4-96553818fa81"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 04:34:49.299350 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:49.299327 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b02de0a-83dc-4683-add4-96553818fa81-kube-api-access-q6g9m" (OuterVolumeSpecName: "kube-api-access-q6g9m") pod "1b02de0a-83dc-4683-add4-96553818fa81" (UID: "1b02de0a-83dc-4683-add4-96553818fa81"). InnerVolumeSpecName "kube-api-access-q6g9m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 04:34:49.304785 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:49.304742 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b02de0a-83dc-4683-add4-96553818fa81-util" (OuterVolumeSpecName: "util") pod "1b02de0a-83dc-4683-add4-96553818fa81" (UID: "1b02de0a-83dc-4683-add4-96553818fa81"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 04:34:49.398688 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:49.398602 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1b02de0a-83dc-4683-add4-96553818fa81-bundle\") on node \"ip-10-0-140-86.ec2.internal\" DevicePath \"\"" Jun 15 04:34:49.398688 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:49.398630 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q6g9m\" (UniqueName: \"kubernetes.io/projected/1b02de0a-83dc-4683-add4-96553818fa81-kube-api-access-q6g9m\") on node \"ip-10-0-140-86.ec2.internal\" DevicePath \"\"" Jun 15 04:34:49.398688 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:49.398641 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1b02de0a-83dc-4683-add4-96553818fa81-util\") on node \"ip-10-0-140-86.ec2.internal\" DevicePath \"\"" Jun 15 04:34:50.070745 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:50.070718 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahbgw6" Jun 15 04:34:50.070895 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:50.070744 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahbgw6" event={"ID":"1b02de0a-83dc-4683-add4-96553818fa81","Type":"ContainerDied","Data":"90e6acb92a09061a4c07b3e1dc3d062ee849e367f01b77938a8f623af7fb4e99"} Jun 15 04:34:50.070895 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:50.070790 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="90e6acb92a09061a4c07b3e1dc3d062ee849e367f01b77938a8f623af7fb4e99" Jun 15 04:34:54.992541 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:54.992506 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kg7k6"] Jun 15 04:34:54.993014 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:54.992999 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b02de0a-83dc-4683-add4-96553818fa81" containerName="util" Jun 15 04:34:54.993065 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:54.993017 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b02de0a-83dc-4683-add4-96553818fa81" containerName="util" Jun 15 04:34:54.993065 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:54.993034 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b02de0a-83dc-4683-add4-96553818fa81" containerName="extract" Jun 15 04:34:54.993065 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:54.993043 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b02de0a-83dc-4683-add4-96553818fa81" containerName="extract" Jun 15 04:34:54.993158 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:54.993079 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b02de0a-83dc-4683-add4-96553818fa81" containerName="pull" Jun 15 04:34:54.993158 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:54.993088 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b02de0a-83dc-4683-add4-96553818fa81" containerName="pull" Jun 15 04:34:54.993217 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:54.993168 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b02de0a-83dc-4683-add4-96553818fa81" containerName="extract" Jun 15 04:34:54.996871 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:54.996854 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kg7k6" Jun 15 04:34:54.998767 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:54.998747 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 15 04:34:54.998877 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:54.998808 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 15 04:34:54.998937 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:54.998906 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 15 04:34:54.998937 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:54.998905 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-2kh88\"" Jun 15 04:34:55.006738 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:55.006715 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kg7k6"] Jun 15 04:34:55.149175 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:55.149139 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f99f60f5-8fe8-448f-b89c-9087959d67b3-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kg7k6\" (UID: \"f99f60f5-8fe8-448f-b89c-9087959d67b3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kg7k6" Jun 15 04:34:55.149370 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:55.149184 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f99f60f5-8fe8-448f-b89c-9087959d67b3-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kg7k6\" (UID: \"f99f60f5-8fe8-448f-b89c-9087959d67b3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kg7k6" Jun 15 04:34:55.149370 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:55.149223 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f99f60f5-8fe8-448f-b89c-9087959d67b3-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kg7k6\" (UID: \"f99f60f5-8fe8-448f-b89c-9087959d67b3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kg7k6" Jun 15 04:34:55.149370 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:55.149256 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f99f60f5-8fe8-448f-b89c-9087959d67b3-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kg7k6\" (UID: \"f99f60f5-8fe8-448f-b89c-9087959d67b3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kg7k6" Jun 15 04:34:55.149370 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:55.149292 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f99f60f5-8fe8-448f-b89c-9087959d67b3-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kg7k6\" (UID: \"f99f60f5-8fe8-448f-b89c-9087959d67b3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kg7k6" Jun 15 04:34:55.149370 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:55.149327 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f99f60f5-8fe8-448f-b89c-9087959d67b3-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kg7k6\" (UID: \"f99f60f5-8fe8-448f-b89c-9087959d67b3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kg7k6" Jun 15 04:34:55.149370 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:55.149358 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pz5wl\" (UniqueName: \"kubernetes.io/projected/f99f60f5-8fe8-448f-b89c-9087959d67b3-kube-api-access-pz5wl\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kg7k6\" (UID: \"f99f60f5-8fe8-448f-b89c-9087959d67b3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kg7k6" Jun 15 04:34:55.149698 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:55.149412 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f99f60f5-8fe8-448f-b89c-9087959d67b3-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kg7k6\" (UID: \"f99f60f5-8fe8-448f-b89c-9087959d67b3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kg7k6" Jun 15 04:34:55.149698 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:55.149460 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f99f60f5-8fe8-448f-b89c-9087959d67b3-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kg7k6\" (UID: \"f99f60f5-8fe8-448f-b89c-9087959d67b3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kg7k6" Jun 15 04:34:55.250711 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:55.250611 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f99f60f5-8fe8-448f-b89c-9087959d67b3-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kg7k6\" (UID: \"f99f60f5-8fe8-448f-b89c-9087959d67b3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kg7k6" Jun 15 04:34:55.250711 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:55.250653 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f99f60f5-8fe8-448f-b89c-9087959d67b3-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kg7k6\" (UID: \"f99f60f5-8fe8-448f-b89c-9087959d67b3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kg7k6" Jun 15 04:34:55.250711 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:55.250681 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f99f60f5-8fe8-448f-b89c-9087959d67b3-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kg7k6\" (UID: \"f99f60f5-8fe8-448f-b89c-9087959d67b3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kg7k6" Jun 15 04:34:55.250984 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:55.250726 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f99f60f5-8fe8-448f-b89c-9087959d67b3-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kg7k6\" (UID: \"f99f60f5-8fe8-448f-b89c-9087959d67b3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kg7k6" Jun 15 04:34:55.250984 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:55.250767 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f99f60f5-8fe8-448f-b89c-9087959d67b3-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kg7k6\" (UID: \"f99f60f5-8fe8-448f-b89c-9087959d67b3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kg7k6" Jun 15 04:34:55.250984 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:55.250798 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f99f60f5-8fe8-448f-b89c-9087959d67b3-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kg7k6\" (UID: \"f99f60f5-8fe8-448f-b89c-9087959d67b3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kg7k6" Jun 15 04:34:55.250984 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:55.250822 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pz5wl\" (UniqueName: \"kubernetes.io/projected/f99f60f5-8fe8-448f-b89c-9087959d67b3-kube-api-access-pz5wl\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kg7k6\" (UID: \"f99f60f5-8fe8-448f-b89c-9087959d67b3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kg7k6" Jun 15 04:34:55.250984 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:55.250854 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f99f60f5-8fe8-448f-b89c-9087959d67b3-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kg7k6\" (UID: \"f99f60f5-8fe8-448f-b89c-9087959d67b3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kg7k6" Jun 15 04:34:55.250984 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:55.250892 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f99f60f5-8fe8-448f-b89c-9087959d67b3-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kg7k6\" (UID: \"f99f60f5-8fe8-448f-b89c-9087959d67b3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kg7k6" Jun 15 04:34:55.251274 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:55.251118 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f99f60f5-8fe8-448f-b89c-9087959d67b3-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kg7k6\" (UID: \"f99f60f5-8fe8-448f-b89c-9087959d67b3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kg7k6" Jun 15 04:34:55.251324 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:55.251265 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f99f60f5-8fe8-448f-b89c-9087959d67b3-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kg7k6\" (UID: \"f99f60f5-8fe8-448f-b89c-9087959d67b3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kg7k6" Jun 15 04:34:55.251379 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:55.251302 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f99f60f5-8fe8-448f-b89c-9087959d67b3-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kg7k6\" (UID: \"f99f60f5-8fe8-448f-b89c-9087959d67b3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kg7k6" Jun 15 04:34:55.251379 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:55.251333 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f99f60f5-8fe8-448f-b89c-9087959d67b3-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kg7k6\" (UID: \"f99f60f5-8fe8-448f-b89c-9087959d67b3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kg7k6" Jun 15 04:34:55.251740 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:55.251716 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f99f60f5-8fe8-448f-b89c-9087959d67b3-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kg7k6\" (UID: \"f99f60f5-8fe8-448f-b89c-9087959d67b3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kg7k6" Jun 15 04:34:55.253188 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:55.253164 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f99f60f5-8fe8-448f-b89c-9087959d67b3-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kg7k6\" (UID: \"f99f60f5-8fe8-448f-b89c-9087959d67b3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kg7k6" Jun 15 04:34:55.253517 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:55.253498 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f99f60f5-8fe8-448f-b89c-9087959d67b3-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kg7k6\" (UID: \"f99f60f5-8fe8-448f-b89c-9087959d67b3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kg7k6" Jun 15 04:34:55.257786 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:55.257766 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f99f60f5-8fe8-448f-b89c-9087959d67b3-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kg7k6\" (UID: \"f99f60f5-8fe8-448f-b89c-9087959d67b3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kg7k6" Jun 15 04:34:55.257970 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:55.257952 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pz5wl\" (UniqueName: \"kubernetes.io/projected/f99f60f5-8fe8-448f-b89c-9087959d67b3-kube-api-access-pz5wl\") pod \"data-science-gateway-data-science-gateway-class-74759f9795kg7k6\" (UID: \"f99f60f5-8fe8-448f-b89c-9087959d67b3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kg7k6" Jun 15 04:34:55.309126 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:55.309087 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kg7k6" Jun 15 04:34:55.444025 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:55.443991 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kg7k6"] Jun 15 04:34:55.445171 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:34:55.445145 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf99f60f5_8fe8_448f_b89c_9087959d67b3.slice/crio-f1f83a30e522ec80902e7ce971ac5418dab45136d92604dd82ff3d3e7d03926a WatchSource:0}: Error finding container f1f83a30e522ec80902e7ce971ac5418dab45136d92604dd82ff3d3e7d03926a: Status 404 returned error can't find the container with id f1f83a30e522ec80902e7ce971ac5418dab45136d92604dd82ff3d3e7d03926a Jun 15 04:34:56.105764 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:56.105725 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kg7k6" event={"ID":"f99f60f5-8fe8-448f-b89c-9087959d67b3","Type":"ContainerStarted","Data":"f1f83a30e522ec80902e7ce971ac5418dab45136d92604dd82ff3d3e7d03926a"} Jun 15 04:34:57.376923 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:57.376883 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-6446c88f59-jgkm8"] Jun 15 04:34:57.382427 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:57.382406 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-6446c88f59-jgkm8" Jun 15 04:34:57.386119 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:57.386094 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-cdcn8\"" Jun 15 04:34:57.386239 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:57.386094 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 15 04:34:57.395553 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:57.391571 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-6446c88f59-jgkm8"] Jun 15 04:34:57.573643 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:57.573601 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9xcb\" (UniqueName: \"kubernetes.io/projected/a6b27c6a-f11f-4b95-8858-fb7653453e17-kube-api-access-t9xcb\") pod \"dashboard-redirect-6446c88f59-jgkm8\" (UID: \"a6b27c6a-f11f-4b95-8858-fb7653453e17\") " pod="opendatahub/dashboard-redirect-6446c88f59-jgkm8" Jun 15 04:34:57.573813 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:57.573654 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/a6b27c6a-f11f-4b95-8858-fb7653453e17-redirect-config\") pod \"dashboard-redirect-6446c88f59-jgkm8\" (UID: \"a6b27c6a-f11f-4b95-8858-fb7653453e17\") " pod="opendatahub/dashboard-redirect-6446c88f59-jgkm8" Jun 15 04:34:57.674514 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:57.674482 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9xcb\" (UniqueName: \"kubernetes.io/projected/a6b27c6a-f11f-4b95-8858-fb7653453e17-kube-api-access-t9xcb\") pod \"dashboard-redirect-6446c88f59-jgkm8\" (UID: \"a6b27c6a-f11f-4b95-8858-fb7653453e17\") " pod="opendatahub/dashboard-redirect-6446c88f59-jgkm8" Jun 15 04:34:57.674684 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:57.674532 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/a6b27c6a-f11f-4b95-8858-fb7653453e17-redirect-config\") pod \"dashboard-redirect-6446c88f59-jgkm8\" (UID: \"a6b27c6a-f11f-4b95-8858-fb7653453e17\") " pod="opendatahub/dashboard-redirect-6446c88f59-jgkm8" Jun 15 04:34:57.675300 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:57.675282 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/a6b27c6a-f11f-4b95-8858-fb7653453e17-redirect-config\") pod \"dashboard-redirect-6446c88f59-jgkm8\" (UID: \"a6b27c6a-f11f-4b95-8858-fb7653453e17\") " pod="opendatahub/dashboard-redirect-6446c88f59-jgkm8" Jun 15 04:34:57.682533 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:57.682504 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9xcb\" (UniqueName: \"kubernetes.io/projected/a6b27c6a-f11f-4b95-8858-fb7653453e17-kube-api-access-t9xcb\") pod \"dashboard-redirect-6446c88f59-jgkm8\" (UID: \"a6b27c6a-f11f-4b95-8858-fb7653453e17\") " pod="opendatahub/dashboard-redirect-6446c88f59-jgkm8" Jun 15 04:34:57.701786 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:57.701764 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-6446c88f59-jgkm8" Jun 15 04:34:57.830921 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:57.830897 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-6446c88f59-jgkm8"] Jun 15 04:34:57.833516 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:34:57.833488 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6b27c6a_f11f_4b95_8858_fb7653453e17.slice/crio-7750f76c9779e51e910038f67c9b0807c4dd987dc105f73ab6e1cee1079c5997 WatchSource:0}: Error finding container 7750f76c9779e51e910038f67c9b0807c4dd987dc105f73ab6e1cee1079c5997: Status 404 returned error can't find the container with id 7750f76c9779e51e910038f67c9b0807c4dd987dc105f73ab6e1cee1079c5997 Jun 15 04:34:58.116927 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:34:58.116844 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-6446c88f59-jgkm8" event={"ID":"a6b27c6a-f11f-4b95-8858-fb7653453e17","Type":"ContainerStarted","Data":"7750f76c9779e51e910038f67c9b0807c4dd987dc105f73ab6e1cee1079c5997"} Jun 15 04:35:01.050479 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:01.050421 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 15 04:35:01.050840 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:01.050532 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 15 04:35:01.050840 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:01.050584 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 15 04:35:02.143065 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:02.143023 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kg7k6" event={"ID":"f99f60f5-8fe8-448f-b89c-9087959d67b3","Type":"ContainerStarted","Data":"f38509d32386b05a76b43f05cbd6c01839b1ccf8048e242efb9b2779a5122019"} Jun 15 04:35:02.144529 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:02.144503 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-6446c88f59-jgkm8" event={"ID":"a6b27c6a-f11f-4b95-8858-fb7653453e17","Type":"ContainerStarted","Data":"fcdde36afab3f9d65ec34868a5013c8057ac3172e35e7125032ad32bac5bdf2b"} Jun 15 04:35:02.168849 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:02.168800 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kg7k6" podStartSLOduration=2.5658121879999998 podStartE2EDuration="8.168784539s" totalImagesPullingTime="5.602972351s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 04:34:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:35:02.16733362 +0000 UTC m=+577.695324541" watchObservedRunningTime="2026-06-15 04:35:02.168784539 +0000 UTC m=+577.696775444" Jun 15 04:35:02.190402 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:02.190347 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-6446c88f59-jgkm8" podStartSLOduration=1.924044677 podStartE2EDuration="5.190328395s" totalImagesPullingTime="3.266283718s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 04:34:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:35:02.188196438 +0000 UTC m=+577.716187367" watchObservedRunningTime="2026-06-15 04:35:02.190328395 +0000 UTC m=+577.718319357" Jun 15 04:35:02.309722 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:02.309677 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kg7k6" Jun 15 04:35:02.314792 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:02.314766 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kg7k6" Jun 15 04:35:03.155642 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:03.155559 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kg7k6" Jun 15 04:35:03.156401 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:03.156383 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795kg7k6" Jun 15 04:35:24.811488 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:24.811460 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8fqkk_f345d023-5952-44c4-800e-69cf4dba39a3/ovn-acl-logging/0.log" Jun 15 04:35:24.811998 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:24.811698 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8fqkk_f345d023-5952-44c4-800e-69cf4dba39a3/ovn-acl-logging/0.log" Jun 15 04:35:28.314950 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:28.314917 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-vgsn9"] Jun 15 04:35:28.318553 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:28.318530 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-vgsn9" Jun 15 04:35:28.320403 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:28.320379 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 15 04:35:28.320858 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:28.320842 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 15 04:35:28.320934 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:28.320885 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-745mj\"" Jun 15 04:35:28.328027 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:28.328003 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-vgsn9"] Jun 15 04:35:28.446206 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:28.446170 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlrtt\" (UniqueName: \"kubernetes.io/projected/cff21a1b-15f6-4d5e-b434-6ee3cd88a5aa-kube-api-access-tlrtt\") pod \"kuadrant-operator-catalog-vgsn9\" (UID: \"cff21a1b-15f6-4d5e-b434-6ee3cd88a5aa\") " pod="kuadrant-system/kuadrant-operator-catalog-vgsn9" Jun 15 04:35:28.547490 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:28.547431 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlrtt\" (UniqueName: \"kubernetes.io/projected/cff21a1b-15f6-4d5e-b434-6ee3cd88a5aa-kube-api-access-tlrtt\") pod \"kuadrant-operator-catalog-vgsn9\" (UID: \"cff21a1b-15f6-4d5e-b434-6ee3cd88a5aa\") " pod="kuadrant-system/kuadrant-operator-catalog-vgsn9" Jun 15 04:35:28.555067 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:28.555033 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlrtt\" (UniqueName: \"kubernetes.io/projected/cff21a1b-15f6-4d5e-b434-6ee3cd88a5aa-kube-api-access-tlrtt\") pod \"kuadrant-operator-catalog-vgsn9\" (UID: \"cff21a1b-15f6-4d5e-b434-6ee3cd88a5aa\") " pod="kuadrant-system/kuadrant-operator-catalog-vgsn9" Jun 15 04:35:28.629818 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:28.629742 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-vgsn9" Jun 15 04:35:28.678530 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:28.678496 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-vgsn9"] Jun 15 04:35:28.758384 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:28.758360 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-vgsn9"] Jun 15 04:35:28.760316 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:35:28.760287 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcff21a1b_15f6_4d5e_b434_6ee3cd88a5aa.slice/crio-19663b7f5a99918683d996b63ba1647c31649a4fc7343837ff0622319e16b3b9 WatchSource:0}: Error finding container 19663b7f5a99918683d996b63ba1647c31649a4fc7343837ff0622319e16b3b9: Status 404 returned error can't find the container with id 19663b7f5a99918683d996b63ba1647c31649a4fc7343837ff0622319e16b3b9 Jun 15 04:35:28.887288 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:28.887211 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gg6vb"] Jun 15 04:35:28.891818 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:28.891801 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-gg6vb" Jun 15 04:35:28.896321 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:28.896297 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gg6vb"] Jun 15 04:35:28.951313 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:28.950686 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkbqb\" (UniqueName: \"kubernetes.io/projected/c8697429-bfd9-4f0f-8bf4-04750ab2142f-kube-api-access-bkbqb\") pod \"kuadrant-operator-catalog-gg6vb\" (UID: \"c8697429-bfd9-4f0f-8bf4-04750ab2142f\") " pod="kuadrant-system/kuadrant-operator-catalog-gg6vb" Jun 15 04:35:29.052126 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:29.052090 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkbqb\" (UniqueName: \"kubernetes.io/projected/c8697429-bfd9-4f0f-8bf4-04750ab2142f-kube-api-access-bkbqb\") pod \"kuadrant-operator-catalog-gg6vb\" (UID: \"c8697429-bfd9-4f0f-8bf4-04750ab2142f\") " pod="kuadrant-system/kuadrant-operator-catalog-gg6vb" Jun 15 04:35:29.059886 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:29.059851 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkbqb\" (UniqueName: \"kubernetes.io/projected/c8697429-bfd9-4f0f-8bf4-04750ab2142f-kube-api-access-bkbqb\") pod \"kuadrant-operator-catalog-gg6vb\" (UID: \"c8697429-bfd9-4f0f-8bf4-04750ab2142f\") " pod="kuadrant-system/kuadrant-operator-catalog-gg6vb" Jun 15 04:35:29.202617 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:29.202580 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-gg6vb" Jun 15 04:35:29.288514 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:29.288477 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-vgsn9" event={"ID":"cff21a1b-15f6-4d5e-b434-6ee3cd88a5aa","Type":"ContainerStarted","Data":"19663b7f5a99918683d996b63ba1647c31649a4fc7343837ff0622319e16b3b9"} Jun 15 04:35:29.336558 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:29.336531 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gg6vb"] Jun 15 04:35:29.338194 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:35:29.338169 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8697429_bfd9_4f0f_8bf4_04750ab2142f.slice/crio-c9dc1d61bff43cf544089c7faed12b26d65696d730a1cb4a96b26dc806b7ec9c WatchSource:0}: Error finding container c9dc1d61bff43cf544089c7faed12b26d65696d730a1cb4a96b26dc806b7ec9c: Status 404 returned error can't find the container with id c9dc1d61bff43cf544089c7faed12b26d65696d730a1cb4a96b26dc806b7ec9c Jun 15 04:35:30.297507 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:30.297470 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-gg6vb" event={"ID":"c8697429-bfd9-4f0f-8bf4-04750ab2142f","Type":"ContainerStarted","Data":"c9dc1d61bff43cf544089c7faed12b26d65696d730a1cb4a96b26dc806b7ec9c"} Jun 15 04:35:31.304632 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:31.304531 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-vgsn9" event={"ID":"cff21a1b-15f6-4d5e-b434-6ee3cd88a5aa","Type":"ContainerStarted","Data":"6c9710925c2d801821f0360fd0c2f06f2e5135c39e3f610d3273797def089bf2"} Jun 15 04:35:31.304632 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:31.304592 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-vgsn9" podUID="cff21a1b-15f6-4d5e-b434-6ee3cd88a5aa" containerName="registry-server" containerID="cri-o://6c9710925c2d801821f0360fd0c2f06f2e5135c39e3f610d3273797def089bf2" gracePeriod=2 Jun 15 04:35:31.306239 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:31.306214 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-gg6vb" event={"ID":"c8697429-bfd9-4f0f-8bf4-04750ab2142f","Type":"ContainerStarted","Data":"cf52891cf4f34c117c3b13ed23076dece11fc0929befbdefc6d9cd906809cad2"} Jun 15 04:35:31.321353 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:31.321309 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-vgsn9" podStartSLOduration=1.131398741 podStartE2EDuration="3.321294605s" totalImagesPullingTime="2.189895864s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 04:35:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:35:31.318401546 +0000 UTC m=+606.846392452" watchObservedRunningTime="2026-06-15 04:35:31.321294605 +0000 UTC m=+606.849285573" Jun 15 04:35:31.332650 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:31.332594 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-gg6vb" podStartSLOduration=1.717689121 podStartE2EDuration="3.332580858s" totalImagesPullingTime="1.614891737s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 04:35:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:35:31.331423092 +0000 UTC m=+606.859413998" watchObservedRunningTime="2026-06-15 04:35:31.332580858 +0000 UTC m=+606.860571762" Jun 15 04:35:31.626078 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:31.626046 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-vgsn9" Jun 15 04:35:31.778794 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:31.778756 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tlrtt\" (UniqueName: \"kubernetes.io/projected/cff21a1b-15f6-4d5e-b434-6ee3cd88a5aa-kube-api-access-tlrtt\") pod \"cff21a1b-15f6-4d5e-b434-6ee3cd88a5aa\" (UID: \"cff21a1b-15f6-4d5e-b434-6ee3cd88a5aa\") " Jun 15 04:35:31.781010 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:31.780985 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cff21a1b-15f6-4d5e-b434-6ee3cd88a5aa-kube-api-access-tlrtt" (OuterVolumeSpecName: "kube-api-access-tlrtt") pod "cff21a1b-15f6-4d5e-b434-6ee3cd88a5aa" (UID: "cff21a1b-15f6-4d5e-b434-6ee3cd88a5aa"). InnerVolumeSpecName "kube-api-access-tlrtt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 04:35:31.879672 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:31.879582 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tlrtt\" (UniqueName: \"kubernetes.io/projected/cff21a1b-15f6-4d5e-b434-6ee3cd88a5aa-kube-api-access-tlrtt\") on node \"ip-10-0-140-86.ec2.internal\" DevicePath \"\"" Jun 15 04:35:32.312997 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:32.312959 2561 generic.go:356] "Generic (PLEG): container finished" podID="cff21a1b-15f6-4d5e-b434-6ee3cd88a5aa" containerID="6c9710925c2d801821f0360fd0c2f06f2e5135c39e3f610d3273797def089bf2" exitCode=0 Jun 15 04:35:32.313490 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:32.313005 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-vgsn9" Jun 15 04:35:32.313490 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:32.313048 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-vgsn9" event={"ID":"cff21a1b-15f6-4d5e-b434-6ee3cd88a5aa","Type":"ContainerDied","Data":"6c9710925c2d801821f0360fd0c2f06f2e5135c39e3f610d3273797def089bf2"} Jun 15 04:35:32.313490 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:32.313104 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-vgsn9" event={"ID":"cff21a1b-15f6-4d5e-b434-6ee3cd88a5aa","Type":"ContainerDied","Data":"19663b7f5a99918683d996b63ba1647c31649a4fc7343837ff0622319e16b3b9"} Jun 15 04:35:32.313490 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:32.313129 2561 scope.go:117] "RemoveContainer" containerID="6c9710925c2d801821f0360fd0c2f06f2e5135c39e3f610d3273797def089bf2" Jun 15 04:35:32.322356 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:32.322327 2561 scope.go:117] "RemoveContainer" containerID="6c9710925c2d801821f0360fd0c2f06f2e5135c39e3f610d3273797def089bf2" Jun 15 04:35:32.322598 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:35:32.322580 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c9710925c2d801821f0360fd0c2f06f2e5135c39e3f610d3273797def089bf2\": container with ID starting with 6c9710925c2d801821f0360fd0c2f06f2e5135c39e3f610d3273797def089bf2 not found: ID does not exist" containerID="6c9710925c2d801821f0360fd0c2f06f2e5135c39e3f610d3273797def089bf2" Jun 15 04:35:32.322645 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:32.322609 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c9710925c2d801821f0360fd0c2f06f2e5135c39e3f610d3273797def089bf2"} err="failed to get container status \"6c9710925c2d801821f0360fd0c2f06f2e5135c39e3f610d3273797def089bf2\": rpc error: code = NotFound desc = could not find container \"6c9710925c2d801821f0360fd0c2f06f2e5135c39e3f610d3273797def089bf2\": container with ID starting with 6c9710925c2d801821f0360fd0c2f06f2e5135c39e3f610d3273797def089bf2 not found: ID does not exist" Jun 15 04:35:32.332956 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:32.332935 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-vgsn9"] Jun 15 04:35:32.336453 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:32.336417 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-vgsn9"] Jun 15 04:35:32.826339 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:32.826304 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cff21a1b-15f6-4d5e-b434-6ee3cd88a5aa" path="/var/lib/kubelet/pods/cff21a1b-15f6-4d5e-b434-6ee3cd88a5aa/volumes" Jun 15 04:35:39.203380 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:39.203339 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-gg6vb" Jun 15 04:35:39.203970 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:39.203409 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-gg6vb" Jun 15 04:35:39.225837 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:39.225807 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-gg6vb" Jun 15 04:35:39.373508 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:39.373482 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-gg6vb" Jun 15 04:35:43.719664 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:43.719631 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sr6lt"] Jun 15 04:35:43.720050 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:43.719990 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cff21a1b-15f6-4d5e-b434-6ee3cd88a5aa" containerName="registry-server" Jun 15 04:35:43.720050 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:43.720001 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="cff21a1b-15f6-4d5e-b434-6ee3cd88a5aa" containerName="registry-server" Jun 15 04:35:43.720140 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:43.720058 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="cff21a1b-15f6-4d5e-b434-6ee3cd88a5aa" containerName="registry-server" Jun 15 04:35:43.723377 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:43.723361 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sr6lt" Jun 15 04:35:43.725299 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:43.725278 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-rdghc\"" Jun 15 04:35:43.733872 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:43.733848 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sr6lt"] Jun 15 04:35:43.883664 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:43.883632 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7849488-4e16-4cf8-aae9-3d160ea558a2-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sr6lt\" (UID: \"c7849488-4e16-4cf8-aae9-3d160ea558a2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sr6lt" Jun 15 04:35:43.883664 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:43.883667 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7849488-4e16-4cf8-aae9-3d160ea558a2-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sr6lt\" (UID: \"c7849488-4e16-4cf8-aae9-3d160ea558a2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sr6lt" Jun 15 04:35:43.883844 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:43.883704 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7nsz\" (UniqueName: \"kubernetes.io/projected/c7849488-4e16-4cf8-aae9-3d160ea558a2-kube-api-access-t7nsz\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sr6lt\" (UID: \"c7849488-4e16-4cf8-aae9-3d160ea558a2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sr6lt" Jun 15 04:35:43.985015 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:43.984940 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7849488-4e16-4cf8-aae9-3d160ea558a2-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sr6lt\" (UID: \"c7849488-4e16-4cf8-aae9-3d160ea558a2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sr6lt" Jun 15 04:35:43.985015 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:43.984979 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7849488-4e16-4cf8-aae9-3d160ea558a2-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sr6lt\" (UID: \"c7849488-4e16-4cf8-aae9-3d160ea558a2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sr6lt" Jun 15 04:35:43.985245 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:43.985033 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7nsz\" (UniqueName: \"kubernetes.io/projected/c7849488-4e16-4cf8-aae9-3d160ea558a2-kube-api-access-t7nsz\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sr6lt\" (UID: \"c7849488-4e16-4cf8-aae9-3d160ea558a2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sr6lt" Jun 15 04:35:43.985362 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:43.985344 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7849488-4e16-4cf8-aae9-3d160ea558a2-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sr6lt\" (UID: \"c7849488-4e16-4cf8-aae9-3d160ea558a2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sr6lt" Jun 15 04:35:43.985404 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:43.985363 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7849488-4e16-4cf8-aae9-3d160ea558a2-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sr6lt\" (UID: \"c7849488-4e16-4cf8-aae9-3d160ea558a2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sr6lt" Jun 15 04:35:43.992091 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:43.992070 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7nsz\" (UniqueName: \"kubernetes.io/projected/c7849488-4e16-4cf8-aae9-3d160ea558a2-kube-api-access-t7nsz\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sr6lt\" (UID: \"c7849488-4e16-4cf8-aae9-3d160ea558a2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sr6lt" Jun 15 04:35:44.032539 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:44.032518 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sr6lt" Jun 15 04:35:44.163514 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:44.163491 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sr6lt"] Jun 15 04:35:44.165000 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:35:44.164973 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7849488_4e16_4cf8_aae9_3d160ea558a2.slice/crio-995aa5dd1f514f1980aac22e2b072bd1178d55d4c7d66f9230462bac3dcebaaa WatchSource:0}: Error finding container 995aa5dd1f514f1980aac22e2b072bd1178d55d4c7d66f9230462bac3dcebaaa: Status 404 returned error can't find the container with id 995aa5dd1f514f1980aac22e2b072bd1178d55d4c7d66f9230462bac3dcebaaa Jun 15 04:35:44.318856 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:44.318819 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kmdgj"] Jun 15 04:35:44.322546 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:44.322527 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kmdgj" Jun 15 04:35:44.328316 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:44.328293 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kmdgj"] Jun 15 04:35:44.379290 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:44.379258 2561 generic.go:356] "Generic (PLEG): container finished" podID="c7849488-4e16-4cf8-aae9-3d160ea558a2" containerID="c3eb27e0e0a5dff511d99d01c0e3f68d4fd4de6cbadd80a3ee8ad4ebc6d528c9" exitCode=0 Jun 15 04:35:44.379476 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:44.379313 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sr6lt" event={"ID":"c7849488-4e16-4cf8-aae9-3d160ea558a2","Type":"ContainerDied","Data":"c3eb27e0e0a5dff511d99d01c0e3f68d4fd4de6cbadd80a3ee8ad4ebc6d528c9"} Jun 15 04:35:44.379476 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:44.379365 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sr6lt" event={"ID":"c7849488-4e16-4cf8-aae9-3d160ea558a2","Type":"ContainerStarted","Data":"995aa5dd1f514f1980aac22e2b072bd1178d55d4c7d66f9230462bac3dcebaaa"} Jun 15 04:35:44.490010 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:44.489971 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ctwv\" (UniqueName: \"kubernetes.io/projected/a9392e3e-6b09-458d-9577-ca7e955b80e2-kube-api-access-6ctwv\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kmdgj\" (UID: \"a9392e3e-6b09-458d-9577-ca7e955b80e2\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kmdgj" Jun 15 04:35:44.490176 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:44.490038 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a9392e3e-6b09-458d-9577-ca7e955b80e2-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kmdgj\" (UID: \"a9392e3e-6b09-458d-9577-ca7e955b80e2\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kmdgj" Jun 15 04:35:44.490176 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:44.490086 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a9392e3e-6b09-458d-9577-ca7e955b80e2-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kmdgj\" (UID: \"a9392e3e-6b09-458d-9577-ca7e955b80e2\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kmdgj" Jun 15 04:35:44.590698 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:44.590606 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ctwv\" (UniqueName: \"kubernetes.io/projected/a9392e3e-6b09-458d-9577-ca7e955b80e2-kube-api-access-6ctwv\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kmdgj\" (UID: \"a9392e3e-6b09-458d-9577-ca7e955b80e2\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kmdgj" Jun 15 04:35:44.590866 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:44.590703 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a9392e3e-6b09-458d-9577-ca7e955b80e2-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kmdgj\" (UID: \"a9392e3e-6b09-458d-9577-ca7e955b80e2\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kmdgj" Jun 15 04:35:44.590866 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:44.590759 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a9392e3e-6b09-458d-9577-ca7e955b80e2-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kmdgj\" (UID: \"a9392e3e-6b09-458d-9577-ca7e955b80e2\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kmdgj" Jun 15 04:35:44.591068 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:44.591042 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a9392e3e-6b09-458d-9577-ca7e955b80e2-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kmdgj\" (UID: \"a9392e3e-6b09-458d-9577-ca7e955b80e2\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kmdgj" Jun 15 04:35:44.591134 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:44.591092 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a9392e3e-6b09-458d-9577-ca7e955b80e2-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kmdgj\" (UID: \"a9392e3e-6b09-458d-9577-ca7e955b80e2\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kmdgj" Jun 15 04:35:44.598289 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:44.598267 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ctwv\" (UniqueName: \"kubernetes.io/projected/a9392e3e-6b09-458d-9577-ca7e955b80e2-kube-api-access-6ctwv\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kmdgj\" (UID: \"a9392e3e-6b09-458d-9577-ca7e955b80e2\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kmdgj" Jun 15 04:35:44.633130 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:44.633109 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kmdgj" Jun 15 04:35:44.721655 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:44.721613 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l2nwq"] Jun 15 04:35:44.727000 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:44.726979 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l2nwq" Jun 15 04:35:44.730633 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:44.730580 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l2nwq"] Jun 15 04:35:44.775647 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:44.775622 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kmdgj"] Jun 15 04:35:44.777053 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:35:44.777024 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9392e3e_6b09_458d_9577_ca7e955b80e2.slice/crio-c6265075a89150d07112e4f5d743254932977c02d53c60d5852189337a7f574a WatchSource:0}: Error finding container c6265075a89150d07112e4f5d743254932977c02d53c60d5852189337a7f574a: Status 404 returned error can't find the container with id c6265075a89150d07112e4f5d743254932977c02d53c60d5852189337a7f574a Jun 15 04:35:44.792190 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:44.792169 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8bceeda4-fed8-4766-9b7e-69edaa7a5b15-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l2nwq\" (UID: \"8bceeda4-fed8-4766-9b7e-69edaa7a5b15\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l2nwq" Jun 15 04:35:44.792244 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:44.792201 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4l8f\" (UniqueName: \"kubernetes.io/projected/8bceeda4-fed8-4766-9b7e-69edaa7a5b15-kube-api-access-m4l8f\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l2nwq\" (UID: \"8bceeda4-fed8-4766-9b7e-69edaa7a5b15\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l2nwq" Jun 15 04:35:44.792302 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:44.792283 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8bceeda4-fed8-4766-9b7e-69edaa7a5b15-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l2nwq\" (UID: \"8bceeda4-fed8-4766-9b7e-69edaa7a5b15\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l2nwq" Jun 15 04:35:44.893163 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:44.893134 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8bceeda4-fed8-4766-9b7e-69edaa7a5b15-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l2nwq\" (UID: \"8bceeda4-fed8-4766-9b7e-69edaa7a5b15\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l2nwq" Jun 15 04:35:44.893272 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:44.893207 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8bceeda4-fed8-4766-9b7e-69edaa7a5b15-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l2nwq\" (UID: \"8bceeda4-fed8-4766-9b7e-69edaa7a5b15\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l2nwq" Jun 15 04:35:44.893272 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:44.893227 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4l8f\" (UniqueName: \"kubernetes.io/projected/8bceeda4-fed8-4766-9b7e-69edaa7a5b15-kube-api-access-m4l8f\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l2nwq\" (UID: \"8bceeda4-fed8-4766-9b7e-69edaa7a5b15\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l2nwq" Jun 15 04:35:44.893591 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:44.893565 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8bceeda4-fed8-4766-9b7e-69edaa7a5b15-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l2nwq\" (UID: \"8bceeda4-fed8-4766-9b7e-69edaa7a5b15\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l2nwq" Jun 15 04:35:44.893634 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:44.893599 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8bceeda4-fed8-4766-9b7e-69edaa7a5b15-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l2nwq\" (UID: \"8bceeda4-fed8-4766-9b7e-69edaa7a5b15\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l2nwq" Jun 15 04:35:44.900104 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:44.900081 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4l8f\" (UniqueName: \"kubernetes.io/projected/8bceeda4-fed8-4766-9b7e-69edaa7a5b15-kube-api-access-m4l8f\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l2nwq\" (UID: \"8bceeda4-fed8-4766-9b7e-69edaa7a5b15\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l2nwq" Jun 15 04:35:45.040186 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:45.040157 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l2nwq" Jun 15 04:35:45.180431 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:45.180401 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l2nwq"] Jun 15 04:35:45.211460 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:35:45.211412 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bceeda4_fed8_4766_9b7e_69edaa7a5b15.slice/crio-8e64a795c7ce0ac21f5b1edf8f48715baa36ff720a67b1348c0ad038eb25a107 WatchSource:0}: Error finding container 8e64a795c7ce0ac21f5b1edf8f48715baa36ff720a67b1348c0ad038eb25a107: Status 404 returned error can't find the container with id 8e64a795c7ce0ac21f5b1edf8f48715baa36ff720a67b1348c0ad038eb25a107 Jun 15 04:35:45.319093 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:45.319061 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xmstj"] Jun 15 04:35:45.322763 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:45.322747 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xmstj" Jun 15 04:35:45.329110 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:45.329085 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xmstj"] Jun 15 04:35:45.386715 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:45.386644 2561 generic.go:356] "Generic (PLEG): container finished" podID="8bceeda4-fed8-4766-9b7e-69edaa7a5b15" containerID="8c0c0e7eb936830ad67bf99e7ae08e0c1d6cb98bf7f020c79be6172e51d3975b" exitCode=0 Jun 15 04:35:45.386854 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:45.386707 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l2nwq" event={"ID":"8bceeda4-fed8-4766-9b7e-69edaa7a5b15","Type":"ContainerDied","Data":"8c0c0e7eb936830ad67bf99e7ae08e0c1d6cb98bf7f020c79be6172e51d3975b"} Jun 15 04:35:45.386854 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:45.386761 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l2nwq" event={"ID":"8bceeda4-fed8-4766-9b7e-69edaa7a5b15","Type":"ContainerStarted","Data":"8e64a795c7ce0ac21f5b1edf8f48715baa36ff720a67b1348c0ad038eb25a107"} Jun 15 04:35:45.388696 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:45.388658 2561 generic.go:356] "Generic (PLEG): container finished" podID="c7849488-4e16-4cf8-aae9-3d160ea558a2" containerID="a8f6d5a945a967bc87acea158dbdb6be6f88cbd3b09157502f16559936e08aad" exitCode=0 Jun 15 04:35:45.388804 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:45.388727 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sr6lt" event={"ID":"c7849488-4e16-4cf8-aae9-3d160ea558a2","Type":"ContainerDied","Data":"a8f6d5a945a967bc87acea158dbdb6be6f88cbd3b09157502f16559936e08aad"} Jun 15 04:35:45.390458 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:45.390411 2561 generic.go:356] "Generic (PLEG): container finished" podID="a9392e3e-6b09-458d-9577-ca7e955b80e2" containerID="1fe30e1969c2bdfe8caabf5fbe3fcac93fd8f06c779794f6469fa8a6077f7cfe" exitCode=0 Jun 15 04:35:45.390540 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:45.390482 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kmdgj" event={"ID":"a9392e3e-6b09-458d-9577-ca7e955b80e2","Type":"ContainerDied","Data":"1fe30e1969c2bdfe8caabf5fbe3fcac93fd8f06c779794f6469fa8a6077f7cfe"} Jun 15 04:35:45.390540 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:45.390532 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kmdgj" event={"ID":"a9392e3e-6b09-458d-9577-ca7e955b80e2","Type":"ContainerStarted","Data":"c6265075a89150d07112e4f5d743254932977c02d53c60d5852189337a7f574a"} Jun 15 04:35:45.397526 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:45.397503 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzxnt\" (UniqueName: \"kubernetes.io/projected/5965e6e4-2adb-47a8-930c-cbd4a52d9d9d-kube-api-access-kzxnt\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xmstj\" (UID: \"5965e6e4-2adb-47a8-930c-cbd4a52d9d9d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xmstj" Jun 15 04:35:45.397600 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:45.397544 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5965e6e4-2adb-47a8-930c-cbd4a52d9d9d-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xmstj\" (UID: \"5965e6e4-2adb-47a8-930c-cbd4a52d9d9d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xmstj" Jun 15 04:35:45.397669 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:45.397648 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5965e6e4-2adb-47a8-930c-cbd4a52d9d9d-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xmstj\" (UID: \"5965e6e4-2adb-47a8-930c-cbd4a52d9d9d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xmstj" Jun 15 04:35:45.498326 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:45.498291 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzxnt\" (UniqueName: \"kubernetes.io/projected/5965e6e4-2adb-47a8-930c-cbd4a52d9d9d-kube-api-access-kzxnt\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xmstj\" (UID: \"5965e6e4-2adb-47a8-930c-cbd4a52d9d9d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xmstj" Jun 15 04:35:45.498326 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:45.498334 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5965e6e4-2adb-47a8-930c-cbd4a52d9d9d-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xmstj\" (UID: \"5965e6e4-2adb-47a8-930c-cbd4a52d9d9d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xmstj" Jun 15 04:35:45.498608 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:45.498394 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5965e6e4-2adb-47a8-930c-cbd4a52d9d9d-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xmstj\" (UID: \"5965e6e4-2adb-47a8-930c-cbd4a52d9d9d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xmstj" Jun 15 04:35:45.498783 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:45.498763 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5965e6e4-2adb-47a8-930c-cbd4a52d9d9d-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xmstj\" (UID: \"5965e6e4-2adb-47a8-930c-cbd4a52d9d9d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xmstj" Jun 15 04:35:45.498839 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:45.498793 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5965e6e4-2adb-47a8-930c-cbd4a52d9d9d-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xmstj\" (UID: \"5965e6e4-2adb-47a8-930c-cbd4a52d9d9d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xmstj" Jun 15 04:35:45.507494 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:45.507471 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzxnt\" (UniqueName: \"kubernetes.io/projected/5965e6e4-2adb-47a8-930c-cbd4a52d9d9d-kube-api-access-kzxnt\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xmstj\" (UID: \"5965e6e4-2adb-47a8-930c-cbd4a52d9d9d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xmstj" Jun 15 04:35:45.659235 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:45.659209 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xmstj" Jun 15 04:35:45.794148 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:45.794123 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xmstj"] Jun 15 04:35:45.795865 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:35:45.795840 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5965e6e4_2adb_47a8_930c_cbd4a52d9d9d.slice/crio-8a0ffb6fd3f22ccba5000e01d09b1627bbba620e827aab9983b5c2e6adffc22a WatchSource:0}: Error finding container 8a0ffb6fd3f22ccba5000e01d09b1627bbba620e827aab9983b5c2e6adffc22a: Status 404 returned error can't find the container with id 8a0ffb6fd3f22ccba5000e01d09b1627bbba620e827aab9983b5c2e6adffc22a Jun 15 04:35:46.400305 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:46.400277 2561 generic.go:356] "Generic (PLEG): container finished" podID="5965e6e4-2adb-47a8-930c-cbd4a52d9d9d" containerID="fabc9598977ac097079221aa3d2726ddd5634bc5b7760930537b353a318dd8a3" exitCode=0 Jun 15 04:35:46.400400 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:46.400363 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xmstj" event={"ID":"5965e6e4-2adb-47a8-930c-cbd4a52d9d9d","Type":"ContainerDied","Data":"fabc9598977ac097079221aa3d2726ddd5634bc5b7760930537b353a318dd8a3"} Jun 15 04:35:46.400478 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:46.400416 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xmstj" event={"ID":"5965e6e4-2adb-47a8-930c-cbd4a52d9d9d","Type":"ContainerStarted","Data":"8a0ffb6fd3f22ccba5000e01d09b1627bbba620e827aab9983b5c2e6adffc22a"} Jun 15 04:35:46.403514 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:46.403327 2561 generic.go:356] "Generic (PLEG): container finished" podID="c7849488-4e16-4cf8-aae9-3d160ea558a2" containerID="ffea817dd271b69893433ea22bb1c8fbf278dec4ad17f7fa1e0f520042782223" exitCode=0 Jun 15 04:35:46.403514 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:46.403461 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sr6lt" event={"ID":"c7849488-4e16-4cf8-aae9-3d160ea558a2","Type":"ContainerDied","Data":"ffea817dd271b69893433ea22bb1c8fbf278dec4ad17f7fa1e0f520042782223"} Jun 15 04:35:47.411505 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:47.411474 2561 generic.go:356] "Generic (PLEG): container finished" podID="8bceeda4-fed8-4766-9b7e-69edaa7a5b15" containerID="aa082bb254a00ec846ffe3fb89cb396790542e03985b75e8954bd7dd488b23d5" exitCode=0 Jun 15 04:35:47.411930 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:47.411601 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l2nwq" event={"ID":"8bceeda4-fed8-4766-9b7e-69edaa7a5b15","Type":"ContainerDied","Data":"aa082bb254a00ec846ffe3fb89cb396790542e03985b75e8954bd7dd488b23d5"} Jun 15 04:35:47.413539 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:47.413518 2561 generic.go:356] "Generic (PLEG): container finished" podID="a9392e3e-6b09-458d-9577-ca7e955b80e2" containerID="a5e30cc1411ba8616f7359760f74c548a87e15304d2ac4fa8cd67c85f6a98984" exitCode=0 Jun 15 04:35:47.413653 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:47.413554 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kmdgj" event={"ID":"a9392e3e-6b09-458d-9577-ca7e955b80e2","Type":"ContainerDied","Data":"a5e30cc1411ba8616f7359760f74c548a87e15304d2ac4fa8cd67c85f6a98984"} Jun 15 04:35:47.415532 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:47.415510 2561 generic.go:356] "Generic (PLEG): container finished" podID="5965e6e4-2adb-47a8-930c-cbd4a52d9d9d" containerID="38ad566d132aedc0b44f6e954f66fcfe1a57c2ce8de83d55f997800f1e088685" exitCode=0 Jun 15 04:35:47.415611 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:47.415544 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xmstj" event={"ID":"5965e6e4-2adb-47a8-930c-cbd4a52d9d9d","Type":"ContainerDied","Data":"38ad566d132aedc0b44f6e954f66fcfe1a57c2ce8de83d55f997800f1e088685"} Jun 15 04:35:47.565864 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:47.565833 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sr6lt" Jun 15 04:35:47.616641 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:47.616611 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7849488-4e16-4cf8-aae9-3d160ea558a2-bundle\") pod \"c7849488-4e16-4cf8-aae9-3d160ea558a2\" (UID: \"c7849488-4e16-4cf8-aae9-3d160ea558a2\") " Jun 15 04:35:47.616804 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:47.616671 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t7nsz\" (UniqueName: \"kubernetes.io/projected/c7849488-4e16-4cf8-aae9-3d160ea558a2-kube-api-access-t7nsz\") pod \"c7849488-4e16-4cf8-aae9-3d160ea558a2\" (UID: \"c7849488-4e16-4cf8-aae9-3d160ea558a2\") " Jun 15 04:35:47.616804 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:47.616700 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7849488-4e16-4cf8-aae9-3d160ea558a2-util\") pod \"c7849488-4e16-4cf8-aae9-3d160ea558a2\" (UID: \"c7849488-4e16-4cf8-aae9-3d160ea558a2\") " Jun 15 04:35:47.617253 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:47.617222 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7849488-4e16-4cf8-aae9-3d160ea558a2-bundle" (OuterVolumeSpecName: "bundle") pod "c7849488-4e16-4cf8-aae9-3d160ea558a2" (UID: "c7849488-4e16-4cf8-aae9-3d160ea558a2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 04:35:47.618726 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:47.618702 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7849488-4e16-4cf8-aae9-3d160ea558a2-kube-api-access-t7nsz" (OuterVolumeSpecName: "kube-api-access-t7nsz") pod "c7849488-4e16-4cf8-aae9-3d160ea558a2" (UID: "c7849488-4e16-4cf8-aae9-3d160ea558a2"). InnerVolumeSpecName "kube-api-access-t7nsz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 04:35:47.622709 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:47.622685 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7849488-4e16-4cf8-aae9-3d160ea558a2-util" (OuterVolumeSpecName: "util") pod "c7849488-4e16-4cf8-aae9-3d160ea558a2" (UID: "c7849488-4e16-4cf8-aae9-3d160ea558a2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 04:35:47.717426 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:47.717393 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7849488-4e16-4cf8-aae9-3d160ea558a2-bundle\") on node \"ip-10-0-140-86.ec2.internal\" DevicePath \"\"" Jun 15 04:35:47.717426 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:47.717419 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t7nsz\" (UniqueName: \"kubernetes.io/projected/c7849488-4e16-4cf8-aae9-3d160ea558a2-kube-api-access-t7nsz\") on node \"ip-10-0-140-86.ec2.internal\" DevicePath \"\"" Jun 15 04:35:47.717426 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:47.717430 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7849488-4e16-4cf8-aae9-3d160ea558a2-util\") on node \"ip-10-0-140-86.ec2.internal\" DevicePath \"\"" Jun 15 04:35:48.423049 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:48.423014 2561 generic.go:356] "Generic (PLEG): container finished" podID="5965e6e4-2adb-47a8-930c-cbd4a52d9d9d" containerID="065b3dc22a5907094b4d8c8119d82a779ef8a2621d7d70ccded6135e83002dec" exitCode=0 Jun 15 04:35:48.423485 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:48.423082 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xmstj" event={"ID":"5965e6e4-2adb-47a8-930c-cbd4a52d9d9d","Type":"ContainerDied","Data":"065b3dc22a5907094b4d8c8119d82a779ef8a2621d7d70ccded6135e83002dec"} Jun 15 04:35:48.425156 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:48.425134 2561 generic.go:356] "Generic (PLEG): container finished" podID="8bceeda4-fed8-4766-9b7e-69edaa7a5b15" containerID="f60b2278a54e356872db290af9cd218d9b6a4cd83703371b40a3b937da2b7c47" exitCode=0 Jun 15 04:35:48.425267 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:48.425217 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l2nwq" event={"ID":"8bceeda4-fed8-4766-9b7e-69edaa7a5b15","Type":"ContainerDied","Data":"f60b2278a54e356872db290af9cd218d9b6a4cd83703371b40a3b937da2b7c47"} Jun 15 04:35:48.427056 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:48.427041 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sr6lt" Jun 15 04:35:48.427170 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:48.427062 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sr6lt" event={"ID":"c7849488-4e16-4cf8-aae9-3d160ea558a2","Type":"ContainerDied","Data":"995aa5dd1f514f1980aac22e2b072bd1178d55d4c7d66f9230462bac3dcebaaa"} Jun 15 04:35:48.427170 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:48.427094 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="995aa5dd1f514f1980aac22e2b072bd1178d55d4c7d66f9230462bac3dcebaaa" Jun 15 04:35:48.429093 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:48.429070 2561 generic.go:356] "Generic (PLEG): container finished" podID="a9392e3e-6b09-458d-9577-ca7e955b80e2" containerID="4da1a8ee8273beb443353de8bee68e6fb20a58a31890be137991af596fe29845" exitCode=0 Jun 15 04:35:48.429184 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:48.429152 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kmdgj" event={"ID":"a9392e3e-6b09-458d-9577-ca7e955b80e2","Type":"ContainerDied","Data":"4da1a8ee8273beb443353de8bee68e6fb20a58a31890be137991af596fe29845"} Jun 15 04:35:49.578017 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:49.577992 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kmdgj" Jun 15 04:35:49.625392 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:49.625366 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xmstj" Jun 15 04:35:49.628857 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:49.628838 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l2nwq" Jun 15 04:35:49.631808 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:49.631793 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6ctwv\" (UniqueName: \"kubernetes.io/projected/a9392e3e-6b09-458d-9577-ca7e955b80e2-kube-api-access-6ctwv\") pod \"a9392e3e-6b09-458d-9577-ca7e955b80e2\" (UID: \"a9392e3e-6b09-458d-9577-ca7e955b80e2\") " Jun 15 04:35:49.631854 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:49.631820 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a9392e3e-6b09-458d-9577-ca7e955b80e2-bundle\") pod \"a9392e3e-6b09-458d-9577-ca7e955b80e2\" (UID: \"a9392e3e-6b09-458d-9577-ca7e955b80e2\") " Jun 15 04:35:49.631854 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:49.631839 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a9392e3e-6b09-458d-9577-ca7e955b80e2-util\") pod \"a9392e3e-6b09-458d-9577-ca7e955b80e2\" (UID: \"a9392e3e-6b09-458d-9577-ca7e955b80e2\") " Jun 15 04:35:49.631950 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:49.631858 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5965e6e4-2adb-47a8-930c-cbd4a52d9d9d-bundle\") pod \"5965e6e4-2adb-47a8-930c-cbd4a52d9d9d\" (UID: \"5965e6e4-2adb-47a8-930c-cbd4a52d9d9d\") " Jun 15 04:35:49.631950 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:49.631877 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8bceeda4-fed8-4766-9b7e-69edaa7a5b15-bundle\") pod \"8bceeda4-fed8-4766-9b7e-69edaa7a5b15\" (UID: \"8bceeda4-fed8-4766-9b7e-69edaa7a5b15\") " Jun 15 04:35:49.631950 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:49.631894 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kzxnt\" (UniqueName: \"kubernetes.io/projected/5965e6e4-2adb-47a8-930c-cbd4a52d9d9d-kube-api-access-kzxnt\") pod \"5965e6e4-2adb-47a8-930c-cbd4a52d9d9d\" (UID: \"5965e6e4-2adb-47a8-930c-cbd4a52d9d9d\") " Jun 15 04:35:49.631950 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:49.631927 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8bceeda4-fed8-4766-9b7e-69edaa7a5b15-util\") pod \"8bceeda4-fed8-4766-9b7e-69edaa7a5b15\" (UID: \"8bceeda4-fed8-4766-9b7e-69edaa7a5b15\") " Jun 15 04:35:49.632137 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:49.632001 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5965e6e4-2adb-47a8-930c-cbd4a52d9d9d-util\") pod \"5965e6e4-2adb-47a8-930c-cbd4a52d9d9d\" (UID: \"5965e6e4-2adb-47a8-930c-cbd4a52d9d9d\") " Jun 15 04:35:49.632137 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:49.632043 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m4l8f\" (UniqueName: \"kubernetes.io/projected/8bceeda4-fed8-4766-9b7e-69edaa7a5b15-kube-api-access-m4l8f\") pod \"8bceeda4-fed8-4766-9b7e-69edaa7a5b15\" (UID: \"8bceeda4-fed8-4766-9b7e-69edaa7a5b15\") " Jun 15 04:35:49.634199 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:49.632463 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9392e3e-6b09-458d-9577-ca7e955b80e2-bundle" (OuterVolumeSpecName: "bundle") pod "a9392e3e-6b09-458d-9577-ca7e955b80e2" (UID: "a9392e3e-6b09-458d-9577-ca7e955b80e2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 04:35:49.634199 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:49.632586 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5965e6e4-2adb-47a8-930c-cbd4a52d9d9d-bundle" (OuterVolumeSpecName: "bundle") pod "5965e6e4-2adb-47a8-930c-cbd4a52d9d9d" (UID: "5965e6e4-2adb-47a8-930c-cbd4a52d9d9d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 04:35:49.634199 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:49.632924 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8bceeda4-fed8-4766-9b7e-69edaa7a5b15-bundle" (OuterVolumeSpecName: "bundle") pod "8bceeda4-fed8-4766-9b7e-69edaa7a5b15" (UID: "8bceeda4-fed8-4766-9b7e-69edaa7a5b15"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 04:35:49.634199 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:49.634066 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9392e3e-6b09-458d-9577-ca7e955b80e2-kube-api-access-6ctwv" (OuterVolumeSpecName: "kube-api-access-6ctwv") pod "a9392e3e-6b09-458d-9577-ca7e955b80e2" (UID: "a9392e3e-6b09-458d-9577-ca7e955b80e2"). InnerVolumeSpecName "kube-api-access-6ctwv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 04:35:49.634479 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:49.634460 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8bceeda4-fed8-4766-9b7e-69edaa7a5b15-kube-api-access-m4l8f" (OuterVolumeSpecName: "kube-api-access-m4l8f") pod "8bceeda4-fed8-4766-9b7e-69edaa7a5b15" (UID: "8bceeda4-fed8-4766-9b7e-69edaa7a5b15"). InnerVolumeSpecName "kube-api-access-m4l8f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 04:35:49.634626 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:49.634606 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5965e6e4-2adb-47a8-930c-cbd4a52d9d9d-kube-api-access-kzxnt" (OuterVolumeSpecName: "kube-api-access-kzxnt") pod "5965e6e4-2adb-47a8-930c-cbd4a52d9d9d" (UID: "5965e6e4-2adb-47a8-930c-cbd4a52d9d9d"). InnerVolumeSpecName "kube-api-access-kzxnt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 04:35:49.638494 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:49.638470 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8bceeda4-fed8-4766-9b7e-69edaa7a5b15-util" (OuterVolumeSpecName: "util") pod "8bceeda4-fed8-4766-9b7e-69edaa7a5b15" (UID: "8bceeda4-fed8-4766-9b7e-69edaa7a5b15"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 04:35:49.641372 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:49.641351 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5965e6e4-2adb-47a8-930c-cbd4a52d9d9d-util" (OuterVolumeSpecName: "util") pod "5965e6e4-2adb-47a8-930c-cbd4a52d9d9d" (UID: "5965e6e4-2adb-47a8-930c-cbd4a52d9d9d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 04:35:49.641729 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:49.641713 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9392e3e-6b09-458d-9577-ca7e955b80e2-util" (OuterVolumeSpecName: "util") pod "a9392e3e-6b09-458d-9577-ca7e955b80e2" (UID: "a9392e3e-6b09-458d-9577-ca7e955b80e2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 04:35:49.733264 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:49.733182 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5965e6e4-2adb-47a8-930c-cbd4a52d9d9d-util\") on node \"ip-10-0-140-86.ec2.internal\" DevicePath \"\"" Jun 15 04:35:49.733264 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:49.733208 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m4l8f\" (UniqueName: \"kubernetes.io/projected/8bceeda4-fed8-4766-9b7e-69edaa7a5b15-kube-api-access-m4l8f\") on node \"ip-10-0-140-86.ec2.internal\" DevicePath \"\"" Jun 15 04:35:49.733264 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:49.733220 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6ctwv\" (UniqueName: \"kubernetes.io/projected/a9392e3e-6b09-458d-9577-ca7e955b80e2-kube-api-access-6ctwv\") on node \"ip-10-0-140-86.ec2.internal\" DevicePath \"\"" Jun 15 04:35:49.733264 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:49.733229 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a9392e3e-6b09-458d-9577-ca7e955b80e2-bundle\") on node \"ip-10-0-140-86.ec2.internal\" DevicePath \"\"" Jun 15 04:35:49.733264 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:49.733237 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a9392e3e-6b09-458d-9577-ca7e955b80e2-util\") on node \"ip-10-0-140-86.ec2.internal\" DevicePath \"\"" Jun 15 04:35:49.733264 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:49.733245 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5965e6e4-2adb-47a8-930c-cbd4a52d9d9d-bundle\") on node \"ip-10-0-140-86.ec2.internal\" DevicePath \"\"" Jun 15 04:35:49.733264 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:49.733252 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8bceeda4-fed8-4766-9b7e-69edaa7a5b15-bundle\") on node \"ip-10-0-140-86.ec2.internal\" DevicePath \"\"" Jun 15 04:35:49.733264 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:49.733260 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kzxnt\" (UniqueName: \"kubernetes.io/projected/5965e6e4-2adb-47a8-930c-cbd4a52d9d9d-kube-api-access-kzxnt\") on node \"ip-10-0-140-86.ec2.internal\" DevicePath \"\"" Jun 15 04:35:49.733264 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:49.733267 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8bceeda4-fed8-4766-9b7e-69edaa7a5b15-util\") on node \"ip-10-0-140-86.ec2.internal\" DevicePath \"\"" Jun 15 04:35:50.442481 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:50.442431 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l2nwq" Jun 15 04:35:50.442481 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:50.442463 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l2nwq" event={"ID":"8bceeda4-fed8-4766-9b7e-69edaa7a5b15","Type":"ContainerDied","Data":"8e64a795c7ce0ac21f5b1edf8f48715baa36ff720a67b1348c0ad038eb25a107"} Jun 15 04:35:50.442724 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:50.442513 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8e64a795c7ce0ac21f5b1edf8f48715baa36ff720a67b1348c0ad038eb25a107" Jun 15 04:35:50.444433 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:50.444412 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kmdgj" Jun 15 04:35:50.444599 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:50.444469 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kmdgj" event={"ID":"a9392e3e-6b09-458d-9577-ca7e955b80e2","Type":"ContainerDied","Data":"c6265075a89150d07112e4f5d743254932977c02d53c60d5852189337a7f574a"} Jun 15 04:35:50.444599 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:50.444510 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c6265075a89150d07112e4f5d743254932977c02d53c60d5852189337a7f574a" Jun 15 04:35:50.446582 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:50.446551 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xmstj" event={"ID":"5965e6e4-2adb-47a8-930c-cbd4a52d9d9d","Type":"ContainerDied","Data":"8a0ffb6fd3f22ccba5000e01d09b1627bbba620e827aab9983b5c2e6adffc22a"} Jun 15 04:35:50.446687 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:50.446595 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8a0ffb6fd3f22ccba5000e01d09b1627bbba620e827aab9983b5c2e6adffc22a" Jun 15 04:35:50.446687 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:35:50.446565 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xmstj" Jun 15 04:36:01.554823 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:01.554789 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c2dtx"] Jun 15 04:36:01.555190 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:01.555148 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5965e6e4-2adb-47a8-930c-cbd4a52d9d9d" containerName="extract" Jun 15 04:36:01.555190 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:01.555159 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="5965e6e4-2adb-47a8-930c-cbd4a52d9d9d" containerName="extract" Jun 15 04:36:01.555190 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:01.555171 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9392e3e-6b09-458d-9577-ca7e955b80e2" containerName="util" Jun 15 04:36:01.555190 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:01.555176 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9392e3e-6b09-458d-9577-ca7e955b80e2" containerName="util" Jun 15 04:36:01.555190 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:01.555183 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7849488-4e16-4cf8-aae9-3d160ea558a2" containerName="extract" Jun 15 04:36:01.555190 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:01.555189 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7849488-4e16-4cf8-aae9-3d160ea558a2" containerName="extract" Jun 15 04:36:01.555384 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:01.555198 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8bceeda4-fed8-4766-9b7e-69edaa7a5b15" containerName="extract" Jun 15 04:36:01.555384 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:01.555203 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="8bceeda4-fed8-4766-9b7e-69edaa7a5b15" containerName="extract" Jun 15 04:36:01.555384 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:01.555209 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5965e6e4-2adb-47a8-930c-cbd4a52d9d9d" containerName="util" Jun 15 04:36:01.555384 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:01.555214 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="5965e6e4-2adb-47a8-930c-cbd4a52d9d9d" containerName="util" Jun 15 04:36:01.555384 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:01.555219 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8bceeda4-fed8-4766-9b7e-69edaa7a5b15" containerName="pull" Jun 15 04:36:01.555384 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:01.555224 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="8bceeda4-fed8-4766-9b7e-69edaa7a5b15" containerName="pull" Jun 15 04:36:01.555384 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:01.555241 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7849488-4e16-4cf8-aae9-3d160ea558a2" containerName="pull" Jun 15 04:36:01.555384 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:01.555245 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7849488-4e16-4cf8-aae9-3d160ea558a2" containerName="pull" Jun 15 04:36:01.555384 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:01.555252 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9392e3e-6b09-458d-9577-ca7e955b80e2" containerName="pull" Jun 15 04:36:01.555384 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:01.555257 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9392e3e-6b09-458d-9577-ca7e955b80e2" containerName="pull" Jun 15 04:36:01.555384 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:01.555264 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9392e3e-6b09-458d-9577-ca7e955b80e2" containerName="extract" Jun 15 04:36:01.555384 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:01.555269 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9392e3e-6b09-458d-9577-ca7e955b80e2" containerName="extract" Jun 15 04:36:01.555384 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:01.555275 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7849488-4e16-4cf8-aae9-3d160ea558a2" containerName="util" Jun 15 04:36:01.555384 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:01.555279 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7849488-4e16-4cf8-aae9-3d160ea558a2" containerName="util" Jun 15 04:36:01.555384 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:01.555284 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8bceeda4-fed8-4766-9b7e-69edaa7a5b15" containerName="util" Jun 15 04:36:01.555384 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:01.555289 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="8bceeda4-fed8-4766-9b7e-69edaa7a5b15" containerName="util" Jun 15 04:36:01.555384 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:01.555296 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5965e6e4-2adb-47a8-930c-cbd4a52d9d9d" containerName="pull" Jun 15 04:36:01.555384 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:01.555301 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="5965e6e4-2adb-47a8-930c-cbd4a52d9d9d" containerName="pull" Jun 15 04:36:01.555384 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:01.555359 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="5965e6e4-2adb-47a8-930c-cbd4a52d9d9d" containerName="extract" Jun 15 04:36:01.555384 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:01.555367 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7849488-4e16-4cf8-aae9-3d160ea558a2" containerName="extract" Jun 15 04:36:01.555384 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:01.555374 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="8bceeda4-fed8-4766-9b7e-69edaa7a5b15" containerName="extract" Jun 15 04:36:01.555384 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:01.555381 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9392e3e-6b09-458d-9577-ca7e955b80e2" containerName="extract" Jun 15 04:36:01.559886 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:01.559869 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c2dtx" Jun 15 04:36:01.561991 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:01.561971 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-b2srt\"" Jun 15 04:36:01.571332 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:01.571305 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c2dtx"] Jun 15 04:36:01.635751 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:01.635702 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtvjh\" (UniqueName: \"kubernetes.io/projected/314d9948-1c1e-43bc-adfd-d4c4b7e17f22-kube-api-access-gtvjh\") pod \"kuadrant-operator-controller-manager-8684c9ff49-c2dtx\" (UID: \"314d9948-1c1e-43bc-adfd-d4c4b7e17f22\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c2dtx" Jun 15 04:36:01.635940 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:01.635804 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/314d9948-1c1e-43bc-adfd-d4c4b7e17f22-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-c2dtx\" (UID: \"314d9948-1c1e-43bc-adfd-d4c4b7e17f22\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c2dtx" Jun 15 04:36:01.736928 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:01.736894 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtvjh\" (UniqueName: \"kubernetes.io/projected/314d9948-1c1e-43bc-adfd-d4c4b7e17f22-kube-api-access-gtvjh\") pod \"kuadrant-operator-controller-manager-8684c9ff49-c2dtx\" (UID: \"314d9948-1c1e-43bc-adfd-d4c4b7e17f22\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c2dtx" Jun 15 04:36:01.737087 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:01.736949 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/314d9948-1c1e-43bc-adfd-d4c4b7e17f22-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-c2dtx\" (UID: \"314d9948-1c1e-43bc-adfd-d4c4b7e17f22\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c2dtx" Jun 15 04:36:01.737255 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:01.737240 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/314d9948-1c1e-43bc-adfd-d4c4b7e17f22-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-c2dtx\" (UID: \"314d9948-1c1e-43bc-adfd-d4c4b7e17f22\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c2dtx" Jun 15 04:36:01.745560 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:01.745543 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtvjh\" (UniqueName: \"kubernetes.io/projected/314d9948-1c1e-43bc-adfd-d4c4b7e17f22-kube-api-access-gtvjh\") pod \"kuadrant-operator-controller-manager-8684c9ff49-c2dtx\" (UID: \"314d9948-1c1e-43bc-adfd-d4c4b7e17f22\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c2dtx" Jun 15 04:36:01.871222 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:01.871115 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c2dtx" Jun 15 04:36:02.012012 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:02.011987 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c2dtx"] Jun 15 04:36:02.014112 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:36:02.014080 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod314d9948_1c1e_43bc_adfd_d4c4b7e17f22.slice/crio-42f934785a282334b865cb6cf2e398c043c85d94536bc0a3bca596b1133896a2 WatchSource:0}: Error finding container 42f934785a282334b865cb6cf2e398c043c85d94536bc0a3bca596b1133896a2: Status 404 returned error can't find the container with id 42f934785a282334b865cb6cf2e398c043c85d94536bc0a3bca596b1133896a2 Jun 15 04:36:02.516762 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:02.516717 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c2dtx" event={"ID":"314d9948-1c1e-43bc-adfd-d4c4b7e17f22","Type":"ContainerStarted","Data":"42f934785a282334b865cb6cf2e398c043c85d94536bc0a3bca596b1133896a2"} Jun 15 04:36:04.467581 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:04.467546 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-dtx7z"] Jun 15 04:36:04.476670 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:04.476638 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dtx7z" Jun 15 04:36:04.476670 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:04.476653 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-dtx7z"] Jun 15 04:36:04.479102 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:04.478938 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-7kh2b\"" Jun 15 04:36:04.479102 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:04.478938 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 15 04:36:04.562527 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:04.562482 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6qvz\" (UniqueName: \"kubernetes.io/projected/1d3656ae-74de-48fd-80a6-14c002d3977a-kube-api-access-z6qvz\") pod \"dns-operator-controller-manager-864dd78c4c-dtx7z\" (UID: \"1d3656ae-74de-48fd-80a6-14c002d3977a\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dtx7z" Jun 15 04:36:04.663877 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:04.663832 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6qvz\" (UniqueName: \"kubernetes.io/projected/1d3656ae-74de-48fd-80a6-14c002d3977a-kube-api-access-z6qvz\") pod \"dns-operator-controller-manager-864dd78c4c-dtx7z\" (UID: \"1d3656ae-74de-48fd-80a6-14c002d3977a\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dtx7z" Jun 15 04:36:04.672742 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:04.672716 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6qvz\" (UniqueName: \"kubernetes.io/projected/1d3656ae-74de-48fd-80a6-14c002d3977a-kube-api-access-z6qvz\") pod \"dns-operator-controller-manager-864dd78c4c-dtx7z\" (UID: \"1d3656ae-74de-48fd-80a6-14c002d3977a\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dtx7z" Jun 15 04:36:04.791840 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:04.791760 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dtx7z" Jun 15 04:36:04.927080 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:04.927049 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-dtx7z"] Jun 15 04:36:05.537120 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:05.537089 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dtx7z" event={"ID":"1d3656ae-74de-48fd-80a6-14c002d3977a","Type":"ContainerStarted","Data":"4c4b87cd442f5bce24a2ff1ff06d13476c0ed7f3651678e9da9e4ae31de61b5d"} Jun 15 04:36:07.552149 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:07.552106 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dtx7z" event={"ID":"1d3656ae-74de-48fd-80a6-14c002d3977a","Type":"ContainerStarted","Data":"c927aa0063099ed977b5e55a3c08e5e004e415fe6b654b473f67333c2a6cb34f"} Jun 15 04:36:07.552594 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:07.552236 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dtx7z" Jun 15 04:36:07.571033 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:07.570985 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dtx7z" podStartSLOduration=1.369309708 podStartE2EDuration="3.57096805s" totalImagesPullingTime="2.201658342s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 04:36:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:36:07.567352217 +0000 UTC m=+643.095343122" watchObservedRunningTime="2026-06-15 04:36:07.57096805 +0000 UTC m=+643.098958997" Jun 15 04:36:08.559399 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:08.559363 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c2dtx" event={"ID":"314d9948-1c1e-43bc-adfd-d4c4b7e17f22","Type":"ContainerStarted","Data":"50142722691ea1b100ff5b8405062476a11bd733845298e9188b6e642589d169"} Jun 15 04:36:08.559814 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:08.559605 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c2dtx" Jun 15 04:36:08.579019 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:08.578973 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c2dtx" podStartSLOduration=1.138881287 podStartE2EDuration="7.578956722s" totalImagesPullingTime="6.440075435s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 04:36:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:36:08.57536974 +0000 UTC m=+644.103360646" watchObservedRunningTime="2026-06-15 04:36:08.578956722 +0000 UTC m=+644.106947626" Jun 15 04:36:12.105531 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:12.105491 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-d6bdbb769-2lw8s"] Jun 15 04:36:12.109409 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:12.109387 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d6bdbb769-2lw8s" Jun 15 04:36:12.118372 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:12.118346 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d6bdbb769-2lw8s"] Jun 15 04:36:12.235497 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:12.235458 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/779e5074-d20b-4b87-93b9-64be0b255888-oauth-serving-cert\") pod \"console-d6bdbb769-2lw8s\" (UID: \"779e5074-d20b-4b87-93b9-64be0b255888\") " pod="openshift-console/console-d6bdbb769-2lw8s" Jun 15 04:36:12.235812 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:12.235786 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/779e5074-d20b-4b87-93b9-64be0b255888-service-ca\") pod \"console-d6bdbb769-2lw8s\" (UID: \"779e5074-d20b-4b87-93b9-64be0b255888\") " pod="openshift-console/console-d6bdbb769-2lw8s" Jun 15 04:36:12.235987 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:12.235971 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/779e5074-d20b-4b87-93b9-64be0b255888-trusted-ca-bundle\") pod \"console-d6bdbb769-2lw8s\" (UID: \"779e5074-d20b-4b87-93b9-64be0b255888\") " pod="openshift-console/console-d6bdbb769-2lw8s" Jun 15 04:36:12.236221 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:12.236206 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/779e5074-d20b-4b87-93b9-64be0b255888-console-serving-cert\") pod \"console-d6bdbb769-2lw8s\" (UID: \"779e5074-d20b-4b87-93b9-64be0b255888\") " pod="openshift-console/console-d6bdbb769-2lw8s" Jun 15 04:36:12.236364 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:12.236347 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/779e5074-d20b-4b87-93b9-64be0b255888-console-config\") pod \"console-d6bdbb769-2lw8s\" (UID: \"779e5074-d20b-4b87-93b9-64be0b255888\") " pod="openshift-console/console-d6bdbb769-2lw8s" Jun 15 04:36:12.236549 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:12.236530 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/779e5074-d20b-4b87-93b9-64be0b255888-console-oauth-config\") pod \"console-d6bdbb769-2lw8s\" (UID: \"779e5074-d20b-4b87-93b9-64be0b255888\") " pod="openshift-console/console-d6bdbb769-2lw8s" Jun 15 04:36:12.236709 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:12.236693 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fnnz\" (UniqueName: \"kubernetes.io/projected/779e5074-d20b-4b87-93b9-64be0b255888-kube-api-access-7fnnz\") pod \"console-d6bdbb769-2lw8s\" (UID: \"779e5074-d20b-4b87-93b9-64be0b255888\") " pod="openshift-console/console-d6bdbb769-2lw8s" Jun 15 04:36:12.337513 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:12.337471 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/779e5074-d20b-4b87-93b9-64be0b255888-oauth-serving-cert\") pod \"console-d6bdbb769-2lw8s\" (UID: \"779e5074-d20b-4b87-93b9-64be0b255888\") " pod="openshift-console/console-d6bdbb769-2lw8s" Jun 15 04:36:12.337713 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:12.337522 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/779e5074-d20b-4b87-93b9-64be0b255888-service-ca\") pod \"console-d6bdbb769-2lw8s\" (UID: \"779e5074-d20b-4b87-93b9-64be0b255888\") " pod="openshift-console/console-d6bdbb769-2lw8s" Jun 15 04:36:12.337713 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:12.337541 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/779e5074-d20b-4b87-93b9-64be0b255888-trusted-ca-bundle\") pod \"console-d6bdbb769-2lw8s\" (UID: \"779e5074-d20b-4b87-93b9-64be0b255888\") " pod="openshift-console/console-d6bdbb769-2lw8s" Jun 15 04:36:12.337713 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:12.337628 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/779e5074-d20b-4b87-93b9-64be0b255888-console-serving-cert\") pod \"console-d6bdbb769-2lw8s\" (UID: \"779e5074-d20b-4b87-93b9-64be0b255888\") " pod="openshift-console/console-d6bdbb769-2lw8s" Jun 15 04:36:12.337713 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:12.337658 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/779e5074-d20b-4b87-93b9-64be0b255888-console-config\") pod \"console-d6bdbb769-2lw8s\" (UID: \"779e5074-d20b-4b87-93b9-64be0b255888\") " pod="openshift-console/console-d6bdbb769-2lw8s" Jun 15 04:36:12.337713 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:12.337681 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/779e5074-d20b-4b87-93b9-64be0b255888-console-oauth-config\") pod \"console-d6bdbb769-2lw8s\" (UID: \"779e5074-d20b-4b87-93b9-64be0b255888\") " pod="openshift-console/console-d6bdbb769-2lw8s" Jun 15 04:36:12.337713 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:12.337709 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fnnz\" (UniqueName: \"kubernetes.io/projected/779e5074-d20b-4b87-93b9-64be0b255888-kube-api-access-7fnnz\") pod \"console-d6bdbb769-2lw8s\" (UID: \"779e5074-d20b-4b87-93b9-64be0b255888\") " pod="openshift-console/console-d6bdbb769-2lw8s" Jun 15 04:36:12.338343 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:12.338319 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/779e5074-d20b-4b87-93b9-64be0b255888-oauth-serving-cert\") pod \"console-d6bdbb769-2lw8s\" (UID: \"779e5074-d20b-4b87-93b9-64be0b255888\") " pod="openshift-console/console-d6bdbb769-2lw8s" Jun 15 04:36:12.338472 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:12.338359 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/779e5074-d20b-4b87-93b9-64be0b255888-service-ca\") pod \"console-d6bdbb769-2lw8s\" (UID: \"779e5074-d20b-4b87-93b9-64be0b255888\") " pod="openshift-console/console-d6bdbb769-2lw8s" Jun 15 04:36:12.338540 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:12.338486 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/779e5074-d20b-4b87-93b9-64be0b255888-console-config\") pod \"console-d6bdbb769-2lw8s\" (UID: \"779e5074-d20b-4b87-93b9-64be0b255888\") " pod="openshift-console/console-d6bdbb769-2lw8s" Jun 15 04:36:12.338815 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:12.338794 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/779e5074-d20b-4b87-93b9-64be0b255888-trusted-ca-bundle\") pod \"console-d6bdbb769-2lw8s\" (UID: \"779e5074-d20b-4b87-93b9-64be0b255888\") " pod="openshift-console/console-d6bdbb769-2lw8s" Jun 15 04:36:12.340958 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:12.340923 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/779e5074-d20b-4b87-93b9-64be0b255888-console-serving-cert\") pod \"console-d6bdbb769-2lw8s\" (UID: \"779e5074-d20b-4b87-93b9-64be0b255888\") " pod="openshift-console/console-d6bdbb769-2lw8s" Jun 15 04:36:12.341176 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:12.341152 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/779e5074-d20b-4b87-93b9-64be0b255888-console-oauth-config\") pod \"console-d6bdbb769-2lw8s\" (UID: \"779e5074-d20b-4b87-93b9-64be0b255888\") " pod="openshift-console/console-d6bdbb769-2lw8s" Jun 15 04:36:12.344602 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:12.344581 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fnnz\" (UniqueName: \"kubernetes.io/projected/779e5074-d20b-4b87-93b9-64be0b255888-kube-api-access-7fnnz\") pod \"console-d6bdbb769-2lw8s\" (UID: \"779e5074-d20b-4b87-93b9-64be0b255888\") " pod="openshift-console/console-d6bdbb769-2lw8s" Jun 15 04:36:12.419796 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:12.419767 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d6bdbb769-2lw8s" Jun 15 04:36:12.551607 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:12.551579 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d6bdbb769-2lw8s"] Jun 15 04:36:12.552653 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:36:12.552631 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod779e5074_d20b_4b87_93b9_64be0b255888.slice/crio-58f7cb37b0faca70f02ae4858148b16138cf3c40dd854c5609bd93f8a31e354f WatchSource:0}: Error finding container 58f7cb37b0faca70f02ae4858148b16138cf3c40dd854c5609bd93f8a31e354f: Status 404 returned error can't find the container with id 58f7cb37b0faca70f02ae4858148b16138cf3c40dd854c5609bd93f8a31e354f Jun 15 04:36:12.582234 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:12.582209 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d6bdbb769-2lw8s" event={"ID":"779e5074-d20b-4b87-93b9-64be0b255888","Type":"ContainerStarted","Data":"58f7cb37b0faca70f02ae4858148b16138cf3c40dd854c5609bd93f8a31e354f"} Jun 15 04:36:12.973291 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:12.973256 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4kd4q"] Jun 15 04:36:12.977274 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:12.977258 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4kd4q" Jun 15 04:36:12.979317 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:12.979300 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-rmwcf\"" Jun 15 04:36:12.995760 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:12.995725 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4kd4q"] Jun 15 04:36:13.044263 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:13.044231 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzmmz\" (UniqueName: \"kubernetes.io/projected/e148464b-973b-4f86-9c90-4aa0abf45088-kube-api-access-jzmmz\") pod \"limitador-operator-controller-manager-859d7b78bd-4kd4q\" (UID: \"e148464b-973b-4f86-9c90-4aa0abf45088\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4kd4q" Jun 15 04:36:13.144805 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:13.144774 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzmmz\" (UniqueName: \"kubernetes.io/projected/e148464b-973b-4f86-9c90-4aa0abf45088-kube-api-access-jzmmz\") pod \"limitador-operator-controller-manager-859d7b78bd-4kd4q\" (UID: \"e148464b-973b-4f86-9c90-4aa0abf45088\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4kd4q" Jun 15 04:36:13.155377 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:13.155352 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzmmz\" (UniqueName: \"kubernetes.io/projected/e148464b-973b-4f86-9c90-4aa0abf45088-kube-api-access-jzmmz\") pod \"limitador-operator-controller-manager-859d7b78bd-4kd4q\" (UID: \"e148464b-973b-4f86-9c90-4aa0abf45088\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4kd4q" Jun 15 04:36:13.291740 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:13.291655 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4kd4q" Jun 15 04:36:13.449126 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:13.449098 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4kd4q"] Jun 15 04:36:13.450769 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:36:13.450741 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode148464b_973b_4f86_9c90_4aa0abf45088.slice/crio-0baa0d19f9b784e170fd40d4d00f72ec2279dceb124113b1e127ac127de293c3 WatchSource:0}: Error finding container 0baa0d19f9b784e170fd40d4d00f72ec2279dceb124113b1e127ac127de293c3: Status 404 returned error can't find the container with id 0baa0d19f9b784e170fd40d4d00f72ec2279dceb124113b1e127ac127de293c3 Jun 15 04:36:13.453242 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:13.453227 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 15 04:36:13.589357 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:13.589263 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d6bdbb769-2lw8s" event={"ID":"779e5074-d20b-4b87-93b9-64be0b255888","Type":"ContainerStarted","Data":"e6c928205b67f129a009e9ab2c5829ffcfa958d1a2ad0d8230557ace2f46c345"} Jun 15 04:36:13.590691 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:13.590664 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4kd4q" event={"ID":"e148464b-973b-4f86-9c90-4aa0abf45088","Type":"ContainerStarted","Data":"0baa0d19f9b784e170fd40d4d00f72ec2279dceb124113b1e127ac127de293c3"} Jun 15 04:36:13.607384 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:13.607335 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-d6bdbb769-2lw8s" podStartSLOduration=1.6073217899999999 podStartE2EDuration="1.60732179s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 04:36:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:36:13.604805296 +0000 UTC m=+649.132796192" watchObservedRunningTime="2026-06-15 04:36:13.60732179 +0000 UTC m=+649.135312695" Jun 15 04:36:15.604769 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:15.604680 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4kd4q" event={"ID":"e148464b-973b-4f86-9c90-4aa0abf45088","Type":"ContainerStarted","Data":"85d90aa0f6c50b7aede74c09af9c74a7c0b377461fa6bf7e8659daad0ad71232"} Jun 15 04:36:15.604769 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:15.604754 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4kd4q" Jun 15 04:36:15.622509 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:15.622465 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4kd4q" podStartSLOduration=1.911924579 podStartE2EDuration="3.622435308s" totalImagesPullingTime="1.710510729s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 04:36:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:36:15.619620475 +0000 UTC m=+651.147611381" watchObservedRunningTime="2026-06-15 04:36:15.622435308 +0000 UTC m=+651.150426213" Jun 15 04:36:18.562166 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:18.562135 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dtx7z" Jun 15 04:36:19.566666 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:19.566630 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c2dtx" Jun 15 04:36:21.194416 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:21.194376 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c2dtx"] Jun 15 04:36:21.194898 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:21.194649 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c2dtx" podUID="314d9948-1c1e-43bc-adfd-d4c4b7e17f22" containerName="manager" containerID="cri-o://50142722691ea1b100ff5b8405062476a11bd733845298e9188b6e642589d169" gracePeriod=2 Jun 15 04:36:21.196384 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:36:21.196350 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-c2dtx\" is forbidden: User \"system:node:ip-10-0-140-86.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-86.ec2.internal' and this object" podUID="314d9948-1c1e-43bc-adfd-d4c4b7e17f22" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c2dtx" Jun 15 04:36:21.197904 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:21.197878 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c2dtx"] Jun 15 04:36:21.217899 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:21.217868 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z8fzz"] Jun 15 04:36:21.218339 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:21.218321 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="314d9948-1c1e-43bc-adfd-d4c4b7e17f22" containerName="manager" Jun 15 04:36:21.218423 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:21.218341 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="314d9948-1c1e-43bc-adfd-d4c4b7e17f22" containerName="manager" Jun 15 04:36:21.218503 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:21.218429 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="314d9948-1c1e-43bc-adfd-d4c4b7e17f22" containerName="manager" Jun 15 04:36:21.229117 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:21.228699 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z8fzz" Jun 15 04:36:21.230743 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:36:21.230710 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-c2dtx\" is forbidden: User \"system:node:ip-10-0-140-86.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-86.ec2.internal' and this object" podUID="314d9948-1c1e-43bc-adfd-d4c4b7e17f22" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c2dtx" Jun 15 04:36:21.231827 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:21.231805 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z8fzz"] Jun 15 04:36:21.251240 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:21.251213 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4kd4q"] Jun 15 04:36:21.251777 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:21.251423 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4kd4q" podUID="e148464b-973b-4f86-9c90-4aa0abf45088" containerName="manager" containerID="cri-o://85d90aa0f6c50b7aede74c09af9c74a7c0b377461fa6bf7e8659daad0ad71232" gracePeriod=2 Jun 15 04:36:21.253306 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:21.253259 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4kd4q" Jun 15 04:36:21.257002 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:36:21.256976 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-c2dtx\" is forbidden: User \"system:node:ip-10-0-140-86.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-86.ec2.internal' and this object" podUID="314d9948-1c1e-43bc-adfd-d4c4b7e17f22" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c2dtx" Jun 15 04:36:21.261529 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:36:21.261421 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-c2dtx\" is forbidden: User \"system:node:ip-10-0-140-86.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-86.ec2.internal' and this object" podUID="314d9948-1c1e-43bc-adfd-d4c4b7e17f22" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c2dtx" Jun 15 04:36:21.263103 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:36:21.263073 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4kd4q\" is forbidden: User \"system:node:ip-10-0-140-86.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-86.ec2.internal' and this object" podUID="e148464b-973b-4f86-9c90-4aa0abf45088" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4kd4q" Jun 15 04:36:21.263478 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:21.263459 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4kd4q"] Jun 15 04:36:21.281749 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:21.281718 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mcsg8"] Jun 15 04:36:21.282153 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:21.282135 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e148464b-973b-4f86-9c90-4aa0abf45088" containerName="manager" Jun 15 04:36:21.282235 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:21.282156 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e148464b-973b-4f86-9c90-4aa0abf45088" containerName="manager" Jun 15 04:36:21.282292 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:21.282285 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="e148464b-973b-4f86-9c90-4aa0abf45088" containerName="manager" Jun 15 04:36:21.285500 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:21.285481 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mcsg8" Jun 15 04:36:21.287652 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:36:21.287627 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-c2dtx\" is forbidden: User \"system:node:ip-10-0-140-86.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-86.ec2.internal' and this object" podUID="314d9948-1c1e-43bc-adfd-d4c4b7e17f22" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c2dtx" Jun 15 04:36:21.289694 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:36:21.289663 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4kd4q\" is forbidden: User \"system:node:ip-10-0-140-86.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-86.ec2.internal' and this object" podUID="e148464b-973b-4f86-9c90-4aa0abf45088" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4kd4q" Jun 15 04:36:21.297932 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:21.297909 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mcsg8"] Jun 15 04:36:21.320312 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:21.320283 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42xtr\" (UniqueName: \"kubernetes.io/projected/b85cbd25-c275-4754-9407-df9009c42562-kube-api-access-42xtr\") pod \"kuadrant-operator-controller-manager-8684c9ff49-z8fzz\" (UID: \"b85cbd25-c275-4754-9407-df9009c42562\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z8fzz" Jun 15 04:36:21.320459 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:21.320327 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b85cbd25-c275-4754-9407-df9009c42562-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-z8fzz\" (UID: \"b85cbd25-c275-4754-9407-df9009c42562\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z8fzz" Jun 15 04:36:21.421582 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:21.421546 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxxvn\" (UniqueName: \"kubernetes.io/projected/a3f7c378-2ac3-4dde-ad88-3dc7bbb12b3b-kube-api-access-jxxvn\") pod \"limitador-operator-controller-manager-859d7b78bd-mcsg8\" (UID: \"a3f7c378-2ac3-4dde-ad88-3dc7bbb12b3b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mcsg8" Jun 15 04:36:21.421742 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:21.421611 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42xtr\" (UniqueName: \"kubernetes.io/projected/b85cbd25-c275-4754-9407-df9009c42562-kube-api-access-42xtr\") pod \"kuadrant-operator-controller-manager-8684c9ff49-z8fzz\" (UID: \"b85cbd25-c275-4754-9407-df9009c42562\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z8fzz" Jun 15 04:36:21.421742 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:21.421671 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b85cbd25-c275-4754-9407-df9009c42562-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-z8fzz\" (UID: \"b85cbd25-c275-4754-9407-df9009c42562\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z8fzz" Jun 15 04:36:21.422144 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:21.422121 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b85cbd25-c275-4754-9407-df9009c42562-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-z8fzz\" (UID: \"b85cbd25-c275-4754-9407-df9009c42562\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z8fzz" Jun 15 04:36:21.435150 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:21.434491 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-42xtr\" (UniqueName: \"kubernetes.io/projected/b85cbd25-c275-4754-9407-df9009c42562-kube-api-access-42xtr\") pod \"kuadrant-operator-controller-manager-8684c9ff49-z8fzz\" (UID: \"b85cbd25-c275-4754-9407-df9009c42562\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z8fzz" Jun 15 04:36:21.493902 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:21.493876 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c2dtx" Jun 15 04:36:21.495858 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:36:21.495829 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-c2dtx\" is forbidden: User \"system:node:ip-10-0-140-86.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-86.ec2.internal' and this object" podUID="314d9948-1c1e-43bc-adfd-d4c4b7e17f22" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c2dtx" Jun 15 04:36:21.496591 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:21.496568 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4kd4q" Jun 15 04:36:21.497379 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:36:21.497360 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4kd4q\" is forbidden: User \"system:node:ip-10-0-140-86.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-86.ec2.internal' and this object" podUID="e148464b-973b-4f86-9c90-4aa0abf45088" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4kd4q" Jun 15 04:36:21.498686 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:36:21.498666 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-c2dtx\" is forbidden: User \"system:node:ip-10-0-140-86.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-86.ec2.internal' and this object" podUID="314d9948-1c1e-43bc-adfd-d4c4b7e17f22" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c2dtx" Jun 15 04:36:21.500165 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:36:21.500143 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4kd4q\" is forbidden: User \"system:node:ip-10-0-140-86.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-86.ec2.internal' and this object" podUID="e148464b-973b-4f86-9c90-4aa0abf45088" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4kd4q" Jun 15 04:36:21.522675 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:21.522646 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxxvn\" (UniqueName: \"kubernetes.io/projected/a3f7c378-2ac3-4dde-ad88-3dc7bbb12b3b-kube-api-access-jxxvn\") pod \"limitador-operator-controller-manager-859d7b78bd-mcsg8\" (UID: \"a3f7c378-2ac3-4dde-ad88-3dc7bbb12b3b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mcsg8" Jun 15 04:36:21.530931 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:21.530907 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxxvn\" (UniqueName: \"kubernetes.io/projected/a3f7c378-2ac3-4dde-ad88-3dc7bbb12b3b-kube-api-access-jxxvn\") pod \"limitador-operator-controller-manager-859d7b78bd-mcsg8\" (UID: \"a3f7c378-2ac3-4dde-ad88-3dc7bbb12b3b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mcsg8" Jun 15 04:36:21.623117 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:21.623085 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/314d9948-1c1e-43bc-adfd-d4c4b7e17f22-extensions-socket-volume\") pod \"314d9948-1c1e-43bc-adfd-d4c4b7e17f22\" (UID: \"314d9948-1c1e-43bc-adfd-d4c4b7e17f22\") " Jun 15 04:36:21.623314 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:21.623161 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gtvjh\" (UniqueName: \"kubernetes.io/projected/314d9948-1c1e-43bc-adfd-d4c4b7e17f22-kube-api-access-gtvjh\") pod \"314d9948-1c1e-43bc-adfd-d4c4b7e17f22\" (UID: \"314d9948-1c1e-43bc-adfd-d4c4b7e17f22\") " Jun 15 04:36:21.623314 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:21.623178 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jzmmz\" (UniqueName: \"kubernetes.io/projected/e148464b-973b-4f86-9c90-4aa0abf45088-kube-api-access-jzmmz\") pod \"e148464b-973b-4f86-9c90-4aa0abf45088\" (UID: \"e148464b-973b-4f86-9c90-4aa0abf45088\") " Jun 15 04:36:21.623596 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:21.623573 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/314d9948-1c1e-43bc-adfd-d4c4b7e17f22-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "314d9948-1c1e-43bc-adfd-d4c4b7e17f22" (UID: "314d9948-1c1e-43bc-adfd-d4c4b7e17f22"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 04:36:21.625204 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:21.625176 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e148464b-973b-4f86-9c90-4aa0abf45088-kube-api-access-jzmmz" (OuterVolumeSpecName: "kube-api-access-jzmmz") pod "e148464b-973b-4f86-9c90-4aa0abf45088" (UID: "e148464b-973b-4f86-9c90-4aa0abf45088"). InnerVolumeSpecName "kube-api-access-jzmmz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 04:36:21.625204 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:21.625190 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/314d9948-1c1e-43bc-adfd-d4c4b7e17f22-kube-api-access-gtvjh" (OuterVolumeSpecName: "kube-api-access-gtvjh") pod "314d9948-1c1e-43bc-adfd-d4c4b7e17f22" (UID: "314d9948-1c1e-43bc-adfd-d4c4b7e17f22"). InnerVolumeSpecName "kube-api-access-gtvjh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 04:36:21.635539 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:21.635515 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z8fzz" Jun 15 04:36:21.640427 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:21.640407 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mcsg8" Jun 15 04:36:21.642174 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:21.642149 2561 generic.go:356] "Generic (PLEG): container finished" podID="314d9948-1c1e-43bc-adfd-d4c4b7e17f22" containerID="50142722691ea1b100ff5b8405062476a11bd733845298e9188b6e642589d169" exitCode=0 Jun 15 04:36:21.642253 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:21.642188 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c2dtx" Jun 15 04:36:21.642253 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:21.642241 2561 scope.go:117] "RemoveContainer" containerID="50142722691ea1b100ff5b8405062476a11bd733845298e9188b6e642589d169" Jun 15 04:36:21.643678 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:21.643655 2561 generic.go:356] "Generic (PLEG): container finished" podID="e148464b-973b-4f86-9c90-4aa0abf45088" containerID="85d90aa0f6c50b7aede74c09af9c74a7c0b377461fa6bf7e8659daad0ad71232" exitCode=0 Jun 15 04:36:21.643758 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:21.643707 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4kd4q" Jun 15 04:36:21.644232 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:36:21.644209 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-c2dtx\" is forbidden: User \"system:node:ip-10-0-140-86.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-86.ec2.internal' and this object" podUID="314d9948-1c1e-43bc-adfd-d4c4b7e17f22" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c2dtx" Jun 15 04:36:21.653247 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:36:21.648289 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4kd4q\" is forbidden: User \"system:node:ip-10-0-140-86.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-86.ec2.internal' and this object" podUID="e148464b-973b-4f86-9c90-4aa0abf45088" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4kd4q" Jun 15 04:36:21.653247 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:36:21.650018 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-c2dtx\" is forbidden: User \"system:node:ip-10-0-140-86.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-86.ec2.internal' and this object" podUID="314d9948-1c1e-43bc-adfd-d4c4b7e17f22" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c2dtx" Jun 15 04:36:21.653247 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:36:21.651507 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4kd4q\" is forbidden: User \"system:node:ip-10-0-140-86.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-86.ec2.internal' and this object" podUID="e148464b-973b-4f86-9c90-4aa0abf45088" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4kd4q" Jun 15 04:36:21.661016 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:36:21.660985 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-c2dtx\" is forbidden: User \"system:node:ip-10-0-140-86.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-86.ec2.internal' and this object" podUID="314d9948-1c1e-43bc-adfd-d4c4b7e17f22" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c2dtx" Jun 15 04:36:21.661106 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:21.661039 2561 scope.go:117] "RemoveContainer" containerID="50142722691ea1b100ff5b8405062476a11bd733845298e9188b6e642589d169" Jun 15 04:36:21.661358 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:36:21.661338 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50142722691ea1b100ff5b8405062476a11bd733845298e9188b6e642589d169\": container with ID starting with 50142722691ea1b100ff5b8405062476a11bd733845298e9188b6e642589d169 not found: ID does not exist" containerID="50142722691ea1b100ff5b8405062476a11bd733845298e9188b6e642589d169" Jun 15 04:36:21.661432 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:21.661366 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50142722691ea1b100ff5b8405062476a11bd733845298e9188b6e642589d169"} err="failed to get container status \"50142722691ea1b100ff5b8405062476a11bd733845298e9188b6e642589d169\": rpc error: code = NotFound desc = could not find container \"50142722691ea1b100ff5b8405062476a11bd733845298e9188b6e642589d169\": container with ID starting with 50142722691ea1b100ff5b8405062476a11bd733845298e9188b6e642589d169 not found: ID does not exist" Jun 15 04:36:21.661432 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:21.661383 2561 scope.go:117] "RemoveContainer" containerID="85d90aa0f6c50b7aede74c09af9c74a7c0b377461fa6bf7e8659daad0ad71232" Jun 15 04:36:21.662499 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:36:21.662468 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4kd4q\" is forbidden: User \"system:node:ip-10-0-140-86.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-86.ec2.internal' and this object" podUID="e148464b-973b-4f86-9c90-4aa0abf45088" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4kd4q" Jun 15 04:36:21.664045 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:36:21.664013 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-c2dtx\" is forbidden: User \"system:node:ip-10-0-140-86.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-86.ec2.internal' and this object" podUID="314d9948-1c1e-43bc-adfd-d4c4b7e17f22" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c2dtx" Jun 15 04:36:21.665638 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:36:21.665607 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4kd4q\" is forbidden: User \"system:node:ip-10-0-140-86.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-86.ec2.internal' and this object" podUID="e148464b-973b-4f86-9c90-4aa0abf45088" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4kd4q" Jun 15 04:36:21.670558 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:21.670536 2561 scope.go:117] "RemoveContainer" containerID="85d90aa0f6c50b7aede74c09af9c74a7c0b377461fa6bf7e8659daad0ad71232" Jun 15 04:36:21.670864 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:36:21.670844 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85d90aa0f6c50b7aede74c09af9c74a7c0b377461fa6bf7e8659daad0ad71232\": container with ID starting with 85d90aa0f6c50b7aede74c09af9c74a7c0b377461fa6bf7e8659daad0ad71232 not found: ID does not exist" containerID="85d90aa0f6c50b7aede74c09af9c74a7c0b377461fa6bf7e8659daad0ad71232" Jun 15 04:36:21.670964 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:21.670868 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85d90aa0f6c50b7aede74c09af9c74a7c0b377461fa6bf7e8659daad0ad71232"} err="failed to get container status \"85d90aa0f6c50b7aede74c09af9c74a7c0b377461fa6bf7e8659daad0ad71232\": rpc error: code = NotFound desc = could not find container \"85d90aa0f6c50b7aede74c09af9c74a7c0b377461fa6bf7e8659daad0ad71232\": container with ID starting with 85d90aa0f6c50b7aede74c09af9c74a7c0b377461fa6bf7e8659daad0ad71232 not found: ID does not exist" Jun 15 04:36:21.724771 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:21.724683 2561 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/314d9948-1c1e-43bc-adfd-d4c4b7e17f22-extensions-socket-volume\") on node \"ip-10-0-140-86.ec2.internal\" DevicePath \"\"" Jun 15 04:36:21.724771 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:21.724716 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gtvjh\" (UniqueName: \"kubernetes.io/projected/314d9948-1c1e-43bc-adfd-d4c4b7e17f22-kube-api-access-gtvjh\") on node \"ip-10-0-140-86.ec2.internal\" DevicePath \"\"" Jun 15 04:36:21.724771 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:21.724731 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jzmmz\" (UniqueName: \"kubernetes.io/projected/e148464b-973b-4f86-9c90-4aa0abf45088-kube-api-access-jzmmz\") on node \"ip-10-0-140-86.ec2.internal\" DevicePath \"\"" Jun 15 04:36:21.790964 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:21.790927 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z8fzz"] Jun 15 04:36:21.793950 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:36:21.793913 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb85cbd25_c275_4754_9407_df9009c42562.slice/crio-ab18bbf522baff722dc899e696556304b67a9c5eb0e0649764221fe02497cb30 WatchSource:0}: Error finding container ab18bbf522baff722dc899e696556304b67a9c5eb0e0649764221fe02497cb30: Status 404 returned error can't find the container with id ab18bbf522baff722dc899e696556304b67a9c5eb0e0649764221fe02497cb30 Jun 15 04:36:21.811331 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:21.811308 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mcsg8"] Jun 15 04:36:21.815390 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:36:21.815365 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3f7c378_2ac3_4dde_ad88_3dc7bbb12b3b.slice/crio-e0aa5ee4decdc221523ca422b7d2b1492710869822d30e40e0f2a3f44ba357a4 WatchSource:0}: Error finding container e0aa5ee4decdc221523ca422b7d2b1492710869822d30e40e0f2a3f44ba357a4: Status 404 returned error can't find the container with id e0aa5ee4decdc221523ca422b7d2b1492710869822d30e40e0f2a3f44ba357a4 Jun 15 04:36:22.419981 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:22.419946 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-d6bdbb769-2lw8s" Jun 15 04:36:22.420346 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:22.420002 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-d6bdbb769-2lw8s" Jun 15 04:36:22.424976 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:22.424955 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-d6bdbb769-2lw8s" Jun 15 04:36:22.426642 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:36:22.426620 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-c2dtx\" is forbidden: User \"system:node:ip-10-0-140-86.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-86.ec2.internal' and this object" podUID="314d9948-1c1e-43bc-adfd-d4c4b7e17f22" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c2dtx" Jun 15 04:36:22.428142 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:36:22.428120 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4kd4q\" is forbidden: User \"system:node:ip-10-0-140-86.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-86.ec2.internal' and this object" podUID="e148464b-973b-4f86-9c90-4aa0abf45088" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4kd4q" Jun 15 04:36:22.651187 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:22.651100 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z8fzz" event={"ID":"b85cbd25-c275-4754-9407-df9009c42562","Type":"ContainerStarted","Data":"c9efa84853e5ed0a8c1b5aaaad9de93084a0922dbc3f807807fe8ba5c8b490a6"} Jun 15 04:36:22.651187 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:22.651161 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z8fzz" event={"ID":"b85cbd25-c275-4754-9407-df9009c42562","Type":"ContainerStarted","Data":"ab18bbf522baff722dc899e696556304b67a9c5eb0e0649764221fe02497cb30"} Jun 15 04:36:22.651419 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:22.651283 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z8fzz" Jun 15 04:36:22.653563 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:22.653538 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mcsg8" event={"ID":"a3f7c378-2ac3-4dde-ad88-3dc7bbb12b3b","Type":"ContainerStarted","Data":"c02c580170d0f7e1e5d6f4aedd84f18f7d0579bd5a9f3c4778e4ee2319c8ddb2"} Jun 15 04:36:22.653709 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:22.653581 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mcsg8" event={"ID":"a3f7c378-2ac3-4dde-ad88-3dc7bbb12b3b","Type":"ContainerStarted","Data":"e0aa5ee4decdc221523ca422b7d2b1492710869822d30e40e0f2a3f44ba357a4"} Jun 15 04:36:22.653709 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:22.653606 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mcsg8" Jun 15 04:36:22.658354 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:22.658335 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-d6bdbb769-2lw8s" Jun 15 04:36:22.670262 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:36:22.670228 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-c2dtx\" is forbidden: User \"system:node:ip-10-0-140-86.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-86.ec2.internal' and this object" podUID="314d9948-1c1e-43bc-adfd-d4c4b7e17f22" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c2dtx" Jun 15 04:36:22.671378 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:22.671339 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z8fzz" podStartSLOduration=1.671327582 podStartE2EDuration="1.671327582s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 04:36:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:36:22.668660268 +0000 UTC m=+658.196651168" watchObservedRunningTime="2026-06-15 04:36:22.671327582 +0000 UTC m=+658.199318486" Jun 15 04:36:22.671682 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:36:22.671659 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4kd4q\" is forbidden: User \"system:node:ip-10-0-140-86.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-86.ec2.internal' and this object" podUID="e148464b-973b-4f86-9c90-4aa0abf45088" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4kd4q" Jun 15 04:36:22.673128 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:36:22.673108 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-c2dtx\" is forbidden: User \"system:node:ip-10-0-140-86.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-86.ec2.internal' and this object" podUID="314d9948-1c1e-43bc-adfd-d4c4b7e17f22" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c2dtx" Jun 15 04:36:22.674460 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:36:22.674422 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4kd4q\" is forbidden: User \"system:node:ip-10-0-140-86.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-86.ec2.internal' and this object" podUID="e148464b-973b-4f86-9c90-4aa0abf45088" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4kd4q" Jun 15 04:36:22.689049 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:22.689001 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mcsg8" podStartSLOduration=1.688988421 podStartE2EDuration="1.688988421s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 04:36:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:36:22.687716544 +0000 UTC m=+658.215707449" watchObservedRunningTime="2026-06-15 04:36:22.688988421 +0000 UTC m=+658.216979327" Jun 15 04:36:22.738754 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:22.738720 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7cbfd949db-rpg2j"] Jun 15 04:36:22.759061 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:36:22.759027 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-c2dtx\" is forbidden: User \"system:node:ip-10-0-140-86.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-86.ec2.internal' and this object" podUID="314d9948-1c1e-43bc-adfd-d4c4b7e17f22" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c2dtx" Jun 15 04:36:22.760272 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:36:22.760240 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4kd4q\" is forbidden: User \"system:node:ip-10-0-140-86.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-86.ec2.internal' and this object" podUID="e148464b-973b-4f86-9c90-4aa0abf45088" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4kd4q" Jun 15 04:36:22.826267 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:22.826225 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="314d9948-1c1e-43bc-adfd-d4c4b7e17f22" path="/var/lib/kubelet/pods/314d9948-1c1e-43bc-adfd-d4c4b7e17f22/volumes" Jun 15 04:36:22.826678 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:22.826658 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e148464b-973b-4f86-9c90-4aa0abf45088" path="/var/lib/kubelet/pods/e148464b-973b-4f86-9c90-4aa0abf45088/volumes" Jun 15 04:36:33.662792 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:33.662762 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z8fzz" Jun 15 04:36:33.663197 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:33.662838 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mcsg8" Jun 15 04:36:38.422011 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:38.421977 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z8fzz"] Jun 15 04:36:38.422392 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:38.422158 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z8fzz" podUID="b85cbd25-c275-4754-9407-df9009c42562" containerName="manager" containerID="cri-o://c9efa84853e5ed0a8c1b5aaaad9de93084a0922dbc3f807807fe8ba5c8b490a6" gracePeriod=10 Jun 15 04:36:39.673982 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:39.673952 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z8fzz" Jun 15 04:36:39.684686 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:39.684665 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-42xtr\" (UniqueName: \"kubernetes.io/projected/b85cbd25-c275-4754-9407-df9009c42562-kube-api-access-42xtr\") pod \"b85cbd25-c275-4754-9407-df9009c42562\" (UID: \"b85cbd25-c275-4754-9407-df9009c42562\") " Jun 15 04:36:39.684796 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:39.684700 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b85cbd25-c275-4754-9407-df9009c42562-extensions-socket-volume\") pod \"b85cbd25-c275-4754-9407-df9009c42562\" (UID: \"b85cbd25-c275-4754-9407-df9009c42562\") " Jun 15 04:36:39.685083 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:39.685057 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b85cbd25-c275-4754-9407-df9009c42562-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b85cbd25-c275-4754-9407-df9009c42562" (UID: "b85cbd25-c275-4754-9407-df9009c42562"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 04:36:39.686687 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:39.686664 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b85cbd25-c275-4754-9407-df9009c42562-kube-api-access-42xtr" (OuterVolumeSpecName: "kube-api-access-42xtr") pod "b85cbd25-c275-4754-9407-df9009c42562" (UID: "b85cbd25-c275-4754-9407-df9009c42562"). InnerVolumeSpecName "kube-api-access-42xtr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 04:36:39.754822 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:39.754779 2561 generic.go:356] "Generic (PLEG): container finished" podID="b85cbd25-c275-4754-9407-df9009c42562" containerID="c9efa84853e5ed0a8c1b5aaaad9de93084a0922dbc3f807807fe8ba5c8b490a6" exitCode=0 Jun 15 04:36:39.754822 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:39.754826 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z8fzz" Jun 15 04:36:39.754991 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:39.754860 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z8fzz" event={"ID":"b85cbd25-c275-4754-9407-df9009c42562","Type":"ContainerDied","Data":"c9efa84853e5ed0a8c1b5aaaad9de93084a0922dbc3f807807fe8ba5c8b490a6"} Jun 15 04:36:39.754991 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:39.754916 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z8fzz" event={"ID":"b85cbd25-c275-4754-9407-df9009c42562","Type":"ContainerDied","Data":"ab18bbf522baff722dc899e696556304b67a9c5eb0e0649764221fe02497cb30"} Jun 15 04:36:39.754991 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:39.754940 2561 scope.go:117] "RemoveContainer" containerID="c9efa84853e5ed0a8c1b5aaaad9de93084a0922dbc3f807807fe8ba5c8b490a6" Jun 15 04:36:39.764114 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:39.764096 2561 scope.go:117] "RemoveContainer" containerID="c9efa84853e5ed0a8c1b5aaaad9de93084a0922dbc3f807807fe8ba5c8b490a6" Jun 15 04:36:39.764362 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:36:39.764342 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9efa84853e5ed0a8c1b5aaaad9de93084a0922dbc3f807807fe8ba5c8b490a6\": container with ID starting with c9efa84853e5ed0a8c1b5aaaad9de93084a0922dbc3f807807fe8ba5c8b490a6 not found: ID does not exist" containerID="c9efa84853e5ed0a8c1b5aaaad9de93084a0922dbc3f807807fe8ba5c8b490a6" Jun 15 04:36:39.764409 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:39.764371 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9efa84853e5ed0a8c1b5aaaad9de93084a0922dbc3f807807fe8ba5c8b490a6"} err="failed to get container status \"c9efa84853e5ed0a8c1b5aaaad9de93084a0922dbc3f807807fe8ba5c8b490a6\": rpc error: code = NotFound desc = could not find container \"c9efa84853e5ed0a8c1b5aaaad9de93084a0922dbc3f807807fe8ba5c8b490a6\": container with ID starting with c9efa84853e5ed0a8c1b5aaaad9de93084a0922dbc3f807807fe8ba5c8b490a6 not found: ID does not exist" Jun 15 04:36:39.777774 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:39.777748 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z8fzz"] Jun 15 04:36:39.783499 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:39.783475 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-z8fzz"] Jun 15 04:36:39.786247 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:39.786198 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-42xtr\" (UniqueName: \"kubernetes.io/projected/b85cbd25-c275-4754-9407-df9009c42562-kube-api-access-42xtr\") on node \"ip-10-0-140-86.ec2.internal\" DevicePath \"\"" Jun 15 04:36:39.786247 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:39.786220 2561 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b85cbd25-c275-4754-9407-df9009c42562-extensions-socket-volume\") on node \"ip-10-0-140-86.ec2.internal\" DevicePath \"\"" Jun 15 04:36:40.826154 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:40.826120 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b85cbd25-c275-4754-9407-df9009c42562" path="/var/lib/kubelet/pods/b85cbd25-c275-4754-9407-df9009c42562/volumes" Jun 15 04:36:47.760066 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:47.760000 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7cbfd949db-rpg2j" podUID="0527aca7-d878-4a6c-8e91-3686bd5244c4" containerName="console" containerID="cri-o://128da59ca17be89457019f2bad73bd91d3db70d368bd8949553c1b47a99b7430" gracePeriod=15 Jun 15 04:36:48.015037 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:48.014976 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cbfd949db-rpg2j" Jun 15 04:36:48.060401 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:48.060372 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0527aca7-d878-4a6c-8e91-3686bd5244c4-console-serving-cert\") pod \"0527aca7-d878-4a6c-8e91-3686bd5244c4\" (UID: \"0527aca7-d878-4a6c-8e91-3686bd5244c4\") " Jun 15 04:36:48.060597 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:48.060409 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0527aca7-d878-4a6c-8e91-3686bd5244c4-console-oauth-config\") pod \"0527aca7-d878-4a6c-8e91-3686bd5244c4\" (UID: \"0527aca7-d878-4a6c-8e91-3686bd5244c4\") " Jun 15 04:36:48.060597 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:48.060507 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0527aca7-d878-4a6c-8e91-3686bd5244c4-trusted-ca-bundle\") pod \"0527aca7-d878-4a6c-8e91-3686bd5244c4\" (UID: \"0527aca7-d878-4a6c-8e91-3686bd5244c4\") " Jun 15 04:36:48.060597 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:48.060552 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0527aca7-d878-4a6c-8e91-3686bd5244c4-oauth-serving-cert\") pod \"0527aca7-d878-4a6c-8e91-3686bd5244c4\" (UID: \"0527aca7-d878-4a6c-8e91-3686bd5244c4\") " Jun 15 04:36:48.060776 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:48.060602 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0527aca7-d878-4a6c-8e91-3686bd5244c4-service-ca\") pod \"0527aca7-d878-4a6c-8e91-3686bd5244c4\" (UID: \"0527aca7-d878-4a6c-8e91-3686bd5244c4\") " Jun 15 04:36:48.060776 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:48.060634 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t2lv8\" (UniqueName: \"kubernetes.io/projected/0527aca7-d878-4a6c-8e91-3686bd5244c4-kube-api-access-t2lv8\") pod \"0527aca7-d878-4a6c-8e91-3686bd5244c4\" (UID: \"0527aca7-d878-4a6c-8e91-3686bd5244c4\") " Jun 15 04:36:48.060776 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:48.060674 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0527aca7-d878-4a6c-8e91-3686bd5244c4-console-config\") pod \"0527aca7-d878-4a6c-8e91-3686bd5244c4\" (UID: \"0527aca7-d878-4a6c-8e91-3686bd5244c4\") " Jun 15 04:36:48.060999 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:48.060957 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0527aca7-d878-4a6c-8e91-3686bd5244c4-service-ca" (OuterVolumeSpecName: "service-ca") pod "0527aca7-d878-4a6c-8e91-3686bd5244c4" (UID: "0527aca7-d878-4a6c-8e91-3686bd5244c4"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 04:36:48.060999 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:48.060974 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0527aca7-d878-4a6c-8e91-3686bd5244c4-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0527aca7-d878-4a6c-8e91-3686bd5244c4" (UID: "0527aca7-d878-4a6c-8e91-3686bd5244c4"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 04:36:48.061123 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:48.060998 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0527aca7-d878-4a6c-8e91-3686bd5244c4-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "0527aca7-d878-4a6c-8e91-3686bd5244c4" (UID: "0527aca7-d878-4a6c-8e91-3686bd5244c4"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 04:36:48.061232 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:48.061210 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0527aca7-d878-4a6c-8e91-3686bd5244c4-console-config" (OuterVolumeSpecName: "console-config") pod "0527aca7-d878-4a6c-8e91-3686bd5244c4" (UID: "0527aca7-d878-4a6c-8e91-3686bd5244c4"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 04:36:48.062660 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:48.062635 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0527aca7-d878-4a6c-8e91-3686bd5244c4-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0527aca7-d878-4a6c-8e91-3686bd5244c4" (UID: "0527aca7-d878-4a6c-8e91-3686bd5244c4"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 04:36:48.062778 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:48.062756 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0527aca7-d878-4a6c-8e91-3686bd5244c4-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0527aca7-d878-4a6c-8e91-3686bd5244c4" (UID: "0527aca7-d878-4a6c-8e91-3686bd5244c4"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 04:36:48.062842 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:48.062801 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0527aca7-d878-4a6c-8e91-3686bd5244c4-kube-api-access-t2lv8" (OuterVolumeSpecName: "kube-api-access-t2lv8") pod "0527aca7-d878-4a6c-8e91-3686bd5244c4" (UID: "0527aca7-d878-4a6c-8e91-3686bd5244c4"). InnerVolumeSpecName "kube-api-access-t2lv8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 04:36:48.161934 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:48.161905 2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0527aca7-d878-4a6c-8e91-3686bd5244c4-console-config\") on node \"ip-10-0-140-86.ec2.internal\" DevicePath \"\"" Jun 15 04:36:48.161934 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:48.161929 2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0527aca7-d878-4a6c-8e91-3686bd5244c4-console-serving-cert\") on node \"ip-10-0-140-86.ec2.internal\" DevicePath \"\"" Jun 15 04:36:48.161934 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:48.161939 2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0527aca7-d878-4a6c-8e91-3686bd5244c4-console-oauth-config\") on node \"ip-10-0-140-86.ec2.internal\" DevicePath \"\"" Jun 15 04:36:48.162146 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:48.161947 2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0527aca7-d878-4a6c-8e91-3686bd5244c4-trusted-ca-bundle\") on node \"ip-10-0-140-86.ec2.internal\" DevicePath \"\"" Jun 15 04:36:48.162146 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:48.161956 2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0527aca7-d878-4a6c-8e91-3686bd5244c4-oauth-serving-cert\") on node \"ip-10-0-140-86.ec2.internal\" DevicePath \"\"" Jun 15 04:36:48.162146 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:48.161964 2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0527aca7-d878-4a6c-8e91-3686bd5244c4-service-ca\") on node \"ip-10-0-140-86.ec2.internal\" DevicePath \"\"" Jun 15 04:36:48.162146 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:48.161974 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t2lv8\" (UniqueName: \"kubernetes.io/projected/0527aca7-d878-4a6c-8e91-3686bd5244c4-kube-api-access-t2lv8\") on node \"ip-10-0-140-86.ec2.internal\" DevicePath \"\"" Jun 15 04:36:48.807017 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:48.806983 2561 generic.go:356] "Generic (PLEG): container finished" podID="0527aca7-d878-4a6c-8e91-3686bd5244c4" containerID="128da59ca17be89457019f2bad73bd91d3db70d368bd8949553c1b47a99b7430" exitCode=0 Jun 15 04:36:48.807395 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:48.807032 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cbfd949db-rpg2j" Jun 15 04:36:48.807395 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:48.807063 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cbfd949db-rpg2j" event={"ID":"0527aca7-d878-4a6c-8e91-3686bd5244c4","Type":"ContainerDied","Data":"128da59ca17be89457019f2bad73bd91d3db70d368bd8949553c1b47a99b7430"} Jun 15 04:36:48.807395 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:48.807119 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cbfd949db-rpg2j" event={"ID":"0527aca7-d878-4a6c-8e91-3686bd5244c4","Type":"ContainerDied","Data":"0eb196a93da7634dfd7e0fc469c24b027f8c6e6e8920f5ad36c9627a4d5a650b"} Jun 15 04:36:48.807395 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:48.807148 2561 scope.go:117] "RemoveContainer" containerID="128da59ca17be89457019f2bad73bd91d3db70d368bd8949553c1b47a99b7430" Jun 15 04:36:48.817341 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:48.817319 2561 scope.go:117] "RemoveContainer" containerID="128da59ca17be89457019f2bad73bd91d3db70d368bd8949553c1b47a99b7430" Jun 15 04:36:48.817633 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:36:48.817613 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"128da59ca17be89457019f2bad73bd91d3db70d368bd8949553c1b47a99b7430\": container with ID starting with 128da59ca17be89457019f2bad73bd91d3db70d368bd8949553c1b47a99b7430 not found: ID does not exist" containerID="128da59ca17be89457019f2bad73bd91d3db70d368bd8949553c1b47a99b7430" Jun 15 04:36:48.817713 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:48.817641 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"128da59ca17be89457019f2bad73bd91d3db70d368bd8949553c1b47a99b7430"} err="failed to get container status \"128da59ca17be89457019f2bad73bd91d3db70d368bd8949553c1b47a99b7430\": rpc error: code = NotFound desc = could not find container \"128da59ca17be89457019f2bad73bd91d3db70d368bd8949553c1b47a99b7430\": container with ID starting with 128da59ca17be89457019f2bad73bd91d3db70d368bd8949553c1b47a99b7430 not found: ID does not exist" Jun 15 04:36:48.836313 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:48.836286 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7cbfd949db-rpg2j"] Jun 15 04:36:48.840652 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:48.840628 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7cbfd949db-rpg2j"] Jun 15 04:36:50.824665 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:50.824632 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0527aca7-d878-4a6c-8e91-3686bd5244c4" path="/var/lib/kubelet/pods/0527aca7-d878-4a6c-8e91-3686bd5244c4/volumes" Jun 15 04:36:54.725328 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:54.725290 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-52z6d"] Jun 15 04:36:54.725898 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:54.725878 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0527aca7-d878-4a6c-8e91-3686bd5244c4" containerName="console" Jun 15 04:36:54.725983 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:54.725901 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="0527aca7-d878-4a6c-8e91-3686bd5244c4" containerName="console" Jun 15 04:36:54.725983 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:54.725942 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b85cbd25-c275-4754-9407-df9009c42562" containerName="manager" Jun 15 04:36:54.725983 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:54.725951 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b85cbd25-c275-4754-9407-df9009c42562" containerName="manager" Jun 15 04:36:54.726131 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:54.726046 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="b85cbd25-c275-4754-9407-df9009c42562" containerName="manager" Jun 15 04:36:54.726131 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:54.726060 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="0527aca7-d878-4a6c-8e91-3686bd5244c4" containerName="console" Jun 15 04:36:54.730945 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:54.730923 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-52z6d" Jun 15 04:36:54.733121 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:54.733101 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-kqb5r\"" Jun 15 04:36:54.741163 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:54.741137 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-52z6d"] Jun 15 04:36:54.823463 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:54.823419 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd4117cb-4e31-4833-b8fa-cffe57c8b8c8-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-52z6d\" (UID: \"dd4117cb-4e31-4833-b8fa-cffe57c8b8c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-52z6d" Jun 15 04:36:54.823463 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:54.823467 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd4117cb-4e31-4833-b8fa-cffe57c8b8c8-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-52z6d\" (UID: \"dd4117cb-4e31-4833-b8fa-cffe57c8b8c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-52z6d" Jun 15 04:36:54.823719 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:54.823495 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd4117cb-4e31-4833-b8fa-cffe57c8b8c8-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-52z6d\" (UID: \"dd4117cb-4e31-4833-b8fa-cffe57c8b8c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-52z6d" Jun 15 04:36:54.823719 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:54.823557 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9v48c\" (UniqueName: \"kubernetes.io/projected/dd4117cb-4e31-4833-b8fa-cffe57c8b8c8-kube-api-access-9v48c\") pod \"maas-default-gateway-openshift-default-687ff6996-52z6d\" (UID: \"dd4117cb-4e31-4833-b8fa-cffe57c8b8c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-52z6d" Jun 15 04:36:54.823719 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:54.823596 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd4117cb-4e31-4833-b8fa-cffe57c8b8c8-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-52z6d\" (UID: \"dd4117cb-4e31-4833-b8fa-cffe57c8b8c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-52z6d" Jun 15 04:36:54.823719 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:54.823614 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd4117cb-4e31-4833-b8fa-cffe57c8b8c8-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-52z6d\" (UID: \"dd4117cb-4e31-4833-b8fa-cffe57c8b8c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-52z6d" Jun 15 04:36:54.823719 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:54.823686 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd4117cb-4e31-4833-b8fa-cffe57c8b8c8-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-52z6d\" (UID: \"dd4117cb-4e31-4833-b8fa-cffe57c8b8c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-52z6d" Jun 15 04:36:54.823719 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:54.823718 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd4117cb-4e31-4833-b8fa-cffe57c8b8c8-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-52z6d\" (UID: \"dd4117cb-4e31-4833-b8fa-cffe57c8b8c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-52z6d" Jun 15 04:36:54.824031 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:54.823748 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd4117cb-4e31-4833-b8fa-cffe57c8b8c8-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-52z6d\" (UID: \"dd4117cb-4e31-4833-b8fa-cffe57c8b8c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-52z6d" Jun 15 04:36:54.924982 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:54.924942 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd4117cb-4e31-4833-b8fa-cffe57c8b8c8-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-52z6d\" (UID: \"dd4117cb-4e31-4833-b8fa-cffe57c8b8c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-52z6d" Jun 15 04:36:54.924982 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:54.924983 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd4117cb-4e31-4833-b8fa-cffe57c8b8c8-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-52z6d\" (UID: \"dd4117cb-4e31-4833-b8fa-cffe57c8b8c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-52z6d" Jun 15 04:36:54.925242 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:54.925019 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd4117cb-4e31-4833-b8fa-cffe57c8b8c8-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-52z6d\" (UID: \"dd4117cb-4e31-4833-b8fa-cffe57c8b8c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-52z6d" Jun 15 04:36:54.925242 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:54.925070 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd4117cb-4e31-4833-b8fa-cffe57c8b8c8-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-52z6d\" (UID: \"dd4117cb-4e31-4833-b8fa-cffe57c8b8c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-52z6d" Jun 15 04:36:54.925242 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:54.925094 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd4117cb-4e31-4833-b8fa-cffe57c8b8c8-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-52z6d\" (UID: \"dd4117cb-4e31-4833-b8fa-cffe57c8b8c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-52z6d" Jun 15 04:36:54.925242 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:54.925122 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd4117cb-4e31-4833-b8fa-cffe57c8b8c8-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-52z6d\" (UID: \"dd4117cb-4e31-4833-b8fa-cffe57c8b8c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-52z6d" Jun 15 04:36:54.925242 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:54.925161 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9v48c\" (UniqueName: \"kubernetes.io/projected/dd4117cb-4e31-4833-b8fa-cffe57c8b8c8-kube-api-access-9v48c\") pod \"maas-default-gateway-openshift-default-687ff6996-52z6d\" (UID: \"dd4117cb-4e31-4833-b8fa-cffe57c8b8c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-52z6d" Jun 15 04:36:54.925242 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:54.925202 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd4117cb-4e31-4833-b8fa-cffe57c8b8c8-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-52z6d\" (UID: \"dd4117cb-4e31-4833-b8fa-cffe57c8b8c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-52z6d" Jun 15 04:36:54.925242 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:54.925226 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd4117cb-4e31-4833-b8fa-cffe57c8b8c8-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-52z6d\" (UID: \"dd4117cb-4e31-4833-b8fa-cffe57c8b8c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-52z6d" Jun 15 04:36:54.925604 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:54.925407 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd4117cb-4e31-4833-b8fa-cffe57c8b8c8-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-52z6d\" (UID: \"dd4117cb-4e31-4833-b8fa-cffe57c8b8c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-52z6d" Jun 15 04:36:54.925604 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:54.925482 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd4117cb-4e31-4833-b8fa-cffe57c8b8c8-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-52z6d\" (UID: \"dd4117cb-4e31-4833-b8fa-cffe57c8b8c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-52z6d" Jun 15 04:36:54.925684 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:54.925606 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd4117cb-4e31-4833-b8fa-cffe57c8b8c8-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-52z6d\" (UID: \"dd4117cb-4e31-4833-b8fa-cffe57c8b8c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-52z6d" Jun 15 04:36:54.925843 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:54.925821 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd4117cb-4e31-4833-b8fa-cffe57c8b8c8-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-52z6d\" (UID: \"dd4117cb-4e31-4833-b8fa-cffe57c8b8c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-52z6d" Jun 15 04:36:54.926091 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:54.926071 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd4117cb-4e31-4833-b8fa-cffe57c8b8c8-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-52z6d\" (UID: \"dd4117cb-4e31-4833-b8fa-cffe57c8b8c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-52z6d" Jun 15 04:36:54.928162 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:54.928140 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd4117cb-4e31-4833-b8fa-cffe57c8b8c8-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-52z6d\" (UID: \"dd4117cb-4e31-4833-b8fa-cffe57c8b8c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-52z6d" Jun 15 04:36:54.928374 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:54.928357 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd4117cb-4e31-4833-b8fa-cffe57c8b8c8-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-52z6d\" (UID: \"dd4117cb-4e31-4833-b8fa-cffe57c8b8c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-52z6d" Jun 15 04:36:54.934722 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:54.934694 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd4117cb-4e31-4833-b8fa-cffe57c8b8c8-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-52z6d\" (UID: \"dd4117cb-4e31-4833-b8fa-cffe57c8b8c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-52z6d" Jun 15 04:36:54.934957 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:54.934935 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9v48c\" (UniqueName: \"kubernetes.io/projected/dd4117cb-4e31-4833-b8fa-cffe57c8b8c8-kube-api-access-9v48c\") pod \"maas-default-gateway-openshift-default-687ff6996-52z6d\" (UID: \"dd4117cb-4e31-4833-b8fa-cffe57c8b8c8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-52z6d" Jun 15 04:36:55.042707 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:55.042616 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-52z6d" Jun 15 04:36:55.180230 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:55.180201 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-52z6d"] Jun 15 04:36:55.181565 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:36:55.181532 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd4117cb_4e31_4833_b8fa_cffe57c8b8c8.slice/crio-5bcab875960462052e7635f3ec7f0576f8fb5832d02c38f1361ad8da1c85174a WatchSource:0}: Error finding container 5bcab875960462052e7635f3ec7f0576f8fb5832d02c38f1361ad8da1c85174a: Status 404 returned error can't find the container with id 5bcab875960462052e7635f3ec7f0576f8fb5832d02c38f1361ad8da1c85174a Jun 15 04:36:55.183672 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:55.183640 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 15 04:36:55.183783 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:55.183706 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 15 04:36:55.183783 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:55.183734 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 15 04:36:55.854106 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:55.854066 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-52z6d" event={"ID":"dd4117cb-4e31-4833-b8fa-cffe57c8b8c8","Type":"ContainerStarted","Data":"d3c0b09811e87ce00b8fa7b8eeec1fa250ad0e4696da3f3cbb98b65256c01e5f"} Jun 15 04:36:55.854522 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:55.854135 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-52z6d" event={"ID":"dd4117cb-4e31-4833-b8fa-cffe57c8b8c8","Type":"ContainerStarted","Data":"5bcab875960462052e7635f3ec7f0576f8fb5832d02c38f1361ad8da1c85174a"} Jun 15 04:36:55.878188 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:55.878135 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-52z6d" podStartSLOduration=1.8781208299999999 podStartE2EDuration="1.87812083s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 04:36:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:36:55.876877287 +0000 UTC m=+691.404868192" watchObservedRunningTime="2026-06-15 04:36:55.87812083 +0000 UTC m=+691.406111735" Jun 15 04:36:56.043136 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:56.043099 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-52z6d" Jun 15 04:36:56.047973 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:56.047949 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-52z6d" Jun 15 04:36:56.859918 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:56.859883 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-52z6d" Jun 15 04:36:56.860772 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:36:56.860750 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-52z6d" Jun 15 04:37:01.016156 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:01.016122 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-4rk6j"] Jun 15 04:37:01.019944 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:01.019928 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-4rk6j" Jun 15 04:37:01.022096 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:01.022075 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-rdghc\"" Jun 15 04:37:01.022200 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:01.022112 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 15 04:37:01.030528 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:01.030507 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-4rk6j"] Jun 15 04:37:01.077904 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:01.077860 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbd5v\" (UniqueName: \"kubernetes.io/projected/934a5239-a49d-4373-82f3-3254f8c0eaab-kube-api-access-bbd5v\") pod \"limitador-limitador-64c94fd64f-4rk6j\" (UID: \"934a5239-a49d-4373-82f3-3254f8c0eaab\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-4rk6j" Jun 15 04:37:01.078274 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:01.078247 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/934a5239-a49d-4373-82f3-3254f8c0eaab-config-file\") pod \"limitador-limitador-64c94fd64f-4rk6j\" (UID: \"934a5239-a49d-4373-82f3-3254f8c0eaab\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-4rk6j" Jun 15 04:37:01.110473 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:01.110431 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-4rk6j"] Jun 15 04:37:01.178964 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:01.178931 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/934a5239-a49d-4373-82f3-3254f8c0eaab-config-file\") pod \"limitador-limitador-64c94fd64f-4rk6j\" (UID: \"934a5239-a49d-4373-82f3-3254f8c0eaab\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-4rk6j" Jun 15 04:37:01.179131 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:01.178976 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbd5v\" (UniqueName: \"kubernetes.io/projected/934a5239-a49d-4373-82f3-3254f8c0eaab-kube-api-access-bbd5v\") pod \"limitador-limitador-64c94fd64f-4rk6j\" (UID: \"934a5239-a49d-4373-82f3-3254f8c0eaab\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-4rk6j" Jun 15 04:37:01.179647 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:01.179624 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/934a5239-a49d-4373-82f3-3254f8c0eaab-config-file\") pod \"limitador-limitador-64c94fd64f-4rk6j\" (UID: \"934a5239-a49d-4373-82f3-3254f8c0eaab\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-4rk6j" Jun 15 04:37:01.186606 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:01.186584 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbd5v\" (UniqueName: \"kubernetes.io/projected/934a5239-a49d-4373-82f3-3254f8c0eaab-kube-api-access-bbd5v\") pod \"limitador-limitador-64c94fd64f-4rk6j\" (UID: \"934a5239-a49d-4373-82f3-3254f8c0eaab\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-4rk6j" Jun 15 04:37:01.332668 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:01.332571 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-4rk6j" Jun 15 04:37:01.462523 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:01.462492 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-4rk6j"] Jun 15 04:37:01.464265 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:37:01.464240 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod934a5239_a49d_4373_82f3_3254f8c0eaab.slice/crio-961812a6b60d178bb67aa1b11f1728e933b064c5bee7d9dc89c36e0a2f6a30be WatchSource:0}: Error finding container 961812a6b60d178bb67aa1b11f1728e933b064c5bee7d9dc89c36e0a2f6a30be: Status 404 returned error can't find the container with id 961812a6b60d178bb67aa1b11f1728e933b064c5bee7d9dc89c36e0a2f6a30be Jun 15 04:37:01.814980 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:01.814942 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-49dx2"] Jun 15 04:37:01.820191 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:01.820167 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-49dx2" Jun 15 04:37:01.822535 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:01.822511 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-ppwxw\"" Jun 15 04:37:01.828758 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:01.828738 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-49dx2"] Jun 15 04:37:01.885572 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:01.885533 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhl2x\" (UniqueName: \"kubernetes.io/projected/f06c34a1-5594-4e7b-8bda-ee966d02ee3b-kube-api-access-bhl2x\") pod \"authorino-58cd955675-49dx2\" (UID: \"f06c34a1-5594-4e7b-8bda-ee966d02ee3b\") " pod="kuadrant-system/authorino-58cd955675-49dx2" Jun 15 04:37:01.887906 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:01.887880 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-4rk6j" event={"ID":"934a5239-a49d-4373-82f3-3254f8c0eaab","Type":"ContainerStarted","Data":"961812a6b60d178bb67aa1b11f1728e933b064c5bee7d9dc89c36e0a2f6a30be"} Jun 15 04:37:01.987020 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:01.986986 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhl2x\" (UniqueName: \"kubernetes.io/projected/f06c34a1-5594-4e7b-8bda-ee966d02ee3b-kube-api-access-bhl2x\") pod \"authorino-58cd955675-49dx2\" (UID: \"f06c34a1-5594-4e7b-8bda-ee966d02ee3b\") " pod="kuadrant-system/authorino-58cd955675-49dx2" Jun 15 04:37:01.995001 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:01.994970 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhl2x\" (UniqueName: \"kubernetes.io/projected/f06c34a1-5594-4e7b-8bda-ee966d02ee3b-kube-api-access-bhl2x\") pod \"authorino-58cd955675-49dx2\" (UID: \"f06c34a1-5594-4e7b-8bda-ee966d02ee3b\") " pod="kuadrant-system/authorino-58cd955675-49dx2" Jun 15 04:37:02.131258 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:02.131177 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-49dx2" Jun 15 04:37:02.320203 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:02.320163 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-49dx2"] Jun 15 04:37:02.895898 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:02.895856 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-49dx2" event={"ID":"f06c34a1-5594-4e7b-8bda-ee966d02ee3b","Type":"ContainerStarted","Data":"d195afd75da9f9df11b4f5fc1a841d6e7c8e051621a702e7056dd5000c8de5f8"} Jun 15 04:37:06.923856 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:06.923818 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-4rk6j" event={"ID":"934a5239-a49d-4373-82f3-3254f8c0eaab","Type":"ContainerStarted","Data":"e560342c2c1cae30f7d78ac608d38f2b35b3bab1f494bddaa6457bc0428e61d1"} Jun 15 04:37:06.924316 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:06.923876 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-4rk6j" Jun 15 04:37:06.925350 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:06.925326 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-49dx2" event={"ID":"f06c34a1-5594-4e7b-8bda-ee966d02ee3b","Type":"ContainerStarted","Data":"c8c5c5096d50d2b5aabc85dee0dbe9e1aa3c1a02c6dbc20cb867acd11f15cfa6"} Jun 15 04:37:06.941481 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:06.941419 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-4rk6j" podStartSLOduration=2.434732618 podStartE2EDuration="6.941404439s" totalImagesPullingTime="4.506671821s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 04:37:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:37:06.939791154 +0000 UTC m=+702.467782060" watchObservedRunningTime="2026-06-15 04:37:06.941404439 +0000 UTC m=+702.469395344" Jun 15 04:37:06.953356 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:06.953311 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-49dx2" podStartSLOduration=2.255696311 podStartE2EDuration="5.953297643s" totalImagesPullingTime="3.697601332s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 04:37:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:37:06.952318531 +0000 UTC m=+702.480309439" watchObservedRunningTime="2026-06-15 04:37:06.953297643 +0000 UTC m=+702.481288580" Jun 15 04:37:07.680759 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:07.680717 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-49dx2"] Jun 15 04:37:08.936579 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:08.936539 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-49dx2" podUID="f06c34a1-5594-4e7b-8bda-ee966d02ee3b" containerName="authorino" containerID="cri-o://c8c5c5096d50d2b5aabc85dee0dbe9e1aa3c1a02c6dbc20cb867acd11f15cfa6" gracePeriod=30 Jun 15 04:37:09.192571 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:09.192515 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-49dx2" Jun 15 04:37:09.361119 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:09.361091 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bhl2x\" (UniqueName: \"kubernetes.io/projected/f06c34a1-5594-4e7b-8bda-ee966d02ee3b-kube-api-access-bhl2x\") pod \"f06c34a1-5594-4e7b-8bda-ee966d02ee3b\" (UID: \"f06c34a1-5594-4e7b-8bda-ee966d02ee3b\") " Jun 15 04:37:09.363138 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:09.363101 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f06c34a1-5594-4e7b-8bda-ee966d02ee3b-kube-api-access-bhl2x" (OuterVolumeSpecName: "kube-api-access-bhl2x") pod "f06c34a1-5594-4e7b-8bda-ee966d02ee3b" (UID: "f06c34a1-5594-4e7b-8bda-ee966d02ee3b"). InnerVolumeSpecName "kube-api-access-bhl2x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 04:37:09.462275 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:09.462192 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bhl2x\" (UniqueName: \"kubernetes.io/projected/f06c34a1-5594-4e7b-8bda-ee966d02ee3b-kube-api-access-bhl2x\") on node \"ip-10-0-140-86.ec2.internal\" DevicePath \"\"" Jun 15 04:37:09.944289 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:09.944249 2561 generic.go:356] "Generic (PLEG): container finished" podID="f06c34a1-5594-4e7b-8bda-ee966d02ee3b" containerID="c8c5c5096d50d2b5aabc85dee0dbe9e1aa3c1a02c6dbc20cb867acd11f15cfa6" exitCode=0 Jun 15 04:37:09.944729 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:09.944295 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-49dx2" Jun 15 04:37:09.944729 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:09.944333 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-49dx2" event={"ID":"f06c34a1-5594-4e7b-8bda-ee966d02ee3b","Type":"ContainerDied","Data":"c8c5c5096d50d2b5aabc85dee0dbe9e1aa3c1a02c6dbc20cb867acd11f15cfa6"} Jun 15 04:37:09.944729 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:09.944381 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-49dx2" event={"ID":"f06c34a1-5594-4e7b-8bda-ee966d02ee3b","Type":"ContainerDied","Data":"d195afd75da9f9df11b4f5fc1a841d6e7c8e051621a702e7056dd5000c8de5f8"} Jun 15 04:37:09.944729 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:09.944398 2561 scope.go:117] "RemoveContainer" containerID="c8c5c5096d50d2b5aabc85dee0dbe9e1aa3c1a02c6dbc20cb867acd11f15cfa6" Jun 15 04:37:09.953752 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:09.953731 2561 scope.go:117] "RemoveContainer" containerID="c8c5c5096d50d2b5aabc85dee0dbe9e1aa3c1a02c6dbc20cb867acd11f15cfa6" Jun 15 04:37:09.954008 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:37:09.953989 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8c5c5096d50d2b5aabc85dee0dbe9e1aa3c1a02c6dbc20cb867acd11f15cfa6\": container with ID starting with c8c5c5096d50d2b5aabc85dee0dbe9e1aa3c1a02c6dbc20cb867acd11f15cfa6 not found: ID does not exist" containerID="c8c5c5096d50d2b5aabc85dee0dbe9e1aa3c1a02c6dbc20cb867acd11f15cfa6" Jun 15 04:37:09.954057 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:09.954015 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8c5c5096d50d2b5aabc85dee0dbe9e1aa3c1a02c6dbc20cb867acd11f15cfa6"} err="failed to get container status \"c8c5c5096d50d2b5aabc85dee0dbe9e1aa3c1a02c6dbc20cb867acd11f15cfa6\": rpc error: code = NotFound desc = could not find container \"c8c5c5096d50d2b5aabc85dee0dbe9e1aa3c1a02c6dbc20cb867acd11f15cfa6\": container with ID starting with c8c5c5096d50d2b5aabc85dee0dbe9e1aa3c1a02c6dbc20cb867acd11f15cfa6 not found: ID does not exist" Jun 15 04:37:09.965369 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:09.965335 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-49dx2"] Jun 15 04:37:09.969490 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:09.969470 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-49dx2"] Jun 15 04:37:10.826140 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:10.826099 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f06c34a1-5594-4e7b-8bda-ee966d02ee3b" path="/var/lib/kubelet/pods/f06c34a1-5594-4e7b-8bda-ee966d02ee3b/volumes" Jun 15 04:37:17.932286 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:17.932253 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-4rk6j" Jun 15 04:37:18.682709 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:18.682673 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-4rk6j"] Jun 15 04:37:18.682903 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:18.682868 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-4rk6j" podUID="934a5239-a49d-4373-82f3-3254f8c0eaab" containerName="limitador" containerID="cri-o://e560342c2c1cae30f7d78ac608d38f2b35b3bab1f494bddaa6457bc0428e61d1" gracePeriod=30 Jun 15 04:37:19.236734 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:19.236708 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-4rk6j" Jun 15 04:37:19.251551 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:19.251230 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/934a5239-a49d-4373-82f3-3254f8c0eaab-config-file\") pod \"934a5239-a49d-4373-82f3-3254f8c0eaab\" (UID: \"934a5239-a49d-4373-82f3-3254f8c0eaab\") " Jun 15 04:37:19.251551 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:19.251298 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bbd5v\" (UniqueName: \"kubernetes.io/projected/934a5239-a49d-4373-82f3-3254f8c0eaab-kube-api-access-bbd5v\") pod \"934a5239-a49d-4373-82f3-3254f8c0eaab\" (UID: \"934a5239-a49d-4373-82f3-3254f8c0eaab\") " Jun 15 04:37:19.251740 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:19.251644 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/934a5239-a49d-4373-82f3-3254f8c0eaab-config-file" (OuterVolumeSpecName: "config-file") pod "934a5239-a49d-4373-82f3-3254f8c0eaab" (UID: "934a5239-a49d-4373-82f3-3254f8c0eaab"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 04:37:19.253664 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:19.253628 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/934a5239-a49d-4373-82f3-3254f8c0eaab-kube-api-access-bbd5v" (OuterVolumeSpecName: "kube-api-access-bbd5v") pod "934a5239-a49d-4373-82f3-3254f8c0eaab" (UID: "934a5239-a49d-4373-82f3-3254f8c0eaab"). InnerVolumeSpecName "kube-api-access-bbd5v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 04:37:19.352742 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:19.352706 2561 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/934a5239-a49d-4373-82f3-3254f8c0eaab-config-file\") on node \"ip-10-0-140-86.ec2.internal\" DevicePath \"\"" Jun 15 04:37:19.352742 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:19.352732 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bbd5v\" (UniqueName: \"kubernetes.io/projected/934a5239-a49d-4373-82f3-3254f8c0eaab-kube-api-access-bbd5v\") on node \"ip-10-0-140-86.ec2.internal\" DevicePath \"\"" Jun 15 04:37:20.005578 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:20.005544 2561 generic.go:356] "Generic (PLEG): container finished" podID="934a5239-a49d-4373-82f3-3254f8c0eaab" containerID="e560342c2c1cae30f7d78ac608d38f2b35b3bab1f494bddaa6457bc0428e61d1" exitCode=0 Jun 15 04:37:20.005769 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:20.005590 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-4rk6j" Jun 15 04:37:20.005769 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:20.005632 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-4rk6j" event={"ID":"934a5239-a49d-4373-82f3-3254f8c0eaab","Type":"ContainerDied","Data":"e560342c2c1cae30f7d78ac608d38f2b35b3bab1f494bddaa6457bc0428e61d1"} Jun 15 04:37:20.005769 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:20.005695 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-4rk6j" event={"ID":"934a5239-a49d-4373-82f3-3254f8c0eaab","Type":"ContainerDied","Data":"961812a6b60d178bb67aa1b11f1728e933b064c5bee7d9dc89c36e0a2f6a30be"} Jun 15 04:37:20.005769 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:20.005726 2561 scope.go:117] "RemoveContainer" containerID="e560342c2c1cae30f7d78ac608d38f2b35b3bab1f494bddaa6457bc0428e61d1" Jun 15 04:37:20.014926 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:20.014910 2561 scope.go:117] "RemoveContainer" containerID="e560342c2c1cae30f7d78ac608d38f2b35b3bab1f494bddaa6457bc0428e61d1" Jun 15 04:37:20.015195 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:37:20.015176 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e560342c2c1cae30f7d78ac608d38f2b35b3bab1f494bddaa6457bc0428e61d1\": container with ID starting with e560342c2c1cae30f7d78ac608d38f2b35b3bab1f494bddaa6457bc0428e61d1 not found: ID does not exist" containerID="e560342c2c1cae30f7d78ac608d38f2b35b3bab1f494bddaa6457bc0428e61d1" Jun 15 04:37:20.015240 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:20.015206 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e560342c2c1cae30f7d78ac608d38f2b35b3bab1f494bddaa6457bc0428e61d1"} err="failed to get container status \"e560342c2c1cae30f7d78ac608d38f2b35b3bab1f494bddaa6457bc0428e61d1\": rpc error: code = NotFound desc = could not find container \"e560342c2c1cae30f7d78ac608d38f2b35b3bab1f494bddaa6457bc0428e61d1\": container with ID starting with e560342c2c1cae30f7d78ac608d38f2b35b3bab1f494bddaa6457bc0428e61d1 not found: ID does not exist" Jun 15 04:37:20.026287 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:20.026263 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-4rk6j"] Jun 15 04:37:20.032378 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:20.032355 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-4rk6j"] Jun 15 04:37:20.825387 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:20.825353 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="934a5239-a49d-4373-82f3-3254f8c0eaab" path="/var/lib/kubelet/pods/934a5239-a49d-4373-82f3-3254f8c0eaab/volumes" Jun 15 04:37:23.476787 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:23.476754 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-hxdn6"] Jun 15 04:37:23.477249 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:23.477145 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="934a5239-a49d-4373-82f3-3254f8c0eaab" containerName="limitador" Jun 15 04:37:23.477249 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:23.477156 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="934a5239-a49d-4373-82f3-3254f8c0eaab" containerName="limitador" Jun 15 04:37:23.477249 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:23.477174 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f06c34a1-5594-4e7b-8bda-ee966d02ee3b" containerName="authorino" Jun 15 04:37:23.477249 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:23.477180 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f06c34a1-5594-4e7b-8bda-ee966d02ee3b" containerName="authorino" Jun 15 04:37:23.477249 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:23.477240 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="f06c34a1-5594-4e7b-8bda-ee966d02ee3b" containerName="authorino" Jun 15 04:37:23.477249 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:23.477249 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="934a5239-a49d-4373-82f3-3254f8c0eaab" containerName="limitador" Jun 15 04:37:23.481758 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:23.481737 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-hxdn6" Jun 15 04:37:23.483737 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:23.483714 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 15 04:37:23.489970 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:23.489945 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-hxdn6"] Jun 15 04:37:23.592051 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:23.592019 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/01bb059b-3031-449c-91e4-c8270aa7aa58-data\") pod \"postgres-69fb4594cf-hxdn6\" (UID: \"01bb059b-3031-449c-91e4-c8270aa7aa58\") " pod="opendatahub/postgres-69fb4594cf-hxdn6" Jun 15 04:37:23.592228 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:23.592092 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgzgq\" (UniqueName: \"kubernetes.io/projected/01bb059b-3031-449c-91e4-c8270aa7aa58-kube-api-access-sgzgq\") pod \"postgres-69fb4594cf-hxdn6\" (UID: \"01bb059b-3031-449c-91e4-c8270aa7aa58\") " pod="opendatahub/postgres-69fb4594cf-hxdn6" Jun 15 04:37:23.692779 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:23.692745 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgzgq\" (UniqueName: \"kubernetes.io/projected/01bb059b-3031-449c-91e4-c8270aa7aa58-kube-api-access-sgzgq\") pod \"postgres-69fb4594cf-hxdn6\" (UID: \"01bb059b-3031-449c-91e4-c8270aa7aa58\") " pod="opendatahub/postgres-69fb4594cf-hxdn6" Jun 15 04:37:23.692961 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:23.692855 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/01bb059b-3031-449c-91e4-c8270aa7aa58-data\") pod \"postgres-69fb4594cf-hxdn6\" (UID: \"01bb059b-3031-449c-91e4-c8270aa7aa58\") " pod="opendatahub/postgres-69fb4594cf-hxdn6" Jun 15 04:37:23.693230 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:23.693213 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/01bb059b-3031-449c-91e4-c8270aa7aa58-data\") pod \"postgres-69fb4594cf-hxdn6\" (UID: \"01bb059b-3031-449c-91e4-c8270aa7aa58\") " pod="opendatahub/postgres-69fb4594cf-hxdn6" Jun 15 04:37:23.700266 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:23.700240 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgzgq\" (UniqueName: \"kubernetes.io/projected/01bb059b-3031-449c-91e4-c8270aa7aa58-kube-api-access-sgzgq\") pod \"postgres-69fb4594cf-hxdn6\" (UID: \"01bb059b-3031-449c-91e4-c8270aa7aa58\") " pod="opendatahub/postgres-69fb4594cf-hxdn6" Jun 15 04:37:23.793967 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:23.793870 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-hxdn6" Jun 15 04:37:23.924279 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:23.924251 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-hxdn6"] Jun 15 04:37:23.925508 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:37:23.925478 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01bb059b_3031_449c_91e4_c8270aa7aa58.slice/crio-e3d902b5a9007ccce9595635cc347b5c6cdc21533914940ef0c3148c4dd639a9 WatchSource:0}: Error finding container e3d902b5a9007ccce9595635cc347b5c6cdc21533914940ef0c3148c4dd639a9: Status 404 returned error can't find the container with id e3d902b5a9007ccce9595635cc347b5c6cdc21533914940ef0c3148c4dd639a9 Jun 15 04:37:24.031628 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:24.031594 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-hxdn6" event={"ID":"01bb059b-3031-449c-91e4-c8270aa7aa58","Type":"ContainerStarted","Data":"e3d902b5a9007ccce9595635cc347b5c6cdc21533914940ef0c3148c4dd639a9"} Jun 15 04:37:26.166261 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:26.166238 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 15 04:37:27.057433 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:27.057387 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-hxdn6" event={"ID":"01bb059b-3031-449c-91e4-c8270aa7aa58","Type":"ContainerStarted","Data":"14df7322d7d4aeb66387701152dc453de9537697972b71c2e1c83d5a4e2886fa"} Jun 15 04:37:27.057612 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:27.057511 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-hxdn6" Jun 15 04:37:33.094506 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:33.094479 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-hxdn6" Jun 15 04:37:33.110793 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:33.110745 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-hxdn6" podStartSLOduration=7.873535244 podStartE2EDuration="10.110730651s" totalImagesPullingTime="2.237195407s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 04:37:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:37:27.071985513 +0000 UTC m=+722.599976419" watchObservedRunningTime="2026-06-15 04:37:33.110730651 +0000 UTC m=+728.638721555" Jun 15 04:37:34.446764 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:34.446723 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748b58n5"] Jun 15 04:37:34.451594 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:34.451574 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748b58n5" Jun 15 04:37:34.453805 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:34.453780 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 15 04:37:34.453927 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:34.453867 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 15 04:37:34.454745 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:34.454713 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-vpc82\"" Jun 15 04:37:34.458413 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:34.458390 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748b58n5"] Jun 15 04:37:34.493806 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:34.493774 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vzrx\" (UniqueName: \"kubernetes.io/projected/affb9171-cb83-474e-af7a-8dec5a84f519-kube-api-access-4vzrx\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748b58n5\" (UID: \"affb9171-cb83-474e-af7a-8dec5a84f519\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748b58n5" Jun 15 04:37:34.494022 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:34.493828 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/affb9171-cb83-474e-af7a-8dec5a84f519-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748b58n5\" (UID: \"affb9171-cb83-474e-af7a-8dec5a84f519\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748b58n5" Jun 15 04:37:34.494022 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:34.493940 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/affb9171-cb83-474e-af7a-8dec5a84f519-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748b58n5\" (UID: \"affb9171-cb83-474e-af7a-8dec5a84f519\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748b58n5" Jun 15 04:37:34.594375 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:34.594336 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/affb9171-cb83-474e-af7a-8dec5a84f519-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748b58n5\" (UID: \"affb9171-cb83-474e-af7a-8dec5a84f519\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748b58n5" Jun 15 04:37:34.594612 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:34.594419 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/affb9171-cb83-474e-af7a-8dec5a84f519-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748b58n5\" (UID: \"affb9171-cb83-474e-af7a-8dec5a84f519\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748b58n5" Jun 15 04:37:34.594612 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:34.594480 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vzrx\" (UniqueName: \"kubernetes.io/projected/affb9171-cb83-474e-af7a-8dec5a84f519-kube-api-access-4vzrx\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748b58n5\" (UID: \"affb9171-cb83-474e-af7a-8dec5a84f519\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748b58n5" Jun 15 04:37:34.594771 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:34.594739 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/affb9171-cb83-474e-af7a-8dec5a84f519-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748b58n5\" (UID: \"affb9171-cb83-474e-af7a-8dec5a84f519\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748b58n5" Jun 15 04:37:34.594837 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:34.594802 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/affb9171-cb83-474e-af7a-8dec5a84f519-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748b58n5\" (UID: \"affb9171-cb83-474e-af7a-8dec5a84f519\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748b58n5" Jun 15 04:37:34.602168 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:34.602144 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vzrx\" (UniqueName: \"kubernetes.io/projected/affb9171-cb83-474e-af7a-8dec5a84f519-kube-api-access-4vzrx\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748b58n5\" (UID: \"affb9171-cb83-474e-af7a-8dec5a84f519\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748b58n5" Jun 15 04:37:34.761848 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:34.761747 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748b58n5" Jun 15 04:37:34.895994 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:34.895880 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748b58n5"] Jun 15 04:37:34.899092 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:37:34.899060 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaffb9171_cb83_474e_af7a_8dec5a84f519.slice/crio-5fee207515538a7fc2a02d36906b7c78933725d0edac694219d95791f8c854c2 WatchSource:0}: Error finding container 5fee207515538a7fc2a02d36906b7c78933725d0edac694219d95791f8c854c2: Status 404 returned error can't find the container with id 5fee207515538a7fc2a02d36906b7c78933725d0edac694219d95791f8c854c2 Jun 15 04:37:35.102501 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:35.102375 2561 generic.go:356] "Generic (PLEG): container finished" podID="affb9171-cb83-474e-af7a-8dec5a84f519" containerID="d0d40647aad3a32b4730201177a81fec411a2109fc2aeb5f3a92516ef4bf7821" exitCode=0 Jun 15 04:37:35.102501 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:35.102417 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748b58n5" event={"ID":"affb9171-cb83-474e-af7a-8dec5a84f519","Type":"ContainerDied","Data":"d0d40647aad3a32b4730201177a81fec411a2109fc2aeb5f3a92516ef4bf7821"} Jun 15 04:37:35.102501 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:35.102495 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748b58n5" event={"ID":"affb9171-cb83-474e-af7a-8dec5a84f519","Type":"ContainerStarted","Data":"5fee207515538a7fc2a02d36906b7c78933725d0edac694219d95791f8c854c2"} Jun 15 04:37:36.112993 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:36.112957 2561 generic.go:356] "Generic (PLEG): container finished" podID="affb9171-cb83-474e-af7a-8dec5a84f519" containerID="7c12ccf70eb3c86ec8b2538409b7eb2899c0bf40a542f78be37d3efd513608c9" exitCode=0 Jun 15 04:37:36.113356 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:36.113041 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748b58n5" event={"ID":"affb9171-cb83-474e-af7a-8dec5a84f519","Type":"ContainerDied","Data":"7c12ccf70eb3c86ec8b2538409b7eb2899c0bf40a542f78be37d3efd513608c9"} Jun 15 04:37:37.120584 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:37.120548 2561 generic.go:356] "Generic (PLEG): container finished" podID="affb9171-cb83-474e-af7a-8dec5a84f519" containerID="de6294ab858d3ef39726a3b34680efe7703eb3339a144bb0a9bde2520141093e" exitCode=0 Jun 15 04:37:37.121035 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:37.120637 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748b58n5" event={"ID":"affb9171-cb83-474e-af7a-8dec5a84f519","Type":"ContainerDied","Data":"de6294ab858d3ef39726a3b34680efe7703eb3339a144bb0a9bde2520141093e"} Jun 15 04:37:38.261365 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:38.261343 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748b58n5" Jun 15 04:37:38.330314 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:38.330283 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4vzrx\" (UniqueName: \"kubernetes.io/projected/affb9171-cb83-474e-af7a-8dec5a84f519-kube-api-access-4vzrx\") pod \"affb9171-cb83-474e-af7a-8dec5a84f519\" (UID: \"affb9171-cb83-474e-af7a-8dec5a84f519\") " Jun 15 04:37:38.330514 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:38.330342 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/affb9171-cb83-474e-af7a-8dec5a84f519-util\") pod \"affb9171-cb83-474e-af7a-8dec5a84f519\" (UID: \"affb9171-cb83-474e-af7a-8dec5a84f519\") " Jun 15 04:37:38.330514 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:38.330383 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/affb9171-cb83-474e-af7a-8dec5a84f519-bundle\") pod \"affb9171-cb83-474e-af7a-8dec5a84f519\" (UID: \"affb9171-cb83-474e-af7a-8dec5a84f519\") " Jun 15 04:37:38.330950 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:38.330925 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/affb9171-cb83-474e-af7a-8dec5a84f519-bundle" (OuterVolumeSpecName: "bundle") pod "affb9171-cb83-474e-af7a-8dec5a84f519" (UID: "affb9171-cb83-474e-af7a-8dec5a84f519"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 04:37:38.332421 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:38.332398 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/affb9171-cb83-474e-af7a-8dec5a84f519-kube-api-access-4vzrx" (OuterVolumeSpecName: "kube-api-access-4vzrx") pod "affb9171-cb83-474e-af7a-8dec5a84f519" (UID: "affb9171-cb83-474e-af7a-8dec5a84f519"). InnerVolumeSpecName "kube-api-access-4vzrx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 04:37:38.336261 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:38.336236 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/affb9171-cb83-474e-af7a-8dec5a84f519-util" (OuterVolumeSpecName: "util") pod "affb9171-cb83-474e-af7a-8dec5a84f519" (UID: "affb9171-cb83-474e-af7a-8dec5a84f519"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 04:37:38.431410 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:38.431382 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4vzrx\" (UniqueName: \"kubernetes.io/projected/affb9171-cb83-474e-af7a-8dec5a84f519-kube-api-access-4vzrx\") on node \"ip-10-0-140-86.ec2.internal\" DevicePath \"\"" Jun 15 04:37:38.431410 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:38.431409 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/affb9171-cb83-474e-af7a-8dec5a84f519-util\") on node \"ip-10-0-140-86.ec2.internal\" DevicePath \"\"" Jun 15 04:37:38.431608 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:38.431422 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/affb9171-cb83-474e-af7a-8dec5a84f519-bundle\") on node \"ip-10-0-140-86.ec2.internal\" DevicePath \"\"" Jun 15 04:37:39.134156 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:39.134088 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748b58n5" Jun 15 04:37:39.134156 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:39.134113 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748b58n5" event={"ID":"affb9171-cb83-474e-af7a-8dec5a84f519","Type":"ContainerDied","Data":"5fee207515538a7fc2a02d36906b7c78933725d0edac694219d95791f8c854c2"} Jun 15 04:37:39.134156 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:39.134157 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5fee207515538a7fc2a02d36906b7c78933725d0edac694219d95791f8c854c2" Jun 15 04:37:41.761230 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:41.761196 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-8stct"] Jun 15 04:37:41.761610 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:41.761602 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="affb9171-cb83-474e-af7a-8dec5a84f519" containerName="util" Jun 15 04:37:41.761662 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:41.761613 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="affb9171-cb83-474e-af7a-8dec5a84f519" containerName="util" Jun 15 04:37:41.761662 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:41.761631 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="affb9171-cb83-474e-af7a-8dec5a84f519" containerName="extract" Jun 15 04:37:41.761662 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:41.761637 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="affb9171-cb83-474e-af7a-8dec5a84f519" containerName="extract" Jun 15 04:37:41.761662 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:41.761655 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="affb9171-cb83-474e-af7a-8dec5a84f519" containerName="pull" Jun 15 04:37:41.761662 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:41.761660 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="affb9171-cb83-474e-af7a-8dec5a84f519" containerName="pull" Jun 15 04:37:41.761821 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:41.761733 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="affb9171-cb83-474e-af7a-8dec5a84f519" containerName="extract" Jun 15 04:37:41.765978 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:41.765956 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-8stct" Jun 15 04:37:41.768338 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:41.768322 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 15 04:37:41.768664 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:41.768648 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 15 04:37:41.768992 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:41.768975 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-w87qz\"" Jun 15 04:37:41.773565 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:41.773541 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-8stct"] Jun 15 04:37:41.864811 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:41.864781 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvbpm\" (UniqueName: \"kubernetes.io/projected/a2d5d088-4167-4611-95e4-781bab726f3d-kube-api-access-qvbpm\") pod \"keycloak-operator-d67dbbb48-8stct\" (UID: \"a2d5d088-4167-4611-95e4-781bab726f3d\") " pod="keycloak-system/keycloak-operator-d67dbbb48-8stct" Jun 15 04:37:41.965610 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:41.965575 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvbpm\" (UniqueName: \"kubernetes.io/projected/a2d5d088-4167-4611-95e4-781bab726f3d-kube-api-access-qvbpm\") pod \"keycloak-operator-d67dbbb48-8stct\" (UID: \"a2d5d088-4167-4611-95e4-781bab726f3d\") " pod="keycloak-system/keycloak-operator-d67dbbb48-8stct" Jun 15 04:37:41.973448 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:41.973420 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvbpm\" (UniqueName: \"kubernetes.io/projected/a2d5d088-4167-4611-95e4-781bab726f3d-kube-api-access-qvbpm\") pod \"keycloak-operator-d67dbbb48-8stct\" (UID: \"a2d5d088-4167-4611-95e4-781bab726f3d\") " pod="keycloak-system/keycloak-operator-d67dbbb48-8stct" Jun 15 04:37:42.077597 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:42.077511 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-8stct" Jun 15 04:37:42.217083 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:42.216653 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-8stct"] Jun 15 04:37:42.219228 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:37:42.219035 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2d5d088_4167_4611_95e4_781bab726f3d.slice/crio-18ba264447f831922ca34044c10b4d5c39637fc931d60d93b9de778db2e81182 WatchSource:0}: Error finding container 18ba264447f831922ca34044c10b4d5c39637fc931d60d93b9de778db2e81182: Status 404 returned error can't find the container with id 18ba264447f831922ca34044c10b4d5c39637fc931d60d93b9de778db2e81182 Jun 15 04:37:43.171197 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:43.171148 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-8stct" event={"ID":"a2d5d088-4167-4611-95e4-781bab726f3d","Type":"ContainerStarted","Data":"18ba264447f831922ca34044c10b4d5c39637fc931d60d93b9de778db2e81182"} Jun 15 04:37:48.205599 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:48.205555 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-8stct" event={"ID":"a2d5d088-4167-4611-95e4-781bab726f3d","Type":"ContainerStarted","Data":"a55f37996286ab66e7a82afb5597e6942521c3b586f632c6215b17af6fdbf4f3"} Jun 15 04:37:48.221689 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:37:48.221588 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-d67dbbb48-8stct" podStartSLOduration=1.474040367 podStartE2EDuration="7.221572178s" totalImagesPullingTime="5.747531811s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 04:37:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:37:48.219556631 +0000 UTC m=+743.747547536" watchObservedRunningTime="2026-06-15 04:37:48.221572178 +0000 UTC m=+743.749563082" Jun 15 04:38:26.773980 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:38:26.773949 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-zslxt"] Jun 15 04:38:26.780849 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:38:26.780823 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-zslxt" Jun 15 04:38:26.782773 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:38:26.782750 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-ppwxw\"" Jun 15 04:38:26.783512 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:38:26.783481 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-zslxt"] Jun 15 04:38:26.867502 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:38:26.867466 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpppv\" (UniqueName: \"kubernetes.io/projected/beb55320-c960-4baa-9b92-c901865cfdf2-kube-api-access-fpppv\") pod \"authorino-5d4b67c446-zslxt\" (UID: \"beb55320-c960-4baa-9b92-c901865cfdf2\") " pod="kuadrant-system/authorino-5d4b67c446-zslxt" Jun 15 04:38:26.968933 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:38:26.968895 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpppv\" (UniqueName: \"kubernetes.io/projected/beb55320-c960-4baa-9b92-c901865cfdf2-kube-api-access-fpppv\") pod \"authorino-5d4b67c446-zslxt\" (UID: \"beb55320-c960-4baa-9b92-c901865cfdf2\") " pod="kuadrant-system/authorino-5d4b67c446-zslxt" Jun 15 04:38:26.977487 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:38:26.977455 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpppv\" (UniqueName: \"kubernetes.io/projected/beb55320-c960-4baa-9b92-c901865cfdf2-kube-api-access-fpppv\") pod \"authorino-5d4b67c446-zslxt\" (UID: \"beb55320-c960-4baa-9b92-c901865cfdf2\") " pod="kuadrant-system/authorino-5d4b67c446-zslxt" Jun 15 04:38:27.004783 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:38:27.004417 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-zslxt"] Jun 15 04:38:27.005124 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:38:27.005045 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-zslxt" Jun 15 04:38:27.142921 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:38:27.142887 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-zslxt"] Jun 15 04:38:27.143795 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:38:27.143766 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbeb55320_c960_4baa_9b92_c901865cfdf2.slice/crio-5c3e832f41d00e774e20f7c03f948b8fc9da55933430bd21d709dcb8b6404e18 WatchSource:0}: Error finding container 5c3e832f41d00e774e20f7c03f948b8fc9da55933430bd21d709dcb8b6404e18: Status 404 returned error can't find the container with id 5c3e832f41d00e774e20f7c03f948b8fc9da55933430bd21d709dcb8b6404e18 Jun 15 04:38:27.431156 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:38:27.431123 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-zslxt" event={"ID":"beb55320-c960-4baa-9b92-c901865cfdf2","Type":"ContainerStarted","Data":"5c3e832f41d00e774e20f7c03f948b8fc9da55933430bd21d709dcb8b6404e18"} Jun 15 04:38:28.438911 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:38:28.438869 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-zslxt" event={"ID":"beb55320-c960-4baa-9b92-c901865cfdf2","Type":"ContainerStarted","Data":"1f8b0c8a03eb9687ae69f3df46574fed036320af8ba371fb26f6b97981f98ec9"} Jun 15 04:38:28.439332 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:38:28.438925 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-zslxt" podUID="beb55320-c960-4baa-9b92-c901865cfdf2" containerName="authorino" containerID="cri-o://1f8b0c8a03eb9687ae69f3df46574fed036320af8ba371fb26f6b97981f98ec9" gracePeriod=30 Jun 15 04:38:28.453110 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:38:28.453065 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-zslxt" podStartSLOduration=2.111437115 podStartE2EDuration="2.453051403s" totalImagesPullingTime="341.614288ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 04:38:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:38:28.451308793 +0000 UTC m=+783.979299699" watchObservedRunningTime="2026-06-15 04:38:28.453051403 +0000 UTC m=+783.981042307" Jun 15 04:38:28.696063 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:38:28.695989 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-zslxt" Jun 15 04:38:28.785200 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:38:28.785167 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fpppv\" (UniqueName: \"kubernetes.io/projected/beb55320-c960-4baa-9b92-c901865cfdf2-kube-api-access-fpppv\") pod \"beb55320-c960-4baa-9b92-c901865cfdf2\" (UID: \"beb55320-c960-4baa-9b92-c901865cfdf2\") " Jun 15 04:38:28.787238 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:38:28.787215 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/beb55320-c960-4baa-9b92-c901865cfdf2-kube-api-access-fpppv" (OuterVolumeSpecName: "kube-api-access-fpppv") pod "beb55320-c960-4baa-9b92-c901865cfdf2" (UID: "beb55320-c960-4baa-9b92-c901865cfdf2"). InnerVolumeSpecName "kube-api-access-fpppv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 04:38:28.886566 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:38:28.886525 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fpppv\" (UniqueName: \"kubernetes.io/projected/beb55320-c960-4baa-9b92-c901865cfdf2-kube-api-access-fpppv\") on node \"ip-10-0-140-86.ec2.internal\" DevicePath \"\"" Jun 15 04:38:29.446770 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:38:29.446734 2561 generic.go:356] "Generic (PLEG): container finished" podID="beb55320-c960-4baa-9b92-c901865cfdf2" containerID="1f8b0c8a03eb9687ae69f3df46574fed036320af8ba371fb26f6b97981f98ec9" exitCode=0 Jun 15 04:38:29.447194 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:38:29.446781 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-zslxt" Jun 15 04:38:29.447194 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:38:29.446814 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-zslxt" event={"ID":"beb55320-c960-4baa-9b92-c901865cfdf2","Type":"ContainerDied","Data":"1f8b0c8a03eb9687ae69f3df46574fed036320af8ba371fb26f6b97981f98ec9"} Jun 15 04:38:29.447194 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:38:29.446859 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-zslxt" event={"ID":"beb55320-c960-4baa-9b92-c901865cfdf2","Type":"ContainerDied","Data":"5c3e832f41d00e774e20f7c03f948b8fc9da55933430bd21d709dcb8b6404e18"} Jun 15 04:38:29.447194 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:38:29.446876 2561 scope.go:117] "RemoveContainer" containerID="1f8b0c8a03eb9687ae69f3df46574fed036320af8ba371fb26f6b97981f98ec9" Jun 15 04:38:29.455815 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:38:29.455794 2561 scope.go:117] "RemoveContainer" containerID="1f8b0c8a03eb9687ae69f3df46574fed036320af8ba371fb26f6b97981f98ec9" Jun 15 04:38:29.456067 ip-10-0-140-86 kubenswrapper[2561]: E0615 04:38:29.456046 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f8b0c8a03eb9687ae69f3df46574fed036320af8ba371fb26f6b97981f98ec9\": container with ID starting with 1f8b0c8a03eb9687ae69f3df46574fed036320af8ba371fb26f6b97981f98ec9 not found: ID does not exist" containerID="1f8b0c8a03eb9687ae69f3df46574fed036320af8ba371fb26f6b97981f98ec9" Jun 15 04:38:29.456132 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:38:29.456080 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f8b0c8a03eb9687ae69f3df46574fed036320af8ba371fb26f6b97981f98ec9"} err="failed to get container status \"1f8b0c8a03eb9687ae69f3df46574fed036320af8ba371fb26f6b97981f98ec9\": rpc error: code = NotFound desc = could not find container \"1f8b0c8a03eb9687ae69f3df46574fed036320af8ba371fb26f6b97981f98ec9\": container with ID starting with 1f8b0c8a03eb9687ae69f3df46574fed036320af8ba371fb26f6b97981f98ec9 not found: ID does not exist" Jun 15 04:38:29.461416 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:38:29.461392 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-zslxt"] Jun 15 04:38:29.465095 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:38:29.465073 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-zslxt"] Jun 15 04:38:30.826549 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:38:30.826509 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="beb55320-c960-4baa-9b92-c901865cfdf2" path="/var/lib/kubelet/pods/beb55320-c960-4baa-9b92-c901865cfdf2/volumes" Jun 15 04:39:06.912541 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:39:06.912502 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-hzbt8"] Jun 15 04:39:06.913121 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:39:06.913101 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="beb55320-c960-4baa-9b92-c901865cfdf2" containerName="authorino" Jun 15 04:39:06.913203 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:39:06.913125 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="beb55320-c960-4baa-9b92-c901865cfdf2" containerName="authorino" Jun 15 04:39:06.913264 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:39:06.913256 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="beb55320-c960-4baa-9b92-c901865cfdf2" containerName="authorino" Jun 15 04:39:06.916427 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:39:06.916407 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-hzbt8" Jun 15 04:39:06.916746 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:39:06.916714 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4gqf\" (UniqueName: \"kubernetes.io/projected/556b7390-59d9-4bf8-8e15-645e2b25c299-kube-api-access-b4gqf\") pod \"payload-pre-processing-579785bc64-hzbt8\" (UID: \"556b7390-59d9-4bf8-8e15-645e2b25c299\") " pod="openshift-ingress/payload-pre-processing-579785bc64-hzbt8" Jun 15 04:39:06.918512 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:39:06.918494 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 15 04:39:06.918592 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:39:06.918532 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-88lxj\"" Jun 15 04:39:06.925497 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:39:06.925472 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-hzbt8"] Jun 15 04:39:06.944237 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:39:06.944212 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-z2rrc"] Jun 15 04:39:06.947941 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:39:06.947921 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-z2rrc" Jun 15 04:39:06.958799 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:39:06.958775 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-z2rrc"] Jun 15 04:39:07.018480 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:39:07.018427 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtzkm\" (UniqueName: \"kubernetes.io/projected/6b6b6ef0-cfc4-4acd-a111-14dc1c6a7e45-kube-api-access-jtzkm\") pod \"payload-processing-699b6cd6c-z2rrc\" (UID: \"6b6b6ef0-cfc4-4acd-a111-14dc1c6a7e45\") " pod="openshift-ingress/payload-processing-699b6cd6c-z2rrc" Jun 15 04:39:07.018625 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:39:07.018585 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4gqf\" (UniqueName: \"kubernetes.io/projected/556b7390-59d9-4bf8-8e15-645e2b25c299-kube-api-access-b4gqf\") pod \"payload-pre-processing-579785bc64-hzbt8\" (UID: \"556b7390-59d9-4bf8-8e15-645e2b25c299\") " pod="openshift-ingress/payload-pre-processing-579785bc64-hzbt8" Jun 15 04:39:07.025633 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:39:07.025604 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4gqf\" (UniqueName: \"kubernetes.io/projected/556b7390-59d9-4bf8-8e15-645e2b25c299-kube-api-access-b4gqf\") pod \"payload-pre-processing-579785bc64-hzbt8\" (UID: \"556b7390-59d9-4bf8-8e15-645e2b25c299\") " pod="openshift-ingress/payload-pre-processing-579785bc64-hzbt8" Jun 15 04:39:07.119636 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:39:07.119605 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtzkm\" (UniqueName: \"kubernetes.io/projected/6b6b6ef0-cfc4-4acd-a111-14dc1c6a7e45-kube-api-access-jtzkm\") pod \"payload-processing-699b6cd6c-z2rrc\" (UID: \"6b6b6ef0-cfc4-4acd-a111-14dc1c6a7e45\") " pod="openshift-ingress/payload-processing-699b6cd6c-z2rrc" Jun 15 04:39:07.128412 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:39:07.128379 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtzkm\" (UniqueName: \"kubernetes.io/projected/6b6b6ef0-cfc4-4acd-a111-14dc1c6a7e45-kube-api-access-jtzkm\") pod \"payload-processing-699b6cd6c-z2rrc\" (UID: \"6b6b6ef0-cfc4-4acd-a111-14dc1c6a7e45\") " pod="openshift-ingress/payload-processing-699b6cd6c-z2rrc" Jun 15 04:39:07.227872 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:39:07.227782 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-hzbt8" Jun 15 04:39:07.259068 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:39:07.259040 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-z2rrc" Jun 15 04:39:07.373593 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:39:07.373562 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-hzbt8"] Jun 15 04:39:07.376411 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:39:07.376379 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod556b7390_59d9_4bf8_8e15_645e2b25c299.slice/crio-9cfd1b2d8136cba4765940f0bcead765550b69a872690794ffe35e5892016ba0 WatchSource:0}: Error finding container 9cfd1b2d8136cba4765940f0bcead765550b69a872690794ffe35e5892016ba0: Status 404 returned error can't find the container with id 9cfd1b2d8136cba4765940f0bcead765550b69a872690794ffe35e5892016ba0 Jun 15 04:39:07.404606 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:39:07.404582 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-z2rrc"] Jun 15 04:39:07.406147 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:39:07.406118 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b6b6ef0_cfc4_4acd_a111_14dc1c6a7e45.slice/crio-0b39d81771f752328e5ef3acff9e523830c36a5ebd4bdac79b5656ea07ea155e WatchSource:0}: Error finding container 0b39d81771f752328e5ef3acff9e523830c36a5ebd4bdac79b5656ea07ea155e: Status 404 returned error can't find the container with id 0b39d81771f752328e5ef3acff9e523830c36a5ebd4bdac79b5656ea07ea155e Jun 15 04:39:07.676838 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:39:07.676800 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-hzbt8" event={"ID":"556b7390-59d9-4bf8-8e15-645e2b25c299","Type":"ContainerStarted","Data":"9cfd1b2d8136cba4765940f0bcead765550b69a872690794ffe35e5892016ba0"} Jun 15 04:39:07.677931 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:39:07.677904 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-z2rrc" event={"ID":"6b6b6ef0-cfc4-4acd-a111-14dc1c6a7e45","Type":"ContainerStarted","Data":"0b39d81771f752328e5ef3acff9e523830c36a5ebd4bdac79b5656ea07ea155e"} Jun 15 04:39:10.702477 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:39:10.702414 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-z2rrc" event={"ID":"6b6b6ef0-cfc4-4acd-a111-14dc1c6a7e45","Type":"ContainerStarted","Data":"b6aaf940d9ba7e5ec95ed6028ecd733c7b0001ff63cacf7fe8f45fa5d76ed3c4"} Jun 15 04:39:10.702955 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:39:10.702515 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-699b6cd6c-z2rrc" Jun 15 04:39:10.704030 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:39:10.704008 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-hzbt8" event={"ID":"556b7390-59d9-4bf8-8e15-645e2b25c299","Type":"ContainerStarted","Data":"2152c8bf725c9ed70f32fd15ddd4bf0bce451d1db57e3add19a1008101634942"} Jun 15 04:39:10.704170 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:39:10.704153 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-579785bc64-hzbt8" Jun 15 04:39:10.719793 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:39:10.719753 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-699b6cd6c-z2rrc" podStartSLOduration=1.6304346029999999 podStartE2EDuration="4.719740499s" totalImagesPullingTime="3.089305896s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 04:39:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:39:10.716715819 +0000 UTC m=+826.244706724" watchObservedRunningTime="2026-06-15 04:39:10.719740499 +0000 UTC m=+826.247731403" Jun 15 04:39:10.732682 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:39:10.731415 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-579785bc64-hzbt8" podStartSLOduration=1.606331055 podStartE2EDuration="4.731404326s" totalImagesPullingTime="3.125073271s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 04:39:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:39:10.729230696 +0000 UTC m=+826.257221602" watchObservedRunningTime="2026-06-15 04:39:10.731404326 +0000 UTC m=+826.259395231" Jun 15 04:39:12.901625 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:39:12.901581 2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-52z6d container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jun 15 04:39:12.902127 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:39:12.901635 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-52z6d" podUID="dd4117cb-4e31-4833-b8fa-cffe57c8b8c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jun 15 04:39:14.731858 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:39:14.731825 2561 generic.go:356] "Generic (PLEG): container finished" podID="dd4117cb-4e31-4833-b8fa-cffe57c8b8c8" containerID="d3c0b09811e87ce00b8fa7b8eeec1fa250ad0e4696da3f3cbb98b65256c01e5f" exitCode=0 Jun 15 04:39:14.732270 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:39:14.731899 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-52z6d" event={"ID":"dd4117cb-4e31-4833-b8fa-cffe57c8b8c8","Type":"ContainerDied","Data":"d3c0b09811e87ce00b8fa7b8eeec1fa250ad0e4696da3f3cbb98b65256c01e5f"} Jun 15 04:39:14.732319 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:39:14.732277 2561 scope.go:117] "RemoveContainer" containerID="d3c0b09811e87ce00b8fa7b8eeec1fa250ad0e4696da3f3cbb98b65256c01e5f" Jun 15 04:39:14.733212 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:39:14.733185 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 15 04:39:14.733269 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:39:14.733256 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 15 04:39:14.733309 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:39:14.733289 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 15 04:39:15.742606 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:39:15.742562 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-52z6d" event={"ID":"dd4117cb-4e31-4833-b8fa-cffe57c8b8c8","Type":"ContainerStarted","Data":"0b0f48e31e941b301d2dbe89be3b3b9392cc800638af7f6fa7917a57362e4570"} Jun 15 04:39:16.042933 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:39:16.042823 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-52z6d" Jun 15 04:39:16.043113 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:39:16.043063 2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-52z6d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body= Jun 15 04:39:16.043175 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:39:16.043125 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-52z6d" podUID="dd4117cb-4e31-4833-b8fa-cffe57c8b8c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" Jun 15 04:39:17.043042 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:39:17.042998 2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-52z6d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body= Jun 15 04:39:17.043567 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:39:17.043082 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-52z6d" podUID="dd4117cb-4e31-4833-b8fa-cffe57c8b8c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" Jun 15 04:39:18.043185 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:39:18.043145 2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-52z6d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body= Jun 15 04:39:18.043818 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:39:18.043783 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-52z6d" podUID="dd4117cb-4e31-4833-b8fa-cffe57c8b8c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" Jun 15 04:39:19.043641 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:39:19.043602 2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-52z6d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body= Jun 15 04:39:19.044227 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:39:19.044194 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-52z6d" podUID="dd4117cb-4e31-4833-b8fa-cffe57c8b8c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" Jun 15 04:39:20.047218 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:39:20.047183 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-52z6d" Jun 15 04:39:20.047723 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:39:20.047468 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-52z6d" Jun 15 04:39:20.048264 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:39:20.048246 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-52z6d" Jun 15 04:39:21.713383 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:39:21.713355 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-699b6cd6c-z2rrc" Jun 15 04:39:21.713772 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:39:21.713566 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-579785bc64-hzbt8" Jun 15 04:40:24.853999 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:40:24.853966 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8fqkk_f345d023-5952-44c4-800e-69cf4dba39a3/ovn-acl-logging/0.log" Jun 15 04:40:24.855168 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:40:24.855141 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8fqkk_f345d023-5952-44c4-800e-69cf4dba39a3/ovn-acl-logging/0.log" Jun 15 04:40:32.096706 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:40:32.096673 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-6mffn"] Jun 15 04:40:32.100744 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:40:32.100722 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6mffn" Jun 15 04:40:32.102964 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:40:32.102937 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 15 04:40:32.103120 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:40:32.103010 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-cs2fn\"" Jun 15 04:40:32.103120 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:40:32.103033 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 15 04:40:32.103958 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:40:32.103941 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 15 04:40:32.110236 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:40:32.110216 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-6mffn"] Jun 15 04:40:32.225763 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:40:32.225727 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6388b101-c59d-45ed-8520-e9e4d5f40275-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6mffn\" (UID: \"6388b101-c59d-45ed-8520-e9e4d5f40275\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6mffn" Jun 15 04:40:32.225936 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:40:32.225794 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6388b101-c59d-45ed-8520-e9e4d5f40275-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6mffn\" (UID: \"6388b101-c59d-45ed-8520-e9e4d5f40275\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6mffn" Jun 15 04:40:32.225936 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:40:32.225819 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6388b101-c59d-45ed-8520-e9e4d5f40275-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6mffn\" (UID: \"6388b101-c59d-45ed-8520-e9e4d5f40275\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6mffn" Jun 15 04:40:32.225936 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:40:32.225852 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhr7w\" (UniqueName: \"kubernetes.io/projected/6388b101-c59d-45ed-8520-e9e4d5f40275-kube-api-access-hhr7w\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6mffn\" (UID: \"6388b101-c59d-45ed-8520-e9e4d5f40275\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6mffn" Jun 15 04:40:32.225936 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:40:32.225904 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6388b101-c59d-45ed-8520-e9e4d5f40275-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6mffn\" (UID: \"6388b101-c59d-45ed-8520-e9e4d5f40275\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6mffn" Jun 15 04:40:32.225936 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:40:32.225919 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6388b101-c59d-45ed-8520-e9e4d5f40275-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6mffn\" (UID: \"6388b101-c59d-45ed-8520-e9e4d5f40275\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6mffn" Jun 15 04:40:32.327241 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:40:32.327209 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6388b101-c59d-45ed-8520-e9e4d5f40275-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6mffn\" (UID: \"6388b101-c59d-45ed-8520-e9e4d5f40275\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6mffn" Jun 15 04:40:32.327431 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:40:32.327256 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhr7w\" (UniqueName: \"kubernetes.io/projected/6388b101-c59d-45ed-8520-e9e4d5f40275-kube-api-access-hhr7w\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6mffn\" (UID: \"6388b101-c59d-45ed-8520-e9e4d5f40275\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6mffn" Jun 15 04:40:32.327431 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:40:32.327289 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6388b101-c59d-45ed-8520-e9e4d5f40275-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6mffn\" (UID: \"6388b101-c59d-45ed-8520-e9e4d5f40275\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6mffn" Jun 15 04:40:32.327431 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:40:32.327308 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6388b101-c59d-45ed-8520-e9e4d5f40275-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6mffn\" (UID: \"6388b101-c59d-45ed-8520-e9e4d5f40275\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6mffn" Jun 15 04:40:32.327431 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:40:32.327336 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6388b101-c59d-45ed-8520-e9e4d5f40275-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6mffn\" (UID: \"6388b101-c59d-45ed-8520-e9e4d5f40275\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6mffn" Jun 15 04:40:32.327699 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:40:32.327499 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6388b101-c59d-45ed-8520-e9e4d5f40275-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6mffn\" (UID: \"6388b101-c59d-45ed-8520-e9e4d5f40275\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6mffn" Jun 15 04:40:32.327774 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:40:32.327730 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6388b101-c59d-45ed-8520-e9e4d5f40275-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6mffn\" (UID: \"6388b101-c59d-45ed-8520-e9e4d5f40275\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6mffn" Jun 15 04:40:32.327830 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:40:32.327785 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6388b101-c59d-45ed-8520-e9e4d5f40275-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6mffn\" (UID: \"6388b101-c59d-45ed-8520-e9e4d5f40275\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6mffn" Jun 15 04:40:32.327874 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:40:32.327839 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6388b101-c59d-45ed-8520-e9e4d5f40275-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6mffn\" (UID: \"6388b101-c59d-45ed-8520-e9e4d5f40275\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6mffn" Jun 15 04:40:32.329515 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:40:32.329496 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6388b101-c59d-45ed-8520-e9e4d5f40275-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6mffn\" (UID: \"6388b101-c59d-45ed-8520-e9e4d5f40275\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6mffn" Jun 15 04:40:32.329901 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:40:32.329879 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6388b101-c59d-45ed-8520-e9e4d5f40275-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6mffn\" (UID: \"6388b101-c59d-45ed-8520-e9e4d5f40275\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6mffn" Jun 15 04:40:32.334455 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:40:32.334422 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhr7w\" (UniqueName: \"kubernetes.io/projected/6388b101-c59d-45ed-8520-e9e4d5f40275-kube-api-access-hhr7w\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6mffn\" (UID: \"6388b101-c59d-45ed-8520-e9e4d5f40275\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6mffn" Jun 15 04:40:32.413622 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:40:32.413594 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6mffn" Jun 15 04:40:32.552385 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:40:32.552359 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-6mffn"] Jun 15 04:40:32.554021 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:40:32.553993 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6388b101_c59d_45ed_8520_e9e4d5f40275.slice/crio-a7b129bf53cb70a5aea82c22847d580a50d8466372ab02e25b3bb9aa7b2e52bd WatchSource:0}: Error finding container a7b129bf53cb70a5aea82c22847d580a50d8466372ab02e25b3bb9aa7b2e52bd: Status 404 returned error can't find the container with id a7b129bf53cb70a5aea82c22847d580a50d8466372ab02e25b3bb9aa7b2e52bd Jun 15 04:40:33.203295 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:40:33.203255 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6mffn" event={"ID":"6388b101-c59d-45ed-8520-e9e4d5f40275","Type":"ContainerStarted","Data":"a7b129bf53cb70a5aea82c22847d580a50d8466372ab02e25b3bb9aa7b2e52bd"} Jun 15 04:40:36.227585 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:40:36.227547 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6mffn" event={"ID":"6388b101-c59d-45ed-8520-e9e4d5f40275","Type":"ContainerStarted","Data":"d1ce362b3241f2433254222d147f078f65cb249e531ee674db4f0dc1e21b100e"} Jun 15 04:40:46.286279 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:40:46.286242 2561 generic.go:356] "Generic (PLEG): container finished" podID="6388b101-c59d-45ed-8520-e9e4d5f40275" containerID="d1ce362b3241f2433254222d147f078f65cb249e531ee674db4f0dc1e21b100e" exitCode=0 Jun 15 04:40:46.286710 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:40:46.286315 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6mffn" event={"ID":"6388b101-c59d-45ed-8520-e9e4d5f40275","Type":"ContainerDied","Data":"d1ce362b3241f2433254222d147f078f65cb249e531ee674db4f0dc1e21b100e"} Jun 15 04:40:48.302272 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:40:48.302235 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6mffn" event={"ID":"6388b101-c59d-45ed-8520-e9e4d5f40275","Type":"ContainerStarted","Data":"9a79e3d4b69df7d91d2d65a0fd1f61aba9dd5ca3f6121cd576d948cc246115f9"} Jun 15 04:40:48.321561 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:40:48.321511 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6mffn" podStartSLOduration=2.481367251 podStartE2EDuration="16.321494688s" totalImagesPullingTime="4.380929932s" totalInitContainerRuntime="9.459197505s" isStatefulPod=false podCreationTimestamp="2026-06-15 04:40:32 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:40:48.318862705 +0000 UTC m=+923.846853619" watchObservedRunningTime="2026-06-15 04:40:48.321494688 +0000 UTC m=+923.849485592" Jun 15 04:40:52.414488 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:40:52.414456 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6mffn" Jun 15 04:40:52.414851 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:40:52.414522 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6mffn" Jun 15 04:40:52.427579 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:40:52.427555 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6mffn" Jun 15 04:40:53.343140 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:40:53.343109 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6mffn" Jun 15 04:42:28.328176 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:42:28.328139 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5f58f4c5bc-xlz22"] Jun 15 04:42:28.331740 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:42:28.331724 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5f58f4c5bc-xlz22" Jun 15 04:42:28.334489 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:42:28.334463 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 15 04:42:28.334616 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:42:28.334487 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 15 04:42:28.334616 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:42:28.334539 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-ppwxw\"" Jun 15 04:42:28.340408 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:42:28.340384 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5f58f4c5bc-xlz22"] Jun 15 04:42:28.361898 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:42:28.361871 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ec3f9363-c46d-41ee-ab18-dc9ce71cb786-tls-cert\") pod \"authorino-5f58f4c5bc-xlz22\" (UID: \"ec3f9363-c46d-41ee-ab18-dc9ce71cb786\") " pod="kuadrant-system/authorino-5f58f4c5bc-xlz22" Jun 15 04:42:28.362019 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:42:28.361918 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqvxr\" (UniqueName: \"kubernetes.io/projected/ec3f9363-c46d-41ee-ab18-dc9ce71cb786-kube-api-access-lqvxr\") pod \"authorino-5f58f4c5bc-xlz22\" (UID: \"ec3f9363-c46d-41ee-ab18-dc9ce71cb786\") " pod="kuadrant-system/authorino-5f58f4c5bc-xlz22" Jun 15 04:42:28.362019 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:42:28.361981 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/ec3f9363-c46d-41ee-ab18-dc9ce71cb786-oidc-ca\") pod \"authorino-5f58f4c5bc-xlz22\" (UID: \"ec3f9363-c46d-41ee-ab18-dc9ce71cb786\") " pod="kuadrant-system/authorino-5f58f4c5bc-xlz22" Jun 15 04:42:28.463464 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:42:28.463408 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/ec3f9363-c46d-41ee-ab18-dc9ce71cb786-oidc-ca\") pod \"authorino-5f58f4c5bc-xlz22\" (UID: \"ec3f9363-c46d-41ee-ab18-dc9ce71cb786\") " pod="kuadrant-system/authorino-5f58f4c5bc-xlz22" Jun 15 04:42:28.463646 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:42:28.463494 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ec3f9363-c46d-41ee-ab18-dc9ce71cb786-tls-cert\") pod \"authorino-5f58f4c5bc-xlz22\" (UID: \"ec3f9363-c46d-41ee-ab18-dc9ce71cb786\") " pod="kuadrant-system/authorino-5f58f4c5bc-xlz22" Jun 15 04:42:28.463646 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:42:28.463526 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqvxr\" (UniqueName: \"kubernetes.io/projected/ec3f9363-c46d-41ee-ab18-dc9ce71cb786-kube-api-access-lqvxr\") pod \"authorino-5f58f4c5bc-xlz22\" (UID: \"ec3f9363-c46d-41ee-ab18-dc9ce71cb786\") " pod="kuadrant-system/authorino-5f58f4c5bc-xlz22" Jun 15 04:42:28.464122 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:42:28.464096 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/ec3f9363-c46d-41ee-ab18-dc9ce71cb786-oidc-ca\") pod \"authorino-5f58f4c5bc-xlz22\" (UID: \"ec3f9363-c46d-41ee-ab18-dc9ce71cb786\") " pod="kuadrant-system/authorino-5f58f4c5bc-xlz22" Jun 15 04:42:28.465855 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:42:28.465831 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ec3f9363-c46d-41ee-ab18-dc9ce71cb786-tls-cert\") pod \"authorino-5f58f4c5bc-xlz22\" (UID: \"ec3f9363-c46d-41ee-ab18-dc9ce71cb786\") " pod="kuadrant-system/authorino-5f58f4c5bc-xlz22" Jun 15 04:42:28.470272 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:42:28.470248 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqvxr\" (UniqueName: \"kubernetes.io/projected/ec3f9363-c46d-41ee-ab18-dc9ce71cb786-kube-api-access-lqvxr\") pod \"authorino-5f58f4c5bc-xlz22\" (UID: \"ec3f9363-c46d-41ee-ab18-dc9ce71cb786\") " pod="kuadrant-system/authorino-5f58f4c5bc-xlz22" Jun 15 04:42:28.642637 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:42:28.642554 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5f58f4c5bc-xlz22" Jun 15 04:42:28.778802 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:42:28.778776 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5f58f4c5bc-xlz22"] Jun 15 04:42:28.780042 ip-10-0-140-86 kubenswrapper[2561]: W0615 04:42:28.780020 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podec3f9363_c46d_41ee_ab18_dc9ce71cb786.slice/crio-25888f6645c31454fdf3c9bb3985b6d810ee429394506878b2a4492d24fe3e6b WatchSource:0}: Error finding container 25888f6645c31454fdf3c9bb3985b6d810ee429394506878b2a4492d24fe3e6b: Status 404 returned error can't find the container with id 25888f6645c31454fdf3c9bb3985b6d810ee429394506878b2a4492d24fe3e6b Jun 15 04:42:28.782577 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:42:28.782558 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 15 04:42:28.910695 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:42:28.910664 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5f58f4c5bc-xlz22" event={"ID":"ec3f9363-c46d-41ee-ab18-dc9ce71cb786","Type":"ContainerStarted","Data":"25888f6645c31454fdf3c9bb3985b6d810ee429394506878b2a4492d24fe3e6b"} Jun 15 04:42:29.919261 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:42:29.919225 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5f58f4c5bc-xlz22" event={"ID":"ec3f9363-c46d-41ee-ab18-dc9ce71cb786","Type":"ContainerStarted","Data":"d1906d6f32ed732463b27208e82785847ef8eeb85197ab86591f4ee7b749dd57"} Jun 15 04:42:29.942763 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:42:29.942708 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5f58f4c5bc-xlz22" podStartSLOduration=1.459187284 podStartE2EDuration="1.942689853s" totalImagesPullingTime="483.502569ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 04:42:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 04:42:29.94056919 +0000 UTC m=+1025.468560124" watchObservedRunningTime="2026-06-15 04:42:29.942689853 +0000 UTC m=+1025.470680784" Jun 15 04:45:24.896339 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:45:24.896308 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8fqkk_f345d023-5952-44c4-800e-69cf4dba39a3/ovn-acl-logging/0.log" Jun 15 04:45:24.900487 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:45:24.900467 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8fqkk_f345d023-5952-44c4-800e-69cf4dba39a3/ovn-acl-logging/0.log" Jun 15 04:50:24.938256 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:50:24.938229 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8fqkk_f345d023-5952-44c4-800e-69cf4dba39a3/ovn-acl-logging/0.log" Jun 15 04:50:24.949580 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:50:24.949560 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8fqkk_f345d023-5952-44c4-800e-69cf4dba39a3/ovn-acl-logging/0.log" Jun 15 04:55:24.987269 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:55:24.987159 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8fqkk_f345d023-5952-44c4-800e-69cf4dba39a3/ovn-acl-logging/0.log" Jun 15 04:55:24.999704 ip-10-0-140-86 kubenswrapper[2561]: I0615 04:55:24.999682 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8fqkk_f345d023-5952-44c4-800e-69cf4dba39a3/ovn-acl-logging/0.log" Jun 15 05:00:25.029619 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:00:25.029519 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8fqkk_f345d023-5952-44c4-800e-69cf4dba39a3/ovn-acl-logging/0.log" Jun 15 05:00:25.044172 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:00:25.044146 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8fqkk_f345d023-5952-44c4-800e-69cf4dba39a3/ovn-acl-logging/0.log" Jun 15 05:05:25.070884 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:05:25.070780 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8fqkk_f345d023-5952-44c4-800e-69cf4dba39a3/ovn-acl-logging/0.log" Jun 15 05:05:25.085906 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:05:25.085884 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8fqkk_f345d023-5952-44c4-800e-69cf4dba39a3/ovn-acl-logging/0.log" Jun 15 05:06:26.920869 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:26.920834 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5f58f4c5bc-xlz22_ec3f9363-c46d-41ee-ab18-dc9ce71cb786/authorino/0.log" Jun 15 05:06:31.814082 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:31.814047 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-6446c88f59-jgkm8_a6b27c6a-f11f-4b95-8858-fb7653453e17/nginx/0.log" Jun 15 05:06:33.079575 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:33.079548 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-54bcdff745-sqckf_ba04564a-566b-4020-9e43-ca8644dbbc67/copy-manifests/0.log" Jun 15 05:06:33.085714 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:33.085689 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-54bcdff745-sqckf_ba04564a-566b-4020-9e43-ca8644dbbc67/manager/0.log" Jun 15 05:06:33.341586 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:33.341506 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-hxdn6_01bb059b-3031-449c-91e4-c8270aa7aa58/postgres/0.log" Jun 15 05:06:34.121178 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:34.121143 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l2nwq_8bceeda4-fed8-4766-9b7e-69edaa7a5b15/pull/0.log" Jun 15 05:06:34.126613 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:34.126589 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l2nwq_8bceeda4-fed8-4766-9b7e-69edaa7a5b15/extract/0.log" Jun 15 05:06:34.132064 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:34.132047 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l2nwq_8bceeda4-fed8-4766-9b7e-69edaa7a5b15/util/0.log" Jun 15 05:06:34.269636 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:34.269603 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sr6lt_c7849488-4e16-4cf8-aae9-3d160ea558a2/pull/0.log" Jun 15 05:06:34.275254 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:34.275230 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sr6lt_c7849488-4e16-4cf8-aae9-3d160ea558a2/extract/0.log" Jun 15 05:06:34.280547 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:34.280528 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sr6lt_c7849488-4e16-4cf8-aae9-3d160ea558a2/util/0.log" Jun 15 05:06:34.407273 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:34.407241 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xmstj_5965e6e4-2adb-47a8-930c-cbd4a52d9d9d/pull/0.log" Jun 15 05:06:34.412860 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:34.412827 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xmstj_5965e6e4-2adb-47a8-930c-cbd4a52d9d9d/extract/0.log" Jun 15 05:06:34.418033 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:34.418013 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xmstj_5965e6e4-2adb-47a8-930c-cbd4a52d9d9d/util/0.log" Jun 15 05:06:34.539248 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:34.539217 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kmdgj_a9392e3e-6b09-458d-9577-ca7e955b80e2/util/0.log" Jun 15 05:06:34.544318 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:34.544296 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kmdgj_a9392e3e-6b09-458d-9577-ca7e955b80e2/pull/0.log" Jun 15 05:06:34.549207 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:34.549178 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kmdgj_a9392e3e-6b09-458d-9577-ca7e955b80e2/extract/0.log" Jun 15 05:06:34.686476 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:34.686374 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5f58f4c5bc-xlz22_ec3f9363-c46d-41ee-ab18-dc9ce71cb786/authorino/0.log" Jun 15 05:06:34.923416 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:34.923388 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-dtx7z_1d3656ae-74de-48fd-80a6-14c002d3977a/manager/0.log" Jun 15 05:06:35.186996 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:35.186964 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-gg6vb_c8697429-bfd9-4f0f-8bf4-04750ab2142f/registry-server/0.log" Jun 15 05:06:35.603941 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:35.603857 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-mcsg8_a3f7c378-2ac3-4dde-ad88-3dc7bbb12b3b/manager/0.log" Jun 15 05:06:35.950480 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:35.950429 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795kg7k6_f99f60f5-8fe8-448f-b89c-9087959d67b3/istio-proxy/0.log" Jun 15 05:06:36.407078 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:36.407055 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-52z6d_dd4117cb-4e31-4833-b8fa-cffe57c8b8c8/istio-proxy/1.log" Jun 15 05:06:36.547223 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:36.547191 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-hzbt8_556b7390-59d9-4bf8-8e15-645e2b25c299/payload-pre-processing/0.log" Jun 15 05:06:36.668048 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:36.667974 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-z2rrc_6b6b6ef0-cfc4-4acd-a111-14dc1c6a7e45/payload-processing/0.log" Jun 15 05:06:37.298249 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:37.298218 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-6mffn_6388b101-c59d-45ed-8520-e9e4d5f40275/storage-initializer/0.log" Jun 15 05:06:37.305564 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:37.305530 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-6mffn_6388b101-c59d-45ed-8520-e9e4d5f40275/main/0.log" Jun 15 05:06:44.672556 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:44.672528 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-ng2rb_78c7be15-9916-443f-8d76-29dc1412a6ce/global-pull-secret-syncer/0.log" Jun 15 05:06:44.741036 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:44.741005 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-jpvfh_be43e236-891d-432a-834c-bc8ee5a8b117/konnectivity-agent/0.log" Jun 15 05:06:44.841389 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:44.841350 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-86.ec2.internal_e70cbef6b93985193b629bb99223d30c/haproxy/0.log" Jun 15 05:06:49.275824 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:49.275792 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l2nwq_8bceeda4-fed8-4766-9b7e-69edaa7a5b15/extract/0.log" Jun 15 05:06:49.291859 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:49.291838 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l2nwq_8bceeda4-fed8-4766-9b7e-69edaa7a5b15/util/0.log" Jun 15 05:06:49.308663 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:49.308640 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l2nwq_8bceeda4-fed8-4766-9b7e-69edaa7a5b15/pull/0.log" Jun 15 05:06:49.349147 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:49.349115 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sr6lt_c7849488-4e16-4cf8-aae9-3d160ea558a2/extract/0.log" Jun 15 05:06:49.367423 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:49.367397 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sr6lt_c7849488-4e16-4cf8-aae9-3d160ea558a2/util/0.log" Jun 15 05:06:49.387099 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:49.387074 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sr6lt_c7849488-4e16-4cf8-aae9-3d160ea558a2/pull/0.log" Jun 15 05:06:49.408667 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:49.408641 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xmstj_5965e6e4-2adb-47a8-930c-cbd4a52d9d9d/extract/0.log" Jun 15 05:06:49.429127 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:49.429106 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xmstj_5965e6e4-2adb-47a8-930c-cbd4a52d9d9d/util/0.log" Jun 15 05:06:49.445084 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:49.445056 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xmstj_5965e6e4-2adb-47a8-930c-cbd4a52d9d9d/pull/0.log" Jun 15 05:06:49.465410 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:49.465389 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kmdgj_a9392e3e-6b09-458d-9577-ca7e955b80e2/extract/0.log" Jun 15 05:06:49.494351 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:49.494325 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kmdgj_a9392e3e-6b09-458d-9577-ca7e955b80e2/util/0.log" Jun 15 05:06:49.515098 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:49.515071 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kmdgj_a9392e3e-6b09-458d-9577-ca7e955b80e2/pull/0.log" Jun 15 05:06:49.937187 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:49.937154 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5f58f4c5bc-xlz22_ec3f9363-c46d-41ee-ab18-dc9ce71cb786/authorino/0.log" Jun 15 05:06:49.986225 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:49.986199 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-dtx7z_1d3656ae-74de-48fd-80a6-14c002d3977a/manager/0.log" Jun 15 05:06:50.065304 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:50.065279 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-gg6vb_c8697429-bfd9-4f0f-8bf4-04750ab2142f/registry-server/0.log" Jun 15 05:06:50.257228 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:50.257145 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-mcsg8_a3f7c378-2ac3-4dde-ad88-3dc7bbb12b3b/manager/0.log" Jun 15 05:06:52.107536 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:52.107498 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-84nz8_55950e9e-522b-4792-b22d-c3a5cdaa61c9/kube-state-metrics/0.log" Jun 15 05:06:52.127201 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:52.127172 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-84nz8_55950e9e-522b-4792-b22d-c3a5cdaa61c9/kube-rbac-proxy-main/0.log" Jun 15 05:06:52.149241 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:52.149213 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-84nz8_55950e9e-522b-4792-b22d-c3a5cdaa61c9/kube-rbac-proxy-self/0.log" Jun 15 05:06:52.170582 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:52.170557 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-ff6b4fd97-vpsrh_2adda7a5-05be-40bb-8beb-8b92f762bace/metrics-server/0.log" Jun 15 05:06:52.191726 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:52.191696 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-589576dfc7-llqnw_7f9a5b26-2747-4de7-86f8-f46117b31143/monitoring-plugin/0.log" Jun 15 05:06:52.350648 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:52.350611 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-t97gc_af51b2a9-d67b-49dd-9cf7-6c1ed7363a2b/node-exporter/0.log" Jun 15 05:06:52.368075 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:52.367993 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-t97gc_af51b2a9-d67b-49dd-9cf7-6c1ed7363a2b/kube-rbac-proxy/0.log" Jun 15 05:06:52.384484 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:52.384434 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-t97gc_af51b2a9-d67b-49dd-9cf7-6c1ed7363a2b/init-textfile/0.log" Jun 15 05:06:52.426775 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:52.426748 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-9pgrx_382a07e2-0ef4-421e-8167-568ab4be9a73/kube-rbac-proxy-main/0.log" Jun 15 05:06:52.453675 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:52.453648 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-9pgrx_382a07e2-0ef4-421e-8167-568ab4be9a73/kube-rbac-proxy-self/0.log" Jun 15 05:06:52.476162 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:52.476138 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-9pgrx_382a07e2-0ef4-421e-8167-568ab4be9a73/openshift-state-metrics/0.log" Jun 15 05:06:52.762000 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:52.761968 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5cf667749c-8gjqv_f137ce52-a220-46de-a6c6-f9c648fc8005/prometheus-operator-admission-webhook/0.log" Jun 15 05:06:52.786802 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:52.786778 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-66bd4f964b-967ck_1e28875a-fa68-4877-842a-7fd898b5257f/telemeter-client/0.log" Jun 15 05:06:52.802154 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:52.802130 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-66bd4f964b-967ck_1e28875a-fa68-4877-842a-7fd898b5257f/reload/0.log" Jun 15 05:06:52.823848 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:52.823817 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-66bd4f964b-967ck_1e28875a-fa68-4877-842a-7fd898b5257f/kube-rbac-proxy/0.log" Jun 15 05:06:52.876372 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:52.876346 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6fd4d678b4-cnzlq_148991d8-7720-4971-a969-f32a1b3a3662/thanos-query/0.log" Jun 15 05:06:52.896887 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:52.896854 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6fd4d678b4-cnzlq_148991d8-7720-4971-a969-f32a1b3a3662/kube-rbac-proxy-web/0.log" Jun 15 05:06:52.915298 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:52.915273 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6fd4d678b4-cnzlq_148991d8-7720-4971-a969-f32a1b3a3662/kube-rbac-proxy/0.log" Jun 15 05:06:52.931948 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:52.931924 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6fd4d678b4-cnzlq_148991d8-7720-4971-a969-f32a1b3a3662/prom-label-proxy/0.log" Jun 15 05:06:52.947618 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:52.947592 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6fd4d678b4-cnzlq_148991d8-7720-4971-a969-f32a1b3a3662/kube-rbac-proxy-rules/0.log" Jun 15 05:06:52.965705 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:52.965680 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6fd4d678b4-cnzlq_148991d8-7720-4971-a969-f32a1b3a3662/kube-rbac-proxy-metrics/0.log" Jun 15 05:06:54.469006 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:54.468976 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-867b76cb74-sgvbt_6c21d099-af2c-41fc-aca7-dac74c4dee06/networking-console-plugin/0.log" Jun 15 05:06:55.598473 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:55.598425 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-d6bdbb769-2lw8s_779e5074-d20b-4b87-93b9-64be0b255888/console/0.log" Jun 15 05:06:55.633645 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:55.633614 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-694c955b9-ttp92_c692cf67-9f35-45fb-b965-4f4fd1b2be04/download-server/0.log" Jun 15 05:06:56.846182 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:56.846149 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-l6v9r/perf-node-gather-daemonset-wdnwf"] Jun 15 05:06:56.850078 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:56.850057 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-l6v9r/perf-node-gather-daemonset-wdnwf" Jun 15 05:06:56.852058 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:56.852039 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-l6v9r\"/\"openshift-service-ca.crt\"" Jun 15 05:06:56.852695 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:56.852676 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-l6v9r\"/\"default-dockercfg-zvzng\"" Jun 15 05:06:56.852844 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:56.852719 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-l6v9r\"/\"kube-root-ca.crt\"" Jun 15 05:06:56.856478 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:56.856456 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-l6v9r/perf-node-gather-daemonset-wdnwf"] Jun 15 05:06:56.906073 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:56.906036 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2eb5593a-beec-458d-9e04-cc010419082d-proc\") pod \"perf-node-gather-daemonset-wdnwf\" (UID: \"2eb5593a-beec-458d-9e04-cc010419082d\") " pod="openshift-must-gather-l6v9r/perf-node-gather-daemonset-wdnwf" Jun 15 05:06:56.906231 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:56.906121 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2eb5593a-beec-458d-9e04-cc010419082d-lib-modules\") pod \"perf-node-gather-daemonset-wdnwf\" (UID: \"2eb5593a-beec-458d-9e04-cc010419082d\") " pod="openshift-must-gather-l6v9r/perf-node-gather-daemonset-wdnwf" Jun 15 05:06:56.906231 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:56.906146 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2eb5593a-beec-458d-9e04-cc010419082d-podres\") pod \"perf-node-gather-daemonset-wdnwf\" (UID: \"2eb5593a-beec-458d-9e04-cc010419082d\") " pod="openshift-must-gather-l6v9r/perf-node-gather-daemonset-wdnwf" Jun 15 05:06:56.906231 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:56.906172 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2eb5593a-beec-458d-9e04-cc010419082d-sys\") pod \"perf-node-gather-daemonset-wdnwf\" (UID: \"2eb5593a-beec-458d-9e04-cc010419082d\") " pod="openshift-must-gather-l6v9r/perf-node-gather-daemonset-wdnwf" Jun 15 05:06:56.906231 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:56.906198 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tl7vb\" (UniqueName: \"kubernetes.io/projected/2eb5593a-beec-458d-9e04-cc010419082d-kube-api-access-tl7vb\") pod \"perf-node-gather-daemonset-wdnwf\" (UID: \"2eb5593a-beec-458d-9e04-cc010419082d\") " pod="openshift-must-gather-l6v9r/perf-node-gather-daemonset-wdnwf" Jun 15 05:06:57.006916 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:57.006880 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2eb5593a-beec-458d-9e04-cc010419082d-proc\") pod \"perf-node-gather-daemonset-wdnwf\" (UID: \"2eb5593a-beec-458d-9e04-cc010419082d\") " pod="openshift-must-gather-l6v9r/perf-node-gather-daemonset-wdnwf" Jun 15 05:06:57.007149 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:57.006942 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2eb5593a-beec-458d-9e04-cc010419082d-lib-modules\") pod \"perf-node-gather-daemonset-wdnwf\" (UID: \"2eb5593a-beec-458d-9e04-cc010419082d\") " pod="openshift-must-gather-l6v9r/perf-node-gather-daemonset-wdnwf" Jun 15 05:06:57.007149 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:57.006963 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2eb5593a-beec-458d-9e04-cc010419082d-podres\") pod \"perf-node-gather-daemonset-wdnwf\" (UID: \"2eb5593a-beec-458d-9e04-cc010419082d\") " pod="openshift-must-gather-l6v9r/perf-node-gather-daemonset-wdnwf" Jun 15 05:06:57.007149 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:57.006986 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2eb5593a-beec-458d-9e04-cc010419082d-sys\") pod \"perf-node-gather-daemonset-wdnwf\" (UID: \"2eb5593a-beec-458d-9e04-cc010419082d\") " pod="openshift-must-gather-l6v9r/perf-node-gather-daemonset-wdnwf" Jun 15 05:06:57.007149 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:57.007010 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2eb5593a-beec-458d-9e04-cc010419082d-proc\") pod \"perf-node-gather-daemonset-wdnwf\" (UID: \"2eb5593a-beec-458d-9e04-cc010419082d\") " pod="openshift-must-gather-l6v9r/perf-node-gather-daemonset-wdnwf" Jun 15 05:06:57.007149 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:57.007017 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tl7vb\" (UniqueName: \"kubernetes.io/projected/2eb5593a-beec-458d-9e04-cc010419082d-kube-api-access-tl7vb\") pod \"perf-node-gather-daemonset-wdnwf\" (UID: \"2eb5593a-beec-458d-9e04-cc010419082d\") " pod="openshift-must-gather-l6v9r/perf-node-gather-daemonset-wdnwf" Jun 15 05:06:57.007149 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:57.007086 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2eb5593a-beec-458d-9e04-cc010419082d-sys\") pod \"perf-node-gather-daemonset-wdnwf\" (UID: \"2eb5593a-beec-458d-9e04-cc010419082d\") " pod="openshift-must-gather-l6v9r/perf-node-gather-daemonset-wdnwf" Jun 15 05:06:57.007149 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:57.007128 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2eb5593a-beec-458d-9e04-cc010419082d-podres\") pod \"perf-node-gather-daemonset-wdnwf\" (UID: \"2eb5593a-beec-458d-9e04-cc010419082d\") " pod="openshift-must-gather-l6v9r/perf-node-gather-daemonset-wdnwf" Jun 15 05:06:57.007149 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:57.007133 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2eb5593a-beec-458d-9e04-cc010419082d-lib-modules\") pod \"perf-node-gather-daemonset-wdnwf\" (UID: \"2eb5593a-beec-458d-9e04-cc010419082d\") " pod="openshift-must-gather-l6v9r/perf-node-gather-daemonset-wdnwf" Jun 15 05:06:57.014031 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:57.014002 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tl7vb\" (UniqueName: \"kubernetes.io/projected/2eb5593a-beec-458d-9e04-cc010419082d-kube-api-access-tl7vb\") pod \"perf-node-gather-daemonset-wdnwf\" (UID: \"2eb5593a-beec-458d-9e04-cc010419082d\") " pod="openshift-must-gather-l6v9r/perf-node-gather-daemonset-wdnwf" Jun 15 05:06:57.162056 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:57.162029 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-l6v9r/perf-node-gather-daemonset-wdnwf" Jun 15 05:06:57.300529 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:57.300499 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-l6v9r/perf-node-gather-daemonset-wdnwf"] Jun 15 05:06:57.302419 ip-10-0-140-86 kubenswrapper[2561]: W0615 05:06:57.302386 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2eb5593a_beec_458d_9e04_cc010419082d.slice/crio-08b077ae9f72bc650fe90bbefd2cb81520d2c111f1321faddde289cbf561719d WatchSource:0}: Error finding container 08b077ae9f72bc650fe90bbefd2cb81520d2c111f1321faddde289cbf561719d: Status 404 returned error can't find the container with id 08b077ae9f72bc650fe90bbefd2cb81520d2c111f1321faddde289cbf561719d Jun 15 05:06:57.461094 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:57.461071 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7xnm7_f9bfaab4-82a7-48b0-8da5-3c0253207235/dns/0.log" Jun 15 05:06:57.477172 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:57.477154 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7xnm7_f9bfaab4-82a7-48b0-8da5-3c0253207235/kube-rbac-proxy/0.log" Jun 15 05:06:57.575117 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:57.575088 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4znw7_fd16b391-af84-45b8-bbaf-e042e8a2c1e4/dns-node-resolver/0.log" Jun 15 05:06:57.773736 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:57.773637 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-l6v9r/perf-node-gather-daemonset-wdnwf" event={"ID":"2eb5593a-beec-458d-9e04-cc010419082d","Type":"ContainerStarted","Data":"ecdd2176261ab32449f1ff8ebd505cd6350cf6388f65f009418c0c5953f2f690"} Jun 15 05:06:57.773736 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:57.773699 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-l6v9r/perf-node-gather-daemonset-wdnwf" event={"ID":"2eb5593a-beec-458d-9e04-cc010419082d","Type":"ContainerStarted","Data":"08b077ae9f72bc650fe90bbefd2cb81520d2c111f1321faddde289cbf561719d"} Jun 15 05:06:57.774189 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:57.773754 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-l6v9r/perf-node-gather-daemonset-wdnwf" Jun 15 05:06:57.790335 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:57.790286 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-l6v9r/perf-node-gather-daemonset-wdnwf" podStartSLOduration=1.790272754 podStartE2EDuration="1.790272754s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 05:06:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 05:06:57.78707206 +0000 UTC m=+2493.315062966" watchObservedRunningTime="2026-06-15 05:06:57.790272754 +0000 UTC m=+2493.318263660" Jun 15 05:06:58.154162 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:58.154066 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-96sfm_90fa004f-1d43-402a-8a68-a5147aea49e6/node-ca/0.log" Jun 15 05:06:59.054332 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:59.054283 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795kg7k6_f99f60f5-8fe8-448f-b89c-9087959d67b3/istio-proxy/0.log" Jun 15 05:06:59.183342 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:59.183314 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-52z6d_dd4117cb-4e31-4833-b8fa-cffe57c8b8c8/istio-proxy/0.log" Jun 15 05:06:59.249413 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:59.249377 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-52z6d_dd4117cb-4e31-4833-b8fa-cffe57c8b8c8/istio-proxy/1.log" Jun 15 05:06:59.285491 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:59.285462 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-hzbt8_556b7390-59d9-4bf8-8e15-645e2b25c299/payload-pre-processing/0.log" Jun 15 05:06:59.386693 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:06:59.386615 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-z2rrc_6b6b6ef0-cfc4-4acd-a111-14dc1c6a7e45/payload-processing/0.log" Jun 15 05:07:00.025067 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:07:00.025029 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fjpd5_36d7d24f-8986-48c6-adc6-0a26989040fb/serve-healthcheck-canary/0.log" Jun 15 05:07:00.544965 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:07:00.544929 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fvvjk_a64a069b-6288-41dd-a2b4-844b5a0e0a6a/kube-rbac-proxy/0.log" Jun 15 05:07:00.559516 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:07:00.559470 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fvvjk_a64a069b-6288-41dd-a2b4-844b5a0e0a6a/exporter/0.log" Jun 15 05:07:00.574818 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:07:00.574793 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fvvjk_a64a069b-6288-41dd-a2b4-844b5a0e0a6a/extractor/0.log" Jun 15 05:07:02.813982 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:07:02.813955 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-6446c88f59-jgkm8_a6b27c6a-f11f-4b95-8858-fb7653453e17/nginx/0.log" Jun 15 05:07:03.350491 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:07:03.350463 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-54bcdff745-sqckf_ba04564a-566b-4020-9e43-ca8644dbbc67/manager/0.log" Jun 15 05:07:03.366758 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:07:03.366715 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-54bcdff745-sqckf_ba04564a-566b-4020-9e43-ca8644dbbc67/copy-manifests/0.log" Jun 15 05:07:03.430321 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:07:03.430290 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-hxdn6_01bb059b-3031-449c-91e4-c8270aa7aa58/postgres/0.log" Jun 15 05:07:03.791232 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:07:03.791200 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-l6v9r/perf-node-gather-daemonset-wdnwf" Jun 15 05:07:04.856914 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:07:04.856885 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-56698c95d7-qnplb_1eda4a6b-fa9c-44b8-b47a-c71d3904e3ca/manager/0.log" Jun 15 05:07:04.902376 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:07:04.902346 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-b768d_1e1db8b1-9a53-4089-9506-7e902457db63/openshift-lws-operator/0.log" Jun 15 05:07:09.779350 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:07:09.779318 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795kg7k6_f99f60f5-8fe8-448f-b89c-9087959d67b3/istio-proxy/0.log" Jun 15 05:07:09.875976 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:07:09.875935 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-52z6d_dd4117cb-4e31-4833-b8fa-cffe57c8b8c8/istio-proxy/0.log" Jun 15 05:07:09.947242 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:07:09.947200 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-52z6d_dd4117cb-4e31-4833-b8fa-cffe57c8b8c8/istio-proxy/1.log" Jun 15 05:07:09.973664 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:07:09.973571 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-hzbt8_556b7390-59d9-4bf8-8e15-645e2b25c299/payload-pre-processing/0.log" Jun 15 05:07:10.057792 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:07:10.057761 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-z2rrc_6b6b6ef0-cfc4-4acd-a111-14dc1c6a7e45/payload-processing/0.log" Jun 15 05:07:10.117451 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:07:10.117421 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d4bcd4867-rktt4_ad42f712-062f-47f0-8ab0-31d97605da00/migrator/0.log" Jun 15 05:07:10.133698 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:07:10.133669 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d4bcd4867-rktt4_ad42f712-062f-47f0-8ab0-31d97605da00/graceful-termination/0.log" Jun 15 05:07:10.597337 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:07:10.597305 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7c578b78fc-7rsjb_a865e14d-8cfa-4465-bd6e-56ac84b2f7cd/kube-storage-version-migrator-operator/1.log" Jun 15 05:07:10.598764 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:07:10.598737 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7c578b78fc-7rsjb_a865e14d-8cfa-4465-bd6e-56ac84b2f7cd/kube-storage-version-migrator-operator/0.log" Jun 15 05:07:11.129480 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:07:11.129391 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795kg7k6_f99f60f5-8fe8-448f-b89c-9087959d67b3/istio-proxy/0.log" Jun 15 05:07:11.233615 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:07:11.233582 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-52z6d_dd4117cb-4e31-4833-b8fa-cffe57c8b8c8/istio-proxy/0.log" Jun 15 05:07:11.297228 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:07:11.297185 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-52z6d_dd4117cb-4e31-4833-b8fa-cffe57c8b8c8/istio-proxy/1.log" Jun 15 05:07:11.325732 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:07:11.325701 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-hzbt8_556b7390-59d9-4bf8-8e15-645e2b25c299/payload-pre-processing/0.log" Jun 15 05:07:11.415841 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:07:11.415808 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-z2rrc_6b6b6ef0-cfc4-4acd-a111-14dc1c6a7e45/payload-processing/0.log" Jun 15 05:07:11.684658 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:07:11.684581 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b8vpm_89608486-9c9e-4aa2-a842-ac5c48544dd0/kube-multus-additional-cni-plugins/0.log" Jun 15 05:07:11.701459 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:07:11.701416 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b8vpm_89608486-9c9e-4aa2-a842-ac5c48544dd0/egress-router-binary-copy/0.log" Jun 15 05:07:11.718059 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:07:11.718021 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b8vpm_89608486-9c9e-4aa2-a842-ac5c48544dd0/cni-plugins/0.log" Jun 15 05:07:11.733451 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:07:11.733345 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b8vpm_89608486-9c9e-4aa2-a842-ac5c48544dd0/bond-cni-plugin/0.log" Jun 15 05:07:11.752540 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:07:11.752517 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b8vpm_89608486-9c9e-4aa2-a842-ac5c48544dd0/routeoverride-cni/0.log" Jun 15 05:07:11.767209 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:07:11.767188 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b8vpm_89608486-9c9e-4aa2-a842-ac5c48544dd0/whereabouts-cni-bincopy/0.log" Jun 15 05:07:11.782035 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:07:11.782011 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b8vpm_89608486-9c9e-4aa2-a842-ac5c48544dd0/whereabouts-cni/0.log" Jun 15 05:07:12.099346 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:07:12.099264 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-dtzbz_60d517e2-146b-40e3-899a-9ed192a41a96/kube-multus/0.log" Jun 15 05:07:12.143553 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:07:12.143520 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-4vqz4_87abfa61-f00e-4746-9e96-f6940cbec767/network-metrics-daemon/0.log" Jun 15 05:07:12.156561 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:07:12.156538 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-4vqz4_87abfa61-f00e-4746-9e96-f6940cbec767/kube-rbac-proxy/0.log" Jun 15 05:07:13.027672 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:07:13.027637 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795kg7k6_f99f60f5-8fe8-448f-b89c-9087959d67b3/istio-proxy/0.log" Jun 15 05:07:13.125132 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:07:13.125100 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-52z6d_dd4117cb-4e31-4833-b8fa-cffe57c8b8c8/istio-proxy/0.log" Jun 15 05:07:13.131983 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:07:13.131951 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8fqkk_f345d023-5952-44c4-800e-69cf4dba39a3/ovn-controller/0.log" Jun 15 05:07:13.147010 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:07:13.146986 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8fqkk_f345d023-5952-44c4-800e-69cf4dba39a3/ovn-acl-logging/1.log" Jun 15 05:07:13.147416 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:07:13.147011 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8fqkk_f345d023-5952-44c4-800e-69cf4dba39a3/ovn-acl-logging/0.log" Jun 15 05:07:13.170908 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:07:13.170882 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8fqkk_f345d023-5952-44c4-800e-69cf4dba39a3/kube-rbac-proxy-node/0.log" Jun 15 05:07:13.194530 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:07:13.194508 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8fqkk_f345d023-5952-44c4-800e-69cf4dba39a3/kube-rbac-proxy-ovn-metrics/0.log" Jun 15 05:07:13.196582 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:07:13.196557 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-52z6d_dd4117cb-4e31-4833-b8fa-cffe57c8b8c8/istio-proxy/1.log" Jun 15 05:07:13.208297 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:07:13.208261 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8fqkk_f345d023-5952-44c4-800e-69cf4dba39a3/northd/0.log" Jun 15 05:07:13.222716 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:07:13.222693 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-hzbt8_556b7390-59d9-4bf8-8e15-645e2b25c299/payload-pre-processing/0.log" Jun 15 05:07:13.222903 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:07:13.222883 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8fqkk_f345d023-5952-44c4-800e-69cf4dba39a3/nbdb/0.log" Jun 15 05:07:13.241855 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:07:13.241824 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8fqkk_f345d023-5952-44c4-800e-69cf4dba39a3/sbdb/0.log" Jun 15 05:07:13.342599 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:07:13.342508 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8fqkk_f345d023-5952-44c4-800e-69cf4dba39a3/ovnkube-controller/0.log" Jun 15 05:07:13.344640 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:07:13.344618 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-z2rrc_6b6b6ef0-cfc4-4acd-a111-14dc1c6a7e45/payload-processing/0.log" Jun 15 05:07:14.995541 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:07:14.995509 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-qwgsn_990077c4-c49d-4ae5-b011-c77744e70ea9/network-check-target-container/0.log" Jun 15 05:07:15.385774 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:07:15.385677 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795kg7k6_f99f60f5-8fe8-448f-b89c-9087959d67b3/istio-proxy/0.log" Jun 15 05:07:15.505119 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:07:15.505082 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-52z6d_dd4117cb-4e31-4833-b8fa-cffe57c8b8c8/istio-proxy/0.log" Jun 15 05:07:15.571381 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:07:15.571349 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-52z6d_dd4117cb-4e31-4833-b8fa-cffe57c8b8c8/istio-proxy/1.log" Jun 15 05:07:15.599795 ip-10-0-140-86 kubenswrapper[2561]: I0615 05:07:15.599763 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-hzbt8_556b7390-59d9-4bf8-8e15-645e2b25c299/payload-pre-processing/0.log"