Jun 09 05:29:09.799111 ip-10-0-130-106 systemd[1]: Starting Kubernetes Kubelet... Jun 09 05:29:10.190251 ip-10-0-130-106 kubenswrapper[2564]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 05:29:10.190251 ip-10-0-130-106 kubenswrapper[2564]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 09 05:29:10.190251 ip-10-0-130-106 kubenswrapper[2564]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 05:29:10.190251 ip-10-0-130-106 kubenswrapper[2564]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 09 05:29:10.190251 ip-10-0-130-106 kubenswrapper[2564]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 05:29:10.191050 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.190963 2564 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 09 05:29:10.198608 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198593 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 05:29:10.198650 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198609 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 05:29:10.198650 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198615 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 05:29:10.198650 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198618 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 05:29:10.198650 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198621 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 05:29:10.198650 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198624 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 05:29:10.198650 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198628 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 05:29:10.198650 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198632 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 05:29:10.198650 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198635 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 05:29:10.198650 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198638 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 05:29:10.198650 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198641 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 05:29:10.198650 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198644 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 05:29:10.198650 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198647 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 05:29:10.198650 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198650 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 05:29:10.198650 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198653 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 05:29:10.198650 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198655 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 05:29:10.198650 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198658 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 05:29:10.199049 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198661 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 05:29:10.199049 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198664 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 05:29:10.199049 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198667 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 05:29:10.199049 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198670 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 05:29:10.199049 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198672 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 05:29:10.199049 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198675 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 05:29:10.199049 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198677 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 05:29:10.199049 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198680 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 05:29:10.199049 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198682 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 05:29:10.199049 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198685 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 05:29:10.199049 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198687 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 05:29:10.199049 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198690 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 05:29:10.199049 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198692 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 05:29:10.199049 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198695 2564 feature_gate.go:328] unrecognized feature gate: Example Jun 09 05:29:10.199049 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198698 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 05:29:10.199049 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198700 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 05:29:10.199049 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198702 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 05:29:10.199049 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198706 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 05:29:10.199049 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198709 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 05:29:10.199049 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198711 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 05:29:10.199567 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198715 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 05:29:10.199567 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198718 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 05:29:10.199567 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198721 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 05:29:10.199567 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198723 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 05:29:10.199567 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198726 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 05:29:10.199567 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198729 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 05:29:10.199567 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198732 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 05:29:10.199567 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198734 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 05:29:10.199567 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198737 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 05:29:10.199567 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198739 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 05:29:10.199567 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198742 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 05:29:10.199567 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198744 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 05:29:10.199567 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198748 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 05:29:10.199567 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198751 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 05:29:10.199567 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198754 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 05:29:10.199567 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198757 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 05:29:10.199567 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198759 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 05:29:10.199567 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198762 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 05:29:10.199567 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198765 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 05:29:10.200048 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198767 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 05:29:10.200048 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198770 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 05:29:10.200048 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198772 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 05:29:10.200048 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198775 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 05:29:10.200048 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198777 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 05:29:10.200048 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198779 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 05:29:10.200048 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198782 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 05:29:10.200048 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198786 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 05:29:10.200048 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198804 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 05:29:10.200048 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198809 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 05:29:10.200048 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198813 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 05:29:10.200048 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198817 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 05:29:10.200048 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198820 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 05:29:10.200048 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198823 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 05:29:10.200048 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198826 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 05:29:10.200048 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198829 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 05:29:10.200048 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198831 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 05:29:10.200048 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198834 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 05:29:10.200048 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198836 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 05:29:10.200048 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198839 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 05:29:10.200532 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198841 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 05:29:10.200532 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198843 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 05:29:10.200532 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198846 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 05:29:10.200532 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198849 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 05:29:10.200532 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198851 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 05:29:10.200532 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198856 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 05:29:10.200532 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198859 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 05:29:10.200532 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198862 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 05:29:10.200532 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198865 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 05:29:10.200532 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198867 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 05:29:10.200532 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198870 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 05:29:10.200532 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198872 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 05:29:10.200532 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198875 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 05:29:10.200532 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198877 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 05:29:10.200532 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198880 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 05:29:10.200532 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198882 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 05:29:10.200532 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198884 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 05:29:10.200532 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198887 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 05:29:10.200532 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198890 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 05:29:10.200532 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198892 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 05:29:10.201053 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198895 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 05:29:10.201053 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198898 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 05:29:10.201053 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.198900 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 05:29:10.201053 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199623 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 05:29:10.201053 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199630 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 05:29:10.201053 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199633 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 05:29:10.201053 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199636 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 05:29:10.201053 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199638 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 05:29:10.201053 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199648 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 05:29:10.201053 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199651 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 05:29:10.201053 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199654 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 05:29:10.201053 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199657 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 05:29:10.201053 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199659 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 05:29:10.201053 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199662 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 05:29:10.201053 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199665 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 05:29:10.201053 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199667 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 05:29:10.201053 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199670 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 05:29:10.201053 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199673 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 05:29:10.201053 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199676 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 05:29:10.201053 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199678 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 05:29:10.201552 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199681 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 05:29:10.201552 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199684 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 05:29:10.201552 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199686 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 05:29:10.201552 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199688 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 05:29:10.201552 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199691 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 05:29:10.201552 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199693 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 05:29:10.201552 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199696 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 05:29:10.201552 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199699 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 05:29:10.201552 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199701 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 05:29:10.201552 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199704 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 05:29:10.201552 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199707 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 05:29:10.201552 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199709 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 05:29:10.201552 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199712 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 05:29:10.201552 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199715 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 05:29:10.201552 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199718 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 05:29:10.201552 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199720 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 05:29:10.201552 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199723 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 05:29:10.201552 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199725 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 05:29:10.201552 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199728 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 05:29:10.201552 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199730 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 05:29:10.202089 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199733 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 05:29:10.202089 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199739 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 05:29:10.202089 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199742 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 05:29:10.202089 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199745 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 05:29:10.202089 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199748 2564 feature_gate.go:328] unrecognized feature gate: Example Jun 09 05:29:10.202089 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199750 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 05:29:10.202089 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199753 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 05:29:10.202089 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199756 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 05:29:10.202089 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199760 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 05:29:10.202089 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199764 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 05:29:10.202089 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199767 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 05:29:10.202089 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199770 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 05:29:10.202089 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199773 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 05:29:10.202089 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199776 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 05:29:10.202089 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199779 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 05:29:10.202089 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199781 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 05:29:10.202089 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199784 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 05:29:10.202089 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199786 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 05:29:10.202089 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199811 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 05:29:10.202089 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199814 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 05:29:10.202572 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199816 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 05:29:10.202572 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199819 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 05:29:10.202572 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199821 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 05:29:10.202572 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199824 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 05:29:10.202572 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199826 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 05:29:10.202572 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199831 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 05:29:10.202572 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199834 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 05:29:10.202572 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199837 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 05:29:10.202572 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199840 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 05:29:10.202572 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199842 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 05:29:10.202572 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199845 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 05:29:10.202572 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199847 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 05:29:10.202572 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199850 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 05:29:10.202572 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199853 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 05:29:10.202572 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199859 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 05:29:10.202572 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199863 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 05:29:10.202572 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199866 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 05:29:10.202572 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199869 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 05:29:10.202572 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199872 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 05:29:10.203062 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199875 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 05:29:10.203062 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199878 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 05:29:10.203062 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199881 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 05:29:10.203062 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199884 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 05:29:10.203062 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199887 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 05:29:10.203062 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199890 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 05:29:10.203062 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199892 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 05:29:10.203062 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199895 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 05:29:10.203062 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199898 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 05:29:10.203062 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199901 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 05:29:10.203062 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199904 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 05:29:10.203062 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199906 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 05:29:10.203062 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199909 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 05:29:10.203062 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199912 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 05:29:10.203062 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199915 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 05:29:10.203062 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199917 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 05:29:10.203062 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199920 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 05:29:10.203062 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199922 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 05:29:10.203062 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199925 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 05:29:10.203638 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199928 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 05:29:10.203638 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199931 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 05:29:10.203638 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199933 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 05:29:10.203638 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.199936 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 05:29:10.203638 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200304 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 05:29:10.203638 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200309 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 05:29:10.203638 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200312 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 05:29:10.203638 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200314 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 05:29:10.203638 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200318 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 05:29:10.203638 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200321 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 05:29:10.203638 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200323 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 05:29:10.203638 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200328 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 05:29:10.203638 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200332 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 05:29:10.203638 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200336 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 05:29:10.203638 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200338 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 05:29:10.203638 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200341 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 05:29:10.203638 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200360 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 05:29:10.203638 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200364 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 05:29:10.203638 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200367 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 05:29:10.204118 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200370 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 05:29:10.204118 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200372 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 05:29:10.204118 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200375 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 05:29:10.204118 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200377 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 05:29:10.204118 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200381 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 05:29:10.204118 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200387 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 05:29:10.204118 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200390 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 05:29:10.204118 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200393 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 05:29:10.204118 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200396 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 05:29:10.204118 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200398 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 05:29:10.204118 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200401 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 05:29:10.204118 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200404 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 05:29:10.204118 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200406 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 05:29:10.204118 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200409 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 05:29:10.204118 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200412 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 05:29:10.204118 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200414 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 05:29:10.204118 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200417 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 05:29:10.204118 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200419 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 05:29:10.204118 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200422 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 05:29:10.204118 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200424 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 05:29:10.204639 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200427 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 05:29:10.204639 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200429 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 05:29:10.204639 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200432 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 05:29:10.204639 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200435 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 05:29:10.204639 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200437 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 05:29:10.204639 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200440 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 05:29:10.204639 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200445 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 05:29:10.204639 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200449 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 05:29:10.204639 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200452 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 05:29:10.204639 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200455 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 05:29:10.204639 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200457 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 05:29:10.204639 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200460 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 05:29:10.204639 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200462 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 05:29:10.204639 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200465 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 05:29:10.204639 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200467 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 05:29:10.204639 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200470 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 05:29:10.204639 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200473 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 05:29:10.204639 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200476 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 05:29:10.204639 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200479 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 05:29:10.204639 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200482 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 05:29:10.205136 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200484 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 05:29:10.205136 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200487 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 05:29:10.205136 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200489 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 05:29:10.205136 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200492 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 05:29:10.205136 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200494 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 05:29:10.205136 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200497 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 05:29:10.205136 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200499 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 05:29:10.205136 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200502 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 05:29:10.205136 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200504 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 05:29:10.205136 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200506 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 05:29:10.205136 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200509 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 05:29:10.205136 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200511 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 05:29:10.205136 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200514 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 05:29:10.205136 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200516 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 05:29:10.205136 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200519 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 05:29:10.205136 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200522 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 05:29:10.205136 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200525 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 05:29:10.205136 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200527 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 05:29:10.205136 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200530 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 05:29:10.205590 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200533 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 05:29:10.205590 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200536 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 05:29:10.205590 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200538 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 05:29:10.205590 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200542 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 05:29:10.205590 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200545 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 05:29:10.205590 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200548 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 05:29:10.205590 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200550 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 05:29:10.205590 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200553 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 05:29:10.205590 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200555 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 05:29:10.205590 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200558 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 05:29:10.205590 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200561 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 05:29:10.205590 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200563 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 05:29:10.205590 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200566 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 05:29:10.205590 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200568 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 05:29:10.205590 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200571 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 05:29:10.205590 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200574 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 05:29:10.205590 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200576 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 05:29:10.205590 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200578 2564 feature_gate.go:328] unrecognized feature gate: Example Jun 09 05:29:10.205590 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200581 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 05:29:10.206107 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200584 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 05:29:10.206107 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200586 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 05:29:10.206107 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200589 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 05:29:10.206107 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200591 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 05:29:10.206107 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200594 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 05:29:10.206107 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.200596 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 05:29:10.206107 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200661 2564 flags.go:64] FLAG: --address="0.0.0.0" Jun 09 05:29:10.206107 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200672 2564 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 09 05:29:10.206107 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200677 2564 flags.go:64] FLAG: --anonymous-auth="true" Jun 09 05:29:10.206107 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200682 2564 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 09 05:29:10.206107 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200686 2564 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 09 05:29:10.206107 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200689 2564 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 09 05:29:10.206107 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200693 2564 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 09 05:29:10.206107 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200698 2564 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 09 05:29:10.206107 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200701 2564 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 09 05:29:10.206107 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200704 2564 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 09 05:29:10.206107 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200708 2564 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 09 05:29:10.206107 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200711 2564 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 09 05:29:10.206107 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200714 2564 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 09 05:29:10.206107 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200717 2564 flags.go:64] FLAG: --cgroup-root="" Jun 09 05:29:10.206107 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200720 2564 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 09 05:29:10.206107 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200723 2564 flags.go:64] FLAG: --client-ca-file="" Jun 09 05:29:10.206107 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200726 2564 flags.go:64] FLAG: --cloud-provider="external" Jun 09 05:29:10.206668 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200729 2564 flags.go:64] FLAG: --cluster-dns="[]" Jun 09 05:29:10.206668 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200734 2564 flags.go:64] FLAG: --cluster-domain="" Jun 09 05:29:10.206668 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200737 2564 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 09 05:29:10.206668 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200741 2564 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 09 05:29:10.206668 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200744 2564 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 09 05:29:10.206668 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200747 2564 flags.go:64] FLAG: --container-log-max-files="5" Jun 09 05:29:10.206668 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200751 2564 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 09 05:29:10.206668 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200754 2564 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 09 05:29:10.206668 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200757 2564 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 09 05:29:10.206668 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200760 2564 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 09 05:29:10.206668 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200763 2564 flags.go:64] FLAG: --contention-profiling="false" Jun 09 05:29:10.206668 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200766 2564 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 09 05:29:10.206668 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200769 2564 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 09 05:29:10.206668 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200772 2564 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 09 05:29:10.206668 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200775 2564 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 09 05:29:10.206668 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200779 2564 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 09 05:29:10.206668 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200782 2564 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 09 05:29:10.206668 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200785 2564 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 09 05:29:10.206668 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200788 2564 flags.go:64] FLAG: --enable-load-reader="false" Jun 09 05:29:10.206668 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200807 2564 flags.go:64] FLAG: --enable-server="true" Jun 09 05:29:10.206668 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200814 2564 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 09 05:29:10.206668 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200818 2564 flags.go:64] FLAG: --event-burst="100" Jun 09 05:29:10.206668 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200821 2564 flags.go:64] FLAG: --event-qps="50" Jun 09 05:29:10.206668 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200824 2564 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 09 05:29:10.207259 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200827 2564 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 09 05:29:10.207259 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200830 2564 flags.go:64] FLAG: --eviction-hard="" Jun 09 05:29:10.207259 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200834 2564 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 09 05:29:10.207259 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200836 2564 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 09 05:29:10.207259 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200839 2564 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 09 05:29:10.207259 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200842 2564 flags.go:64] FLAG: --eviction-soft="" Jun 09 05:29:10.207259 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200845 2564 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 09 05:29:10.207259 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200848 2564 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 09 05:29:10.207259 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200851 2564 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 09 05:29:10.207259 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200854 2564 flags.go:64] FLAG: --experimental-mounter-path="" Jun 09 05:29:10.207259 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200857 2564 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 09 05:29:10.207259 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200860 2564 flags.go:64] FLAG: --fail-swap-on="true" Jun 09 05:29:10.207259 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200863 2564 flags.go:64] FLAG: --feature-gates="" Jun 09 05:29:10.207259 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200867 2564 flags.go:64] FLAG: --file-check-frequency="20s" Jun 09 05:29:10.207259 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200870 2564 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 09 05:29:10.207259 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200873 2564 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 09 05:29:10.207259 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200875 2564 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 09 05:29:10.207259 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200878 2564 flags.go:64] FLAG: --healthz-port="10248" Jun 09 05:29:10.207259 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200881 2564 flags.go:64] FLAG: --help="false" Jun 09 05:29:10.207259 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200884 2564 flags.go:64] FLAG: --hostname-override="ip-10-0-130-106.ec2.internal" Jun 09 05:29:10.207259 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200887 2564 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 09 05:29:10.207259 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200890 2564 flags.go:64] FLAG: --http-check-frequency="20s" Jun 09 05:29:10.207259 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200893 2564 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 09 05:29:10.207922 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200896 2564 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 09 05:29:10.207922 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200899 2564 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 09 05:29:10.207922 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200903 2564 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 09 05:29:10.207922 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200905 2564 flags.go:64] FLAG: --image-service-endpoint="" Jun 09 05:29:10.207922 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200908 2564 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 09 05:29:10.207922 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200912 2564 flags.go:64] FLAG: --kube-api-burst="100" Jun 09 05:29:10.207922 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200915 2564 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 09 05:29:10.207922 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200918 2564 flags.go:64] FLAG: --kube-api-qps="50" Jun 09 05:29:10.207922 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200922 2564 flags.go:64] FLAG: --kube-reserved="" Jun 09 05:29:10.207922 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200924 2564 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 09 05:29:10.207922 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200927 2564 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 09 05:29:10.207922 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200930 2564 flags.go:64] FLAG: --kubelet-cgroups="" Jun 09 05:29:10.207922 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200933 2564 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 09 05:29:10.207922 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200936 2564 flags.go:64] FLAG: --lock-file="" Jun 09 05:29:10.207922 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200939 2564 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 09 05:29:10.207922 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200942 2564 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 09 05:29:10.207922 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200945 2564 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 09 05:29:10.207922 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200950 2564 flags.go:64] FLAG: --log-json-split-stream="false" Jun 09 05:29:10.207922 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200953 2564 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 09 05:29:10.207922 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200956 2564 flags.go:64] FLAG: --log-text-split-stream="false" Jun 09 05:29:10.207922 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200958 2564 flags.go:64] FLAG: --logging-format="text" Jun 09 05:29:10.207922 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200961 2564 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 09 05:29:10.207922 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200964 2564 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 09 05:29:10.207922 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200967 2564 flags.go:64] FLAG: --manifest-url="" Jun 09 05:29:10.208505 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200970 2564 flags.go:64] FLAG: --manifest-url-header="" Jun 09 05:29:10.208505 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200974 2564 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 09 05:29:10.208505 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200977 2564 flags.go:64] FLAG: --max-open-files="1000000" Jun 09 05:29:10.208505 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200981 2564 flags.go:64] FLAG: --max-pods="110" Jun 09 05:29:10.208505 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200984 2564 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 09 05:29:10.208505 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200986 2564 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 09 05:29:10.208505 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200989 2564 flags.go:64] FLAG: --memory-manager-policy="None" Jun 09 05:29:10.208505 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200992 2564 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 09 05:29:10.208505 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200995 2564 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 09 05:29:10.208505 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.200998 2564 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 09 05:29:10.208505 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.201001 2564 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 09 05:29:10.208505 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.201007 2564 flags.go:64] FLAG: --node-status-max-images="50" Jun 09 05:29:10.208505 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.201010 2564 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 09 05:29:10.208505 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.201014 2564 flags.go:64] FLAG: --oom-score-adj="-999" Jun 09 05:29:10.208505 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.201017 2564 flags.go:64] FLAG: --pod-cidr="" Jun 09 05:29:10.208505 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.201021 2564 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 09 05:29:10.208505 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.201026 2564 flags.go:64] FLAG: --pod-manifest-path="" Jun 09 05:29:10.208505 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.201029 2564 flags.go:64] FLAG: --pod-max-pids="-1" Jun 09 05:29:10.208505 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.201032 2564 flags.go:64] FLAG: --pods-per-core="0" Jun 09 05:29:10.208505 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.201035 2564 flags.go:64] FLAG: --port="10250" Jun 09 05:29:10.208505 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.201038 2564 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 09 05:29:10.208505 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.201040 2564 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-04762133da6fb34f0" Jun 09 05:29:10.208505 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.201044 2564 flags.go:64] FLAG: --qos-reserved="" Jun 09 05:29:10.208505 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.201047 2564 flags.go:64] FLAG: --read-only-port="10255" Jun 09 05:29:10.209096 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.201050 2564 flags.go:64] FLAG: --register-node="true" Jun 09 05:29:10.209096 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.201054 2564 flags.go:64] FLAG: --register-with-taints="" Jun 09 05:29:10.209096 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.201058 2564 flags.go:64] FLAG: --registry-burst="10" Jun 09 05:29:10.209096 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.201061 2564 flags.go:64] FLAG: --registry-qps="5" Jun 09 05:29:10.209096 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.201064 2564 flags.go:64] FLAG: --reserved-cpus="" Jun 09 05:29:10.209096 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.201067 2564 flags.go:64] FLAG: --reserved-memory="" Jun 09 05:29:10.209096 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.201074 2564 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 09 05:29:10.209096 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.201077 2564 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 09 05:29:10.209096 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.201080 2564 flags.go:64] FLAG: --rotate-certificates="false" Jun 09 05:29:10.209096 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.201083 2564 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 09 05:29:10.209096 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.201086 2564 flags.go:64] FLAG: --runonce="false" Jun 09 05:29:10.209096 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.201089 2564 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 09 05:29:10.209096 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.201092 2564 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 09 05:29:10.209096 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.201095 2564 flags.go:64] FLAG: --seccomp-default="false" Jun 09 05:29:10.209096 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.201097 2564 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 09 05:29:10.209096 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.201100 2564 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 09 05:29:10.209096 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.201103 2564 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 09 05:29:10.209096 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.201106 2564 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 09 05:29:10.209096 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.201109 2564 flags.go:64] FLAG: --storage-driver-password="root" Jun 09 05:29:10.209096 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.201112 2564 flags.go:64] FLAG: --storage-driver-secure="false" Jun 09 05:29:10.209096 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.201115 2564 flags.go:64] FLAG: --storage-driver-table="stats" Jun 09 05:29:10.209096 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.201117 2564 flags.go:64] FLAG: --storage-driver-user="root" Jun 09 05:29:10.209096 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.201121 2564 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 09 05:29:10.209096 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.201124 2564 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 09 05:29:10.209096 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.201128 2564 flags.go:64] FLAG: --system-cgroups="" Jun 09 05:29:10.209731 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.201131 2564 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 09 05:29:10.209731 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.201136 2564 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 09 05:29:10.209731 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.201139 2564 flags.go:64] FLAG: --tls-cert-file="" Jun 09 05:29:10.209731 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.201142 2564 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 09 05:29:10.209731 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.201146 2564 flags.go:64] FLAG: --tls-min-version="" Jun 09 05:29:10.209731 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.201149 2564 flags.go:64] FLAG: --tls-private-key-file="" Jun 09 05:29:10.209731 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.201152 2564 flags.go:64] FLAG: --topology-manager-policy="none" Jun 09 05:29:10.209731 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.201155 2564 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 09 05:29:10.209731 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.201159 2564 flags.go:64] FLAG: --topology-manager-scope="container" Jun 09 05:29:10.209731 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.201162 2564 flags.go:64] FLAG: --v="2" Jun 09 05:29:10.209731 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.201165 2564 flags.go:64] FLAG: --version="false" Jun 09 05:29:10.209731 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.201169 2564 flags.go:64] FLAG: --vmodule="" Jun 09 05:29:10.209731 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.201173 2564 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 09 05:29:10.209731 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.201176 2564 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 09 05:29:10.209731 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201294 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 05:29:10.209731 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201298 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 05:29:10.209731 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201301 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 05:29:10.209731 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201305 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 05:29:10.209731 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201308 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 05:29:10.209731 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201311 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 05:29:10.209731 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201314 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 05:29:10.209731 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201316 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 05:29:10.209731 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201319 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 05:29:10.210353 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201322 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 05:29:10.210353 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201325 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 05:29:10.210353 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201328 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 05:29:10.210353 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201330 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 05:29:10.210353 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201333 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 05:29:10.210353 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201335 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 05:29:10.210353 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201340 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 05:29:10.210353 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201343 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 05:29:10.210353 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201346 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 05:29:10.210353 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201350 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 05:29:10.210353 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201352 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 05:29:10.210353 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201355 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 05:29:10.210353 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201359 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 05:29:10.210353 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201362 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 05:29:10.210353 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201365 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 05:29:10.210353 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201368 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 05:29:10.210353 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201371 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 05:29:10.210353 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201376 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 05:29:10.210353 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201378 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 05:29:10.210353 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201381 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 05:29:10.211157 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201384 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 05:29:10.211157 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201387 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 05:29:10.211157 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201389 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 05:29:10.211157 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201392 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 05:29:10.211157 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201394 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 05:29:10.211157 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201397 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 05:29:10.211157 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201401 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 05:29:10.211157 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201404 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 05:29:10.211157 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201407 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 05:29:10.211157 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201410 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 05:29:10.211157 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201412 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 05:29:10.211157 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201415 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 05:29:10.211157 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201417 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 05:29:10.211157 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201420 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 05:29:10.211157 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201422 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 05:29:10.211157 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201425 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 05:29:10.211157 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201428 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 05:29:10.211157 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201430 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 05:29:10.211157 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201435 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 05:29:10.211708 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201438 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 05:29:10.211708 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201440 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 05:29:10.211708 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201443 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 05:29:10.211708 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201447 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 05:29:10.211708 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201451 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 05:29:10.211708 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201454 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 05:29:10.211708 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201456 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 05:29:10.211708 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201459 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 05:29:10.211708 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201462 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 05:29:10.211708 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201464 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 05:29:10.211708 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201468 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 05:29:10.211708 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201470 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 05:29:10.211708 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201473 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 05:29:10.211708 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201476 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 05:29:10.211708 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201479 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 05:29:10.211708 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201481 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 05:29:10.211708 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201484 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 05:29:10.211708 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201487 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 05:29:10.211708 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201489 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 05:29:10.211708 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201492 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 05:29:10.212232 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201494 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 05:29:10.212232 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201497 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 05:29:10.212232 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201500 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 05:29:10.212232 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201502 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 05:29:10.212232 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201505 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 05:29:10.212232 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201507 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 05:29:10.212232 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201510 2564 feature_gate.go:328] unrecognized feature gate: Example Jun 09 05:29:10.212232 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201512 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 05:29:10.212232 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201515 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 05:29:10.212232 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201517 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 05:29:10.212232 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201520 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 05:29:10.212232 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201523 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 05:29:10.212232 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201526 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 05:29:10.212232 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201529 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 05:29:10.212232 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201531 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 05:29:10.212232 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201534 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 05:29:10.212232 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201537 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 05:29:10.212232 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201539 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 05:29:10.212232 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201542 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 05:29:10.212711 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201544 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 05:29:10.212711 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201547 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 05:29:10.212711 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201550 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 05:29:10.212711 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201554 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 05:29:10.212711 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201556 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 05:29:10.212711 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201559 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 05:29:10.212711 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201562 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 05:29:10.212711 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201564 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 05:29:10.212711 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201567 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 05:29:10.212711 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201569 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 05:29:10.212711 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201572 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 05:29:10.212711 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.201575 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 05:29:10.212711 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.202326 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 05:29:10.212711 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.209318 2564 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 09 05:29:10.212711 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.209332 2564 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 09 05:29:10.213117 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.209350 2564 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 09 05:29:10.213117 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.209355 2564 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 09 05:29:10.213117 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209421 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 05:29:10.213117 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209426 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 05:29:10.213117 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209429 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 05:29:10.213117 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209432 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 05:29:10.213117 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209435 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 05:29:10.213117 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209438 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 05:29:10.213117 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209441 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 05:29:10.213117 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209444 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 05:29:10.213117 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209447 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 05:29:10.213117 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209450 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 05:29:10.213117 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209463 2564 feature_gate.go:328] unrecognized feature gate: Example Jun 09 05:29:10.213117 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209467 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 05:29:10.213117 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209469 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 05:29:10.213117 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209472 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 05:29:10.213117 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209474 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 05:29:10.213117 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209478 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 05:29:10.213117 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209480 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 05:29:10.213117 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209483 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 05:29:10.213697 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209486 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 05:29:10.213697 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209488 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 05:29:10.213697 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209491 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 05:29:10.213697 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209495 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 05:29:10.213697 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209499 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 05:29:10.213697 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209503 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 05:29:10.213697 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209506 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 05:29:10.213697 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209509 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 05:29:10.213697 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209512 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 05:29:10.213697 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209515 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 05:29:10.213697 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209518 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 05:29:10.213697 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209522 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 05:29:10.213697 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209525 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 05:29:10.213697 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209528 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 05:29:10.213697 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209531 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 05:29:10.213697 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209534 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 05:29:10.213697 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209536 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 05:29:10.213697 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209539 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 05:29:10.213697 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209542 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 05:29:10.214172 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209544 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 05:29:10.214172 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209547 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 05:29:10.214172 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209549 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 05:29:10.214172 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209552 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 05:29:10.214172 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209554 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 05:29:10.214172 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209557 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 05:29:10.214172 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209559 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 05:29:10.214172 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209562 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 05:29:10.214172 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209565 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 05:29:10.214172 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209568 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 05:29:10.214172 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209571 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 05:29:10.214172 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209573 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 05:29:10.214172 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209576 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 05:29:10.214172 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209578 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 05:29:10.214172 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209581 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 05:29:10.214172 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209583 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 05:29:10.214172 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209586 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 05:29:10.214172 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209588 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 05:29:10.214172 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209591 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 05:29:10.214172 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209594 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 05:29:10.214648 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209596 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 05:29:10.214648 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209599 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 05:29:10.214648 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209601 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 05:29:10.214648 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209604 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 05:29:10.214648 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209607 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 05:29:10.214648 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209610 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 05:29:10.214648 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209612 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 05:29:10.214648 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209615 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 05:29:10.214648 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209617 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 05:29:10.214648 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209620 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 05:29:10.214648 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209622 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 05:29:10.214648 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209625 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 05:29:10.214648 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209627 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 05:29:10.214648 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209630 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 05:29:10.214648 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209632 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 05:29:10.214648 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209635 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 05:29:10.214648 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209638 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 05:29:10.214648 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209640 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 05:29:10.214648 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209643 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 05:29:10.215124 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209645 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 05:29:10.215124 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209648 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 05:29:10.215124 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209651 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 05:29:10.215124 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209653 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 05:29:10.215124 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209657 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 05:29:10.215124 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209660 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 05:29:10.215124 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209663 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 05:29:10.215124 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209667 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 05:29:10.215124 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209669 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 05:29:10.215124 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209672 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 05:29:10.215124 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209674 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 05:29:10.215124 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209676 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 05:29:10.215124 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209679 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 05:29:10.215124 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209682 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 05:29:10.215124 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209684 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 05:29:10.215124 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209687 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 05:29:10.215124 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209690 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 05:29:10.215124 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209693 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 05:29:10.215124 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209695 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 05:29:10.215124 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209698 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 05:29:10.215617 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209701 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 05:29:10.215617 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209703 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 05:29:10.215617 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209706 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 05:29:10.215617 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.209711 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 05:29:10.215617 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209848 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 05:29:10.215617 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209854 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 05:29:10.215617 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209857 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 05:29:10.215617 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209860 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 05:29:10.215617 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209863 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 05:29:10.215617 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209865 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 05:29:10.215617 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209868 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 05:29:10.215617 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209870 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 05:29:10.215617 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209873 2564 feature_gate.go:328] unrecognized feature gate: Example Jun 09 05:29:10.215617 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209875 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 05:29:10.215617 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209877 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 05:29:10.216024 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209880 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 05:29:10.216024 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209882 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 05:29:10.216024 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209885 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 05:29:10.216024 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209887 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 05:29:10.216024 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209890 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 05:29:10.216024 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209892 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 05:29:10.216024 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209895 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 05:29:10.216024 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209897 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 05:29:10.216024 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209900 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 05:29:10.216024 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209904 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 05:29:10.216024 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209908 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 05:29:10.216024 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209911 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 05:29:10.216024 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209913 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 05:29:10.216024 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209916 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 05:29:10.216024 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209918 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 05:29:10.216024 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209921 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 05:29:10.216024 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209923 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 05:29:10.216024 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209926 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 05:29:10.216024 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209928 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 05:29:10.216471 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209931 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 05:29:10.216471 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209934 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 05:29:10.216471 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209936 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 05:29:10.216471 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209939 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 05:29:10.216471 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209941 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 05:29:10.216471 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209943 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 05:29:10.216471 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209946 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 05:29:10.216471 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209948 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 05:29:10.216471 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209951 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 05:29:10.216471 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209953 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 05:29:10.216471 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209956 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 05:29:10.216471 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209958 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 05:29:10.216471 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209960 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 05:29:10.216471 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209963 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 05:29:10.216471 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209965 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 05:29:10.216471 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209967 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 05:29:10.216471 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209970 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 05:29:10.216471 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209987 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 05:29:10.216471 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209991 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 05:29:10.216471 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209994 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 05:29:10.217077 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.209997 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 05:29:10.217077 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.210000 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 05:29:10.217077 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.210003 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 05:29:10.217077 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.210006 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 05:29:10.217077 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.210009 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 05:29:10.217077 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.210011 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 05:29:10.217077 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.210014 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 05:29:10.217077 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.210017 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 05:29:10.217077 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.210019 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 05:29:10.217077 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.210022 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 05:29:10.217077 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.210024 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 05:29:10.217077 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.210027 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 05:29:10.217077 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.210030 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 05:29:10.217077 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.210032 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 05:29:10.217077 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.210036 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 05:29:10.217077 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.210039 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 05:29:10.217077 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.210042 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 05:29:10.217077 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.210045 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 05:29:10.217077 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.210048 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 05:29:10.217647 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.210051 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 05:29:10.217647 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.210054 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 05:29:10.217647 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.210056 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 05:29:10.217647 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.210060 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 05:29:10.217647 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.210063 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 05:29:10.217647 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.210066 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 05:29:10.217647 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.210068 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 05:29:10.217647 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.210071 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 05:29:10.217647 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.210075 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 05:29:10.217647 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.210078 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 05:29:10.217647 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.210081 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 05:29:10.217647 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.210084 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 05:29:10.217647 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.210086 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 05:29:10.217647 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.210089 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 05:29:10.217647 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.210091 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 05:29:10.217647 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.210094 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 05:29:10.217647 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.210096 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 05:29:10.217647 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.210099 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 05:29:10.217647 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.210101 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 05:29:10.218135 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.210104 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 05:29:10.218135 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.210107 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 05:29:10.218135 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.210109 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 05:29:10.218135 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.210111 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 05:29:10.218135 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.210114 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 05:29:10.218135 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.210116 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 05:29:10.218135 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.210119 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 05:29:10.218135 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.210122 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 05:29:10.218135 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.210124 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 05:29:10.218135 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.210127 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 05:29:10.218135 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:10.210129 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 05:29:10.218135 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.210133 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 05:29:10.218135 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.213391 2564 server.go:962] "Client rotation is on, will bootstrap in background" Jun 09 05:29:10.218135 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.215628 2564 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 09 05:29:10.218135 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.217217 2564 server.go:1019] "Starting client certificate rotation" Jun 09 05:29:10.218579 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.217338 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 05:29:10.218579 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.217391 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 05:29:10.219710 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.219693 2564 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 05:29:10.224352 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.224335 2564 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 05:29:10.237809 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.237772 2564 log.go:25] "Validated CRI v1 runtime API" Jun 09 05:29:10.240445 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.240432 2564 log.go:25] "Validated CRI v1 image API" Jun 09 05:29:10.241226 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.241210 2564 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 09 05:29:10.244040 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.244011 2564 fs.go:135] Filesystem UUIDs: map[15583b63-908a-41bc-937b-a55689e372c0:/dev/nvme0n1p4 5f01e1e8-114e-42c6-9f99-1d31197b10b9:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jun 09 05:29:10.244118 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.244038 2564 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 09 05:29:10.245220 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.245203 2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 05:29:10.249176 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.249062 2564 manager.go:216] Machine: {Timestamp:2026-06-09 05:29:10.247750703 +0000 UTC m=+0.330402449 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100767 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec27ef0b62f617edbcb8499932c8f3e1 SystemUUID:ec27ef0b-62f6-17ed-bcb8-499932c8f3e1 BootID:526bf89d-f044-4ea5-9266-ce887193ae12 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f1:f7:3f:fb:9f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f1:f7:3f:fb:9f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:0a:d1:49:76:76:22 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 09 05:29:10.249176 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.249170 2564 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 09 05:29:10.249299 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.249283 2564 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 09 05:29:10.252694 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.252672 2564 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 09 05:29:10.252901 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.252696 2564 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-106.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 09 05:29:10.253481 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.253472 2564 topology_manager.go:138] "Creating topology manager with none policy" Jun 09 05:29:10.253513 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.253484 2564 container_manager_linux.go:309] "Creating device plugin manager" Jun 09 05:29:10.253513 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.253492 2564 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 05:29:10.254057 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.254046 2564 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 05:29:10.254857 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.254848 2564 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 09 05:29:10.257744 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.257732 2564 state_mem.go:36] "Initialized new in-memory state store" Jun 09 05:29:10.257879 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.257869 2564 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 09 05:29:10.257925 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.257898 2564 kubelet.go:486] "Attempting to sync node with API server" Jun 09 05:29:10.257925 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.257914 2564 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 09 05:29:10.257993 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.257930 2564 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 09 05:29:10.258033 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.258011 2564 kubelet.go:398] "Adding apiserver pod source" Jun 09 05:29:10.258033 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.258027 2564 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 09 05:29:10.258844 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.258826 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 05:29:10.258930 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.258864 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 05:29:10.261734 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.261714 2564 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 09 05:29:10.263115 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.263091 2564 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 09 05:29:10.263170 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.263133 2564 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 09 05:29:10.263816 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.263787 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 09 05:29:10.263852 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.263827 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 09 05:29:10.263852 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.263842 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 09 05:29:10.263852 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.263851 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 09 05:29:10.263936 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.263865 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 09 05:29:10.263936 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.263872 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 09 05:29:10.263936 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.263880 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 09 05:29:10.263936 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.263886 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 09 05:29:10.263936 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.263893 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 09 05:29:10.263936 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.263898 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 09 05:29:10.263936 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.263906 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 09 05:29:10.263936 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.263912 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 09 05:29:10.265157 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.265146 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 09 05:29:10.265157 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.265157 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 09 05:29:10.265644 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.265626 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rh6kw" Jun 09 05:29:10.268228 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.268215 2564 server.go:1268] "Started kubelet" Jun 09 05:29:10.268341 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.268301 2564 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 09 05:29:10.268385 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.268319 2564 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 09 05:29:10.268433 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.268406 2564 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 09 05:29:10.269120 ip-10-0-130-106 systemd[1]: Started Kubernetes Kubelet. Jun 09 05:29:10.270165 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.270007 2564 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 09 05:29:10.270631 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.270605 2564 server.go:310] "Adding debug handlers to kubelet server" Jun 09 05:29:10.270988 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:10.270965 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 09 05:29:10.270988 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:10.270970 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-106.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 09 05:29:10.271157 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.271048 2564 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-106.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 09 05:29:10.273165 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.273148 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rh6kw" Jun 09 05:29:10.275062 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:10.274266 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-106.ec2.internal.18b7528ea5c3382b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-106.ec2.internal,UID:ip-10-0-130-106.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-106.ec2.internal,},FirstTimestamp:2026-06-09 05:29:10.268188715 +0000 UTC m=+0.350840441,LastTimestamp:2026-06-09 05:29:10.268188715 +0000 UTC m=+0.350840441,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-106.ec2.internal,}" Jun 09 05:29:10.276340 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:10.276317 2564 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 09 05:29:10.276743 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.276726 2564 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 09 05:29:10.276888 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:10.276872 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-106.ec2.internal\" not found" Jun 09 05:29:10.276949 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.276907 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 09 05:29:10.277523 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.277503 2564 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 09 05:29:10.277701 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.277676 2564 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 09 05:29:10.277815 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.277719 2564 factory.go:55] Registering systemd factory Jun 09 05:29:10.277815 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.277736 2564 factory.go:223] Registration of the systemd container factory successfully Jun 09 05:29:10.277815 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.277775 2564 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 09 05:29:10.277966 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.277856 2564 reconstruct.go:97] "Volume reconstruction finished" Jun 09 05:29:10.277966 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.277863 2564 reconciler.go:29] "Reconciler: start to sync state" Jun 09 05:29:10.277966 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.277947 2564 factory.go:153] Registering CRI-O factory Jun 09 05:29:10.277966 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.277961 2564 factory.go:223] Registration of the crio container factory successfully Jun 09 05:29:10.278122 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.278022 2564 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 09 05:29:10.278122 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.278072 2564 factory.go:103] Registering Raw factory Jun 09 05:29:10.278122 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.278097 2564 manager.go:1196] Started watching for new ooms in manager Jun 09 05:29:10.278691 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.278674 2564 manager.go:349] Starting recovery of all containers Jun 09 05:29:10.284533 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.284511 2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 05:29:10.287742 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:10.287714 2564 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-130-106.ec2.internal\" not found" node="ip-10-0-130-106.ec2.internal" Jun 09 05:29:10.291703 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.291688 2564 manager.go:354] Recovery completed Jun 09 05:29:10.295589 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.295577 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 05:29:10.297663 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.297646 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-106.ec2.internal" event="NodeHasSufficientMemory" Jun 09 05:29:10.297731 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.297677 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-106.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 05:29:10.297731 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.297689 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-106.ec2.internal" event="NodeHasSufficientPID" Jun 09 05:29:10.298309 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.298289 2564 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 09 05:29:10.298309 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.298304 2564 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 09 05:29:10.298432 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.298319 2564 state_mem.go:36] "Initialized new in-memory state store" Jun 09 05:29:10.298432 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.298320 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 05:29:10.299038 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.299018 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-106.ec2.internal" event="NodeHasSufficientMemory" Jun 09 05:29:10.299095 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.299054 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-106.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 05:29:10.299095 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.299070 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-106.ec2.internal" event="NodeHasSufficientPID" Jun 09 05:29:10.299429 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.299418 2564 policy_none.go:49] "None policy: Start" Jun 09 05:29:10.299459 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.299433 2564 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 09 05:29:10.299459 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.299443 2564 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 09 05:29:10.300431 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.300422 2564 policy_none.go:47] "Start" Jun 09 05:29:10.334409 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.334393 2564 manager.go:337] "Starting Device Plugin manager" Jun 09 05:29:10.339378 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:10.334461 2564 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 09 05:29:10.339378 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.334474 2564 server.go:87] "Starting device plugin registration server" Jun 09 05:29:10.339378 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.334756 2564 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 09 05:29:10.339378 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.334768 2564 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 09 05:29:10.339378 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.334945 2564 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 09 05:29:10.339378 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.335074 2564 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 09 05:29:10.339378 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.335084 2564 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 09 05:29:10.339378 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:10.335625 2564 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 09 05:29:10.339378 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:10.335669 2564 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-106.ec2.internal\" not found" Jun 09 05:29:10.339378 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.338947 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 09 05:29:10.340139 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.340122 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 09 05:29:10.340198 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.340168 2564 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 09 05:29:10.340198 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.340190 2564 kubelet.go:2448] "Starting kubelet main sync loop" Jun 09 05:29:10.340294 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:10.340263 2564 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 09 05:29:10.342190 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.342165 2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 05:29:10.435321 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.435293 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 05:29:10.436239 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.436224 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-106.ec2.internal" event="NodeHasSufficientMemory" Jun 09 05:29:10.436313 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.436254 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-106.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 05:29:10.436313 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.436264 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-106.ec2.internal" event="NodeHasSufficientPID" Jun 09 05:29:10.436313 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.436289 2564 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-106.ec2.internal" Jun 09 05:29:10.441392 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.441344 2564 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-106.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-106.ec2.internal"] Jun 09 05:29:10.441454 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.441401 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 05:29:10.442153 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.442135 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-106.ec2.internal" event="NodeHasSufficientMemory" Jun 09 05:29:10.442249 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.442161 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-106.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 05:29:10.442249 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.442171 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-106.ec2.internal" event="NodeHasSufficientPID" Jun 09 05:29:10.443681 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.443666 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 05:29:10.443778 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.443764 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-106.ec2.internal" Jun 09 05:29:10.443842 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.443814 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 05:29:10.444729 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.444708 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-106.ec2.internal" event="NodeHasSufficientMemory" Jun 09 05:29:10.444830 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.444737 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-106.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 05:29:10.444830 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.444752 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-106.ec2.internal" event="NodeHasSufficientPID" Jun 09 05:29:10.444830 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.444812 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-106.ec2.internal" event="NodeHasSufficientMemory" Jun 09 05:29:10.444830 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.444830 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-106.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 05:29:10.445014 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.444843 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-106.ec2.internal" event="NodeHasSufficientPID" Jun 09 05:29:10.445935 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.445845 2564 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-106.ec2.internal" Jun 09 05:29:10.445935 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:10.445871 2564 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-106.ec2.internal\": node \"ip-10-0-130-106.ec2.internal\" not found" Jun 09 05:29:10.446967 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.446940 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-106.ec2.internal" Jun 09 05:29:10.447068 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.446974 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 05:29:10.447705 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.447688 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-106.ec2.internal" event="NodeHasSufficientMemory" Jun 09 05:29:10.447811 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.447715 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-106.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 05:29:10.447811 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.447725 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-106.ec2.internal" event="NodeHasSufficientPID" Jun 09 05:29:10.460373 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:10.460356 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-106.ec2.internal\" not found" Jun 09 05:29:10.475447 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:10.475431 2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-106.ec2.internal\" not found" node="ip-10-0-130-106.ec2.internal" Jun 09 05:29:10.478265 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.478124 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/264b5536af84b660adf2173e962a4403-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-106.ec2.internal\" (UID: \"264b5536af84b660adf2173e962a4403\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-106.ec2.internal" Jun 09 05:29:10.478265 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.478150 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/264b5536af84b660adf2173e962a4403-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-106.ec2.internal\" (UID: \"264b5536af84b660adf2173e962a4403\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-106.ec2.internal" Jun 09 05:29:10.478265 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.478174 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/508e38f1dea9898446f7e228709d5418-config\") pod \"kube-apiserver-proxy-ip-10-0-130-106.ec2.internal\" (UID: \"508e38f1dea9898446f7e228709d5418\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-106.ec2.internal" Jun 09 05:29:10.479827 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:10.479812 2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-106.ec2.internal\" not found" node="ip-10-0-130-106.ec2.internal" Jun 09 05:29:10.560948 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:10.560916 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-106.ec2.internal\" not found" Jun 09 05:29:10.579192 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.579162 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/264b5536af84b660adf2173e962a4403-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-106.ec2.internal\" (UID: \"264b5536af84b660adf2173e962a4403\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-106.ec2.internal" Jun 09 05:29:10.579330 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.579195 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/264b5536af84b660adf2173e962a4403-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-106.ec2.internal\" (UID: \"264b5536af84b660adf2173e962a4403\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-106.ec2.internal" Jun 09 05:29:10.579330 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.579218 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/508e38f1dea9898446f7e228709d5418-config\") pod \"kube-apiserver-proxy-ip-10-0-130-106.ec2.internal\" (UID: \"508e38f1dea9898446f7e228709d5418\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-106.ec2.internal" Jun 09 05:29:10.579330 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.579265 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/264b5536af84b660adf2173e962a4403-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-106.ec2.internal\" (UID: \"264b5536af84b660adf2173e962a4403\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-106.ec2.internal" Jun 09 05:29:10.579330 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.579315 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/264b5536af84b660adf2173e962a4403-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-106.ec2.internal\" (UID: \"264b5536af84b660adf2173e962a4403\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-106.ec2.internal" Jun 09 05:29:10.579472 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.579339 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/508e38f1dea9898446f7e228709d5418-config\") pod \"kube-apiserver-proxy-ip-10-0-130-106.ec2.internal\" (UID: \"508e38f1dea9898446f7e228709d5418\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-106.ec2.internal" Jun 09 05:29:10.661020 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:10.660988 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-106.ec2.internal\" not found" Jun 09 05:29:10.761851 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:10.761776 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-106.ec2.internal\" not found" Jun 09 05:29:10.780092 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.780057 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-106.ec2.internal" Jun 09 05:29:10.784272 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:10.784256 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-106.ec2.internal" Jun 09 05:29:10.862301 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:10.862268 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-106.ec2.internal\" not found" Jun 09 05:29:10.962830 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:10.962807 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-106.ec2.internal\" not found" Jun 09 05:29:11.063352 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:11.063284 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-106.ec2.internal\" not found" Jun 09 05:29:11.163873 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:11.163840 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-106.ec2.internal\" not found" Jun 09 05:29:11.216336 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:11.216307 2564 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 09 05:29:11.217027 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:11.216500 2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 05:29:11.217027 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:11.216507 2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 05:29:11.265009 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:11.264834 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-106.ec2.internal\" not found" Jun 09 05:29:11.278868 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:11.278837 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-08 05:24:10 +0000 UTC" deadline="2027-11-23 02:18:35.567595747 +0000 UTC" Jun 09 05:29:11.278868 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:11.278866 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12764h49m24.288733457s" Jun 09 05:29:11.323746 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:11.323682 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod264b5536af84b660adf2173e962a4403.slice/crio-96d07028aa50cb082d8167db977d013e4a962a23f851f9a7c260db5b30b9a152 WatchSource:0}: Error finding container 96d07028aa50cb082d8167db977d013e4a962a23f851f9a7c260db5b30b9a152: Status 404 returned error can't find the container with id 96d07028aa50cb082d8167db977d013e4a962a23f851f9a7c260db5b30b9a152 Jun 09 05:29:11.324203 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:11.324173 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod508e38f1dea9898446f7e228709d5418.slice/crio-bcf7e81c1e43b97880ca535ed1059082fc79ddf353317051915a129f1a76f372 WatchSource:0}: Error finding container bcf7e81c1e43b97880ca535ed1059082fc79ddf353317051915a129f1a76f372: Status 404 returned error can't find the container with id bcf7e81c1e43b97880ca535ed1059082fc79ddf353317051915a129f1a76f372 Jun 09 05:29:11.328478 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:11.328461 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 05:29:11.343840 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:11.343785 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-106.ec2.internal" event={"ID":"264b5536af84b660adf2173e962a4403","Type":"ContainerStarted","Data":"96d07028aa50cb082d8167db977d013e4a962a23f851f9a7c260db5b30b9a152"} Jun 09 05:29:11.344887 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:11.344870 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-106.ec2.internal" event={"ID":"508e38f1dea9898446f7e228709d5418","Type":"ContainerStarted","Data":"bcf7e81c1e43b97880ca535ed1059082fc79ddf353317051915a129f1a76f372"} Jun 09 05:29:11.366044 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:11.366020 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-106.ec2.internal\" not found" Jun 09 05:29:11.391569 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:11.391552 2564 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 05:29:11.477360 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:11.477330 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-106.ec2.internal" Jun 09 05:29:11.489160 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:11.489142 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 05:29:11.490998 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:11.490986 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-106.ec2.internal" Jun 09 05:29:11.499433 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:11.499418 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 05:29:11.853864 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:11.852523 2564 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 05:29:12.038099 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.038069 2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 05:29:12.259287 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.259207 2564 apiserver.go:52] "Watching apiserver" Jun 09 05:29:12.266845 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.266823 2564 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 09 05:29:12.267217 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.267184 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-g2vt2","openshift-network-diagnostics/network-check-target-s7jfk","kube-system/kube-apiserver-proxy-ip-10-0-130-106.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5khgb","openshift-cluster-node-tuning-operator/tuned-9crt8","openshift-dns/node-resolver-n8vqj","openshift-network-operator/iptables-alerter-crzck","openshift-ovn-kubernetes/ovnkube-node-42h5b","kube-system/global-pull-secret-syncer-c5rjt","kube-system/konnectivity-agent-qr8vr","openshift-image-registry/node-ca-zbjvr","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-106.ec2.internal","openshift-multus/multus-7x4c6","openshift-multus/multus-additional-cni-plugins-qmt9g"] Jun 09 05:29:12.269904 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.269860 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-crzck" Jun 09 05:29:12.271875 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.271851 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7x4c6" Jun 09 05:29:12.272411 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.272389 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 09 05:29:12.272506 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.272391 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 09 05:29:12.272506 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.272399 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 09 05:29:12.272506 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.272484 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-dbp9f\"" Jun 09 05:29:12.274087 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.273961 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qmt9g" Jun 09 05:29:12.274426 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.274342 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 09 05:29:12.274426 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.274346 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-9gbrz\"" Jun 09 05:29:12.274576 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.274428 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 09 05:29:12.274576 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.274561 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 09 05:29:12.274680 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.274608 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 09 05:29:12.276203 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.276082 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 09 05:29:12.276203 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.276120 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 09 05:29:12.276203 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.276147 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-sdwt8\"" Jun 09 05:29:12.276203 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.276192 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5khgb" Jun 09 05:29:12.277861 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.277829 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 09 05:29:12.278832 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.278461 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9crt8" Jun 09 05:29:12.278832 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.278599 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 09 05:29:12.278832 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.278659 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 09 05:29:12.278832 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.278704 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-c85v9\"" Jun 09 05:29:12.278832 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.278813 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 09 05:29:12.280497 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.280475 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-n8vqj" Jun 09 05:29:12.280771 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.280748 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 09 05:29:12.281203 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.281186 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-vn79s\"" Jun 09 05:29:12.281294 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.281242 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 09 05:29:12.282422 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.282401 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 09 05:29:12.282516 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.282430 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-wznqz\"" Jun 09 05:29:12.282581 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.282518 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 09 05:29:12.282664 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.282651 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c5rjt" Jun 09 05:29:12.282762 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:12.282740 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c5rjt" podUID="0fe11a08-fb62-4c73-bbd8-f595316df872" Jun 09 05:29:12.284760 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.284742 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g2vt2" Jun 09 05:29:12.284866 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:12.284824 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g2vt2" podUID="73b6af10-58e6-4c5f-bcfc-083f82dfc9db" Jun 09 05:29:12.286433 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.286044 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c59113d3-15fe-4b55-b86e-fe821d85b2c6-sys-fs\") pod \"aws-ebs-csi-driver-node-5khgb\" (UID: \"c59113d3-15fe-4b55-b86e-fe821d85b2c6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5khgb" Jun 09 05:29:12.286433 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.286079 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f96a0345-2a40-44d1-ac0f-61cd00d2036f-etc-sysctl-conf\") pod \"tuned-9crt8\" (UID: \"f96a0345-2a40-44d1-ac0f-61cd00d2036f\") " pod="openshift-cluster-node-tuning-operator/tuned-9crt8" Jun 09 05:29:12.286433 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.286104 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f96a0345-2a40-44d1-ac0f-61cd00d2036f-etc-systemd\") pod \"tuned-9crt8\" (UID: \"f96a0345-2a40-44d1-ac0f-61cd00d2036f\") " pod="openshift-cluster-node-tuning-operator/tuned-9crt8" Jun 09 05:29:12.286433 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.286130 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f96a0345-2a40-44d1-ac0f-61cd00d2036f-var-lib-kubelet\") pod \"tuned-9crt8\" (UID: \"f96a0345-2a40-44d1-ac0f-61cd00d2036f\") " pod="openshift-cluster-node-tuning-operator/tuned-9crt8" Jun 09 05:29:12.286433 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.286157 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/029a21cf-4c7d-4135-b327-7658b521553c-iptables-alerter-script\") pod \"iptables-alerter-crzck\" (UID: \"029a21cf-4c7d-4135-b327-7658b521553c\") " pod="openshift-network-operator/iptables-alerter-crzck" Jun 09 05:29:12.286433 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.286184 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/029a21cf-4c7d-4135-b327-7658b521553c-host-slash\") pod \"iptables-alerter-crzck\" (UID: \"029a21cf-4c7d-4135-b327-7658b521553c\") " pod="openshift-network-operator/iptables-alerter-crzck" Jun 09 05:29:12.286433 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.286241 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f0b74df6-4873-4f9c-b0f5-9dc2da97c37d-system-cni-dir\") pod \"multus-7x4c6\" (UID: \"f0b74df6-4873-4f9c-b0f5-9dc2da97c37d\") " pod="openshift-multus/multus-7x4c6" Jun 09 05:29:12.286433 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.286277 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f0b74df6-4873-4f9c-b0f5-9dc2da97c37d-host-var-lib-cni-multus\") pod \"multus-7x4c6\" (UID: \"f0b74df6-4873-4f9c-b0f5-9dc2da97c37d\") " pod="openshift-multus/multus-7x4c6" Jun 09 05:29:12.286433 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.286309 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f0b74df6-4873-4f9c-b0f5-9dc2da97c37d-multus-conf-dir\") pod \"multus-7x4c6\" (UID: \"f0b74df6-4873-4f9c-b0f5-9dc2da97c37d\") " pod="openshift-multus/multus-7x4c6" Jun 09 05:29:12.286433 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.286350 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/04cabc1f-f6d7-4aa2-a53e-06946b3655a7-cni-binary-copy\") pod \"multus-additional-cni-plugins-qmt9g\" (UID: \"04cabc1f-f6d7-4aa2-a53e-06946b3655a7\") " pod="openshift-multus/multus-additional-cni-plugins-qmt9g" Jun 09 05:29:12.286433 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.286380 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c59113d3-15fe-4b55-b86e-fe821d85b2c6-device-dir\") pod \"aws-ebs-csi-driver-node-5khgb\" (UID: \"c59113d3-15fe-4b55-b86e-fe821d85b2c6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5khgb" Jun 09 05:29:12.286433 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.286404 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f96a0345-2a40-44d1-ac0f-61cd00d2036f-etc-kubernetes\") pod \"tuned-9crt8\" (UID: \"f96a0345-2a40-44d1-ac0f-61cd00d2036f\") " pod="openshift-cluster-node-tuning-operator/tuned-9crt8" Jun 09 05:29:12.287169 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.286445 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f0b74df6-4873-4f9c-b0f5-9dc2da97c37d-cni-binary-copy\") pod \"multus-7x4c6\" (UID: \"f0b74df6-4873-4f9c-b0f5-9dc2da97c37d\") " pod="openshift-multus/multus-7x4c6" Jun 09 05:29:12.287169 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.286471 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c59113d3-15fe-4b55-b86e-fe821d85b2c6-socket-dir\") pod \"aws-ebs-csi-driver-node-5khgb\" (UID: \"c59113d3-15fe-4b55-b86e-fe821d85b2c6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5khgb" Jun 09 05:29:12.287169 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.286538 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28729\" (UniqueName: \"kubernetes.io/projected/c59113d3-15fe-4b55-b86e-fe821d85b2c6-kube-api-access-28729\") pod \"aws-ebs-csi-driver-node-5khgb\" (UID: \"c59113d3-15fe-4b55-b86e-fe821d85b2c6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5khgb" Jun 09 05:29:12.287169 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.286582 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f96a0345-2a40-44d1-ac0f-61cd00d2036f-etc-tuned\") pod \"tuned-9crt8\" (UID: \"f96a0345-2a40-44d1-ac0f-61cd00d2036f\") " pod="openshift-cluster-node-tuning-operator/tuned-9crt8" Jun 09 05:29:12.287169 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.286601 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f0b74df6-4873-4f9c-b0f5-9dc2da97c37d-multus-socket-dir-parent\") pod \"multus-7x4c6\" (UID: \"f0b74df6-4873-4f9c-b0f5-9dc2da97c37d\") " pod="openshift-multus/multus-7x4c6" Jun 09 05:29:12.287169 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.286621 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f0b74df6-4873-4f9c-b0f5-9dc2da97c37d-host-run-k8s-cni-cncf-io\") pod \"multus-7x4c6\" (UID: \"f0b74df6-4873-4f9c-b0f5-9dc2da97c37d\") " pod="openshift-multus/multus-7x4c6" Jun 09 05:29:12.287169 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.286642 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f0b74df6-4873-4f9c-b0f5-9dc2da97c37d-host-var-lib-kubelet\") pod \"multus-7x4c6\" (UID: \"f0b74df6-4873-4f9c-b0f5-9dc2da97c37d\") " pod="openshift-multus/multus-7x4c6" Jun 09 05:29:12.287169 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.286687 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/04cabc1f-f6d7-4aa2-a53e-06946b3655a7-cnibin\") pod \"multus-additional-cni-plugins-qmt9g\" (UID: \"04cabc1f-f6d7-4aa2-a53e-06946b3655a7\") " pod="openshift-multus/multus-additional-cni-plugins-qmt9g" Jun 09 05:29:12.287169 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.286726 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/04cabc1f-f6d7-4aa2-a53e-06946b3655a7-os-release\") pod \"multus-additional-cni-plugins-qmt9g\" (UID: \"04cabc1f-f6d7-4aa2-a53e-06946b3655a7\") " pod="openshift-multus/multus-additional-cni-plugins-qmt9g" Jun 09 05:29:12.287169 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.286752 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c59113d3-15fe-4b55-b86e-fe821d85b2c6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5khgb\" (UID: \"c59113d3-15fe-4b55-b86e-fe821d85b2c6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5khgb" Jun 09 05:29:12.287169 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.286789 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c59113d3-15fe-4b55-b86e-fe821d85b2c6-registration-dir\") pod \"aws-ebs-csi-driver-node-5khgb\" (UID: \"c59113d3-15fe-4b55-b86e-fe821d85b2c6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5khgb" Jun 09 05:29:12.287169 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.286825 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f96a0345-2a40-44d1-ac0f-61cd00d2036f-etc-sysctl-d\") pod \"tuned-9crt8\" (UID: \"f96a0345-2a40-44d1-ac0f-61cd00d2036f\") " pod="openshift-cluster-node-tuning-operator/tuned-9crt8" Jun 09 05:29:12.287169 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.286848 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f0b74df6-4873-4f9c-b0f5-9dc2da97c37d-host-var-lib-cni-bin\") pod \"multus-7x4c6\" (UID: \"f0b74df6-4873-4f9c-b0f5-9dc2da97c37d\") " pod="openshift-multus/multus-7x4c6" Jun 09 05:29:12.287169 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.286875 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/04cabc1f-f6d7-4aa2-a53e-06946b3655a7-system-cni-dir\") pod \"multus-additional-cni-plugins-qmt9g\" (UID: \"04cabc1f-f6d7-4aa2-a53e-06946b3655a7\") " pod="openshift-multus/multus-additional-cni-plugins-qmt9g" Jun 09 05:29:12.287169 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.286914 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/04cabc1f-f6d7-4aa2-a53e-06946b3655a7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qmt9g\" (UID: \"04cabc1f-f6d7-4aa2-a53e-06946b3655a7\") " pod="openshift-multus/multus-additional-cni-plugins-qmt9g" Jun 09 05:29:12.287169 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.286940 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f96a0345-2a40-44d1-ac0f-61cd00d2036f-etc-sysconfig\") pod \"tuned-9crt8\" (UID: \"f96a0345-2a40-44d1-ac0f-61cd00d2036f\") " pod="openshift-cluster-node-tuning-operator/tuned-9crt8" Jun 09 05:29:12.287875 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.286978 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpt78\" (UniqueName: \"kubernetes.io/projected/f96a0345-2a40-44d1-ac0f-61cd00d2036f-kube-api-access-wpt78\") pod \"tuned-9crt8\" (UID: \"f96a0345-2a40-44d1-ac0f-61cd00d2036f\") " pod="openshift-cluster-node-tuning-operator/tuned-9crt8" Jun 09 05:29:12.287875 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.287002 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mz7bx\" (UniqueName: \"kubernetes.io/projected/029a21cf-4c7d-4135-b327-7658b521553c-kube-api-access-mz7bx\") pod \"iptables-alerter-crzck\" (UID: \"029a21cf-4c7d-4135-b327-7658b521553c\") " pod="openshift-network-operator/iptables-alerter-crzck" Jun 09 05:29:12.287875 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.287027 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vqd2\" (UniqueName: \"kubernetes.io/projected/f0b74df6-4873-4f9c-b0f5-9dc2da97c37d-kube-api-access-2vqd2\") pod \"multus-7x4c6\" (UID: \"f0b74df6-4873-4f9c-b0f5-9dc2da97c37d\") " pod="openshift-multus/multus-7x4c6" Jun 09 05:29:12.287875 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.287065 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s7jfk" Jun 09 05:29:12.287875 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:12.287114 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s7jfk" podUID="d7f984ce-8d75-4a12-89e3-ff77731c2fb3" Jun 09 05:29:12.287875 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.287060 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lv2sj\" (UniqueName: \"kubernetes.io/projected/04cabc1f-f6d7-4aa2-a53e-06946b3655a7-kube-api-access-lv2sj\") pod \"multus-additional-cni-plugins-qmt9g\" (UID: \"04cabc1f-f6d7-4aa2-a53e-06946b3655a7\") " pod="openshift-multus/multus-additional-cni-plugins-qmt9g" Jun 09 05:29:12.287875 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.287203 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f96a0345-2a40-44d1-ac0f-61cd00d2036f-etc-modprobe-d\") pod \"tuned-9crt8\" (UID: \"f96a0345-2a40-44d1-ac0f-61cd00d2036f\") " pod="openshift-cluster-node-tuning-operator/tuned-9crt8" Jun 09 05:29:12.287875 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.287222 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f96a0345-2a40-44d1-ac0f-61cd00d2036f-run\") pod \"tuned-9crt8\" (UID: \"f96a0345-2a40-44d1-ac0f-61cd00d2036f\") " pod="openshift-cluster-node-tuning-operator/tuned-9crt8" Jun 09 05:29:12.287875 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.287235 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f96a0345-2a40-44d1-ac0f-61cd00d2036f-sys\") pod \"tuned-9crt8\" (UID: \"f96a0345-2a40-44d1-ac0f-61cd00d2036f\") " pod="openshift-cluster-node-tuning-operator/tuned-9crt8" Jun 09 05:29:12.287875 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.287250 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f96a0345-2a40-44d1-ac0f-61cd00d2036f-lib-modules\") pod \"tuned-9crt8\" (UID: \"f96a0345-2a40-44d1-ac0f-61cd00d2036f\") " pod="openshift-cluster-node-tuning-operator/tuned-9crt8" Jun 09 05:29:12.287875 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.287272 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f0b74df6-4873-4f9c-b0f5-9dc2da97c37d-multus-cni-dir\") pod \"multus-7x4c6\" (UID: \"f0b74df6-4873-4f9c-b0f5-9dc2da97c37d\") " pod="openshift-multus/multus-7x4c6" Jun 09 05:29:12.287875 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.287312 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f0b74df6-4873-4f9c-b0f5-9dc2da97c37d-cnibin\") pod \"multus-7x4c6\" (UID: \"f0b74df6-4873-4f9c-b0f5-9dc2da97c37d\") " pod="openshift-multus/multus-7x4c6" Jun 09 05:29:12.287875 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.287334 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f0b74df6-4873-4f9c-b0f5-9dc2da97c37d-os-release\") pod \"multus-7x4c6\" (UID: \"f0b74df6-4873-4f9c-b0f5-9dc2da97c37d\") " pod="openshift-multus/multus-7x4c6" Jun 09 05:29:12.287875 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.287380 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f0b74df6-4873-4f9c-b0f5-9dc2da97c37d-host-run-netns\") pod \"multus-7x4c6\" (UID: \"f0b74df6-4873-4f9c-b0f5-9dc2da97c37d\") " pod="openshift-multus/multus-7x4c6" Jun 09 05:29:12.287875 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.287418 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f0b74df6-4873-4f9c-b0f5-9dc2da97c37d-multus-daemon-config\") pod \"multus-7x4c6\" (UID: \"f0b74df6-4873-4f9c-b0f5-9dc2da97c37d\") " pod="openshift-multus/multus-7x4c6" Jun 09 05:29:12.287875 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.287434 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f0b74df6-4873-4f9c-b0f5-9dc2da97c37d-etc-kubernetes\") pod \"multus-7x4c6\" (UID: \"f0b74df6-4873-4f9c-b0f5-9dc2da97c37d\") " pod="openshift-multus/multus-7x4c6" Jun 09 05:29:12.287875 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.287465 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c59113d3-15fe-4b55-b86e-fe821d85b2c6-etc-selinux\") pod \"aws-ebs-csi-driver-node-5khgb\" (UID: \"c59113d3-15fe-4b55-b86e-fe821d85b2c6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5khgb" Jun 09 05:29:12.288641 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.287486 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f96a0345-2a40-44d1-ac0f-61cd00d2036f-host\") pod \"tuned-9crt8\" (UID: \"f96a0345-2a40-44d1-ac0f-61cd00d2036f\") " pod="openshift-cluster-node-tuning-operator/tuned-9crt8" Jun 09 05:29:12.288641 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.287505 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f0b74df6-4873-4f9c-b0f5-9dc2da97c37d-host-run-multus-certs\") pod \"multus-7x4c6\" (UID: \"f0b74df6-4873-4f9c-b0f5-9dc2da97c37d\") " pod="openshift-multus/multus-7x4c6" Jun 09 05:29:12.288641 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.287530 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/04cabc1f-f6d7-4aa2-a53e-06946b3655a7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qmt9g\" (UID: \"04cabc1f-f6d7-4aa2-a53e-06946b3655a7\") " pod="openshift-multus/multus-additional-cni-plugins-qmt9g" Jun 09 05:29:12.288641 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.287551 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/04cabc1f-f6d7-4aa2-a53e-06946b3655a7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qmt9g\" (UID: \"04cabc1f-f6d7-4aa2-a53e-06946b3655a7\") " pod="openshift-multus/multus-additional-cni-plugins-qmt9g" Jun 09 05:29:12.288641 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.287568 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f96a0345-2a40-44d1-ac0f-61cd00d2036f-tmp\") pod \"tuned-9crt8\" (UID: \"f96a0345-2a40-44d1-ac0f-61cd00d2036f\") " pod="openshift-cluster-node-tuning-operator/tuned-9crt8" Jun 09 05:29:12.288641 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.287587 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f0b74df6-4873-4f9c-b0f5-9dc2da97c37d-hostroot\") pod \"multus-7x4c6\" (UID: \"f0b74df6-4873-4f9c-b0f5-9dc2da97c37d\") " pod="openshift-multus/multus-7x4c6" Jun 09 05:29:12.288641 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.288367 2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 05:29:12.289465 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.289447 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qr8vr" Jun 09 05:29:12.291718 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.291665 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-6d9n7\"" Jun 09 05:29:12.291718 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.291680 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 09 05:29:12.291718 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.291666 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 09 05:29:12.292669 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.292338 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zbjvr" Jun 09 05:29:12.294830 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.294811 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 09 05:29:12.295627 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.295609 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 09 05:29:12.296076 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.295788 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-d6nrj\"" Jun 09 05:29:12.296076 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.295863 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 09 05:29:12.297147 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.297130 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-42h5b" Jun 09 05:29:12.299521 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.299383 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 09 05:29:12.299521 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.299421 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 09 05:29:12.299521 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.299390 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 09 05:29:12.299709 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.299492 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 09 05:29:12.299709 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.299669 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 09 05:29:12.300688 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.300669 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-prrtd\"" Jun 09 05:29:12.300788 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.300724 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 09 05:29:12.309332 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.309311 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-bxqwv" Jun 09 05:29:12.314618 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.314597 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-bxqwv" Jun 09 05:29:12.379837 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.379812 2564 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 09 05:29:12.387781 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.387759 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f0b74df6-4873-4f9c-b0f5-9dc2da97c37d-multus-socket-dir-parent\") pod \"multus-7x4c6\" (UID: \"f0b74df6-4873-4f9c-b0f5-9dc2da97c37d\") " pod="openshift-multus/multus-7x4c6" Jun 09 05:29:12.387930 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.387785 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/04cabc1f-f6d7-4aa2-a53e-06946b3655a7-cnibin\") pod \"multus-additional-cni-plugins-qmt9g\" (UID: \"04cabc1f-f6d7-4aa2-a53e-06946b3655a7\") " pod="openshift-multus/multus-additional-cni-plugins-qmt9g" Jun 09 05:29:12.387930 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.387833 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c59113d3-15fe-4b55-b86e-fe821d85b2c6-registration-dir\") pod \"aws-ebs-csi-driver-node-5khgb\" (UID: \"c59113d3-15fe-4b55-b86e-fe821d85b2c6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5khgb" Jun 09 05:29:12.387930 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.387851 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f96a0345-2a40-44d1-ac0f-61cd00d2036f-etc-sysctl-d\") pod \"tuned-9crt8\" (UID: \"f96a0345-2a40-44d1-ac0f-61cd00d2036f\") " pod="openshift-cluster-node-tuning-operator/tuned-9crt8" Jun 09 05:29:12.387930 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.387881 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/02c37648-4419-4ff7-a316-568fa0510cee-log-socket\") pod \"ovnkube-node-42h5b\" (UID: \"02c37648-4419-4ff7-a316-568fa0510cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-42h5b" Jun 09 05:29:12.387930 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.387890 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f0b74df6-4873-4f9c-b0f5-9dc2da97c37d-multus-socket-dir-parent\") pod \"multus-7x4c6\" (UID: \"f0b74df6-4873-4f9c-b0f5-9dc2da97c37d\") " pod="openshift-multus/multus-7x4c6" Jun 09 05:29:12.387930 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.387906 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/04cabc1f-f6d7-4aa2-a53e-06946b3655a7-system-cni-dir\") pod \"multus-additional-cni-plugins-qmt9g\" (UID: \"04cabc1f-f6d7-4aa2-a53e-06946b3655a7\") " pod="openshift-multus/multus-additional-cni-plugins-qmt9g" Jun 09 05:29:12.388231 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.387942 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/04cabc1f-f6d7-4aa2-a53e-06946b3655a7-system-cni-dir\") pod \"multus-additional-cni-plugins-qmt9g\" (UID: \"04cabc1f-f6d7-4aa2-a53e-06946b3655a7\") " pod="openshift-multus/multus-additional-cni-plugins-qmt9g" Jun 09 05:29:12.388231 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.387944 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/04cabc1f-f6d7-4aa2-a53e-06946b3655a7-cnibin\") pod \"multus-additional-cni-plugins-qmt9g\" (UID: \"04cabc1f-f6d7-4aa2-a53e-06946b3655a7\") " pod="openshift-multus/multus-additional-cni-plugins-qmt9g" Jun 09 05:29:12.388231 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.387963 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/04cabc1f-f6d7-4aa2-a53e-06946b3655a7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qmt9g\" (UID: \"04cabc1f-f6d7-4aa2-a53e-06946b3655a7\") " pod="openshift-multus/multus-additional-cni-plugins-qmt9g" Jun 09 05:29:12.388231 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.387997 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c59113d3-15fe-4b55-b86e-fe821d85b2c6-registration-dir\") pod \"aws-ebs-csi-driver-node-5khgb\" (UID: \"c59113d3-15fe-4b55-b86e-fe821d85b2c6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5khgb" Jun 09 05:29:12.388231 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.388010 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f96a0345-2a40-44d1-ac0f-61cd00d2036f-etc-modprobe-d\") pod \"tuned-9crt8\" (UID: \"f96a0345-2a40-44d1-ac0f-61cd00d2036f\") " pod="openshift-cluster-node-tuning-operator/tuned-9crt8" Jun 09 05:29:12.388231 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.388031 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f96a0345-2a40-44d1-ac0f-61cd00d2036f-etc-sysctl-d\") pod \"tuned-9crt8\" (UID: \"f96a0345-2a40-44d1-ac0f-61cd00d2036f\") " pod="openshift-cluster-node-tuning-operator/tuned-9crt8" Jun 09 05:29:12.388231 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.388040 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/02c37648-4419-4ff7-a316-568fa0510cee-ovnkube-config\") pod \"ovnkube-node-42h5b\" (UID: \"02c37648-4419-4ff7-a316-568fa0510cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-42h5b" Jun 09 05:29:12.388231 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.388066 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f0b74df6-4873-4f9c-b0f5-9dc2da97c37d-host-run-netns\") pod \"multus-7x4c6\" (UID: \"f0b74df6-4873-4f9c-b0f5-9dc2da97c37d\") " pod="openshift-multus/multus-7x4c6" Jun 09 05:29:12.388231 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.388093 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f0b74df6-4873-4f9c-b0f5-9dc2da97c37d-etc-kubernetes\") pod \"multus-7x4c6\" (UID: \"f0b74df6-4873-4f9c-b0f5-9dc2da97c37d\") " pod="openshift-multus/multus-7x4c6" Jun 09 05:29:12.388231 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.388105 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f96a0345-2a40-44d1-ac0f-61cd00d2036f-etc-modprobe-d\") pod \"tuned-9crt8\" (UID: \"f96a0345-2a40-44d1-ac0f-61cd00d2036f\") " pod="openshift-cluster-node-tuning-operator/tuned-9crt8" Jun 09 05:29:12.388231 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.388117 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/73b6af10-58e6-4c5f-bcfc-083f82dfc9db-metrics-certs\") pod \"network-metrics-daemon-g2vt2\" (UID: \"73b6af10-58e6-4c5f-bcfc-083f82dfc9db\") " pod="openshift-multus/network-metrics-daemon-g2vt2" Jun 09 05:29:12.388231 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.388143 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f0b74df6-4873-4f9c-b0f5-9dc2da97c37d-host-run-multus-certs\") pod \"multus-7x4c6\" (UID: \"f0b74df6-4873-4f9c-b0f5-9dc2da97c37d\") " pod="openshift-multus/multus-7x4c6" Jun 09 05:29:12.388231 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.388144 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f0b74df6-4873-4f9c-b0f5-9dc2da97c37d-host-run-netns\") pod \"multus-7x4c6\" (UID: \"f0b74df6-4873-4f9c-b0f5-9dc2da97c37d\") " pod="openshift-multus/multus-7x4c6" Jun 09 05:29:12.388231 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.388184 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f0b74df6-4873-4f9c-b0f5-9dc2da97c37d-etc-kubernetes\") pod \"multus-7x4c6\" (UID: \"f0b74df6-4873-4f9c-b0f5-9dc2da97c37d\") " pod="openshift-multus/multus-7x4c6" Jun 09 05:29:12.388231 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.388221 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/04cabc1f-f6d7-4aa2-a53e-06946b3655a7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qmt9g\" (UID: \"04cabc1f-f6d7-4aa2-a53e-06946b3655a7\") " pod="openshift-multus/multus-additional-cni-plugins-qmt9g" Jun 09 05:29:12.388931 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.388249 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4qg7\" (UniqueName: \"kubernetes.io/projected/50e77e00-d2c2-45fa-9095-05a6d05a90e4-kube-api-access-n4qg7\") pod \"node-resolver-n8vqj\" (UID: \"50e77e00-d2c2-45fa-9095-05a6d05a90e4\") " pod="openshift-dns/node-resolver-n8vqj" Jun 09 05:29:12.388931 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.388264 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/02c37648-4419-4ff7-a316-568fa0510cee-host-kubelet\") pod \"ovnkube-node-42h5b\" (UID: \"02c37648-4419-4ff7-a316-568fa0510cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-42h5b" Jun 09 05:29:12.388931 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.388278 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f0b74df6-4873-4f9c-b0f5-9dc2da97c37d-hostroot\") pod \"multus-7x4c6\" (UID: \"f0b74df6-4873-4f9c-b0f5-9dc2da97c37d\") " pod="openshift-multus/multus-7x4c6" Jun 09 05:29:12.388931 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.388282 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f0b74df6-4873-4f9c-b0f5-9dc2da97c37d-host-run-multus-certs\") pod \"multus-7x4c6\" (UID: \"f0b74df6-4873-4f9c-b0f5-9dc2da97c37d\") " pod="openshift-multus/multus-7x4c6" Jun 09 05:29:12.388931 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.388303 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f96a0345-2a40-44d1-ac0f-61cd00d2036f-etc-sysctl-conf\") pod \"tuned-9crt8\" (UID: \"f96a0345-2a40-44d1-ac0f-61cd00d2036f\") " pod="openshift-cluster-node-tuning-operator/tuned-9crt8" Jun 09 05:29:12.388931 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.388330 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f0b74df6-4873-4f9c-b0f5-9dc2da97c37d-hostroot\") pod \"multus-7x4c6\" (UID: \"f0b74df6-4873-4f9c-b0f5-9dc2da97c37d\") " pod="openshift-multus/multus-7x4c6" Jun 09 05:29:12.388931 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.388341 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f96a0345-2a40-44d1-ac0f-61cd00d2036f-var-lib-kubelet\") pod \"tuned-9crt8\" (UID: \"f96a0345-2a40-44d1-ac0f-61cd00d2036f\") " pod="openshift-cluster-node-tuning-operator/tuned-9crt8" Jun 09 05:29:12.388931 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.388388 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/02c37648-4419-4ff7-a316-568fa0510cee-host-slash\") pod \"ovnkube-node-42h5b\" (UID: \"02c37648-4419-4ff7-a316-568fa0510cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-42h5b" Jun 09 05:29:12.388931 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.388395 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/04cabc1f-f6d7-4aa2-a53e-06946b3655a7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qmt9g\" (UID: \"04cabc1f-f6d7-4aa2-a53e-06946b3655a7\") " pod="openshift-multus/multus-additional-cni-plugins-qmt9g" Jun 09 05:29:12.388931 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.388420 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/02c37648-4419-4ff7-a316-568fa0510cee-etc-openvswitch\") pod \"ovnkube-node-42h5b\" (UID: \"02c37648-4419-4ff7-a316-568fa0510cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-42h5b" Jun 09 05:29:12.388931 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.388443 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f96a0345-2a40-44d1-ac0f-61cd00d2036f-etc-sysctl-conf\") pod \"tuned-9crt8\" (UID: \"f96a0345-2a40-44d1-ac0f-61cd00d2036f\") " pod="openshift-cluster-node-tuning-operator/tuned-9crt8" Jun 09 05:29:12.388931 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.388470 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/02c37648-4419-4ff7-a316-568fa0510cee-env-overrides\") pod \"ovnkube-node-42h5b\" (UID: \"02c37648-4419-4ff7-a316-568fa0510cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-42h5b" Jun 09 05:29:12.388931 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.388477 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f96a0345-2a40-44d1-ac0f-61cd00d2036f-var-lib-kubelet\") pod \"tuned-9crt8\" (UID: \"f96a0345-2a40-44d1-ac0f-61cd00d2036f\") " pod="openshift-cluster-node-tuning-operator/tuned-9crt8" Jun 09 05:29:12.388931 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.388513 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f0b74df6-4873-4f9c-b0f5-9dc2da97c37d-host-var-lib-cni-multus\") pod \"multus-7x4c6\" (UID: \"f0b74df6-4873-4f9c-b0f5-9dc2da97c37d\") " pod="openshift-multus/multus-7x4c6" Jun 09 05:29:12.388931 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.388552 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f0b74df6-4873-4f9c-b0f5-9dc2da97c37d-host-var-lib-cni-multus\") pod \"multus-7x4c6\" (UID: \"f0b74df6-4873-4f9c-b0f5-9dc2da97c37d\") " pod="openshift-multus/multus-7x4c6" Jun 09 05:29:12.388931 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.388567 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/04cabc1f-f6d7-4aa2-a53e-06946b3655a7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qmt9g\" (UID: \"04cabc1f-f6d7-4aa2-a53e-06946b3655a7\") " pod="openshift-multus/multus-additional-cni-plugins-qmt9g" Jun 09 05:29:12.388931 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.388569 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f0b74df6-4873-4f9c-b0f5-9dc2da97c37d-multus-conf-dir\") pod \"multus-7x4c6\" (UID: \"f0b74df6-4873-4f9c-b0f5-9dc2da97c37d\") " pod="openshift-multus/multus-7x4c6" Jun 09 05:29:12.389689 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.388613 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f0b74df6-4873-4f9c-b0f5-9dc2da97c37d-multus-conf-dir\") pod \"multus-7x4c6\" (UID: \"f0b74df6-4873-4f9c-b0f5-9dc2da97c37d\") " pod="openshift-multus/multus-7x4c6" Jun 09 05:29:12.389689 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.388643 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/04cabc1f-f6d7-4aa2-a53e-06946b3655a7-cni-binary-copy\") pod \"multus-additional-cni-plugins-qmt9g\" (UID: \"04cabc1f-f6d7-4aa2-a53e-06946b3655a7\") " pod="openshift-multus/multus-additional-cni-plugins-qmt9g" Jun 09 05:29:12.389689 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.388665 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0fe11a08-fb62-4c73-bbd8-f595316df872-kubelet-config\") pod \"global-pull-secret-syncer-c5rjt\" (UID: \"0fe11a08-fb62-4c73-bbd8-f595316df872\") " pod="kube-system/global-pull-secret-syncer-c5rjt" Jun 09 05:29:12.389689 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.388697 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/02c37648-4419-4ff7-a316-568fa0510cee-run-openvswitch\") pod \"ovnkube-node-42h5b\" (UID: \"02c37648-4419-4ff7-a316-568fa0510cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-42h5b" Jun 09 05:29:12.389689 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.388719 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/02c37648-4419-4ff7-a316-568fa0510cee-run-ovn\") pod \"ovnkube-node-42h5b\" (UID: \"02c37648-4419-4ff7-a316-568fa0510cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-42h5b" Jun 09 05:29:12.389689 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.388745 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f0b74df6-4873-4f9c-b0f5-9dc2da97c37d-cni-binary-copy\") pod \"multus-7x4c6\" (UID: \"f0b74df6-4873-4f9c-b0f5-9dc2da97c37d\") " pod="openshift-multus/multus-7x4c6" Jun 09 05:29:12.389689 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.388769 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c59113d3-15fe-4b55-b86e-fe821d85b2c6-socket-dir\") pod \"aws-ebs-csi-driver-node-5khgb\" (UID: \"c59113d3-15fe-4b55-b86e-fe821d85b2c6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5khgb" Jun 09 05:29:12.389689 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.388805 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/50e77e00-d2c2-45fa-9095-05a6d05a90e4-hosts-file\") pod \"node-resolver-n8vqj\" (UID: \"50e77e00-d2c2-45fa-9095-05a6d05a90e4\") " pod="openshift-dns/node-resolver-n8vqj" Jun 09 05:29:12.389689 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.388829 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1165c84b-2a43-44a3-9537-cd4fb2a25489-konnectivity-ca\") pod \"konnectivity-agent-qr8vr\" (UID: \"1165c84b-2a43-44a3-9537-cd4fb2a25489\") " pod="kube-system/konnectivity-agent-qr8vr" Jun 09 05:29:12.389689 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.388883 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/da2e480a-b5b6-44d9-a94c-0ad232ec311c-host\") pod \"node-ca-zbjvr\" (UID: \"da2e480a-b5b6-44d9-a94c-0ad232ec311c\") " pod="openshift-image-registry/node-ca-zbjvr" Jun 09 05:29:12.389689 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.388918 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wfsq\" (UniqueName: \"kubernetes.io/projected/da2e480a-b5b6-44d9-a94c-0ad232ec311c-kube-api-access-4wfsq\") pod \"node-ca-zbjvr\" (UID: \"da2e480a-b5b6-44d9-a94c-0ad232ec311c\") " pod="openshift-image-registry/node-ca-zbjvr" Jun 09 05:29:12.389689 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.388924 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c59113d3-15fe-4b55-b86e-fe821d85b2c6-socket-dir\") pod \"aws-ebs-csi-driver-node-5khgb\" (UID: \"c59113d3-15fe-4b55-b86e-fe821d85b2c6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5khgb" Jun 09 05:29:12.389689 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.388954 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f0b74df6-4873-4f9c-b0f5-9dc2da97c37d-host-run-k8s-cni-cncf-io\") pod \"multus-7x4c6\" (UID: \"f0b74df6-4873-4f9c-b0f5-9dc2da97c37d\") " pod="openshift-multus/multus-7x4c6" Jun 09 05:29:12.389689 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.388980 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f0b74df6-4873-4f9c-b0f5-9dc2da97c37d-host-var-lib-kubelet\") pod \"multus-7x4c6\" (UID: \"f0b74df6-4873-4f9c-b0f5-9dc2da97c37d\") " pod="openshift-multus/multus-7x4c6" Jun 09 05:29:12.389689 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.388991 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f0b74df6-4873-4f9c-b0f5-9dc2da97c37d-host-run-k8s-cni-cncf-io\") pod \"multus-7x4c6\" (UID: \"f0b74df6-4873-4f9c-b0f5-9dc2da97c37d\") " pod="openshift-multus/multus-7x4c6" Jun 09 05:29:12.389689 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.389004 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/04cabc1f-f6d7-4aa2-a53e-06946b3655a7-os-release\") pod \"multus-additional-cni-plugins-qmt9g\" (UID: \"04cabc1f-f6d7-4aa2-a53e-06946b3655a7\") " pod="openshift-multus/multus-additional-cni-plugins-qmt9g" Jun 09 05:29:12.389689 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.389028 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c59113d3-15fe-4b55-b86e-fe821d85b2c6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5khgb\" (UID: \"c59113d3-15fe-4b55-b86e-fe821d85b2c6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5khgb" Jun 09 05:29:12.390530 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.389035 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f0b74df6-4873-4f9c-b0f5-9dc2da97c37d-host-var-lib-kubelet\") pod \"multus-7x4c6\" (UID: \"f0b74df6-4873-4f9c-b0f5-9dc2da97c37d\") " pod="openshift-multus/multus-7x4c6" Jun 09 05:29:12.390530 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.389051 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mz7bx\" (UniqueName: \"kubernetes.io/projected/029a21cf-4c7d-4135-b327-7658b521553c-kube-api-access-mz7bx\") pod \"iptables-alerter-crzck\" (UID: \"029a21cf-4c7d-4135-b327-7658b521553c\") " pod="openshift-network-operator/iptables-alerter-crzck" Jun 09 05:29:12.390530 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.389078 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f0b74df6-4873-4f9c-b0f5-9dc2da97c37d-host-var-lib-cni-bin\") pod \"multus-7x4c6\" (UID: \"f0b74df6-4873-4f9c-b0f5-9dc2da97c37d\") " pod="openshift-multus/multus-7x4c6" Jun 09 05:29:12.390530 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.389087 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c59113d3-15fe-4b55-b86e-fe821d85b2c6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5khgb\" (UID: \"c59113d3-15fe-4b55-b86e-fe821d85b2c6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5khgb" Jun 09 05:29:12.390530 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.389101 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f96a0345-2a40-44d1-ac0f-61cd00d2036f-etc-sysconfig\") pod \"tuned-9crt8\" (UID: \"f96a0345-2a40-44d1-ac0f-61cd00d2036f\") " pod="openshift-cluster-node-tuning-operator/tuned-9crt8" Jun 09 05:29:12.390530 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.389102 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/04cabc1f-f6d7-4aa2-a53e-06946b3655a7-os-release\") pod \"multus-additional-cni-plugins-qmt9g\" (UID: \"04cabc1f-f6d7-4aa2-a53e-06946b3655a7\") " pod="openshift-multus/multus-additional-cni-plugins-qmt9g" Jun 09 05:29:12.390530 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.389142 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f0b74df6-4873-4f9c-b0f5-9dc2da97c37d-host-var-lib-cni-bin\") pod \"multus-7x4c6\" (UID: \"f0b74df6-4873-4f9c-b0f5-9dc2da97c37d\") " pod="openshift-multus/multus-7x4c6" Jun 09 05:29:12.390530 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.389175 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f96a0345-2a40-44d1-ac0f-61cd00d2036f-etc-sysconfig\") pod \"tuned-9crt8\" (UID: \"f96a0345-2a40-44d1-ac0f-61cd00d2036f\") " pod="openshift-cluster-node-tuning-operator/tuned-9crt8" Jun 09 05:29:12.390530 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.389208 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/04cabc1f-f6d7-4aa2-a53e-06946b3655a7-cni-binary-copy\") pod \"multus-additional-cni-plugins-qmt9g\" (UID: \"04cabc1f-f6d7-4aa2-a53e-06946b3655a7\") " pod="openshift-multus/multus-additional-cni-plugins-qmt9g" Jun 09 05:29:12.390530 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.389224 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpt78\" (UniqueName: \"kubernetes.io/projected/f96a0345-2a40-44d1-ac0f-61cd00d2036f-kube-api-access-wpt78\") pod \"tuned-9crt8\" (UID: \"f96a0345-2a40-44d1-ac0f-61cd00d2036f\") " pod="openshift-cluster-node-tuning-operator/tuned-9crt8" Jun 09 05:29:12.390530 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.389353 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfrb6\" (UniqueName: \"kubernetes.io/projected/d7f984ce-8d75-4a12-89e3-ff77731c2fb3-kube-api-access-wfrb6\") pod \"network-check-target-s7jfk\" (UID: \"d7f984ce-8d75-4a12-89e3-ff77731c2fb3\") " pod="openshift-network-diagnostics/network-check-target-s7jfk" Jun 09 05:29:12.390530 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.389373 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1165c84b-2a43-44a3-9537-cd4fb2a25489-agent-certs\") pod \"konnectivity-agent-qr8vr\" (UID: \"1165c84b-2a43-44a3-9537-cd4fb2a25489\") " pod="kube-system/konnectivity-agent-qr8vr" Jun 09 05:29:12.390530 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.389391 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vqd2\" (UniqueName: \"kubernetes.io/projected/f0b74df6-4873-4f9c-b0f5-9dc2da97c37d-kube-api-access-2vqd2\") pod \"multus-7x4c6\" (UID: \"f0b74df6-4873-4f9c-b0f5-9dc2da97c37d\") " pod="openshift-multus/multus-7x4c6" Jun 09 05:29:12.390530 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.389431 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lv2sj\" (UniqueName: \"kubernetes.io/projected/04cabc1f-f6d7-4aa2-a53e-06946b3655a7-kube-api-access-lv2sj\") pod \"multus-additional-cni-plugins-qmt9g\" (UID: \"04cabc1f-f6d7-4aa2-a53e-06946b3655a7\") " pod="openshift-multus/multus-additional-cni-plugins-qmt9g" Jun 09 05:29:12.390530 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.389455 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f0b74df6-4873-4f9c-b0f5-9dc2da97c37d-cni-binary-copy\") pod \"multus-7x4c6\" (UID: \"f0b74df6-4873-4f9c-b0f5-9dc2da97c37d\") " pod="openshift-multus/multus-7x4c6" Jun 09 05:29:12.390530 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.389456 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f96a0345-2a40-44d1-ac0f-61cd00d2036f-run\") pod \"tuned-9crt8\" (UID: \"f96a0345-2a40-44d1-ac0f-61cd00d2036f\") " pod="openshift-cluster-node-tuning-operator/tuned-9crt8" Jun 09 05:29:12.390530 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.389543 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f96a0345-2a40-44d1-ac0f-61cd00d2036f-sys\") pod \"tuned-9crt8\" (UID: \"f96a0345-2a40-44d1-ac0f-61cd00d2036f\") " pod="openshift-cluster-node-tuning-operator/tuned-9crt8" Jun 09 05:29:12.391293 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.389576 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f96a0345-2a40-44d1-ac0f-61cd00d2036f-lib-modules\") pod \"tuned-9crt8\" (UID: \"f96a0345-2a40-44d1-ac0f-61cd00d2036f\") " pod="openshift-cluster-node-tuning-operator/tuned-9crt8" Jun 09 05:29:12.391293 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.389606 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f96a0345-2a40-44d1-ac0f-61cd00d2036f-host\") pod \"tuned-9crt8\" (UID: \"f96a0345-2a40-44d1-ac0f-61cd00d2036f\") " pod="openshift-cluster-node-tuning-operator/tuned-9crt8" Jun 09 05:29:12.391293 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.389616 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f96a0345-2a40-44d1-ac0f-61cd00d2036f-run\") pod \"tuned-9crt8\" (UID: \"f96a0345-2a40-44d1-ac0f-61cd00d2036f\") " pod="openshift-cluster-node-tuning-operator/tuned-9crt8" Jun 09 05:29:12.391293 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.389632 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f0b74df6-4873-4f9c-b0f5-9dc2da97c37d-multus-cni-dir\") pod \"multus-7x4c6\" (UID: \"f0b74df6-4873-4f9c-b0f5-9dc2da97c37d\") " pod="openshift-multus/multus-7x4c6" Jun 09 05:29:12.391293 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.389655 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f0b74df6-4873-4f9c-b0f5-9dc2da97c37d-cnibin\") pod \"multus-7x4c6\" (UID: \"f0b74df6-4873-4f9c-b0f5-9dc2da97c37d\") " pod="openshift-multus/multus-7x4c6" Jun 09 05:29:12.391293 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.389706 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f0b74df6-4873-4f9c-b0f5-9dc2da97c37d-os-release\") pod \"multus-7x4c6\" (UID: \"f0b74df6-4873-4f9c-b0f5-9dc2da97c37d\") " pod="openshift-multus/multus-7x4c6" Jun 09 05:29:12.391293 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.389714 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f96a0345-2a40-44d1-ac0f-61cd00d2036f-host\") pod \"tuned-9crt8\" (UID: \"f96a0345-2a40-44d1-ac0f-61cd00d2036f\") " pod="openshift-cluster-node-tuning-operator/tuned-9crt8" Jun 09 05:29:12.391293 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.389727 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f96a0345-2a40-44d1-ac0f-61cd00d2036f-lib-modules\") pod \"tuned-9crt8\" (UID: \"f96a0345-2a40-44d1-ac0f-61cd00d2036f\") " pod="openshift-cluster-node-tuning-operator/tuned-9crt8" Jun 09 05:29:12.391293 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.389730 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f0b74df6-4873-4f9c-b0f5-9dc2da97c37d-multus-daemon-config\") pod \"multus-7x4c6\" (UID: \"f0b74df6-4873-4f9c-b0f5-9dc2da97c37d\") " pod="openshift-multus/multus-7x4c6" Jun 09 05:29:12.391293 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.389763 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c59113d3-15fe-4b55-b86e-fe821d85b2c6-etc-selinux\") pod \"aws-ebs-csi-driver-node-5khgb\" (UID: \"c59113d3-15fe-4b55-b86e-fe821d85b2c6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5khgb" Jun 09 05:29:12.391293 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.389770 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f0b74df6-4873-4f9c-b0f5-9dc2da97c37d-cnibin\") pod \"multus-7x4c6\" (UID: \"f0b74df6-4873-4f9c-b0f5-9dc2da97c37d\") " pod="openshift-multus/multus-7x4c6" Jun 09 05:29:12.391293 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.389809 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/02c37648-4419-4ff7-a316-568fa0510cee-systemd-units\") pod \"ovnkube-node-42h5b\" (UID: \"02c37648-4419-4ff7-a316-568fa0510cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-42h5b" Jun 09 05:29:12.391293 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.389838 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/02c37648-4419-4ff7-a316-568fa0510cee-host-run-netns\") pod \"ovnkube-node-42h5b\" (UID: \"02c37648-4419-4ff7-a316-568fa0510cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-42h5b" Jun 09 05:29:12.391293 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.389844 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f0b74df6-4873-4f9c-b0f5-9dc2da97c37d-multus-cni-dir\") pod \"multus-7x4c6\" (UID: \"f0b74df6-4873-4f9c-b0f5-9dc2da97c37d\") " pod="openshift-multus/multus-7x4c6" Jun 09 05:29:12.391293 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.389865 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/02c37648-4419-4ff7-a316-568fa0510cee-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-42h5b\" (UID: \"02c37648-4419-4ff7-a316-568fa0510cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-42h5b" Jun 09 05:29:12.391293 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.389883 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f0b74df6-4873-4f9c-b0f5-9dc2da97c37d-os-release\") pod \"multus-7x4c6\" (UID: \"f0b74df6-4873-4f9c-b0f5-9dc2da97c37d\") " pod="openshift-multus/multus-7x4c6" Jun 09 05:29:12.391293 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.389894 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/04cabc1f-f6d7-4aa2-a53e-06946b3655a7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qmt9g\" (UID: \"04cabc1f-f6d7-4aa2-a53e-06946b3655a7\") " pod="openshift-multus/multus-additional-cni-plugins-qmt9g" Jun 09 05:29:12.391293 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.389921 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f96a0345-2a40-44d1-ac0f-61cd00d2036f-tmp\") pod \"tuned-9crt8\" (UID: \"f96a0345-2a40-44d1-ac0f-61cd00d2036f\") " pod="openshift-cluster-node-tuning-operator/tuned-9crt8" Jun 09 05:29:12.391971 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.389954 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/02c37648-4419-4ff7-a316-568fa0510cee-run-systemd\") pod \"ovnkube-node-42h5b\" (UID: \"02c37648-4419-4ff7-a316-568fa0510cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-42h5b" Jun 09 05:29:12.391971 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.389985 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/02c37648-4419-4ff7-a316-568fa0510cee-host-cni-bin\") pod \"ovnkube-node-42h5b\" (UID: \"02c37648-4419-4ff7-a316-568fa0510cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-42h5b" Jun 09 05:29:12.391971 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.390001 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c59113d3-15fe-4b55-b86e-fe821d85b2c6-etc-selinux\") pod \"aws-ebs-csi-driver-node-5khgb\" (UID: \"c59113d3-15fe-4b55-b86e-fe821d85b2c6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5khgb" Jun 09 05:29:12.391971 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.390007 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/02c37648-4419-4ff7-a316-568fa0510cee-host-cni-netd\") pod \"ovnkube-node-42h5b\" (UID: \"02c37648-4419-4ff7-a316-568fa0510cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-42h5b" Jun 09 05:29:12.391971 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.390033 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c59113d3-15fe-4b55-b86e-fe821d85b2c6-sys-fs\") pod \"aws-ebs-csi-driver-node-5khgb\" (UID: \"c59113d3-15fe-4b55-b86e-fe821d85b2c6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5khgb" Jun 09 05:29:12.391971 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.390056 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f96a0345-2a40-44d1-ac0f-61cd00d2036f-etc-systemd\") pod \"tuned-9crt8\" (UID: \"f96a0345-2a40-44d1-ac0f-61cd00d2036f\") " pod="openshift-cluster-node-tuning-operator/tuned-9crt8" Jun 09 05:29:12.391971 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.390074 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/029a21cf-4c7d-4135-b327-7658b521553c-iptables-alerter-script\") pod \"iptables-alerter-crzck\" (UID: \"029a21cf-4c7d-4135-b327-7658b521553c\") " pod="openshift-network-operator/iptables-alerter-crzck" Jun 09 05:29:12.391971 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.390112 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c59113d3-15fe-4b55-b86e-fe821d85b2c6-sys-fs\") pod \"aws-ebs-csi-driver-node-5khgb\" (UID: \"c59113d3-15fe-4b55-b86e-fe821d85b2c6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5khgb" Jun 09 05:29:12.391971 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.390123 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/029a21cf-4c7d-4135-b327-7658b521553c-host-slash\") pod \"iptables-alerter-crzck\" (UID: \"029a21cf-4c7d-4135-b327-7658b521553c\") " pod="openshift-network-operator/iptables-alerter-crzck" Jun 09 05:29:12.391971 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.390154 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0fe11a08-fb62-4c73-bbd8-f595316df872-original-pull-secret\") pod \"global-pull-secret-syncer-c5rjt\" (UID: \"0fe11a08-fb62-4c73-bbd8-f595316df872\") " pod="kube-system/global-pull-secret-syncer-c5rjt" Jun 09 05:29:12.391971 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.390159 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f96a0345-2a40-44d1-ac0f-61cd00d2036f-etc-systemd\") pod \"tuned-9crt8\" (UID: \"f96a0345-2a40-44d1-ac0f-61cd00d2036f\") " pod="openshift-cluster-node-tuning-operator/tuned-9crt8" Jun 09 05:29:12.391971 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.390195 2564 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 09 05:29:12.391971 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.390208 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/02c37648-4419-4ff7-a316-568fa0510cee-var-lib-openvswitch\") pod \"ovnkube-node-42h5b\" (UID: \"02c37648-4419-4ff7-a316-568fa0510cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-42h5b" Jun 09 05:29:12.391971 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.390215 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f0b74df6-4873-4f9c-b0f5-9dc2da97c37d-multus-daemon-config\") pod \"multus-7x4c6\" (UID: \"f0b74df6-4873-4f9c-b0f5-9dc2da97c37d\") " pod="openshift-multus/multus-7x4c6" Jun 09 05:29:12.391971 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.390220 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/029a21cf-4c7d-4135-b327-7658b521553c-host-slash\") pod \"iptables-alerter-crzck\" (UID: \"029a21cf-4c7d-4135-b327-7658b521553c\") " pod="openshift-network-operator/iptables-alerter-crzck" Jun 09 05:29:12.391971 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.390288 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f96a0345-2a40-44d1-ac0f-61cd00d2036f-sys\") pod \"tuned-9crt8\" (UID: \"f96a0345-2a40-44d1-ac0f-61cd00d2036f\") " pod="openshift-cluster-node-tuning-operator/tuned-9crt8" Jun 09 05:29:12.391971 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.390289 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/02c37648-4419-4ff7-a316-568fa0510cee-host-run-ovn-kubernetes\") pod \"ovnkube-node-42h5b\" (UID: \"02c37648-4419-4ff7-a316-568fa0510cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-42h5b" Jun 09 05:29:12.392567 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.390326 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/02c37648-4419-4ff7-a316-568fa0510cee-ovn-node-metrics-cert\") pod \"ovnkube-node-42h5b\" (UID: \"02c37648-4419-4ff7-a316-568fa0510cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-42h5b" Jun 09 05:29:12.392567 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.390350 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f0b74df6-4873-4f9c-b0f5-9dc2da97c37d-system-cni-dir\") pod \"multus-7x4c6\" (UID: \"f0b74df6-4873-4f9c-b0f5-9dc2da97c37d\") " pod="openshift-multus/multus-7x4c6" Jun 09 05:29:12.392567 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.390375 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c59113d3-15fe-4b55-b86e-fe821d85b2c6-device-dir\") pod \"aws-ebs-csi-driver-node-5khgb\" (UID: \"c59113d3-15fe-4b55-b86e-fe821d85b2c6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5khgb" Jun 09 05:29:12.392567 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.390395 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f0b74df6-4873-4f9c-b0f5-9dc2da97c37d-system-cni-dir\") pod \"multus-7x4c6\" (UID: \"f0b74df6-4873-4f9c-b0f5-9dc2da97c37d\") " pod="openshift-multus/multus-7x4c6" Jun 09 05:29:12.392567 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.390401 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f96a0345-2a40-44d1-ac0f-61cd00d2036f-etc-kubernetes\") pod \"tuned-9crt8\" (UID: \"f96a0345-2a40-44d1-ac0f-61cd00d2036f\") " pod="openshift-cluster-node-tuning-operator/tuned-9crt8" Jun 09 05:29:12.392567 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.390433 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/50e77e00-d2c2-45fa-9095-05a6d05a90e4-tmp-dir\") pod \"node-resolver-n8vqj\" (UID: \"50e77e00-d2c2-45fa-9095-05a6d05a90e4\") " pod="openshift-dns/node-resolver-n8vqj" Jun 09 05:29:12.392567 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.390456 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f96a0345-2a40-44d1-ac0f-61cd00d2036f-etc-kubernetes\") pod \"tuned-9crt8\" (UID: \"f96a0345-2a40-44d1-ac0f-61cd00d2036f\") " pod="openshift-cluster-node-tuning-operator/tuned-9crt8" Jun 09 05:29:12.392567 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.390457 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0fe11a08-fb62-4c73-bbd8-f595316df872-dbus\") pod \"global-pull-secret-syncer-c5rjt\" (UID: \"0fe11a08-fb62-4c73-bbd8-f595316df872\") " pod="kube-system/global-pull-secret-syncer-c5rjt" Jun 09 05:29:12.392567 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.390472 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c59113d3-15fe-4b55-b86e-fe821d85b2c6-device-dir\") pod \"aws-ebs-csi-driver-node-5khgb\" (UID: \"c59113d3-15fe-4b55-b86e-fe821d85b2c6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5khgb" Jun 09 05:29:12.392567 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.390493 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2txv\" (UniqueName: \"kubernetes.io/projected/73b6af10-58e6-4c5f-bcfc-083f82dfc9db-kube-api-access-g2txv\") pod \"network-metrics-daemon-g2vt2\" (UID: \"73b6af10-58e6-4c5f-bcfc-083f82dfc9db\") " pod="openshift-multus/network-metrics-daemon-g2vt2" Jun 09 05:29:12.392567 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.390522 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/04cabc1f-f6d7-4aa2-a53e-06946b3655a7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qmt9g\" (UID: \"04cabc1f-f6d7-4aa2-a53e-06946b3655a7\") " pod="openshift-multus/multus-additional-cni-plugins-qmt9g" Jun 09 05:29:12.392567 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.390539 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/da2e480a-b5b6-44d9-a94c-0ad232ec311c-serviceca\") pod \"node-ca-zbjvr\" (UID: \"da2e480a-b5b6-44d9-a94c-0ad232ec311c\") " pod="openshift-image-registry/node-ca-zbjvr" Jun 09 05:29:12.392567 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.390565 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28729\" (UniqueName: \"kubernetes.io/projected/c59113d3-15fe-4b55-b86e-fe821d85b2c6-kube-api-access-28729\") pod \"aws-ebs-csi-driver-node-5khgb\" (UID: \"c59113d3-15fe-4b55-b86e-fe821d85b2c6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5khgb" Jun 09 05:29:12.392567 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.390591 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f96a0345-2a40-44d1-ac0f-61cd00d2036f-etc-tuned\") pod \"tuned-9crt8\" (UID: \"f96a0345-2a40-44d1-ac0f-61cd00d2036f\") " pod="openshift-cluster-node-tuning-operator/tuned-9crt8" Jun 09 05:29:12.392567 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.390615 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/02c37648-4419-4ff7-a316-568fa0510cee-node-log\") pod \"ovnkube-node-42h5b\" (UID: \"02c37648-4419-4ff7-a316-568fa0510cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-42h5b" Jun 09 05:29:12.392567 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.390639 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/02c37648-4419-4ff7-a316-568fa0510cee-ovnkube-script-lib\") pod \"ovnkube-node-42h5b\" (UID: \"02c37648-4419-4ff7-a316-568fa0510cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-42h5b" Jun 09 05:29:12.392567 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.390663 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xrns\" (UniqueName: \"kubernetes.io/projected/02c37648-4419-4ff7-a316-568fa0510cee-kube-api-access-2xrns\") pod \"ovnkube-node-42h5b\" (UID: \"02c37648-4419-4ff7-a316-568fa0510cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-42h5b" Jun 09 05:29:12.393245 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.390682 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/029a21cf-4c7d-4135-b327-7658b521553c-iptables-alerter-script\") pod \"iptables-alerter-crzck\" (UID: \"029a21cf-4c7d-4135-b327-7658b521553c\") " pod="openshift-network-operator/iptables-alerter-crzck" Jun 09 05:29:12.393305 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.393268 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f96a0345-2a40-44d1-ac0f-61cd00d2036f-tmp\") pod \"tuned-9crt8\" (UID: \"f96a0345-2a40-44d1-ac0f-61cd00d2036f\") " pod="openshift-cluster-node-tuning-operator/tuned-9crt8" Jun 09 05:29:12.393305 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.393285 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f96a0345-2a40-44d1-ac0f-61cd00d2036f-etc-tuned\") pod \"tuned-9crt8\" (UID: \"f96a0345-2a40-44d1-ac0f-61cd00d2036f\") " pod="openshift-cluster-node-tuning-operator/tuned-9crt8" Jun 09 05:29:12.394949 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.394922 2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 05:29:12.396913 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.396876 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpt78\" (UniqueName: \"kubernetes.io/projected/f96a0345-2a40-44d1-ac0f-61cd00d2036f-kube-api-access-wpt78\") pod \"tuned-9crt8\" (UID: \"f96a0345-2a40-44d1-ac0f-61cd00d2036f\") " pod="openshift-cluster-node-tuning-operator/tuned-9crt8" Jun 09 05:29:12.397460 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.397431 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vqd2\" (UniqueName: \"kubernetes.io/projected/f0b74df6-4873-4f9c-b0f5-9dc2da97c37d-kube-api-access-2vqd2\") pod \"multus-7x4c6\" (UID: \"f0b74df6-4873-4f9c-b0f5-9dc2da97c37d\") " pod="openshift-multus/multus-7x4c6" Jun 09 05:29:12.397595 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.397436 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mz7bx\" (UniqueName: \"kubernetes.io/projected/029a21cf-4c7d-4135-b327-7658b521553c-kube-api-access-mz7bx\") pod \"iptables-alerter-crzck\" (UID: \"029a21cf-4c7d-4135-b327-7658b521553c\") " pod="openshift-network-operator/iptables-alerter-crzck" Jun 09 05:29:12.397595 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.397558 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lv2sj\" (UniqueName: \"kubernetes.io/projected/04cabc1f-f6d7-4aa2-a53e-06946b3655a7-kube-api-access-lv2sj\") pod \"multus-additional-cni-plugins-qmt9g\" (UID: \"04cabc1f-f6d7-4aa2-a53e-06946b3655a7\") " pod="openshift-multus/multus-additional-cni-plugins-qmt9g" Jun 09 05:29:12.401418 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.400707 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-28729\" (UniqueName: \"kubernetes.io/projected/c59113d3-15fe-4b55-b86e-fe821d85b2c6-kube-api-access-28729\") pod \"aws-ebs-csi-driver-node-5khgb\" (UID: \"c59113d3-15fe-4b55-b86e-fe821d85b2c6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5khgb" Jun 09 05:29:12.491312 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.491280 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfrb6\" (UniqueName: \"kubernetes.io/projected/d7f984ce-8d75-4a12-89e3-ff77731c2fb3-kube-api-access-wfrb6\") pod \"network-check-target-s7jfk\" (UID: \"d7f984ce-8d75-4a12-89e3-ff77731c2fb3\") " pod="openshift-network-diagnostics/network-check-target-s7jfk" Jun 09 05:29:12.491467 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.491318 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1165c84b-2a43-44a3-9537-cd4fb2a25489-agent-certs\") pod \"konnectivity-agent-qr8vr\" (UID: \"1165c84b-2a43-44a3-9537-cd4fb2a25489\") " pod="kube-system/konnectivity-agent-qr8vr" Jun 09 05:29:12.491467 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.491348 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/02c37648-4419-4ff7-a316-568fa0510cee-systemd-units\") pod \"ovnkube-node-42h5b\" (UID: \"02c37648-4419-4ff7-a316-568fa0510cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-42h5b" Jun 09 05:29:12.491467 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.491368 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/02c37648-4419-4ff7-a316-568fa0510cee-host-run-netns\") pod \"ovnkube-node-42h5b\" (UID: \"02c37648-4419-4ff7-a316-568fa0510cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-42h5b" Jun 09 05:29:12.491467 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.491391 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/02c37648-4419-4ff7-a316-568fa0510cee-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-42h5b\" (UID: \"02c37648-4419-4ff7-a316-568fa0510cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-42h5b" Jun 09 05:29:12.491467 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.491419 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/02c37648-4419-4ff7-a316-568fa0510cee-run-systemd\") pod \"ovnkube-node-42h5b\" (UID: \"02c37648-4419-4ff7-a316-568fa0510cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-42h5b" Jun 09 05:29:12.491467 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.491439 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/02c37648-4419-4ff7-a316-568fa0510cee-host-cni-bin\") pod \"ovnkube-node-42h5b\" (UID: \"02c37648-4419-4ff7-a316-568fa0510cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-42h5b" Jun 09 05:29:12.491467 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.491459 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/02c37648-4419-4ff7-a316-568fa0510cee-host-cni-netd\") pod \"ovnkube-node-42h5b\" (UID: \"02c37648-4419-4ff7-a316-568fa0510cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-42h5b" Jun 09 05:29:12.491847 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.491475 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/02c37648-4419-4ff7-a316-568fa0510cee-systemd-units\") pod \"ovnkube-node-42h5b\" (UID: \"02c37648-4419-4ff7-a316-568fa0510cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-42h5b" Jun 09 05:29:12.491847 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.491498 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/02c37648-4419-4ff7-a316-568fa0510cee-host-run-netns\") pod \"ovnkube-node-42h5b\" (UID: \"02c37648-4419-4ff7-a316-568fa0510cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-42h5b" Jun 09 05:29:12.491847 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.491485 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0fe11a08-fb62-4c73-bbd8-f595316df872-original-pull-secret\") pod \"global-pull-secret-syncer-c5rjt\" (UID: \"0fe11a08-fb62-4c73-bbd8-f595316df872\") " pod="kube-system/global-pull-secret-syncer-c5rjt" Jun 09 05:29:12.491847 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.491538 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/02c37648-4419-4ff7-a316-568fa0510cee-run-systemd\") pod \"ovnkube-node-42h5b\" (UID: \"02c37648-4419-4ff7-a316-568fa0510cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-42h5b" Jun 09 05:29:12.491847 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.491551 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/02c37648-4419-4ff7-a316-568fa0510cee-host-cni-netd\") pod \"ovnkube-node-42h5b\" (UID: \"02c37648-4419-4ff7-a316-568fa0510cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-42h5b" Jun 09 05:29:12.491847 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.491543 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/02c37648-4419-4ff7-a316-568fa0510cee-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-42h5b\" (UID: \"02c37648-4419-4ff7-a316-568fa0510cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-42h5b" Jun 09 05:29:12.491847 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:12.491616 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 05:29:12.491847 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.491612 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/02c37648-4419-4ff7-a316-568fa0510cee-var-lib-openvswitch\") pod \"ovnkube-node-42h5b\" (UID: \"02c37648-4419-4ff7-a316-568fa0510cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-42h5b" Jun 09 05:29:12.491847 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.491653 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/02c37648-4419-4ff7-a316-568fa0510cee-var-lib-openvswitch\") pod \"ovnkube-node-42h5b\" (UID: \"02c37648-4419-4ff7-a316-568fa0510cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-42h5b" Jun 09 05:29:12.491847 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.491653 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/02c37648-4419-4ff7-a316-568fa0510cee-host-cni-bin\") pod \"ovnkube-node-42h5b\" (UID: \"02c37648-4419-4ff7-a316-568fa0510cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-42h5b" Jun 09 05:29:12.491847 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:12.491702 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0fe11a08-fb62-4c73-bbd8-f595316df872-original-pull-secret podName:0fe11a08-fb62-4c73-bbd8-f595316df872 nodeName:}" failed. No retries permitted until 2026-06-09 05:29:12.991659677 +0000 UTC m=+3.074311396 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0fe11a08-fb62-4c73-bbd8-f595316df872-original-pull-secret") pod "global-pull-secret-syncer-c5rjt" (UID: "0fe11a08-fb62-4c73-bbd8-f595316df872") : object "kube-system"/"original-pull-secret" not registered Jun 09 05:29:12.491847 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.491723 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/02c37648-4419-4ff7-a316-568fa0510cee-host-run-ovn-kubernetes\") pod \"ovnkube-node-42h5b\" (UID: \"02c37648-4419-4ff7-a316-568fa0510cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-42h5b" Jun 09 05:29:12.491847 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.491752 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/02c37648-4419-4ff7-a316-568fa0510cee-ovn-node-metrics-cert\") pod \"ovnkube-node-42h5b\" (UID: \"02c37648-4419-4ff7-a316-568fa0510cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-42h5b" Jun 09 05:29:12.491847 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.491759 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/02c37648-4419-4ff7-a316-568fa0510cee-host-run-ovn-kubernetes\") pod \"ovnkube-node-42h5b\" (UID: \"02c37648-4419-4ff7-a316-568fa0510cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-42h5b" Jun 09 05:29:12.491847 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.491779 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/50e77e00-d2c2-45fa-9095-05a6d05a90e4-tmp-dir\") pod \"node-resolver-n8vqj\" (UID: \"50e77e00-d2c2-45fa-9095-05a6d05a90e4\") " pod="openshift-dns/node-resolver-n8vqj" Jun 09 05:29:12.491847 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.491825 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0fe11a08-fb62-4c73-bbd8-f595316df872-dbus\") pod \"global-pull-secret-syncer-c5rjt\" (UID: \"0fe11a08-fb62-4c73-bbd8-f595316df872\") " pod="kube-system/global-pull-secret-syncer-c5rjt" Jun 09 05:29:12.491847 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.491850 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2txv\" (UniqueName: \"kubernetes.io/projected/73b6af10-58e6-4c5f-bcfc-083f82dfc9db-kube-api-access-g2txv\") pod \"network-metrics-daemon-g2vt2\" (UID: \"73b6af10-58e6-4c5f-bcfc-083f82dfc9db\") " pod="openshift-multus/network-metrics-daemon-g2vt2" Jun 09 05:29:12.492638 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.491874 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/da2e480a-b5b6-44d9-a94c-0ad232ec311c-serviceca\") pod \"node-ca-zbjvr\" (UID: \"da2e480a-b5b6-44d9-a94c-0ad232ec311c\") " pod="openshift-image-registry/node-ca-zbjvr" Jun 09 05:29:12.492638 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.491900 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/02c37648-4419-4ff7-a316-568fa0510cee-node-log\") pod \"ovnkube-node-42h5b\" (UID: \"02c37648-4419-4ff7-a316-568fa0510cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-42h5b" Jun 09 05:29:12.492638 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.491924 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/02c37648-4419-4ff7-a316-568fa0510cee-ovnkube-script-lib\") pod \"ovnkube-node-42h5b\" (UID: \"02c37648-4419-4ff7-a316-568fa0510cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-42h5b" Jun 09 05:29:12.492638 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.491937 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0fe11a08-fb62-4c73-bbd8-f595316df872-dbus\") pod \"global-pull-secret-syncer-c5rjt\" (UID: \"0fe11a08-fb62-4c73-bbd8-f595316df872\") " pod="kube-system/global-pull-secret-syncer-c5rjt" Jun 09 05:29:12.492638 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.491948 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xrns\" (UniqueName: \"kubernetes.io/projected/02c37648-4419-4ff7-a316-568fa0510cee-kube-api-access-2xrns\") pod \"ovnkube-node-42h5b\" (UID: \"02c37648-4419-4ff7-a316-568fa0510cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-42h5b" Jun 09 05:29:12.492638 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.491988 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/02c37648-4419-4ff7-a316-568fa0510cee-log-socket\") pod \"ovnkube-node-42h5b\" (UID: \"02c37648-4419-4ff7-a316-568fa0510cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-42h5b" Jun 09 05:29:12.492638 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.492022 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/02c37648-4419-4ff7-a316-568fa0510cee-ovnkube-config\") pod \"ovnkube-node-42h5b\" (UID: \"02c37648-4419-4ff7-a316-568fa0510cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-42h5b" Jun 09 05:29:12.492638 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.492050 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/73b6af10-58e6-4c5f-bcfc-083f82dfc9db-metrics-certs\") pod \"network-metrics-daemon-g2vt2\" (UID: \"73b6af10-58e6-4c5f-bcfc-083f82dfc9db\") " pod="openshift-multus/network-metrics-daemon-g2vt2" Jun 09 05:29:12.492638 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.492075 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4qg7\" (UniqueName: \"kubernetes.io/projected/50e77e00-d2c2-45fa-9095-05a6d05a90e4-kube-api-access-n4qg7\") pod \"node-resolver-n8vqj\" (UID: \"50e77e00-d2c2-45fa-9095-05a6d05a90e4\") " pod="openshift-dns/node-resolver-n8vqj" Jun 09 05:29:12.492638 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.492099 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/02c37648-4419-4ff7-a316-568fa0510cee-host-kubelet\") pod \"ovnkube-node-42h5b\" (UID: \"02c37648-4419-4ff7-a316-568fa0510cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-42h5b" Jun 09 05:29:12.492638 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.492106 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/02c37648-4419-4ff7-a316-568fa0510cee-node-log\") pod \"ovnkube-node-42h5b\" (UID: \"02c37648-4419-4ff7-a316-568fa0510cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-42h5b" Jun 09 05:29:12.492638 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.492133 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/02c37648-4419-4ff7-a316-568fa0510cee-host-slash\") pod \"ovnkube-node-42h5b\" (UID: \"02c37648-4419-4ff7-a316-568fa0510cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-42h5b" Jun 09 05:29:12.492638 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.492155 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/02c37648-4419-4ff7-a316-568fa0510cee-etc-openvswitch\") pod \"ovnkube-node-42h5b\" (UID: \"02c37648-4419-4ff7-a316-568fa0510cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-42h5b" Jun 09 05:29:12.492638 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.492168 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/02c37648-4419-4ff7-a316-568fa0510cee-log-socket\") pod \"ovnkube-node-42h5b\" (UID: \"02c37648-4419-4ff7-a316-568fa0510cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-42h5b" Jun 09 05:29:12.492638 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.492176 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/02c37648-4419-4ff7-a316-568fa0510cee-env-overrides\") pod \"ovnkube-node-42h5b\" (UID: \"02c37648-4419-4ff7-a316-568fa0510cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-42h5b" Jun 09 05:29:12.492638 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.492201 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0fe11a08-fb62-4c73-bbd8-f595316df872-kubelet-config\") pod \"global-pull-secret-syncer-c5rjt\" (UID: \"0fe11a08-fb62-4c73-bbd8-f595316df872\") " pod="kube-system/global-pull-secret-syncer-c5rjt" Jun 09 05:29:12.492638 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.492225 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/02c37648-4419-4ff7-a316-568fa0510cee-run-openvswitch\") pod \"ovnkube-node-42h5b\" (UID: \"02c37648-4419-4ff7-a316-568fa0510cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-42h5b" Jun 09 05:29:12.492638 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.492247 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/02c37648-4419-4ff7-a316-568fa0510cee-run-ovn\") pod \"ovnkube-node-42h5b\" (UID: \"02c37648-4419-4ff7-a316-568fa0510cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-42h5b" Jun 09 05:29:12.493280 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.492274 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/50e77e00-d2c2-45fa-9095-05a6d05a90e4-hosts-file\") pod \"node-resolver-n8vqj\" (UID: \"50e77e00-d2c2-45fa-9095-05a6d05a90e4\") " pod="openshift-dns/node-resolver-n8vqj" Jun 09 05:29:12.493280 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.492299 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1165c84b-2a43-44a3-9537-cd4fb2a25489-konnectivity-ca\") pod \"konnectivity-agent-qr8vr\" (UID: \"1165c84b-2a43-44a3-9537-cd4fb2a25489\") " pod="kube-system/konnectivity-agent-qr8vr" Jun 09 05:29:12.493280 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.492321 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/da2e480a-b5b6-44d9-a94c-0ad232ec311c-host\") pod \"node-ca-zbjvr\" (UID: \"da2e480a-b5b6-44d9-a94c-0ad232ec311c\") " pod="openshift-image-registry/node-ca-zbjvr" Jun 09 05:29:12.493280 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.492330 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/50e77e00-d2c2-45fa-9095-05a6d05a90e4-tmp-dir\") pod \"node-resolver-n8vqj\" (UID: \"50e77e00-d2c2-45fa-9095-05a6d05a90e4\") " pod="openshift-dns/node-resolver-n8vqj" Jun 09 05:29:12.493280 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.492347 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wfsq\" (UniqueName: \"kubernetes.io/projected/da2e480a-b5b6-44d9-a94c-0ad232ec311c-kube-api-access-4wfsq\") pod \"node-ca-zbjvr\" (UID: \"da2e480a-b5b6-44d9-a94c-0ad232ec311c\") " pod="openshift-image-registry/node-ca-zbjvr" Jun 09 05:29:12.493280 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.492362 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/da2e480a-b5b6-44d9-a94c-0ad232ec311c-serviceca\") pod \"node-ca-zbjvr\" (UID: \"da2e480a-b5b6-44d9-a94c-0ad232ec311c\") " pod="openshift-image-registry/node-ca-zbjvr" Jun 09 05:29:12.493280 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.492415 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/02c37648-4419-4ff7-a316-568fa0510cee-host-kubelet\") pod \"ovnkube-node-42h5b\" (UID: \"02c37648-4419-4ff7-a316-568fa0510cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-42h5b" Jun 09 05:29:12.493280 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.492430 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/02c37648-4419-4ff7-a316-568fa0510cee-run-openvswitch\") pod \"ovnkube-node-42h5b\" (UID: \"02c37648-4419-4ff7-a316-568fa0510cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-42h5b" Jun 09 05:29:12.493280 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:12.492456 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 05:29:12.493280 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.492472 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/02c37648-4419-4ff7-a316-568fa0510cee-host-slash\") pod \"ovnkube-node-42h5b\" (UID: \"02c37648-4419-4ff7-a316-568fa0510cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-42h5b" Jun 09 05:29:12.493280 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.492455 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/02c37648-4419-4ff7-a316-568fa0510cee-run-ovn\") pod \"ovnkube-node-42h5b\" (UID: \"02c37648-4419-4ff7-a316-568fa0510cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-42h5b" Jun 09 05:29:12.493280 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.492514 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/02c37648-4419-4ff7-a316-568fa0510cee-etc-openvswitch\") pod \"ovnkube-node-42h5b\" (UID: \"02c37648-4419-4ff7-a316-568fa0510cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-42h5b" Jun 09 05:29:12.493280 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:12.492529 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73b6af10-58e6-4c5f-bcfc-083f82dfc9db-metrics-certs podName:73b6af10-58e6-4c5f-bcfc-083f82dfc9db nodeName:}" failed. No retries permitted until 2026-06-09 05:29:12.992511594 +0000 UTC m=+3.075163310 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/73b6af10-58e6-4c5f-bcfc-083f82dfc9db-metrics-certs") pod "network-metrics-daemon-g2vt2" (UID: "73b6af10-58e6-4c5f-bcfc-083f82dfc9db") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 05:29:12.493280 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.492552 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/50e77e00-d2c2-45fa-9095-05a6d05a90e4-hosts-file\") pod \"node-resolver-n8vqj\" (UID: \"50e77e00-d2c2-45fa-9095-05a6d05a90e4\") " pod="openshift-dns/node-resolver-n8vqj" Jun 09 05:29:12.493280 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.492603 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0fe11a08-fb62-4c73-bbd8-f595316df872-kubelet-config\") pod \"global-pull-secret-syncer-c5rjt\" (UID: \"0fe11a08-fb62-4c73-bbd8-f595316df872\") " pod="kube-system/global-pull-secret-syncer-c5rjt" Jun 09 05:29:12.493280 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.492669 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/da2e480a-b5b6-44d9-a94c-0ad232ec311c-host\") pod \"node-ca-zbjvr\" (UID: \"da2e480a-b5b6-44d9-a94c-0ad232ec311c\") " pod="openshift-image-registry/node-ca-zbjvr" Jun 09 05:29:12.493280 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.492730 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/02c37648-4419-4ff7-a316-568fa0510cee-ovnkube-script-lib\") pod \"ovnkube-node-42h5b\" (UID: \"02c37648-4419-4ff7-a316-568fa0510cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-42h5b" Jun 09 05:29:12.493280 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.492939 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/02c37648-4419-4ff7-a316-568fa0510cee-env-overrides\") pod \"ovnkube-node-42h5b\" (UID: \"02c37648-4419-4ff7-a316-568fa0510cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-42h5b" Jun 09 05:29:12.493781 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.493123 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/02c37648-4419-4ff7-a316-568fa0510cee-ovnkube-config\") pod \"ovnkube-node-42h5b\" (UID: \"02c37648-4419-4ff7-a316-568fa0510cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-42h5b" Jun 09 05:29:12.493994 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.493978 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1165c84b-2a43-44a3-9537-cd4fb2a25489-konnectivity-ca\") pod \"konnectivity-agent-qr8vr\" (UID: \"1165c84b-2a43-44a3-9537-cd4fb2a25489\") " pod="kube-system/konnectivity-agent-qr8vr" Jun 09 05:29:12.494138 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.494118 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/02c37648-4419-4ff7-a316-568fa0510cee-ovn-node-metrics-cert\") pod \"ovnkube-node-42h5b\" (UID: \"02c37648-4419-4ff7-a316-568fa0510cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-42h5b" Jun 09 05:29:12.494474 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.494457 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1165c84b-2a43-44a3-9537-cd4fb2a25489-agent-certs\") pod \"konnectivity-agent-qr8vr\" (UID: \"1165c84b-2a43-44a3-9537-cd4fb2a25489\") " pod="kube-system/konnectivity-agent-qr8vr" Jun 09 05:29:12.499941 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:12.499923 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 05:29:12.499941 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:12.499943 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 05:29:12.500089 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:12.499953 2564 projected.go:196] Error preparing data for projected volume kube-api-access-wfrb6 for pod openshift-network-diagnostics/network-check-target-s7jfk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 05:29:12.500089 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:12.500007 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d7f984ce-8d75-4a12-89e3-ff77731c2fb3-kube-api-access-wfrb6 podName:d7f984ce-8d75-4a12-89e3-ff77731c2fb3 nodeName:}" failed. No retries permitted until 2026-06-09 05:29:12.999994458 +0000 UTC m=+3.082646198 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-wfrb6" (UniqueName: "kubernetes.io/projected/d7f984ce-8d75-4a12-89e3-ff77731c2fb3-kube-api-access-wfrb6") pod "network-check-target-s7jfk" (UID: "d7f984ce-8d75-4a12-89e3-ff77731c2fb3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 05:29:12.502684 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.502659 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4qg7\" (UniqueName: \"kubernetes.io/projected/50e77e00-d2c2-45fa-9095-05a6d05a90e4-kube-api-access-n4qg7\") pod \"node-resolver-n8vqj\" (UID: \"50e77e00-d2c2-45fa-9095-05a6d05a90e4\") " pod="openshift-dns/node-resolver-n8vqj" Jun 09 05:29:12.502813 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.502690 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2txv\" (UniqueName: \"kubernetes.io/projected/73b6af10-58e6-4c5f-bcfc-083f82dfc9db-kube-api-access-g2txv\") pod \"network-metrics-daemon-g2vt2\" (UID: \"73b6af10-58e6-4c5f-bcfc-083f82dfc9db\") " pod="openshift-multus/network-metrics-daemon-g2vt2" Jun 09 05:29:12.503435 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.503418 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wfsq\" (UniqueName: \"kubernetes.io/projected/da2e480a-b5b6-44d9-a94c-0ad232ec311c-kube-api-access-4wfsq\") pod \"node-ca-zbjvr\" (UID: \"da2e480a-b5b6-44d9-a94c-0ad232ec311c\") " pod="openshift-image-registry/node-ca-zbjvr" Jun 09 05:29:12.503561 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.503543 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xrns\" (UniqueName: \"kubernetes.io/projected/02c37648-4419-4ff7-a316-568fa0510cee-kube-api-access-2xrns\") pod \"ovnkube-node-42h5b\" (UID: \"02c37648-4419-4ff7-a316-568fa0510cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-42h5b" Jun 09 05:29:12.582361 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.582326 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-crzck" Jun 09 05:29:12.590370 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.590346 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qmt9g" Jun 09 05:29:12.601008 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.600989 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7x4c6" Jun 09 05:29:12.605494 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.605478 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5khgb" Jun 09 05:29:12.611039 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.611020 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9crt8" Jun 09 05:29:12.617527 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.617511 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-n8vqj" Jun 09 05:29:12.624104 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.624088 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qr8vr" Jun 09 05:29:12.629613 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.629597 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zbjvr" Jun 09 05:29:12.634014 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.633997 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-42h5b" Jun 09 05:29:12.995874 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.995785 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0fe11a08-fb62-4c73-bbd8-f595316df872-original-pull-secret\") pod \"global-pull-secret-syncer-c5rjt\" (UID: \"0fe11a08-fb62-4c73-bbd8-f595316df872\") " pod="kube-system/global-pull-secret-syncer-c5rjt" Jun 09 05:29:12.995874 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:12.995842 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/73b6af10-58e6-4c5f-bcfc-083f82dfc9db-metrics-certs\") pod \"network-metrics-daemon-g2vt2\" (UID: \"73b6af10-58e6-4c5f-bcfc-083f82dfc9db\") " pod="openshift-multus/network-metrics-daemon-g2vt2" Jun 09 05:29:12.996065 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:12.995909 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 05:29:12.996065 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:12.995922 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 05:29:12.996065 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:12.995969 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73b6af10-58e6-4c5f-bcfc-083f82dfc9db-metrics-certs podName:73b6af10-58e6-4c5f-bcfc-083f82dfc9db nodeName:}" failed. No retries permitted until 2026-06-09 05:29:13.995956266 +0000 UTC m=+4.078607980 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/73b6af10-58e6-4c5f-bcfc-083f82dfc9db-metrics-certs") pod "network-metrics-daemon-g2vt2" (UID: "73b6af10-58e6-4c5f-bcfc-083f82dfc9db") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 05:29:12.996065 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:12.995981 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0fe11a08-fb62-4c73-bbd8-f595316df872-original-pull-secret podName:0fe11a08-fb62-4c73-bbd8-f595316df872 nodeName:}" failed. No retries permitted until 2026-06-09 05:29:13.995975373 +0000 UTC m=+4.078627086 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0fe11a08-fb62-4c73-bbd8-f595316df872-original-pull-secret") pod "global-pull-secret-syncer-c5rjt" (UID: "0fe11a08-fb62-4c73-bbd8-f595316df872") : object "kube-system"/"original-pull-secret" not registered Jun 09 05:29:13.096173 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:13.096147 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfrb6\" (UniqueName: \"kubernetes.io/projected/d7f984ce-8d75-4a12-89e3-ff77731c2fb3-kube-api-access-wfrb6\") pod \"network-check-target-s7jfk\" (UID: \"d7f984ce-8d75-4a12-89e3-ff77731c2fb3\") " pod="openshift-network-diagnostics/network-check-target-s7jfk" Jun 09 05:29:13.096359 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:13.096274 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 05:29:13.096359 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:13.096293 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 05:29:13.096359 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:13.096302 2564 projected.go:196] Error preparing data for projected volume kube-api-access-wfrb6 for pod openshift-network-diagnostics/network-check-target-s7jfk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 05:29:13.096359 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:13.096353 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d7f984ce-8d75-4a12-89e3-ff77731c2fb3-kube-api-access-wfrb6 podName:d7f984ce-8d75-4a12-89e3-ff77731c2fb3 nodeName:}" failed. No retries permitted until 2026-06-09 05:29:14.096336445 +0000 UTC m=+4.178988180 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-wfrb6" (UniqueName: "kubernetes.io/projected/d7f984ce-8d75-4a12-89e3-ff77731c2fb3-kube-api-access-wfrb6") pod "network-check-target-s7jfk" (UID: "d7f984ce-8d75-4a12-89e3-ff77731c2fb3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 05:29:13.166781 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:13.166753 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02c37648_4419_4ff7_a316_568fa0510cee.slice/crio-02e0fd55901a636db7513826233e7912a49bc170aa9c58766a8f2fe0c797bf06 WatchSource:0}: Error finding container 02e0fd55901a636db7513826233e7912a49bc170aa9c58766a8f2fe0c797bf06: Status 404 returned error can't find the container with id 02e0fd55901a636db7513826233e7912a49bc170aa9c58766a8f2fe0c797bf06 Jun 09 05:29:13.176022 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:13.175996 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod029a21cf_4c7d_4135_b327_7658b521553c.slice/crio-d8c2024af6b29415f1e8923aa6545ed85f66d4935f55d12ba11ab37dd393b15e WatchSource:0}: Error finding container d8c2024af6b29415f1e8923aa6545ed85f66d4935f55d12ba11ab37dd393b15e: Status 404 returned error can't find the container with id d8c2024af6b29415f1e8923aa6545ed85f66d4935f55d12ba11ab37dd393b15e Jun 09 05:29:13.177083 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:13.177056 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc59113d3_15fe_4b55_b86e_fe821d85b2c6.slice/crio-07d1c1058a4b23a4031556aeeb7b0b77daee72e6b8b437eb04bfd644410ef435 WatchSource:0}: Error finding container 07d1c1058a4b23a4031556aeeb7b0b77daee72e6b8b437eb04bfd644410ef435: Status 404 returned error can't find the container with id 07d1c1058a4b23a4031556aeeb7b0b77daee72e6b8b437eb04bfd644410ef435 Jun 09 05:29:13.178366 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:13.178245 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf96a0345_2a40_44d1_ac0f_61cd00d2036f.slice/crio-3db2d46a172b3be1473a8523fc68e180899eb9dd98e71c30662d685355b9cdc8 WatchSource:0}: Error finding container 3db2d46a172b3be1473a8523fc68e180899eb9dd98e71c30662d685355b9cdc8: Status 404 returned error can't find the container with id 3db2d46a172b3be1473a8523fc68e180899eb9dd98e71c30662d685355b9cdc8 Jun 09 05:29:13.179903 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:13.179829 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50e77e00_d2c2_45fa_9095_05a6d05a90e4.slice/crio-f4c3a4ebba2faf5f49dde371226e9bc7eb2b38dc34bd301d76daa0a58655f1f2 WatchSource:0}: Error finding container f4c3a4ebba2faf5f49dde371226e9bc7eb2b38dc34bd301d76daa0a58655f1f2: Status 404 returned error can't find the container with id f4c3a4ebba2faf5f49dde371226e9bc7eb2b38dc34bd301d76daa0a58655f1f2 Jun 09 05:29:13.182365 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:13.182341 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04cabc1f_f6d7_4aa2_a53e_06946b3655a7.slice/crio-ffd928dbcc95079c13c15c74f7a20cad87705c658235f4f07545569be5612441 WatchSource:0}: Error finding container ffd928dbcc95079c13c15c74f7a20cad87705c658235f4f07545569be5612441: Status 404 returned error can't find the container with id ffd928dbcc95079c13c15c74f7a20cad87705c658235f4f07545569be5612441 Jun 09 05:29:13.205435 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:13.205407 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0b74df6_4873_4f9c_b0f5_9dc2da97c37d.slice/crio-3f45ba958106c164171b70747b269550396e459a39c73b32e4a32b80deb6e9b4 WatchSource:0}: Error finding container 3f45ba958106c164171b70747b269550396e459a39c73b32e4a32b80deb6e9b4: Status 404 returned error can't find the container with id 3f45ba958106c164171b70747b269550396e459a39c73b32e4a32b80deb6e9b4 Jun 09 05:29:13.206135 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:13.206113 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1165c84b_2a43_44a3_9537_cd4fb2a25489.slice/crio-af86602ef2367cc7258a69fdc6e4aa10f84f8c31772305cf39235ce44729b91e WatchSource:0}: Error finding container af86602ef2367cc7258a69fdc6e4aa10f84f8c31772305cf39235ce44729b91e: Status 404 returned error can't find the container with id af86602ef2367cc7258a69fdc6e4aa10f84f8c31772305cf39235ce44729b91e Jun 09 05:29:13.207777 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:13.207746 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda2e480a_b5b6_44d9_a94c_0ad232ec311c.slice/crio-1eb9fda577f548284447e9c858795aa310d44489f3277bee9889dc70be3763a1 WatchSource:0}: Error finding container 1eb9fda577f548284447e9c858795aa310d44489f3277bee9889dc70be3763a1: Status 404 returned error can't find the container with id 1eb9fda577f548284447e9c858795aa310d44489f3277bee9889dc70be3763a1 Jun 09 05:29:13.319368 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:13.319332 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 05:24:12 +0000 UTC" deadline="2027-11-23 04:30:13.094950853 +0000 UTC" Jun 09 05:29:13.319368 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:13.319361 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12767h0m59.775592614s" Jun 09 05:29:13.349133 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:13.349098 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-n8vqj" event={"ID":"50e77e00-d2c2-45fa-9095-05a6d05a90e4","Type":"ContainerStarted","Data":"f4c3a4ebba2faf5f49dde371226e9bc7eb2b38dc34bd301d76daa0a58655f1f2"} Jun 09 05:29:13.350416 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:13.350390 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-crzck" event={"ID":"029a21cf-4c7d-4135-b327-7658b521553c","Type":"ContainerStarted","Data":"d8c2024af6b29415f1e8923aa6545ed85f66d4935f55d12ba11ab37dd393b15e"} Jun 09 05:29:13.351613 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:13.351586 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-42h5b" event={"ID":"02c37648-4419-4ff7-a316-568fa0510cee","Type":"ContainerStarted","Data":"02e0fd55901a636db7513826233e7912a49bc170aa9c58766a8f2fe0c797bf06"} Jun 09 05:29:13.352602 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:13.352580 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zbjvr" event={"ID":"da2e480a-b5b6-44d9-a94c-0ad232ec311c","Type":"ContainerStarted","Data":"1eb9fda577f548284447e9c858795aa310d44489f3277bee9889dc70be3763a1"} Jun 09 05:29:13.353540 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:13.353517 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7x4c6" event={"ID":"f0b74df6-4873-4f9c-b0f5-9dc2da97c37d","Type":"ContainerStarted","Data":"3f45ba958106c164171b70747b269550396e459a39c73b32e4a32b80deb6e9b4"} Jun 09 05:29:13.355347 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:13.355323 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5khgb" event={"ID":"c59113d3-15fe-4b55-b86e-fe821d85b2c6","Type":"ContainerStarted","Data":"07d1c1058a4b23a4031556aeeb7b0b77daee72e6b8b437eb04bfd644410ef435"} Jun 09 05:29:13.359676 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:13.359651 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9crt8" event={"ID":"f96a0345-2a40-44d1-ac0f-61cd00d2036f","Type":"ContainerStarted","Data":"3db2d46a172b3be1473a8523fc68e180899eb9dd98e71c30662d685355b9cdc8"} Jun 09 05:29:13.361848 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:13.361823 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-106.ec2.internal" event={"ID":"508e38f1dea9898446f7e228709d5418","Type":"ContainerStarted","Data":"25236f47c432f0491908affb810f5d6d79600cdb55334ec5b0f2902bb596c9a9"} Jun 09 05:29:13.362928 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:13.362909 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qr8vr" event={"ID":"1165c84b-2a43-44a3-9537-cd4fb2a25489","Type":"ContainerStarted","Data":"af86602ef2367cc7258a69fdc6e4aa10f84f8c31772305cf39235ce44729b91e"} Jun 09 05:29:13.363892 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:13.363867 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qmt9g" event={"ID":"04cabc1f-f6d7-4aa2-a53e-06946b3655a7","Type":"ContainerStarted","Data":"ffd928dbcc95079c13c15c74f7a20cad87705c658235f4f07545569be5612441"} Jun 09 05:29:13.375083 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:13.375012 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-106.ec2.internal" podStartSLOduration=2.374995647 podStartE2EDuration="2.374995647s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 05:29:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 05:29:13.37489472 +0000 UTC m=+3.457546457" watchObservedRunningTime="2026-06-09 05:29:13.374995647 +0000 UTC m=+3.457647383" Jun 09 05:29:14.002408 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:14.002366 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0fe11a08-fb62-4c73-bbd8-f595316df872-original-pull-secret\") pod \"global-pull-secret-syncer-c5rjt\" (UID: \"0fe11a08-fb62-4c73-bbd8-f595316df872\") " pod="kube-system/global-pull-secret-syncer-c5rjt" Jun 09 05:29:14.002597 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:14.002429 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/73b6af10-58e6-4c5f-bcfc-083f82dfc9db-metrics-certs\") pod \"network-metrics-daemon-g2vt2\" (UID: \"73b6af10-58e6-4c5f-bcfc-083f82dfc9db\") " pod="openshift-multus/network-metrics-daemon-g2vt2" Jun 09 05:29:14.002597 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:14.002582 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 05:29:14.002705 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:14.002649 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73b6af10-58e6-4c5f-bcfc-083f82dfc9db-metrics-certs podName:73b6af10-58e6-4c5f-bcfc-083f82dfc9db nodeName:}" failed. No retries permitted until 2026-06-09 05:29:16.002627553 +0000 UTC m=+6.085279273 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/73b6af10-58e6-4c5f-bcfc-083f82dfc9db-metrics-certs") pod "network-metrics-daemon-g2vt2" (UID: "73b6af10-58e6-4c5f-bcfc-083f82dfc9db") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 05:29:14.003204 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:14.003182 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 05:29:14.003298 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:14.003239 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0fe11a08-fb62-4c73-bbd8-f595316df872-original-pull-secret podName:0fe11a08-fb62-4c73-bbd8-f595316df872 nodeName:}" failed. No retries permitted until 2026-06-09 05:29:16.00322442 +0000 UTC m=+6.085876147 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0fe11a08-fb62-4c73-bbd8-f595316df872-original-pull-secret") pod "global-pull-secret-syncer-c5rjt" (UID: "0fe11a08-fb62-4c73-bbd8-f595316df872") : object "kube-system"/"original-pull-secret" not registered Jun 09 05:29:14.103296 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:14.103257 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfrb6\" (UniqueName: \"kubernetes.io/projected/d7f984ce-8d75-4a12-89e3-ff77731c2fb3-kube-api-access-wfrb6\") pod \"network-check-target-s7jfk\" (UID: \"d7f984ce-8d75-4a12-89e3-ff77731c2fb3\") " pod="openshift-network-diagnostics/network-check-target-s7jfk" Jun 09 05:29:14.103481 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:14.103449 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 05:29:14.103481 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:14.103468 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 05:29:14.103481 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:14.103481 2564 projected.go:196] Error preparing data for projected volume kube-api-access-wfrb6 for pod openshift-network-diagnostics/network-check-target-s7jfk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 05:29:14.103642 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:14.103544 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d7f984ce-8d75-4a12-89e3-ff77731c2fb3-kube-api-access-wfrb6 podName:d7f984ce-8d75-4a12-89e3-ff77731c2fb3 nodeName:}" failed. No retries permitted until 2026-06-09 05:29:16.103523955 +0000 UTC m=+6.186175686 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-wfrb6" (UniqueName: "kubernetes.io/projected/d7f984ce-8d75-4a12-89e3-ff77731c2fb3-kube-api-access-wfrb6") pod "network-check-target-s7jfk" (UID: "d7f984ce-8d75-4a12-89e3-ff77731c2fb3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 05:29:14.319868 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:14.319787 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 05:24:12 +0000 UTC" deadline="2027-11-14 02:56:02.105592894 +0000 UTC" Jun 09 05:29:14.319868 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:14.319867 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12549h26m47.785731139s" Jun 09 05:29:14.343981 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:14.343948 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s7jfk" Jun 09 05:29:14.344159 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:14.344069 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s7jfk" podUID="d7f984ce-8d75-4a12-89e3-ff77731c2fb3" Jun 09 05:29:14.344301 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:14.344280 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g2vt2" Jun 09 05:29:14.344406 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:14.344385 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g2vt2" podUID="73b6af10-58e6-4c5f-bcfc-083f82dfc9db" Jun 09 05:29:14.344472 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:14.344457 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c5rjt" Jun 09 05:29:14.344553 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:14.344535 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c5rjt" podUID="0fe11a08-fb62-4c73-bbd8-f595316df872" Jun 09 05:29:14.397089 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:14.397035 2564 generic.go:356] "Generic (PLEG): container finished" podID="264b5536af84b660adf2173e962a4403" containerID="4a17379158bd7cf9cbdb90888c877510f712a2d249a2d377185acd3334e01bd7" exitCode=0 Jun 09 05:29:14.399009 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:14.397989 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-106.ec2.internal" event={"ID":"264b5536af84b660adf2173e962a4403","Type":"ContainerDied","Data":"4a17379158bd7cf9cbdb90888c877510f712a2d249a2d377185acd3334e01bd7"} Jun 09 05:29:15.418981 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:15.418262 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-106.ec2.internal" event={"ID":"264b5536af84b660adf2173e962a4403","Type":"ContainerStarted","Data":"dee0c64594b6a9c109181e20ac08f345748aa8de48b81a48378a9187fb9b7bd8"} Jun 09 05:29:15.435023 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:15.434853 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-106.ec2.internal" podStartSLOduration=4.434833389 podStartE2EDuration="4.434833389s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 05:29:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 05:29:15.433681279 +0000 UTC m=+5.516333018" watchObservedRunningTime="2026-06-09 05:29:15.434833389 +0000 UTC m=+5.517485126" Jun 09 05:29:16.031284 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:16.030463 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0fe11a08-fb62-4c73-bbd8-f595316df872-original-pull-secret\") pod \"global-pull-secret-syncer-c5rjt\" (UID: \"0fe11a08-fb62-4c73-bbd8-f595316df872\") " pod="kube-system/global-pull-secret-syncer-c5rjt" Jun 09 05:29:16.031284 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:16.030531 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/73b6af10-58e6-4c5f-bcfc-083f82dfc9db-metrics-certs\") pod \"network-metrics-daemon-g2vt2\" (UID: \"73b6af10-58e6-4c5f-bcfc-083f82dfc9db\") " pod="openshift-multus/network-metrics-daemon-g2vt2" Jun 09 05:29:16.031284 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:16.030689 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 05:29:16.031284 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:16.030755 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73b6af10-58e6-4c5f-bcfc-083f82dfc9db-metrics-certs podName:73b6af10-58e6-4c5f-bcfc-083f82dfc9db nodeName:}" failed. No retries permitted until 2026-06-09 05:29:20.030733687 +0000 UTC m=+10.113385418 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/73b6af10-58e6-4c5f-bcfc-083f82dfc9db-metrics-certs") pod "network-metrics-daemon-g2vt2" (UID: "73b6af10-58e6-4c5f-bcfc-083f82dfc9db") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 05:29:16.031284 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:16.031200 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 05:29:16.031284 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:16.031247 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0fe11a08-fb62-4c73-bbd8-f595316df872-original-pull-secret podName:0fe11a08-fb62-4c73-bbd8-f595316df872 nodeName:}" failed. No retries permitted until 2026-06-09 05:29:20.031232599 +0000 UTC m=+10.113884316 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0fe11a08-fb62-4c73-bbd8-f595316df872-original-pull-secret") pod "global-pull-secret-syncer-c5rjt" (UID: "0fe11a08-fb62-4c73-bbd8-f595316df872") : object "kube-system"/"original-pull-secret" not registered Jun 09 05:29:16.131336 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:16.131294 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfrb6\" (UniqueName: \"kubernetes.io/projected/d7f984ce-8d75-4a12-89e3-ff77731c2fb3-kube-api-access-wfrb6\") pod \"network-check-target-s7jfk\" (UID: \"d7f984ce-8d75-4a12-89e3-ff77731c2fb3\") " pod="openshift-network-diagnostics/network-check-target-s7jfk" Jun 09 05:29:16.131624 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:16.131598 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 05:29:16.131717 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:16.131632 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 05:29:16.131717 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:16.131645 2564 projected.go:196] Error preparing data for projected volume kube-api-access-wfrb6 for pod openshift-network-diagnostics/network-check-target-s7jfk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 05:29:16.131717 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:16.131710 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d7f984ce-8d75-4a12-89e3-ff77731c2fb3-kube-api-access-wfrb6 podName:d7f984ce-8d75-4a12-89e3-ff77731c2fb3 nodeName:}" failed. No retries permitted until 2026-06-09 05:29:20.131688285 +0000 UTC m=+10.214340014 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-wfrb6" (UniqueName: "kubernetes.io/projected/d7f984ce-8d75-4a12-89e3-ff77731c2fb3-kube-api-access-wfrb6") pod "network-check-target-s7jfk" (UID: "d7f984ce-8d75-4a12-89e3-ff77731c2fb3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 05:29:16.342375 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:16.341892 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c5rjt" Jun 09 05:29:16.342375 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:16.341933 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g2vt2" Jun 09 05:29:16.342375 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:16.342028 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c5rjt" podUID="0fe11a08-fb62-4c73-bbd8-f595316df872" Jun 09 05:29:16.342375 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:16.341895 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s7jfk" Jun 09 05:29:16.342375 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:16.342153 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s7jfk" podUID="d7f984ce-8d75-4a12-89e3-ff77731c2fb3" Jun 09 05:29:16.342375 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:16.342235 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g2vt2" podUID="73b6af10-58e6-4c5f-bcfc-083f82dfc9db" Jun 09 05:29:18.340560 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:18.340411 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g2vt2" Jun 09 05:29:18.340560 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:18.340558 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g2vt2" podUID="73b6af10-58e6-4c5f-bcfc-083f82dfc9db" Jun 09 05:29:18.341046 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:18.340587 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s7jfk" Jun 09 05:29:18.341046 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:18.340691 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s7jfk" podUID="d7f984ce-8d75-4a12-89e3-ff77731c2fb3" Jun 09 05:29:18.341046 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:18.340741 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c5rjt" Jun 09 05:29:18.341046 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:18.340871 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c5rjt" podUID="0fe11a08-fb62-4c73-bbd8-f595316df872" Jun 09 05:29:20.066748 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:20.066022 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0fe11a08-fb62-4c73-bbd8-f595316df872-original-pull-secret\") pod \"global-pull-secret-syncer-c5rjt\" (UID: \"0fe11a08-fb62-4c73-bbd8-f595316df872\") " pod="kube-system/global-pull-secret-syncer-c5rjt" Jun 09 05:29:20.066748 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:20.066081 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/73b6af10-58e6-4c5f-bcfc-083f82dfc9db-metrics-certs\") pod \"network-metrics-daemon-g2vt2\" (UID: \"73b6af10-58e6-4c5f-bcfc-083f82dfc9db\") " pod="openshift-multus/network-metrics-daemon-g2vt2" Jun 09 05:29:20.066748 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:20.066204 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 05:29:20.066748 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:20.066265 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73b6af10-58e6-4c5f-bcfc-083f82dfc9db-metrics-certs podName:73b6af10-58e6-4c5f-bcfc-083f82dfc9db nodeName:}" failed. No retries permitted until 2026-06-09 05:29:28.066245248 +0000 UTC m=+18.148896966 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/73b6af10-58e6-4c5f-bcfc-083f82dfc9db-metrics-certs") pod "network-metrics-daemon-g2vt2" (UID: "73b6af10-58e6-4c5f-bcfc-083f82dfc9db") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 05:29:20.066748 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:20.066660 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 05:29:20.066748 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:20.066713 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0fe11a08-fb62-4c73-bbd8-f595316df872-original-pull-secret podName:0fe11a08-fb62-4c73-bbd8-f595316df872 nodeName:}" failed. No retries permitted until 2026-06-09 05:29:28.06669672 +0000 UTC m=+18.149348457 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0fe11a08-fb62-4c73-bbd8-f595316df872-original-pull-secret") pod "global-pull-secret-syncer-c5rjt" (UID: "0fe11a08-fb62-4c73-bbd8-f595316df872") : object "kube-system"/"original-pull-secret" not registered Jun 09 05:29:20.166619 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:20.166551 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfrb6\" (UniqueName: \"kubernetes.io/projected/d7f984ce-8d75-4a12-89e3-ff77731c2fb3-kube-api-access-wfrb6\") pod \"network-check-target-s7jfk\" (UID: \"d7f984ce-8d75-4a12-89e3-ff77731c2fb3\") " pod="openshift-network-diagnostics/network-check-target-s7jfk" Jun 09 05:29:20.166815 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:20.166737 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 05:29:20.166815 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:20.166756 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 05:29:20.166815 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:20.166765 2564 projected.go:196] Error preparing data for projected volume kube-api-access-wfrb6 for pod openshift-network-diagnostics/network-check-target-s7jfk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 05:29:20.166996 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:20.166821 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d7f984ce-8d75-4a12-89e3-ff77731c2fb3-kube-api-access-wfrb6 podName:d7f984ce-8d75-4a12-89e3-ff77731c2fb3 nodeName:}" failed. No retries permitted until 2026-06-09 05:29:28.166808042 +0000 UTC m=+18.249459769 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-wfrb6" (UniqueName: "kubernetes.io/projected/d7f984ce-8d75-4a12-89e3-ff77731c2fb3-kube-api-access-wfrb6") pod "network-check-target-s7jfk" (UID: "d7f984ce-8d75-4a12-89e3-ff77731c2fb3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 05:29:20.341684 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:20.341563 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c5rjt" Jun 09 05:29:20.341885 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:20.341685 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c5rjt" podUID="0fe11a08-fb62-4c73-bbd8-f595316df872" Jun 09 05:29:20.342018 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:20.341992 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g2vt2" Jun 09 05:29:20.342129 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:20.342072 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g2vt2" podUID="73b6af10-58e6-4c5f-bcfc-083f82dfc9db" Jun 09 05:29:20.342129 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:20.342109 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s7jfk" Jun 09 05:29:20.342236 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:20.342208 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s7jfk" podUID="d7f984ce-8d75-4a12-89e3-ff77731c2fb3" Jun 09 05:29:22.341066 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:22.341027 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g2vt2" Jun 09 05:29:22.341520 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:22.341027 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c5rjt" Jun 09 05:29:22.341520 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:22.341190 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g2vt2" podUID="73b6af10-58e6-4c5f-bcfc-083f82dfc9db" Jun 09 05:29:22.341520 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:22.341241 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s7jfk" Jun 09 05:29:22.341520 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:22.341357 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c5rjt" podUID="0fe11a08-fb62-4c73-bbd8-f595316df872" Jun 09 05:29:22.341520 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:22.341449 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s7jfk" podUID="d7f984ce-8d75-4a12-89e3-ff77731c2fb3" Jun 09 05:29:24.341528 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:24.341279 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c5rjt" Jun 09 05:29:24.342013 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:24.341279 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g2vt2" Jun 09 05:29:24.342013 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:24.341626 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c5rjt" podUID="0fe11a08-fb62-4c73-bbd8-f595316df872" Jun 09 05:29:24.342013 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:24.341281 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s7jfk" Jun 09 05:29:24.342013 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:24.341718 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g2vt2" podUID="73b6af10-58e6-4c5f-bcfc-083f82dfc9db" Jun 09 05:29:24.342013 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:24.341820 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s7jfk" podUID="d7f984ce-8d75-4a12-89e3-ff77731c2fb3" Jun 09 05:29:26.340637 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:26.340600 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s7jfk" Jun 09 05:29:26.341093 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:26.340619 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c5rjt" Jun 09 05:29:26.341093 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:26.340742 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s7jfk" podUID="d7f984ce-8d75-4a12-89e3-ff77731c2fb3" Jun 09 05:29:26.341093 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:26.340787 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c5rjt" podUID="0fe11a08-fb62-4c73-bbd8-f595316df872" Jun 09 05:29:26.341093 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:26.340850 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g2vt2" Jun 09 05:29:26.341093 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:26.340947 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g2vt2" podUID="73b6af10-58e6-4c5f-bcfc-083f82dfc9db" Jun 09 05:29:28.129594 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:28.129555 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0fe11a08-fb62-4c73-bbd8-f595316df872-original-pull-secret\") pod \"global-pull-secret-syncer-c5rjt\" (UID: \"0fe11a08-fb62-4c73-bbd8-f595316df872\") " pod="kube-system/global-pull-secret-syncer-c5rjt" Jun 09 05:29:28.130065 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:28.129606 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/73b6af10-58e6-4c5f-bcfc-083f82dfc9db-metrics-certs\") pod \"network-metrics-daemon-g2vt2\" (UID: \"73b6af10-58e6-4c5f-bcfc-083f82dfc9db\") " pod="openshift-multus/network-metrics-daemon-g2vt2" Jun 09 05:29:28.130065 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:28.129719 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 05:29:28.130065 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:28.129781 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73b6af10-58e6-4c5f-bcfc-083f82dfc9db-metrics-certs podName:73b6af10-58e6-4c5f-bcfc-083f82dfc9db nodeName:}" failed. No retries permitted until 2026-06-09 05:29:44.129764531 +0000 UTC m=+34.212416245 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/73b6af10-58e6-4c5f-bcfc-083f82dfc9db-metrics-certs") pod "network-metrics-daemon-g2vt2" (UID: "73b6af10-58e6-4c5f-bcfc-083f82dfc9db") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 05:29:28.130065 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:28.129719 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 05:29:28.130065 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:28.129889 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0fe11a08-fb62-4c73-bbd8-f595316df872-original-pull-secret podName:0fe11a08-fb62-4c73-bbd8-f595316df872 nodeName:}" failed. No retries permitted until 2026-06-09 05:29:44.129857935 +0000 UTC m=+34.212509665 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0fe11a08-fb62-4c73-bbd8-f595316df872-original-pull-secret") pod "global-pull-secret-syncer-c5rjt" (UID: "0fe11a08-fb62-4c73-bbd8-f595316df872") : object "kube-system"/"original-pull-secret" not registered Jun 09 05:29:28.230085 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:28.230048 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfrb6\" (UniqueName: \"kubernetes.io/projected/d7f984ce-8d75-4a12-89e3-ff77731c2fb3-kube-api-access-wfrb6\") pod \"network-check-target-s7jfk\" (UID: \"d7f984ce-8d75-4a12-89e3-ff77731c2fb3\") " pod="openshift-network-diagnostics/network-check-target-s7jfk" Jun 09 05:29:28.230236 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:28.230224 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 05:29:28.230284 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:28.230245 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 05:29:28.230284 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:28.230255 2564 projected.go:196] Error preparing data for projected volume kube-api-access-wfrb6 for pod openshift-network-diagnostics/network-check-target-s7jfk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 05:29:28.230340 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:28.230300 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d7f984ce-8d75-4a12-89e3-ff77731c2fb3-kube-api-access-wfrb6 podName:d7f984ce-8d75-4a12-89e3-ff77731c2fb3 nodeName:}" failed. No retries permitted until 2026-06-09 05:29:44.230285855 +0000 UTC m=+34.312937570 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-wfrb6" (UniqueName: "kubernetes.io/projected/d7f984ce-8d75-4a12-89e3-ff77731c2fb3-kube-api-access-wfrb6") pod "network-check-target-s7jfk" (UID: "d7f984ce-8d75-4a12-89e3-ff77731c2fb3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 05:29:28.340635 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:28.340571 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g2vt2" Jun 09 05:29:28.340635 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:28.340611 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s7jfk" Jun 09 05:29:28.340635 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:28.340619 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c5rjt" Jun 09 05:29:28.340930 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:28.340736 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g2vt2" podUID="73b6af10-58e6-4c5f-bcfc-083f82dfc9db" Jun 09 05:29:28.340930 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:28.340745 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c5rjt" podUID="0fe11a08-fb62-4c73-bbd8-f595316df872" Jun 09 05:29:28.340930 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:28.340810 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s7jfk" podUID="d7f984ce-8d75-4a12-89e3-ff77731c2fb3" Jun 09 05:29:30.341376 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:30.341345 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s7jfk" Jun 09 05:29:30.341863 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:30.341441 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c5rjt" Jun 09 05:29:30.341863 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:30.341450 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s7jfk" podUID="d7f984ce-8d75-4a12-89e3-ff77731c2fb3" Jun 09 05:29:30.341863 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:30.341550 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g2vt2" Jun 09 05:29:30.341863 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:30.341552 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c5rjt" podUID="0fe11a08-fb62-4c73-bbd8-f595316df872" Jun 09 05:29:30.341863 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:30.341624 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g2vt2" podUID="73b6af10-58e6-4c5f-bcfc-083f82dfc9db" Jun 09 05:29:32.341323 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:32.341211 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c5rjt" Jun 09 05:29:32.341961 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:32.341218 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g2vt2" Jun 09 05:29:32.341961 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:32.341396 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c5rjt" podUID="0fe11a08-fb62-4c73-bbd8-f595316df872" Jun 09 05:29:32.341961 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:32.341497 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g2vt2" podUID="73b6af10-58e6-4c5f-bcfc-083f82dfc9db" Jun 09 05:29:32.341961 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:32.341224 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s7jfk" Jun 09 05:29:32.341961 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:32.341562 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s7jfk" podUID="d7f984ce-8d75-4a12-89e3-ff77731c2fb3" Jun 09 05:29:32.449561 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:32.449532 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qr8vr" event={"ID":"1165c84b-2a43-44a3-9537-cd4fb2a25489","Type":"ContainerStarted","Data":"80e2785239336b34ee2d9e50cf0200e65e655a7f9105146d760d5b4b624ad90a"} Jun 09 05:29:32.450916 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:32.450895 2564 generic.go:356] "Generic (PLEG): container finished" podID="04cabc1f-f6d7-4aa2-a53e-06946b3655a7" containerID="aa30b6114d0dbddfa34ebd2e112ec2facfbe6f3e0dc6b5cfe5204bb77e6d919c" exitCode=0 Jun 09 05:29:32.451030 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:32.450981 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qmt9g" event={"ID":"04cabc1f-f6d7-4aa2-a53e-06946b3655a7","Type":"ContainerDied","Data":"aa30b6114d0dbddfa34ebd2e112ec2facfbe6f3e0dc6b5cfe5204bb77e6d919c"} Jun 09 05:29:32.452454 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:32.452433 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-n8vqj" event={"ID":"50e77e00-d2c2-45fa-9095-05a6d05a90e4","Type":"ContainerStarted","Data":"5ee6b6526fc73eefb012ad6ed6ee84f4aed83f0b7e555c7467b53e8520f9013b"} Jun 09 05:29:32.454281 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:32.454267 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-42h5b_02c37648-4419-4ff7-a316-568fa0510cee/ovn-acl-logging/0.log" Jun 09 05:29:32.454590 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:32.454573 2564 generic.go:356] "Generic (PLEG): container finished" podID="02c37648-4419-4ff7-a316-568fa0510cee" containerID="4f92cdc230e7a52506eeb0b04fd567e8611c16910120a98baa2ddaec43c246f7" exitCode=1 Jun 09 05:29:32.454660 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:32.454632 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-42h5b" event={"ID":"02c37648-4419-4ff7-a316-568fa0510cee","Type":"ContainerStarted","Data":"4794bf3aa30456abdf5b882ffc82454261d67b3788fd0ed442dcc91e1eaf5535"} Jun 09 05:29:32.454706 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:32.454679 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-42h5b" event={"ID":"02c37648-4419-4ff7-a316-568fa0510cee","Type":"ContainerDied","Data":"4f92cdc230e7a52506eeb0b04fd567e8611c16910120a98baa2ddaec43c246f7"} Jun 09 05:29:32.454786 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:32.454710 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-42h5b" event={"ID":"02c37648-4419-4ff7-a316-568fa0510cee","Type":"ContainerStarted","Data":"db7908b257921b544d64b12426be1dafcaeba268e8ebf3dd3690ca8684152602"} Jun 09 05:29:32.455910 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:32.455892 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zbjvr" event={"ID":"da2e480a-b5b6-44d9-a94c-0ad232ec311c","Type":"ContainerStarted","Data":"13a52de665cc6263950e2ca49cd393569544d12c71c07d7128136d67e6cb0989"} Jun 09 05:29:32.457312 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:32.457294 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7x4c6" event={"ID":"f0b74df6-4873-4f9c-b0f5-9dc2da97c37d","Type":"ContainerStarted","Data":"c84ce859edcd30a8993b47382adfe248640790e971e12c2abffc5b4475f25fec"} Jun 09 05:29:32.458728 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:32.458701 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5khgb" event={"ID":"c59113d3-15fe-4b55-b86e-fe821d85b2c6","Type":"ContainerStarted","Data":"97af19a7c2324676201b8af7b401650fee75ed9b6c9134b258383cc3acdfae1a"} Jun 09 05:29:32.460046 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:32.460019 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9crt8" event={"ID":"f96a0345-2a40-44d1-ac0f-61cd00d2036f","Type":"ContainerStarted","Data":"4cee466c723ba2a0eb436e5b0fc48ed98147922d8bd56c32566d8a2c0e0c218e"} Jun 09 05:29:32.462964 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:32.462915 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-qr8vr" podStartSLOduration=8.5086767 podStartE2EDuration="22.462898329s" totalImagesPullingTime="13.954221629s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 05:29:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 05:29:32.462243045 +0000 UTC m=+22.544894802" watchObservedRunningTime="2026-06-09 05:29:32.462898329 +0000 UTC m=+22.545550066" Jun 09 05:29:32.492947 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:32.492915 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-9crt8" podStartSLOduration=3.847965837 podStartE2EDuration="22.49290331s" totalImagesPullingTime="18.644937473s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 05:29:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 05:29:32.477394423 +0000 UTC m=+22.560046151" watchObservedRunningTime="2026-06-09 05:29:32.49290331 +0000 UTC m=+22.575555049" Jun 09 05:29:32.493016 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:32.492999 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-n8vqj" podStartSLOduration=3.852385746 podStartE2EDuration="22.49299584s" totalImagesPullingTime="18.640610094s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 05:29:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 05:29:32.492594519 +0000 UTC m=+22.575246257" watchObservedRunningTime="2026-06-09 05:29:32.49299584 +0000 UTC m=+22.575647573" Jun 09 05:29:32.507209 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:32.507177 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-7x4c6" podStartSLOduration=3.871203332 podStartE2EDuration="22.507166766s" totalImagesPullingTime="18.635963434s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 05:29:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 05:29:32.507106136 +0000 UTC m=+22.589757898" watchObservedRunningTime="2026-06-09 05:29:32.507166766 +0000 UTC m=+22.589818501" Jun 09 05:29:32.520446 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:32.520413 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-zbjvr" podStartSLOduration=3.9083505990000003 podStartE2EDuration="22.52040165s" totalImagesPullingTime="18.612051051s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 05:29:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 05:29:32.520076481 +0000 UTC m=+22.602728235" watchObservedRunningTime="2026-06-09 05:29:32.52040165 +0000 UTC m=+22.603053385" Jun 09 05:29:33.450885 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:33.450854 2564 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 09 05:29:33.464067 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:33.464020 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-crzck" event={"ID":"029a21cf-4c7d-4135-b327-7658b521553c","Type":"ContainerStarted","Data":"8a725add4173f9e90d76e2f1d9d1b5f0d5f59f863bdcda760a62f1ad67381203"} Jun 09 05:29:33.467155 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:33.467137 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-42h5b_02c37648-4419-4ff7-a316-568fa0510cee/ovn-acl-logging/0.log" Jun 09 05:29:33.467534 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:33.467514 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-42h5b" event={"ID":"02c37648-4419-4ff7-a316-568fa0510cee","Type":"ContainerStarted","Data":"59fffc0e55f0618a62fe7266f97a4262873a6b1516d0610c6d46d04de3c2f519"} Jun 09 05:29:33.467628 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:33.467615 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-42h5b" event={"ID":"02c37648-4419-4ff7-a316-568fa0510cee","Type":"ContainerStarted","Data":"1158219c864d5bf9a8d6687397d870f257560b44a578b9b2ec069c16104fe15c"} Jun 09 05:29:33.467681 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:33.467657 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-42h5b" event={"ID":"02c37648-4419-4ff7-a316-568fa0510cee","Type":"ContainerStarted","Data":"cf032cf96076037192d4057a1242e903030b7b87b4987374517ba952f2147a11"} Jun 09 05:29:33.469518 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:33.469483 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5khgb" event={"ID":"c59113d3-15fe-4b55-b86e-fe821d85b2c6","Type":"ContainerStarted","Data":"dbfe71008f4c0d45f9c0a0a314be7cba00ec44f97eedda6fe125917bfc5cf5a4"} Jun 09 05:29:33.476730 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:33.476696 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-crzck" podStartSLOduration=4.831686593 podStartE2EDuration="23.476683801s" totalImagesPullingTime="18.644997208s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 05:29:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 05:29:33.476420829 +0000 UTC m=+23.559072557" watchObservedRunningTime="2026-06-09 05:29:33.476683801 +0000 UTC m=+23.559335536" Jun 09 05:29:34.341422 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:34.341393 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s7jfk" Jun 09 05:29:34.341620 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:34.341403 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c5rjt" Jun 09 05:29:34.341620 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:34.341513 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s7jfk" podUID="d7f984ce-8d75-4a12-89e3-ff77731c2fb3" Jun 09 05:29:34.341762 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:34.341622 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c5rjt" podUID="0fe11a08-fb62-4c73-bbd8-f595316df872" Jun 09 05:29:34.341762 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:34.341690 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g2vt2" Jun 09 05:29:34.341887 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:34.341833 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g2vt2" podUID="73b6af10-58e6-4c5f-bcfc-083f82dfc9db" Jun 09 05:29:34.347585 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:34.347509 2564 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-09T05:29:33.450884923Z","UUID":"f0c3847e-e429-40b2-ac1a-e530581d95ee","Handler":null,"Name":"","Endpoint":""} Jun 09 05:29:34.348997 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:34.348980 2564 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 09 05:29:34.349092 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:34.349019 2564 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 09 05:29:34.473895 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:34.473862 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5khgb" event={"ID":"c59113d3-15fe-4b55-b86e-fe821d85b2c6","Type":"ContainerStarted","Data":"9b4ce4afe9d05609e90598132cd167d7cbdbaa49c512137fd9bd4ca6724379e0"} Jun 09 05:29:35.481713 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:35.481683 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-42h5b_02c37648-4419-4ff7-a316-568fa0510cee/ovn-acl-logging/0.log" Jun 09 05:29:35.482222 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:35.482130 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-42h5b" event={"ID":"02c37648-4419-4ff7-a316-568fa0510cee","Type":"ContainerStarted","Data":"35e6885021c2ff60a73bba0ec8dd5586a63d36ad1a0248a81ee12db150201a71"} Jun 09 05:29:35.949812 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:35.949768 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-qr8vr" Jun 09 05:29:35.950491 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:35.950466 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-qr8vr" Jun 09 05:29:35.963859 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:35.963812 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5khgb" podStartSLOduration=5.095748132 podStartE2EDuration="25.963782291s" totalImagesPullingTime="20.868034159s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 05:29:10 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 05:29:34.491478651 +0000 UTC m=+24.574130380" watchObservedRunningTime="2026-06-09 05:29:35.963782291 +0000 UTC m=+26.046434028" Jun 09 05:29:36.341218 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:36.341189 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c5rjt" Jun 09 05:29:36.341375 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:36.341195 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s7jfk" Jun 09 05:29:36.341375 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:36.341309 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c5rjt" podUID="0fe11a08-fb62-4c73-bbd8-f595316df872" Jun 09 05:29:36.341375 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:36.341318 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g2vt2" Jun 09 05:29:36.341510 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:36.341413 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s7jfk" podUID="d7f984ce-8d75-4a12-89e3-ff77731c2fb3" Jun 09 05:29:36.341566 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:36.341512 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g2vt2" podUID="73b6af10-58e6-4c5f-bcfc-083f82dfc9db" Jun 09 05:29:37.488561 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:37.488338 2564 generic.go:356] "Generic (PLEG): container finished" podID="04cabc1f-f6d7-4aa2-a53e-06946b3655a7" containerID="09a11b7fc32fc2f5e8994e4d49ad7bd7071b7b87980971c0224a7cc13b23ccab" exitCode=0 Jun 09 05:29:37.488561 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:37.488397 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qmt9g" event={"ID":"04cabc1f-f6d7-4aa2-a53e-06946b3655a7","Type":"ContainerDied","Data":"09a11b7fc32fc2f5e8994e4d49ad7bd7071b7b87980971c0224a7cc13b23ccab"} Jun 09 05:29:37.492275 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:37.492243 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-42h5b_02c37648-4419-4ff7-a316-568fa0510cee/ovn-acl-logging/0.log" Jun 09 05:29:37.492633 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:37.492608 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-42h5b" event={"ID":"02c37648-4419-4ff7-a316-568fa0510cee","Type":"ContainerStarted","Data":"4e93a12c2fb30dc252389d25d10da89fc0a8ecb042d50b39c54d300bebd71045"} Jun 09 05:29:37.492967 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:37.492941 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-42h5b" Jun 09 05:29:37.493051 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:37.493025 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-42h5b" Jun 09 05:29:37.493164 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:37.493147 2564 scope.go:117] "RemoveContainer" containerID="4f92cdc230e7a52506eeb0b04fd567e8611c16910120a98baa2ddaec43c246f7" Jun 09 05:29:37.509316 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:37.509294 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-42h5b" Jun 09 05:29:37.509732 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:37.509719 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-42h5b" Jun 09 05:29:38.340634 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:38.340599 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c5rjt" Jun 09 05:29:38.340634 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:38.340623 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g2vt2" Jun 09 05:29:38.340882 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:38.340599 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s7jfk" Jun 09 05:29:38.340882 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:38.340738 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c5rjt" podUID="0fe11a08-fb62-4c73-bbd8-f595316df872" Jun 09 05:29:38.340882 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:38.340849 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g2vt2" podUID="73b6af10-58e6-4c5f-bcfc-083f82dfc9db" Jun 09 05:29:38.341035 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:38.340882 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s7jfk" podUID="d7f984ce-8d75-4a12-89e3-ff77731c2fb3" Jun 09 05:29:38.498402 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:38.498369 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-42h5b_02c37648-4419-4ff7-a316-568fa0510cee/ovn-acl-logging/0.log" Jun 09 05:29:38.498830 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:38.498770 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-42h5b" event={"ID":"02c37648-4419-4ff7-a316-568fa0510cee","Type":"ContainerStarted","Data":"8aba754becc70083c2a809230391c93b124c5eb82f9c1cebc19e5a2fb55f4e31"} Jun 09 05:29:38.498883 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:38.498869 2564 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 09 05:29:38.552732 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:38.552685 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-42h5b" podStartSLOduration=9.840776023 podStartE2EDuration="28.55266556s" totalImagesPullingTime="18.711889537s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 05:29:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 05:29:38.552124523 +0000 UTC m=+28.634776259" watchObservedRunningTime="2026-06-09 05:29:38.55266556 +0000 UTC m=+28.635317297" Jun 09 05:29:38.579091 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:38.579060 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-qr8vr" Jun 09 05:29:38.579253 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:38.579226 2564 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 09 05:29:38.579845 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:38.579751 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-qr8vr" Jun 09 05:29:38.818009 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:38.817747 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-s7jfk"] Jun 09 05:29:38.818138 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:38.818102 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s7jfk" Jun 09 05:29:38.818228 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:38.818209 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s7jfk" podUID="d7f984ce-8d75-4a12-89e3-ff77731c2fb3" Jun 09 05:29:38.818499 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:38.818470 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-c5rjt"] Jun 09 05:29:38.818588 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:38.818553 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c5rjt" Jun 09 05:29:38.818656 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:38.818637 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c5rjt" podUID="0fe11a08-fb62-4c73-bbd8-f595316df872" Jun 09 05:29:38.820383 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:38.820358 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-g2vt2"] Jun 09 05:29:38.820482 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:38.820433 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g2vt2" Jun 09 05:29:38.820531 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:38.820507 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g2vt2" podUID="73b6af10-58e6-4c5f-bcfc-083f82dfc9db" Jun 09 05:29:39.503298 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:39.503199 2564 generic.go:356] "Generic (PLEG): container finished" podID="04cabc1f-f6d7-4aa2-a53e-06946b3655a7" containerID="ce30c5edfd81345dad8e28a02471ec3ad8a15f8783c782e98735fedf392777a5" exitCode=0 Jun 09 05:29:39.503298 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:39.503275 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qmt9g" event={"ID":"04cabc1f-f6d7-4aa2-a53e-06946b3655a7","Type":"ContainerDied","Data":"ce30c5edfd81345dad8e28a02471ec3ad8a15f8783c782e98735fedf392777a5"} Jun 09 05:29:39.503916 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:39.503513 2564 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 09 05:29:40.035380 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:40.035342 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-42h5b" Jun 09 05:29:40.341269 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:40.341247 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s7jfk" Jun 09 05:29:40.341402 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:40.341338 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c5rjt" Jun 09 05:29:40.341402 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:40.341347 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s7jfk" podUID="d7f984ce-8d75-4a12-89e3-ff77731c2fb3" Jun 09 05:29:40.341515 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:40.341441 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g2vt2" Jun 09 05:29:40.341515 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:40.341449 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c5rjt" podUID="0fe11a08-fb62-4c73-bbd8-f595316df872" Jun 09 05:29:40.341610 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:40.341536 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g2vt2" podUID="73b6af10-58e6-4c5f-bcfc-083f82dfc9db" Jun 09 05:29:40.507506 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:40.507476 2564 generic.go:356] "Generic (PLEG): container finished" podID="04cabc1f-f6d7-4aa2-a53e-06946b3655a7" containerID="f5b91b43d785ede6ba24e0a2622c419616edaddf02d06f946a5617fda5d77831" exitCode=0 Jun 09 05:29:40.507979 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:40.507562 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qmt9g" event={"ID":"04cabc1f-f6d7-4aa2-a53e-06946b3655a7","Type":"ContainerDied","Data":"f5b91b43d785ede6ba24e0a2622c419616edaddf02d06f946a5617fda5d77831"} Jun 09 05:29:42.340656 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:42.340623 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c5rjt" Jun 09 05:29:42.341287 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:42.340627 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s7jfk" Jun 09 05:29:42.341287 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:42.340751 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c5rjt" podUID="0fe11a08-fb62-4c73-bbd8-f595316df872" Jun 09 05:29:42.341287 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:42.340857 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s7jfk" podUID="d7f984ce-8d75-4a12-89e3-ff77731c2fb3" Jun 09 05:29:42.341287 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:42.340627 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g2vt2" Jun 09 05:29:42.341287 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:42.340950 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g2vt2" podUID="73b6af10-58e6-4c5f-bcfc-083f82dfc9db" Jun 09 05:29:44.157747 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:44.157706 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0fe11a08-fb62-4c73-bbd8-f595316df872-original-pull-secret\") pod \"global-pull-secret-syncer-c5rjt\" (UID: \"0fe11a08-fb62-4c73-bbd8-f595316df872\") " pod="kube-system/global-pull-secret-syncer-c5rjt" Jun 09 05:29:44.158327 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:44.157762 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/73b6af10-58e6-4c5f-bcfc-083f82dfc9db-metrics-certs\") pod \"network-metrics-daemon-g2vt2\" (UID: \"73b6af10-58e6-4c5f-bcfc-083f82dfc9db\") " pod="openshift-multus/network-metrics-daemon-g2vt2" Jun 09 05:29:44.158327 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:44.157897 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 05:29:44.158327 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:44.157973 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73b6af10-58e6-4c5f-bcfc-083f82dfc9db-metrics-certs podName:73b6af10-58e6-4c5f-bcfc-083f82dfc9db nodeName:}" failed. No retries permitted until 2026-06-09 05:30:16.157951285 +0000 UTC m=+66.240602998 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/73b6af10-58e6-4c5f-bcfc-083f82dfc9db-metrics-certs") pod "network-metrics-daemon-g2vt2" (UID: "73b6af10-58e6-4c5f-bcfc-083f82dfc9db") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 05:29:44.158327 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:44.157895 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 05:29:44.158327 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:44.158050 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0fe11a08-fb62-4c73-bbd8-f595316df872-original-pull-secret podName:0fe11a08-fb62-4c73-bbd8-f595316df872 nodeName:}" failed. No retries permitted until 2026-06-09 05:30:16.158032497 +0000 UTC m=+66.240684228 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0fe11a08-fb62-4c73-bbd8-f595316df872-original-pull-secret") pod "global-pull-secret-syncer-c5rjt" (UID: "0fe11a08-fb62-4c73-bbd8-f595316df872") : object "kube-system"/"original-pull-secret" not registered Jun 09 05:29:44.258488 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:44.258447 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfrb6\" (UniqueName: \"kubernetes.io/projected/d7f984ce-8d75-4a12-89e3-ff77731c2fb3-kube-api-access-wfrb6\") pod \"network-check-target-s7jfk\" (UID: \"d7f984ce-8d75-4a12-89e3-ff77731c2fb3\") " pod="openshift-network-diagnostics/network-check-target-s7jfk" Jun 09 05:29:44.258661 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:44.258606 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 05:29:44.258661 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:44.258632 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 05:29:44.258661 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:44.258645 2564 projected.go:196] Error preparing data for projected volume kube-api-access-wfrb6 for pod openshift-network-diagnostics/network-check-target-s7jfk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 05:29:44.258774 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:44.258710 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d7f984ce-8d75-4a12-89e3-ff77731c2fb3-kube-api-access-wfrb6 podName:d7f984ce-8d75-4a12-89e3-ff77731c2fb3 nodeName:}" failed. No retries permitted until 2026-06-09 05:30:16.25869081 +0000 UTC m=+66.341342540 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-wfrb6" (UniqueName: "kubernetes.io/projected/d7f984ce-8d75-4a12-89e3-ff77731c2fb3-kube-api-access-wfrb6") pod "network-check-target-s7jfk" (UID: "d7f984ce-8d75-4a12-89e3-ff77731c2fb3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 05:29:44.340642 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:44.340610 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s7jfk" Jun 09 05:29:44.340642 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:44.340643 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g2vt2" Jun 09 05:29:44.340907 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:44.340610 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c5rjt" Jun 09 05:29:44.340907 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:44.340753 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s7jfk" podUID="d7f984ce-8d75-4a12-89e3-ff77731c2fb3" Jun 09 05:29:44.340907 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:44.340822 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c5rjt" podUID="0fe11a08-fb62-4c73-bbd8-f595316df872" Jun 09 05:29:44.341041 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:44.340915 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g2vt2" podUID="73b6af10-58e6-4c5f-bcfc-083f82dfc9db" Jun 09 05:29:44.719580 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:44.719393 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-106.ec2.internal" event="NodeReady" Jun 09 05:29:44.719769 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:44.719684 2564 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 09 05:29:44.758543 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:44.758519 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-xv6r9"] Jun 09 05:29:44.776240 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:44.776216 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-kvqjb"] Jun 09 05:29:44.776352 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:44.776334 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xv6r9" Jun 09 05:29:44.780849 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:44.780823 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 09 05:29:44.780971 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:44.780859 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 09 05:29:44.780971 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:44.780866 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ww7k9\"" Jun 09 05:29:44.792343 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:44.792323 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xv6r9"] Jun 09 05:29:44.792434 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:44.792356 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kvqjb"] Jun 09 05:29:44.792434 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:44.792421 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kvqjb" Jun 09 05:29:44.794476 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:44.794455 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 09 05:29:44.794476 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:44.794467 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 09 05:29:44.794739 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:44.794725 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-n9hnl\"" Jun 09 05:29:44.794859 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:44.794842 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 09 05:29:44.863698 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:44.863663 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/516d15e3-b193-4355-8f8d-991da86b5526-tmp-dir\") pod \"dns-default-xv6r9\" (UID: \"516d15e3-b193-4355-8f8d-991da86b5526\") " pod="openshift-dns/dns-default-xv6r9" Jun 09 05:29:44.863698 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:44.863702 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/516d15e3-b193-4355-8f8d-991da86b5526-metrics-tls\") pod \"dns-default-xv6r9\" (UID: \"516d15e3-b193-4355-8f8d-991da86b5526\") " pod="openshift-dns/dns-default-xv6r9" Jun 09 05:29:44.863933 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:44.863723 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4rvs\" (UniqueName: \"kubernetes.io/projected/516d15e3-b193-4355-8f8d-991da86b5526-kube-api-access-w4rvs\") pod \"dns-default-xv6r9\" (UID: \"516d15e3-b193-4355-8f8d-991da86b5526\") " pod="openshift-dns/dns-default-xv6r9" Jun 09 05:29:44.863933 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:44.863781 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/516d15e3-b193-4355-8f8d-991da86b5526-config-volume\") pod \"dns-default-xv6r9\" (UID: \"516d15e3-b193-4355-8f8d-991da86b5526\") " pod="openshift-dns/dns-default-xv6r9" Jun 09 05:29:44.965112 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:44.965024 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6brzk\" (UniqueName: \"kubernetes.io/projected/b6726283-2599-497d-a285-634461e11061-kube-api-access-6brzk\") pod \"ingress-canary-kvqjb\" (UID: \"b6726283-2599-497d-a285-634461e11061\") " pod="openshift-ingress-canary/ingress-canary-kvqjb" Jun 09 05:29:44.965112 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:44.965069 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/516d15e3-b193-4355-8f8d-991da86b5526-tmp-dir\") pod \"dns-default-xv6r9\" (UID: \"516d15e3-b193-4355-8f8d-991da86b5526\") " pod="openshift-dns/dns-default-xv6r9" Jun 09 05:29:44.965306 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:44.965124 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/516d15e3-b193-4355-8f8d-991da86b5526-metrics-tls\") pod \"dns-default-xv6r9\" (UID: \"516d15e3-b193-4355-8f8d-991da86b5526\") " pod="openshift-dns/dns-default-xv6r9" Jun 09 05:29:44.965306 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:44.965160 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4rvs\" (UniqueName: \"kubernetes.io/projected/516d15e3-b193-4355-8f8d-991da86b5526-kube-api-access-w4rvs\") pod \"dns-default-xv6r9\" (UID: \"516d15e3-b193-4355-8f8d-991da86b5526\") " pod="openshift-dns/dns-default-xv6r9" Jun 09 05:29:44.965306 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:44.965187 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/516d15e3-b193-4355-8f8d-991da86b5526-config-volume\") pod \"dns-default-xv6r9\" (UID: \"516d15e3-b193-4355-8f8d-991da86b5526\") " pod="openshift-dns/dns-default-xv6r9" Jun 09 05:29:44.965306 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:44.965206 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b6726283-2599-497d-a285-634461e11061-cert\") pod \"ingress-canary-kvqjb\" (UID: \"b6726283-2599-497d-a285-634461e11061\") " pod="openshift-ingress-canary/ingress-canary-kvqjb" Jun 09 05:29:44.965526 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:44.965323 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 05:29:44.965526 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:44.965399 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/516d15e3-b193-4355-8f8d-991da86b5526-tmp-dir\") pod \"dns-default-xv6r9\" (UID: \"516d15e3-b193-4355-8f8d-991da86b5526\") " pod="openshift-dns/dns-default-xv6r9" Jun 09 05:29:44.965526 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:44.965407 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/516d15e3-b193-4355-8f8d-991da86b5526-metrics-tls podName:516d15e3-b193-4355-8f8d-991da86b5526 nodeName:}" failed. No retries permitted until 2026-06-09 05:29:45.465387379 +0000 UTC m=+35.548039092 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/516d15e3-b193-4355-8f8d-991da86b5526-metrics-tls") pod "dns-default-xv6r9" (UID: "516d15e3-b193-4355-8f8d-991da86b5526") : secret "dns-default-metrics-tls" not found Jun 09 05:29:44.965829 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:44.965781 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/516d15e3-b193-4355-8f8d-991da86b5526-config-volume\") pod \"dns-default-xv6r9\" (UID: \"516d15e3-b193-4355-8f8d-991da86b5526\") " pod="openshift-dns/dns-default-xv6r9" Jun 09 05:29:44.974328 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:44.974311 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4rvs\" (UniqueName: \"kubernetes.io/projected/516d15e3-b193-4355-8f8d-991da86b5526-kube-api-access-w4rvs\") pod \"dns-default-xv6r9\" (UID: \"516d15e3-b193-4355-8f8d-991da86b5526\") " pod="openshift-dns/dns-default-xv6r9" Jun 09 05:29:45.066494 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:45.066461 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b6726283-2599-497d-a285-634461e11061-cert\") pod \"ingress-canary-kvqjb\" (UID: \"b6726283-2599-497d-a285-634461e11061\") " pod="openshift-ingress-canary/ingress-canary-kvqjb" Jun 09 05:29:45.066659 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:45.066536 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6brzk\" (UniqueName: \"kubernetes.io/projected/b6726283-2599-497d-a285-634461e11061-kube-api-access-6brzk\") pod \"ingress-canary-kvqjb\" (UID: \"b6726283-2599-497d-a285-634461e11061\") " pod="openshift-ingress-canary/ingress-canary-kvqjb" Jun 09 05:29:45.068892 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:45.068865 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b6726283-2599-497d-a285-634461e11061-cert\") pod \"ingress-canary-kvqjb\" (UID: \"b6726283-2599-497d-a285-634461e11061\") " pod="openshift-ingress-canary/ingress-canary-kvqjb" Jun 09 05:29:45.073427 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:45.073406 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6brzk\" (UniqueName: \"kubernetes.io/projected/b6726283-2599-497d-a285-634461e11061-kube-api-access-6brzk\") pod \"ingress-canary-kvqjb\" (UID: \"b6726283-2599-497d-a285-634461e11061\") " pod="openshift-ingress-canary/ingress-canary-kvqjb" Jun 09 05:29:45.117036 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:45.117010 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kvqjb" Jun 09 05:29:45.296269 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:45.296233 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kvqjb"] Jun 09 05:29:45.300151 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:29:45.300127 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6726283_2599_497d_a285_634461e11061.slice/crio-6c86f7ec802c4bf0c0dd589c9e3dbe476172f829a441ca5296c141eedf3f7cef WatchSource:0}: Error finding container 6c86f7ec802c4bf0c0dd589c9e3dbe476172f829a441ca5296c141eedf3f7cef: Status 404 returned error can't find the container with id 6c86f7ec802c4bf0c0dd589c9e3dbe476172f829a441ca5296c141eedf3f7cef Jun 09 05:29:45.468988 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:45.468951 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/516d15e3-b193-4355-8f8d-991da86b5526-metrics-tls\") pod \"dns-default-xv6r9\" (UID: \"516d15e3-b193-4355-8f8d-991da86b5526\") " pod="openshift-dns/dns-default-xv6r9" Jun 09 05:29:45.469168 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:45.469105 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 05:29:45.469213 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:45.469192 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/516d15e3-b193-4355-8f8d-991da86b5526-metrics-tls podName:516d15e3-b193-4355-8f8d-991da86b5526 nodeName:}" failed. No retries permitted until 2026-06-09 05:29:46.469151687 +0000 UTC m=+36.551803404 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/516d15e3-b193-4355-8f8d-991da86b5526-metrics-tls") pod "dns-default-xv6r9" (UID: "516d15e3-b193-4355-8f8d-991da86b5526") : secret "dns-default-metrics-tls" not found Jun 09 05:29:45.520337 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:45.520304 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kvqjb" event={"ID":"b6726283-2599-497d-a285-634461e11061","Type":"ContainerStarted","Data":"6c86f7ec802c4bf0c0dd589c9e3dbe476172f829a441ca5296c141eedf3f7cef"} Jun 09 05:29:45.522885 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:45.522855 2564 generic.go:356] "Generic (PLEG): container finished" podID="04cabc1f-f6d7-4aa2-a53e-06946b3655a7" containerID="6312bb83b4e1c72828400e5a226fba24de30962f7bdfec36df80f6266a1c3702" exitCode=0 Jun 09 05:29:45.522885 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:45.522886 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qmt9g" event={"ID":"04cabc1f-f6d7-4aa2-a53e-06946b3655a7","Type":"ContainerDied","Data":"6312bb83b4e1c72828400e5a226fba24de30962f7bdfec36df80f6266a1c3702"} Jun 09 05:29:46.340380 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:46.340349 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c5rjt" Jun 09 05:29:46.340840 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:46.340356 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s7jfk" Jun 09 05:29:46.340840 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:46.340457 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g2vt2" Jun 09 05:29:46.343188 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:46.343168 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 05:29:46.344079 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:46.344049 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 05:29:46.344079 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:46.344067 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tg4g2\"" Jun 09 05:29:46.344079 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:46.344077 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vlvww\"" Jun 09 05:29:46.344293 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:46.344111 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 05:29:46.344388 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:46.344371 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 05:29:46.476806 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:46.476756 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/516d15e3-b193-4355-8f8d-991da86b5526-metrics-tls\") pod \"dns-default-xv6r9\" (UID: \"516d15e3-b193-4355-8f8d-991da86b5526\") " pod="openshift-dns/dns-default-xv6r9" Jun 09 05:29:46.476994 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:46.476921 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 05:29:46.476994 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:46.476985 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/516d15e3-b193-4355-8f8d-991da86b5526-metrics-tls podName:516d15e3-b193-4355-8f8d-991da86b5526 nodeName:}" failed. No retries permitted until 2026-06-09 05:29:48.476968142 +0000 UTC m=+38.559619873 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/516d15e3-b193-4355-8f8d-991da86b5526-metrics-tls") pod "dns-default-xv6r9" (UID: "516d15e3-b193-4355-8f8d-991da86b5526") : secret "dns-default-metrics-tls" not found Jun 09 05:29:46.529085 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:46.529052 2564 generic.go:356] "Generic (PLEG): container finished" podID="04cabc1f-f6d7-4aa2-a53e-06946b3655a7" containerID="7d1043b551b93d6fd3548af78c47281c324a4123ce024473f35a72009ebac1fc" exitCode=0 Jun 09 05:29:46.529240 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:46.529090 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qmt9g" event={"ID":"04cabc1f-f6d7-4aa2-a53e-06946b3655a7","Type":"ContainerDied","Data":"7d1043b551b93d6fd3548af78c47281c324a4123ce024473f35a72009ebac1fc"} Jun 09 05:29:47.534463 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:47.534295 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qmt9g" event={"ID":"04cabc1f-f6d7-4aa2-a53e-06946b3655a7","Type":"ContainerStarted","Data":"1d0b1c367b34f28d12efa5377e29f3b6a46cd402d2b18b1fcd5d3310e21b14c5"} Jun 09 05:29:47.535745 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:47.535720 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kvqjb" event={"ID":"b6726283-2599-497d-a285-634461e11061","Type":"ContainerStarted","Data":"6ad7c8354b44afb59c6278e284c2aa8b9da4ced6b1797c44b9ed62cbe7c35ea3"} Jun 09 05:29:47.556603 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:47.556563 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-qmt9g" podStartSLOduration=8.411768014 podStartE2EDuration="37.556549963s" totalImagesPullingTime="29.144781949s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 05:29:10 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 05:29:47.55534567 +0000 UTC m=+37.637997407" watchObservedRunningTime="2026-06-09 05:29:47.556549963 +0000 UTC m=+37.639201723" Jun 09 05:29:47.569216 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:47.569169 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-kvqjb" podStartSLOduration=2.005860778 podStartE2EDuration="3.569154692s" totalImagesPullingTime="1.563293914s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 05:29:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 05:29:47.5683175 +0000 UTC m=+37.650969247" watchObservedRunningTime="2026-06-09 05:29:47.569154692 +0000 UTC m=+37.651806427" Jun 09 05:29:48.492218 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:48.492157 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/516d15e3-b193-4355-8f8d-991da86b5526-metrics-tls\") pod \"dns-default-xv6r9\" (UID: \"516d15e3-b193-4355-8f8d-991da86b5526\") " pod="openshift-dns/dns-default-xv6r9" Jun 09 05:29:48.492380 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:48.492315 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 05:29:48.492418 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:48.492386 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/516d15e3-b193-4355-8f8d-991da86b5526-metrics-tls podName:516d15e3-b193-4355-8f8d-991da86b5526 nodeName:}" failed. No retries permitted until 2026-06-09 05:29:52.492368831 +0000 UTC m=+42.575020566 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/516d15e3-b193-4355-8f8d-991da86b5526-metrics-tls") pod "dns-default-xv6r9" (UID: "516d15e3-b193-4355-8f8d-991da86b5526") : secret "dns-default-metrics-tls" not found Jun 09 05:29:52.515333 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:29:52.515302 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/516d15e3-b193-4355-8f8d-991da86b5526-metrics-tls\") pod \"dns-default-xv6r9\" (UID: \"516d15e3-b193-4355-8f8d-991da86b5526\") " pod="openshift-dns/dns-default-xv6r9" Jun 09 05:29:52.515836 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:52.515410 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 05:29:52.515836 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:29:52.515456 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/516d15e3-b193-4355-8f8d-991da86b5526-metrics-tls podName:516d15e3-b193-4355-8f8d-991da86b5526 nodeName:}" failed. No retries permitted until 2026-06-09 05:30:00.515442501 +0000 UTC m=+50.598094218 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/516d15e3-b193-4355-8f8d-991da86b5526-metrics-tls") pod "dns-default-xv6r9" (UID: "516d15e3-b193-4355-8f8d-991da86b5526") : secret "dns-default-metrics-tls" not found Jun 09 05:30:00.565343 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:30:00.565308 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/516d15e3-b193-4355-8f8d-991da86b5526-metrics-tls\") pod \"dns-default-xv6r9\" (UID: \"516d15e3-b193-4355-8f8d-991da86b5526\") " pod="openshift-dns/dns-default-xv6r9" Jun 09 05:30:00.565817 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:30:00.565447 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 05:30:00.565817 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:30:00.565502 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/516d15e3-b193-4355-8f8d-991da86b5526-metrics-tls podName:516d15e3-b193-4355-8f8d-991da86b5526 nodeName:}" failed. No retries permitted until 2026-06-09 05:30:16.565485418 +0000 UTC m=+66.648137131 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/516d15e3-b193-4355-8f8d-991da86b5526-metrics-tls") pod "dns-default-xv6r9" (UID: "516d15e3-b193-4355-8f8d-991da86b5526") : secret "dns-default-metrics-tls" not found Jun 09 05:30:05.937310 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:30:05.937280 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-cd4db94dd-2dsgm"] Jun 09 05:30:05.982511 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:30:05.982483 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-cd4db94dd-2dsgm"] Jun 09 05:30:05.982640 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:30:05.982566 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-cd4db94dd-2dsgm" Jun 09 05:30:05.985786 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:30:05.985761 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 09 05:30:05.985923 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:30:05.985842 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-2vhgr\"" Jun 09 05:30:05.985923 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:30:05.985873 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 09 05:30:05.986036 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:30:05.985926 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 09 05:30:05.986036 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:30:05.985999 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 09 05:30:06.102886 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:30:06.102857 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khvvd\" (UniqueName: \"kubernetes.io/projected/4c809885-3db6-43cf-8cb7-b6e0ce7f0ae8-kube-api-access-khvvd\") pod \"managed-serviceaccount-addon-agent-cd4db94dd-2dsgm\" (UID: \"4c809885-3db6-43cf-8cb7-b6e0ce7f0ae8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-cd4db94dd-2dsgm" Jun 09 05:30:06.103016 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:30:06.102890 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4c809885-3db6-43cf-8cb7-b6e0ce7f0ae8-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-cd4db94dd-2dsgm\" (UID: \"4c809885-3db6-43cf-8cb7-b6e0ce7f0ae8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-cd4db94dd-2dsgm" Jun 09 05:30:06.203553 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:30:06.203489 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4c809885-3db6-43cf-8cb7-b6e0ce7f0ae8-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-cd4db94dd-2dsgm\" (UID: \"4c809885-3db6-43cf-8cb7-b6e0ce7f0ae8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-cd4db94dd-2dsgm" Jun 09 05:30:06.203652 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:30:06.203574 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khvvd\" (UniqueName: \"kubernetes.io/projected/4c809885-3db6-43cf-8cb7-b6e0ce7f0ae8-kube-api-access-khvvd\") pod \"managed-serviceaccount-addon-agent-cd4db94dd-2dsgm\" (UID: \"4c809885-3db6-43cf-8cb7-b6e0ce7f0ae8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-cd4db94dd-2dsgm" Jun 09 05:30:06.207139 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:30:06.207112 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4c809885-3db6-43cf-8cb7-b6e0ce7f0ae8-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-cd4db94dd-2dsgm\" (UID: \"4c809885-3db6-43cf-8cb7-b6e0ce7f0ae8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-cd4db94dd-2dsgm" Jun 09 05:30:06.211063 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:30:06.211031 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-khvvd\" (UniqueName: \"kubernetes.io/projected/4c809885-3db6-43cf-8cb7-b6e0ce7f0ae8-kube-api-access-khvvd\") pod \"managed-serviceaccount-addon-agent-cd4db94dd-2dsgm\" (UID: \"4c809885-3db6-43cf-8cb7-b6e0ce7f0ae8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-cd4db94dd-2dsgm" Jun 09 05:30:06.300053 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:30:06.300031 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-cd4db94dd-2dsgm" Jun 09 05:30:06.434708 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:30:06.434678 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-cd4db94dd-2dsgm"] Jun 09 05:30:06.438238 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:30:06.438210 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4c809885_3db6_43cf_8cb7_b6e0ce7f0ae8.slice/crio-4784b2828552b1bb362ff9f2d2be7fd251ab0ef928cf4f968eb476fb5b2bac40 WatchSource:0}: Error finding container 4784b2828552b1bb362ff9f2d2be7fd251ab0ef928cf4f968eb476fb5b2bac40: Status 404 returned error can't find the container with id 4784b2828552b1bb362ff9f2d2be7fd251ab0ef928cf4f968eb476fb5b2bac40 Jun 09 05:30:06.577716 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:30:06.577686 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-cd4db94dd-2dsgm" event={"ID":"4c809885-3db6-43cf-8cb7-b6e0ce7f0ae8","Type":"ContainerStarted","Data":"4784b2828552b1bb362ff9f2d2be7fd251ab0ef928cf4f968eb476fb5b2bac40"} Jun 09 05:30:10.518201 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:30:10.518174 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-42h5b" Jun 09 05:30:10.589123 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:30:10.589081 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-cd4db94dd-2dsgm" event={"ID":"4c809885-3db6-43cf-8cb7-b6e0ce7f0ae8","Type":"ContainerStarted","Data":"dc3ce1c1e5d32e3d549fa6aab0c971de3f283e3a2b58266b4fe8be60cb6eb863"} Jun 09 05:30:10.603097 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:30:10.603044 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-cd4db94dd-2dsgm" podStartSLOduration=2.0135524 podStartE2EDuration="5.603020281s" totalImagesPullingTime="3.589467881s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 05:30:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 05:30:10.602627564 +0000 UTC m=+60.685279301" watchObservedRunningTime="2026-06-09 05:30:10.603020281 +0000 UTC m=+60.685672018" Jun 09 05:30:16.180497 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:30:16.180461 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/73b6af10-58e6-4c5f-bcfc-083f82dfc9db-metrics-certs\") pod \"network-metrics-daemon-g2vt2\" (UID: \"73b6af10-58e6-4c5f-bcfc-083f82dfc9db\") " pod="openshift-multus/network-metrics-daemon-g2vt2" Jun 09 05:30:16.180963 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:30:16.180527 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0fe11a08-fb62-4c73-bbd8-f595316df872-original-pull-secret\") pod \"global-pull-secret-syncer-c5rjt\" (UID: \"0fe11a08-fb62-4c73-bbd8-f595316df872\") " pod="kube-system/global-pull-secret-syncer-c5rjt" Jun 09 05:30:16.183227 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:30:16.183205 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 05:30:16.183322 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:30:16.183217 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 05:30:16.191400 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:30:16.191372 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 05:30:16.191527 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:30:16.191448 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73b6af10-58e6-4c5f-bcfc-083f82dfc9db-metrics-certs podName:73b6af10-58e6-4c5f-bcfc-083f82dfc9db nodeName:}" failed. No retries permitted until 2026-06-09 05:31:20.191430967 +0000 UTC m=+130.274082694 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/73b6af10-58e6-4c5f-bcfc-083f82dfc9db-metrics-certs") pod "network-metrics-daemon-g2vt2" (UID: "73b6af10-58e6-4c5f-bcfc-083f82dfc9db") : secret "metrics-daemon-secret" not found Jun 09 05:30:16.193716 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:30:16.193699 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0fe11a08-fb62-4c73-bbd8-f595316df872-original-pull-secret\") pod \"global-pull-secret-syncer-c5rjt\" (UID: \"0fe11a08-fb62-4c73-bbd8-f595316df872\") " pod="kube-system/global-pull-secret-syncer-c5rjt" Jun 09 05:30:16.281871 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:30:16.281832 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfrb6\" (UniqueName: \"kubernetes.io/projected/d7f984ce-8d75-4a12-89e3-ff77731c2fb3-kube-api-access-wfrb6\") pod \"network-check-target-s7jfk\" (UID: \"d7f984ce-8d75-4a12-89e3-ff77731c2fb3\") " pod="openshift-network-diagnostics/network-check-target-s7jfk" Jun 09 05:30:16.284410 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:30:16.284391 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 05:30:16.294160 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:30:16.294131 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 05:30:16.304861 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:30:16.304836 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfrb6\" (UniqueName: \"kubernetes.io/projected/d7f984ce-8d75-4a12-89e3-ff77731c2fb3-kube-api-access-wfrb6\") pod \"network-check-target-s7jfk\" (UID: \"d7f984ce-8d75-4a12-89e3-ff77731c2fb3\") " pod="openshift-network-diagnostics/network-check-target-s7jfk" Jun 09 05:30:16.351832 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:30:16.351790 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c5rjt" Jun 09 05:30:16.360123 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:30:16.360100 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vlvww\"" Jun 09 05:30:16.368067 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:30:16.368030 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s7jfk" Jun 09 05:30:16.503478 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:30:16.503078 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-c5rjt"] Jun 09 05:30:16.509520 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:30:16.509495 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fe11a08_fb62_4c73_bbd8_f595316df872.slice/crio-c7a6c4591fbf0f0a64b25b82d5dc26eee1c7b3decec430908682929bef57c4d5 WatchSource:0}: Error finding container c7a6c4591fbf0f0a64b25b82d5dc26eee1c7b3decec430908682929bef57c4d5: Status 404 returned error can't find the container with id c7a6c4591fbf0f0a64b25b82d5dc26eee1c7b3decec430908682929bef57c4d5 Jun 09 05:30:16.521711 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:30:16.521686 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-s7jfk"] Jun 09 05:30:16.524674 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:30:16.524651 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7f984ce_8d75_4a12_89e3_ff77731c2fb3.slice/crio-576274d7a7ddbe5e803ed62b8a5a738f349cac43cfcb60034d579ed0387cc2d7 WatchSource:0}: Error finding container 576274d7a7ddbe5e803ed62b8a5a738f349cac43cfcb60034d579ed0387cc2d7: Status 404 returned error can't find the container with id 576274d7a7ddbe5e803ed62b8a5a738f349cac43cfcb60034d579ed0387cc2d7 Jun 09 05:30:16.584140 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:30:16.584099 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/516d15e3-b193-4355-8f8d-991da86b5526-metrics-tls\") pod \"dns-default-xv6r9\" (UID: \"516d15e3-b193-4355-8f8d-991da86b5526\") " pod="openshift-dns/dns-default-xv6r9" Jun 09 05:30:16.584304 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:30:16.584246 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 05:30:16.584304 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:30:16.584303 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/516d15e3-b193-4355-8f8d-991da86b5526-metrics-tls podName:516d15e3-b193-4355-8f8d-991da86b5526 nodeName:}" failed. No retries permitted until 2026-06-09 05:30:48.584286873 +0000 UTC m=+98.666938590 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/516d15e3-b193-4355-8f8d-991da86b5526-metrics-tls") pod "dns-default-xv6r9" (UID: "516d15e3-b193-4355-8f8d-991da86b5526") : secret "dns-default-metrics-tls" not found Jun 09 05:30:16.603313 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:30:16.603278 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-c5rjt" event={"ID":"0fe11a08-fb62-4c73-bbd8-f595316df872","Type":"ContainerStarted","Data":"c7a6c4591fbf0f0a64b25b82d5dc26eee1c7b3decec430908682929bef57c4d5"} Jun 09 05:30:16.604227 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:30:16.604207 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-s7jfk" event={"ID":"d7f984ce-8d75-4a12-89e3-ff77731c2fb3","Type":"ContainerStarted","Data":"576274d7a7ddbe5e803ed62b8a5a738f349cac43cfcb60034d579ed0387cc2d7"} Jun 09 05:30:19.614708 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:30:19.614665 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-s7jfk" event={"ID":"d7f984ce-8d75-4a12-89e3-ff77731c2fb3","Type":"ContainerStarted","Data":"a278d6a2a1e83a2a18c7d7414b81349278c267ce4f1b8657370ed3f4bc737c11"} Jun 09 05:30:19.615191 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:30:19.614827 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-s7jfk" Jun 09 05:30:19.633828 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:30:19.633751 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-s7jfk" podStartSLOduration=66.759560091 podStartE2EDuration="1m9.633730677s" totalImagesPullingTime="2.874170586s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 05:29:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 05:30:19.631980975 +0000 UTC m=+69.714632712" watchObservedRunningTime="2026-06-09 05:30:19.633730677 +0000 UTC m=+69.716382414" Jun 09 05:30:21.620513 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:30:21.620472 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-c5rjt" event={"ID":"0fe11a08-fb62-4c73-bbd8-f595316df872","Type":"ContainerStarted","Data":"4ea68c47dd9fc48b78f30f9ca2e6cb7fcc3ffd86a673f2e4ac3559dba054a4d3"} Jun 09 05:30:21.635010 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:30:21.634961 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-c5rjt" podStartSLOduration=67.215749548 podStartE2EDuration="1m11.634945649s" totalImagesPullingTime="4.419196101s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 05:29:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 05:30:21.633879925 +0000 UTC m=+71.716531676" watchObservedRunningTime="2026-06-09 05:30:21.634945649 +0000 UTC m=+71.717597385" Jun 09 05:30:48.607301 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:30:48.607269 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/516d15e3-b193-4355-8f8d-991da86b5526-metrics-tls\") pod \"dns-default-xv6r9\" (UID: \"516d15e3-b193-4355-8f8d-991da86b5526\") " pod="openshift-dns/dns-default-xv6r9" Jun 09 05:30:48.607712 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:30:48.607380 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 05:30:48.607712 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:30:48.607445 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/516d15e3-b193-4355-8f8d-991da86b5526-metrics-tls podName:516d15e3-b193-4355-8f8d-991da86b5526 nodeName:}" failed. No retries permitted until 2026-06-09 05:31:52.607428463 +0000 UTC m=+162.690080193 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/516d15e3-b193-4355-8f8d-991da86b5526-metrics-tls") pod "dns-default-xv6r9" (UID: "516d15e3-b193-4355-8f8d-991da86b5526") : secret "dns-default-metrics-tls" not found Jun 09 05:30:50.620349 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:30:50.620319 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-s7jfk" Jun 09 05:31:20.222048 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:31:20.222005 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/73b6af10-58e6-4c5f-bcfc-083f82dfc9db-metrics-certs\") pod \"network-metrics-daemon-g2vt2\" (UID: \"73b6af10-58e6-4c5f-bcfc-083f82dfc9db\") " pod="openshift-multus/network-metrics-daemon-g2vt2" Jun 09 05:31:20.222534 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:31:20.222142 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 05:31:20.222534 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:31:20.222206 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73b6af10-58e6-4c5f-bcfc-083f82dfc9db-metrics-certs podName:73b6af10-58e6-4c5f-bcfc-083f82dfc9db nodeName:}" failed. No retries permitted until 2026-06-09 05:33:22.222191023 +0000 UTC m=+252.304842737 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/73b6af10-58e6-4c5f-bcfc-083f82dfc9db-metrics-certs") pod "network-metrics-daemon-g2vt2" (UID: "73b6af10-58e6-4c5f-bcfc-083f82dfc9db") : secret "metrics-daemon-secret" not found Jun 09 05:31:47.812877 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:31:47.812841 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-xv6r9" podUID="516d15e3-b193-4355-8f8d-991da86b5526" Jun 09 05:31:47.821691 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:31:47.821667 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xv6r9" Jun 09 05:31:49.362292 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:31:49.362261 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-g2vt2" podUID="73b6af10-58e6-4c5f-bcfc-083f82dfc9db" Jun 09 05:31:52.625748 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:31:52.625705 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/516d15e3-b193-4355-8f8d-991da86b5526-metrics-tls\") pod \"dns-default-xv6r9\" (UID: \"516d15e3-b193-4355-8f8d-991da86b5526\") " pod="openshift-dns/dns-default-xv6r9" Jun 09 05:31:52.626231 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:31:52.625840 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 05:31:52.626231 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:31:52.625944 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/516d15e3-b193-4355-8f8d-991da86b5526-metrics-tls podName:516d15e3-b193-4355-8f8d-991da86b5526 nodeName:}" failed. No retries permitted until 2026-06-09 05:33:54.625923465 +0000 UTC m=+284.708575195 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/516d15e3-b193-4355-8f8d-991da86b5526-metrics-tls") pod "dns-default-xv6r9" (UID: "516d15e3-b193-4355-8f8d-991da86b5526") : secret "dns-default-metrics-tls" not found Jun 09 05:32:04.340641 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:04.340610 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g2vt2" Jun 09 05:32:10.878432 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:10.878393 2564 generic.go:356] "Generic (PLEG): container finished" podID="4c809885-3db6-43cf-8cb7-b6e0ce7f0ae8" containerID="dc3ce1c1e5d32e3d549fa6aab0c971de3f283e3a2b58266b4fe8be60cb6eb863" exitCode=255 Jun 09 05:32:10.878863 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:10.878461 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-cd4db94dd-2dsgm" event={"ID":"4c809885-3db6-43cf-8cb7-b6e0ce7f0ae8","Type":"ContainerDied","Data":"dc3ce1c1e5d32e3d549fa6aab0c971de3f283e3a2b58266b4fe8be60cb6eb863"} Jun 09 05:32:10.883848 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:10.883832 2564 scope.go:117] "RemoveContainer" containerID="dc3ce1c1e5d32e3d549fa6aab0c971de3f283e3a2b58266b4fe8be60cb6eb863" Jun 09 05:32:11.884404 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:11.884360 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-cd4db94dd-2dsgm" event={"ID":"4c809885-3db6-43cf-8cb7-b6e0ce7f0ae8","Type":"ContainerStarted","Data":"877c1d95ab8d336c76a51156aa9d1daa050d8dd57d17ea7ded36c75c1701fee8"} Jun 09 05:32:27.636349 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.636318 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-9ffff86c7-mcqvf"] Jun 09 05:32:27.639267 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.639246 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-lx6qd"] Jun 09 05:32:27.639375 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.639360 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9ffff86c7-mcqvf" Jun 09 05:32:27.641877 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.641857 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 09 05:32:27.641988 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.641972 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-896549976-r4vnz"] Jun 09 05:32:27.642053 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.641999 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 09 05:32:27.642053 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.642007 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-2rk2w\"" Jun 09 05:32:27.642145 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.642110 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-lx6qd" Jun 09 05:32:27.642656 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.642637 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 09 05:32:27.644246 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.644227 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 09 05:32:27.644899 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.644870 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-jkwbm"] Jun 09 05:32:27.644992 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.644974 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 09 05:32:27.645235 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.645124 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 09 05:32:27.645235 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.645147 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 09 05:32:27.645235 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.645182 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-r64qr\"" Jun 09 05:32:27.645402 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.645308 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-r4vnz" Jun 09 05:32:27.647612 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.647589 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-jkwbm" Jun 09 05:32:27.648734 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.648717 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 09 05:32:27.649229 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.649211 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 09 05:32:27.649959 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.649944 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-fzwgz\"" Jun 09 05:32:27.650141 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.650002 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 09 05:32:27.650281 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.650265 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 09 05:32:27.651625 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.651605 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-mjqcs\"" Jun 09 05:32:27.651752 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.651734 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 09 05:32:27.654241 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.653952 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-jkwbm"] Jun 09 05:32:27.654911 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.654698 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 09 05:32:27.655074 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.655053 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-lx6qd"] Jun 09 05:32:27.655982 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.655964 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-r4vnz"] Jun 09 05:32:27.656983 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.656966 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-9ffff86c7-mcqvf"] Jun 09 05:32:27.726617 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.726592 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-6jn5z"] Jun 09 05:32:27.729480 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.729462 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-6jn5z" Jun 09 05:32:27.729579 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.729513 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-kwf45"] Jun 09 05:32:27.731611 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.731595 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 09 05:32:27.731708 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.731645 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-8cqwf\"" Jun 09 05:32:27.732103 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.732082 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 09 05:32:27.732277 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.732257 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-c7jcw"] Jun 09 05:32:27.732464 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.732366 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-kwf45" Jun 09 05:32:27.734478 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.734459 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 09 05:32:27.735083 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.735058 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-vmn7b"] Jun 09 05:32:27.735184 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.735171 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-c7jcw" Jun 09 05:32:27.735387 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.735311 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-k8jrm\"" Jun 09 05:32:27.736786 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.736765 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 09 05:32:27.737723 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.737704 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 09 05:32:27.737948 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.737925 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 09 05:32:27.738299 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.738282 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-zp8lx\"" Jun 09 05:32:27.738727 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.738710 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 09 05:32:27.740467 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.738992 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 09 05:32:27.740821 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.740785 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-6jn5z"] Jun 09 05:32:27.740923 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.740910 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-vmn7b" Jun 09 05:32:27.744402 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.743583 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 09 05:32:27.744402 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.743645 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-tqzbm\"" Jun 09 05:32:27.744402 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.743864 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 09 05:32:27.744402 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.744065 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 09 05:32:27.744402 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.744209 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-c7jcw"] Jun 09 05:32:27.745196 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.745179 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-kwf45"] Jun 09 05:32:27.746294 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.746272 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-vmn7b"] Jun 09 05:32:27.749059 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.749043 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/09110d03-6ef0-4c54-afb7-872377f07269-image-registry-private-configuration\") pod \"image-registry-9ffff86c7-mcqvf\" (UID: \"09110d03-6ef0-4c54-afb7-872377f07269\") " pod="openshift-image-registry/image-registry-9ffff86c7-mcqvf" Jun 09 05:32:27.749154 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.749065 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzkgw\" (UniqueName: \"kubernetes.io/projected/5aadd1b0-611a-48e8-bde8-9fbb65562c69-kube-api-access-jzkgw\") pod \"insights-operator-896549976-r4vnz\" (UID: \"5aadd1b0-611a-48e8-bde8-9fbb65562c69\") " pod="openshift-insights/insights-operator-896549976-r4vnz" Jun 09 05:32:27.749154 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.749104 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fzt8\" (UniqueName: \"kubernetes.io/projected/e834c0a8-1573-4e0f-beec-81f91de398f9-kube-api-access-2fzt8\") pod \"network-check-source-dbd9cf844-jkwbm\" (UID: \"e834c0a8-1573-4e0f-beec-81f91de398f9\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-jkwbm" Jun 09 05:32:27.749268 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.749156 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/09110d03-6ef0-4c54-afb7-872377f07269-registry-certificates\") pod \"image-registry-9ffff86c7-mcqvf\" (UID: \"09110d03-6ef0-4c54-afb7-872377f07269\") " pod="openshift-image-registry/image-registry-9ffff86c7-mcqvf" Jun 09 05:32:27.749268 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.749204 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/09110d03-6ef0-4c54-afb7-872377f07269-installation-pull-secrets\") pod \"image-registry-9ffff86c7-mcqvf\" (UID: \"09110d03-6ef0-4c54-afb7-872377f07269\") " pod="openshift-image-registry/image-registry-9ffff86c7-mcqvf" Jun 09 05:32:27.749268 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.749232 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5aadd1b0-611a-48e8-bde8-9fbb65562c69-service-ca-bundle\") pod \"insights-operator-896549976-r4vnz\" (UID: \"5aadd1b0-611a-48e8-bde8-9fbb65562c69\") " pod="openshift-insights/insights-operator-896549976-r4vnz" Jun 09 05:32:27.749268 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.749256 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5aadd1b0-611a-48e8-bde8-9fbb65562c69-serving-cert\") pod \"insights-operator-896549976-r4vnz\" (UID: \"5aadd1b0-611a-48e8-bde8-9fbb65562c69\") " pod="openshift-insights/insights-operator-896549976-r4vnz" Jun 09 05:32:27.749494 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.749324 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/09110d03-6ef0-4c54-afb7-872377f07269-ca-trust-extracted\") pod \"image-registry-9ffff86c7-mcqvf\" (UID: \"09110d03-6ef0-4c54-afb7-872377f07269\") " pod="openshift-image-registry/image-registry-9ffff86c7-mcqvf" Jun 09 05:32:27.749494 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.749355 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/105c1a70-a1c8-478d-982a-41a350a2dbd2-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-lx6qd\" (UID: \"105c1a70-a1c8-478d-982a-41a350a2dbd2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-lx6qd" Jun 09 05:32:27.749494 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.749389 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5aadd1b0-611a-48e8-bde8-9fbb65562c69-trusted-ca-bundle\") pod \"insights-operator-896549976-r4vnz\" (UID: \"5aadd1b0-611a-48e8-bde8-9fbb65562c69\") " pod="openshift-insights/insights-operator-896549976-r4vnz" Jun 09 05:32:27.749494 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.749415 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/09110d03-6ef0-4c54-afb7-872377f07269-trusted-ca\") pod \"image-registry-9ffff86c7-mcqvf\" (UID: \"09110d03-6ef0-4c54-afb7-872377f07269\") " pod="openshift-image-registry/image-registry-9ffff86c7-mcqvf" Jun 09 05:32:27.749494 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.749440 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czfsm\" (UniqueName: \"kubernetes.io/projected/105c1a70-a1c8-478d-982a-41a350a2dbd2-kube-api-access-czfsm\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-lx6qd\" (UID: \"105c1a70-a1c8-478d-982a-41a350a2dbd2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-lx6qd" Jun 09 05:32:27.749494 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.749472 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/09110d03-6ef0-4c54-afb7-872377f07269-bound-sa-token\") pod \"image-registry-9ffff86c7-mcqvf\" (UID: \"09110d03-6ef0-4c54-afb7-872377f07269\") " pod="openshift-image-registry/image-registry-9ffff86c7-mcqvf" Jun 09 05:32:27.749720 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.749495 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kks2k\" (UniqueName: \"kubernetes.io/projected/09110d03-6ef0-4c54-afb7-872377f07269-kube-api-access-kks2k\") pod \"image-registry-9ffff86c7-mcqvf\" (UID: \"09110d03-6ef0-4c54-afb7-872377f07269\") " pod="openshift-image-registry/image-registry-9ffff86c7-mcqvf" Jun 09 05:32:27.749720 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.749515 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5aadd1b0-611a-48e8-bde8-9fbb65562c69-tmp\") pod \"insights-operator-896549976-r4vnz\" (UID: \"5aadd1b0-611a-48e8-bde8-9fbb65562c69\") " pod="openshift-insights/insights-operator-896549976-r4vnz" Jun 09 05:32:27.749720 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.749650 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/09110d03-6ef0-4c54-afb7-872377f07269-registry-tls\") pod \"image-registry-9ffff86c7-mcqvf\" (UID: \"09110d03-6ef0-4c54-afb7-872377f07269\") " pod="openshift-image-registry/image-registry-9ffff86c7-mcqvf" Jun 09 05:32:27.749720 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.749680 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5aadd1b0-611a-48e8-bde8-9fbb65562c69-snapshots\") pod \"insights-operator-896549976-r4vnz\" (UID: \"5aadd1b0-611a-48e8-bde8-9fbb65562c69\") " pod="openshift-insights/insights-operator-896549976-r4vnz" Jun 09 05:32:27.749720 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.749702 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/105c1a70-a1c8-478d-982a-41a350a2dbd2-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-lx6qd\" (UID: \"105c1a70-a1c8-478d-982a-41a350a2dbd2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-lx6qd" Jun 09 05:32:27.850282 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.850257 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czfsm\" (UniqueName: \"kubernetes.io/projected/105c1a70-a1c8-478d-982a-41a350a2dbd2-kube-api-access-czfsm\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-lx6qd\" (UID: \"105c1a70-a1c8-478d-982a-41a350a2dbd2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-lx6qd" Jun 09 05:32:27.850404 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.850286 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l694s\" (UniqueName: \"kubernetes.io/projected/c5e08a5a-46b4-441b-99b9-89560f55d695-kube-api-access-l694s\") pod \"cluster-samples-operator-854f8b96b6-vmn7b\" (UID: \"c5e08a5a-46b4-441b-99b9-89560f55d695\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-vmn7b" Jun 09 05:32:27.850404 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.850303 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5aadd1b0-611a-48e8-bde8-9fbb65562c69-tmp\") pod \"insights-operator-896549976-r4vnz\" (UID: \"5aadd1b0-611a-48e8-bde8-9fbb65562c69\") " pod="openshift-insights/insights-operator-896549976-r4vnz" Jun 09 05:32:27.850404 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.850321 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/09110d03-6ef0-4c54-afb7-872377f07269-bound-sa-token\") pod \"image-registry-9ffff86c7-mcqvf\" (UID: \"09110d03-6ef0-4c54-afb7-872377f07269\") " pod="openshift-image-registry/image-registry-9ffff86c7-mcqvf" Jun 09 05:32:27.850404 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.850339 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/105c1a70-a1c8-478d-982a-41a350a2dbd2-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-lx6qd\" (UID: \"105c1a70-a1c8-478d-982a-41a350a2dbd2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-lx6qd" Jun 09 05:32:27.850404 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.850393 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/09110d03-6ef0-4c54-afb7-872377f07269-registry-tls\") pod \"image-registry-9ffff86c7-mcqvf\" (UID: \"09110d03-6ef0-4c54-afb7-872377f07269\") " pod="openshift-image-registry/image-registry-9ffff86c7-mcqvf" Jun 09 05:32:27.850649 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.850419 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c01ba14d-9950-4d95-b65e-a651fda07075-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-c7jcw\" (UID: \"c01ba14d-9950-4d95-b65e-a651fda07075\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-c7jcw" Jun 09 05:32:27.850649 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.850451 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/09110d03-6ef0-4c54-afb7-872377f07269-registry-certificates\") pod \"image-registry-9ffff86c7-mcqvf\" (UID: \"09110d03-6ef0-4c54-afb7-872377f07269\") " pod="openshift-image-registry/image-registry-9ffff86c7-mcqvf" Jun 09 05:32:27.850649 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.850477 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5g2wn\" (UniqueName: \"kubernetes.io/projected/51e3be8b-37d4-49d8-ad17-ac56f6d1223a-kube-api-access-5g2wn\") pod \"volume-data-source-validator-78dd696465-6jn5z\" (UID: \"51e3be8b-37d4-49d8-ad17-ac56f6d1223a\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-6jn5z" Jun 09 05:32:27.850649 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:32:27.850506 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 05:32:27.850649 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.850508 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/09110d03-6ef0-4c54-afb7-872377f07269-image-registry-private-configuration\") pod \"image-registry-9ffff86c7-mcqvf\" (UID: \"09110d03-6ef0-4c54-afb7-872377f07269\") " pod="openshift-image-registry/image-registry-9ffff86c7-mcqvf" Jun 09 05:32:27.850649 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:32:27.850518 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9ffff86c7-mcqvf: secret "image-registry-tls" not found Jun 09 05:32:27.850649 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.850532 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzkgw\" (UniqueName: \"kubernetes.io/projected/5aadd1b0-611a-48e8-bde8-9fbb65562c69-kube-api-access-jzkgw\") pod \"insights-operator-896549976-r4vnz\" (UID: \"5aadd1b0-611a-48e8-bde8-9fbb65562c69\") " pod="openshift-insights/insights-operator-896549976-r4vnz" Jun 09 05:32:27.850649 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:32:27.850579 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/09110d03-6ef0-4c54-afb7-872377f07269-registry-tls podName:09110d03-6ef0-4c54-afb7-872377f07269 nodeName:}" failed. No retries permitted until 2026-06-09 05:32:28.350559462 +0000 UTC m=+198.433211189 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/09110d03-6ef0-4c54-afb7-872377f07269-registry-tls") pod "image-registry-9ffff86c7-mcqvf" (UID: "09110d03-6ef0-4c54-afb7-872377f07269") : secret "image-registry-tls" not found Jun 09 05:32:27.850649 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.850599 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/75d2abf6-37dc-42d2-875e-1cb1b449f1f4-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-kwf45\" (UID: \"75d2abf6-37dc-42d2-875e-1cb1b449f1f4\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-kwf45" Jun 09 05:32:27.850649 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.850627 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6h4r\" (UniqueName: \"kubernetes.io/projected/c01ba14d-9950-4d95-b65e-a651fda07075-kube-api-access-z6h4r\") pod \"service-ca-operator-6bc5ff68f5-c7jcw\" (UID: \"c01ba14d-9950-4d95-b65e-a651fda07075\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-c7jcw" Jun 09 05:32:27.850649 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.850642 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5aadd1b0-611a-48e8-bde8-9fbb65562c69-tmp\") pod \"insights-operator-896549976-r4vnz\" (UID: \"5aadd1b0-611a-48e8-bde8-9fbb65562c69\") " pod="openshift-insights/insights-operator-896549976-r4vnz" Jun 09 05:32:27.850649 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.850652 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c5e08a5a-46b4-441b-99b9-89560f55d695-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-vmn7b\" (UID: \"c5e08a5a-46b4-441b-99b9-89560f55d695\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-vmn7b" Jun 09 05:32:27.851319 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.850709 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/75d2abf6-37dc-42d2-875e-1cb1b449f1f4-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-kwf45\" (UID: \"75d2abf6-37dc-42d2-875e-1cb1b449f1f4\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-kwf45" Jun 09 05:32:27.851319 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.850865 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5aadd1b0-611a-48e8-bde8-9fbb65562c69-trusted-ca-bundle\") pod \"insights-operator-896549976-r4vnz\" (UID: \"5aadd1b0-611a-48e8-bde8-9fbb65562c69\") " pod="openshift-insights/insights-operator-896549976-r4vnz" Jun 09 05:32:27.851319 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.850897 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/09110d03-6ef0-4c54-afb7-872377f07269-trusted-ca\") pod \"image-registry-9ffff86c7-mcqvf\" (UID: \"09110d03-6ef0-4c54-afb7-872377f07269\") " pod="openshift-image-registry/image-registry-9ffff86c7-mcqvf" Jun 09 05:32:27.851319 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.850933 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kks2k\" (UniqueName: \"kubernetes.io/projected/09110d03-6ef0-4c54-afb7-872377f07269-kube-api-access-kks2k\") pod \"image-registry-9ffff86c7-mcqvf\" (UID: \"09110d03-6ef0-4c54-afb7-872377f07269\") " pod="openshift-image-registry/image-registry-9ffff86c7-mcqvf" Jun 09 05:32:27.851319 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.850967 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5aadd1b0-611a-48e8-bde8-9fbb65562c69-snapshots\") pod \"insights-operator-896549976-r4vnz\" (UID: \"5aadd1b0-611a-48e8-bde8-9fbb65562c69\") " pod="openshift-insights/insights-operator-896549976-r4vnz" Jun 09 05:32:27.851319 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.850992 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/105c1a70-a1c8-478d-982a-41a350a2dbd2-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-lx6qd\" (UID: \"105c1a70-a1c8-478d-982a-41a350a2dbd2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-lx6qd" Jun 09 05:32:27.851319 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.851033 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fzt8\" (UniqueName: \"kubernetes.io/projected/e834c0a8-1573-4e0f-beec-81f91de398f9-kube-api-access-2fzt8\") pod \"network-check-source-dbd9cf844-jkwbm\" (UID: \"e834c0a8-1573-4e0f-beec-81f91de398f9\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-jkwbm" Jun 09 05:32:27.851319 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.851059 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/09110d03-6ef0-4c54-afb7-872377f07269-installation-pull-secrets\") pod \"image-registry-9ffff86c7-mcqvf\" (UID: \"09110d03-6ef0-4c54-afb7-872377f07269\") " pod="openshift-image-registry/image-registry-9ffff86c7-mcqvf" Jun 09 05:32:27.851319 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.851085 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5aadd1b0-611a-48e8-bde8-9fbb65562c69-service-ca-bundle\") pod \"insights-operator-896549976-r4vnz\" (UID: \"5aadd1b0-611a-48e8-bde8-9fbb65562c69\") " pod="openshift-insights/insights-operator-896549976-r4vnz" Jun 09 05:32:27.851319 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.851109 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5aadd1b0-611a-48e8-bde8-9fbb65562c69-serving-cert\") pod \"insights-operator-896549976-r4vnz\" (UID: \"5aadd1b0-611a-48e8-bde8-9fbb65562c69\") " pod="openshift-insights/insights-operator-896549976-r4vnz" Jun 09 05:32:27.851319 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.851129 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/09110d03-6ef0-4c54-afb7-872377f07269-registry-certificates\") pod \"image-registry-9ffff86c7-mcqvf\" (UID: \"09110d03-6ef0-4c54-afb7-872377f07269\") " pod="openshift-image-registry/image-registry-9ffff86c7-mcqvf" Jun 09 05:32:27.851319 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.851134 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c01ba14d-9950-4d95-b65e-a651fda07075-config\") pod \"service-ca-operator-6bc5ff68f5-c7jcw\" (UID: \"c01ba14d-9950-4d95-b65e-a651fda07075\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-c7jcw" Jun 09 05:32:27.851319 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.851206 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/09110d03-6ef0-4c54-afb7-872377f07269-ca-trust-extracted\") pod \"image-registry-9ffff86c7-mcqvf\" (UID: \"09110d03-6ef0-4c54-afb7-872377f07269\") " pod="openshift-image-registry/image-registry-9ffff86c7-mcqvf" Jun 09 05:32:27.851979 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.851502 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/09110d03-6ef0-4c54-afb7-872377f07269-ca-trust-extracted\") pod \"image-registry-9ffff86c7-mcqvf\" (UID: \"09110d03-6ef0-4c54-afb7-872377f07269\") " pod="openshift-image-registry/image-registry-9ffff86c7-mcqvf" Jun 09 05:32:27.851979 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.851709 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5aadd1b0-611a-48e8-bde8-9fbb65562c69-trusted-ca-bundle\") pod \"insights-operator-896549976-r4vnz\" (UID: \"5aadd1b0-611a-48e8-bde8-9fbb65562c69\") " pod="openshift-insights/insights-operator-896549976-r4vnz" Jun 09 05:32:27.851979 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.851737 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5aadd1b0-611a-48e8-bde8-9fbb65562c69-snapshots\") pod \"insights-operator-896549976-r4vnz\" (UID: \"5aadd1b0-611a-48e8-bde8-9fbb65562c69\") " pod="openshift-insights/insights-operator-896549976-r4vnz" Jun 09 05:32:27.851979 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.851762 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5aadd1b0-611a-48e8-bde8-9fbb65562c69-service-ca-bundle\") pod \"insights-operator-896549976-r4vnz\" (UID: \"5aadd1b0-611a-48e8-bde8-9fbb65562c69\") " pod="openshift-insights/insights-operator-896549976-r4vnz" Jun 09 05:32:27.852202 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.852181 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/09110d03-6ef0-4c54-afb7-872377f07269-trusted-ca\") pod \"image-registry-9ffff86c7-mcqvf\" (UID: \"09110d03-6ef0-4c54-afb7-872377f07269\") " pod="openshift-image-registry/image-registry-9ffff86c7-mcqvf" Jun 09 05:32:27.852348 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.852329 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/105c1a70-a1c8-478d-982a-41a350a2dbd2-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-lx6qd\" (UID: \"105c1a70-a1c8-478d-982a-41a350a2dbd2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-lx6qd" Jun 09 05:32:27.853110 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.853094 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/105c1a70-a1c8-478d-982a-41a350a2dbd2-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-lx6qd\" (UID: \"105c1a70-a1c8-478d-982a-41a350a2dbd2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-lx6qd" Jun 09 05:32:27.853401 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.853381 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/09110d03-6ef0-4c54-afb7-872377f07269-image-registry-private-configuration\") pod \"image-registry-9ffff86c7-mcqvf\" (UID: \"09110d03-6ef0-4c54-afb7-872377f07269\") " pod="openshift-image-registry/image-registry-9ffff86c7-mcqvf" Jun 09 05:32:27.853729 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.853709 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/09110d03-6ef0-4c54-afb7-872377f07269-installation-pull-secrets\") pod \"image-registry-9ffff86c7-mcqvf\" (UID: \"09110d03-6ef0-4c54-afb7-872377f07269\") " pod="openshift-image-registry/image-registry-9ffff86c7-mcqvf" Jun 09 05:32:27.853956 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.853942 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5aadd1b0-611a-48e8-bde8-9fbb65562c69-serving-cert\") pod \"insights-operator-896549976-r4vnz\" (UID: \"5aadd1b0-611a-48e8-bde8-9fbb65562c69\") " pod="openshift-insights/insights-operator-896549976-r4vnz" Jun 09 05:32:27.864394 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.864369 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-czfsm\" (UniqueName: \"kubernetes.io/projected/105c1a70-a1c8-478d-982a-41a350a2dbd2-kube-api-access-czfsm\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-lx6qd\" (UID: \"105c1a70-a1c8-478d-982a-41a350a2dbd2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-lx6qd" Jun 09 05:32:27.864696 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.864675 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fzt8\" (UniqueName: \"kubernetes.io/projected/e834c0a8-1573-4e0f-beec-81f91de398f9-kube-api-access-2fzt8\") pod \"network-check-source-dbd9cf844-jkwbm\" (UID: \"e834c0a8-1573-4e0f-beec-81f91de398f9\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-jkwbm" Jun 09 05:32:27.864964 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.864944 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kks2k\" (UniqueName: \"kubernetes.io/projected/09110d03-6ef0-4c54-afb7-872377f07269-kube-api-access-kks2k\") pod \"image-registry-9ffff86c7-mcqvf\" (UID: \"09110d03-6ef0-4c54-afb7-872377f07269\") " pod="openshift-image-registry/image-registry-9ffff86c7-mcqvf" Jun 09 05:32:27.865174 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.865159 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzkgw\" (UniqueName: \"kubernetes.io/projected/5aadd1b0-611a-48e8-bde8-9fbb65562c69-kube-api-access-jzkgw\") pod \"insights-operator-896549976-r4vnz\" (UID: \"5aadd1b0-611a-48e8-bde8-9fbb65562c69\") " pod="openshift-insights/insights-operator-896549976-r4vnz" Jun 09 05:32:27.865514 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.865494 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/09110d03-6ef0-4c54-afb7-872377f07269-bound-sa-token\") pod \"image-registry-9ffff86c7-mcqvf\" (UID: \"09110d03-6ef0-4c54-afb7-872377f07269\") " pod="openshift-image-registry/image-registry-9ffff86c7-mcqvf" Jun 09 05:32:27.951721 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.951661 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6h4r\" (UniqueName: \"kubernetes.io/projected/c01ba14d-9950-4d95-b65e-a651fda07075-kube-api-access-z6h4r\") pod \"service-ca-operator-6bc5ff68f5-c7jcw\" (UID: \"c01ba14d-9950-4d95-b65e-a651fda07075\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-c7jcw" Jun 09 05:32:27.951721 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.951690 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c5e08a5a-46b4-441b-99b9-89560f55d695-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-vmn7b\" (UID: \"c5e08a5a-46b4-441b-99b9-89560f55d695\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-vmn7b" Jun 09 05:32:27.951721 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.951713 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/75d2abf6-37dc-42d2-875e-1cb1b449f1f4-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-kwf45\" (UID: \"75d2abf6-37dc-42d2-875e-1cb1b449f1f4\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-kwf45" Jun 09 05:32:27.952031 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.951759 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c01ba14d-9950-4d95-b65e-a651fda07075-config\") pod \"service-ca-operator-6bc5ff68f5-c7jcw\" (UID: \"c01ba14d-9950-4d95-b65e-a651fda07075\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-c7jcw" Jun 09 05:32:27.952031 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.951813 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l694s\" (UniqueName: \"kubernetes.io/projected/c5e08a5a-46b4-441b-99b9-89560f55d695-kube-api-access-l694s\") pod \"cluster-samples-operator-854f8b96b6-vmn7b\" (UID: \"c5e08a5a-46b4-441b-99b9-89560f55d695\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-vmn7b" Jun 09 05:32:27.952031 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:32:27.951823 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 05:32:27.952031 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.951858 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c01ba14d-9950-4d95-b65e-a651fda07075-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-c7jcw\" (UID: \"c01ba14d-9950-4d95-b65e-a651fda07075\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-c7jcw" Jun 09 05:32:27.952031 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:32:27.951875 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5e08a5a-46b4-441b-99b9-89560f55d695-samples-operator-tls podName:c5e08a5a-46b4-441b-99b9-89560f55d695 nodeName:}" failed. No retries permitted until 2026-06-09 05:32:28.451858851 +0000 UTC m=+198.534510579 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c5e08a5a-46b4-441b-99b9-89560f55d695-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-vmn7b" (UID: "c5e08a5a-46b4-441b-99b9-89560f55d695") : secret "samples-operator-tls" not found Jun 09 05:32:27.952031 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:32:27.951884 2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 05:32:27.952031 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.951911 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5g2wn\" (UniqueName: \"kubernetes.io/projected/51e3be8b-37d4-49d8-ad17-ac56f6d1223a-kube-api-access-5g2wn\") pod \"volume-data-source-validator-78dd696465-6jn5z\" (UID: \"51e3be8b-37d4-49d8-ad17-ac56f6d1223a\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-6jn5z" Jun 09 05:32:27.952320 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:32:27.952159 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75d2abf6-37dc-42d2-875e-1cb1b449f1f4-networking-console-plugin-cert podName:75d2abf6-37dc-42d2-875e-1cb1b449f1f4 nodeName:}" failed. No retries permitted until 2026-06-09 05:32:28.451932541 +0000 UTC m=+198.534584257 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/75d2abf6-37dc-42d2-875e-1cb1b449f1f4-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-kwf45" (UID: "75d2abf6-37dc-42d2-875e-1cb1b449f1f4") : secret "networking-console-plugin-cert" not found Jun 09 05:32:27.952320 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.952188 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/75d2abf6-37dc-42d2-875e-1cb1b449f1f4-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-kwf45\" (UID: \"75d2abf6-37dc-42d2-875e-1cb1b449f1f4\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-kwf45" Jun 09 05:32:27.952414 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.952396 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c01ba14d-9950-4d95-b65e-a651fda07075-config\") pod \"service-ca-operator-6bc5ff68f5-c7jcw\" (UID: \"c01ba14d-9950-4d95-b65e-a651fda07075\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-c7jcw" Jun 09 05:32:27.952683 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.952666 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/75d2abf6-37dc-42d2-875e-1cb1b449f1f4-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-kwf45\" (UID: \"75d2abf6-37dc-42d2-875e-1cb1b449f1f4\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-kwf45" Jun 09 05:32:27.953718 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.953703 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c01ba14d-9950-4d95-b65e-a651fda07075-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-c7jcw\" (UID: \"c01ba14d-9950-4d95-b65e-a651fda07075\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-c7jcw" Jun 09 05:32:27.957223 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.957194 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-lx6qd" Jun 09 05:32:27.959531 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.959508 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5g2wn\" (UniqueName: \"kubernetes.io/projected/51e3be8b-37d4-49d8-ad17-ac56f6d1223a-kube-api-access-5g2wn\") pod \"volume-data-source-validator-78dd696465-6jn5z\" (UID: \"51e3be8b-37d4-49d8-ad17-ac56f6d1223a\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-6jn5z" Jun 09 05:32:27.959648 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.959576 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l694s\" (UniqueName: \"kubernetes.io/projected/c5e08a5a-46b4-441b-99b9-89560f55d695-kube-api-access-l694s\") pod \"cluster-samples-operator-854f8b96b6-vmn7b\" (UID: \"c5e08a5a-46b4-441b-99b9-89560f55d695\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-vmn7b" Jun 09 05:32:27.960155 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.960140 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6h4r\" (UniqueName: \"kubernetes.io/projected/c01ba14d-9950-4d95-b65e-a651fda07075-kube-api-access-z6h4r\") pod \"service-ca-operator-6bc5ff68f5-c7jcw\" (UID: \"c01ba14d-9950-4d95-b65e-a651fda07075\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-c7jcw" Jun 09 05:32:27.964422 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.964405 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-r4vnz" Jun 09 05:32:27.969242 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:27.969224 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-jkwbm" Jun 09 05:32:28.044274 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:28.044243 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-6jn5z" Jun 09 05:32:28.058596 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:28.058248 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-c7jcw" Jun 09 05:32:28.106341 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:28.106292 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-lx6qd"] Jun 09 05:32:28.123849 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:28.123475 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-r4vnz"] Jun 09 05:32:28.129285 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:32:28.129228 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5aadd1b0_611a_48e8_bde8_9fbb65562c69.slice/crio-00523acb85c6a67f81b9057f40b77d7a73622884d261c8efcbb2e6d2eef1539f WatchSource:0}: Error finding container 00523acb85c6a67f81b9057f40b77d7a73622884d261c8efcbb2e6d2eef1539f: Status 404 returned error can't find the container with id 00523acb85c6a67f81b9057f40b77d7a73622884d261c8efcbb2e6d2eef1539f Jun 09 05:32:28.144325 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:28.144296 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-jkwbm"] Jun 09 05:32:28.149072 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:32:28.149026 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode834c0a8_1573_4e0f_beec_81f91de398f9.slice/crio-58226f17a782ce63ccd8da575a19ebc828a41e96799098aac3901163281b9a90 WatchSource:0}: Error finding container 58226f17a782ce63ccd8da575a19ebc828a41e96799098aac3901163281b9a90: Status 404 returned error can't find the container with id 58226f17a782ce63ccd8da575a19ebc828a41e96799098aac3901163281b9a90 Jun 09 05:32:28.193298 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:28.193271 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-6jn5z"] Jun 09 05:32:28.196705 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:32:28.196682 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51e3be8b_37d4_49d8_ad17_ac56f6d1223a.slice/crio-d9dfb45a61d6919123deee0c8dfbb5aeb0815b82e21813c7f2613b3a04477f45 WatchSource:0}: Error finding container d9dfb45a61d6919123deee0c8dfbb5aeb0815b82e21813c7f2613b3a04477f45: Status 404 returned error can't find the container with id d9dfb45a61d6919123deee0c8dfbb5aeb0815b82e21813c7f2613b3a04477f45 Jun 09 05:32:28.209475 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:28.209455 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-c7jcw"] Jun 09 05:32:28.211884 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:32:28.211857 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc01ba14d_9950_4d95_b65e_a651fda07075.slice/crio-d7a98329341e3426dda456ba5cc7df1fff8d2accfd4bc32face8118ffb51ee44 WatchSource:0}: Error finding container d7a98329341e3426dda456ba5cc7df1fff8d2accfd4bc32face8118ffb51ee44: Status 404 returned error can't find the container with id d7a98329341e3426dda456ba5cc7df1fff8d2accfd4bc32face8118ffb51ee44 Jun 09 05:32:28.355663 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:28.355636 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/09110d03-6ef0-4c54-afb7-872377f07269-registry-tls\") pod \"image-registry-9ffff86c7-mcqvf\" (UID: \"09110d03-6ef0-4c54-afb7-872377f07269\") " pod="openshift-image-registry/image-registry-9ffff86c7-mcqvf" Jun 09 05:32:28.355815 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:32:28.355730 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 05:32:28.355815 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:32:28.355740 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9ffff86c7-mcqvf: secret "image-registry-tls" not found Jun 09 05:32:28.355815 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:32:28.355783 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/09110d03-6ef0-4c54-afb7-872377f07269-registry-tls podName:09110d03-6ef0-4c54-afb7-872377f07269 nodeName:}" failed. No retries permitted until 2026-06-09 05:32:29.3557693 +0000 UTC m=+199.438421014 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/09110d03-6ef0-4c54-afb7-872377f07269-registry-tls") pod "image-registry-9ffff86c7-mcqvf" (UID: "09110d03-6ef0-4c54-afb7-872377f07269") : secret "image-registry-tls" not found Jun 09 05:32:28.456998 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:28.456924 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c5e08a5a-46b4-441b-99b9-89560f55d695-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-vmn7b\" (UID: \"c5e08a5a-46b4-441b-99b9-89560f55d695\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-vmn7b" Jun 09 05:32:28.456998 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:28.456978 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/75d2abf6-37dc-42d2-875e-1cb1b449f1f4-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-kwf45\" (UID: \"75d2abf6-37dc-42d2-875e-1cb1b449f1f4\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-kwf45" Jun 09 05:32:28.457171 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:32:28.457012 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 05:32:28.457171 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:32:28.457062 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5e08a5a-46b4-441b-99b9-89560f55d695-samples-operator-tls podName:c5e08a5a-46b4-441b-99b9-89560f55d695 nodeName:}" failed. No retries permitted until 2026-06-09 05:32:29.457045921 +0000 UTC m=+199.539697663 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c5e08a5a-46b4-441b-99b9-89560f55d695-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-vmn7b" (UID: "c5e08a5a-46b4-441b-99b9-89560f55d695") : secret "samples-operator-tls" not found Jun 09 05:32:28.457171 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:32:28.457082 2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 05:32:28.457171 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:32:28.457136 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75d2abf6-37dc-42d2-875e-1cb1b449f1f4-networking-console-plugin-cert podName:75d2abf6-37dc-42d2-875e-1cb1b449f1f4 nodeName:}" failed. No retries permitted until 2026-06-09 05:32:29.457119846 +0000 UTC m=+199.539771560 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/75d2abf6-37dc-42d2-875e-1cb1b449f1f4-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-kwf45" (UID: "75d2abf6-37dc-42d2-875e-1cb1b449f1f4") : secret "networking-console-plugin-cert" not found Jun 09 05:32:28.938656 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:28.938584 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-6jn5z" event={"ID":"51e3be8b-37d4-49d8-ad17-ac56f6d1223a","Type":"ContainerStarted","Data":"d9dfb45a61d6919123deee0c8dfbb5aeb0815b82e21813c7f2613b3a04477f45"} Jun 09 05:32:28.942029 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:28.941332 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-jkwbm" event={"ID":"e834c0a8-1573-4e0f-beec-81f91de398f9","Type":"ContainerStarted","Data":"54d9cb4fe3ce676fac2feda8d9e781163e5d8c919bda0ff5bdd3a24d6953242c"} Jun 09 05:32:28.942029 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:28.941415 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-jkwbm" event={"ID":"e834c0a8-1573-4e0f-beec-81f91de398f9","Type":"ContainerStarted","Data":"58226f17a782ce63ccd8da575a19ebc828a41e96799098aac3901163281b9a90"} Jun 09 05:32:28.944694 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:28.944633 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-lx6qd" event={"ID":"105c1a70-a1c8-478d-982a-41a350a2dbd2","Type":"ContainerStarted","Data":"17afbfbfcfef8e2fc3dbd6a480f09e6927d9b7ddf11fb0d219afb77d20485301"} Jun 09 05:32:28.947530 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:28.947465 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-r4vnz" event={"ID":"5aadd1b0-611a-48e8-bde8-9fbb65562c69","Type":"ContainerStarted","Data":"00523acb85c6a67f81b9057f40b77d7a73622884d261c8efcbb2e6d2eef1539f"} Jun 09 05:32:28.948944 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:28.948921 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-c7jcw" event={"ID":"c01ba14d-9950-4d95-b65e-a651fda07075","Type":"ContainerStarted","Data":"d7a98329341e3426dda456ba5cc7df1fff8d2accfd4bc32face8118ffb51ee44"} Jun 09 05:32:28.957189 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:28.956736 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-jkwbm" podStartSLOduration=1.956719292 podStartE2EDuration="1.956719292s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 05:32:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 05:32:28.956609377 +0000 UTC m=+199.039261148" watchObservedRunningTime="2026-06-09 05:32:28.956719292 +0000 UTC m=+199.039371030" Jun 09 05:32:29.366447 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:29.365784 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/09110d03-6ef0-4c54-afb7-872377f07269-registry-tls\") pod \"image-registry-9ffff86c7-mcqvf\" (UID: \"09110d03-6ef0-4c54-afb7-872377f07269\") " pod="openshift-image-registry/image-registry-9ffff86c7-mcqvf" Jun 09 05:32:29.366447 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:32:29.366000 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 05:32:29.366447 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:32:29.366018 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9ffff86c7-mcqvf: secret "image-registry-tls" not found Jun 09 05:32:29.366447 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:32:29.366079 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/09110d03-6ef0-4c54-afb7-872377f07269-registry-tls podName:09110d03-6ef0-4c54-afb7-872377f07269 nodeName:}" failed. No retries permitted until 2026-06-09 05:32:31.366058718 +0000 UTC m=+201.448710453 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/09110d03-6ef0-4c54-afb7-872377f07269-registry-tls") pod "image-registry-9ffff86c7-mcqvf" (UID: "09110d03-6ef0-4c54-afb7-872377f07269") : secret "image-registry-tls" not found Jun 09 05:32:29.466864 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:29.466838 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c5e08a5a-46b4-441b-99b9-89560f55d695-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-vmn7b\" (UID: \"c5e08a5a-46b4-441b-99b9-89560f55d695\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-vmn7b" Jun 09 05:32:29.466974 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:29.466882 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/75d2abf6-37dc-42d2-875e-1cb1b449f1f4-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-kwf45\" (UID: \"75d2abf6-37dc-42d2-875e-1cb1b449f1f4\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-kwf45" Jun 09 05:32:29.467091 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:32:29.467072 2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 05:32:29.467155 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:32:29.467125 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75d2abf6-37dc-42d2-875e-1cb1b449f1f4-networking-console-plugin-cert podName:75d2abf6-37dc-42d2-875e-1cb1b449f1f4 nodeName:}" failed. No retries permitted until 2026-06-09 05:32:31.467106926 +0000 UTC m=+201.549758643 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/75d2abf6-37dc-42d2-875e-1cb1b449f1f4-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-kwf45" (UID: "75d2abf6-37dc-42d2-875e-1cb1b449f1f4") : secret "networking-console-plugin-cert" not found Jun 09 05:32:29.467464 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:32:29.467448 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 05:32:29.467531 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:32:29.467494 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5e08a5a-46b4-441b-99b9-89560f55d695-samples-operator-tls podName:c5e08a5a-46b4-441b-99b9-89560f55d695 nodeName:}" failed. No retries permitted until 2026-06-09 05:32:31.467480963 +0000 UTC m=+201.550132680 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c5e08a5a-46b4-441b-99b9-89560f55d695-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-vmn7b" (UID: "c5e08a5a-46b4-441b-99b9-89560f55d695") : secret "samples-operator-tls" not found Jun 09 05:32:29.954423 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:29.954378 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-6jn5z" event={"ID":"51e3be8b-37d4-49d8-ad17-ac56f6d1223a","Type":"ContainerStarted","Data":"313214369ccda6c1c330f5f806fec7812ef374c9e19a2e4680d928f3b63b7ff6"} Jun 09 05:32:29.967636 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:29.967591 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-6jn5z" podStartSLOduration=1.713390306 podStartE2EDuration="2.967577782s" totalImagesPullingTime="1.254187476s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 05:32:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 05:32:29.967481948 +0000 UTC m=+200.050133711" watchObservedRunningTime="2026-06-09 05:32:29.967577782 +0000 UTC m=+200.050229518" Jun 09 05:32:31.383683 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:31.383640 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/09110d03-6ef0-4c54-afb7-872377f07269-registry-tls\") pod \"image-registry-9ffff86c7-mcqvf\" (UID: \"09110d03-6ef0-4c54-afb7-872377f07269\") " pod="openshift-image-registry/image-registry-9ffff86c7-mcqvf" Jun 09 05:32:31.384143 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:32:31.383823 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 05:32:31.384143 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:32:31.383849 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9ffff86c7-mcqvf: secret "image-registry-tls" not found Jun 09 05:32:31.384143 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:32:31.383920 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/09110d03-6ef0-4c54-afb7-872377f07269-registry-tls podName:09110d03-6ef0-4c54-afb7-872377f07269 nodeName:}" failed. No retries permitted until 2026-06-09 05:32:35.383900548 +0000 UTC m=+205.466552264 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/09110d03-6ef0-4c54-afb7-872377f07269-registry-tls") pod "image-registry-9ffff86c7-mcqvf" (UID: "09110d03-6ef0-4c54-afb7-872377f07269") : secret "image-registry-tls" not found Jun 09 05:32:31.484420 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:31.484383 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c5e08a5a-46b4-441b-99b9-89560f55d695-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-vmn7b\" (UID: \"c5e08a5a-46b4-441b-99b9-89560f55d695\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-vmn7b" Jun 09 05:32:31.484578 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:31.484430 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/75d2abf6-37dc-42d2-875e-1cb1b449f1f4-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-kwf45\" (UID: \"75d2abf6-37dc-42d2-875e-1cb1b449f1f4\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-kwf45" Jun 09 05:32:31.484578 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:32:31.484537 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 05:32:31.484683 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:32:31.484606 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5e08a5a-46b4-441b-99b9-89560f55d695-samples-operator-tls podName:c5e08a5a-46b4-441b-99b9-89560f55d695 nodeName:}" failed. No retries permitted until 2026-06-09 05:32:35.484586573 +0000 UTC m=+205.567238318 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c5e08a5a-46b4-441b-99b9-89560f55d695-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-vmn7b" (UID: "c5e08a5a-46b4-441b-99b9-89560f55d695") : secret "samples-operator-tls" not found Jun 09 05:32:31.484683 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:32:31.484621 2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 05:32:31.484683 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:32:31.484681 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75d2abf6-37dc-42d2-875e-1cb1b449f1f4-networking-console-plugin-cert podName:75d2abf6-37dc-42d2-875e-1cb1b449f1f4 nodeName:}" failed. No retries permitted until 2026-06-09 05:32:35.484663801 +0000 UTC m=+205.567315520 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/75d2abf6-37dc-42d2-875e-1cb1b449f1f4-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-kwf45" (UID: "75d2abf6-37dc-42d2-875e-1cb1b449f1f4") : secret "networking-console-plugin-cert" not found Jun 09 05:32:31.963636 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:31.963537 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-lx6qd" event={"ID":"105c1a70-a1c8-478d-982a-41a350a2dbd2","Type":"ContainerStarted","Data":"26f08cda32562cb0aa9203613f2064ee367cfae1f7b639acb2f0b4f80ef39a10"} Jun 09 05:32:31.965181 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:31.965149 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-r4vnz" event={"ID":"5aadd1b0-611a-48e8-bde8-9fbb65562c69","Type":"ContainerStarted","Data":"ec6f533e3aa1e451306b7be8cbb208816d651688f1c25e67a2a5f7932b1ce4c0"} Jun 09 05:32:31.966703 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:31.966652 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-c7jcw" event={"ID":"c01ba14d-9950-4d95-b65e-a651fda07075","Type":"ContainerStarted","Data":"8212bade71d32f4443bf4c3300ccacd9c3ac2f595ec23e515e841b63d578c14d"} Jun 09 05:32:31.978627 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:31.978581 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-lx6qd" podStartSLOduration=1.468396361 podStartE2EDuration="4.978566251s" totalImagesPullingTime="3.51016989s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 05:32:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 05:32:31.977704011 +0000 UTC m=+202.060355749" watchObservedRunningTime="2026-06-09 05:32:31.978566251 +0000 UTC m=+202.061217987" Jun 09 05:32:31.992460 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:31.992418 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-896549976-r4vnz" podStartSLOduration=1.491428714 podStartE2EDuration="4.992403702s" totalImagesPullingTime="3.500974988s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 05:32:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 05:32:31.991102836 +0000 UTC m=+202.073754572" watchObservedRunningTime="2026-06-09 05:32:31.992403702 +0000 UTC m=+202.075055438" Jun 09 05:32:32.007464 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:32.007423 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-c7jcw" podStartSLOduration=1.591014133 podStartE2EDuration="5.007405663s" totalImagesPullingTime="3.41639153s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 05:32:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 05:32:32.006854741 +0000 UTC m=+202.089506478" watchObservedRunningTime="2026-06-09 05:32:32.007405663 +0000 UTC m=+202.090057399" Jun 09 05:32:35.121892 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:35.121865 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-n8vqj_50e77e00-d2c2-45fa-9095-05a6d05a90e4/dns-node-resolver/0.log" Jun 09 05:32:35.416228 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:35.416146 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/09110d03-6ef0-4c54-afb7-872377f07269-registry-tls\") pod \"image-registry-9ffff86c7-mcqvf\" (UID: \"09110d03-6ef0-4c54-afb7-872377f07269\") " pod="openshift-image-registry/image-registry-9ffff86c7-mcqvf" Jun 09 05:32:35.416379 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:32:35.416303 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 05:32:35.416379 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:32:35.416323 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9ffff86c7-mcqvf: secret "image-registry-tls" not found Jun 09 05:32:35.416491 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:32:35.416403 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/09110d03-6ef0-4c54-afb7-872377f07269-registry-tls podName:09110d03-6ef0-4c54-afb7-872377f07269 nodeName:}" failed. No retries permitted until 2026-06-09 05:32:43.416381307 +0000 UTC m=+213.499033021 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/09110d03-6ef0-4c54-afb7-872377f07269-registry-tls") pod "image-registry-9ffff86c7-mcqvf" (UID: "09110d03-6ef0-4c54-afb7-872377f07269") : secret "image-registry-tls" not found Jun 09 05:32:35.517241 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:35.517212 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c5e08a5a-46b4-441b-99b9-89560f55d695-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-vmn7b\" (UID: \"c5e08a5a-46b4-441b-99b9-89560f55d695\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-vmn7b" Jun 09 05:32:35.517241 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:35.517243 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/75d2abf6-37dc-42d2-875e-1cb1b449f1f4-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-kwf45\" (UID: \"75d2abf6-37dc-42d2-875e-1cb1b449f1f4\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-kwf45" Jun 09 05:32:35.517411 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:32:35.517358 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 05:32:35.517411 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:32:35.517397 2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 05:32:35.517474 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:32:35.517414 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5e08a5a-46b4-441b-99b9-89560f55d695-samples-operator-tls podName:c5e08a5a-46b4-441b-99b9-89560f55d695 nodeName:}" failed. No retries permitted until 2026-06-09 05:32:43.517399921 +0000 UTC m=+213.600051635 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c5e08a5a-46b4-441b-99b9-89560f55d695-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-vmn7b" (UID: "c5e08a5a-46b4-441b-99b9-89560f55d695") : secret "samples-operator-tls" not found Jun 09 05:32:35.517474 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:32:35.517443 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75d2abf6-37dc-42d2-875e-1cb1b449f1f4-networking-console-plugin-cert podName:75d2abf6-37dc-42d2-875e-1cb1b449f1f4 nodeName:}" failed. No retries permitted until 2026-06-09 05:32:43.517431554 +0000 UTC m=+213.600083268 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/75d2abf6-37dc-42d2-875e-1cb1b449f1f4-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-kwf45" (UID: "75d2abf6-37dc-42d2-875e-1cb1b449f1f4") : secret "networking-console-plugin-cert" not found Jun 09 05:32:36.121714 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:36.121689 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zbjvr_da2e480a-b5b6-44d9-a94c-0ad232ec311c/node-ca/0.log" Jun 09 05:32:36.922423 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:36.922401 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kvqjb_b6726283-2599-497d-a285-634461e11061/serve-healthcheck-canary/0.log" Jun 09 05:32:43.480727 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:43.480688 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/09110d03-6ef0-4c54-afb7-872377f07269-registry-tls\") pod \"image-registry-9ffff86c7-mcqvf\" (UID: \"09110d03-6ef0-4c54-afb7-872377f07269\") " pod="openshift-image-registry/image-registry-9ffff86c7-mcqvf" Jun 09 05:32:43.483027 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:43.483002 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/09110d03-6ef0-4c54-afb7-872377f07269-registry-tls\") pod \"image-registry-9ffff86c7-mcqvf\" (UID: \"09110d03-6ef0-4c54-afb7-872377f07269\") " pod="openshift-image-registry/image-registry-9ffff86c7-mcqvf" Jun 09 05:32:43.550847 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:43.550789 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9ffff86c7-mcqvf" Jun 09 05:32:43.582021 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:43.581993 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c5e08a5a-46b4-441b-99b9-89560f55d695-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-vmn7b\" (UID: \"c5e08a5a-46b4-441b-99b9-89560f55d695\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-vmn7b" Jun 09 05:32:43.582021 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:43.582025 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/75d2abf6-37dc-42d2-875e-1cb1b449f1f4-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-kwf45\" (UID: \"75d2abf6-37dc-42d2-875e-1cb1b449f1f4\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-kwf45" Jun 09 05:32:43.582211 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:32:43.582146 2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 05:32:43.582211 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:32:43.582196 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75d2abf6-37dc-42d2-875e-1cb1b449f1f4-networking-console-plugin-cert podName:75d2abf6-37dc-42d2-875e-1cb1b449f1f4 nodeName:}" failed. No retries permitted until 2026-06-09 05:32:59.582183088 +0000 UTC m=+229.664834802 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/75d2abf6-37dc-42d2-875e-1cb1b449f1f4-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-kwf45" (UID: "75d2abf6-37dc-42d2-875e-1cb1b449f1f4") : secret "networking-console-plugin-cert" not found Jun 09 05:32:43.584276 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:43.584256 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c5e08a5a-46b4-441b-99b9-89560f55d695-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-vmn7b\" (UID: \"c5e08a5a-46b4-441b-99b9-89560f55d695\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-vmn7b" Jun 09 05:32:43.662447 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:43.662420 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-vmn7b" Jun 09 05:32:43.674464 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:43.674440 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-9ffff86c7-mcqvf"] Jun 09 05:32:43.677515 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:32:43.677491 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09110d03_6ef0_4c54_afb7_872377f07269.slice/crio-1951d57737a0b8bee398511bacfd5b9e1ff9dbf24367d5b682ac0f14471be3b4 WatchSource:0}: Error finding container 1951d57737a0b8bee398511bacfd5b9e1ff9dbf24367d5b682ac0f14471be3b4: Status 404 returned error can't find the container with id 1951d57737a0b8bee398511bacfd5b9e1ff9dbf24367d5b682ac0f14471be3b4 Jun 09 05:32:43.783634 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:43.783606 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-vmn7b"] Jun 09 05:32:44.003017 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:44.002932 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-9ffff86c7-mcqvf" event={"ID":"09110d03-6ef0-4c54-afb7-872377f07269","Type":"ContainerStarted","Data":"7d701aac4289aedef64fa209b7d86ecf5c255d90a73b4d4e9c25ad954cc91e0b"} Jun 09 05:32:44.003017 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:44.002994 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-9ffff86c7-mcqvf" event={"ID":"09110d03-6ef0-4c54-afb7-872377f07269","Type":"ContainerStarted","Data":"1951d57737a0b8bee398511bacfd5b9e1ff9dbf24367d5b682ac0f14471be3b4"} Jun 09 05:32:44.003259 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:44.003023 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-9ffff86c7-mcqvf" Jun 09 05:32:44.008511 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:44.008477 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-vmn7b" event={"ID":"c5e08a5a-46b4-441b-99b9-89560f55d695","Type":"ContainerStarted","Data":"077075a76f64ad949b87875565f48ba4742514d6f0505df78e2997f8e7e4b79d"} Jun 09 05:32:44.020775 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:44.020735 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-9ffff86c7-mcqvf" podStartSLOduration=17.020722072 podStartE2EDuration="17.020722072s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 05:32:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 05:32:44.019787272 +0000 UTC m=+214.102439025" watchObservedRunningTime="2026-06-09 05:32:44.020722072 +0000 UTC m=+214.103373807" Jun 09 05:32:46.016449 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:46.016372 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-vmn7b" event={"ID":"c5e08a5a-46b4-441b-99b9-89560f55d695","Type":"ContainerStarted","Data":"de9052fe3c5f80eff1b8bce70bcf5d8e32eb6dec8ed2eb614ba4d06b5c225a95"} Jun 09 05:32:46.016449 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:46.016422 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-vmn7b" event={"ID":"c5e08a5a-46b4-441b-99b9-89560f55d695","Type":"ContainerStarted","Data":"2ed63ef61e2e37ba927aa42e8c26e6a9909014f24313150d58190ec5276e28ba"} Jun 09 05:32:46.030397 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:46.030351 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-vmn7b" podStartSLOduration=17.209747416 podStartE2EDuration="19.030338144s" totalImagesPullingTime="1.820590728s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 05:32:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 05:32:46.02947175 +0000 UTC m=+216.112123481" watchObservedRunningTime="2026-06-09 05:32:46.030338144 +0000 UTC m=+216.112989879" Jun 09 05:32:54.256775 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:54.256742 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-cbktn"] Jun 09 05:32:54.262449 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:54.262429 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cbktn" Jun 09 05:32:54.265520 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:54.265497 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 09 05:32:54.265632 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:54.265538 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-w5x62\"" Jun 09 05:32:54.265632 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:54.265541 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 09 05:32:54.273978 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:54.273952 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cbktn"] Jun 09 05:32:54.292578 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:54.292547 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-9ffff86c7-mcqvf"] Jun 09 05:32:54.362921 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:54.362889 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/88b8a41e-19a5-4323-b7d1-387ae87392ee-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cbktn\" (UID: \"88b8a41e-19a5-4323-b7d1-387ae87392ee\") " pod="openshift-insights/insights-runtime-extractor-cbktn" Jun 09 05:32:54.363081 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:54.362965 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xf6gl\" (UniqueName: \"kubernetes.io/projected/88b8a41e-19a5-4323-b7d1-387ae87392ee-kube-api-access-xf6gl\") pod \"insights-runtime-extractor-cbktn\" (UID: \"88b8a41e-19a5-4323-b7d1-387ae87392ee\") " pod="openshift-insights/insights-runtime-extractor-cbktn" Jun 09 05:32:54.363081 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:54.363010 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/88b8a41e-19a5-4323-b7d1-387ae87392ee-crio-socket\") pod \"insights-runtime-extractor-cbktn\" (UID: \"88b8a41e-19a5-4323-b7d1-387ae87392ee\") " pod="openshift-insights/insights-runtime-extractor-cbktn" Jun 09 05:32:54.363081 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:54.363052 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/88b8a41e-19a5-4323-b7d1-387ae87392ee-data-volume\") pod \"insights-runtime-extractor-cbktn\" (UID: \"88b8a41e-19a5-4323-b7d1-387ae87392ee\") " pod="openshift-insights/insights-runtime-extractor-cbktn" Jun 09 05:32:54.363081 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:54.363079 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/88b8a41e-19a5-4323-b7d1-387ae87392ee-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cbktn\" (UID: \"88b8a41e-19a5-4323-b7d1-387ae87392ee\") " pod="openshift-insights/insights-runtime-extractor-cbktn" Jun 09 05:32:54.463827 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:54.463779 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/88b8a41e-19a5-4323-b7d1-387ae87392ee-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cbktn\" (UID: \"88b8a41e-19a5-4323-b7d1-387ae87392ee\") " pod="openshift-insights/insights-runtime-extractor-cbktn" Jun 09 05:32:54.464024 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:54.463875 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xf6gl\" (UniqueName: \"kubernetes.io/projected/88b8a41e-19a5-4323-b7d1-387ae87392ee-kube-api-access-xf6gl\") pod \"insights-runtime-extractor-cbktn\" (UID: \"88b8a41e-19a5-4323-b7d1-387ae87392ee\") " pod="openshift-insights/insights-runtime-extractor-cbktn" Jun 09 05:32:54.464024 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:54.463895 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/88b8a41e-19a5-4323-b7d1-387ae87392ee-crio-socket\") pod \"insights-runtime-extractor-cbktn\" (UID: \"88b8a41e-19a5-4323-b7d1-387ae87392ee\") " pod="openshift-insights/insights-runtime-extractor-cbktn" Jun 09 05:32:54.464024 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:54.463912 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/88b8a41e-19a5-4323-b7d1-387ae87392ee-data-volume\") pod \"insights-runtime-extractor-cbktn\" (UID: \"88b8a41e-19a5-4323-b7d1-387ae87392ee\") " pod="openshift-insights/insights-runtime-extractor-cbktn" Jun 09 05:32:54.464024 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:54.463934 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/88b8a41e-19a5-4323-b7d1-387ae87392ee-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cbktn\" (UID: \"88b8a41e-19a5-4323-b7d1-387ae87392ee\") " pod="openshift-insights/insights-runtime-extractor-cbktn" Jun 09 05:32:54.464024 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:54.463997 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/88b8a41e-19a5-4323-b7d1-387ae87392ee-crio-socket\") pod \"insights-runtime-extractor-cbktn\" (UID: \"88b8a41e-19a5-4323-b7d1-387ae87392ee\") " pod="openshift-insights/insights-runtime-extractor-cbktn" Jun 09 05:32:54.464315 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:54.464292 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/88b8a41e-19a5-4323-b7d1-387ae87392ee-data-volume\") pod \"insights-runtime-extractor-cbktn\" (UID: \"88b8a41e-19a5-4323-b7d1-387ae87392ee\") " pod="openshift-insights/insights-runtime-extractor-cbktn" Jun 09 05:32:54.464522 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:54.464506 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/88b8a41e-19a5-4323-b7d1-387ae87392ee-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cbktn\" (UID: \"88b8a41e-19a5-4323-b7d1-387ae87392ee\") " pod="openshift-insights/insights-runtime-extractor-cbktn" Jun 09 05:32:54.466090 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:54.466069 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/88b8a41e-19a5-4323-b7d1-387ae87392ee-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cbktn\" (UID: \"88b8a41e-19a5-4323-b7d1-387ae87392ee\") " pod="openshift-insights/insights-runtime-extractor-cbktn" Jun 09 05:32:54.475049 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:54.475028 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xf6gl\" (UniqueName: \"kubernetes.io/projected/88b8a41e-19a5-4323-b7d1-387ae87392ee-kube-api-access-xf6gl\") pod \"insights-runtime-extractor-cbktn\" (UID: \"88b8a41e-19a5-4323-b7d1-387ae87392ee\") " pod="openshift-insights/insights-runtime-extractor-cbktn" Jun 09 05:32:54.571149 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:54.571118 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cbktn" Jun 09 05:32:54.692684 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:54.692653 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cbktn"] Jun 09 05:32:54.695435 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:32:54.695406 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88b8a41e_19a5_4323_b7d1_387ae87392ee.slice/crio-c8d22ff941b237fe6e1db10a32cdf45679c4a67df321dbd447a43d3a4f242cfe WatchSource:0}: Error finding container c8d22ff941b237fe6e1db10a32cdf45679c4a67df321dbd447a43d3a4f242cfe: Status 404 returned error can't find the container with id c8d22ff941b237fe6e1db10a32cdf45679c4a67df321dbd447a43d3a4f242cfe Jun 09 05:32:55.047300 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:55.047266 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cbktn" event={"ID":"88b8a41e-19a5-4323-b7d1-387ae87392ee","Type":"ContainerStarted","Data":"3c0a261faa43b9a72eba0f944f1c152a474be2d09cf3bf614f043e778e597727"} Jun 09 05:32:55.047449 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:55.047323 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cbktn" event={"ID":"88b8a41e-19a5-4323-b7d1-387ae87392ee","Type":"ContainerStarted","Data":"c8d22ff941b237fe6e1db10a32cdf45679c4a67df321dbd447a43d3a4f242cfe"} Jun 09 05:32:56.055107 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:56.055069 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cbktn" event={"ID":"88b8a41e-19a5-4323-b7d1-387ae87392ee","Type":"ContainerStarted","Data":"a79fb8fa02c4cd2f8f092e9dc92334f1d5c62f9ec677f2b9370c4af5c366c0e1"} Jun 09 05:32:57.062655 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:57.062616 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cbktn" event={"ID":"88b8a41e-19a5-4323-b7d1-387ae87392ee","Type":"ContainerStarted","Data":"ebab99eaba9985888eef5d814e0f1e9665954cc13525990d7015521031595500"} Jun 09 05:32:57.079062 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:57.079017 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-cbktn" podStartSLOduration=1.019165463 podStartE2EDuration="3.079001292s" totalImagesPullingTime="2.059835829s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 05:32:54 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 05:32:57.07836786 +0000 UTC m=+227.161019595" watchObservedRunningTime="2026-06-09 05:32:57.079001292 +0000 UTC m=+227.161653030" Jun 09 05:32:59.610363 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:59.610320 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/75d2abf6-37dc-42d2-875e-1cb1b449f1f4-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-kwf45\" (UID: \"75d2abf6-37dc-42d2-875e-1cb1b449f1f4\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-kwf45" Jun 09 05:32:59.612585 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:59.612567 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/75d2abf6-37dc-42d2-875e-1cb1b449f1f4-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-kwf45\" (UID: \"75d2abf6-37dc-42d2-875e-1cb1b449f1f4\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-kwf45" Jun 09 05:32:59.851415 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:59.851378 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-kwf45" Jun 09 05:32:59.971301 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:32:59.971276 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-kwf45"] Jun 09 05:32:59.973659 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:32:59.973634 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75d2abf6_37dc_42d2_875e_1cb1b449f1f4.slice/crio-b96979a8fe2ffc0166fc1e0f06ba93efe4defbe4d2a17eeba7ce54331cc2babe WatchSource:0}: Error finding container b96979a8fe2ffc0166fc1e0f06ba93efe4defbe4d2a17eeba7ce54331cc2babe: Status 404 returned error can't find the container with id b96979a8fe2ffc0166fc1e0f06ba93efe4defbe4d2a17eeba7ce54331cc2babe Jun 09 05:33:00.073805 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:00.073762 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-kwf45" event={"ID":"75d2abf6-37dc-42d2-875e-1cb1b449f1f4","Type":"ContainerStarted","Data":"b96979a8fe2ffc0166fc1e0f06ba93efe4defbe4d2a17eeba7ce54331cc2babe"} Jun 09 05:33:01.935657 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:01.935629 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-khfkm"] Jun 09 05:33:01.937701 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:01.937687 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-khfkm" Jun 09 05:33:01.939808 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:01.939782 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 09 05:33:01.939928 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:01.939907 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-4jvpn\"" Jun 09 05:33:01.952721 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:01.952703 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-khfkm"] Jun 09 05:33:02.030201 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:02.030172 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/59b54565-7d99-4561-9b2d-b26a494a8fef-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-khfkm\" (UID: \"59b54565-7d99-4561-9b2d-b26a494a8fef\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-khfkm" Jun 09 05:33:02.082219 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:02.082184 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-kwf45" event={"ID":"75d2abf6-37dc-42d2-875e-1cb1b449f1f4","Type":"ContainerStarted","Data":"2735000866e15f1c92ba7d6e8606d07debe4a73c1760df3e273f2ec5b334d375"} Jun 09 05:33:02.095608 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:02.095565 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-kwf45" podStartSLOduration=33.75452605 podStartE2EDuration="35.095551254s" totalImagesPullingTime="1.341025204s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 05:32:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 05:33:02.094285531 +0000 UTC m=+232.176937268" watchObservedRunningTime="2026-06-09 05:33:02.095551254 +0000 UTC m=+232.178202990" Jun 09 05:33:02.130991 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:02.130965 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/59b54565-7d99-4561-9b2d-b26a494a8fef-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-khfkm\" (UID: \"59b54565-7d99-4561-9b2d-b26a494a8fef\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-khfkm" Jun 09 05:33:02.131119 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:33:02.131101 2564 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jun 09 05:33:02.131182 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:33:02.131163 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59b54565-7d99-4561-9b2d-b26a494a8fef-tls-certificates podName:59b54565-7d99-4561-9b2d-b26a494a8fef nodeName:}" failed. No retries permitted until 2026-06-09 05:33:02.63114472 +0000 UTC m=+232.713796437 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/59b54565-7d99-4561-9b2d-b26a494a8fef-tls-certificates") pod "prometheus-operator-admission-webhook-5b6b8f594-khfkm" (UID: "59b54565-7d99-4561-9b2d-b26a494a8fef") : secret "prometheus-operator-admission-webhook-tls" not found Jun 09 05:33:02.634437 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:02.634408 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/59b54565-7d99-4561-9b2d-b26a494a8fef-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-khfkm\" (UID: \"59b54565-7d99-4561-9b2d-b26a494a8fef\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-khfkm" Jun 09 05:33:02.636643 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:02.636617 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/59b54565-7d99-4561-9b2d-b26a494a8fef-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-khfkm\" (UID: \"59b54565-7d99-4561-9b2d-b26a494a8fef\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-khfkm" Jun 09 05:33:02.846099 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:02.846073 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-khfkm" Jun 09 05:33:02.979924 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:02.979898 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-khfkm"] Jun 09 05:33:02.982856 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:33:02.982821 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59b54565_7d99_4561_9b2d_b26a494a8fef.slice/crio-50a3896c6d740d3c3b455ba21a1bfb8bbc0c4959cc4252d28c5f2335c19b2ec1 WatchSource:0}: Error finding container 50a3896c6d740d3c3b455ba21a1bfb8bbc0c4959cc4252d28c5f2335c19b2ec1: Status 404 returned error can't find the container with id 50a3896c6d740d3c3b455ba21a1bfb8bbc0c4959cc4252d28c5f2335c19b2ec1 Jun 09 05:33:03.073440 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:03.073403 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-685f578bdb-nmlg4"] Jun 09 05:33:03.076137 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:03.076114 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-685f578bdb-nmlg4" Jun 09 05:33:03.078294 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:03.078267 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 09 05:33:03.079468 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:03.079423 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 09 05:33:03.079468 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:03.079433 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 09 05:33:03.079468 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:03.079425 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-pm8wp\"" Jun 09 05:33:03.079615 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:03.079488 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 09 05:33:03.079615 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:03.079517 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 09 05:33:03.079810 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:03.079779 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 09 05:33:03.079904 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:03.079778 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 09 05:33:03.086166 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:03.086145 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-685f578bdb-nmlg4"] Jun 09 05:33:03.086560 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:03.086526 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-khfkm" event={"ID":"59b54565-7d99-4561-9b2d-b26a494a8fef","Type":"ContainerStarted","Data":"50a3896c6d740d3c3b455ba21a1bfb8bbc0c4959cc4252d28c5f2335c19b2ec1"} Jun 09 05:33:03.138144 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:03.138116 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/27f5c4e4-b1f4-4132-80be-a3d46df42f4e-console-serving-cert\") pod \"console-685f578bdb-nmlg4\" (UID: \"27f5c4e4-b1f4-4132-80be-a3d46df42f4e\") " pod="openshift-console/console-685f578bdb-nmlg4" Jun 09 05:33:03.138265 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:03.138155 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/27f5c4e4-b1f4-4132-80be-a3d46df42f4e-service-ca\") pod \"console-685f578bdb-nmlg4\" (UID: \"27f5c4e4-b1f4-4132-80be-a3d46df42f4e\") " pod="openshift-console/console-685f578bdb-nmlg4" Jun 09 05:33:03.138265 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:03.138180 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/27f5c4e4-b1f4-4132-80be-a3d46df42f4e-console-config\") pod \"console-685f578bdb-nmlg4\" (UID: \"27f5c4e4-b1f4-4132-80be-a3d46df42f4e\") " pod="openshift-console/console-685f578bdb-nmlg4" Jun 09 05:33:03.138265 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:03.138249 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/27f5c4e4-b1f4-4132-80be-a3d46df42f4e-oauth-serving-cert\") pod \"console-685f578bdb-nmlg4\" (UID: \"27f5c4e4-b1f4-4132-80be-a3d46df42f4e\") " pod="openshift-console/console-685f578bdb-nmlg4" Jun 09 05:33:03.138422 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:03.138290 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbxqh\" (UniqueName: \"kubernetes.io/projected/27f5c4e4-b1f4-4132-80be-a3d46df42f4e-kube-api-access-vbxqh\") pod \"console-685f578bdb-nmlg4\" (UID: \"27f5c4e4-b1f4-4132-80be-a3d46df42f4e\") " pod="openshift-console/console-685f578bdb-nmlg4" Jun 09 05:33:03.138422 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:03.138338 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/27f5c4e4-b1f4-4132-80be-a3d46df42f4e-console-oauth-config\") pod \"console-685f578bdb-nmlg4\" (UID: \"27f5c4e4-b1f4-4132-80be-a3d46df42f4e\") " pod="openshift-console/console-685f578bdb-nmlg4" Jun 09 05:33:03.239651 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:03.239591 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/27f5c4e4-b1f4-4132-80be-a3d46df42f4e-console-oauth-config\") pod \"console-685f578bdb-nmlg4\" (UID: \"27f5c4e4-b1f4-4132-80be-a3d46df42f4e\") " pod="openshift-console/console-685f578bdb-nmlg4" Jun 09 05:33:03.239651 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:03.239635 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/27f5c4e4-b1f4-4132-80be-a3d46df42f4e-console-serving-cert\") pod \"console-685f578bdb-nmlg4\" (UID: \"27f5c4e4-b1f4-4132-80be-a3d46df42f4e\") " pod="openshift-console/console-685f578bdb-nmlg4" Jun 09 05:33:03.239817 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:03.239779 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/27f5c4e4-b1f4-4132-80be-a3d46df42f4e-service-ca\") pod \"console-685f578bdb-nmlg4\" (UID: \"27f5c4e4-b1f4-4132-80be-a3d46df42f4e\") " pod="openshift-console/console-685f578bdb-nmlg4" Jun 09 05:33:03.239870 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:03.239838 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/27f5c4e4-b1f4-4132-80be-a3d46df42f4e-console-config\") pod \"console-685f578bdb-nmlg4\" (UID: \"27f5c4e4-b1f4-4132-80be-a3d46df42f4e\") " pod="openshift-console/console-685f578bdb-nmlg4" Jun 09 05:33:03.239929 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:03.239910 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/27f5c4e4-b1f4-4132-80be-a3d46df42f4e-oauth-serving-cert\") pod \"console-685f578bdb-nmlg4\" (UID: \"27f5c4e4-b1f4-4132-80be-a3d46df42f4e\") " pod="openshift-console/console-685f578bdb-nmlg4" Jun 09 05:33:03.239985 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:03.239934 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbxqh\" (UniqueName: \"kubernetes.io/projected/27f5c4e4-b1f4-4132-80be-a3d46df42f4e-kube-api-access-vbxqh\") pod \"console-685f578bdb-nmlg4\" (UID: \"27f5c4e4-b1f4-4132-80be-a3d46df42f4e\") " pod="openshift-console/console-685f578bdb-nmlg4" Jun 09 05:33:03.240473 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:03.240452 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/27f5c4e4-b1f4-4132-80be-a3d46df42f4e-service-ca\") pod \"console-685f578bdb-nmlg4\" (UID: \"27f5c4e4-b1f4-4132-80be-a3d46df42f4e\") " pod="openshift-console/console-685f578bdb-nmlg4" Jun 09 05:33:03.240585 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:03.240563 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/27f5c4e4-b1f4-4132-80be-a3d46df42f4e-console-config\") pod \"console-685f578bdb-nmlg4\" (UID: \"27f5c4e4-b1f4-4132-80be-a3d46df42f4e\") " pod="openshift-console/console-685f578bdb-nmlg4" Jun 09 05:33:03.240650 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:03.240629 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/27f5c4e4-b1f4-4132-80be-a3d46df42f4e-oauth-serving-cert\") pod \"console-685f578bdb-nmlg4\" (UID: \"27f5c4e4-b1f4-4132-80be-a3d46df42f4e\") " pod="openshift-console/console-685f578bdb-nmlg4" Jun 09 05:33:03.242143 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:03.242118 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/27f5c4e4-b1f4-4132-80be-a3d46df42f4e-console-oauth-config\") pod \"console-685f578bdb-nmlg4\" (UID: \"27f5c4e4-b1f4-4132-80be-a3d46df42f4e\") " pod="openshift-console/console-685f578bdb-nmlg4" Jun 09 05:33:03.242222 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:03.242124 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/27f5c4e4-b1f4-4132-80be-a3d46df42f4e-console-serving-cert\") pod \"console-685f578bdb-nmlg4\" (UID: \"27f5c4e4-b1f4-4132-80be-a3d46df42f4e\") " pod="openshift-console/console-685f578bdb-nmlg4" Jun 09 05:33:03.246879 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:03.246857 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbxqh\" (UniqueName: \"kubernetes.io/projected/27f5c4e4-b1f4-4132-80be-a3d46df42f4e-kube-api-access-vbxqh\") pod \"console-685f578bdb-nmlg4\" (UID: \"27f5c4e4-b1f4-4132-80be-a3d46df42f4e\") " pod="openshift-console/console-685f578bdb-nmlg4" Jun 09 05:33:03.387065 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:03.387042 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-685f578bdb-nmlg4" Jun 09 05:33:03.509767 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:03.509610 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-685f578bdb-nmlg4"] Jun 09 05:33:03.512574 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:33:03.512543 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27f5c4e4_b1f4_4132_80be_a3d46df42f4e.slice/crio-50e8d56dc431afc5b060352ee7033eb95496971e1f051fba48ce81de5687dced WatchSource:0}: Error finding container 50e8d56dc431afc5b060352ee7033eb95496971e1f051fba48ce81de5687dced: Status 404 returned error can't find the container with id 50e8d56dc431afc5b060352ee7033eb95496971e1f051fba48ce81de5687dced Jun 09 05:33:04.092895 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:04.092865 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-685f578bdb-nmlg4" event={"ID":"27f5c4e4-b1f4-4132-80be-a3d46df42f4e","Type":"ContainerStarted","Data":"50e8d56dc431afc5b060352ee7033eb95496971e1f051fba48ce81de5687dced"} Jun 09 05:33:04.094513 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:04.094490 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-khfkm" event={"ID":"59b54565-7d99-4561-9b2d-b26a494a8fef","Type":"ContainerStarted","Data":"1d047a6c013ef2edfc13ae1b8a5fe1bfc2724e39ba9377001b1f4490429131cc"} Jun 09 05:33:04.094733 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:04.094715 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-khfkm" Jun 09 05:33:04.099409 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:04.099388 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-khfkm" Jun 09 05:33:04.109689 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:04.109654 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-khfkm" podStartSLOduration=2.139655259 podStartE2EDuration="3.109641228s" totalImagesPullingTime="969.985969ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 05:33:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 05:33:04.108988941 +0000 UTC m=+234.191640689" watchObservedRunningTime="2026-06-09 05:33:04.109641228 +0000 UTC m=+234.192292982" Jun 09 05:33:04.298930 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:04.298902 2564 patch_prober.go:28] interesting pod/image-registry-9ffff86c7-mcqvf container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 05:33:04.299158 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:04.298947 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-9ffff86c7-mcqvf" podUID="09110d03-6ef0-4c54-afb7-872377f07269" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 05:33:04.872909 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:04.872879 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8f84b5d59-rhn74"] Jun 09 05:33:04.875357 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:04.875342 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8f84b5d59-rhn74" Jun 09 05:33:04.882526 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:04.882505 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 09 05:33:04.884836 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:04.884814 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8f84b5d59-rhn74"] Jun 09 05:33:04.955360 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:04.955335 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d348c05-f72b-4145-8152-9ba13b80a0af-oauth-serving-cert\") pod \"console-8f84b5d59-rhn74\" (UID: \"3d348c05-f72b-4145-8152-9ba13b80a0af\") " pod="openshift-console/console-8f84b5d59-rhn74" Jun 09 05:33:04.955462 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:04.955366 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d348c05-f72b-4145-8152-9ba13b80a0af-console-oauth-config\") pod \"console-8f84b5d59-rhn74\" (UID: \"3d348c05-f72b-4145-8152-9ba13b80a0af\") " pod="openshift-console/console-8f84b5d59-rhn74" Jun 09 05:33:04.955462 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:04.955384 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d348c05-f72b-4145-8152-9ba13b80a0af-console-config\") pod \"console-8f84b5d59-rhn74\" (UID: \"3d348c05-f72b-4145-8152-9ba13b80a0af\") " pod="openshift-console/console-8f84b5d59-rhn74" Jun 09 05:33:04.955540 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:04.955464 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d348c05-f72b-4145-8152-9ba13b80a0af-service-ca\") pod \"console-8f84b5d59-rhn74\" (UID: \"3d348c05-f72b-4145-8152-9ba13b80a0af\") " pod="openshift-console/console-8f84b5d59-rhn74" Jun 09 05:33:04.955540 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:04.955493 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d348c05-f72b-4145-8152-9ba13b80a0af-console-serving-cert\") pod \"console-8f84b5d59-rhn74\" (UID: \"3d348c05-f72b-4145-8152-9ba13b80a0af\") " pod="openshift-console/console-8f84b5d59-rhn74" Jun 09 05:33:04.955540 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:04.955513 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d348c05-f72b-4145-8152-9ba13b80a0af-trusted-ca-bundle\") pod \"console-8f84b5d59-rhn74\" (UID: \"3d348c05-f72b-4145-8152-9ba13b80a0af\") " pod="openshift-console/console-8f84b5d59-rhn74" Jun 09 05:33:04.955540 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:04.955533 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkqlt\" (UniqueName: \"kubernetes.io/projected/3d348c05-f72b-4145-8152-9ba13b80a0af-kube-api-access-hkqlt\") pod \"console-8f84b5d59-rhn74\" (UID: \"3d348c05-f72b-4145-8152-9ba13b80a0af\") " pod="openshift-console/console-8f84b5d59-rhn74" Jun 09 05:33:05.056189 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:05.056165 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d348c05-f72b-4145-8152-9ba13b80a0af-oauth-serving-cert\") pod \"console-8f84b5d59-rhn74\" (UID: \"3d348c05-f72b-4145-8152-9ba13b80a0af\") " pod="openshift-console/console-8f84b5d59-rhn74" Jun 09 05:33:05.056311 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:05.056194 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d348c05-f72b-4145-8152-9ba13b80a0af-console-oauth-config\") pod \"console-8f84b5d59-rhn74\" (UID: \"3d348c05-f72b-4145-8152-9ba13b80a0af\") " pod="openshift-console/console-8f84b5d59-rhn74" Jun 09 05:33:05.056311 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:05.056212 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d348c05-f72b-4145-8152-9ba13b80a0af-console-config\") pod \"console-8f84b5d59-rhn74\" (UID: \"3d348c05-f72b-4145-8152-9ba13b80a0af\") " pod="openshift-console/console-8f84b5d59-rhn74" Jun 09 05:33:05.056419 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:05.056395 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d348c05-f72b-4145-8152-9ba13b80a0af-service-ca\") pod \"console-8f84b5d59-rhn74\" (UID: \"3d348c05-f72b-4145-8152-9ba13b80a0af\") " pod="openshift-console/console-8f84b5d59-rhn74" Jun 09 05:33:05.056464 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:05.056434 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d348c05-f72b-4145-8152-9ba13b80a0af-console-serving-cert\") pod \"console-8f84b5d59-rhn74\" (UID: \"3d348c05-f72b-4145-8152-9ba13b80a0af\") " pod="openshift-console/console-8f84b5d59-rhn74" Jun 09 05:33:05.056602 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:05.056574 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d348c05-f72b-4145-8152-9ba13b80a0af-trusted-ca-bundle\") pod \"console-8f84b5d59-rhn74\" (UID: \"3d348c05-f72b-4145-8152-9ba13b80a0af\") " pod="openshift-console/console-8f84b5d59-rhn74" Jun 09 05:33:05.056684 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:05.056623 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkqlt\" (UniqueName: \"kubernetes.io/projected/3d348c05-f72b-4145-8152-9ba13b80a0af-kube-api-access-hkqlt\") pod \"console-8f84b5d59-rhn74\" (UID: \"3d348c05-f72b-4145-8152-9ba13b80a0af\") " pod="openshift-console/console-8f84b5d59-rhn74" Jun 09 05:33:05.057022 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:05.056971 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d348c05-f72b-4145-8152-9ba13b80a0af-oauth-serving-cert\") pod \"console-8f84b5d59-rhn74\" (UID: \"3d348c05-f72b-4145-8152-9ba13b80a0af\") " pod="openshift-console/console-8f84b5d59-rhn74" Jun 09 05:33:05.057124 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:05.057030 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d348c05-f72b-4145-8152-9ba13b80a0af-console-config\") pod \"console-8f84b5d59-rhn74\" (UID: \"3d348c05-f72b-4145-8152-9ba13b80a0af\") " pod="openshift-console/console-8f84b5d59-rhn74" Jun 09 05:33:05.057124 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:05.057087 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d348c05-f72b-4145-8152-9ba13b80a0af-service-ca\") pod \"console-8f84b5d59-rhn74\" (UID: \"3d348c05-f72b-4145-8152-9ba13b80a0af\") " pod="openshift-console/console-8f84b5d59-rhn74" Jun 09 05:33:05.057494 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:05.057472 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d348c05-f72b-4145-8152-9ba13b80a0af-trusted-ca-bundle\") pod \"console-8f84b5d59-rhn74\" (UID: \"3d348c05-f72b-4145-8152-9ba13b80a0af\") " pod="openshift-console/console-8f84b5d59-rhn74" Jun 09 05:33:05.059015 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:05.058992 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d348c05-f72b-4145-8152-9ba13b80a0af-console-oauth-config\") pod \"console-8f84b5d59-rhn74\" (UID: \"3d348c05-f72b-4145-8152-9ba13b80a0af\") " pod="openshift-console/console-8f84b5d59-rhn74" Jun 09 05:33:05.059191 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:05.059173 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d348c05-f72b-4145-8152-9ba13b80a0af-console-serving-cert\") pod \"console-8f84b5d59-rhn74\" (UID: \"3d348c05-f72b-4145-8152-9ba13b80a0af\") " pod="openshift-console/console-8f84b5d59-rhn74" Jun 09 05:33:05.063998 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:05.063976 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkqlt\" (UniqueName: \"kubernetes.io/projected/3d348c05-f72b-4145-8152-9ba13b80a0af-kube-api-access-hkqlt\") pod \"console-8f84b5d59-rhn74\" (UID: \"3d348c05-f72b-4145-8152-9ba13b80a0af\") " pod="openshift-console/console-8f84b5d59-rhn74" Jun 09 05:33:05.184983 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:05.184900 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8f84b5d59-rhn74" Jun 09 05:33:05.329109 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:05.329085 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8f84b5d59-rhn74"] Jun 09 05:33:05.331523 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:33:05.331495 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d348c05_f72b_4145_8152_9ba13b80a0af.slice/crio-ae478603e4fdeff4380582d442527ad5870c781a144bad1d491e536f73ecca69 WatchSource:0}: Error finding container ae478603e4fdeff4380582d442527ad5870c781a144bad1d491e536f73ecca69: Status 404 returned error can't find the container with id ae478603e4fdeff4380582d442527ad5870c781a144bad1d491e536f73ecca69 Jun 09 05:33:06.104525 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:06.104488 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8f84b5d59-rhn74" event={"ID":"3d348c05-f72b-4145-8152-9ba13b80a0af","Type":"ContainerStarted","Data":"ae478603e4fdeff4380582d442527ad5870c781a144bad1d491e536f73ecca69"} Jun 09 05:33:08.112930 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:08.112892 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-685f578bdb-nmlg4" event={"ID":"27f5c4e4-b1f4-4132-80be-a3d46df42f4e","Type":"ContainerStarted","Data":"0a2a087ca88cd991a4e138086ac01eaab841a54ecae7e924a536066441ae9722"} Jun 09 05:33:08.116732 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:08.116705 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8f84b5d59-rhn74" event={"ID":"3d348c05-f72b-4145-8152-9ba13b80a0af","Type":"ContainerStarted","Data":"e479f3b73227116b2496479f1e37ee7a5c29c9df418ccf0e4149c9144a916062"} Jun 09 05:33:08.128432 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:08.128392 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-685f578bdb-nmlg4" podStartSLOduration=1.276865597 podStartE2EDuration="5.128378443s" totalImagesPullingTime="3.851512846s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 05:33:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 05:33:08.127634544 +0000 UTC m=+238.210286279" watchObservedRunningTime="2026-06-09 05:33:08.128378443 +0000 UTC m=+238.211030247" Jun 09 05:33:08.142984 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:08.142946 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8f84b5d59-rhn74" podStartSLOduration=2.103887153 podStartE2EDuration="4.142933638s" totalImagesPullingTime="2.039046485s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 05:33:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 05:33:08.142140176 +0000 UTC m=+238.224791912" watchObservedRunningTime="2026-06-09 05:33:08.142933638 +0000 UTC m=+238.225585374" Jun 09 05:33:09.313765 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:09.313734 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-rnsbg"] Jun 09 05:33:09.316239 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:09.316216 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-rnsbg" Jun 09 05:33:09.318374 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:09.318354 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 09 05:33:09.318512 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:09.318362 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 09 05:33:09.318582 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:09.318566 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 09 05:33:09.319568 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:09.319545 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 09 05:33:09.319670 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:09.319572 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 09 05:33:09.319670 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:09.319588 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-5wqcw\"" Jun 09 05:33:09.327742 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:09.327721 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-rnsbg"] Jun 09 05:33:09.338012 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:09.337993 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-25bwf"] Jun 09 05:33:09.340096 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:09.340080 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-25bwf" Jun 09 05:33:09.342349 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:09.342329 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 09 05:33:09.342444 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:09.342414 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-wgd4p\"" Jun 09 05:33:09.342526 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:09.342508 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 09 05:33:09.342624 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:09.342603 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 09 05:33:09.392957 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:09.392934 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/73457598-81c7-40a6-8ac6-f3e89ce31b36-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-rnsbg\" (UID: \"73457598-81c7-40a6-8ac6-f3e89ce31b36\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-rnsbg" Jun 09 05:33:09.393049 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:09.392994 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/73457598-81c7-40a6-8ac6-f3e89ce31b36-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-rnsbg\" (UID: \"73457598-81c7-40a6-8ac6-f3e89ce31b36\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-rnsbg" Jun 09 05:33:09.393049 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:09.393014 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8k56\" (UniqueName: \"kubernetes.io/projected/73457598-81c7-40a6-8ac6-f3e89ce31b36-kube-api-access-k8k56\") pod \"openshift-state-metrics-65f78d5c66-rnsbg\" (UID: \"73457598-81c7-40a6-8ac6-f3e89ce31b36\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-rnsbg" Jun 09 05:33:09.393129 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:09.393052 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73457598-81c7-40a6-8ac6-f3e89ce31b36-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-rnsbg\" (UID: \"73457598-81c7-40a6-8ac6-f3e89ce31b36\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-rnsbg" Jun 09 05:33:09.493538 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:09.493509 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3837e945-5f86-443f-b2c1-a68dca1b5d7d-node-exporter-accelerators-collector-config\") pod \"node-exporter-25bwf\" (UID: \"3837e945-5f86-443f-b2c1-a68dca1b5d7d\") " pod="openshift-monitoring/node-exporter-25bwf" Jun 09 05:33:09.493654 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:09.493540 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3837e945-5f86-443f-b2c1-a68dca1b5d7d-root\") pod \"node-exporter-25bwf\" (UID: \"3837e945-5f86-443f-b2c1-a68dca1b5d7d\") " pod="openshift-monitoring/node-exporter-25bwf" Jun 09 05:33:09.493654 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:09.493571 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/73457598-81c7-40a6-8ac6-f3e89ce31b36-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-rnsbg\" (UID: \"73457598-81c7-40a6-8ac6-f3e89ce31b36\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-rnsbg" Jun 09 05:33:09.493654 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:09.493629 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3837e945-5f86-443f-b2c1-a68dca1b5d7d-metrics-client-ca\") pod \"node-exporter-25bwf\" (UID: \"3837e945-5f86-443f-b2c1-a68dca1b5d7d\") " pod="openshift-monitoring/node-exporter-25bwf" Jun 09 05:33:09.493829 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:09.493667 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3837e945-5f86-443f-b2c1-a68dca1b5d7d-node-exporter-textfile\") pod \"node-exporter-25bwf\" (UID: \"3837e945-5f86-443f-b2c1-a68dca1b5d7d\") " pod="openshift-monitoring/node-exporter-25bwf" Jun 09 05:33:09.493829 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:09.493688 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3837e945-5f86-443f-b2c1-a68dca1b5d7d-node-exporter-wtmp\") pod \"node-exporter-25bwf\" (UID: \"3837e945-5f86-443f-b2c1-a68dca1b5d7d\") " pod="openshift-monitoring/node-exporter-25bwf" Jun 09 05:33:09.493829 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:09.493721 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-446kh\" (UniqueName: \"kubernetes.io/projected/3837e945-5f86-443f-b2c1-a68dca1b5d7d-kube-api-access-446kh\") pod \"node-exporter-25bwf\" (UID: \"3837e945-5f86-443f-b2c1-a68dca1b5d7d\") " pod="openshift-monitoring/node-exporter-25bwf" Jun 09 05:33:09.493829 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:09.493746 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/73457598-81c7-40a6-8ac6-f3e89ce31b36-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-rnsbg\" (UID: \"73457598-81c7-40a6-8ac6-f3e89ce31b36\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-rnsbg" Jun 09 05:33:09.494018 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:33:09.493832 2564 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jun 09 05:33:09.494018 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:09.493834 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8k56\" (UniqueName: \"kubernetes.io/projected/73457598-81c7-40a6-8ac6-f3e89ce31b36-kube-api-access-k8k56\") pod \"openshift-state-metrics-65f78d5c66-rnsbg\" (UID: \"73457598-81c7-40a6-8ac6-f3e89ce31b36\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-rnsbg" Jun 09 05:33:09.494018 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:33:09.493873 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73457598-81c7-40a6-8ac6-f3e89ce31b36-openshift-state-metrics-tls podName:73457598-81c7-40a6-8ac6-f3e89ce31b36 nodeName:}" failed. No retries permitted until 2026-06-09 05:33:09.993859756 +0000 UTC m=+240.076511470 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/73457598-81c7-40a6-8ac6-f3e89ce31b36-openshift-state-metrics-tls") pod "openshift-state-metrics-65f78d5c66-rnsbg" (UID: "73457598-81c7-40a6-8ac6-f3e89ce31b36") : secret "openshift-state-metrics-tls" not found Jun 09 05:33:09.494018 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:09.493886 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3837e945-5f86-443f-b2c1-a68dca1b5d7d-node-exporter-tls\") pod \"node-exporter-25bwf\" (UID: \"3837e945-5f86-443f-b2c1-a68dca1b5d7d\") " pod="openshift-monitoring/node-exporter-25bwf" Jun 09 05:33:09.494018 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:09.493914 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73457598-81c7-40a6-8ac6-f3e89ce31b36-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-rnsbg\" (UID: \"73457598-81c7-40a6-8ac6-f3e89ce31b36\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-rnsbg" Jun 09 05:33:09.494018 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:09.493958 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3837e945-5f86-443f-b2c1-a68dca1b5d7d-sys\") pod \"node-exporter-25bwf\" (UID: \"3837e945-5f86-443f-b2c1-a68dca1b5d7d\") " pod="openshift-monitoring/node-exporter-25bwf" Jun 09 05:33:09.494018 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:09.493982 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3837e945-5f86-443f-b2c1-a68dca1b5d7d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-25bwf\" (UID: \"3837e945-5f86-443f-b2c1-a68dca1b5d7d\") " pod="openshift-monitoring/node-exporter-25bwf" Jun 09 05:33:09.494582 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:09.494565 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73457598-81c7-40a6-8ac6-f3e89ce31b36-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-rnsbg\" (UID: \"73457598-81c7-40a6-8ac6-f3e89ce31b36\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-rnsbg" Jun 09 05:33:09.495998 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:09.495977 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/73457598-81c7-40a6-8ac6-f3e89ce31b36-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-rnsbg\" (UID: \"73457598-81c7-40a6-8ac6-f3e89ce31b36\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-rnsbg" Jun 09 05:33:09.501909 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:09.501886 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8k56\" (UniqueName: \"kubernetes.io/projected/73457598-81c7-40a6-8ac6-f3e89ce31b36-kube-api-access-k8k56\") pod \"openshift-state-metrics-65f78d5c66-rnsbg\" (UID: \"73457598-81c7-40a6-8ac6-f3e89ce31b36\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-rnsbg" Jun 09 05:33:09.594783 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:09.594721 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3837e945-5f86-443f-b2c1-a68dca1b5d7d-metrics-client-ca\") pod \"node-exporter-25bwf\" (UID: \"3837e945-5f86-443f-b2c1-a68dca1b5d7d\") " pod="openshift-monitoring/node-exporter-25bwf" Jun 09 05:33:09.594783 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:09.594764 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3837e945-5f86-443f-b2c1-a68dca1b5d7d-node-exporter-textfile\") pod \"node-exporter-25bwf\" (UID: \"3837e945-5f86-443f-b2c1-a68dca1b5d7d\") " pod="openshift-monitoring/node-exporter-25bwf" Jun 09 05:33:09.594783 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:09.594781 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3837e945-5f86-443f-b2c1-a68dca1b5d7d-node-exporter-wtmp\") pod \"node-exporter-25bwf\" (UID: \"3837e945-5f86-443f-b2c1-a68dca1b5d7d\") " pod="openshift-monitoring/node-exporter-25bwf" Jun 09 05:33:09.595003 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:09.594836 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-446kh\" (UniqueName: \"kubernetes.io/projected/3837e945-5f86-443f-b2c1-a68dca1b5d7d-kube-api-access-446kh\") pod \"node-exporter-25bwf\" (UID: \"3837e945-5f86-443f-b2c1-a68dca1b5d7d\") " pod="openshift-monitoring/node-exporter-25bwf" Jun 09 05:33:09.595003 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:09.594876 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3837e945-5f86-443f-b2c1-a68dca1b5d7d-node-exporter-tls\") pod \"node-exporter-25bwf\" (UID: \"3837e945-5f86-443f-b2c1-a68dca1b5d7d\") " pod="openshift-monitoring/node-exporter-25bwf" Jun 09 05:33:09.595003 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:09.594897 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3837e945-5f86-443f-b2c1-a68dca1b5d7d-sys\") pod \"node-exporter-25bwf\" (UID: \"3837e945-5f86-443f-b2c1-a68dca1b5d7d\") " pod="openshift-monitoring/node-exporter-25bwf" Jun 09 05:33:09.595003 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:09.594925 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3837e945-5f86-443f-b2c1-a68dca1b5d7d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-25bwf\" (UID: \"3837e945-5f86-443f-b2c1-a68dca1b5d7d\") " pod="openshift-monitoring/node-exporter-25bwf" Jun 09 05:33:09.595003 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:09.594967 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3837e945-5f86-443f-b2c1-a68dca1b5d7d-node-exporter-accelerators-collector-config\") pod \"node-exporter-25bwf\" (UID: \"3837e945-5f86-443f-b2c1-a68dca1b5d7d\") " pod="openshift-monitoring/node-exporter-25bwf" Jun 09 05:33:09.595003 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:09.594986 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3837e945-5f86-443f-b2c1-a68dca1b5d7d-sys\") pod \"node-exporter-25bwf\" (UID: \"3837e945-5f86-443f-b2c1-a68dca1b5d7d\") " pod="openshift-monitoring/node-exporter-25bwf" Jun 09 05:33:09.595003 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:09.594995 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3837e945-5f86-443f-b2c1-a68dca1b5d7d-root\") pod \"node-exporter-25bwf\" (UID: \"3837e945-5f86-443f-b2c1-a68dca1b5d7d\") " pod="openshift-monitoring/node-exporter-25bwf" Jun 09 05:33:09.595327 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:09.595073 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3837e945-5f86-443f-b2c1-a68dca1b5d7d-root\") pod \"node-exporter-25bwf\" (UID: \"3837e945-5f86-443f-b2c1-a68dca1b5d7d\") " pod="openshift-monitoring/node-exporter-25bwf" Jun 09 05:33:09.595327 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:09.595106 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3837e945-5f86-443f-b2c1-a68dca1b5d7d-node-exporter-textfile\") pod \"node-exporter-25bwf\" (UID: \"3837e945-5f86-443f-b2c1-a68dca1b5d7d\") " pod="openshift-monitoring/node-exporter-25bwf" Jun 09 05:33:09.595444 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:09.595423 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3837e945-5f86-443f-b2c1-a68dca1b5d7d-node-exporter-wtmp\") pod \"node-exporter-25bwf\" (UID: \"3837e945-5f86-443f-b2c1-a68dca1b5d7d\") " pod="openshift-monitoring/node-exporter-25bwf" Jun 09 05:33:09.595489 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:09.595466 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3837e945-5f86-443f-b2c1-a68dca1b5d7d-node-exporter-accelerators-collector-config\") pod \"node-exporter-25bwf\" (UID: \"3837e945-5f86-443f-b2c1-a68dca1b5d7d\") " pod="openshift-monitoring/node-exporter-25bwf" Jun 09 05:33:09.595600 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:09.595580 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3837e945-5f86-443f-b2c1-a68dca1b5d7d-metrics-client-ca\") pod \"node-exporter-25bwf\" (UID: \"3837e945-5f86-443f-b2c1-a68dca1b5d7d\") " pod="openshift-monitoring/node-exporter-25bwf" Jun 09 05:33:09.597022 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:09.597004 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3837e945-5f86-443f-b2c1-a68dca1b5d7d-node-exporter-tls\") pod \"node-exporter-25bwf\" (UID: \"3837e945-5f86-443f-b2c1-a68dca1b5d7d\") " pod="openshift-monitoring/node-exporter-25bwf" Jun 09 05:33:09.597220 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:09.597200 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3837e945-5f86-443f-b2c1-a68dca1b5d7d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-25bwf\" (UID: \"3837e945-5f86-443f-b2c1-a68dca1b5d7d\") " pod="openshift-monitoring/node-exporter-25bwf" Jun 09 05:33:09.603975 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:09.603956 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-446kh\" (UniqueName: \"kubernetes.io/projected/3837e945-5f86-443f-b2c1-a68dca1b5d7d-kube-api-access-446kh\") pod \"node-exporter-25bwf\" (UID: \"3837e945-5f86-443f-b2c1-a68dca1b5d7d\") " pod="openshift-monitoring/node-exporter-25bwf" Jun 09 05:33:09.649047 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:09.649026 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-25bwf" Jun 09 05:33:09.658647 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:33:09.658627 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3837e945_5f86_443f_b2c1_a68dca1b5d7d.slice/crio-efd1de90cc78410c581ae1115c3395eb5c4ed863ff89764b7b9115b4adcb7bf8 WatchSource:0}: Error finding container efd1de90cc78410c581ae1115c3395eb5c4ed863ff89764b7b9115b4adcb7bf8: Status 404 returned error can't find the container with id efd1de90cc78410c581ae1115c3395eb5c4ed863ff89764b7b9115b4adcb7bf8 Jun 09 05:33:09.998459 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:09.998374 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/73457598-81c7-40a6-8ac6-f3e89ce31b36-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-rnsbg\" (UID: \"73457598-81c7-40a6-8ac6-f3e89ce31b36\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-rnsbg" Jun 09 05:33:10.000970 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:10.000945 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/73457598-81c7-40a6-8ac6-f3e89ce31b36-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-rnsbg\" (UID: \"73457598-81c7-40a6-8ac6-f3e89ce31b36\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-rnsbg" Jun 09 05:33:10.125742 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:10.125705 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-25bwf" event={"ID":"3837e945-5f86-443f-b2c1-a68dca1b5d7d","Type":"ContainerStarted","Data":"efd1de90cc78410c581ae1115c3395eb5c4ed863ff89764b7b9115b4adcb7bf8"} Jun 09 05:33:10.225232 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:10.225190 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-rnsbg" Jun 09 05:33:10.393282 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:10.393253 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 05:33:10.395811 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:10.395779 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 05:33:10.398478 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:10.398450 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 09 05:33:10.398588 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:10.398566 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-sn2j8\"" Jun 09 05:33:10.398829 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:10.398663 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 09 05:33:10.398829 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:10.398678 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 09 05:33:10.398829 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:10.398763 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 09 05:33:10.398829 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:10.398452 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 09 05:33:10.399096 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:10.399078 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 09 05:33:10.399162 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:10.399143 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 09 05:33:10.399281 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:10.399264 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 09 05:33:10.399351 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:10.399316 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 09 05:33:10.411399 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:10.411320 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 05:33:10.502314 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:10.502285 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/24b00280-231b-40c0-98b4-e2b8fb434a89-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"24b00280-231b-40c0-98b4-e2b8fb434a89\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 05:33:10.502428 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:10.502321 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/24b00280-231b-40c0-98b4-e2b8fb434a89-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"24b00280-231b-40c0-98b4-e2b8fb434a89\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 05:33:10.502428 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:10.502345 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/24b00280-231b-40c0-98b4-e2b8fb434a89-config-volume\") pod \"alertmanager-main-0\" (UID: \"24b00280-231b-40c0-98b4-e2b8fb434a89\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 05:33:10.502428 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:10.502373 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/24b00280-231b-40c0-98b4-e2b8fb434a89-tls-assets\") pod \"alertmanager-main-0\" (UID: \"24b00280-231b-40c0-98b4-e2b8fb434a89\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 05:33:10.502556 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:10.502445 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcchp\" (UniqueName: \"kubernetes.io/projected/24b00280-231b-40c0-98b4-e2b8fb434a89-kube-api-access-qcchp\") pod \"alertmanager-main-0\" (UID: \"24b00280-231b-40c0-98b4-e2b8fb434a89\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 05:33:10.502556 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:10.502490 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/24b00280-231b-40c0-98b4-e2b8fb434a89-web-config\") pod \"alertmanager-main-0\" (UID: \"24b00280-231b-40c0-98b4-e2b8fb434a89\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 05:33:10.502556 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:10.502519 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/24b00280-231b-40c0-98b4-e2b8fb434a89-config-out\") pod \"alertmanager-main-0\" (UID: \"24b00280-231b-40c0-98b4-e2b8fb434a89\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 05:33:10.502665 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:10.502611 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/24b00280-231b-40c0-98b4-e2b8fb434a89-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"24b00280-231b-40c0-98b4-e2b8fb434a89\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 05:33:10.502705 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:10.502668 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/24b00280-231b-40c0-98b4-e2b8fb434a89-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"24b00280-231b-40c0-98b4-e2b8fb434a89\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 05:33:10.502743 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:10.502702 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24b00280-231b-40c0-98b4-e2b8fb434a89-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"24b00280-231b-40c0-98b4-e2b8fb434a89\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 05:33:10.502780 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:10.502752 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/24b00280-231b-40c0-98b4-e2b8fb434a89-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"24b00280-231b-40c0-98b4-e2b8fb434a89\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 05:33:10.502856 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:10.502830 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/24b00280-231b-40c0-98b4-e2b8fb434a89-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"24b00280-231b-40c0-98b4-e2b8fb434a89\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 05:33:10.502906 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:10.502892 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/24b00280-231b-40c0-98b4-e2b8fb434a89-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"24b00280-231b-40c0-98b4-e2b8fb434a89\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 05:33:10.515976 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:10.515852 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-rnsbg"] Jun 09 05:33:10.518591 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:33:10.518564 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73457598_81c7_40a6_8ac6_f3e89ce31b36.slice/crio-91498ad3623ad3b6c813bedeed93bbebcf4af1020421de3015591c7a162d409a WatchSource:0}: Error finding container 91498ad3623ad3b6c813bedeed93bbebcf4af1020421de3015591c7a162d409a: Status 404 returned error can't find the container with id 91498ad3623ad3b6c813bedeed93bbebcf4af1020421de3015591c7a162d409a Jun 09 05:33:10.604001 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:10.603967 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/24b00280-231b-40c0-98b4-e2b8fb434a89-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"24b00280-231b-40c0-98b4-e2b8fb434a89\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 05:33:10.604001 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:10.604006 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/24b00280-231b-40c0-98b4-e2b8fb434a89-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"24b00280-231b-40c0-98b4-e2b8fb434a89\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 05:33:10.604196 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:10.604037 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/24b00280-231b-40c0-98b4-e2b8fb434a89-config-volume\") pod \"alertmanager-main-0\" (UID: \"24b00280-231b-40c0-98b4-e2b8fb434a89\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 05:33:10.604196 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:10.604063 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/24b00280-231b-40c0-98b4-e2b8fb434a89-tls-assets\") pod \"alertmanager-main-0\" (UID: \"24b00280-231b-40c0-98b4-e2b8fb434a89\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 05:33:10.604196 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:10.604102 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcchp\" (UniqueName: \"kubernetes.io/projected/24b00280-231b-40c0-98b4-e2b8fb434a89-kube-api-access-qcchp\") pod \"alertmanager-main-0\" (UID: \"24b00280-231b-40c0-98b4-e2b8fb434a89\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 05:33:10.604196 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:10.604128 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/24b00280-231b-40c0-98b4-e2b8fb434a89-web-config\") pod \"alertmanager-main-0\" (UID: \"24b00280-231b-40c0-98b4-e2b8fb434a89\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 05:33:10.604196 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:10.604168 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/24b00280-231b-40c0-98b4-e2b8fb434a89-config-out\") pod \"alertmanager-main-0\" (UID: \"24b00280-231b-40c0-98b4-e2b8fb434a89\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 05:33:10.604445 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:10.604213 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/24b00280-231b-40c0-98b4-e2b8fb434a89-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"24b00280-231b-40c0-98b4-e2b8fb434a89\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 05:33:10.604445 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:10.604254 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/24b00280-231b-40c0-98b4-e2b8fb434a89-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"24b00280-231b-40c0-98b4-e2b8fb434a89\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 05:33:10.604445 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:10.604279 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24b00280-231b-40c0-98b4-e2b8fb434a89-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"24b00280-231b-40c0-98b4-e2b8fb434a89\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 05:33:10.604445 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:10.604310 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/24b00280-231b-40c0-98b4-e2b8fb434a89-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"24b00280-231b-40c0-98b4-e2b8fb434a89\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 05:33:10.604445 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:10.604332 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/24b00280-231b-40c0-98b4-e2b8fb434a89-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"24b00280-231b-40c0-98b4-e2b8fb434a89\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 05:33:10.604445 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:10.604361 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/24b00280-231b-40c0-98b4-e2b8fb434a89-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"24b00280-231b-40c0-98b4-e2b8fb434a89\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 05:33:10.604733 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:33:10.604670 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/24b00280-231b-40c0-98b4-e2b8fb434a89-alertmanager-trusted-ca-bundle podName:24b00280-231b-40c0-98b4-e2b8fb434a89 nodeName:}" failed. No retries permitted until 2026-06-09 05:33:11.104645015 +0000 UTC m=+241.187296748 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/24b00280-231b-40c0-98b4-e2b8fb434a89-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "24b00280-231b-40c0-98b4-e2b8fb434a89") : configmap references non-existent config key: ca-bundle.crt Jun 09 05:33:10.605862 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:10.605130 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/24b00280-231b-40c0-98b4-e2b8fb434a89-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"24b00280-231b-40c0-98b4-e2b8fb434a89\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 05:33:10.605862 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:10.605773 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/24b00280-231b-40c0-98b4-e2b8fb434a89-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"24b00280-231b-40c0-98b4-e2b8fb434a89\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 05:33:10.607037 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:10.607012 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/24b00280-231b-40c0-98b4-e2b8fb434a89-config-out\") pod \"alertmanager-main-0\" (UID: \"24b00280-231b-40c0-98b4-e2b8fb434a89\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 05:33:10.607151 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:10.607099 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/24b00280-231b-40c0-98b4-e2b8fb434a89-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"24b00280-231b-40c0-98b4-e2b8fb434a89\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 05:33:10.607221 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:10.607184 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/24b00280-231b-40c0-98b4-e2b8fb434a89-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"24b00280-231b-40c0-98b4-e2b8fb434a89\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 05:33:10.607277 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:10.607230 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/24b00280-231b-40c0-98b4-e2b8fb434a89-tls-assets\") pod \"alertmanager-main-0\" (UID: \"24b00280-231b-40c0-98b4-e2b8fb434a89\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 05:33:10.607523 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:10.607500 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/24b00280-231b-40c0-98b4-e2b8fb434a89-web-config\") pod \"alertmanager-main-0\" (UID: \"24b00280-231b-40c0-98b4-e2b8fb434a89\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 05:33:10.607608 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:10.607562 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/24b00280-231b-40c0-98b4-e2b8fb434a89-config-volume\") pod \"alertmanager-main-0\" (UID: \"24b00280-231b-40c0-98b4-e2b8fb434a89\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 05:33:10.608076 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:10.608058 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/24b00280-231b-40c0-98b4-e2b8fb434a89-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"24b00280-231b-40c0-98b4-e2b8fb434a89\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 05:33:10.608629 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:10.608614 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/24b00280-231b-40c0-98b4-e2b8fb434a89-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"24b00280-231b-40c0-98b4-e2b8fb434a89\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 05:33:10.608999 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:10.608981 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/24b00280-231b-40c0-98b4-e2b8fb434a89-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"24b00280-231b-40c0-98b4-e2b8fb434a89\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 05:33:10.613903 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:10.613885 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcchp\" (UniqueName: \"kubernetes.io/projected/24b00280-231b-40c0-98b4-e2b8fb434a89-kube-api-access-qcchp\") pod \"alertmanager-main-0\" (UID: \"24b00280-231b-40c0-98b4-e2b8fb434a89\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 05:33:11.110211 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:11.110142 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24b00280-231b-40c0-98b4-e2b8fb434a89-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"24b00280-231b-40c0-98b4-e2b8fb434a89\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 05:33:11.111099 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:11.111054 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24b00280-231b-40c0-98b4-e2b8fb434a89-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"24b00280-231b-40c0-98b4-e2b8fb434a89\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 05:33:11.130878 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:11.130840 2564 generic.go:356] "Generic (PLEG): container finished" podID="3837e945-5f86-443f-b2c1-a68dca1b5d7d" containerID="9c7eccaad7a123ade8162bd3adf6b5c91cf20b7ee543131e4e03ab2b25a5aed8" exitCode=0 Jun 09 05:33:11.131016 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:11.130943 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-25bwf" event={"ID":"3837e945-5f86-443f-b2c1-a68dca1b5d7d","Type":"ContainerDied","Data":"9c7eccaad7a123ade8162bd3adf6b5c91cf20b7ee543131e4e03ab2b25a5aed8"} Jun 09 05:33:11.133180 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:11.133153 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-rnsbg" event={"ID":"73457598-81c7-40a6-8ac6-f3e89ce31b36","Type":"ContainerStarted","Data":"ddcef33ab6ed2aa91942ba99fdabddd72c1a430266f56953ae484ea0efd1bd85"} Jun 09 05:33:11.133293 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:11.133213 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-rnsbg" event={"ID":"73457598-81c7-40a6-8ac6-f3e89ce31b36","Type":"ContainerStarted","Data":"611c5888f6f25ccaee2d55c9bada588b512058fac7f8cfd5d3ce6caa58e7c9ac"} Jun 09 05:33:11.133293 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:11.133244 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-rnsbg" event={"ID":"73457598-81c7-40a6-8ac6-f3e89ce31b36","Type":"ContainerStarted","Data":"91498ad3623ad3b6c813bedeed93bbebcf4af1020421de3015591c7a162d409a"} Jun 09 05:33:11.305937 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:11.305904 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 05:33:11.587379 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:11.587360 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 05:33:11.589545 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:33:11.589510 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24b00280_231b_40c0_98b4_e2b8fb434a89.slice/crio-58cb292935c8cd8be077f6e60d0ad2aa03c58c3384f482d187f261a9b0b799d1 WatchSource:0}: Error finding container 58cb292935c8cd8be077f6e60d0ad2aa03c58c3384f482d187f261a9b0b799d1: Status 404 returned error can't find the container with id 58cb292935c8cd8be077f6e60d0ad2aa03c58c3384f482d187f261a9b0b799d1 Jun 09 05:33:12.138221 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:12.138187 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"24b00280-231b-40c0-98b4-e2b8fb434a89","Type":"ContainerStarted","Data":"58cb292935c8cd8be077f6e60d0ad2aa03c58c3384f482d187f261a9b0b799d1"} Jun 09 05:33:12.140332 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:12.140305 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-rnsbg" event={"ID":"73457598-81c7-40a6-8ac6-f3e89ce31b36","Type":"ContainerStarted","Data":"2bcc7c2297b278a7f5d22caa6f84bff3bb815c3f74b52d1539f0285fae3d6a91"} Jun 09 05:33:12.142569 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:12.142545 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-25bwf" event={"ID":"3837e945-5f86-443f-b2c1-a68dca1b5d7d","Type":"ContainerStarted","Data":"60e5f3f11bc54c073ca51c6646550cc444f862375d5121d094dac281b32fd147"} Jun 09 05:33:12.142661 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:12.142593 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-25bwf" event={"ID":"3837e945-5f86-443f-b2c1-a68dca1b5d7d","Type":"ContainerStarted","Data":"c1da585a19425edfe8ca97ba32971b0e00a05d9c57cc4ecca8bd60cb7e548132"} Jun 09 05:33:12.161670 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:12.158843 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-rnsbg" podStartSLOduration=2.366493904 podStartE2EDuration="3.15882373s" totalImagesPullingTime="792.329826ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 05:33:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 05:33:12.155718544 +0000 UTC m=+242.238370291" watchObservedRunningTime="2026-06-09 05:33:12.15882373 +0000 UTC m=+242.241475467" Jun 09 05:33:12.173563 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:12.173513 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-25bwf" podStartSLOduration=2.366278838 podStartE2EDuration="3.173500616s" totalImagesPullingTime="740.210762ms" totalInitContainerRuntime="67.011016ms" isStatefulPod=true podCreationTimestamp="2026-06-09 05:33:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 05:33:12.172895849 +0000 UTC m=+242.255547586" watchObservedRunningTime="2026-06-09 05:33:12.173500616 +0000 UTC m=+242.256152354" Jun 09 05:33:13.146990 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:13.146953 2564 generic.go:356] "Generic (PLEG): container finished" podID="24b00280-231b-40c0-98b4-e2b8fb434a89" containerID="3fa5538b697e88f617ea8901431be083314754f31c86e5f3aae3661949c890bb" exitCode=0 Jun 09 05:33:13.147461 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:13.147045 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"24b00280-231b-40c0-98b4-e2b8fb434a89","Type":"ContainerDied","Data":"3fa5538b697e88f617ea8901431be083314754f31c86e5f3aae3661949c890bb"} Jun 09 05:33:13.387759 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:13.387730 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-685f578bdb-nmlg4" Jun 09 05:33:13.387938 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:13.387811 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-685f578bdb-nmlg4" Jun 09 05:33:13.389200 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:13.389177 2564 patch_prober.go:28] interesting pod/console-685f578bdb-nmlg4 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.19:8443/health\": dial tcp 10.133.0.19:8443: connect: connection refused" start-of-body= Jun 09 05:33:13.389309 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:13.389215 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-685f578bdb-nmlg4" podUID="27f5c4e4-b1f4-4132-80be-a3d46df42f4e" containerName="console" probeResult="failure" output="Get \"https://10.133.0.19:8443/health\": dial tcp 10.133.0.19:8443: connect: connection refused" Jun 09 05:33:14.139317 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:14.139281 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-685f578bdb-nmlg4"] Jun 09 05:33:14.165600 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:14.165559 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5cffbdf6c5-px4mf"] Jun 09 05:33:14.168727 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:14.168702 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cffbdf6c5-px4mf" Jun 09 05:33:14.181237 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:14.181210 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cffbdf6c5-px4mf"] Jun 09 05:33:14.296945 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:14.296914 2564 patch_prober.go:28] interesting pod/image-registry-9ffff86c7-mcqvf container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 05:33:14.297095 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:14.296963 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-9ffff86c7-mcqvf" podUID="09110d03-6ef0-4c54-afb7-872377f07269" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 05:33:14.340648 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:14.340614 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752-console-serving-cert\") pod \"console-5cffbdf6c5-px4mf\" (UID: \"e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752\") " pod="openshift-console/console-5cffbdf6c5-px4mf" Jun 09 05:33:14.340851 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:14.340668 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752-service-ca\") pod \"console-5cffbdf6c5-px4mf\" (UID: \"e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752\") " pod="openshift-console/console-5cffbdf6c5-px4mf" Jun 09 05:33:14.340851 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:14.340711 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbl44\" (UniqueName: \"kubernetes.io/projected/e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752-kube-api-access-fbl44\") pod \"console-5cffbdf6c5-px4mf\" (UID: \"e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752\") " pod="openshift-console/console-5cffbdf6c5-px4mf" Jun 09 05:33:14.340851 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:14.340785 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752-trusted-ca-bundle\") pod \"console-5cffbdf6c5-px4mf\" (UID: \"e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752\") " pod="openshift-console/console-5cffbdf6c5-px4mf" Jun 09 05:33:14.340851 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:14.340836 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752-console-config\") pod \"console-5cffbdf6c5-px4mf\" (UID: \"e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752\") " pod="openshift-console/console-5cffbdf6c5-px4mf" Jun 09 05:33:14.341051 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:14.340861 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752-console-oauth-config\") pod \"console-5cffbdf6c5-px4mf\" (UID: \"e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752\") " pod="openshift-console/console-5cffbdf6c5-px4mf" Jun 09 05:33:14.341051 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:14.340891 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752-oauth-serving-cert\") pod \"console-5cffbdf6c5-px4mf\" (UID: \"e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752\") " pod="openshift-console/console-5cffbdf6c5-px4mf" Jun 09 05:33:14.441959 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:14.441880 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752-console-oauth-config\") pod \"console-5cffbdf6c5-px4mf\" (UID: \"e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752\") " pod="openshift-console/console-5cffbdf6c5-px4mf" Jun 09 05:33:14.441959 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:14.441914 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752-oauth-serving-cert\") pod \"console-5cffbdf6c5-px4mf\" (UID: \"e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752\") " pod="openshift-console/console-5cffbdf6c5-px4mf" Jun 09 05:33:14.442276 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:14.442170 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752-console-serving-cert\") pod \"console-5cffbdf6c5-px4mf\" (UID: \"e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752\") " pod="openshift-console/console-5cffbdf6c5-px4mf" Jun 09 05:33:14.442276 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:14.442228 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752-service-ca\") pod \"console-5cffbdf6c5-px4mf\" (UID: \"e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752\") " pod="openshift-console/console-5cffbdf6c5-px4mf" Jun 09 05:33:14.442276 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:14.442259 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbl44\" (UniqueName: \"kubernetes.io/projected/e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752-kube-api-access-fbl44\") pod \"console-5cffbdf6c5-px4mf\" (UID: \"e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752\") " pod="openshift-console/console-5cffbdf6c5-px4mf" Jun 09 05:33:14.442423 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:14.442340 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752-trusted-ca-bundle\") pod \"console-5cffbdf6c5-px4mf\" (UID: \"e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752\") " pod="openshift-console/console-5cffbdf6c5-px4mf" Jun 09 05:33:14.442423 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:14.442399 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752-console-config\") pod \"console-5cffbdf6c5-px4mf\" (UID: \"e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752\") " pod="openshift-console/console-5cffbdf6c5-px4mf" Jun 09 05:33:14.442749 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:14.442718 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752-oauth-serving-cert\") pod \"console-5cffbdf6c5-px4mf\" (UID: \"e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752\") " pod="openshift-console/console-5cffbdf6c5-px4mf" Jun 09 05:33:14.442889 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:14.442823 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752-service-ca\") pod \"console-5cffbdf6c5-px4mf\" (UID: \"e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752\") " pod="openshift-console/console-5cffbdf6c5-px4mf" Jun 09 05:33:14.443155 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:14.443116 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752-console-config\") pod \"console-5cffbdf6c5-px4mf\" (UID: \"e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752\") " pod="openshift-console/console-5cffbdf6c5-px4mf" Jun 09 05:33:14.443330 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:14.443314 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752-trusted-ca-bundle\") pod \"console-5cffbdf6c5-px4mf\" (UID: \"e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752\") " pod="openshift-console/console-5cffbdf6c5-px4mf" Jun 09 05:33:14.444991 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:14.444968 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752-console-oauth-config\") pod \"console-5cffbdf6c5-px4mf\" (UID: \"e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752\") " pod="openshift-console/console-5cffbdf6c5-px4mf" Jun 09 05:33:14.445088 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:14.445002 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752-console-serving-cert\") pod \"console-5cffbdf6c5-px4mf\" (UID: \"e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752\") " pod="openshift-console/console-5cffbdf6c5-px4mf" Jun 09 05:33:14.449770 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:14.449746 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbl44\" (UniqueName: \"kubernetes.io/projected/e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752-kube-api-access-fbl44\") pod \"console-5cffbdf6c5-px4mf\" (UID: \"e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752\") " pod="openshift-console/console-5cffbdf6c5-px4mf" Jun 09 05:33:14.479008 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:14.478973 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cffbdf6c5-px4mf" Jun 09 05:33:14.525365 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:14.525333 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5fb7fdf4f6-jkkh6"] Jun 09 05:33:14.532053 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:14.532025 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5fb7fdf4f6-jkkh6" Jun 09 05:33:14.534255 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:14.534232 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 09 05:33:14.534670 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:14.534518 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-lv2bl\"" Jun 09 05:33:14.534670 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:14.534545 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 09 05:33:14.534670 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:14.534567 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 09 05:33:14.534932 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:14.534688 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 09 05:33:14.534932 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:14.534899 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 09 05:33:14.539287 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:14.539254 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 09 05:33:14.542871 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:14.542840 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5fb7fdf4f6-jkkh6"] Jun 09 05:33:14.617310 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:14.617275 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cffbdf6c5-px4mf"] Jun 09 05:33:14.619470 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:33:14.619432 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3dfb265_c1af_4ea0_8ddc_67c2c3b2d752.slice/crio-2a7460a7d6fa3c217fe263c6a8d9185a893d19c7b7e9c9d49a33333e9d59ad83 WatchSource:0}: Error finding container 2a7460a7d6fa3c217fe263c6a8d9185a893d19c7b7e9c9d49a33333e9d59ad83: Status 404 returned error can't find the container with id 2a7460a7d6fa3c217fe263c6a8d9185a893d19c7b7e9c9d49a33333e9d59ad83 Jun 09 05:33:14.643925 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:14.643895 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/6a1defc2-44e5-4f25-8e0d-99026af777db-federate-client-tls\") pod \"telemeter-client-5fb7fdf4f6-jkkh6\" (UID: \"6a1defc2-44e5-4f25-8e0d-99026af777db\") " pod="openshift-monitoring/telemeter-client-5fb7fdf4f6-jkkh6" Jun 09 05:33:14.644036 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:14.643933 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a1defc2-44e5-4f25-8e0d-99026af777db-serving-certs-ca-bundle\") pod \"telemeter-client-5fb7fdf4f6-jkkh6\" (UID: \"6a1defc2-44e5-4f25-8e0d-99026af777db\") " pod="openshift-monitoring/telemeter-client-5fb7fdf4f6-jkkh6" Jun 09 05:33:14.644036 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:14.643958 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/6a1defc2-44e5-4f25-8e0d-99026af777db-secret-telemeter-client\") pod \"telemeter-client-5fb7fdf4f6-jkkh6\" (UID: \"6a1defc2-44e5-4f25-8e0d-99026af777db\") " pod="openshift-monitoring/telemeter-client-5fb7fdf4f6-jkkh6" Jun 09 05:33:14.644110 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:14.644035 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6a1defc2-44e5-4f25-8e0d-99026af777db-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5fb7fdf4f6-jkkh6\" (UID: \"6a1defc2-44e5-4f25-8e0d-99026af777db\") " pod="openshift-monitoring/telemeter-client-5fb7fdf4f6-jkkh6" Jun 09 05:33:14.644110 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:14.644083 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a1defc2-44e5-4f25-8e0d-99026af777db-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5fb7fdf4f6-jkkh6\" (UID: \"6a1defc2-44e5-4f25-8e0d-99026af777db\") " pod="openshift-monitoring/telemeter-client-5fb7fdf4f6-jkkh6" Jun 09 05:33:14.644181 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:14.644166 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjzcc\" (UniqueName: \"kubernetes.io/projected/6a1defc2-44e5-4f25-8e0d-99026af777db-kube-api-access-zjzcc\") pod \"telemeter-client-5fb7fdf4f6-jkkh6\" (UID: \"6a1defc2-44e5-4f25-8e0d-99026af777db\") " pod="openshift-monitoring/telemeter-client-5fb7fdf4f6-jkkh6" Jun 09 05:33:14.644217 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:14.644199 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/6a1defc2-44e5-4f25-8e0d-99026af777db-telemeter-client-tls\") pod \"telemeter-client-5fb7fdf4f6-jkkh6\" (UID: \"6a1defc2-44e5-4f25-8e0d-99026af777db\") " pod="openshift-monitoring/telemeter-client-5fb7fdf4f6-jkkh6" Jun 09 05:33:14.644252 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:14.644224 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6a1defc2-44e5-4f25-8e0d-99026af777db-metrics-client-ca\") pod \"telemeter-client-5fb7fdf4f6-jkkh6\" (UID: \"6a1defc2-44e5-4f25-8e0d-99026af777db\") " pod="openshift-monitoring/telemeter-client-5fb7fdf4f6-jkkh6" Jun 09 05:33:14.745533 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:14.745445 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a1defc2-44e5-4f25-8e0d-99026af777db-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5fb7fdf4f6-jkkh6\" (UID: \"6a1defc2-44e5-4f25-8e0d-99026af777db\") " pod="openshift-monitoring/telemeter-client-5fb7fdf4f6-jkkh6" Jun 09 05:33:14.745533 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:14.745517 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjzcc\" (UniqueName: \"kubernetes.io/projected/6a1defc2-44e5-4f25-8e0d-99026af777db-kube-api-access-zjzcc\") pod \"telemeter-client-5fb7fdf4f6-jkkh6\" (UID: \"6a1defc2-44e5-4f25-8e0d-99026af777db\") " pod="openshift-monitoring/telemeter-client-5fb7fdf4f6-jkkh6" Jun 09 05:33:14.745728 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:14.745544 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/6a1defc2-44e5-4f25-8e0d-99026af777db-telemeter-client-tls\") pod \"telemeter-client-5fb7fdf4f6-jkkh6\" (UID: \"6a1defc2-44e5-4f25-8e0d-99026af777db\") " pod="openshift-monitoring/telemeter-client-5fb7fdf4f6-jkkh6" Jun 09 05:33:14.745728 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:14.745563 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6a1defc2-44e5-4f25-8e0d-99026af777db-metrics-client-ca\") pod \"telemeter-client-5fb7fdf4f6-jkkh6\" (UID: \"6a1defc2-44e5-4f25-8e0d-99026af777db\") " pod="openshift-monitoring/telemeter-client-5fb7fdf4f6-jkkh6" Jun 09 05:33:14.747109 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:14.745955 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/6a1defc2-44e5-4f25-8e0d-99026af777db-federate-client-tls\") pod \"telemeter-client-5fb7fdf4f6-jkkh6\" (UID: \"6a1defc2-44e5-4f25-8e0d-99026af777db\") " pod="openshift-monitoring/telemeter-client-5fb7fdf4f6-jkkh6" Jun 09 05:33:14.747109 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:14.746081 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a1defc2-44e5-4f25-8e0d-99026af777db-serving-certs-ca-bundle\") pod \"telemeter-client-5fb7fdf4f6-jkkh6\" (UID: \"6a1defc2-44e5-4f25-8e0d-99026af777db\") " pod="openshift-monitoring/telemeter-client-5fb7fdf4f6-jkkh6" Jun 09 05:33:14.747109 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:14.746138 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/6a1defc2-44e5-4f25-8e0d-99026af777db-secret-telemeter-client\") pod \"telemeter-client-5fb7fdf4f6-jkkh6\" (UID: \"6a1defc2-44e5-4f25-8e0d-99026af777db\") " pod="openshift-monitoring/telemeter-client-5fb7fdf4f6-jkkh6" Jun 09 05:33:14.747109 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:14.746199 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6a1defc2-44e5-4f25-8e0d-99026af777db-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5fb7fdf4f6-jkkh6\" (UID: \"6a1defc2-44e5-4f25-8e0d-99026af777db\") " pod="openshift-monitoring/telemeter-client-5fb7fdf4f6-jkkh6" Jun 09 05:33:14.747109 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:14.746943 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6a1defc2-44e5-4f25-8e0d-99026af777db-metrics-client-ca\") pod \"telemeter-client-5fb7fdf4f6-jkkh6\" (UID: \"6a1defc2-44e5-4f25-8e0d-99026af777db\") " pod="openshift-monitoring/telemeter-client-5fb7fdf4f6-jkkh6" Jun 09 05:33:14.747465 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:14.747061 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a1defc2-44e5-4f25-8e0d-99026af777db-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5fb7fdf4f6-jkkh6\" (UID: \"6a1defc2-44e5-4f25-8e0d-99026af777db\") " pod="openshift-monitoring/telemeter-client-5fb7fdf4f6-jkkh6" Jun 09 05:33:14.747465 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:14.747434 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a1defc2-44e5-4f25-8e0d-99026af777db-serving-certs-ca-bundle\") pod \"telemeter-client-5fb7fdf4f6-jkkh6\" (UID: \"6a1defc2-44e5-4f25-8e0d-99026af777db\") " pod="openshift-monitoring/telemeter-client-5fb7fdf4f6-jkkh6" Jun 09 05:33:14.749598 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:14.749420 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6a1defc2-44e5-4f25-8e0d-99026af777db-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5fb7fdf4f6-jkkh6\" (UID: \"6a1defc2-44e5-4f25-8e0d-99026af777db\") " pod="openshift-monitoring/telemeter-client-5fb7fdf4f6-jkkh6" Jun 09 05:33:14.751975 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:14.750555 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/6a1defc2-44e5-4f25-8e0d-99026af777db-secret-telemeter-client\") pod \"telemeter-client-5fb7fdf4f6-jkkh6\" (UID: \"6a1defc2-44e5-4f25-8e0d-99026af777db\") " pod="openshift-monitoring/telemeter-client-5fb7fdf4f6-jkkh6" Jun 09 05:33:14.751975 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:14.750901 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/6a1defc2-44e5-4f25-8e0d-99026af777db-federate-client-tls\") pod \"telemeter-client-5fb7fdf4f6-jkkh6\" (UID: \"6a1defc2-44e5-4f25-8e0d-99026af777db\") " pod="openshift-monitoring/telemeter-client-5fb7fdf4f6-jkkh6" Jun 09 05:33:14.753076 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:14.752228 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/6a1defc2-44e5-4f25-8e0d-99026af777db-telemeter-client-tls\") pod \"telemeter-client-5fb7fdf4f6-jkkh6\" (UID: \"6a1defc2-44e5-4f25-8e0d-99026af777db\") " pod="openshift-monitoring/telemeter-client-5fb7fdf4f6-jkkh6" Jun 09 05:33:14.753992 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:14.753970 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjzcc\" (UniqueName: \"kubernetes.io/projected/6a1defc2-44e5-4f25-8e0d-99026af777db-kube-api-access-zjzcc\") pod \"telemeter-client-5fb7fdf4f6-jkkh6\" (UID: \"6a1defc2-44e5-4f25-8e0d-99026af777db\") " pod="openshift-monitoring/telemeter-client-5fb7fdf4f6-jkkh6" Jun 09 05:33:14.842962 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:14.842918 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5fb7fdf4f6-jkkh6" Jun 09 05:33:14.987090 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:14.987001 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5fb7fdf4f6-jkkh6"] Jun 09 05:33:15.156509 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:15.156469 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cffbdf6c5-px4mf" event={"ID":"e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752","Type":"ContainerStarted","Data":"83652c52eb561be9991495f8eaa61fb744507880109a3d19a26d73d5eac6f842"} Jun 09 05:33:15.156715 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:15.156534 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cffbdf6c5-px4mf" event={"ID":"e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752","Type":"ContainerStarted","Data":"2a7460a7d6fa3c217fe263c6a8d9185a893d19c7b7e9c9d49a33333e9d59ad83"} Jun 09 05:33:15.173088 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:15.173025 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5cffbdf6c5-px4mf" podStartSLOduration=1.173004425 podStartE2EDuration="1.173004425s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 05:33:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 05:33:15.172273536 +0000 UTC m=+245.254925277" watchObservedRunningTime="2026-06-09 05:33:15.173004425 +0000 UTC m=+245.255656163" Jun 09 05:33:15.185183 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:15.185139 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8f84b5d59-rhn74" Jun 09 05:33:15.185342 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:15.185196 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8f84b5d59-rhn74" Jun 09 05:33:15.186890 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:15.186860 2564 patch_prober.go:28] interesting pod/console-8f84b5d59-rhn74 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.20:8443/health\": dial tcp 10.133.0.20:8443: connect: connection refused" start-of-body= Jun 09 05:33:15.187016 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:15.186926 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-8f84b5d59-rhn74" podUID="3d348c05-f72b-4145-8152-9ba13b80a0af" containerName="console" probeResult="failure" output="Get \"https://10.133.0.20:8443/health\": dial tcp 10.133.0.20:8443: connect: connection refused" Jun 09 05:33:15.222780 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:33:15.222747 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a1defc2_44e5_4f25_8e0d_99026af777db.slice/crio-80715d1c4b9015a7aa35483dc0c3fda1a98cdb1c07e71e8afe9c0fd1363d650a WatchSource:0}: Error finding container 80715d1c4b9015a7aa35483dc0c3fda1a98cdb1c07e71e8afe9c0fd1363d650a: Status 404 returned error can't find the container with id 80715d1c4b9015a7aa35483dc0c3fda1a98cdb1c07e71e8afe9c0fd1363d650a Jun 09 05:33:16.165083 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:16.165046 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"24b00280-231b-40c0-98b4-e2b8fb434a89","Type":"ContainerStarted","Data":"b9f863388d1c8c69d5891e03e34f4e3bb3631f976a528ce15bff81b7759da5d4"} Jun 09 05:33:16.165260 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:16.165117 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"24b00280-231b-40c0-98b4-e2b8fb434a89","Type":"ContainerStarted","Data":"20893dadb840ee9653b70f092b9af2c2669e59d36ab687ad7bfa8fbee07d4927"} Jun 09 05:33:16.165260 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:16.165157 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"24b00280-231b-40c0-98b4-e2b8fb434a89","Type":"ContainerStarted","Data":"f9a62e529ad8b430696b62283131bada45ea757df7e37cde0125ab07761e25ee"} Jun 09 05:33:16.165260 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:16.165197 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"24b00280-231b-40c0-98b4-e2b8fb434a89","Type":"ContainerStarted","Data":"3dec100e3474e96dd089770bac0b7adc7d8139ed72cc6f71782563c73dc37730"} Jun 09 05:33:16.165260 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:16.165226 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"24b00280-231b-40c0-98b4-e2b8fb434a89","Type":"ContainerStarted","Data":"583401099eabf0e5d7d1e88472c52a1265b61ec94722d00fe106a1e0f7cc8deb"} Jun 09 05:33:16.166356 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:16.166327 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5fb7fdf4f6-jkkh6" event={"ID":"6a1defc2-44e5-4f25-8e0d-99026af777db","Type":"ContainerStarted","Data":"80715d1c4b9015a7aa35483dc0c3fda1a98cdb1c07e71e8afe9c0fd1363d650a"} Jun 09 05:33:17.172340 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:17.172310 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5fb7fdf4f6-jkkh6" event={"ID":"6a1defc2-44e5-4f25-8e0d-99026af777db","Type":"ContainerStarted","Data":"9690bc11e09f0d8f5c54068e4ade33c837c1db2eaadc179872cf91e6a6f34b67"} Jun 09 05:33:17.172748 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:17.172368 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5fb7fdf4f6-jkkh6" event={"ID":"6a1defc2-44e5-4f25-8e0d-99026af777db","Type":"ContainerStarted","Data":"7e81dbe180999d76329fe3101e423d63ee2aea2466c1f1d5da2cc71309d3a6d6"} Jun 09 05:33:17.172748 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:17.172397 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5fb7fdf4f6-jkkh6" event={"ID":"6a1defc2-44e5-4f25-8e0d-99026af777db","Type":"ContainerStarted","Data":"cb1d63277a1a96f448c7c924152ad88c35aaf664ddec03121dac559ef0b62d7e"} Jun 09 05:33:17.175317 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:17.175294 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"24b00280-231b-40c0-98b4-e2b8fb434a89","Type":"ContainerStarted","Data":"572eb18b3fc9dcc5505f7848f7a5a32923b2a19d118b044fd16d6df49e44d494"} Jun 09 05:33:17.197120 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:17.197075 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5fb7fdf4f6-jkkh6" podStartSLOduration=1.728989932 podStartE2EDuration="3.197061937s" totalImagesPullingTime="1.468072005s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 05:33:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 05:33:17.195675558 +0000 UTC m=+247.278327359" watchObservedRunningTime="2026-06-09 05:33:17.197061937 +0000 UTC m=+247.279713672" Jun 09 05:33:17.218643 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:17.218606 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.163695474 podStartE2EDuration="7.218593469s" totalImagesPullingTime="4.038951816s" totalInitContainerRuntime="15.946179ms" isStatefulPod=false podCreationTimestamp="2026-06-09 05:33:10 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 05:33:17.217380449 +0000 UTC m=+247.300032219" watchObservedRunningTime="2026-06-09 05:33:17.218593469 +0000 UTC m=+247.301245204" Jun 09 05:33:17.288057 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:17.288031 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8f84b5d59-rhn74"] Jun 09 05:33:17.315125 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:17.315102 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6877675969-jzwwr"] Jun 09 05:33:17.318211 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:17.318196 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6877675969-jzwwr" Jun 09 05:33:17.328075 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:17.328050 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6877675969-jzwwr"] Jun 09 05:33:17.471117 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:17.471024 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d-console-oauth-config\") pod \"console-6877675969-jzwwr\" (UID: \"8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d\") " pod="openshift-console/console-6877675969-jzwwr" Jun 09 05:33:17.471117 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:17.471076 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d-trusted-ca-bundle\") pod \"console-6877675969-jzwwr\" (UID: \"8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d\") " pod="openshift-console/console-6877675969-jzwwr" Jun 09 05:33:17.471327 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:17.471139 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d-oauth-serving-cert\") pod \"console-6877675969-jzwwr\" (UID: \"8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d\") " pod="openshift-console/console-6877675969-jzwwr" Jun 09 05:33:17.471327 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:17.471159 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77z2q\" (UniqueName: \"kubernetes.io/projected/8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d-kube-api-access-77z2q\") pod \"console-6877675969-jzwwr\" (UID: \"8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d\") " pod="openshift-console/console-6877675969-jzwwr" Jun 09 05:33:17.471327 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:17.471237 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d-console-serving-cert\") pod \"console-6877675969-jzwwr\" (UID: \"8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d\") " pod="openshift-console/console-6877675969-jzwwr" Jun 09 05:33:17.471327 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:17.471260 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d-console-config\") pod \"console-6877675969-jzwwr\" (UID: \"8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d\") " pod="openshift-console/console-6877675969-jzwwr" Jun 09 05:33:17.471327 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:17.471298 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d-service-ca\") pod \"console-6877675969-jzwwr\" (UID: \"8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d\") " pod="openshift-console/console-6877675969-jzwwr" Jun 09 05:33:17.572359 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:17.572319 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d-console-serving-cert\") pod \"console-6877675969-jzwwr\" (UID: \"8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d\") " pod="openshift-console/console-6877675969-jzwwr" Jun 09 05:33:17.572359 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:17.572361 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d-console-config\") pod \"console-6877675969-jzwwr\" (UID: \"8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d\") " pod="openshift-console/console-6877675969-jzwwr" Jun 09 05:33:17.572587 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:17.572396 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d-service-ca\") pod \"console-6877675969-jzwwr\" (UID: \"8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d\") " pod="openshift-console/console-6877675969-jzwwr" Jun 09 05:33:17.572587 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:17.572439 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d-console-oauth-config\") pod \"console-6877675969-jzwwr\" (UID: \"8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d\") " pod="openshift-console/console-6877675969-jzwwr" Jun 09 05:33:17.572587 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:17.572573 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d-trusted-ca-bundle\") pod \"console-6877675969-jzwwr\" (UID: \"8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d\") " pod="openshift-console/console-6877675969-jzwwr" Jun 09 05:33:17.572730 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:17.572630 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d-oauth-serving-cert\") pod \"console-6877675969-jzwwr\" (UID: \"8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d\") " pod="openshift-console/console-6877675969-jzwwr" Jun 09 05:33:17.572730 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:17.572656 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77z2q\" (UniqueName: \"kubernetes.io/projected/8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d-kube-api-access-77z2q\") pod \"console-6877675969-jzwwr\" (UID: \"8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d\") " pod="openshift-console/console-6877675969-jzwwr" Jun 09 05:33:17.573255 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:17.573228 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d-service-ca\") pod \"console-6877675969-jzwwr\" (UID: \"8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d\") " pod="openshift-console/console-6877675969-jzwwr" Jun 09 05:33:17.573366 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:17.573266 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d-console-config\") pod \"console-6877675969-jzwwr\" (UID: \"8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d\") " pod="openshift-console/console-6877675969-jzwwr" Jun 09 05:33:17.573423 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:17.573402 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d-oauth-serving-cert\") pod \"console-6877675969-jzwwr\" (UID: \"8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d\") " pod="openshift-console/console-6877675969-jzwwr" Jun 09 05:33:17.573485 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:17.573442 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d-trusted-ca-bundle\") pod \"console-6877675969-jzwwr\" (UID: \"8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d\") " pod="openshift-console/console-6877675969-jzwwr" Jun 09 05:33:17.574753 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:17.574727 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d-console-oauth-config\") pod \"console-6877675969-jzwwr\" (UID: \"8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d\") " pod="openshift-console/console-6877675969-jzwwr" Jun 09 05:33:17.574876 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:17.574858 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d-console-serving-cert\") pod \"console-6877675969-jzwwr\" (UID: \"8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d\") " pod="openshift-console/console-6877675969-jzwwr" Jun 09 05:33:17.580544 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:17.580524 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-77z2q\" (UniqueName: \"kubernetes.io/projected/8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d-kube-api-access-77z2q\") pod \"console-6877675969-jzwwr\" (UID: \"8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d\") " pod="openshift-console/console-6877675969-jzwwr" Jun 09 05:33:17.627208 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:17.627186 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6877675969-jzwwr" Jun 09 05:33:17.748279 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:17.748247 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6877675969-jzwwr"] Jun 09 05:33:17.750352 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:33:17.750328 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8121cbfb_ae6f_4a25_8ad6_5885e2e5cf7d.slice/crio-cef765d77c7b9094b83ccc6ce93a5924805934147ff030cc59378a7ba04f765f WatchSource:0}: Error finding container cef765d77c7b9094b83ccc6ce93a5924805934147ff030cc59378a7ba04f765f: Status 404 returned error can't find the container with id cef765d77c7b9094b83ccc6ce93a5924805934147ff030cc59378a7ba04f765f Jun 09 05:33:18.180840 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:18.180784 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6877675969-jzwwr" event={"ID":"8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d","Type":"ContainerStarted","Data":"ac833bc4a2779d00cc7462286fbb80a590d4efd6ad1efe4a9651e2185a12ed2f"} Jun 09 05:33:18.181251 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:18.180859 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6877675969-jzwwr" event={"ID":"8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d","Type":"ContainerStarted","Data":"cef765d77c7b9094b83ccc6ce93a5924805934147ff030cc59378a7ba04f765f"} Jun 09 05:33:18.196439 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:18.196393 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6877675969-jzwwr" podStartSLOduration=1.196376861 podStartE2EDuration="1.196376861s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 05:33:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 05:33:18.195821542 +0000 UTC m=+248.278473293" watchObservedRunningTime="2026-06-09 05:33:18.196376861 +0000 UTC m=+248.279028600" Jun 09 05:33:19.312432 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:19.312345 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-9ffff86c7-mcqvf" podUID="09110d03-6ef0-4c54-afb7-872377f07269" containerName="registry" containerID="cri-o://7d701aac4289aedef64fa209b7d86ecf5c255d90a73b4d4e9c25ad954cc91e0b" gracePeriod=30 Jun 09 05:33:19.551779 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:19.551752 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9ffff86c7-mcqvf" Jun 09 05:33:19.592259 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:19.592190 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/09110d03-6ef0-4c54-afb7-872377f07269-registry-certificates\") pod \"09110d03-6ef0-4c54-afb7-872377f07269\" (UID: \"09110d03-6ef0-4c54-afb7-872377f07269\") " Jun 09 05:33:19.592259 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:19.592222 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/09110d03-6ef0-4c54-afb7-872377f07269-trusted-ca\") pod \"09110d03-6ef0-4c54-afb7-872377f07269\" (UID: \"09110d03-6ef0-4c54-afb7-872377f07269\") " Jun 09 05:33:19.592259 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:19.592251 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/09110d03-6ef0-4c54-afb7-872377f07269-bound-sa-token\") pod \"09110d03-6ef0-4c54-afb7-872377f07269\" (UID: \"09110d03-6ef0-4c54-afb7-872377f07269\") " Jun 09 05:33:19.592483 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:19.592291 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/09110d03-6ef0-4c54-afb7-872377f07269-installation-pull-secrets\") pod \"09110d03-6ef0-4c54-afb7-872377f07269\" (UID: \"09110d03-6ef0-4c54-afb7-872377f07269\") " Jun 09 05:33:19.592483 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:19.592331 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kks2k\" (UniqueName: \"kubernetes.io/projected/09110d03-6ef0-4c54-afb7-872377f07269-kube-api-access-kks2k\") pod \"09110d03-6ef0-4c54-afb7-872377f07269\" (UID: \"09110d03-6ef0-4c54-afb7-872377f07269\") " Jun 09 05:33:19.592483 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:19.592373 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/09110d03-6ef0-4c54-afb7-872377f07269-image-registry-private-configuration\") pod \"09110d03-6ef0-4c54-afb7-872377f07269\" (UID: \"09110d03-6ef0-4c54-afb7-872377f07269\") " Jun 09 05:33:19.592483 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:19.592404 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/09110d03-6ef0-4c54-afb7-872377f07269-ca-trust-extracted\") pod \"09110d03-6ef0-4c54-afb7-872377f07269\" (UID: \"09110d03-6ef0-4c54-afb7-872377f07269\") " Jun 09 05:33:19.592483 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:19.592470 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/09110d03-6ef0-4c54-afb7-872377f07269-registry-tls\") pod \"09110d03-6ef0-4c54-afb7-872377f07269\" (UID: \"09110d03-6ef0-4c54-afb7-872377f07269\") " Jun 09 05:33:19.593314 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:19.592683 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09110d03-6ef0-4c54-afb7-872377f07269-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "09110d03-6ef0-4c54-afb7-872377f07269" (UID: "09110d03-6ef0-4c54-afb7-872377f07269"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 05:33:19.593314 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:19.592746 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09110d03-6ef0-4c54-afb7-872377f07269-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "09110d03-6ef0-4c54-afb7-872377f07269" (UID: "09110d03-6ef0-4c54-afb7-872377f07269"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 05:33:19.593314 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:19.592829 2564 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/09110d03-6ef0-4c54-afb7-872377f07269-registry-certificates\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:33:19.594678 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:19.594649 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/09110d03-6ef0-4c54-afb7-872377f07269-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "09110d03-6ef0-4c54-afb7-872377f07269" (UID: "09110d03-6ef0-4c54-afb7-872377f07269"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 05:33:19.594860 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:19.594663 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/09110d03-6ef0-4c54-afb7-872377f07269-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "09110d03-6ef0-4c54-afb7-872377f07269" (UID: "09110d03-6ef0-4c54-afb7-872377f07269"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 05:33:19.594860 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:19.594780 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09110d03-6ef0-4c54-afb7-872377f07269-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "09110d03-6ef0-4c54-afb7-872377f07269" (UID: "09110d03-6ef0-4c54-afb7-872377f07269"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 05:33:19.594860 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:19.594780 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09110d03-6ef0-4c54-afb7-872377f07269-kube-api-access-kks2k" (OuterVolumeSpecName: "kube-api-access-kks2k") pod "09110d03-6ef0-4c54-afb7-872377f07269" (UID: "09110d03-6ef0-4c54-afb7-872377f07269"). InnerVolumeSpecName "kube-api-access-kks2k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 05:33:19.595106 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:19.595087 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09110d03-6ef0-4c54-afb7-872377f07269-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "09110d03-6ef0-4c54-afb7-872377f07269" (UID: "09110d03-6ef0-4c54-afb7-872377f07269"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 05:33:19.600964 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:19.600941 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09110d03-6ef0-4c54-afb7-872377f07269-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "09110d03-6ef0-4c54-afb7-872377f07269" (UID: "09110d03-6ef0-4c54-afb7-872377f07269"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 05:33:19.694164 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:19.694135 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/09110d03-6ef0-4c54-afb7-872377f07269-trusted-ca\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:33:19.694164 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:19.694160 2564 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/09110d03-6ef0-4c54-afb7-872377f07269-bound-sa-token\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:33:19.694164 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:19.694169 2564 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/09110d03-6ef0-4c54-afb7-872377f07269-installation-pull-secrets\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:33:19.694367 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:19.694177 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kks2k\" (UniqueName: \"kubernetes.io/projected/09110d03-6ef0-4c54-afb7-872377f07269-kube-api-access-kks2k\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:33:19.694367 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:19.694187 2564 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/09110d03-6ef0-4c54-afb7-872377f07269-image-registry-private-configuration\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:33:19.694367 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:19.694196 2564 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/09110d03-6ef0-4c54-afb7-872377f07269-ca-trust-extracted\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:33:19.694367 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:19.694205 2564 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/09110d03-6ef0-4c54-afb7-872377f07269-registry-tls\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:33:20.189501 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:20.189472 2564 generic.go:356] "Generic (PLEG): container finished" podID="09110d03-6ef0-4c54-afb7-872377f07269" containerID="7d701aac4289aedef64fa209b7d86ecf5c255d90a73b4d4e9c25ad954cc91e0b" exitCode=0 Jun 09 05:33:20.189642 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:20.189515 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9ffff86c7-mcqvf" Jun 09 05:33:20.189642 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:20.189542 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-9ffff86c7-mcqvf" event={"ID":"09110d03-6ef0-4c54-afb7-872377f07269","Type":"ContainerDied","Data":"7d701aac4289aedef64fa209b7d86ecf5c255d90a73b4d4e9c25ad954cc91e0b"} Jun 09 05:33:20.189642 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:20.189580 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-9ffff86c7-mcqvf" event={"ID":"09110d03-6ef0-4c54-afb7-872377f07269","Type":"ContainerDied","Data":"1951d57737a0b8bee398511bacfd5b9e1ff9dbf24367d5b682ac0f14471be3b4"} Jun 09 05:33:20.189642 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:20.189600 2564 scope.go:117] "RemoveContainer" containerID="7d701aac4289aedef64fa209b7d86ecf5c255d90a73b4d4e9c25ad954cc91e0b" Jun 09 05:33:20.203492 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:20.203475 2564 scope.go:117] "RemoveContainer" containerID="7d701aac4289aedef64fa209b7d86ecf5c255d90a73b4d4e9c25ad954cc91e0b" Jun 09 05:33:20.203732 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:33:20.203707 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d701aac4289aedef64fa209b7d86ecf5c255d90a73b4d4e9c25ad954cc91e0b\": container with ID starting with 7d701aac4289aedef64fa209b7d86ecf5c255d90a73b4d4e9c25ad954cc91e0b not found: ID does not exist" containerID="7d701aac4289aedef64fa209b7d86ecf5c255d90a73b4d4e9c25ad954cc91e0b" Jun 09 05:33:20.203777 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:20.203740 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d701aac4289aedef64fa209b7d86ecf5c255d90a73b4d4e9c25ad954cc91e0b"} err="failed to get container status \"7d701aac4289aedef64fa209b7d86ecf5c255d90a73b4d4e9c25ad954cc91e0b\": rpc error: code = NotFound desc = could not find container \"7d701aac4289aedef64fa209b7d86ecf5c255d90a73b4d4e9c25ad954cc91e0b\": container with ID starting with 7d701aac4289aedef64fa209b7d86ecf5c255d90a73b4d4e9c25ad954cc91e0b not found: ID does not exist" Jun 09 05:33:20.215947 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:20.215922 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-9ffff86c7-mcqvf"] Jun 09 05:33:20.219905 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:20.219885 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-9ffff86c7-mcqvf"] Jun 09 05:33:20.346112 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:20.346084 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="09110d03-6ef0-4c54-afb7-872377f07269" path="/var/lib/kubelet/pods/09110d03-6ef0-4c54-afb7-872377f07269/volumes" Jun 09 05:33:22.317942 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:22.317894 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/73b6af10-58e6-4c5f-bcfc-083f82dfc9db-metrics-certs\") pod \"network-metrics-daemon-g2vt2\" (UID: \"73b6af10-58e6-4c5f-bcfc-083f82dfc9db\") " pod="openshift-multus/network-metrics-daemon-g2vt2" Jun 09 05:33:22.320317 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:22.320295 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/73b6af10-58e6-4c5f-bcfc-083f82dfc9db-metrics-certs\") pod \"network-metrics-daemon-g2vt2\" (UID: \"73b6af10-58e6-4c5f-bcfc-083f82dfc9db\") " pod="openshift-multus/network-metrics-daemon-g2vt2" Jun 09 05:33:22.343731 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:22.343703 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tg4g2\"" Jun 09 05:33:22.352545 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:22.352513 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g2vt2" Jun 09 05:33:22.483332 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:22.483238 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-g2vt2"] Jun 09 05:33:22.487696 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:33:22.487661 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73b6af10_58e6_4c5f_bcfc_083f82dfc9db.slice/crio-32ed3afa078abba541d9352ae45be71c1d2d74b8cc33c60d988847cceb85b265 WatchSource:0}: Error finding container 32ed3afa078abba541d9352ae45be71c1d2d74b8cc33c60d988847cceb85b265: Status 404 returned error can't find the container with id 32ed3afa078abba541d9352ae45be71c1d2d74b8cc33c60d988847cceb85b265 Jun 09 05:33:23.203171 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:23.203137 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-g2vt2" event={"ID":"73b6af10-58e6-4c5f-bcfc-083f82dfc9db","Type":"ContainerStarted","Data":"32ed3afa078abba541d9352ae45be71c1d2d74b8cc33c60d988847cceb85b265"} Jun 09 05:33:24.213714 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:24.213681 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-g2vt2" event={"ID":"73b6af10-58e6-4c5f-bcfc-083f82dfc9db","Type":"ContainerStarted","Data":"a8f449d25a0a4395545a48cc499901841c5613c1706ea4337125d7a88472ae15"} Jun 09 05:33:24.214167 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:24.213754 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-g2vt2" event={"ID":"73b6af10-58e6-4c5f-bcfc-083f82dfc9db","Type":"ContainerStarted","Data":"806d210ed6caf91b5c34a984024ae1e39fc0bb97bdc32a7a80659d35a022623f"} Jun 09 05:33:24.228754 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:24.228714 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-g2vt2" podStartSLOduration=253.265999024 podStartE2EDuration="4m14.228698969s" totalImagesPullingTime="962.699945ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 05:29:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 05:33:24.227498876 +0000 UTC m=+254.310150612" watchObservedRunningTime="2026-06-09 05:33:24.228698969 +0000 UTC m=+254.311350712" Jun 09 05:33:24.479263 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:24.479184 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5cffbdf6c5-px4mf" Jun 09 05:33:24.479263 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:24.479237 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5cffbdf6c5-px4mf" Jun 09 05:33:24.480535 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:24.480510 2564 patch_prober.go:28] interesting pod/console-5cffbdf6c5-px4mf container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.23:8443/health\": dial tcp 10.133.0.23:8443: connect: connection refused" start-of-body= Jun 09 05:33:24.480653 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:24.480559 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5cffbdf6c5-px4mf" podUID="e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752" containerName="console" probeResult="failure" output="Get \"https://10.133.0.23:8443/health\": dial tcp 10.133.0.23:8443: connect: connection refused" Jun 09 05:33:27.627610 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:27.627575 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6877675969-jzwwr" Jun 09 05:33:27.628081 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:27.627648 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6877675969-jzwwr" Jun 09 05:33:27.629021 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:27.628992 2564 patch_prober.go:28] interesting pod/console-6877675969-jzwwr container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.25:8443/health\": dial tcp 10.133.0.25:8443: connect: connection refused" start-of-body= Jun 09 05:33:27.629126 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:27.629051 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6877675969-jzwwr" podUID="8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d" containerName="console" probeResult="failure" output="Get \"https://10.133.0.25:8443/health\": dial tcp 10.133.0.25:8443: connect: connection refused" Jun 09 05:33:34.480101 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:34.480062 2564 patch_prober.go:28] interesting pod/console-5cffbdf6c5-px4mf container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.23:8443/health\": dial tcp 10.133.0.23:8443: connect: connection refused" start-of-body= Jun 09 05:33:34.480526 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:34.480114 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5cffbdf6c5-px4mf" podUID="e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752" containerName="console" probeResult="failure" output="Get \"https://10.133.0.23:8443/health\": dial tcp 10.133.0.23:8443: connect: connection refused" Jun 09 05:33:37.628258 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:37.628224 2564 patch_prober.go:28] interesting pod/console-6877675969-jzwwr container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.25:8443/health\": dial tcp 10.133.0.25:8443: connect: connection refused" start-of-body= Jun 09 05:33:37.628605 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:37.628287 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6877675969-jzwwr" podUID="8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d" containerName="console" probeResult="failure" output="Get \"https://10.133.0.25:8443/health\": dial tcp 10.133.0.25:8443: connect: connection refused" Jun 09 05:33:39.170992 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:39.170937 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-685f578bdb-nmlg4" podUID="27f5c4e4-b1f4-4132-80be-a3d46df42f4e" containerName="console" containerID="cri-o://0a2a087ca88cd991a4e138086ac01eaab841a54ecae7e924a536066441ae9722" gracePeriod=15 Jun 09 05:33:42.306749 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:42.306705 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-8f84b5d59-rhn74" podUID="3d348c05-f72b-4145-8152-9ba13b80a0af" containerName="console" containerID="cri-o://e479f3b73227116b2496479f1e37ee7a5c29c9df418ccf0e4149c9144a916062" gracePeriod=15 Jun 09 05:33:43.297546 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:43.297513 2564 generic.go:356] "Generic (PLEG): container finished" podID="105c1a70-a1c8-478d-982a-41a350a2dbd2" containerID="26f08cda32562cb0aa9203613f2064ee367cfae1f7b639acb2f0b4f80ef39a10" exitCode=0 Jun 09 05:33:43.297705 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:43.297586 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-lx6qd" event={"ID":"105c1a70-a1c8-478d-982a-41a350a2dbd2","Type":"ContainerDied","Data":"26f08cda32562cb0aa9203613f2064ee367cfae1f7b639acb2f0b4f80ef39a10"} Jun 09 05:33:43.297935 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:43.297921 2564 scope.go:117] "RemoveContainer" containerID="26f08cda32562cb0aa9203613f2064ee367cfae1f7b639acb2f0b4f80ef39a10" Jun 09 05:33:44.303843 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:44.303791 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-lx6qd" event={"ID":"105c1a70-a1c8-478d-982a-41a350a2dbd2","Type":"ContainerStarted","Data":"33c5f132279e90c77a31ec52e5a199ca035b324b772c1b2f215318637cb0e737"} Jun 09 05:33:44.479674 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:44.479644 2564 patch_prober.go:28] interesting pod/console-5cffbdf6c5-px4mf container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.23:8443/health\": dial tcp 10.133.0.23:8443: connect: connection refused" start-of-body= Jun 09 05:33:44.479854 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:44.479685 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5cffbdf6c5-px4mf" podUID="e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752" containerName="console" probeResult="failure" output="Get \"https://10.133.0.23:8443/health\": dial tcp 10.133.0.23:8443: connect: connection refused" Jun 09 05:33:47.628123 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:47.628085 2564 patch_prober.go:28] interesting pod/console-6877675969-jzwwr container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.25:8443/health\": dial tcp 10.133.0.25:8443: connect: connection refused" start-of-body= Jun 09 05:33:47.628503 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:47.628184 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6877675969-jzwwr" podUID="8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d" containerName="console" probeResult="failure" output="Get \"https://10.133.0.25:8443/health\": dial tcp 10.133.0.25:8443: connect: connection refused" Jun 09 05:33:47.776776 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:47.776751 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-685f578bdb-nmlg4" Jun 09 05:33:47.779568 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:47.779551 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8f84b5d59-rhn74" Jun 09 05:33:47.945975 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:47.945870 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d348c05-f72b-4145-8152-9ba13b80a0af-console-serving-cert\") pod \"3d348c05-f72b-4145-8152-9ba13b80a0af\" (UID: \"3d348c05-f72b-4145-8152-9ba13b80a0af\") " Jun 09 05:33:47.945975 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:47.945923 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/27f5c4e4-b1f4-4132-80be-a3d46df42f4e-console-serving-cert\") pod \"27f5c4e4-b1f4-4132-80be-a3d46df42f4e\" (UID: \"27f5c4e4-b1f4-4132-80be-a3d46df42f4e\") " Jun 09 05:33:47.945975 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:47.945954 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/27f5c4e4-b1f4-4132-80be-a3d46df42f4e-oauth-serving-cert\") pod \"27f5c4e4-b1f4-4132-80be-a3d46df42f4e\" (UID: \"27f5c4e4-b1f4-4132-80be-a3d46df42f4e\") " Jun 09 05:33:47.945975 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:47.945979 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d348c05-f72b-4145-8152-9ba13b80a0af-service-ca\") pod \"3d348c05-f72b-4145-8152-9ba13b80a0af\" (UID: \"3d348c05-f72b-4145-8152-9ba13b80a0af\") " Jun 09 05:33:47.946300 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:47.946007 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/27f5c4e4-b1f4-4132-80be-a3d46df42f4e-service-ca\") pod \"27f5c4e4-b1f4-4132-80be-a3d46df42f4e\" (UID: \"27f5c4e4-b1f4-4132-80be-a3d46df42f4e\") " Jun 09 05:33:47.946300 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:47.946032 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vbxqh\" (UniqueName: \"kubernetes.io/projected/27f5c4e4-b1f4-4132-80be-a3d46df42f4e-kube-api-access-vbxqh\") pod \"27f5c4e4-b1f4-4132-80be-a3d46df42f4e\" (UID: \"27f5c4e4-b1f4-4132-80be-a3d46df42f4e\") " Jun 09 05:33:47.946300 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:47.946177 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d348c05-f72b-4145-8152-9ba13b80a0af-console-oauth-config\") pod \"3d348c05-f72b-4145-8152-9ba13b80a0af\" (UID: \"3d348c05-f72b-4145-8152-9ba13b80a0af\") " Jun 09 05:33:47.946300 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:47.946220 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/27f5c4e4-b1f4-4132-80be-a3d46df42f4e-console-oauth-config\") pod \"27f5c4e4-b1f4-4132-80be-a3d46df42f4e\" (UID: \"27f5c4e4-b1f4-4132-80be-a3d46df42f4e\") " Jun 09 05:33:47.946300 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:47.946250 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/27f5c4e4-b1f4-4132-80be-a3d46df42f4e-console-config\") pod \"27f5c4e4-b1f4-4132-80be-a3d46df42f4e\" (UID: \"27f5c4e4-b1f4-4132-80be-a3d46df42f4e\") " Jun 09 05:33:47.946300 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:47.946271 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d348c05-f72b-4145-8152-9ba13b80a0af-oauth-serving-cert\") pod \"3d348c05-f72b-4145-8152-9ba13b80a0af\" (UID: \"3d348c05-f72b-4145-8152-9ba13b80a0af\") " Jun 09 05:33:47.946603 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:47.946326 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d348c05-f72b-4145-8152-9ba13b80a0af-trusted-ca-bundle\") pod \"3d348c05-f72b-4145-8152-9ba13b80a0af\" (UID: \"3d348c05-f72b-4145-8152-9ba13b80a0af\") " Jun 09 05:33:47.946603 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:47.946353 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hkqlt\" (UniqueName: \"kubernetes.io/projected/3d348c05-f72b-4145-8152-9ba13b80a0af-kube-api-access-hkqlt\") pod \"3d348c05-f72b-4145-8152-9ba13b80a0af\" (UID: \"3d348c05-f72b-4145-8152-9ba13b80a0af\") " Jun 09 05:33:47.946603 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:47.946384 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d348c05-f72b-4145-8152-9ba13b80a0af-console-config\") pod \"3d348c05-f72b-4145-8152-9ba13b80a0af\" (UID: \"3d348c05-f72b-4145-8152-9ba13b80a0af\") " Jun 09 05:33:47.946603 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:47.946448 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d348c05-f72b-4145-8152-9ba13b80a0af-service-ca" (OuterVolumeSpecName: "service-ca") pod "3d348c05-f72b-4145-8152-9ba13b80a0af" (UID: "3d348c05-f72b-4145-8152-9ba13b80a0af"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 05:33:47.946603 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:47.946457 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27f5c4e4-b1f4-4132-80be-a3d46df42f4e-service-ca" (OuterVolumeSpecName: "service-ca") pod "27f5c4e4-b1f4-4132-80be-a3d46df42f4e" (UID: "27f5c4e4-b1f4-4132-80be-a3d46df42f4e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 05:33:47.946603 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:47.946536 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27f5c4e4-b1f4-4132-80be-a3d46df42f4e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "27f5c4e4-b1f4-4132-80be-a3d46df42f4e" (UID: "27f5c4e4-b1f4-4132-80be-a3d46df42f4e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 05:33:47.946927 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:47.946723 2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/27f5c4e4-b1f4-4132-80be-a3d46df42f4e-oauth-serving-cert\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:33:47.946927 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:47.946742 2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d348c05-f72b-4145-8152-9ba13b80a0af-service-ca\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:33:47.946927 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:47.946756 2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/27f5c4e4-b1f4-4132-80be-a3d46df42f4e-service-ca\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:33:47.946927 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:47.946845 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27f5c4e4-b1f4-4132-80be-a3d46df42f4e-console-config" (OuterVolumeSpecName: "console-config") pod "27f5c4e4-b1f4-4132-80be-a3d46df42f4e" (UID: "27f5c4e4-b1f4-4132-80be-a3d46df42f4e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 05:33:47.947126 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:47.947025 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d348c05-f72b-4145-8152-9ba13b80a0af-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3d348c05-f72b-4145-8152-9ba13b80a0af" (UID: "3d348c05-f72b-4145-8152-9ba13b80a0af"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 05:33:47.947126 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:47.947069 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d348c05-f72b-4145-8152-9ba13b80a0af-console-config" (OuterVolumeSpecName: "console-config") pod "3d348c05-f72b-4145-8152-9ba13b80a0af" (UID: "3d348c05-f72b-4145-8152-9ba13b80a0af"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 05:33:47.947460 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:47.947431 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d348c05-f72b-4145-8152-9ba13b80a0af-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3d348c05-f72b-4145-8152-9ba13b80a0af" (UID: "3d348c05-f72b-4145-8152-9ba13b80a0af"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 05:33:47.948930 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:47.948906 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27f5c4e4-b1f4-4132-80be-a3d46df42f4e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "27f5c4e4-b1f4-4132-80be-a3d46df42f4e" (UID: "27f5c4e4-b1f4-4132-80be-a3d46df42f4e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 05:33:47.949079 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:47.948950 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27f5c4e4-b1f4-4132-80be-a3d46df42f4e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "27f5c4e4-b1f4-4132-80be-a3d46df42f4e" (UID: "27f5c4e4-b1f4-4132-80be-a3d46df42f4e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 05:33:47.949079 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:47.948962 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27f5c4e4-b1f4-4132-80be-a3d46df42f4e-kube-api-access-vbxqh" (OuterVolumeSpecName: "kube-api-access-vbxqh") pod "27f5c4e4-b1f4-4132-80be-a3d46df42f4e" (UID: "27f5c4e4-b1f4-4132-80be-a3d46df42f4e"). InnerVolumeSpecName "kube-api-access-vbxqh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 05:33:47.949079 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:47.948959 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d348c05-f72b-4145-8152-9ba13b80a0af-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3d348c05-f72b-4145-8152-9ba13b80a0af" (UID: "3d348c05-f72b-4145-8152-9ba13b80a0af"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 05:33:47.949079 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:47.948972 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d348c05-f72b-4145-8152-9ba13b80a0af-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3d348c05-f72b-4145-8152-9ba13b80a0af" (UID: "3d348c05-f72b-4145-8152-9ba13b80a0af"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 05:33:47.949216 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:47.949095 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d348c05-f72b-4145-8152-9ba13b80a0af-kube-api-access-hkqlt" (OuterVolumeSpecName: "kube-api-access-hkqlt") pod "3d348c05-f72b-4145-8152-9ba13b80a0af" (UID: "3d348c05-f72b-4145-8152-9ba13b80a0af"). InnerVolumeSpecName "kube-api-access-hkqlt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 05:33:48.047207 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:48.047170 2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d348c05-f72b-4145-8152-9ba13b80a0af-console-oauth-config\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:33:48.047207 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:48.047202 2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/27f5c4e4-b1f4-4132-80be-a3d46df42f4e-console-oauth-config\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:33:48.047207 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:48.047211 2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/27f5c4e4-b1f4-4132-80be-a3d46df42f4e-console-config\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:33:48.047407 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:48.047220 2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d348c05-f72b-4145-8152-9ba13b80a0af-oauth-serving-cert\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:33:48.047407 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:48.047229 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d348c05-f72b-4145-8152-9ba13b80a0af-trusted-ca-bundle\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:33:48.047407 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:48.047236 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hkqlt\" (UniqueName: \"kubernetes.io/projected/3d348c05-f72b-4145-8152-9ba13b80a0af-kube-api-access-hkqlt\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:33:48.047407 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:48.047246 2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d348c05-f72b-4145-8152-9ba13b80a0af-console-config\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:33:48.047407 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:48.047254 2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d348c05-f72b-4145-8152-9ba13b80a0af-console-serving-cert\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:33:48.047407 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:48.047262 2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/27f5c4e4-b1f4-4132-80be-a3d46df42f4e-console-serving-cert\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:33:48.047407 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:48.047270 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vbxqh\" (UniqueName: \"kubernetes.io/projected/27f5c4e4-b1f4-4132-80be-a3d46df42f4e-kube-api-access-vbxqh\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:33:48.321715 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:48.321684 2564 generic.go:356] "Generic (PLEG): container finished" podID="3d348c05-f72b-4145-8152-9ba13b80a0af" containerID="e479f3b73227116b2496479f1e37ee7a5c29c9df418ccf0e4149c9144a916062" exitCode=0 Jun 09 05:33:48.321907 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:48.321737 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8f84b5d59-rhn74" Jun 09 05:33:48.321907 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:48.321763 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8f84b5d59-rhn74" event={"ID":"3d348c05-f72b-4145-8152-9ba13b80a0af","Type":"ContainerDied","Data":"e479f3b73227116b2496479f1e37ee7a5c29c9df418ccf0e4149c9144a916062"} Jun 09 05:33:48.321907 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:48.321869 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8f84b5d59-rhn74" event={"ID":"3d348c05-f72b-4145-8152-9ba13b80a0af","Type":"ContainerDied","Data":"ae478603e4fdeff4380582d442527ad5870c781a144bad1d491e536f73ecca69"} Jun 09 05:33:48.321907 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:48.321893 2564 scope.go:117] "RemoveContainer" containerID="e479f3b73227116b2496479f1e37ee7a5c29c9df418ccf0e4149c9144a916062" Jun 09 05:33:48.323154 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:48.323131 2564 generic.go:356] "Generic (PLEG): container finished" podID="27f5c4e4-b1f4-4132-80be-a3d46df42f4e" containerID="0a2a087ca88cd991a4e138086ac01eaab841a54ecae7e924a536066441ae9722" exitCode=0 Jun 09 05:33:48.323244 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:48.323157 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-685f578bdb-nmlg4" event={"ID":"27f5c4e4-b1f4-4132-80be-a3d46df42f4e","Type":"ContainerDied","Data":"0a2a087ca88cd991a4e138086ac01eaab841a54ecae7e924a536066441ae9722"} Jun 09 05:33:48.323244 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:48.323194 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-685f578bdb-nmlg4" Jun 09 05:33:48.323244 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:48.323201 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-685f578bdb-nmlg4" event={"ID":"27f5c4e4-b1f4-4132-80be-a3d46df42f4e","Type":"ContainerDied","Data":"50e8d56dc431afc5b060352ee7033eb95496971e1f051fba48ce81de5687dced"} Jun 09 05:33:48.333300 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:48.332275 2564 scope.go:117] "RemoveContainer" containerID="e479f3b73227116b2496479f1e37ee7a5c29c9df418ccf0e4149c9144a916062" Jun 09 05:33:48.333300 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:33:48.332550 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e479f3b73227116b2496479f1e37ee7a5c29c9df418ccf0e4149c9144a916062\": container with ID starting with e479f3b73227116b2496479f1e37ee7a5c29c9df418ccf0e4149c9144a916062 not found: ID does not exist" containerID="e479f3b73227116b2496479f1e37ee7a5c29c9df418ccf0e4149c9144a916062" Jun 09 05:33:48.333300 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:48.332577 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e479f3b73227116b2496479f1e37ee7a5c29c9df418ccf0e4149c9144a916062"} err="failed to get container status \"e479f3b73227116b2496479f1e37ee7a5c29c9df418ccf0e4149c9144a916062\": rpc error: code = NotFound desc = could not find container \"e479f3b73227116b2496479f1e37ee7a5c29c9df418ccf0e4149c9144a916062\": container with ID starting with e479f3b73227116b2496479f1e37ee7a5c29c9df418ccf0e4149c9144a916062 not found: ID does not exist" Jun 09 05:33:48.333300 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:48.332598 2564 scope.go:117] "RemoveContainer" containerID="0a2a087ca88cd991a4e138086ac01eaab841a54ecae7e924a536066441ae9722" Jun 09 05:33:48.340469 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:48.340449 2564 scope.go:117] "RemoveContainer" containerID="0a2a087ca88cd991a4e138086ac01eaab841a54ecae7e924a536066441ae9722" Jun 09 05:33:48.340704 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:33:48.340686 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a2a087ca88cd991a4e138086ac01eaab841a54ecae7e924a536066441ae9722\": container with ID starting with 0a2a087ca88cd991a4e138086ac01eaab841a54ecae7e924a536066441ae9722 not found: ID does not exist" containerID="0a2a087ca88cd991a4e138086ac01eaab841a54ecae7e924a536066441ae9722" Jun 09 05:33:48.340777 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:48.340709 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a2a087ca88cd991a4e138086ac01eaab841a54ecae7e924a536066441ae9722"} err="failed to get container status \"0a2a087ca88cd991a4e138086ac01eaab841a54ecae7e924a536066441ae9722\": rpc error: code = NotFound desc = could not find container \"0a2a087ca88cd991a4e138086ac01eaab841a54ecae7e924a536066441ae9722\": container with ID starting with 0a2a087ca88cd991a4e138086ac01eaab841a54ecae7e924a536066441ae9722 not found: ID does not exist" Jun 09 05:33:48.345345 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:48.345326 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8f84b5d59-rhn74"] Jun 09 05:33:48.347783 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:48.347762 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8f84b5d59-rhn74"] Jun 09 05:33:48.356525 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:48.356505 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-685f578bdb-nmlg4"] Jun 09 05:33:48.362030 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:48.362010 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-685f578bdb-nmlg4"] Jun 09 05:33:50.345965 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:50.345928 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27f5c4e4-b1f4-4132-80be-a3d46df42f4e" path="/var/lib/kubelet/pods/27f5c4e4-b1f4-4132-80be-a3d46df42f4e/volumes" Jun 09 05:33:50.346491 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:50.346472 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d348c05-f72b-4145-8152-9ba13b80a0af" path="/var/lib/kubelet/pods/3d348c05-f72b-4145-8152-9ba13b80a0af/volumes" Jun 09 05:33:50.823062 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:33:50.823026 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-xv6r9" podUID="516d15e3-b193-4355-8f8d-991da86b5526" Jun 09 05:33:51.337407 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:51.337372 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xv6r9" Jun 09 05:33:53.347702 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:53.347662 2564 generic.go:356] "Generic (PLEG): container finished" podID="5aadd1b0-611a-48e8-bde8-9fbb65562c69" containerID="ec6f533e3aa1e451306b7be8cbb208816d651688f1c25e67a2a5f7932b1ce4c0" exitCode=0 Jun 09 05:33:53.348141 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:53.347736 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-r4vnz" event={"ID":"5aadd1b0-611a-48e8-bde8-9fbb65562c69","Type":"ContainerDied","Data":"ec6f533e3aa1e451306b7be8cbb208816d651688f1c25e67a2a5f7932b1ce4c0"} Jun 09 05:33:53.348198 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:53.348153 2564 scope.go:117] "RemoveContainer" containerID="ec6f533e3aa1e451306b7be8cbb208816d651688f1c25e67a2a5f7932b1ce4c0" Jun 09 05:33:53.349304 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:53.349273 2564 generic.go:356] "Generic (PLEG): container finished" podID="c01ba14d-9950-4d95-b65e-a651fda07075" containerID="8212bade71d32f4443bf4c3300ccacd9c3ac2f595ec23e515e841b63d578c14d" exitCode=0 Jun 09 05:33:53.349392 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:53.349322 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-c7jcw" event={"ID":"c01ba14d-9950-4d95-b65e-a651fda07075","Type":"ContainerDied","Data":"8212bade71d32f4443bf4c3300ccacd9c3ac2f595ec23e515e841b63d578c14d"} Jun 09 05:33:53.349586 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:53.349570 2564 scope.go:117] "RemoveContainer" containerID="8212bade71d32f4443bf4c3300ccacd9c3ac2f595ec23e515e841b63d578c14d" Jun 09 05:33:54.355996 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:54.355961 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-c7jcw" event={"ID":"c01ba14d-9950-4d95-b65e-a651fda07075","Type":"ContainerStarted","Data":"1242726a01773af2e8300fa50b8a28d11bdc8a262103c3abbdb036421ebf38ee"} Jun 09 05:33:54.357873 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:54.357850 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-r4vnz" event={"ID":"5aadd1b0-611a-48e8-bde8-9fbb65562c69","Type":"ContainerStarted","Data":"078fa9282600247a129ef84d28e19c96966dd881b7c9223e9245f46359cae38f"} Jun 09 05:33:54.484046 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:54.484019 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5cffbdf6c5-px4mf" Jun 09 05:33:54.488103 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:54.488076 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5cffbdf6c5-px4mf" Jun 09 05:33:54.705076 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:54.704992 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/516d15e3-b193-4355-8f8d-991da86b5526-metrics-tls\") pod \"dns-default-xv6r9\" (UID: \"516d15e3-b193-4355-8f8d-991da86b5526\") " pod="openshift-dns/dns-default-xv6r9" Jun 09 05:33:54.707364 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:54.707340 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/516d15e3-b193-4355-8f8d-991da86b5526-metrics-tls\") pod \"dns-default-xv6r9\" (UID: \"516d15e3-b193-4355-8f8d-991da86b5526\") " pod="openshift-dns/dns-default-xv6r9" Jun 09 05:33:54.940512 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:54.940480 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ww7k9\"" Jun 09 05:33:54.948726 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:54.948695 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xv6r9" Jun 09 05:33:55.081000 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:55.080976 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xv6r9"] Jun 09 05:33:55.082899 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:33:55.082869 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod516d15e3_b193_4355_8f8d_991da86b5526.slice/crio-9c9c073027f120ec6e440f415751e633aba3d331e6f56df1245869f833d03697 WatchSource:0}: Error finding container 9c9c073027f120ec6e440f415751e633aba3d331e6f56df1245869f833d03697: Status 404 returned error can't find the container with id 9c9c073027f120ec6e440f415751e633aba3d331e6f56df1245869f833d03697 Jun 09 05:33:55.363678 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:55.363645 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xv6r9" event={"ID":"516d15e3-b193-4355-8f8d-991da86b5526","Type":"ContainerStarted","Data":"9c9c073027f120ec6e440f415751e633aba3d331e6f56df1245869f833d03697"} Jun 09 05:33:57.375248 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:57.375208 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xv6r9" event={"ID":"516d15e3-b193-4355-8f8d-991da86b5526","Type":"ContainerStarted","Data":"488faead965c94b011482704bcefdc99c6096e9312a2a1195b7ca8f3984ee5cd"} Jun 09 05:33:57.375653 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:57.375262 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xv6r9" event={"ID":"516d15e3-b193-4355-8f8d-991da86b5526","Type":"ContainerStarted","Data":"fd18cc5b6a3c831222acbfebc4e8ef2460f72c141cca7971a6249e11564bfe5b"} Jun 09 05:33:57.375653 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:57.375334 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-xv6r9" Jun 09 05:33:57.391790 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:57.391747 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-xv6r9" podStartSLOduration=251.659218948 podStartE2EDuration="4m13.391734091s" totalImagesPullingTime="1.732515143s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 05:29:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 05:33:57.390149114 +0000 UTC m=+287.472800870" watchObservedRunningTime="2026-06-09 05:33:57.391734091 +0000 UTC m=+287.474385827" Jun 09 05:33:57.631675 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:57.631599 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6877675969-jzwwr" Jun 09 05:33:57.635487 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:57.635463 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6877675969-jzwwr" Jun 09 05:33:57.696155 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:33:57.696125 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5cffbdf6c5-px4mf"] Jun 09 05:34:07.382151 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:07.382121 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-xv6r9" Jun 09 05:34:10.304211 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:10.304190 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-42h5b_02c37648-4419-4ff7-a316-568fa0510cee/ovn-acl-logging/0.log" Jun 09 05:34:10.305549 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:10.305522 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-42h5b_02c37648-4419-4ff7-a316-568fa0510cee/ovn-acl-logging/0.log" Jun 09 05:34:10.307579 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:10.307560 2564 kubelet.go:1648] "Image garbage collection succeeded" Jun 09 05:34:22.716870 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:22.716790 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5cffbdf6c5-px4mf" podUID="e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752" containerName="console" containerID="cri-o://83652c52eb561be9991495f8eaa61fb744507880109a3d19a26d73d5eac6f842" gracePeriod=15 Jun 09 05:34:22.957521 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:22.957494 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cffbdf6c5-px4mf" Jun 09 05:34:23.035707 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:23.035677 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752-console-config\") pod \"e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752\" (UID: \"e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752\") " Jun 09 05:34:23.035891 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:23.035733 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fbl44\" (UniqueName: \"kubernetes.io/projected/e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752-kube-api-access-fbl44\") pod \"e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752\" (UID: \"e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752\") " Jun 09 05:34:23.035891 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:23.035756 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752-trusted-ca-bundle\") pod \"e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752\" (UID: \"e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752\") " Jun 09 05:34:23.035891 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:23.035773 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752-console-oauth-config\") pod \"e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752\" (UID: \"e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752\") " Jun 09 05:34:23.035891 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:23.035831 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752-oauth-serving-cert\") pod \"e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752\" (UID: \"e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752\") " Jun 09 05:34:23.035891 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:23.035874 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752-service-ca\") pod \"e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752\" (UID: \"e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752\") " Jun 09 05:34:23.036179 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:23.035909 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752-console-serving-cert\") pod \"e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752\" (UID: \"e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752\") " Jun 09 05:34:23.036283 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:23.036235 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752" (UID: "e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 05:34:23.036283 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:23.036255 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752-console-config" (OuterVolumeSpecName: "console-config") pod "e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752" (UID: "e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 05:34:23.036443 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:23.036309 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752-service-ca" (OuterVolumeSpecName: "service-ca") pod "e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752" (UID: "e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 05:34:23.036443 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:23.036314 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752" (UID: "e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 05:34:23.037980 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:23.037960 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752" (UID: "e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 05:34:23.038074 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:23.037991 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752" (UID: "e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 05:34:23.038074 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:23.038002 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752-kube-api-access-fbl44" (OuterVolumeSpecName: "kube-api-access-fbl44") pod "e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752" (UID: "e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752"). InnerVolumeSpecName "kube-api-access-fbl44". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 05:34:23.137183 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:23.137134 2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752-oauth-serving-cert\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:34:23.137183 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:23.137170 2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752-service-ca\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:34:23.137183 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:23.137183 2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752-console-serving-cert\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:34:23.137183 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:23.137192 2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752-console-config\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:34:23.137451 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:23.137201 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fbl44\" (UniqueName: \"kubernetes.io/projected/e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752-kube-api-access-fbl44\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:34:23.137451 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:23.137210 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752-trusted-ca-bundle\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:34:23.137451 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:23.137219 2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752-console-oauth-config\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:34:23.482686 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:23.482602 2564 generic.go:356] "Generic (PLEG): container finished" podID="e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752" containerID="83652c52eb561be9991495f8eaa61fb744507880109a3d19a26d73d5eac6f842" exitCode=0 Jun 09 05:34:23.482686 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:23.482652 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cffbdf6c5-px4mf" Jun 09 05:34:23.482887 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:23.482686 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cffbdf6c5-px4mf" event={"ID":"e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752","Type":"ContainerDied","Data":"83652c52eb561be9991495f8eaa61fb744507880109a3d19a26d73d5eac6f842"} Jun 09 05:34:23.482887 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:23.482739 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cffbdf6c5-px4mf" event={"ID":"e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752","Type":"ContainerDied","Data":"2a7460a7d6fa3c217fe263c6a8d9185a893d19c7b7e9c9d49a33333e9d59ad83"} Jun 09 05:34:23.482887 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:23.482760 2564 scope.go:117] "RemoveContainer" containerID="83652c52eb561be9991495f8eaa61fb744507880109a3d19a26d73d5eac6f842" Jun 09 05:34:23.491331 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:23.491308 2564 scope.go:117] "RemoveContainer" containerID="83652c52eb561be9991495f8eaa61fb744507880109a3d19a26d73d5eac6f842" Jun 09 05:34:23.491603 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:34:23.491585 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83652c52eb561be9991495f8eaa61fb744507880109a3d19a26d73d5eac6f842\": container with ID starting with 83652c52eb561be9991495f8eaa61fb744507880109a3d19a26d73d5eac6f842 not found: ID does not exist" containerID="83652c52eb561be9991495f8eaa61fb744507880109a3d19a26d73d5eac6f842" Jun 09 05:34:23.491658 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:23.491610 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83652c52eb561be9991495f8eaa61fb744507880109a3d19a26d73d5eac6f842"} err="failed to get container status \"83652c52eb561be9991495f8eaa61fb744507880109a3d19a26d73d5eac6f842\": rpc error: code = NotFound desc = could not find container \"83652c52eb561be9991495f8eaa61fb744507880109a3d19a26d73d5eac6f842\": container with ID starting with 83652c52eb561be9991495f8eaa61fb744507880109a3d19a26d73d5eac6f842 not found: ID does not exist" Jun 09 05:34:23.502471 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:23.502448 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5cffbdf6c5-px4mf"] Jun 09 05:34:23.505317 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:23.505291 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5cffbdf6c5-px4mf"] Jun 09 05:34:24.345635 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:24.345589 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752" path="/var/lib/kubelet/pods/e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752/volumes" Jun 09 05:34:27.949747 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:27.949712 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-67f6b6b44f-jx5hm"] Jun 09 05:34:27.950137 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:27.950031 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27f5c4e4-b1f4-4132-80be-a3d46df42f4e" containerName="console" Jun 09 05:34:27.950137 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:27.950043 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="27f5c4e4-b1f4-4132-80be-a3d46df42f4e" containerName="console" Jun 09 05:34:27.950137 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:27.950054 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d348c05-f72b-4145-8152-9ba13b80a0af" containerName="console" Jun 09 05:34:27.950137 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:27.950060 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d348c05-f72b-4145-8152-9ba13b80a0af" containerName="console" Jun 09 05:34:27.950137 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:27.950078 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752" containerName="console" Jun 09 05:34:27.950137 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:27.950084 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752" containerName="console" Jun 09 05:34:27.950137 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:27.950092 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09110d03-6ef0-4c54-afb7-872377f07269" containerName="registry" Jun 09 05:34:27.950137 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:27.950098 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="09110d03-6ef0-4c54-afb7-872377f07269" containerName="registry" Jun 09 05:34:27.950425 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:27.950151 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3dfb265-c1af-4ea0-8ddc-67c2c3b2d752" containerName="console" Jun 09 05:34:27.950425 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:27.950162 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="27f5c4e4-b1f4-4132-80be-a3d46df42f4e" containerName="console" Jun 09 05:34:27.950425 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:27.950170 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d348c05-f72b-4145-8152-9ba13b80a0af" containerName="console" Jun 09 05:34:27.950425 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:27.950178 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="09110d03-6ef0-4c54-afb7-872377f07269" containerName="registry" Jun 09 05:34:27.954528 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:27.954513 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67f6b6b44f-jx5hm" Jun 09 05:34:27.965493 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:27.965469 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67f6b6b44f-jx5hm"] Jun 09 05:34:28.076607 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:28.076566 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/99652907-c47f-4688-9f58-44fc647c50f5-console-serving-cert\") pod \"console-67f6b6b44f-jx5hm\" (UID: \"99652907-c47f-4688-9f58-44fc647c50f5\") " pod="openshift-console/console-67f6b6b44f-jx5hm" Jun 09 05:34:28.076788 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:28.076620 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/99652907-c47f-4688-9f58-44fc647c50f5-service-ca\") pod \"console-67f6b6b44f-jx5hm\" (UID: \"99652907-c47f-4688-9f58-44fc647c50f5\") " pod="openshift-console/console-67f6b6b44f-jx5hm" Jun 09 05:34:28.076788 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:28.076650 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/99652907-c47f-4688-9f58-44fc647c50f5-oauth-serving-cert\") pod \"console-67f6b6b44f-jx5hm\" (UID: \"99652907-c47f-4688-9f58-44fc647c50f5\") " pod="openshift-console/console-67f6b6b44f-jx5hm" Jun 09 05:34:28.076788 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:28.076704 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/99652907-c47f-4688-9f58-44fc647c50f5-console-oauth-config\") pod \"console-67f6b6b44f-jx5hm\" (UID: \"99652907-c47f-4688-9f58-44fc647c50f5\") " pod="openshift-console/console-67f6b6b44f-jx5hm" Jun 09 05:34:28.076788 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:28.076733 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/99652907-c47f-4688-9f58-44fc647c50f5-trusted-ca-bundle\") pod \"console-67f6b6b44f-jx5hm\" (UID: \"99652907-c47f-4688-9f58-44fc647c50f5\") " pod="openshift-console/console-67f6b6b44f-jx5hm" Jun 09 05:34:28.076788 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:28.076762 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mccf\" (UniqueName: \"kubernetes.io/projected/99652907-c47f-4688-9f58-44fc647c50f5-kube-api-access-8mccf\") pod \"console-67f6b6b44f-jx5hm\" (UID: \"99652907-c47f-4688-9f58-44fc647c50f5\") " pod="openshift-console/console-67f6b6b44f-jx5hm" Jun 09 05:34:28.076992 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:28.076832 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/99652907-c47f-4688-9f58-44fc647c50f5-console-config\") pod \"console-67f6b6b44f-jx5hm\" (UID: \"99652907-c47f-4688-9f58-44fc647c50f5\") " pod="openshift-console/console-67f6b6b44f-jx5hm" Jun 09 05:34:28.177610 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:28.177569 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/99652907-c47f-4688-9f58-44fc647c50f5-service-ca\") pod \"console-67f6b6b44f-jx5hm\" (UID: \"99652907-c47f-4688-9f58-44fc647c50f5\") " pod="openshift-console/console-67f6b6b44f-jx5hm" Jun 09 05:34:28.177610 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:28.177608 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/99652907-c47f-4688-9f58-44fc647c50f5-oauth-serving-cert\") pod \"console-67f6b6b44f-jx5hm\" (UID: \"99652907-c47f-4688-9f58-44fc647c50f5\") " pod="openshift-console/console-67f6b6b44f-jx5hm" Jun 09 05:34:28.177934 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:28.177627 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/99652907-c47f-4688-9f58-44fc647c50f5-console-oauth-config\") pod \"console-67f6b6b44f-jx5hm\" (UID: \"99652907-c47f-4688-9f58-44fc647c50f5\") " pod="openshift-console/console-67f6b6b44f-jx5hm" Jun 09 05:34:28.177934 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:28.177644 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/99652907-c47f-4688-9f58-44fc647c50f5-trusted-ca-bundle\") pod \"console-67f6b6b44f-jx5hm\" (UID: \"99652907-c47f-4688-9f58-44fc647c50f5\") " pod="openshift-console/console-67f6b6b44f-jx5hm" Jun 09 05:34:28.177934 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:28.177762 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mccf\" (UniqueName: \"kubernetes.io/projected/99652907-c47f-4688-9f58-44fc647c50f5-kube-api-access-8mccf\") pod \"console-67f6b6b44f-jx5hm\" (UID: \"99652907-c47f-4688-9f58-44fc647c50f5\") " pod="openshift-console/console-67f6b6b44f-jx5hm" Jun 09 05:34:28.177934 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:28.177880 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/99652907-c47f-4688-9f58-44fc647c50f5-console-config\") pod \"console-67f6b6b44f-jx5hm\" (UID: \"99652907-c47f-4688-9f58-44fc647c50f5\") " pod="openshift-console/console-67f6b6b44f-jx5hm" Jun 09 05:34:28.177934 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:28.177933 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/99652907-c47f-4688-9f58-44fc647c50f5-console-serving-cert\") pod \"console-67f6b6b44f-jx5hm\" (UID: \"99652907-c47f-4688-9f58-44fc647c50f5\") " pod="openshift-console/console-67f6b6b44f-jx5hm" Jun 09 05:34:28.178529 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:28.178503 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/99652907-c47f-4688-9f58-44fc647c50f5-oauth-serving-cert\") pod \"console-67f6b6b44f-jx5hm\" (UID: \"99652907-c47f-4688-9f58-44fc647c50f5\") " pod="openshift-console/console-67f6b6b44f-jx5hm" Jun 09 05:34:28.178638 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:28.178536 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/99652907-c47f-4688-9f58-44fc647c50f5-trusted-ca-bundle\") pod \"console-67f6b6b44f-jx5hm\" (UID: \"99652907-c47f-4688-9f58-44fc647c50f5\") " pod="openshift-console/console-67f6b6b44f-jx5hm" Jun 09 05:34:28.178638 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:28.178513 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/99652907-c47f-4688-9f58-44fc647c50f5-service-ca\") pod \"console-67f6b6b44f-jx5hm\" (UID: \"99652907-c47f-4688-9f58-44fc647c50f5\") " pod="openshift-console/console-67f6b6b44f-jx5hm" Jun 09 05:34:28.178638 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:28.178568 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/99652907-c47f-4688-9f58-44fc647c50f5-console-config\") pod \"console-67f6b6b44f-jx5hm\" (UID: \"99652907-c47f-4688-9f58-44fc647c50f5\") " pod="openshift-console/console-67f6b6b44f-jx5hm" Jun 09 05:34:28.180625 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:28.180607 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/99652907-c47f-4688-9f58-44fc647c50f5-console-serving-cert\") pod \"console-67f6b6b44f-jx5hm\" (UID: \"99652907-c47f-4688-9f58-44fc647c50f5\") " pod="openshift-console/console-67f6b6b44f-jx5hm" Jun 09 05:34:28.180749 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:28.180729 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/99652907-c47f-4688-9f58-44fc647c50f5-console-oauth-config\") pod \"console-67f6b6b44f-jx5hm\" (UID: \"99652907-c47f-4688-9f58-44fc647c50f5\") " pod="openshift-console/console-67f6b6b44f-jx5hm" Jun 09 05:34:28.185738 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:28.185718 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mccf\" (UniqueName: \"kubernetes.io/projected/99652907-c47f-4688-9f58-44fc647c50f5-kube-api-access-8mccf\") pod \"console-67f6b6b44f-jx5hm\" (UID: \"99652907-c47f-4688-9f58-44fc647c50f5\") " pod="openshift-console/console-67f6b6b44f-jx5hm" Jun 09 05:34:28.263260 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:28.263163 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67f6b6b44f-jx5hm" Jun 09 05:34:28.391265 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:28.391234 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67f6b6b44f-jx5hm"] Jun 09 05:34:28.393776 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:34:28.393747 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99652907_c47f_4688_9f58_44fc647c50f5.slice/crio-5beb68114ae21272109e90fdf0adf4744974f28fc17d73ac598b377d671001c3 WatchSource:0}: Error finding container 5beb68114ae21272109e90fdf0adf4744974f28fc17d73ac598b377d671001c3: Status 404 returned error can't find the container with id 5beb68114ae21272109e90fdf0adf4744974f28fc17d73ac598b377d671001c3 Jun 09 05:34:28.504527 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:28.504485 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67f6b6b44f-jx5hm" event={"ID":"99652907-c47f-4688-9f58-44fc647c50f5","Type":"ContainerStarted","Data":"8d733dce355af750a7e92b1000d0ad674d5c068bc7b286377cbd9c629b47f3ae"} Jun 09 05:34:28.504886 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:28.504579 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67f6b6b44f-jx5hm" event={"ID":"99652907-c47f-4688-9f58-44fc647c50f5","Type":"ContainerStarted","Data":"5beb68114ae21272109e90fdf0adf4744974f28fc17d73ac598b377d671001c3"} Jun 09 05:34:28.521749 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:28.521647 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-67f6b6b44f-jx5hm" podStartSLOduration=1.521630265 podStartE2EDuration="1.521630265s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 05:34:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 05:34:28.521044099 +0000 UTC m=+318.603695854" watchObservedRunningTime="2026-06-09 05:34:28.521630265 +0000 UTC m=+318.604282001" Jun 09 05:34:29.639120 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:29.639084 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 05:34:29.639574 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:29.639354 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="24b00280-231b-40c0-98b4-e2b8fb434a89" containerName="alertmanager" containerID="cri-o://583401099eabf0e5d7d1e88472c52a1265b61ec94722d00fe106a1e0f7cc8deb" gracePeriod=120 Jun 09 05:34:29.639574 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:29.639437 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="24b00280-231b-40c0-98b4-e2b8fb434a89" containerName="kube-rbac-proxy-web" containerID="cri-o://f9a62e529ad8b430696b62283131bada45ea757df7e37cde0125ab07761e25ee" gracePeriod=120 Jun 09 05:34:29.639574 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:29.639464 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="24b00280-231b-40c0-98b4-e2b8fb434a89" containerName="prom-label-proxy" containerID="cri-o://572eb18b3fc9dcc5505f7848f7a5a32923b2a19d118b044fd16d6df49e44d494" gracePeriod=120 Jun 09 05:34:29.639574 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:29.639486 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="24b00280-231b-40c0-98b4-e2b8fb434a89" containerName="config-reloader" containerID="cri-o://3dec100e3474e96dd089770bac0b7adc7d8139ed72cc6f71782563c73dc37730" gracePeriod=120 Jun 09 05:34:29.639574 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:29.639516 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="24b00280-231b-40c0-98b4-e2b8fb434a89" containerName="kube-rbac-proxy" containerID="cri-o://20893dadb840ee9653b70f092b9af2c2669e59d36ab687ad7bfa8fbee07d4927" gracePeriod=120 Jun 09 05:34:29.639574 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:29.639438 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="24b00280-231b-40c0-98b4-e2b8fb434a89" containerName="kube-rbac-proxy-metric" containerID="cri-o://b9f863388d1c8c69d5891e03e34f4e3bb3631f976a528ce15bff81b7759da5d4" gracePeriod=120 Jun 09 05:34:30.515836 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:30.515789 2564 generic.go:356] "Generic (PLEG): container finished" podID="24b00280-231b-40c0-98b4-e2b8fb434a89" containerID="572eb18b3fc9dcc5505f7848f7a5a32923b2a19d118b044fd16d6df49e44d494" exitCode=0 Jun 09 05:34:30.515836 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:30.515825 2564 generic.go:356] "Generic (PLEG): container finished" podID="24b00280-231b-40c0-98b4-e2b8fb434a89" containerID="20893dadb840ee9653b70f092b9af2c2669e59d36ab687ad7bfa8fbee07d4927" exitCode=0 Jun 09 05:34:30.515836 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:30.515831 2564 generic.go:356] "Generic (PLEG): container finished" podID="24b00280-231b-40c0-98b4-e2b8fb434a89" containerID="3dec100e3474e96dd089770bac0b7adc7d8139ed72cc6f71782563c73dc37730" exitCode=0 Jun 09 05:34:30.515836 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:30.515844 2564 generic.go:356] "Generic (PLEG): container finished" podID="24b00280-231b-40c0-98b4-e2b8fb434a89" containerID="583401099eabf0e5d7d1e88472c52a1265b61ec94722d00fe106a1e0f7cc8deb" exitCode=0 Jun 09 05:34:30.516108 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:30.515821 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"24b00280-231b-40c0-98b4-e2b8fb434a89","Type":"ContainerDied","Data":"572eb18b3fc9dcc5505f7848f7a5a32923b2a19d118b044fd16d6df49e44d494"} Jun 09 05:34:30.516108 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:30.515903 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"24b00280-231b-40c0-98b4-e2b8fb434a89","Type":"ContainerDied","Data":"20893dadb840ee9653b70f092b9af2c2669e59d36ab687ad7bfa8fbee07d4927"} Jun 09 05:34:30.516108 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:30.515929 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"24b00280-231b-40c0-98b4-e2b8fb434a89","Type":"ContainerDied","Data":"3dec100e3474e96dd089770bac0b7adc7d8139ed72cc6f71782563c73dc37730"} Jun 09 05:34:30.516108 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:30.515954 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"24b00280-231b-40c0-98b4-e2b8fb434a89","Type":"ContainerDied","Data":"583401099eabf0e5d7d1e88472c52a1265b61ec94722d00fe106a1e0f7cc8deb"} Jun 09 05:34:30.885504 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:30.885480 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 05:34:31.000984 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.000946 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/24b00280-231b-40c0-98b4-e2b8fb434a89-secret-alertmanager-kube-rbac-proxy\") pod \"24b00280-231b-40c0-98b4-e2b8fb434a89\" (UID: \"24b00280-231b-40c0-98b4-e2b8fb434a89\") " Jun 09 05:34:31.000984 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.000988 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/24b00280-231b-40c0-98b4-e2b8fb434a89-alertmanager-main-db\") pod \"24b00280-231b-40c0-98b4-e2b8fb434a89\" (UID: \"24b00280-231b-40c0-98b4-e2b8fb434a89\") " Jun 09 05:34:31.001222 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.001010 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/24b00280-231b-40c0-98b4-e2b8fb434a89-secret-alertmanager-main-tls\") pod \"24b00280-231b-40c0-98b4-e2b8fb434a89\" (UID: \"24b00280-231b-40c0-98b4-e2b8fb434a89\") " Jun 09 05:34:31.001222 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.001040 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/24b00280-231b-40c0-98b4-e2b8fb434a89-cluster-tls-config\") pod \"24b00280-231b-40c0-98b4-e2b8fb434a89\" (UID: \"24b00280-231b-40c0-98b4-e2b8fb434a89\") " Jun 09 05:34:31.001222 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.001059 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/24b00280-231b-40c0-98b4-e2b8fb434a89-tls-assets\") pod \"24b00280-231b-40c0-98b4-e2b8fb434a89\" (UID: \"24b00280-231b-40c0-98b4-e2b8fb434a89\") " Jun 09 05:34:31.001222 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.001088 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/24b00280-231b-40c0-98b4-e2b8fb434a89-config-volume\") pod \"24b00280-231b-40c0-98b4-e2b8fb434a89\" (UID: \"24b00280-231b-40c0-98b4-e2b8fb434a89\") " Jun 09 05:34:31.001222 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.001105 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qcchp\" (UniqueName: \"kubernetes.io/projected/24b00280-231b-40c0-98b4-e2b8fb434a89-kube-api-access-qcchp\") pod \"24b00280-231b-40c0-98b4-e2b8fb434a89\" (UID: \"24b00280-231b-40c0-98b4-e2b8fb434a89\") " Jun 09 05:34:31.001222 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.001120 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/24b00280-231b-40c0-98b4-e2b8fb434a89-secret-alertmanager-kube-rbac-proxy-web\") pod \"24b00280-231b-40c0-98b4-e2b8fb434a89\" (UID: \"24b00280-231b-40c0-98b4-e2b8fb434a89\") " Jun 09 05:34:31.001222 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.001152 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/24b00280-231b-40c0-98b4-e2b8fb434a89-metrics-client-ca\") pod \"24b00280-231b-40c0-98b4-e2b8fb434a89\" (UID: \"24b00280-231b-40c0-98b4-e2b8fb434a89\") " Jun 09 05:34:31.001222 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.001178 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/24b00280-231b-40c0-98b4-e2b8fb434a89-web-config\") pod \"24b00280-231b-40c0-98b4-e2b8fb434a89\" (UID: \"24b00280-231b-40c0-98b4-e2b8fb434a89\") " Jun 09 05:34:31.001222 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.001225 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/24b00280-231b-40c0-98b4-e2b8fb434a89-config-out\") pod \"24b00280-231b-40c0-98b4-e2b8fb434a89\" (UID: \"24b00280-231b-40c0-98b4-e2b8fb434a89\") " Jun 09 05:34:31.001677 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.001251 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24b00280-231b-40c0-98b4-e2b8fb434a89-alertmanager-trusted-ca-bundle\") pod \"24b00280-231b-40c0-98b4-e2b8fb434a89\" (UID: \"24b00280-231b-40c0-98b4-e2b8fb434a89\") " Jun 09 05:34:31.001677 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.001281 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/24b00280-231b-40c0-98b4-e2b8fb434a89-secret-alertmanager-kube-rbac-proxy-metric\") pod \"24b00280-231b-40c0-98b4-e2b8fb434a89\" (UID: \"24b00280-231b-40c0-98b4-e2b8fb434a89\") " Jun 09 05:34:31.001677 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.001358 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24b00280-231b-40c0-98b4-e2b8fb434a89-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "24b00280-231b-40c0-98b4-e2b8fb434a89" (UID: "24b00280-231b-40c0-98b4-e2b8fb434a89"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 05:34:31.001677 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.001616 2564 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/24b00280-231b-40c0-98b4-e2b8fb434a89-alertmanager-main-db\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:34:31.004065 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.004031 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24b00280-231b-40c0-98b4-e2b8fb434a89-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "24b00280-231b-40c0-98b4-e2b8fb434a89" (UID: "24b00280-231b-40c0-98b4-e2b8fb434a89"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 05:34:31.004329 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.004293 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24b00280-231b-40c0-98b4-e2b8fb434a89-config-volume" (OuterVolumeSpecName: "config-volume") pod "24b00280-231b-40c0-98b4-e2b8fb434a89" (UID: "24b00280-231b-40c0-98b4-e2b8fb434a89"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 05:34:31.004329 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.004316 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24b00280-231b-40c0-98b4-e2b8fb434a89-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "24b00280-231b-40c0-98b4-e2b8fb434a89" (UID: "24b00280-231b-40c0-98b4-e2b8fb434a89"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 05:34:31.004503 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.004365 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24b00280-231b-40c0-98b4-e2b8fb434a89-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "24b00280-231b-40c0-98b4-e2b8fb434a89" (UID: "24b00280-231b-40c0-98b4-e2b8fb434a89"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 05:34:31.004562 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.004506 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24b00280-231b-40c0-98b4-e2b8fb434a89-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "24b00280-231b-40c0-98b4-e2b8fb434a89" (UID: "24b00280-231b-40c0-98b4-e2b8fb434a89"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 05:34:31.004810 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.004759 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24b00280-231b-40c0-98b4-e2b8fb434a89-kube-api-access-qcchp" (OuterVolumeSpecName: "kube-api-access-qcchp") pod "24b00280-231b-40c0-98b4-e2b8fb434a89" (UID: "24b00280-231b-40c0-98b4-e2b8fb434a89"). InnerVolumeSpecName "kube-api-access-qcchp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 05:34:31.004810 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.004768 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24b00280-231b-40c0-98b4-e2b8fb434a89-config-out" (OuterVolumeSpecName: "config-out") pod "24b00280-231b-40c0-98b4-e2b8fb434a89" (UID: "24b00280-231b-40c0-98b4-e2b8fb434a89"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 05:34:31.004973 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.004764 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24b00280-231b-40c0-98b4-e2b8fb434a89-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "24b00280-231b-40c0-98b4-e2b8fb434a89" (UID: "24b00280-231b-40c0-98b4-e2b8fb434a89"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 05:34:31.006552 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.006452 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24b00280-231b-40c0-98b4-e2b8fb434a89-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "24b00280-231b-40c0-98b4-e2b8fb434a89" (UID: "24b00280-231b-40c0-98b4-e2b8fb434a89"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 05:34:31.006552 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.006524 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24b00280-231b-40c0-98b4-e2b8fb434a89-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "24b00280-231b-40c0-98b4-e2b8fb434a89" (UID: "24b00280-231b-40c0-98b4-e2b8fb434a89"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 05:34:31.008462 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.008440 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24b00280-231b-40c0-98b4-e2b8fb434a89-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "24b00280-231b-40c0-98b4-e2b8fb434a89" (UID: "24b00280-231b-40c0-98b4-e2b8fb434a89"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 05:34:31.014369 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.014351 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24b00280-231b-40c0-98b4-e2b8fb434a89-web-config" (OuterVolumeSpecName: "web-config") pod "24b00280-231b-40c0-98b4-e2b8fb434a89" (UID: "24b00280-231b-40c0-98b4-e2b8fb434a89"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 05:34:31.102649 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.102546 2564 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/24b00280-231b-40c0-98b4-e2b8fb434a89-config-out\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:34:31.102649 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.102592 2564 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24b00280-231b-40c0-98b4-e2b8fb434a89-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:34:31.102649 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.102603 2564 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/24b00280-231b-40c0-98b4-e2b8fb434a89-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:34:31.102649 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.102612 2564 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/24b00280-231b-40c0-98b4-e2b8fb434a89-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:34:31.102649 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.102623 2564 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/24b00280-231b-40c0-98b4-e2b8fb434a89-secret-alertmanager-main-tls\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:34:31.102649 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.102634 2564 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/24b00280-231b-40c0-98b4-e2b8fb434a89-cluster-tls-config\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:34:31.102649 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.102643 2564 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/24b00280-231b-40c0-98b4-e2b8fb434a89-tls-assets\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:34:31.102649 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.102651 2564 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/24b00280-231b-40c0-98b4-e2b8fb434a89-config-volume\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:34:31.102649 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.102658 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qcchp\" (UniqueName: \"kubernetes.io/projected/24b00280-231b-40c0-98b4-e2b8fb434a89-kube-api-access-qcchp\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:34:31.102649 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.102667 2564 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/24b00280-231b-40c0-98b4-e2b8fb434a89-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:34:31.103135 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.102676 2564 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/24b00280-231b-40c0-98b4-e2b8fb434a89-metrics-client-ca\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:34:31.103135 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.102684 2564 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/24b00280-231b-40c0-98b4-e2b8fb434a89-web-config\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:34:31.522980 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.522886 2564 generic.go:356] "Generic (PLEG): container finished" podID="24b00280-231b-40c0-98b4-e2b8fb434a89" containerID="b9f863388d1c8c69d5891e03e34f4e3bb3631f976a528ce15bff81b7759da5d4" exitCode=0 Jun 09 05:34:31.522980 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.522913 2564 generic.go:356] "Generic (PLEG): container finished" podID="24b00280-231b-40c0-98b4-e2b8fb434a89" containerID="f9a62e529ad8b430696b62283131bada45ea757df7e37cde0125ab07761e25ee" exitCode=0 Jun 09 05:34:31.522980 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.522932 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"24b00280-231b-40c0-98b4-e2b8fb434a89","Type":"ContainerDied","Data":"b9f863388d1c8c69d5891e03e34f4e3bb3631f976a528ce15bff81b7759da5d4"} Jun 09 05:34:31.523249 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.522991 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 05:34:31.523249 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.523022 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"24b00280-231b-40c0-98b4-e2b8fb434a89","Type":"ContainerDied","Data":"f9a62e529ad8b430696b62283131bada45ea757df7e37cde0125ab07761e25ee"} Jun 09 05:34:31.523249 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.523052 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"24b00280-231b-40c0-98b4-e2b8fb434a89","Type":"ContainerDied","Data":"58cb292935c8cd8be077f6e60d0ad2aa03c58c3384f482d187f261a9b0b799d1"} Jun 09 05:34:31.523249 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.523087 2564 scope.go:117] "RemoveContainer" containerID="572eb18b3fc9dcc5505f7848f7a5a32923b2a19d118b044fd16d6df49e44d494" Jun 09 05:34:31.530976 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.530957 2564 scope.go:117] "RemoveContainer" containerID="b9f863388d1c8c69d5891e03e34f4e3bb3631f976a528ce15bff81b7759da5d4" Jun 09 05:34:31.537969 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.537859 2564 scope.go:117] "RemoveContainer" containerID="20893dadb840ee9653b70f092b9af2c2669e59d36ab687ad7bfa8fbee07d4927" Jun 09 05:34:31.545028 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.545008 2564 scope.go:117] "RemoveContainer" containerID="f9a62e529ad8b430696b62283131bada45ea757df7e37cde0125ab07761e25ee" Jun 09 05:34:31.545775 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.545753 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 05:34:31.549997 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.549972 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 05:34:31.552270 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.552254 2564 scope.go:117] "RemoveContainer" containerID="3dec100e3474e96dd089770bac0b7adc7d8139ed72cc6f71782563c73dc37730" Jun 09 05:34:31.559511 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.559493 2564 scope.go:117] "RemoveContainer" containerID="583401099eabf0e5d7d1e88472c52a1265b61ec94722d00fe106a1e0f7cc8deb" Jun 09 05:34:31.566374 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.566357 2564 scope.go:117] "RemoveContainer" containerID="3fa5538b697e88f617ea8901431be083314754f31c86e5f3aae3661949c890bb" Jun 09 05:34:31.573510 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.573488 2564 scope.go:117] "RemoveContainer" containerID="572eb18b3fc9dcc5505f7848f7a5a32923b2a19d118b044fd16d6df49e44d494" Jun 09 05:34:31.573753 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:34:31.573735 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"572eb18b3fc9dcc5505f7848f7a5a32923b2a19d118b044fd16d6df49e44d494\": container with ID starting with 572eb18b3fc9dcc5505f7848f7a5a32923b2a19d118b044fd16d6df49e44d494 not found: ID does not exist" containerID="572eb18b3fc9dcc5505f7848f7a5a32923b2a19d118b044fd16d6df49e44d494" Jun 09 05:34:31.573813 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.573762 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"572eb18b3fc9dcc5505f7848f7a5a32923b2a19d118b044fd16d6df49e44d494"} err="failed to get container status \"572eb18b3fc9dcc5505f7848f7a5a32923b2a19d118b044fd16d6df49e44d494\": rpc error: code = NotFound desc = could not find container \"572eb18b3fc9dcc5505f7848f7a5a32923b2a19d118b044fd16d6df49e44d494\": container with ID starting with 572eb18b3fc9dcc5505f7848f7a5a32923b2a19d118b044fd16d6df49e44d494 not found: ID does not exist" Jun 09 05:34:31.573813 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.573780 2564 scope.go:117] "RemoveContainer" containerID="b9f863388d1c8c69d5891e03e34f4e3bb3631f976a528ce15bff81b7759da5d4" Jun 09 05:34:31.574062 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:34:31.574041 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9f863388d1c8c69d5891e03e34f4e3bb3631f976a528ce15bff81b7759da5d4\": container with ID starting with b9f863388d1c8c69d5891e03e34f4e3bb3631f976a528ce15bff81b7759da5d4 not found: ID does not exist" containerID="b9f863388d1c8c69d5891e03e34f4e3bb3631f976a528ce15bff81b7759da5d4" Jun 09 05:34:31.574098 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.574073 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9f863388d1c8c69d5891e03e34f4e3bb3631f976a528ce15bff81b7759da5d4"} err="failed to get container status \"b9f863388d1c8c69d5891e03e34f4e3bb3631f976a528ce15bff81b7759da5d4\": rpc error: code = NotFound desc = could not find container \"b9f863388d1c8c69d5891e03e34f4e3bb3631f976a528ce15bff81b7759da5d4\": container with ID starting with b9f863388d1c8c69d5891e03e34f4e3bb3631f976a528ce15bff81b7759da5d4 not found: ID does not exist" Jun 09 05:34:31.574098 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.574093 2564 scope.go:117] "RemoveContainer" containerID="20893dadb840ee9653b70f092b9af2c2669e59d36ab687ad7bfa8fbee07d4927" Jun 09 05:34:31.574852 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:34:31.574824 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"20893dadb840ee9653b70f092b9af2c2669e59d36ab687ad7bfa8fbee07d4927\": container with ID starting with 20893dadb840ee9653b70f092b9af2c2669e59d36ab687ad7bfa8fbee07d4927 not found: ID does not exist" containerID="20893dadb840ee9653b70f092b9af2c2669e59d36ab687ad7bfa8fbee07d4927" Jun 09 05:34:31.574949 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.574859 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20893dadb840ee9653b70f092b9af2c2669e59d36ab687ad7bfa8fbee07d4927"} err="failed to get container status \"20893dadb840ee9653b70f092b9af2c2669e59d36ab687ad7bfa8fbee07d4927\": rpc error: code = NotFound desc = could not find container \"20893dadb840ee9653b70f092b9af2c2669e59d36ab687ad7bfa8fbee07d4927\": container with ID starting with 20893dadb840ee9653b70f092b9af2c2669e59d36ab687ad7bfa8fbee07d4927 not found: ID does not exist" Jun 09 05:34:31.574949 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.574902 2564 scope.go:117] "RemoveContainer" containerID="f9a62e529ad8b430696b62283131bada45ea757df7e37cde0125ab07761e25ee" Jun 09 05:34:31.575231 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:34:31.575207 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9a62e529ad8b430696b62283131bada45ea757df7e37cde0125ab07761e25ee\": container with ID starting with f9a62e529ad8b430696b62283131bada45ea757df7e37cde0125ab07761e25ee not found: ID does not exist" containerID="f9a62e529ad8b430696b62283131bada45ea757df7e37cde0125ab07761e25ee" Jun 09 05:34:31.575319 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.575240 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9a62e529ad8b430696b62283131bada45ea757df7e37cde0125ab07761e25ee"} err="failed to get container status \"f9a62e529ad8b430696b62283131bada45ea757df7e37cde0125ab07761e25ee\": rpc error: code = NotFound desc = could not find container \"f9a62e529ad8b430696b62283131bada45ea757df7e37cde0125ab07761e25ee\": container with ID starting with f9a62e529ad8b430696b62283131bada45ea757df7e37cde0125ab07761e25ee not found: ID does not exist" Jun 09 05:34:31.575319 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.575262 2564 scope.go:117] "RemoveContainer" containerID="3dec100e3474e96dd089770bac0b7adc7d8139ed72cc6f71782563c73dc37730" Jun 09 05:34:31.575568 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:34:31.575552 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3dec100e3474e96dd089770bac0b7adc7d8139ed72cc6f71782563c73dc37730\": container with ID starting with 3dec100e3474e96dd089770bac0b7adc7d8139ed72cc6f71782563c73dc37730 not found: ID does not exist" containerID="3dec100e3474e96dd089770bac0b7adc7d8139ed72cc6f71782563c73dc37730" Jun 09 05:34:31.575627 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.575573 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3dec100e3474e96dd089770bac0b7adc7d8139ed72cc6f71782563c73dc37730"} err="failed to get container status \"3dec100e3474e96dd089770bac0b7adc7d8139ed72cc6f71782563c73dc37730\": rpc error: code = NotFound desc = could not find container \"3dec100e3474e96dd089770bac0b7adc7d8139ed72cc6f71782563c73dc37730\": container with ID starting with 3dec100e3474e96dd089770bac0b7adc7d8139ed72cc6f71782563c73dc37730 not found: ID does not exist" Jun 09 05:34:31.575627 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.575590 2564 scope.go:117] "RemoveContainer" containerID="583401099eabf0e5d7d1e88472c52a1265b61ec94722d00fe106a1e0f7cc8deb" Jun 09 05:34:31.575835 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:34:31.575815 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"583401099eabf0e5d7d1e88472c52a1265b61ec94722d00fe106a1e0f7cc8deb\": container with ID starting with 583401099eabf0e5d7d1e88472c52a1265b61ec94722d00fe106a1e0f7cc8deb not found: ID does not exist" containerID="583401099eabf0e5d7d1e88472c52a1265b61ec94722d00fe106a1e0f7cc8deb" Jun 09 05:34:31.575882 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.575837 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"583401099eabf0e5d7d1e88472c52a1265b61ec94722d00fe106a1e0f7cc8deb"} err="failed to get container status \"583401099eabf0e5d7d1e88472c52a1265b61ec94722d00fe106a1e0f7cc8deb\": rpc error: code = NotFound desc = could not find container \"583401099eabf0e5d7d1e88472c52a1265b61ec94722d00fe106a1e0f7cc8deb\": container with ID starting with 583401099eabf0e5d7d1e88472c52a1265b61ec94722d00fe106a1e0f7cc8deb not found: ID does not exist" Jun 09 05:34:31.575882 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.575848 2564 scope.go:117] "RemoveContainer" containerID="3fa5538b697e88f617ea8901431be083314754f31c86e5f3aae3661949c890bb" Jun 09 05:34:31.576121 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:34:31.576103 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3fa5538b697e88f617ea8901431be083314754f31c86e5f3aae3661949c890bb\": container with ID starting with 3fa5538b697e88f617ea8901431be083314754f31c86e5f3aae3661949c890bb not found: ID does not exist" containerID="3fa5538b697e88f617ea8901431be083314754f31c86e5f3aae3661949c890bb" Jun 09 05:34:31.576159 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.576126 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fa5538b697e88f617ea8901431be083314754f31c86e5f3aae3661949c890bb"} err="failed to get container status \"3fa5538b697e88f617ea8901431be083314754f31c86e5f3aae3661949c890bb\": rpc error: code = NotFound desc = could not find container \"3fa5538b697e88f617ea8901431be083314754f31c86e5f3aae3661949c890bb\": container with ID starting with 3fa5538b697e88f617ea8901431be083314754f31c86e5f3aae3661949c890bb not found: ID does not exist" Jun 09 05:34:31.576159 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.576141 2564 scope.go:117] "RemoveContainer" containerID="572eb18b3fc9dcc5505f7848f7a5a32923b2a19d118b044fd16d6df49e44d494" Jun 09 05:34:31.576276 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.576258 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 05:34:31.576382 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.576364 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"572eb18b3fc9dcc5505f7848f7a5a32923b2a19d118b044fd16d6df49e44d494"} err="failed to get container status \"572eb18b3fc9dcc5505f7848f7a5a32923b2a19d118b044fd16d6df49e44d494\": rpc error: code = NotFound desc = could not find container \"572eb18b3fc9dcc5505f7848f7a5a32923b2a19d118b044fd16d6df49e44d494\": container with ID starting with 572eb18b3fc9dcc5505f7848f7a5a32923b2a19d118b044fd16d6df49e44d494 not found: ID does not exist" Jun 09 05:34:31.576455 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.576385 2564 scope.go:117] "RemoveContainer" containerID="b9f863388d1c8c69d5891e03e34f4e3bb3631f976a528ce15bff81b7759da5d4" Jun 09 05:34:31.576594 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.576580 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24b00280-231b-40c0-98b4-e2b8fb434a89" containerName="config-reloader" Jun 09 05:34:31.576646 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.576596 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="24b00280-231b-40c0-98b4-e2b8fb434a89" containerName="config-reloader" Jun 09 05:34:31.576646 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.576607 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24b00280-231b-40c0-98b4-e2b8fb434a89" containerName="prom-label-proxy" Jun 09 05:34:31.576646 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.576603 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9f863388d1c8c69d5891e03e34f4e3bb3631f976a528ce15bff81b7759da5d4"} err="failed to get container status \"b9f863388d1c8c69d5891e03e34f4e3bb3631f976a528ce15bff81b7759da5d4\": rpc error: code = NotFound desc = could not find container \"b9f863388d1c8c69d5891e03e34f4e3bb3631f976a528ce15bff81b7759da5d4\": container with ID starting with b9f863388d1c8c69d5891e03e34f4e3bb3631f976a528ce15bff81b7759da5d4 not found: ID does not exist" Jun 09 05:34:31.576646 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.576627 2564 scope.go:117] "RemoveContainer" containerID="20893dadb840ee9653b70f092b9af2c2669e59d36ab687ad7bfa8fbee07d4927" Jun 09 05:34:31.576878 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.576613 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="24b00280-231b-40c0-98b4-e2b8fb434a89" containerName="prom-label-proxy" Jun 09 05:34:31.576878 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.576692 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24b00280-231b-40c0-98b4-e2b8fb434a89" containerName="kube-rbac-proxy" Jun 09 05:34:31.576878 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.576703 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="24b00280-231b-40c0-98b4-e2b8fb434a89" containerName="kube-rbac-proxy" Jun 09 05:34:31.576878 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.576724 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24b00280-231b-40c0-98b4-e2b8fb434a89" containerName="init-config-reloader" Jun 09 05:34:31.576878 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.576734 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="24b00280-231b-40c0-98b4-e2b8fb434a89" containerName="init-config-reloader" Jun 09 05:34:31.576878 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.576746 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24b00280-231b-40c0-98b4-e2b8fb434a89" containerName="kube-rbac-proxy-web" Jun 09 05:34:31.576878 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.576756 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="24b00280-231b-40c0-98b4-e2b8fb434a89" containerName="kube-rbac-proxy-web" Jun 09 05:34:31.576878 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.576771 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24b00280-231b-40c0-98b4-e2b8fb434a89" containerName="kube-rbac-proxy-metric" Jun 09 05:34:31.576878 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.576780 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="24b00280-231b-40c0-98b4-e2b8fb434a89" containerName="kube-rbac-proxy-metric" Jun 09 05:34:31.577280 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.576905 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24b00280-231b-40c0-98b4-e2b8fb434a89" containerName="alertmanager" Jun 09 05:34:31.577280 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.576919 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="24b00280-231b-40c0-98b4-e2b8fb434a89" containerName="alertmanager" Jun 09 05:34:31.577280 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.576912 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20893dadb840ee9653b70f092b9af2c2669e59d36ab687ad7bfa8fbee07d4927"} err="failed to get container status \"20893dadb840ee9653b70f092b9af2c2669e59d36ab687ad7bfa8fbee07d4927\": rpc error: code = NotFound desc = could not find container \"20893dadb840ee9653b70f092b9af2c2669e59d36ab687ad7bfa8fbee07d4927\": container with ID starting with 20893dadb840ee9653b70f092b9af2c2669e59d36ab687ad7bfa8fbee07d4927 not found: ID does not exist" Jun 09 05:34:31.577280 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.577004 2564 scope.go:117] "RemoveContainer" containerID="f9a62e529ad8b430696b62283131bada45ea757df7e37cde0125ab07761e25ee" Jun 09 05:34:31.577280 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.577037 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="24b00280-231b-40c0-98b4-e2b8fb434a89" containerName="kube-rbac-proxy-web" Jun 09 05:34:31.577280 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.577049 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="24b00280-231b-40c0-98b4-e2b8fb434a89" containerName="kube-rbac-proxy-metric" Jun 09 05:34:31.577280 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.577059 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="24b00280-231b-40c0-98b4-e2b8fb434a89" containerName="kube-rbac-proxy" Jun 09 05:34:31.577280 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.577070 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="24b00280-231b-40c0-98b4-e2b8fb434a89" containerName="alertmanager" Jun 09 05:34:31.577280 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.577083 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="24b00280-231b-40c0-98b4-e2b8fb434a89" containerName="config-reloader" Jun 09 05:34:31.577280 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.577095 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="24b00280-231b-40c0-98b4-e2b8fb434a89" containerName="prom-label-proxy" Jun 09 05:34:31.577280 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.577223 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9a62e529ad8b430696b62283131bada45ea757df7e37cde0125ab07761e25ee"} err="failed to get container status \"f9a62e529ad8b430696b62283131bada45ea757df7e37cde0125ab07761e25ee\": rpc error: code = NotFound desc = could not find container \"f9a62e529ad8b430696b62283131bada45ea757df7e37cde0125ab07761e25ee\": container with ID starting with f9a62e529ad8b430696b62283131bada45ea757df7e37cde0125ab07761e25ee not found: ID does not exist" Jun 09 05:34:31.577280 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.577239 2564 scope.go:117] "RemoveContainer" containerID="3dec100e3474e96dd089770bac0b7adc7d8139ed72cc6f71782563c73dc37730" Jun 09 05:34:31.577854 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.577408 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3dec100e3474e96dd089770bac0b7adc7d8139ed72cc6f71782563c73dc37730"} err="failed to get container status \"3dec100e3474e96dd089770bac0b7adc7d8139ed72cc6f71782563c73dc37730\": rpc error: code = NotFound desc = could not find container \"3dec100e3474e96dd089770bac0b7adc7d8139ed72cc6f71782563c73dc37730\": container with ID starting with 3dec100e3474e96dd089770bac0b7adc7d8139ed72cc6f71782563c73dc37730 not found: ID does not exist" Jun 09 05:34:31.577854 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.577422 2564 scope.go:117] "RemoveContainer" containerID="583401099eabf0e5d7d1e88472c52a1265b61ec94722d00fe106a1e0f7cc8deb" Jun 09 05:34:31.577854 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.577621 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"583401099eabf0e5d7d1e88472c52a1265b61ec94722d00fe106a1e0f7cc8deb"} err="failed to get container status \"583401099eabf0e5d7d1e88472c52a1265b61ec94722d00fe106a1e0f7cc8deb\": rpc error: code = NotFound desc = could not find container \"583401099eabf0e5d7d1e88472c52a1265b61ec94722d00fe106a1e0f7cc8deb\": container with ID starting with 583401099eabf0e5d7d1e88472c52a1265b61ec94722d00fe106a1e0f7cc8deb not found: ID does not exist" Jun 09 05:34:31.577854 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.577633 2564 scope.go:117] "RemoveContainer" containerID="3fa5538b697e88f617ea8901431be083314754f31c86e5f3aae3661949c890bb" Jun 09 05:34:31.577854 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.577829 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fa5538b697e88f617ea8901431be083314754f31c86e5f3aae3661949c890bb"} err="failed to get container status \"3fa5538b697e88f617ea8901431be083314754f31c86e5f3aae3661949c890bb\": rpc error: code = NotFound desc = could not find container \"3fa5538b697e88f617ea8901431be083314754f31c86e5f3aae3661949c890bb\": container with ID starting with 3fa5538b697e88f617ea8901431be083314754f31c86e5f3aae3661949c890bb not found: ID does not exist" Jun 09 05:34:31.583404 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.583386 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 05:34:31.585702 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.585678 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 09 05:34:31.585812 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.585701 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 09 05:34:31.585812 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.585727 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 09 05:34:31.585812 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.585738 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 09 05:34:31.585812 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.585738 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 09 05:34:31.586017 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.585744 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-sn2j8\"" Jun 09 05:34:31.586017 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.585754 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 09 05:34:31.586197 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.586181 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 09 05:34:31.586249 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.586234 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 09 05:34:31.590065 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.590035 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 09 05:34:31.595037 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.595018 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 05:34:31.708412 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.708374 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7cf449ec-e48b-4347-85bc-028c682e3080-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7cf449ec-e48b-4347-85bc-028c682e3080\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 05:34:31.708412 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.708416 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7cf449ec-e48b-4347-85bc-028c682e3080-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7cf449ec-e48b-4347-85bc-028c682e3080\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 05:34:31.708636 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.708495 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gprk8\" (UniqueName: \"kubernetes.io/projected/7cf449ec-e48b-4347-85bc-028c682e3080-kube-api-access-gprk8\") pod \"alertmanager-main-0\" (UID: \"7cf449ec-e48b-4347-85bc-028c682e3080\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 05:34:31.708636 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.708538 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7cf449ec-e48b-4347-85bc-028c682e3080-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7cf449ec-e48b-4347-85bc-028c682e3080\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 05:34:31.708636 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.708563 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7cf449ec-e48b-4347-85bc-028c682e3080-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7cf449ec-e48b-4347-85bc-028c682e3080\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 05:34:31.708636 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.708590 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7cf449ec-e48b-4347-85bc-028c682e3080-config-out\") pod \"alertmanager-main-0\" (UID: \"7cf449ec-e48b-4347-85bc-028c682e3080\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 05:34:31.708636 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.708618 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7cf449ec-e48b-4347-85bc-028c682e3080-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7cf449ec-e48b-4347-85bc-028c682e3080\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 05:34:31.708819 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.708638 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7cf449ec-e48b-4347-85bc-028c682e3080-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7cf449ec-e48b-4347-85bc-028c682e3080\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 05:34:31.708819 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.708656 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7cf449ec-e48b-4347-85bc-028c682e3080-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7cf449ec-e48b-4347-85bc-028c682e3080\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 05:34:31.708819 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.708676 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7cf449ec-e48b-4347-85bc-028c682e3080-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7cf449ec-e48b-4347-85bc-028c682e3080\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 05:34:31.708819 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.708722 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7cf449ec-e48b-4347-85bc-028c682e3080-config-volume\") pod \"alertmanager-main-0\" (UID: \"7cf449ec-e48b-4347-85bc-028c682e3080\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 05:34:31.708819 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.708736 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7cf449ec-e48b-4347-85bc-028c682e3080-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7cf449ec-e48b-4347-85bc-028c682e3080\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 05:34:31.708819 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.708764 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7cf449ec-e48b-4347-85bc-028c682e3080-web-config\") pod \"alertmanager-main-0\" (UID: \"7cf449ec-e48b-4347-85bc-028c682e3080\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 05:34:31.809486 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.809447 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7cf449ec-e48b-4347-85bc-028c682e3080-config-out\") pod \"alertmanager-main-0\" (UID: \"7cf449ec-e48b-4347-85bc-028c682e3080\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 05:34:31.809638 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.809497 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7cf449ec-e48b-4347-85bc-028c682e3080-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7cf449ec-e48b-4347-85bc-028c682e3080\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 05:34:31.809638 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.809520 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7cf449ec-e48b-4347-85bc-028c682e3080-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7cf449ec-e48b-4347-85bc-028c682e3080\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 05:34:31.809638 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.809551 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7cf449ec-e48b-4347-85bc-028c682e3080-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7cf449ec-e48b-4347-85bc-028c682e3080\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 05:34:31.809638 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.809568 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7cf449ec-e48b-4347-85bc-028c682e3080-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7cf449ec-e48b-4347-85bc-028c682e3080\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 05:34:31.809638 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.809592 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7cf449ec-e48b-4347-85bc-028c682e3080-config-volume\") pod \"alertmanager-main-0\" (UID: \"7cf449ec-e48b-4347-85bc-028c682e3080\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 05:34:31.809638 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.809606 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7cf449ec-e48b-4347-85bc-028c682e3080-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7cf449ec-e48b-4347-85bc-028c682e3080\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 05:34:31.809997 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.809645 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7cf449ec-e48b-4347-85bc-028c682e3080-web-config\") pod \"alertmanager-main-0\" (UID: \"7cf449ec-e48b-4347-85bc-028c682e3080\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 05:34:31.809997 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.809682 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7cf449ec-e48b-4347-85bc-028c682e3080-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7cf449ec-e48b-4347-85bc-028c682e3080\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 05:34:31.809997 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.809708 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7cf449ec-e48b-4347-85bc-028c682e3080-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7cf449ec-e48b-4347-85bc-028c682e3080\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 05:34:31.809997 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.809744 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gprk8\" (UniqueName: \"kubernetes.io/projected/7cf449ec-e48b-4347-85bc-028c682e3080-kube-api-access-gprk8\") pod \"alertmanager-main-0\" (UID: \"7cf449ec-e48b-4347-85bc-028c682e3080\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 05:34:31.809997 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.809769 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7cf449ec-e48b-4347-85bc-028c682e3080-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7cf449ec-e48b-4347-85bc-028c682e3080\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 05:34:31.809997 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.809827 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7cf449ec-e48b-4347-85bc-028c682e3080-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7cf449ec-e48b-4347-85bc-028c682e3080\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 05:34:31.810290 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.809997 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7cf449ec-e48b-4347-85bc-028c682e3080-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7cf449ec-e48b-4347-85bc-028c682e3080\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 05:34:31.810579 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.810515 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7cf449ec-e48b-4347-85bc-028c682e3080-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7cf449ec-e48b-4347-85bc-028c682e3080\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 05:34:31.810854 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.810831 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7cf449ec-e48b-4347-85bc-028c682e3080-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7cf449ec-e48b-4347-85bc-028c682e3080\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 05:34:31.812715 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.812356 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7cf449ec-e48b-4347-85bc-028c682e3080-config-out\") pod \"alertmanager-main-0\" (UID: \"7cf449ec-e48b-4347-85bc-028c682e3080\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 05:34:31.812715 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.812592 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7cf449ec-e48b-4347-85bc-028c682e3080-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7cf449ec-e48b-4347-85bc-028c682e3080\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 05:34:31.812715 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.812645 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7cf449ec-e48b-4347-85bc-028c682e3080-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7cf449ec-e48b-4347-85bc-028c682e3080\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 05:34:31.812952 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.812853 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7cf449ec-e48b-4347-85bc-028c682e3080-web-config\") pod \"alertmanager-main-0\" (UID: \"7cf449ec-e48b-4347-85bc-028c682e3080\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 05:34:31.812952 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.812922 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7cf449ec-e48b-4347-85bc-028c682e3080-config-volume\") pod \"alertmanager-main-0\" (UID: \"7cf449ec-e48b-4347-85bc-028c682e3080\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 05:34:31.813085 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.813055 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7cf449ec-e48b-4347-85bc-028c682e3080-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7cf449ec-e48b-4347-85bc-028c682e3080\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 05:34:31.813426 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.813408 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7cf449ec-e48b-4347-85bc-028c682e3080-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7cf449ec-e48b-4347-85bc-028c682e3080\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 05:34:31.813518 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.813499 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7cf449ec-e48b-4347-85bc-028c682e3080-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7cf449ec-e48b-4347-85bc-028c682e3080\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 05:34:31.814480 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.814461 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7cf449ec-e48b-4347-85bc-028c682e3080-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7cf449ec-e48b-4347-85bc-028c682e3080\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 05:34:31.819662 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.819639 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gprk8\" (UniqueName: \"kubernetes.io/projected/7cf449ec-e48b-4347-85bc-028c682e3080-kube-api-access-gprk8\") pod \"alertmanager-main-0\" (UID: \"7cf449ec-e48b-4347-85bc-028c682e3080\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 05:34:31.892740 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:31.892699 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 05:34:32.027481 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:32.027324 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 05:34:32.029994 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:34:32.029970 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cf449ec_e48b_4347_85bc_028c682e3080.slice/crio-158524772f1be31d8b27a6f6112505def2794bf4115fdd2dfc06709279014cff WatchSource:0}: Error finding container 158524772f1be31d8b27a6f6112505def2794bf4115fdd2dfc06709279014cff: Status 404 returned error can't find the container with id 158524772f1be31d8b27a6f6112505def2794bf4115fdd2dfc06709279014cff Jun 09 05:34:32.345456 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:32.345365 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24b00280-231b-40c0-98b4-e2b8fb434a89" path="/var/lib/kubelet/pods/24b00280-231b-40c0-98b4-e2b8fb434a89/volumes" Jun 09 05:34:32.528628 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:32.528585 2564 generic.go:356] "Generic (PLEG): container finished" podID="7cf449ec-e48b-4347-85bc-028c682e3080" containerID="d153273321fbd580d727ee52a969dd3cdb8318204b080ba4ca12b7d4d83a908e" exitCode=0 Jun 09 05:34:32.528817 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:32.528662 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7cf449ec-e48b-4347-85bc-028c682e3080","Type":"ContainerDied","Data":"d153273321fbd580d727ee52a969dd3cdb8318204b080ba4ca12b7d4d83a908e"} Jun 09 05:34:32.528817 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:32.528742 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7cf449ec-e48b-4347-85bc-028c682e3080","Type":"ContainerStarted","Data":"158524772f1be31d8b27a6f6112505def2794bf4115fdd2dfc06709279014cff"} Jun 09 05:34:33.541695 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:33.541603 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7cf449ec-e48b-4347-85bc-028c682e3080","Type":"ContainerStarted","Data":"2eec32346dad544beb47869e77c2deac8ea022f66cd27f6cbffb90337973f8a0"} Jun 09 05:34:33.542164 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:33.541864 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7cf449ec-e48b-4347-85bc-028c682e3080","Type":"ContainerStarted","Data":"b6ff8f3d122797532a9e6e26de1c8a98de078072bd526628888786dc19207b53"} Jun 09 05:34:33.542164 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:33.541945 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7cf449ec-e48b-4347-85bc-028c682e3080","Type":"ContainerStarted","Data":"2735c0be2cf3bb64f74bd8d8d089da7fb59854e3149a0d10aa14fb76ab3334dd"} Jun 09 05:34:33.542164 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:33.541999 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7cf449ec-e48b-4347-85bc-028c682e3080","Type":"ContainerStarted","Data":"0bf803ee10bad88b888a10681a2e9599aab0f259140801df5902e86337f036f5"} Jun 09 05:34:33.542164 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:33.542042 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7cf449ec-e48b-4347-85bc-028c682e3080","Type":"ContainerStarted","Data":"246256ef82ec683f810cb9172b721322bdedbcf83279f5a0cda8a0d8b334fe47"} Jun 09 05:34:33.542164 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:33.542077 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7cf449ec-e48b-4347-85bc-028c682e3080","Type":"ContainerStarted","Data":"f176ef0ace0110e8a248f9b9ddfc3241b3436f8e55d9af173d9861fcd573f7ae"} Jun 09 05:34:33.569089 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:33.569034 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.5526644579999997 podStartE2EDuration="2.56901776s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.353302ms" isStatefulPod=false podCreationTimestamp="2026-06-09 05:34:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 05:34:33.566187671 +0000 UTC m=+323.648839455" watchObservedRunningTime="2026-06-09 05:34:33.56901776 +0000 UTC m=+323.651669495" Jun 09 05:34:38.264102 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:38.264055 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-67f6b6b44f-jx5hm" Jun 09 05:34:38.264523 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:38.264130 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-67f6b6b44f-jx5hm" Jun 09 05:34:38.269158 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:38.269134 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-67f6b6b44f-jx5hm" Jun 09 05:34:38.568645 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:38.568610 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-67f6b6b44f-jx5hm" Jun 09 05:34:38.610276 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:34:38.610246 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6877675969-jzwwr"] Jun 09 05:35:03.629848 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:03.629774 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6877675969-jzwwr" podUID="8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d" containerName="console" containerID="cri-o://ac833bc4a2779d00cc7462286fbb80a590d4efd6ad1efe4a9651e2185a12ed2f" gracePeriod=15 Jun 09 05:35:03.873967 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:03.873942 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6877675969-jzwwr" Jun 09 05:35:03.980596 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:03.980513 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-77z2q\" (UniqueName: \"kubernetes.io/projected/8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d-kube-api-access-77z2q\") pod \"8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d\" (UID: \"8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d\") " Jun 09 05:35:03.980596 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:03.980551 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d-trusted-ca-bundle\") pod \"8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d\" (UID: \"8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d\") " Jun 09 05:35:03.980596 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:03.980570 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d-console-serving-cert\") pod \"8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d\" (UID: \"8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d\") " Jun 09 05:35:03.980883 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:03.980620 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d-console-config\") pod \"8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d\" (UID: \"8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d\") " Jun 09 05:35:03.980883 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:03.980651 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d-console-oauth-config\") pod \"8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d\" (UID: \"8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d\") " Jun 09 05:35:03.980883 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:03.980683 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d-oauth-serving-cert\") pod \"8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d\" (UID: \"8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d\") " Jun 09 05:35:03.980883 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:03.980709 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d-service-ca\") pod \"8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d\" (UID: \"8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d\") " Jun 09 05:35:03.981166 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:03.981059 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d" (UID: "8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 05:35:03.981288 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:03.981181 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d" (UID: "8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 05:35:03.981288 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:03.981191 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d-console-config" (OuterVolumeSpecName: "console-config") pod "8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d" (UID: "8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 05:35:03.981288 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:03.981230 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d-service-ca" (OuterVolumeSpecName: "service-ca") pod "8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d" (UID: "8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 05:35:03.982843 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:03.982809 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d" (UID: "8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 05:35:03.982843 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:03.982826 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d" (UID: "8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 05:35:03.982981 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:03.982866 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d-kube-api-access-77z2q" (OuterVolumeSpecName: "kube-api-access-77z2q") pod "8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d" (UID: "8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d"). InnerVolumeSpecName "kube-api-access-77z2q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 05:35:04.082134 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:04.082085 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-77z2q\" (UniqueName: \"kubernetes.io/projected/8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d-kube-api-access-77z2q\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:35:04.082134 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:04.082127 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d-trusted-ca-bundle\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:35:04.082134 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:04.082138 2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d-console-serving-cert\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:35:04.082134 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:04.082147 2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d-console-config\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:35:04.082134 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:04.082156 2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d-console-oauth-config\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:35:04.082433 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:04.082164 2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d-oauth-serving-cert\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:35:04.082433 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:04.082172 2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d-service-ca\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:35:04.680346 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:04.680252 2564 generic.go:356] "Generic (PLEG): container finished" podID="8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d" containerID="ac833bc4a2779d00cc7462286fbb80a590d4efd6ad1efe4a9651e2185a12ed2f" exitCode=0 Jun 09 05:35:04.680346 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:04.680293 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6877675969-jzwwr" Jun 09 05:35:04.680346 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:04.680310 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6877675969-jzwwr" event={"ID":"8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d","Type":"ContainerDied","Data":"ac833bc4a2779d00cc7462286fbb80a590d4efd6ad1efe4a9651e2185a12ed2f"} Jun 09 05:35:04.680826 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:04.680349 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6877675969-jzwwr" event={"ID":"8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d","Type":"ContainerDied","Data":"cef765d77c7b9094b83ccc6ce93a5924805934147ff030cc59378a7ba04f765f"} Jun 09 05:35:04.680826 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:04.680370 2564 scope.go:117] "RemoveContainer" containerID="ac833bc4a2779d00cc7462286fbb80a590d4efd6ad1efe4a9651e2185a12ed2f" Jun 09 05:35:04.688612 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:04.688595 2564 scope.go:117] "RemoveContainer" containerID="ac833bc4a2779d00cc7462286fbb80a590d4efd6ad1efe4a9651e2185a12ed2f" Jun 09 05:35:04.688875 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:35:04.688847 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac833bc4a2779d00cc7462286fbb80a590d4efd6ad1efe4a9651e2185a12ed2f\": container with ID starting with ac833bc4a2779d00cc7462286fbb80a590d4efd6ad1efe4a9651e2185a12ed2f not found: ID does not exist" containerID="ac833bc4a2779d00cc7462286fbb80a590d4efd6ad1efe4a9651e2185a12ed2f" Jun 09 05:35:04.688977 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:04.688878 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac833bc4a2779d00cc7462286fbb80a590d4efd6ad1efe4a9651e2185a12ed2f"} err="failed to get container status \"ac833bc4a2779d00cc7462286fbb80a590d4efd6ad1efe4a9651e2185a12ed2f\": rpc error: code = NotFound desc = could not find container \"ac833bc4a2779d00cc7462286fbb80a590d4efd6ad1efe4a9651e2185a12ed2f\": container with ID starting with ac833bc4a2779d00cc7462286fbb80a590d4efd6ad1efe4a9651e2185a12ed2f not found: ID does not exist" Jun 09 05:35:04.695623 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:04.695582 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6877675969-jzwwr"] Jun 09 05:35:04.697066 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:04.697047 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6877675969-jzwwr"] Jun 09 05:35:06.345938 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:06.345898 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d" path="/var/lib/kubelet/pods/8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d/volumes" Jun 09 05:35:11.723404 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:11.723364 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgp57p"] Jun 09 05:35:11.723911 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:11.723838 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d" containerName="console" Jun 09 05:35:11.723911 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:11.723856 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d" containerName="console" Jun 09 05:35:11.724033 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:11.723955 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="8121cbfb-ae6f-4a25-8ad6-5885e2e5cf7d" containerName="console" Jun 09 05:35:11.728671 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:11.728650 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgp57p" Jun 09 05:35:11.731057 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:11.731030 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 05:35:11.731057 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:11.731053 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 05:35:11.731939 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:11.731925 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-pcs6v\"" Jun 09 05:35:11.735047 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:11.735012 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgp57p"] Jun 09 05:35:11.849389 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:11.849354 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgwrr\" (UniqueName: \"kubernetes.io/projected/4219de8f-9c0e-4025-bd0b-2082636a25cc-kube-api-access-vgwrr\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgp57p\" (UID: \"4219de8f-9c0e-4025-bd0b-2082636a25cc\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgp57p" Jun 09 05:35:11.849389 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:11.849400 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4219de8f-9c0e-4025-bd0b-2082636a25cc-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgp57p\" (UID: \"4219de8f-9c0e-4025-bd0b-2082636a25cc\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgp57p" Jun 09 05:35:11.849622 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:11.849427 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4219de8f-9c0e-4025-bd0b-2082636a25cc-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgp57p\" (UID: \"4219de8f-9c0e-4025-bd0b-2082636a25cc\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgp57p" Jun 09 05:35:11.950103 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:11.950068 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgwrr\" (UniqueName: \"kubernetes.io/projected/4219de8f-9c0e-4025-bd0b-2082636a25cc-kube-api-access-vgwrr\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgp57p\" (UID: \"4219de8f-9c0e-4025-bd0b-2082636a25cc\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgp57p" Jun 09 05:35:11.950103 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:11.950106 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4219de8f-9c0e-4025-bd0b-2082636a25cc-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgp57p\" (UID: \"4219de8f-9c0e-4025-bd0b-2082636a25cc\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgp57p" Jun 09 05:35:11.950287 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:11.950127 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4219de8f-9c0e-4025-bd0b-2082636a25cc-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgp57p\" (UID: \"4219de8f-9c0e-4025-bd0b-2082636a25cc\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgp57p" Jun 09 05:35:11.950460 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:11.950441 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4219de8f-9c0e-4025-bd0b-2082636a25cc-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgp57p\" (UID: \"4219de8f-9c0e-4025-bd0b-2082636a25cc\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgp57p" Jun 09 05:35:11.950497 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:11.950470 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4219de8f-9c0e-4025-bd0b-2082636a25cc-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgp57p\" (UID: \"4219de8f-9c0e-4025-bd0b-2082636a25cc\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgp57p" Jun 09 05:35:11.958036 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:11.958013 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgwrr\" (UniqueName: \"kubernetes.io/projected/4219de8f-9c0e-4025-bd0b-2082636a25cc-kube-api-access-vgwrr\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgp57p\" (UID: \"4219de8f-9c0e-4025-bd0b-2082636a25cc\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgp57p" Jun 09 05:35:12.038621 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:12.038594 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgp57p" Jun 09 05:35:12.166201 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:12.166176 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgp57p"] Jun 09 05:35:12.168720 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:35:12.168691 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4219de8f_9c0e_4025_bd0b_2082636a25cc.slice/crio-aa4e3696ffbfc8b103107f2be074ed969332d1e7b291844384cac59826f47e40 WatchSource:0}: Error finding container aa4e3696ffbfc8b103107f2be074ed969332d1e7b291844384cac59826f47e40: Status 404 returned error can't find the container with id aa4e3696ffbfc8b103107f2be074ed969332d1e7b291844384cac59826f47e40 Jun 09 05:35:12.170758 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:12.170741 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 05:35:12.716663 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:12.716619 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgp57p" event={"ID":"4219de8f-9c0e-4025-bd0b-2082636a25cc","Type":"ContainerStarted","Data":"aa4e3696ffbfc8b103107f2be074ed969332d1e7b291844384cac59826f47e40"} Jun 09 05:35:22.757783 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:22.757746 2564 generic.go:356] "Generic (PLEG): container finished" podID="4219de8f-9c0e-4025-bd0b-2082636a25cc" containerID="489c4928b0b0c2c258ad9e141309062f8cba9d9ddc931688521db3fda4b1277f" exitCode=0 Jun 09 05:35:22.758215 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:22.757833 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgp57p" event={"ID":"4219de8f-9c0e-4025-bd0b-2082636a25cc","Type":"ContainerDied","Data":"489c4928b0b0c2c258ad9e141309062f8cba9d9ddc931688521db3fda4b1277f"} Jun 09 05:35:23.763658 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:23.763575 2564 generic.go:356] "Generic (PLEG): container finished" podID="4219de8f-9c0e-4025-bd0b-2082636a25cc" containerID="7ba2efcc492fd7ec1b669001e719af7dd0aba7afaf77495e626393c2b507a8b7" exitCode=0 Jun 09 05:35:23.763658 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:23.763623 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgp57p" event={"ID":"4219de8f-9c0e-4025-bd0b-2082636a25cc","Type":"ContainerDied","Data":"7ba2efcc492fd7ec1b669001e719af7dd0aba7afaf77495e626393c2b507a8b7"} Jun 09 05:35:30.793694 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:30.793655 2564 generic.go:356] "Generic (PLEG): container finished" podID="4219de8f-9c0e-4025-bd0b-2082636a25cc" containerID="4e63cb0f514b099bcb86b49cee824cfa68d3a5112fd39214b392ee02691b059e" exitCode=0 Jun 09 05:35:30.794118 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:30.793733 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgp57p" event={"ID":"4219de8f-9c0e-4025-bd0b-2082636a25cc","Type":"ContainerDied","Data":"4e63cb0f514b099bcb86b49cee824cfa68d3a5112fd39214b392ee02691b059e"} Jun 09 05:35:31.923143 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:31.923120 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgp57p" Jun 09 05:35:32.030284 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:32.030255 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4219de8f-9c0e-4025-bd0b-2082636a25cc-bundle\") pod \"4219de8f-9c0e-4025-bd0b-2082636a25cc\" (UID: \"4219de8f-9c0e-4025-bd0b-2082636a25cc\") " Jun 09 05:35:32.030284 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:32.030289 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vgwrr\" (UniqueName: \"kubernetes.io/projected/4219de8f-9c0e-4025-bd0b-2082636a25cc-kube-api-access-vgwrr\") pod \"4219de8f-9c0e-4025-bd0b-2082636a25cc\" (UID: \"4219de8f-9c0e-4025-bd0b-2082636a25cc\") " Jun 09 05:35:32.030531 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:32.030385 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4219de8f-9c0e-4025-bd0b-2082636a25cc-util\") pod \"4219de8f-9c0e-4025-bd0b-2082636a25cc\" (UID: \"4219de8f-9c0e-4025-bd0b-2082636a25cc\") " Jun 09 05:35:32.030976 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:32.030949 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4219de8f-9c0e-4025-bd0b-2082636a25cc-bundle" (OuterVolumeSpecName: "bundle") pod "4219de8f-9c0e-4025-bd0b-2082636a25cc" (UID: "4219de8f-9c0e-4025-bd0b-2082636a25cc"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 05:35:32.032535 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:32.032516 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4219de8f-9c0e-4025-bd0b-2082636a25cc-kube-api-access-vgwrr" (OuterVolumeSpecName: "kube-api-access-vgwrr") pod "4219de8f-9c0e-4025-bd0b-2082636a25cc" (UID: "4219de8f-9c0e-4025-bd0b-2082636a25cc"). InnerVolumeSpecName "kube-api-access-vgwrr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 05:35:32.036518 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:32.036491 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4219de8f-9c0e-4025-bd0b-2082636a25cc-util" (OuterVolumeSpecName: "util") pod "4219de8f-9c0e-4025-bd0b-2082636a25cc" (UID: "4219de8f-9c0e-4025-bd0b-2082636a25cc"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 05:35:32.131911 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:32.131838 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4219de8f-9c0e-4025-bd0b-2082636a25cc-util\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:35:32.131911 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:32.131867 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4219de8f-9c0e-4025-bd0b-2082636a25cc-bundle\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:35:32.131911 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:32.131875 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vgwrr\" (UniqueName: \"kubernetes.io/projected/4219de8f-9c0e-4025-bd0b-2082636a25cc-kube-api-access-vgwrr\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:35:32.808855 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:32.808830 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgp57p" Jun 09 05:35:32.808855 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:32.808839 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgp57p" event={"ID":"4219de8f-9c0e-4025-bd0b-2082636a25cc","Type":"ContainerDied","Data":"aa4e3696ffbfc8b103107f2be074ed969332d1e7b291844384cac59826f47e40"} Jun 09 05:35:32.809054 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:32.808887 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="aa4e3696ffbfc8b103107f2be074ed969332d1e7b291844384cac59826f47e40" Jun 09 05:35:39.431815 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:39.431768 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-trbs7"] Jun 09 05:35:39.432244 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:39.432073 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4219de8f-9c0e-4025-bd0b-2082636a25cc" containerName="extract" Jun 09 05:35:39.432244 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:39.432084 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="4219de8f-9c0e-4025-bd0b-2082636a25cc" containerName="extract" Jun 09 05:35:39.432244 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:39.432093 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4219de8f-9c0e-4025-bd0b-2082636a25cc" containerName="util" Jun 09 05:35:39.432244 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:39.432098 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="4219de8f-9c0e-4025-bd0b-2082636a25cc" containerName="util" Jun 09 05:35:39.432244 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:39.432109 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4219de8f-9c0e-4025-bd0b-2082636a25cc" containerName="pull" Jun 09 05:35:39.432244 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:39.432115 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="4219de8f-9c0e-4025-bd0b-2082636a25cc" containerName="pull" Jun 09 05:35:39.432244 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:39.432162 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="4219de8f-9c0e-4025-bd0b-2082636a25cc" containerName="extract" Jun 09 05:35:39.465413 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:39.465390 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-trbs7"] Jun 09 05:35:39.465543 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:39.465478 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-trbs7" Jun 09 05:35:39.467997 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:39.467971 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 09 05:35:39.468152 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:39.468031 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 09 05:35:39.468245 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:39.468230 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-9f67d\"" Jun 09 05:35:39.587010 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:39.586979 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3b56b76a-b210-45b2-8133-f4f4f3a551d0-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-trbs7\" (UID: \"3b56b76a-b210-45b2-8133-f4f4f3a551d0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-trbs7" Jun 09 05:35:39.587150 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:39.587051 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smz6j\" (UniqueName: \"kubernetes.io/projected/3b56b76a-b210-45b2-8133-f4f4f3a551d0-kube-api-access-smz6j\") pod \"cert-manager-operator-controller-manager-57757f7cfc-trbs7\" (UID: \"3b56b76a-b210-45b2-8133-f4f4f3a551d0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-trbs7" Jun 09 05:35:39.688293 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:39.688229 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smz6j\" (UniqueName: \"kubernetes.io/projected/3b56b76a-b210-45b2-8133-f4f4f3a551d0-kube-api-access-smz6j\") pod \"cert-manager-operator-controller-manager-57757f7cfc-trbs7\" (UID: \"3b56b76a-b210-45b2-8133-f4f4f3a551d0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-trbs7" Jun 09 05:35:39.688293 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:39.688273 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3b56b76a-b210-45b2-8133-f4f4f3a551d0-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-trbs7\" (UID: \"3b56b76a-b210-45b2-8133-f4f4f3a551d0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-trbs7" Jun 09 05:35:39.688623 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:39.688603 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3b56b76a-b210-45b2-8133-f4f4f3a551d0-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-trbs7\" (UID: \"3b56b76a-b210-45b2-8133-f4f4f3a551d0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-trbs7" Jun 09 05:35:39.698838 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:39.698786 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-smz6j\" (UniqueName: \"kubernetes.io/projected/3b56b76a-b210-45b2-8133-f4f4f3a551d0-kube-api-access-smz6j\") pod \"cert-manager-operator-controller-manager-57757f7cfc-trbs7\" (UID: \"3b56b76a-b210-45b2-8133-f4f4f3a551d0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-trbs7" Jun 09 05:35:39.774905 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:39.774870 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-trbs7" Jun 09 05:35:39.930328 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:39.930307 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-trbs7"] Jun 09 05:35:39.931880 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:35:39.931853 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b56b76a_b210_45b2_8133_f4f4f3a551d0.slice/crio-cb467e4cb2f87b6e327b436a6e250180ad10c6325cff5af67c519ee979803262 WatchSource:0}: Error finding container cb467e4cb2f87b6e327b436a6e250180ad10c6325cff5af67c519ee979803262: Status 404 returned error can't find the container with id cb467e4cb2f87b6e327b436a6e250180ad10c6325cff5af67c519ee979803262 Jun 09 05:35:40.842428 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:40.842337 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-trbs7" event={"ID":"3b56b76a-b210-45b2-8133-f4f4f3a551d0","Type":"ContainerStarted","Data":"cb467e4cb2f87b6e327b436a6e250180ad10c6325cff5af67c519ee979803262"} Jun 09 05:35:42.854502 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:42.854466 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-trbs7" event={"ID":"3b56b76a-b210-45b2-8133-f4f4f3a551d0","Type":"ContainerStarted","Data":"fa845f1962a6191f49a7226fc883113160fbd4f882fa65806a76e78998cd083f"} Jun 09 05:35:42.875559 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:42.875500 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-trbs7" podStartSLOduration=1.5933047679999999 podStartE2EDuration="3.875479549s" totalImagesPullingTime="2.282174781s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 05:35:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 05:35:42.873737155 +0000 UTC m=+392.956388891" watchObservedRunningTime="2026-06-09 05:35:42.875479549 +0000 UTC m=+392.958131286" Jun 09 05:35:43.918593 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:43.918559 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxbsmw"] Jun 09 05:35:43.934514 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:43.934491 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxbsmw"] Jun 09 05:35:43.934671 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:43.934594 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxbsmw" Jun 09 05:35:43.936992 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:43.936971 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-pcs6v\"" Jun 09 05:35:43.937112 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:43.937010 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 05:35:43.937112 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:43.937026 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 05:35:44.025027 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:44.025003 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-592hd\" (UniqueName: \"kubernetes.io/projected/a1f01ade-9421-425c-958e-60cfad72df62-kube-api-access-592hd\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxbsmw\" (UID: \"a1f01ade-9421-425c-958e-60cfad72df62\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxbsmw" Jun 09 05:35:44.025135 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:44.025091 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a1f01ade-9421-425c-958e-60cfad72df62-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxbsmw\" (UID: \"a1f01ade-9421-425c-958e-60cfad72df62\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxbsmw" Jun 09 05:35:44.025135 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:44.025123 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a1f01ade-9421-425c-958e-60cfad72df62-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxbsmw\" (UID: \"a1f01ade-9421-425c-958e-60cfad72df62\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxbsmw" Jun 09 05:35:44.126148 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:44.126123 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a1f01ade-9421-425c-958e-60cfad72df62-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxbsmw\" (UID: \"a1f01ade-9421-425c-958e-60cfad72df62\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxbsmw" Jun 09 05:35:44.126258 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:44.126156 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a1f01ade-9421-425c-958e-60cfad72df62-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxbsmw\" (UID: \"a1f01ade-9421-425c-958e-60cfad72df62\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxbsmw" Jun 09 05:35:44.126258 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:44.126180 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-592hd\" (UniqueName: \"kubernetes.io/projected/a1f01ade-9421-425c-958e-60cfad72df62-kube-api-access-592hd\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxbsmw\" (UID: \"a1f01ade-9421-425c-958e-60cfad72df62\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxbsmw" Jun 09 05:35:44.126471 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:44.126454 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a1f01ade-9421-425c-958e-60cfad72df62-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxbsmw\" (UID: \"a1f01ade-9421-425c-958e-60cfad72df62\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxbsmw" Jun 09 05:35:44.126508 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:44.126493 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a1f01ade-9421-425c-958e-60cfad72df62-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxbsmw\" (UID: \"a1f01ade-9421-425c-958e-60cfad72df62\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxbsmw" Jun 09 05:35:44.135344 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:44.135325 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-592hd\" (UniqueName: \"kubernetes.io/projected/a1f01ade-9421-425c-958e-60cfad72df62-kube-api-access-592hd\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxbsmw\" (UID: \"a1f01ade-9421-425c-958e-60cfad72df62\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxbsmw" Jun 09 05:35:44.243284 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:44.243234 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxbsmw" Jun 09 05:35:44.388468 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:44.388446 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxbsmw"] Jun 09 05:35:44.390356 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:35:44.390324 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1f01ade_9421_425c_958e_60cfad72df62.slice/crio-2d06957a9b7a44cee4e7c87a472b77b37cd98593a8bc07b3d7521f4b94c084f9 WatchSource:0}: Error finding container 2d06957a9b7a44cee4e7c87a472b77b37cd98593a8bc07b3d7521f4b94c084f9: Status 404 returned error can't find the container with id 2d06957a9b7a44cee4e7c87a472b77b37cd98593a8bc07b3d7521f4b94c084f9 Jun 09 05:35:44.865173 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:44.865136 2564 generic.go:356] "Generic (PLEG): container finished" podID="a1f01ade-9421-425c-958e-60cfad72df62" containerID="51599b7f28023d8d1b1a9d477079951b5d0009337b244ec2801b3da56454948e" exitCode=0 Jun 09 05:35:44.865324 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:44.865222 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxbsmw" event={"ID":"a1f01ade-9421-425c-958e-60cfad72df62","Type":"ContainerDied","Data":"51599b7f28023d8d1b1a9d477079951b5d0009337b244ec2801b3da56454948e"} Jun 09 05:35:44.865324 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:44.865313 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxbsmw" event={"ID":"a1f01ade-9421-425c-958e-60cfad72df62","Type":"ContainerStarted","Data":"2d06957a9b7a44cee4e7c87a472b77b37cd98593a8bc07b3d7521f4b94c084f9"} Jun 09 05:35:45.305839 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:45.305789 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-7w9gp"] Jun 09 05:35:45.308299 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:45.308279 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-7w9gp" Jun 09 05:35:45.310587 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:45.310569 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 09 05:35:45.310692 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:45.310631 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-92c7j\"" Jun 09 05:35:45.311665 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:45.311641 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 09 05:35:45.316258 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:45.316238 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-7w9gp"] Jun 09 05:35:45.336065 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:45.336041 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8936c153-5209-48ad-bad8-5bdc511aa8e0-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-7w9gp\" (UID: \"8936c153-5209-48ad-bad8-5bdc511aa8e0\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-7w9gp" Jun 09 05:35:45.336170 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:45.336102 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4bn6\" (UniqueName: \"kubernetes.io/projected/8936c153-5209-48ad-bad8-5bdc511aa8e0-kube-api-access-j4bn6\") pod \"cert-manager-webhook-7dc76cbb94-7w9gp\" (UID: \"8936c153-5209-48ad-bad8-5bdc511aa8e0\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-7w9gp" Jun 09 05:35:45.436668 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:45.436599 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4bn6\" (UniqueName: \"kubernetes.io/projected/8936c153-5209-48ad-bad8-5bdc511aa8e0-kube-api-access-j4bn6\") pod \"cert-manager-webhook-7dc76cbb94-7w9gp\" (UID: \"8936c153-5209-48ad-bad8-5bdc511aa8e0\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-7w9gp" Jun 09 05:35:45.436668 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:45.436649 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8936c153-5209-48ad-bad8-5bdc511aa8e0-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-7w9gp\" (UID: \"8936c153-5209-48ad-bad8-5bdc511aa8e0\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-7w9gp" Jun 09 05:35:45.444535 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:45.444515 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8936c153-5209-48ad-bad8-5bdc511aa8e0-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-7w9gp\" (UID: \"8936c153-5209-48ad-bad8-5bdc511aa8e0\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-7w9gp" Jun 09 05:35:45.444660 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:45.444642 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4bn6\" (UniqueName: \"kubernetes.io/projected/8936c153-5209-48ad-bad8-5bdc511aa8e0-kube-api-access-j4bn6\") pod \"cert-manager-webhook-7dc76cbb94-7w9gp\" (UID: \"8936c153-5209-48ad-bad8-5bdc511aa8e0\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-7w9gp" Jun 09 05:35:45.618140 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:45.618111 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-7w9gp" Jun 09 05:35:45.754598 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:45.754570 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-7w9gp"] Jun 09 05:35:45.758089 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:35:45.758052 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8936c153_5209_48ad_bad8_5bdc511aa8e0.slice/crio-3b31c15ea7059f83da6d9afbd4143ef78e5559ff91f19aa813a01cb62c00cf44 WatchSource:0}: Error finding container 3b31c15ea7059f83da6d9afbd4143ef78e5559ff91f19aa813a01cb62c00cf44: Status 404 returned error can't find the container with id 3b31c15ea7059f83da6d9afbd4143ef78e5559ff91f19aa813a01cb62c00cf44 Jun 09 05:35:45.872389 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:45.872350 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-7w9gp" event={"ID":"8936c153-5209-48ad-bad8-5bdc511aa8e0","Type":"ContainerStarted","Data":"3b31c15ea7059f83da6d9afbd4143ef78e5559ff91f19aa813a01cb62c00cf44"} Jun 09 05:35:47.888981 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:47.888948 2564 generic.go:356] "Generic (PLEG): container finished" podID="a1f01ade-9421-425c-958e-60cfad72df62" containerID="b34c6e0326f019161e460de17c1dec21bd9f1b9923b09a3bec69b23adee42c44" exitCode=0 Jun 09 05:35:47.889372 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:47.889043 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxbsmw" event={"ID":"a1f01ade-9421-425c-958e-60cfad72df62","Type":"ContainerDied","Data":"b34c6e0326f019161e460de17c1dec21bd9f1b9923b09a3bec69b23adee42c44"} Jun 09 05:35:48.896457 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:48.896422 2564 generic.go:356] "Generic (PLEG): container finished" podID="a1f01ade-9421-425c-958e-60cfad72df62" containerID="c440909b0ab3e67092b4f26210f444626f4dd21a6b918141424df118d4a1f79d" exitCode=0 Jun 09 05:35:48.896930 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:48.896464 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxbsmw" event={"ID":"a1f01ade-9421-425c-958e-60cfad72df62","Type":"ContainerDied","Data":"c440909b0ab3e67092b4f26210f444626f4dd21a6b918141424df118d4a1f79d"} Jun 09 05:35:49.903513 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:49.903477 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-7w9gp" event={"ID":"8936c153-5209-48ad-bad8-5bdc511aa8e0","Type":"ContainerStarted","Data":"2f7f64b9bb053f875aea71c86637a0f6e62fc8837db40a4ee50427a7c85cd8ed"} Jun 09 05:35:49.919384 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:49.919340 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-7w9gp" podStartSLOduration=1.244637592 podStartE2EDuration="4.919324319s" totalImagesPullingTime="3.674686727s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 05:35:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 05:35:49.917779315 +0000 UTC m=+400.000431052" watchObservedRunningTime="2026-06-09 05:35:49.919324319 +0000 UTC m=+400.001976055" Jun 09 05:35:50.026584 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:50.026559 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxbsmw" Jun 09 05:35:50.069326 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:50.069300 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-592hd\" (UniqueName: \"kubernetes.io/projected/a1f01ade-9421-425c-958e-60cfad72df62-kube-api-access-592hd\") pod \"a1f01ade-9421-425c-958e-60cfad72df62\" (UID: \"a1f01ade-9421-425c-958e-60cfad72df62\") " Jun 09 05:35:50.069475 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:50.069333 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a1f01ade-9421-425c-958e-60cfad72df62-util\") pod \"a1f01ade-9421-425c-958e-60cfad72df62\" (UID: \"a1f01ade-9421-425c-958e-60cfad72df62\") " Jun 09 05:35:50.069475 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:50.069379 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a1f01ade-9421-425c-958e-60cfad72df62-bundle\") pod \"a1f01ade-9421-425c-958e-60cfad72df62\" (UID: \"a1f01ade-9421-425c-958e-60cfad72df62\") " Jun 09 05:35:50.069789 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:50.069767 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1f01ade-9421-425c-958e-60cfad72df62-bundle" (OuterVolumeSpecName: "bundle") pod "a1f01ade-9421-425c-958e-60cfad72df62" (UID: "a1f01ade-9421-425c-958e-60cfad72df62"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 05:35:50.071376 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:50.071356 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1f01ade-9421-425c-958e-60cfad72df62-kube-api-access-592hd" (OuterVolumeSpecName: "kube-api-access-592hd") pod "a1f01ade-9421-425c-958e-60cfad72df62" (UID: "a1f01ade-9421-425c-958e-60cfad72df62"). InnerVolumeSpecName "kube-api-access-592hd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 05:35:50.073451 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:50.073429 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1f01ade-9421-425c-958e-60cfad72df62-util" (OuterVolumeSpecName: "util") pod "a1f01ade-9421-425c-958e-60cfad72df62" (UID: "a1f01ade-9421-425c-958e-60cfad72df62"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 05:35:50.170156 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:50.170072 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-592hd\" (UniqueName: \"kubernetes.io/projected/a1f01ade-9421-425c-958e-60cfad72df62-kube-api-access-592hd\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:35:50.170156 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:50.170098 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a1f01ade-9421-425c-958e-60cfad72df62-util\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:35:50.170156 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:50.170107 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a1f01ade-9421-425c-958e-60cfad72df62-bundle\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:35:50.909268 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:50.909234 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxbsmw" event={"ID":"a1f01ade-9421-425c-958e-60cfad72df62","Type":"ContainerDied","Data":"2d06957a9b7a44cee4e7c87a472b77b37cd98593a8bc07b3d7521f4b94c084f9"} Jun 09 05:35:50.909680 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:50.909283 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2d06957a9b7a44cee4e7c87a472b77b37cd98593a8bc07b3d7521f4b94c084f9" Jun 09 05:35:50.909680 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:50.909241 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxbsmw" Jun 09 05:35:50.909680 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:50.909571 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-7w9gp" Jun 09 05:35:56.718300 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:56.718265 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ptwzv"] Jun 09 05:35:56.718660 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:56.718572 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1f01ade-9421-425c-958e-60cfad72df62" containerName="extract" Jun 09 05:35:56.718660 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:56.718582 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1f01ade-9421-425c-958e-60cfad72df62" containerName="extract" Jun 09 05:35:56.718660 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:56.718597 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1f01ade-9421-425c-958e-60cfad72df62" containerName="pull" Jun 09 05:35:56.718660 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:56.718603 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1f01ade-9421-425c-958e-60cfad72df62" containerName="pull" Jun 09 05:35:56.718660 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:56.718619 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1f01ade-9421-425c-958e-60cfad72df62" containerName="util" Jun 09 05:35:56.718660 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:56.718624 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1f01ade-9421-425c-958e-60cfad72df62" containerName="util" Jun 09 05:35:56.718867 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:56.718676 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1f01ade-9421-425c-958e-60cfad72df62" containerName="extract" Jun 09 05:35:56.720735 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:56.720720 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ptwzv" Jun 09 05:35:56.723028 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:56.723006 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 09 05:35:56.723147 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:56.723044 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-wl2b8\"" Jun 09 05:35:56.724036 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:56.724022 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 09 05:35:56.728262 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:56.728242 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ptwzv"] Jun 09 05:35:56.816899 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:56.816879 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-845nh\" (UniqueName: \"kubernetes.io/projected/45d4dc70-6973-499d-b170-32092e1f35d3-kube-api-access-845nh\") pod \"openshift-lws-operator-fd8ccff4c-ptwzv\" (UID: \"45d4dc70-6973-499d-b170-32092e1f35d3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ptwzv" Jun 09 05:35:56.817000 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:56.816921 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/45d4dc70-6973-499d-b170-32092e1f35d3-tmp\") pod \"openshift-lws-operator-fd8ccff4c-ptwzv\" (UID: \"45d4dc70-6973-499d-b170-32092e1f35d3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ptwzv" Jun 09 05:35:56.915727 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:56.915711 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-7w9gp" Jun 09 05:35:56.918261 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:56.918237 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-845nh\" (UniqueName: \"kubernetes.io/projected/45d4dc70-6973-499d-b170-32092e1f35d3-kube-api-access-845nh\") pod \"openshift-lws-operator-fd8ccff4c-ptwzv\" (UID: \"45d4dc70-6973-499d-b170-32092e1f35d3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ptwzv" Jun 09 05:35:56.918313 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:56.918284 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/45d4dc70-6973-499d-b170-32092e1f35d3-tmp\") pod \"openshift-lws-operator-fd8ccff4c-ptwzv\" (UID: \"45d4dc70-6973-499d-b170-32092e1f35d3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ptwzv" Jun 09 05:35:56.918586 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:56.918573 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/45d4dc70-6973-499d-b170-32092e1f35d3-tmp\") pod \"openshift-lws-operator-fd8ccff4c-ptwzv\" (UID: \"45d4dc70-6973-499d-b170-32092e1f35d3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ptwzv" Jun 09 05:35:56.925667 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:56.925639 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-845nh\" (UniqueName: \"kubernetes.io/projected/45d4dc70-6973-499d-b170-32092e1f35d3-kube-api-access-845nh\") pod \"openshift-lws-operator-fd8ccff4c-ptwzv\" (UID: \"45d4dc70-6973-499d-b170-32092e1f35d3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ptwzv" Jun 09 05:35:57.030235 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:57.030177 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ptwzv" Jun 09 05:35:57.148825 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:57.148785 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ptwzv"] Jun 09 05:35:57.150870 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:35:57.150845 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod45d4dc70_6973_499d_b170_32092e1f35d3.slice/crio-bcefa7aeade668807f8d1fc9ed01bf616243cf4133962d1b48e16abd13d6e141 WatchSource:0}: Error finding container bcefa7aeade668807f8d1fc9ed01bf616243cf4133962d1b48e16abd13d6e141: Status 404 returned error can't find the container with id bcefa7aeade668807f8d1fc9ed01bf616243cf4133962d1b48e16abd13d6e141 Jun 09 05:35:57.941854 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:57.941825 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ptwzv" event={"ID":"45d4dc70-6973-499d-b170-32092e1f35d3","Type":"ContainerStarted","Data":"bcefa7aeade668807f8d1fc9ed01bf616243cf4133962d1b48e16abd13d6e141"} Jun 09 05:35:59.953212 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:59.953176 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ptwzv" event={"ID":"45d4dc70-6973-499d-b170-32092e1f35d3","Type":"ContainerStarted","Data":"32d4e5299387d11008037daa62481781984740dceebab15916a21e0baab7a925"} Jun 09 05:35:59.968664 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:35:59.968618 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ptwzv" podStartSLOduration=1.609989168 podStartE2EDuration="3.968604143s" totalImagesPullingTime="2.358614975s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 05:35:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 05:35:59.967645189 +0000 UTC m=+410.050296925" watchObservedRunningTime="2026-06-09 05:35:59.968604143 +0000 UTC m=+410.051255878" Jun 09 05:36:04.547160 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:04.547124 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdt9s2z"] Jun 09 05:36:04.549830 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:04.549814 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdt9s2z" Jun 09 05:36:04.551986 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:04.551963 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 05:36:04.552111 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:04.552053 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 05:36:04.552111 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:04.552082 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-pcs6v\"" Jun 09 05:36:04.556864 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:04.556736 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdt9s2z"] Jun 09 05:36:04.575051 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:04.575017 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzz9x\" (UniqueName: \"kubernetes.io/projected/e0a26c45-9fbb-4426-a59b-60e6fb1e1f0c-kube-api-access-tzz9x\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdt9s2z\" (UID: \"e0a26c45-9fbb-4426-a59b-60e6fb1e1f0c\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdt9s2z" Jun 09 05:36:04.575202 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:04.575099 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e0a26c45-9fbb-4426-a59b-60e6fb1e1f0c-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdt9s2z\" (UID: \"e0a26c45-9fbb-4426-a59b-60e6fb1e1f0c\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdt9s2z" Jun 09 05:36:04.575202 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:04.575136 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e0a26c45-9fbb-4426-a59b-60e6fb1e1f0c-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdt9s2z\" (UID: \"e0a26c45-9fbb-4426-a59b-60e6fb1e1f0c\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdt9s2z" Jun 09 05:36:04.676341 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:04.676305 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzz9x\" (UniqueName: \"kubernetes.io/projected/e0a26c45-9fbb-4426-a59b-60e6fb1e1f0c-kube-api-access-tzz9x\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdt9s2z\" (UID: \"e0a26c45-9fbb-4426-a59b-60e6fb1e1f0c\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdt9s2z" Jun 09 05:36:04.676522 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:04.676366 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e0a26c45-9fbb-4426-a59b-60e6fb1e1f0c-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdt9s2z\" (UID: \"e0a26c45-9fbb-4426-a59b-60e6fb1e1f0c\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdt9s2z" Jun 09 05:36:04.676522 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:04.676403 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e0a26c45-9fbb-4426-a59b-60e6fb1e1f0c-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdt9s2z\" (UID: \"e0a26c45-9fbb-4426-a59b-60e6fb1e1f0c\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdt9s2z" Jun 09 05:36:04.676831 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:04.676779 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e0a26c45-9fbb-4426-a59b-60e6fb1e1f0c-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdt9s2z\" (UID: \"e0a26c45-9fbb-4426-a59b-60e6fb1e1f0c\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdt9s2z" Jun 09 05:36:04.676872 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:04.676829 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e0a26c45-9fbb-4426-a59b-60e6fb1e1f0c-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdt9s2z\" (UID: \"e0a26c45-9fbb-4426-a59b-60e6fb1e1f0c\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdt9s2z" Jun 09 05:36:04.684369 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:04.684337 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzz9x\" (UniqueName: \"kubernetes.io/projected/e0a26c45-9fbb-4426-a59b-60e6fb1e1f0c-kube-api-access-tzz9x\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdt9s2z\" (UID: \"e0a26c45-9fbb-4426-a59b-60e6fb1e1f0c\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdt9s2z" Jun 09 05:36:04.859942 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:04.859853 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdt9s2z" Jun 09 05:36:04.990294 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:04.990267 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdt9s2z"] Jun 09 05:36:04.992987 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:36:04.992961 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0a26c45_9fbb_4426_a59b_60e6fb1e1f0c.slice/crio-acdc39e040b191d9e6149b093728c9b61c2b6779d37b933bb96948f279005141 WatchSource:0}: Error finding container acdc39e040b191d9e6149b093728c9b61c2b6779d37b933bb96948f279005141: Status 404 returned error can't find the container with id acdc39e040b191d9e6149b093728c9b61c2b6779d37b933bb96948f279005141 Jun 09 05:36:05.980849 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:05.980753 2564 generic.go:356] "Generic (PLEG): container finished" podID="e0a26c45-9fbb-4426-a59b-60e6fb1e1f0c" containerID="a3544816af5314ef7702c72c825d4ef3919192efcbf057d196fa82b044196ace" exitCode=0 Jun 09 05:36:05.980849 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:05.980832 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdt9s2z" event={"ID":"e0a26c45-9fbb-4426-a59b-60e6fb1e1f0c","Type":"ContainerDied","Data":"a3544816af5314ef7702c72c825d4ef3919192efcbf057d196fa82b044196ace"} Jun 09 05:36:05.981255 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:05.980878 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdt9s2z" event={"ID":"e0a26c45-9fbb-4426-a59b-60e6fb1e1f0c","Type":"ContainerStarted","Data":"acdc39e040b191d9e6149b093728c9b61c2b6779d37b933bb96948f279005141"} Jun 09 05:36:06.987185 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:06.987127 2564 generic.go:356] "Generic (PLEG): container finished" podID="e0a26c45-9fbb-4426-a59b-60e6fb1e1f0c" containerID="1c0262a06660ceea22f209b5c6215a6d317a274e3a0be11b06471f98b63f1527" exitCode=0 Jun 09 05:36:06.987514 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:06.987195 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdt9s2z" event={"ID":"e0a26c45-9fbb-4426-a59b-60e6fb1e1f0c","Type":"ContainerDied","Data":"1c0262a06660ceea22f209b5c6215a6d317a274e3a0be11b06471f98b63f1527"} Jun 09 05:36:07.993821 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:07.993778 2564 generic.go:356] "Generic (PLEG): container finished" podID="e0a26c45-9fbb-4426-a59b-60e6fb1e1f0c" containerID="492fe960953b09b2cdee05472418d5b627cd164ed72bff8f366d8f9598711223" exitCode=0 Jun 09 05:36:07.994170 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:07.993866 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdt9s2z" event={"ID":"e0a26c45-9fbb-4426-a59b-60e6fb1e1f0c","Type":"ContainerDied","Data":"492fe960953b09b2cdee05472418d5b627cd164ed72bff8f366d8f9598711223"} Jun 09 05:36:09.124043 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:09.124022 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdt9s2z" Jun 09 05:36:09.214597 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:09.214571 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tzz9x\" (UniqueName: \"kubernetes.io/projected/e0a26c45-9fbb-4426-a59b-60e6fb1e1f0c-kube-api-access-tzz9x\") pod \"e0a26c45-9fbb-4426-a59b-60e6fb1e1f0c\" (UID: \"e0a26c45-9fbb-4426-a59b-60e6fb1e1f0c\") " Jun 09 05:36:09.214712 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:09.214609 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e0a26c45-9fbb-4426-a59b-60e6fb1e1f0c-bundle\") pod \"e0a26c45-9fbb-4426-a59b-60e6fb1e1f0c\" (UID: \"e0a26c45-9fbb-4426-a59b-60e6fb1e1f0c\") " Jun 09 05:36:09.214712 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:09.214636 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e0a26c45-9fbb-4426-a59b-60e6fb1e1f0c-util\") pod \"e0a26c45-9fbb-4426-a59b-60e6fb1e1f0c\" (UID: \"e0a26c45-9fbb-4426-a59b-60e6fb1e1f0c\") " Jun 09 05:36:09.215287 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:09.215260 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0a26c45-9fbb-4426-a59b-60e6fb1e1f0c-bundle" (OuterVolumeSpecName: "bundle") pod "e0a26c45-9fbb-4426-a59b-60e6fb1e1f0c" (UID: "e0a26c45-9fbb-4426-a59b-60e6fb1e1f0c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 05:36:09.216501 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:09.216481 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0a26c45-9fbb-4426-a59b-60e6fb1e1f0c-kube-api-access-tzz9x" (OuterVolumeSpecName: "kube-api-access-tzz9x") pod "e0a26c45-9fbb-4426-a59b-60e6fb1e1f0c" (UID: "e0a26c45-9fbb-4426-a59b-60e6fb1e1f0c"). InnerVolumeSpecName "kube-api-access-tzz9x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 05:36:09.220034 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:09.220011 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0a26c45-9fbb-4426-a59b-60e6fb1e1f0c-util" (OuterVolumeSpecName: "util") pod "e0a26c45-9fbb-4426-a59b-60e6fb1e1f0c" (UID: "e0a26c45-9fbb-4426-a59b-60e6fb1e1f0c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 05:36:09.316222 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:09.316200 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e0a26c45-9fbb-4426-a59b-60e6fb1e1f0c-util\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:36:09.316222 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:09.316222 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tzz9x\" (UniqueName: \"kubernetes.io/projected/e0a26c45-9fbb-4426-a59b-60e6fb1e1f0c-kube-api-access-tzz9x\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:36:09.316353 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:09.316232 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e0a26c45-9fbb-4426-a59b-60e6fb1e1f0c-bundle\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:36:10.005741 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:10.005706 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdt9s2z" event={"ID":"e0a26c45-9fbb-4426-a59b-60e6fb1e1f0c","Type":"ContainerDied","Data":"acdc39e040b191d9e6149b093728c9b61c2b6779d37b933bb96948f279005141"} Jun 09 05:36:10.005915 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:10.005747 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdt9s2z" Jun 09 05:36:10.005915 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:10.005754 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="acdc39e040b191d9e6149b093728c9b61c2b6779d37b933bb96948f279005141" Jun 09 05:36:16.255766 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:16.255726 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-66ccd5c574-4wl8b"] Jun 09 05:36:16.256258 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:16.256222 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0a26c45-9fbb-4426-a59b-60e6fb1e1f0c" containerName="pull" Jun 09 05:36:16.256258 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:16.256239 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0a26c45-9fbb-4426-a59b-60e6fb1e1f0c" containerName="pull" Jun 09 05:36:16.256370 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:16.256267 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0a26c45-9fbb-4426-a59b-60e6fb1e1f0c" containerName="util" Jun 09 05:36:16.256370 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:16.256275 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0a26c45-9fbb-4426-a59b-60e6fb1e1f0c" containerName="util" Jun 09 05:36:16.256370 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:16.256291 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0a26c45-9fbb-4426-a59b-60e6fb1e1f0c" containerName="extract" Jun 09 05:36:16.256370 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:16.256300 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0a26c45-9fbb-4426-a59b-60e6fb1e1f0c" containerName="extract" Jun 09 05:36:16.256567 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:16.256384 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0a26c45-9fbb-4426-a59b-60e6fb1e1f0c" containerName="extract" Jun 09 05:36:16.261418 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:16.261396 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-66ccd5c574-4wl8b" Jun 09 05:36:16.263946 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:16.263924 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 09 05:36:16.264073 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:16.263949 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 09 05:36:16.264073 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:16.263954 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-mjks9\"" Jun 09 05:36:16.264073 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:16.264065 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 09 05:36:16.264412 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:16.264397 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 09 05:36:16.275090 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:16.275070 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-66ccd5c574-4wl8b"] Jun 09 05:36:16.366654 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:16.366626 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9a99d12a-707c-428e-9f95-a7c904ca4240-manifests\") pod \"opendatahub-operator-controller-manager-66ccd5c574-4wl8b\" (UID: \"9a99d12a-707c-428e-9f95-a7c904ca4240\") " pod="opendatahub/opendatahub-operator-controller-manager-66ccd5c574-4wl8b" Jun 09 05:36:16.366763 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:16.366655 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9a99d12a-707c-428e-9f95-a7c904ca4240-webhook-cert\") pod \"opendatahub-operator-controller-manager-66ccd5c574-4wl8b\" (UID: \"9a99d12a-707c-428e-9f95-a7c904ca4240\") " pod="opendatahub/opendatahub-operator-controller-manager-66ccd5c574-4wl8b" Jun 09 05:36:16.366763 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:16.366753 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9a99d12a-707c-428e-9f95-a7c904ca4240-apiservice-cert\") pod \"opendatahub-operator-controller-manager-66ccd5c574-4wl8b\" (UID: \"9a99d12a-707c-428e-9f95-a7c904ca4240\") " pod="opendatahub/opendatahub-operator-controller-manager-66ccd5c574-4wl8b" Jun 09 05:36:16.366859 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:16.366776 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9a99d12a-707c-428e-9f95-a7c904ca4240-tmp\") pod \"opendatahub-operator-controller-manager-66ccd5c574-4wl8b\" (UID: \"9a99d12a-707c-428e-9f95-a7c904ca4240\") " pod="opendatahub/opendatahub-operator-controller-manager-66ccd5c574-4wl8b" Jun 09 05:36:16.366859 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:16.366842 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cnpg\" (UniqueName: \"kubernetes.io/projected/9a99d12a-707c-428e-9f95-a7c904ca4240-kube-api-access-9cnpg\") pod \"opendatahub-operator-controller-manager-66ccd5c574-4wl8b\" (UID: \"9a99d12a-707c-428e-9f95-a7c904ca4240\") " pod="opendatahub/opendatahub-operator-controller-manager-66ccd5c574-4wl8b" Jun 09 05:36:16.467500 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:16.467480 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9a99d12a-707c-428e-9f95-a7c904ca4240-apiservice-cert\") pod \"opendatahub-operator-controller-manager-66ccd5c574-4wl8b\" (UID: \"9a99d12a-707c-428e-9f95-a7c904ca4240\") " pod="opendatahub/opendatahub-operator-controller-manager-66ccd5c574-4wl8b" Jun 09 05:36:16.467615 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:16.467505 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9a99d12a-707c-428e-9f95-a7c904ca4240-tmp\") pod \"opendatahub-operator-controller-manager-66ccd5c574-4wl8b\" (UID: \"9a99d12a-707c-428e-9f95-a7c904ca4240\") " pod="opendatahub/opendatahub-operator-controller-manager-66ccd5c574-4wl8b" Jun 09 05:36:16.467615 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:16.467533 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cnpg\" (UniqueName: \"kubernetes.io/projected/9a99d12a-707c-428e-9f95-a7c904ca4240-kube-api-access-9cnpg\") pod \"opendatahub-operator-controller-manager-66ccd5c574-4wl8b\" (UID: \"9a99d12a-707c-428e-9f95-a7c904ca4240\") " pod="opendatahub/opendatahub-operator-controller-manager-66ccd5c574-4wl8b" Jun 09 05:36:16.467615 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:16.467559 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9a99d12a-707c-428e-9f95-a7c904ca4240-manifests\") pod \"opendatahub-operator-controller-manager-66ccd5c574-4wl8b\" (UID: \"9a99d12a-707c-428e-9f95-a7c904ca4240\") " pod="opendatahub/opendatahub-operator-controller-manager-66ccd5c574-4wl8b" Jun 09 05:36:16.467615 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:16.467603 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9a99d12a-707c-428e-9f95-a7c904ca4240-webhook-cert\") pod \"opendatahub-operator-controller-manager-66ccd5c574-4wl8b\" (UID: \"9a99d12a-707c-428e-9f95-a7c904ca4240\") " pod="opendatahub/opendatahub-operator-controller-manager-66ccd5c574-4wl8b" Jun 09 05:36:16.467902 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:16.467884 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9a99d12a-707c-428e-9f95-a7c904ca4240-manifests\") pod \"opendatahub-operator-controller-manager-66ccd5c574-4wl8b\" (UID: \"9a99d12a-707c-428e-9f95-a7c904ca4240\") " pod="opendatahub/opendatahub-operator-controller-manager-66ccd5c574-4wl8b" Jun 09 05:36:16.469915 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:16.469895 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9a99d12a-707c-428e-9f95-a7c904ca4240-tmp\") pod \"opendatahub-operator-controller-manager-66ccd5c574-4wl8b\" (UID: \"9a99d12a-707c-428e-9f95-a7c904ca4240\") " pod="opendatahub/opendatahub-operator-controller-manager-66ccd5c574-4wl8b" Jun 09 05:36:16.470044 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:16.469954 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9a99d12a-707c-428e-9f95-a7c904ca4240-apiservice-cert\") pod \"opendatahub-operator-controller-manager-66ccd5c574-4wl8b\" (UID: \"9a99d12a-707c-428e-9f95-a7c904ca4240\") " pod="opendatahub/opendatahub-operator-controller-manager-66ccd5c574-4wl8b" Jun 09 05:36:16.470106 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:16.470089 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9a99d12a-707c-428e-9f95-a7c904ca4240-webhook-cert\") pod \"opendatahub-operator-controller-manager-66ccd5c574-4wl8b\" (UID: \"9a99d12a-707c-428e-9f95-a7c904ca4240\") " pod="opendatahub/opendatahub-operator-controller-manager-66ccd5c574-4wl8b" Jun 09 05:36:16.474917 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:16.474886 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cnpg\" (UniqueName: \"kubernetes.io/projected/9a99d12a-707c-428e-9f95-a7c904ca4240-kube-api-access-9cnpg\") pod \"opendatahub-operator-controller-manager-66ccd5c574-4wl8b\" (UID: \"9a99d12a-707c-428e-9f95-a7c904ca4240\") " pod="opendatahub/opendatahub-operator-controller-manager-66ccd5c574-4wl8b" Jun 09 05:36:16.571728 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:16.571699 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-66ccd5c574-4wl8b" Jun 09 05:36:16.704444 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:16.704228 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-66ccd5c574-4wl8b"] Jun 09 05:36:16.708789 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:36:16.708764 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a99d12a_707c_428e_9f95_a7c904ca4240.slice/crio-c1a962cb61c94f23fe7f3b404c7450ab5937a239bb6c2bbadbadad006f0f3788 WatchSource:0}: Error finding container c1a962cb61c94f23fe7f3b404c7450ab5937a239bb6c2bbadbadad006f0f3788: Status 404 returned error can't find the container with id c1a962cb61c94f23fe7f3b404c7450ab5937a239bb6c2bbadbadad006f0f3788 Jun 09 05:36:17.038212 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:17.038181 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-66ccd5c574-4wl8b" event={"ID":"9a99d12a-707c-428e-9f95-a7c904ca4240","Type":"ContainerStarted","Data":"c1a962cb61c94f23fe7f3b404c7450ab5937a239bb6c2bbadbadad006f0f3788"} Jun 09 05:36:20.055730 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:20.055698 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-66ccd5c574-4wl8b" event={"ID":"9a99d12a-707c-428e-9f95-a7c904ca4240","Type":"ContainerStarted","Data":"da357dbb2847216e06a8c738074ae145989e62e81ec3a8e2855bb8d47669cb45"} Jun 09 05:36:21.061326 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:21.061290 2564 generic.go:356] "Generic (PLEG): container finished" podID="9a99d12a-707c-428e-9f95-a7c904ca4240" containerID="da357dbb2847216e06a8c738074ae145989e62e81ec3a8e2855bb8d47669cb45" exitCode=0 Jun 09 05:36:21.061770 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:21.061346 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-66ccd5c574-4wl8b" event={"ID":"9a99d12a-707c-428e-9f95-a7c904ca4240","Type":"ContainerDied","Data":"da357dbb2847216e06a8c738074ae145989e62e81ec3a8e2855bb8d47669cb45"} Jun 09 05:36:22.068195 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:22.068146 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-66ccd5c574-4wl8b" event={"ID":"9a99d12a-707c-428e-9f95-a7c904ca4240","Type":"ContainerStarted","Data":"4522f8d0d170ec5955fd3f3fb9595f07195d1c148e2b43cdbdce0f5652d7ad84"} Jun 09 05:36:22.068601 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:22.068244 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-66ccd5c574-4wl8b" Jun 09 05:36:22.087462 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:22.087417 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-66ccd5c574-4wl8b" podStartSLOduration=1.920645838 podStartE2EDuration="6.08740405s" totalImagesPullingTime="3.252843102s" totalInitContainerRuntime="913.91511ms" isStatefulPod=false podCreationTimestamp="2026-06-09 05:36:16 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 05:36:22.086968763 +0000 UTC m=+432.169620499" watchObservedRunningTime="2026-06-09 05:36:22.08740405 +0000 UTC m=+432.170055785" Jun 09 05:36:33.074435 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:33.074404 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-66ccd5c574-4wl8b" Jun 09 05:36:35.496104 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:35.496066 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-kv94q"] Jun 09 05:36:35.504007 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:35.503974 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-kv94q" Jun 09 05:36:35.506676 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:35.506647 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-kv94q"] Jun 09 05:36:35.506895 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:35.506689 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 09 05:36:35.507094 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:35.507000 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-vtbvk\"" Jun 09 05:36:35.618382 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:35.618348 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kd7tz\" (UniqueName: \"kubernetes.io/projected/4fbcde52-a813-40c6-ab57-9b47f9eb6bee-kube-api-access-kd7tz\") pod \"odh-model-controller-6dc94f689f-kv94q\" (UID: \"4fbcde52-a813-40c6-ab57-9b47f9eb6bee\") " pod="opendatahub/odh-model-controller-6dc94f689f-kv94q" Jun 09 05:36:35.618548 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:35.618448 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4fbcde52-a813-40c6-ab57-9b47f9eb6bee-cert\") pod \"odh-model-controller-6dc94f689f-kv94q\" (UID: \"4fbcde52-a813-40c6-ab57-9b47f9eb6bee\") " pod="opendatahub/odh-model-controller-6dc94f689f-kv94q" Jun 09 05:36:35.719887 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:35.719847 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kd7tz\" (UniqueName: \"kubernetes.io/projected/4fbcde52-a813-40c6-ab57-9b47f9eb6bee-kube-api-access-kd7tz\") pod \"odh-model-controller-6dc94f689f-kv94q\" (UID: \"4fbcde52-a813-40c6-ab57-9b47f9eb6bee\") " pod="opendatahub/odh-model-controller-6dc94f689f-kv94q" Jun 09 05:36:35.720087 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:35.719905 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4fbcde52-a813-40c6-ab57-9b47f9eb6bee-cert\") pod \"odh-model-controller-6dc94f689f-kv94q\" (UID: \"4fbcde52-a813-40c6-ab57-9b47f9eb6bee\") " pod="opendatahub/odh-model-controller-6dc94f689f-kv94q" Jun 09 05:36:35.720087 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:36:35.720072 2564 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 09 05:36:35.720223 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:36:35.720148 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fbcde52-a813-40c6-ab57-9b47f9eb6bee-cert podName:4fbcde52-a813-40c6-ab57-9b47f9eb6bee nodeName:}" failed. No retries permitted until 2026-06-09 05:36:36.220126636 +0000 UTC m=+446.302778370 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/4fbcde52-a813-40c6-ab57-9b47f9eb6bee-cert") pod "odh-model-controller-6dc94f689f-kv94q" (UID: "4fbcde52-a813-40c6-ab57-9b47f9eb6bee") : secret "odh-model-controller-webhook-cert" not found Jun 09 05:36:35.729035 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:35.729002 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kd7tz\" (UniqueName: \"kubernetes.io/projected/4fbcde52-a813-40c6-ab57-9b47f9eb6bee-kube-api-access-kd7tz\") pod \"odh-model-controller-6dc94f689f-kv94q\" (UID: \"4fbcde52-a813-40c6-ab57-9b47f9eb6bee\") " pod="opendatahub/odh-model-controller-6dc94f689f-kv94q" Jun 09 05:36:36.020373 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:36.020341 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-dsxmv"] Jun 09 05:36:36.023832 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:36.023812 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-dsxmv" Jun 09 05:36:36.026130 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:36.026110 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-95sfh\"" Jun 09 05:36:36.026249 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:36.026128 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 09 05:36:36.032832 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:36.032807 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-dsxmv"] Jun 09 05:36:36.124605 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:36.124573 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f51482b8-edfb-4f94-8a31-2b615a67d304-tls-certs\") pod \"model-serving-api-5dd488fc48-dsxmv\" (UID: \"f51482b8-edfb-4f94-8a31-2b615a67d304\") " pod="opendatahub/model-serving-api-5dd488fc48-dsxmv" Jun 09 05:36:36.124768 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:36.124619 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jsqdd\" (UniqueName: \"kubernetes.io/projected/f51482b8-edfb-4f94-8a31-2b615a67d304-kube-api-access-jsqdd\") pod \"model-serving-api-5dd488fc48-dsxmv\" (UID: \"f51482b8-edfb-4f94-8a31-2b615a67d304\") " pod="opendatahub/model-serving-api-5dd488fc48-dsxmv" Jun 09 05:36:36.225770 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:36.225739 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4fbcde52-a813-40c6-ab57-9b47f9eb6bee-cert\") pod \"odh-model-controller-6dc94f689f-kv94q\" (UID: \"4fbcde52-a813-40c6-ab57-9b47f9eb6bee\") " pod="opendatahub/odh-model-controller-6dc94f689f-kv94q" Jun 09 05:36:36.225967 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:36.225782 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f51482b8-edfb-4f94-8a31-2b615a67d304-tls-certs\") pod \"model-serving-api-5dd488fc48-dsxmv\" (UID: \"f51482b8-edfb-4f94-8a31-2b615a67d304\") " pod="opendatahub/model-serving-api-5dd488fc48-dsxmv" Jun 09 05:36:36.225967 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:36.225831 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jsqdd\" (UniqueName: \"kubernetes.io/projected/f51482b8-edfb-4f94-8a31-2b615a67d304-kube-api-access-jsqdd\") pod \"model-serving-api-5dd488fc48-dsxmv\" (UID: \"f51482b8-edfb-4f94-8a31-2b615a67d304\") " pod="opendatahub/model-serving-api-5dd488fc48-dsxmv" Jun 09 05:36:36.226079 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:36:36.225972 2564 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jun 09 05:36:36.226079 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:36:36.226044 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f51482b8-edfb-4f94-8a31-2b615a67d304-tls-certs podName:f51482b8-edfb-4f94-8a31-2b615a67d304 nodeName:}" failed. No retries permitted until 2026-06-09 05:36:36.726024855 +0000 UTC m=+446.808676575 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/f51482b8-edfb-4f94-8a31-2b615a67d304-tls-certs") pod "model-serving-api-5dd488fc48-dsxmv" (UID: "f51482b8-edfb-4f94-8a31-2b615a67d304") : secret "model-serving-api-tls" not found Jun 09 05:36:36.228131 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:36.228110 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4fbcde52-a813-40c6-ab57-9b47f9eb6bee-cert\") pod \"odh-model-controller-6dc94f689f-kv94q\" (UID: \"4fbcde52-a813-40c6-ab57-9b47f9eb6bee\") " pod="opendatahub/odh-model-controller-6dc94f689f-kv94q" Jun 09 05:36:36.236689 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:36.236658 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsqdd\" (UniqueName: \"kubernetes.io/projected/f51482b8-edfb-4f94-8a31-2b615a67d304-kube-api-access-jsqdd\") pod \"model-serving-api-5dd488fc48-dsxmv\" (UID: \"f51482b8-edfb-4f94-8a31-2b615a67d304\") " pod="opendatahub/model-serving-api-5dd488fc48-dsxmv" Jun 09 05:36:36.416624 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:36.416595 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-kv94q" Jun 09 05:36:36.551303 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:36.551271 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-kv94q"] Jun 09 05:36:36.553369 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:36:36.553336 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fbcde52_a813_40c6_ab57_9b47f9eb6bee.slice/crio-3fbb655b32d2fd5defbc3b39283e5bd8433ba5d7688d98b6d1f80ff24b621802 WatchSource:0}: Error finding container 3fbb655b32d2fd5defbc3b39283e5bd8433ba5d7688d98b6d1f80ff24b621802: Status 404 returned error can't find the container with id 3fbb655b32d2fd5defbc3b39283e5bd8433ba5d7688d98b6d1f80ff24b621802 Jun 09 05:36:36.731059 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:36.730981 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f51482b8-edfb-4f94-8a31-2b615a67d304-tls-certs\") pod \"model-serving-api-5dd488fc48-dsxmv\" (UID: \"f51482b8-edfb-4f94-8a31-2b615a67d304\") " pod="opendatahub/model-serving-api-5dd488fc48-dsxmv" Jun 09 05:36:36.733566 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:36.733530 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f51482b8-edfb-4f94-8a31-2b615a67d304-tls-certs\") pod \"model-serving-api-5dd488fc48-dsxmv\" (UID: \"f51482b8-edfb-4f94-8a31-2b615a67d304\") " pod="opendatahub/model-serving-api-5dd488fc48-dsxmv" Jun 09 05:36:36.936565 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:36.936524 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-dsxmv" Jun 09 05:36:37.072177 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:37.072154 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-dsxmv"] Jun 09 05:36:37.074640 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:36:37.074603 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf51482b8_edfb_4f94_8a31_2b615a67d304.slice/crio-89bdeb14c2e83e257bd01f884d38e6c16b7eb90a9e4e0fc184b71e625b834a61 WatchSource:0}: Error finding container 89bdeb14c2e83e257bd01f884d38e6c16b7eb90a9e4e0fc184b71e625b834a61: Status 404 returned error can't find the container with id 89bdeb14c2e83e257bd01f884d38e6c16b7eb90a9e4e0fc184b71e625b834a61 Jun 09 05:36:37.142535 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:37.142022 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-dsxmv" event={"ID":"f51482b8-edfb-4f94-8a31-2b615a67d304","Type":"ContainerStarted","Data":"89bdeb14c2e83e257bd01f884d38e6c16b7eb90a9e4e0fc184b71e625b834a61"} Jun 09 05:36:37.143767 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:37.143741 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-kv94q" event={"ID":"4fbcde52-a813-40c6-ab57-9b47f9eb6bee","Type":"ContainerStarted","Data":"3fbb655b32d2fd5defbc3b39283e5bd8433ba5d7688d98b6d1f80ff24b621802"} Jun 09 05:36:40.767000 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:40.766959 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-55f7df5cdd-bl8zr"] Jun 09 05:36:40.770841 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:40.770816 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-55f7df5cdd-bl8zr" Jun 09 05:36:40.774370 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:40.774348 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-nmfrv\"" Jun 09 05:36:40.774491 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:40.774425 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 09 05:36:40.774491 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:40.774428 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 09 05:36:40.774595 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:40.774351 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 09 05:36:40.782452 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:40.782429 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-55f7df5cdd-bl8zr"] Jun 09 05:36:40.871272 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:40.871240 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6885e467-ada1-464d-8e7b-7513ec056df0-metrics-cert\") pod \"lws-controller-manager-55f7df5cdd-bl8zr\" (UID: \"6885e467-ada1-464d-8e7b-7513ec056df0\") " pod="openshift-lws-operator/lws-controller-manager-55f7df5cdd-bl8zr" Jun 09 05:36:40.871439 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:40.871290 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2l5sx\" (UniqueName: \"kubernetes.io/projected/6885e467-ada1-464d-8e7b-7513ec056df0-kube-api-access-2l5sx\") pod \"lws-controller-manager-55f7df5cdd-bl8zr\" (UID: \"6885e467-ada1-464d-8e7b-7513ec056df0\") " pod="openshift-lws-operator/lws-controller-manager-55f7df5cdd-bl8zr" Jun 09 05:36:40.871439 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:40.871365 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6885e467-ada1-464d-8e7b-7513ec056df0-cert\") pod \"lws-controller-manager-55f7df5cdd-bl8zr\" (UID: \"6885e467-ada1-464d-8e7b-7513ec056df0\") " pod="openshift-lws-operator/lws-controller-manager-55f7df5cdd-bl8zr" Jun 09 05:36:40.871525 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:40.871433 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6885e467-ada1-464d-8e7b-7513ec056df0-manager-config\") pod \"lws-controller-manager-55f7df5cdd-bl8zr\" (UID: \"6885e467-ada1-464d-8e7b-7513ec056df0\") " pod="openshift-lws-operator/lws-controller-manager-55f7df5cdd-bl8zr" Jun 09 05:36:40.972395 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:40.972364 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2l5sx\" (UniqueName: \"kubernetes.io/projected/6885e467-ada1-464d-8e7b-7513ec056df0-kube-api-access-2l5sx\") pod \"lws-controller-manager-55f7df5cdd-bl8zr\" (UID: \"6885e467-ada1-464d-8e7b-7513ec056df0\") " pod="openshift-lws-operator/lws-controller-manager-55f7df5cdd-bl8zr" Jun 09 05:36:40.972511 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:40.972463 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6885e467-ada1-464d-8e7b-7513ec056df0-cert\") pod \"lws-controller-manager-55f7df5cdd-bl8zr\" (UID: \"6885e467-ada1-464d-8e7b-7513ec056df0\") " pod="openshift-lws-operator/lws-controller-manager-55f7df5cdd-bl8zr" Jun 09 05:36:40.972511 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:40.972496 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6885e467-ada1-464d-8e7b-7513ec056df0-manager-config\") pod \"lws-controller-manager-55f7df5cdd-bl8zr\" (UID: \"6885e467-ada1-464d-8e7b-7513ec056df0\") " pod="openshift-lws-operator/lws-controller-manager-55f7df5cdd-bl8zr" Jun 09 05:36:40.972640 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:40.972542 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6885e467-ada1-464d-8e7b-7513ec056df0-metrics-cert\") pod \"lws-controller-manager-55f7df5cdd-bl8zr\" (UID: \"6885e467-ada1-464d-8e7b-7513ec056df0\") " pod="openshift-lws-operator/lws-controller-manager-55f7df5cdd-bl8zr" Jun 09 05:36:40.973400 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:40.973367 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6885e467-ada1-464d-8e7b-7513ec056df0-manager-config\") pod \"lws-controller-manager-55f7df5cdd-bl8zr\" (UID: \"6885e467-ada1-464d-8e7b-7513ec056df0\") " pod="openshift-lws-operator/lws-controller-manager-55f7df5cdd-bl8zr" Jun 09 05:36:40.975408 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:40.975368 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6885e467-ada1-464d-8e7b-7513ec056df0-cert\") pod \"lws-controller-manager-55f7df5cdd-bl8zr\" (UID: \"6885e467-ada1-464d-8e7b-7513ec056df0\") " pod="openshift-lws-operator/lws-controller-manager-55f7df5cdd-bl8zr" Jun 09 05:36:40.975520 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:40.975482 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6885e467-ada1-464d-8e7b-7513ec056df0-metrics-cert\") pod \"lws-controller-manager-55f7df5cdd-bl8zr\" (UID: \"6885e467-ada1-464d-8e7b-7513ec056df0\") " pod="openshift-lws-operator/lws-controller-manager-55f7df5cdd-bl8zr" Jun 09 05:36:40.980732 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:40.980708 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2l5sx\" (UniqueName: \"kubernetes.io/projected/6885e467-ada1-464d-8e7b-7513ec056df0-kube-api-access-2l5sx\") pod \"lws-controller-manager-55f7df5cdd-bl8zr\" (UID: \"6885e467-ada1-464d-8e7b-7513ec056df0\") " pod="openshift-lws-operator/lws-controller-manager-55f7df5cdd-bl8zr" Jun 09 05:36:41.083902 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:41.083874 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-55f7df5cdd-bl8zr" Jun 09 05:36:41.172695 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:41.172658 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-dsxmv" event={"ID":"f51482b8-edfb-4f94-8a31-2b615a67d304","Type":"ContainerStarted","Data":"5e6a40a56009a55eafbdf55dbbe65ca35f1769398f3bbf92ccb58681f1fc05e8"} Jun 09 05:36:41.172857 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:41.172812 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-dsxmv" Jun 09 05:36:41.175258 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:41.175049 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-kv94q" event={"ID":"4fbcde52-a813-40c6-ab57-9b47f9eb6bee","Type":"ContainerStarted","Data":"6af4a3bf616aa88fc974792bc9fd16dc6bcdb0df7a91a04a816591066a09125e"} Jun 09 05:36:41.175258 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:41.175186 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-kv94q" Jun 09 05:36:41.193828 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:41.193732 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-dsxmv" podStartSLOduration=1.379590938 podStartE2EDuration="5.193716482s" totalImagesPullingTime="3.814125544s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 05:36:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 05:36:41.191163817 +0000 UTC m=+451.273815553" watchObservedRunningTime="2026-06-09 05:36:41.193716482 +0000 UTC m=+451.276368218" Jun 09 05:36:41.211684 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:41.211641 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-kv94q" podStartSLOduration=1.833938308 podStartE2EDuration="6.21162552s" totalImagesPullingTime="4.377687212s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 05:36:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 05:36:41.210590019 +0000 UTC m=+451.293241774" watchObservedRunningTime="2026-06-09 05:36:41.21162552 +0000 UTC m=+451.294277256" Jun 09 05:36:41.224787 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:41.224746 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-55f7df5cdd-bl8zr"] Jun 09 05:36:41.230015 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:36:41.229972 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6885e467_ada1_464d_8e7b_7513ec056df0.slice/crio-d994a8b9f0976ebf0be1e19fe2208a521c47fce4aeaf246e5b1745c268b848ee WatchSource:0}: Error finding container d994a8b9f0976ebf0be1e19fe2208a521c47fce4aeaf246e5b1745c268b848ee: Status 404 returned error can't find the container with id d994a8b9f0976ebf0be1e19fe2208a521c47fce4aeaf246e5b1745c268b848ee Jun 09 05:36:42.182125 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:42.182083 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-55f7df5cdd-bl8zr" event={"ID":"6885e467-ada1-464d-8e7b-7513ec056df0","Type":"ContainerStarted","Data":"d994a8b9f0976ebf0be1e19fe2208a521c47fce4aeaf246e5b1745c268b848ee"} Jun 09 05:36:43.188901 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:43.188815 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-55f7df5cdd-bl8zr" event={"ID":"6885e467-ada1-464d-8e7b-7513ec056df0","Type":"ContainerStarted","Data":"034df1bb9d329e51bfec7a340216291ee07edabe7a6fd8247fc1d3d29af86da4"} Jun 09 05:36:43.189258 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:43.188947 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-55f7df5cdd-bl8zr" Jun 09 05:36:43.205351 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:43.205305 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-55f7df5cdd-bl8zr" podStartSLOduration=1.635654464 podStartE2EDuration="3.20529155s" totalImagesPullingTime="1.569637086s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 05:36:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 05:36:43.203953206 +0000 UTC m=+453.286604944" watchObservedRunningTime="2026-06-09 05:36:43.20529155 +0000 UTC m=+453.287943286" Jun 09 05:36:47.632050 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:47.632015 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067sx6k"] Jun 09 05:36:47.635714 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:47.635698 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067sx6k" Jun 09 05:36:47.638060 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:47.638038 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-pcs6v\"" Jun 09 05:36:47.638173 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:47.638080 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 05:36:47.638747 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:47.638732 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 05:36:47.644233 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:47.644211 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067sx6k"] Jun 09 05:36:47.731993 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:47.731968 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b9c3186-890b-4a0f-9b15-95c973999cfd-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067sx6k\" (UID: \"8b9c3186-890b-4a0f-9b15-95c973999cfd\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067sx6k" Jun 09 05:36:47.732117 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:47.732022 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b9c3186-890b-4a0f-9b15-95c973999cfd-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067sx6k\" (UID: \"8b9c3186-890b-4a0f-9b15-95c973999cfd\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067sx6k" Jun 09 05:36:47.732117 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:47.732045 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlrwh\" (UniqueName: \"kubernetes.io/projected/8b9c3186-890b-4a0f-9b15-95c973999cfd-kube-api-access-jlrwh\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067sx6k\" (UID: \"8b9c3186-890b-4a0f-9b15-95c973999cfd\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067sx6k" Jun 09 05:36:47.832945 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:47.832924 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b9c3186-890b-4a0f-9b15-95c973999cfd-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067sx6k\" (UID: \"8b9c3186-890b-4a0f-9b15-95c973999cfd\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067sx6k" Jun 09 05:36:47.833026 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:47.832957 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlrwh\" (UniqueName: \"kubernetes.io/projected/8b9c3186-890b-4a0f-9b15-95c973999cfd-kube-api-access-jlrwh\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067sx6k\" (UID: \"8b9c3186-890b-4a0f-9b15-95c973999cfd\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067sx6k" Jun 09 05:36:47.833026 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:47.832989 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b9c3186-890b-4a0f-9b15-95c973999cfd-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067sx6k\" (UID: \"8b9c3186-890b-4a0f-9b15-95c973999cfd\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067sx6k" Jun 09 05:36:47.833296 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:47.833279 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b9c3186-890b-4a0f-9b15-95c973999cfd-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067sx6k\" (UID: \"8b9c3186-890b-4a0f-9b15-95c973999cfd\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067sx6k" Jun 09 05:36:47.833337 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:47.833323 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b9c3186-890b-4a0f-9b15-95c973999cfd-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067sx6k\" (UID: \"8b9c3186-890b-4a0f-9b15-95c973999cfd\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067sx6k" Jun 09 05:36:47.840580 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:47.840559 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlrwh\" (UniqueName: \"kubernetes.io/projected/8b9c3186-890b-4a0f-9b15-95c973999cfd-kube-api-access-jlrwh\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067sx6k\" (UID: \"8b9c3186-890b-4a0f-9b15-95c973999cfd\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067sx6k" Jun 09 05:36:47.946076 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:47.946028 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067sx6k" Jun 09 05:36:48.070252 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:48.070224 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067sx6k"] Jun 09 05:36:48.073165 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:36:48.073139 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b9c3186_890b_4a0f_9b15_95c973999cfd.slice/crio-14846cdefec814f1b374bbefc5489897cf6cda00539e232541a88af35fa5a98f WatchSource:0}: Error finding container 14846cdefec814f1b374bbefc5489897cf6cda00539e232541a88af35fa5a98f: Status 404 returned error can't find the container with id 14846cdefec814f1b374bbefc5489897cf6cda00539e232541a88af35fa5a98f Jun 09 05:36:48.215175 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:48.215107 2564 generic.go:356] "Generic (PLEG): container finished" podID="8b9c3186-890b-4a0f-9b15-95c973999cfd" containerID="890ba81f3e8274bbbf3a9a284c965321f8f0573cf0ce5d86c6e270b56df73bc0" exitCode=0 Jun 09 05:36:48.215299 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:48.215188 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067sx6k" event={"ID":"8b9c3186-890b-4a0f-9b15-95c973999cfd","Type":"ContainerDied","Data":"890ba81f3e8274bbbf3a9a284c965321f8f0573cf0ce5d86c6e270b56df73bc0"} Jun 09 05:36:48.215299 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:48.215269 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067sx6k" event={"ID":"8b9c3186-890b-4a0f-9b15-95c973999cfd","Type":"ContainerStarted","Data":"14846cdefec814f1b374bbefc5489897cf6cda00539e232541a88af35fa5a98f"} Jun 09 05:36:49.222646 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:49.222616 2564 generic.go:356] "Generic (PLEG): container finished" podID="8b9c3186-890b-4a0f-9b15-95c973999cfd" containerID="ff85ebd9853862a9d44af59e1d98f417bc3305e37ec117020baa7a60cba940b9" exitCode=0 Jun 09 05:36:49.223024 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:49.222707 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067sx6k" event={"ID":"8b9c3186-890b-4a0f-9b15-95c973999cfd","Type":"ContainerDied","Data":"ff85ebd9853862a9d44af59e1d98f417bc3305e37ec117020baa7a60cba940b9"} Jun 09 05:36:50.231224 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:50.231194 2564 generic.go:356] "Generic (PLEG): container finished" podID="8b9c3186-890b-4a0f-9b15-95c973999cfd" containerID="1d7a062e60dd4d14e84be4df4df59f5a34c016409dd28165e1c80236abbb5392" exitCode=0 Jun 09 05:36:50.231626 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:50.231285 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067sx6k" event={"ID":"8b9c3186-890b-4a0f-9b15-95c973999cfd","Type":"ContainerDied","Data":"1d7a062e60dd4d14e84be4df4df59f5a34c016409dd28165e1c80236abbb5392"} Jun 09 05:36:51.359552 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:51.359528 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067sx6k" Jun 09 05:36:51.460647 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:51.460616 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b9c3186-890b-4a0f-9b15-95c973999cfd-bundle\") pod \"8b9c3186-890b-4a0f-9b15-95c973999cfd\" (UID: \"8b9c3186-890b-4a0f-9b15-95c973999cfd\") " Jun 09 05:36:51.460810 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:51.460654 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b9c3186-890b-4a0f-9b15-95c973999cfd-util\") pod \"8b9c3186-890b-4a0f-9b15-95c973999cfd\" (UID: \"8b9c3186-890b-4a0f-9b15-95c973999cfd\") " Jun 09 05:36:51.460810 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:51.460681 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jlrwh\" (UniqueName: \"kubernetes.io/projected/8b9c3186-890b-4a0f-9b15-95c973999cfd-kube-api-access-jlrwh\") pod \"8b9c3186-890b-4a0f-9b15-95c973999cfd\" (UID: \"8b9c3186-890b-4a0f-9b15-95c973999cfd\") " Jun 09 05:36:51.461474 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:51.461437 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b9c3186-890b-4a0f-9b15-95c973999cfd-bundle" (OuterVolumeSpecName: "bundle") pod "8b9c3186-890b-4a0f-9b15-95c973999cfd" (UID: "8b9c3186-890b-4a0f-9b15-95c973999cfd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 05:36:51.462662 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:51.462636 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b9c3186-890b-4a0f-9b15-95c973999cfd-kube-api-access-jlrwh" (OuterVolumeSpecName: "kube-api-access-jlrwh") pod "8b9c3186-890b-4a0f-9b15-95c973999cfd" (UID: "8b9c3186-890b-4a0f-9b15-95c973999cfd"). InnerVolumeSpecName "kube-api-access-jlrwh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 05:36:51.465441 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:51.465420 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b9c3186-890b-4a0f-9b15-95c973999cfd-util" (OuterVolumeSpecName: "util") pod "8b9c3186-890b-4a0f-9b15-95c973999cfd" (UID: "8b9c3186-890b-4a0f-9b15-95c973999cfd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 05:36:51.562098 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:51.562076 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b9c3186-890b-4a0f-9b15-95c973999cfd-util\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:36:51.562098 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:51.562099 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jlrwh\" (UniqueName: \"kubernetes.io/projected/8b9c3186-890b-4a0f-9b15-95c973999cfd-kube-api-access-jlrwh\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:36:51.562236 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:51.562109 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b9c3186-890b-4a0f-9b15-95c973999cfd-bundle\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:36:52.184164 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:52.184137 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-kv94q" Jun 09 05:36:52.186125 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:52.186105 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-dsxmv" Jun 09 05:36:52.243289 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:52.243262 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067sx6k" event={"ID":"8b9c3186-890b-4a0f-9b15-95c973999cfd","Type":"ContainerDied","Data":"14846cdefec814f1b374bbefc5489897cf6cda00539e232541a88af35fa5a98f"} Jun 09 05:36:52.243289 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:52.243284 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067sx6k" Jun 09 05:36:52.243516 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:52.243302 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="14846cdefec814f1b374bbefc5489897cf6cda00539e232541a88af35fa5a98f" Jun 09 05:36:54.196415 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:36:54.196388 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-55f7df5cdd-bl8zr" Jun 09 05:37:02.211452 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:02.211420 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akk5ld"] Jun 09 05:37:02.211926 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:02.211777 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b9c3186-890b-4a0f-9b15-95c973999cfd" containerName="extract" Jun 09 05:37:02.211926 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:02.211788 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b9c3186-890b-4a0f-9b15-95c973999cfd" containerName="extract" Jun 09 05:37:02.211926 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:02.211824 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b9c3186-890b-4a0f-9b15-95c973999cfd" containerName="util" Jun 09 05:37:02.211926 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:02.211833 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b9c3186-890b-4a0f-9b15-95c973999cfd" containerName="util" Jun 09 05:37:02.211926 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:02.211840 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b9c3186-890b-4a0f-9b15-95c973999cfd" containerName="pull" Jun 09 05:37:02.211926 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:02.211846 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b9c3186-890b-4a0f-9b15-95c973999cfd" containerName="pull" Jun 09 05:37:02.211926 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:02.211903 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b9c3186-890b-4a0f-9b15-95c973999cfd" containerName="extract" Jun 09 05:37:02.219134 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:02.219112 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akk5ld" Jun 09 05:37:02.221543 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:02.221520 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 05:37:02.221543 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:02.221530 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-pcs6v\"" Jun 09 05:37:02.221718 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:02.221562 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 05:37:02.225070 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:02.225046 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akk5ld"] Jun 09 05:37:02.247782 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:02.247749 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/160b8846-34bd-413b-b3c2-44b9014c5386-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akk5ld\" (UID: \"160b8846-34bd-413b-b3c2-44b9014c5386\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akk5ld" Jun 09 05:37:02.247948 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:02.247819 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qmgg\" (UniqueName: \"kubernetes.io/projected/160b8846-34bd-413b-b3c2-44b9014c5386-kube-api-access-5qmgg\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akk5ld\" (UID: \"160b8846-34bd-413b-b3c2-44b9014c5386\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akk5ld" Jun 09 05:37:02.247948 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:02.247865 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/160b8846-34bd-413b-b3c2-44b9014c5386-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akk5ld\" (UID: \"160b8846-34bd-413b-b3c2-44b9014c5386\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akk5ld" Jun 09 05:37:02.349195 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:02.349164 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/160b8846-34bd-413b-b3c2-44b9014c5386-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akk5ld\" (UID: \"160b8846-34bd-413b-b3c2-44b9014c5386\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akk5ld" Jun 09 05:37:02.349364 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:02.349207 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qmgg\" (UniqueName: \"kubernetes.io/projected/160b8846-34bd-413b-b3c2-44b9014c5386-kube-api-access-5qmgg\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akk5ld\" (UID: \"160b8846-34bd-413b-b3c2-44b9014c5386\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akk5ld" Jun 09 05:37:02.349364 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:02.349250 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/160b8846-34bd-413b-b3c2-44b9014c5386-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akk5ld\" (UID: \"160b8846-34bd-413b-b3c2-44b9014c5386\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akk5ld" Jun 09 05:37:02.349556 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:02.349520 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/160b8846-34bd-413b-b3c2-44b9014c5386-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akk5ld\" (UID: \"160b8846-34bd-413b-b3c2-44b9014c5386\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akk5ld" Jun 09 05:37:02.349556 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:02.349537 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/160b8846-34bd-413b-b3c2-44b9014c5386-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akk5ld\" (UID: \"160b8846-34bd-413b-b3c2-44b9014c5386\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akk5ld" Jun 09 05:37:02.357439 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:02.357410 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qmgg\" (UniqueName: \"kubernetes.io/projected/160b8846-34bd-413b-b3c2-44b9014c5386-kube-api-access-5qmgg\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akk5ld\" (UID: \"160b8846-34bd-413b-b3c2-44b9014c5386\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akk5ld" Jun 09 05:37:02.441992 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:02.441962 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-85965bc8b6-r96rp"] Jun 09 05:37:02.445415 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:02.445395 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-85965bc8b6-r96rp" Jun 09 05:37:02.447925 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:02.447901 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 09 05:37:02.448047 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:02.447929 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-qj886\"" Jun 09 05:37:02.456154 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:02.456125 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-85965bc8b6-r96rp"] Jun 09 05:37:02.529926 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:02.529828 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akk5ld" Jun 09 05:37:02.551288 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:02.551257 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7q2hd\" (UniqueName: \"kubernetes.io/projected/46835475-9e02-4acc-9987-c3420f9751e9-kube-api-access-7q2hd\") pod \"dashboard-redirect-85965bc8b6-r96rp\" (UID: \"46835475-9e02-4acc-9987-c3420f9751e9\") " pod="opendatahub/dashboard-redirect-85965bc8b6-r96rp" Jun 09 05:37:02.551420 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:02.551304 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/46835475-9e02-4acc-9987-c3420f9751e9-redirect-config\") pod \"dashboard-redirect-85965bc8b6-r96rp\" (UID: \"46835475-9e02-4acc-9987-c3420f9751e9\") " pod="opendatahub/dashboard-redirect-85965bc8b6-r96rp" Jun 09 05:37:02.652558 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:02.652524 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7q2hd\" (UniqueName: \"kubernetes.io/projected/46835475-9e02-4acc-9987-c3420f9751e9-kube-api-access-7q2hd\") pod \"dashboard-redirect-85965bc8b6-r96rp\" (UID: \"46835475-9e02-4acc-9987-c3420f9751e9\") " pod="opendatahub/dashboard-redirect-85965bc8b6-r96rp" Jun 09 05:37:02.652696 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:02.652570 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/46835475-9e02-4acc-9987-c3420f9751e9-redirect-config\") pod \"dashboard-redirect-85965bc8b6-r96rp\" (UID: \"46835475-9e02-4acc-9987-c3420f9751e9\") " pod="opendatahub/dashboard-redirect-85965bc8b6-r96rp" Jun 09 05:37:02.653236 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:02.653218 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/46835475-9e02-4acc-9987-c3420f9751e9-redirect-config\") pod \"dashboard-redirect-85965bc8b6-r96rp\" (UID: \"46835475-9e02-4acc-9987-c3420f9751e9\") " pod="opendatahub/dashboard-redirect-85965bc8b6-r96rp" Jun 09 05:37:02.673100 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:02.673070 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7q2hd\" (UniqueName: \"kubernetes.io/projected/46835475-9e02-4acc-9987-c3420f9751e9-kube-api-access-7q2hd\") pod \"dashboard-redirect-85965bc8b6-r96rp\" (UID: \"46835475-9e02-4acc-9987-c3420f9751e9\") " pod="opendatahub/dashboard-redirect-85965bc8b6-r96rp" Jun 09 05:37:02.681708 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:02.681681 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akk5ld"] Jun 09 05:37:02.683996 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:37:02.683964 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod160b8846_34bd_413b_b3c2_44b9014c5386.slice/crio-f750f3f88a4677f14ae8c4e22cb2145992033783a3a209b2655628b0fdf6e80c WatchSource:0}: Error finding container f750f3f88a4677f14ae8c4e22cb2145992033783a3a209b2655628b0fdf6e80c: Status 404 returned error can't find the container with id f750f3f88a4677f14ae8c4e22cb2145992033783a3a209b2655628b0fdf6e80c Jun 09 05:37:02.756866 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:02.756839 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-85965bc8b6-r96rp" Jun 09 05:37:02.892679 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:02.892651 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-85965bc8b6-r96rp"] Jun 09 05:37:02.894205 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:37:02.894175 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46835475_9e02_4acc_9987_c3420f9751e9.slice/crio-e5980eb93d68abfdbe14c9b24ba460789e9a9cb191dcd40043888d4bb6f586a3 WatchSource:0}: Error finding container e5980eb93d68abfdbe14c9b24ba460789e9a9cb191dcd40043888d4bb6f586a3: Status 404 returned error can't find the container with id e5980eb93d68abfdbe14c9b24ba460789e9a9cb191dcd40043888d4bb6f586a3 Jun 09 05:37:03.304251 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:03.304215 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-85965bc8b6-r96rp" event={"ID":"46835475-9e02-4acc-9987-c3420f9751e9","Type":"ContainerStarted","Data":"e5980eb93d68abfdbe14c9b24ba460789e9a9cb191dcd40043888d4bb6f586a3"} Jun 09 05:37:03.305831 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:03.305808 2564 generic.go:356] "Generic (PLEG): container finished" podID="160b8846-34bd-413b-b3c2-44b9014c5386" containerID="7dc70f09c143e6be04851439b0001b9f44182e8f564bb297a908a2cac94dc654" exitCode=0 Jun 09 05:37:03.305949 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:03.305869 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akk5ld" event={"ID":"160b8846-34bd-413b-b3c2-44b9014c5386","Type":"ContainerDied","Data":"7dc70f09c143e6be04851439b0001b9f44182e8f564bb297a908a2cac94dc654"} Jun 09 05:37:03.305949 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:03.305906 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akk5ld" event={"ID":"160b8846-34bd-413b-b3c2-44b9014c5386","Type":"ContainerStarted","Data":"f750f3f88a4677f14ae8c4e22cb2145992033783a3a209b2655628b0fdf6e80c"} Jun 09 05:37:04.314263 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:04.314231 2564 generic.go:356] "Generic (PLEG): container finished" podID="160b8846-34bd-413b-b3c2-44b9014c5386" containerID="c4749eac2fea500dfbca43752c14ecd5a036559c12a335323f29a63b93b3aec3" exitCode=0 Jun 09 05:37:04.314760 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:04.314293 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akk5ld" event={"ID":"160b8846-34bd-413b-b3c2-44b9014c5386","Type":"ContainerDied","Data":"c4749eac2fea500dfbca43752c14ecd5a036559c12a335323f29a63b93b3aec3"} Jun 09 05:37:05.321105 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:05.321069 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-85965bc8b6-r96rp" event={"ID":"46835475-9e02-4acc-9987-c3420f9751e9","Type":"ContainerStarted","Data":"7ee7c635753552c1a3f572787a3a5da321f5cce562189e540d7950fb6ac6ecf2"} Jun 09 05:37:05.323139 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:05.323112 2564 generic.go:356] "Generic (PLEG): container finished" podID="160b8846-34bd-413b-b3c2-44b9014c5386" containerID="bd76fc72a8a97cdf741ec43b49a7807c011d639dfb96ec7bb8e61180d40f6daf" exitCode=0 Jun 09 05:37:05.323268 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:05.323201 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akk5ld" event={"ID":"160b8846-34bd-413b-b3c2-44b9014c5386","Type":"ContainerDied","Data":"bd76fc72a8a97cdf741ec43b49a7807c011d639dfb96ec7bb8e61180d40f6daf"} Jun 09 05:37:05.337195 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:05.337153 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-85965bc8b6-r96rp" podStartSLOduration=1.3317085880000001 podStartE2EDuration="3.337138735s" totalImagesPullingTime="2.005430147s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 05:37:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 05:37:05.336173964 +0000 UTC m=+475.418825727" watchObservedRunningTime="2026-06-09 05:37:05.337138735 +0000 UTC m=+475.419790505" Jun 09 05:37:06.464073 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:06.464043 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akk5ld" Jun 09 05:37:06.587408 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:06.587322 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/160b8846-34bd-413b-b3c2-44b9014c5386-util\") pod \"160b8846-34bd-413b-b3c2-44b9014c5386\" (UID: \"160b8846-34bd-413b-b3c2-44b9014c5386\") " Jun 09 05:37:06.587408 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:06.587405 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/160b8846-34bd-413b-b3c2-44b9014c5386-bundle\") pod \"160b8846-34bd-413b-b3c2-44b9014c5386\" (UID: \"160b8846-34bd-413b-b3c2-44b9014c5386\") " Jun 09 05:37:06.587591 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:06.587451 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5qmgg\" (UniqueName: \"kubernetes.io/projected/160b8846-34bd-413b-b3c2-44b9014c5386-kube-api-access-5qmgg\") pod \"160b8846-34bd-413b-b3c2-44b9014c5386\" (UID: \"160b8846-34bd-413b-b3c2-44b9014c5386\") " Jun 09 05:37:06.588503 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:06.588465 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/160b8846-34bd-413b-b3c2-44b9014c5386-bundle" (OuterVolumeSpecName: "bundle") pod "160b8846-34bd-413b-b3c2-44b9014c5386" (UID: "160b8846-34bd-413b-b3c2-44b9014c5386"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 05:37:06.589586 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:06.589561 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/160b8846-34bd-413b-b3c2-44b9014c5386-kube-api-access-5qmgg" (OuterVolumeSpecName: "kube-api-access-5qmgg") pod "160b8846-34bd-413b-b3c2-44b9014c5386" (UID: "160b8846-34bd-413b-b3c2-44b9014c5386"). InnerVolumeSpecName "kube-api-access-5qmgg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 05:37:06.595448 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:06.595422 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/160b8846-34bd-413b-b3c2-44b9014c5386-util" (OuterVolumeSpecName: "util") pod "160b8846-34bd-413b-b3c2-44b9014c5386" (UID: "160b8846-34bd-413b-b3c2-44b9014c5386"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 05:37:06.688972 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:06.688920 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/160b8846-34bd-413b-b3c2-44b9014c5386-bundle\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:37:06.688972 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:06.688964 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5qmgg\" (UniqueName: \"kubernetes.io/projected/160b8846-34bd-413b-b3c2-44b9014c5386-kube-api-access-5qmgg\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:37:06.688972 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:06.688975 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/160b8846-34bd-413b-b3c2-44b9014c5386-util\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:37:07.334930 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:07.334897 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akk5ld" Jun 09 05:37:07.335109 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:07.334936 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762akk5ld" event={"ID":"160b8846-34bd-413b-b3c2-44b9014c5386","Type":"ContainerDied","Data":"f750f3f88a4677f14ae8c4e22cb2145992033783a3a209b2655628b0fdf6e80c"} Jun 09 05:37:07.335109 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:07.334997 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f750f3f88a4677f14ae8c4e22cb2145992033783a3a209b2655628b0fdf6e80c" Jun 09 05:37:18.286301 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:18.286272 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795nm9vb"] Jun 09 05:37:18.286762 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:18.286640 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="160b8846-34bd-413b-b3c2-44b9014c5386" containerName="pull" Jun 09 05:37:18.286762 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:18.286650 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="160b8846-34bd-413b-b3c2-44b9014c5386" containerName="pull" Jun 09 05:37:18.286762 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:18.286671 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="160b8846-34bd-413b-b3c2-44b9014c5386" containerName="util" Jun 09 05:37:18.286762 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:18.286677 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="160b8846-34bd-413b-b3c2-44b9014c5386" containerName="util" Jun 09 05:37:18.286762 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:18.286688 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="160b8846-34bd-413b-b3c2-44b9014c5386" containerName="extract" Jun 09 05:37:18.286762 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:18.286694 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="160b8846-34bd-413b-b3c2-44b9014c5386" containerName="extract" Jun 09 05:37:18.286762 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:18.286747 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="160b8846-34bd-413b-b3c2-44b9014c5386" containerName="extract" Jun 09 05:37:18.293164 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:18.293144 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795nm9vb" Jun 09 05:37:18.295606 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:18.295583 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 09 05:37:18.295782 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:18.295763 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-5qdpg\"" Jun 09 05:37:18.295852 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:18.295822 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 09 05:37:18.296022 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:18.296009 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 09 05:37:18.301277 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:18.301258 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795nm9vb"] Jun 09 05:37:18.386260 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:18.386225 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c659facb-644a-4c14-9ccc-2152877a75bb-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795nm9vb\" (UID: \"c659facb-644a-4c14-9ccc-2152877a75bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795nm9vb" Jun 09 05:37:18.386260 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:18.386253 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c659facb-644a-4c14-9ccc-2152877a75bb-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795nm9vb\" (UID: \"c659facb-644a-4c14-9ccc-2152877a75bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795nm9vb" Jun 09 05:37:18.386441 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:18.386276 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c659facb-644a-4c14-9ccc-2152877a75bb-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795nm9vb\" (UID: \"c659facb-644a-4c14-9ccc-2152877a75bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795nm9vb" Jun 09 05:37:18.386441 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:18.386377 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c659facb-644a-4c14-9ccc-2152877a75bb-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795nm9vb\" (UID: \"c659facb-644a-4c14-9ccc-2152877a75bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795nm9vb" Jun 09 05:37:18.386441 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:18.386403 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c659facb-644a-4c14-9ccc-2152877a75bb-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795nm9vb\" (UID: \"c659facb-644a-4c14-9ccc-2152877a75bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795nm9vb" Jun 09 05:37:18.386441 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:18.386430 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcs6d\" (UniqueName: \"kubernetes.io/projected/c659facb-644a-4c14-9ccc-2152877a75bb-kube-api-access-zcs6d\") pod \"data-science-gateway-data-science-gateway-class-74759f9795nm9vb\" (UID: \"c659facb-644a-4c14-9ccc-2152877a75bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795nm9vb" Jun 09 05:37:18.386658 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:18.386488 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c659facb-644a-4c14-9ccc-2152877a75bb-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795nm9vb\" (UID: \"c659facb-644a-4c14-9ccc-2152877a75bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795nm9vb" Jun 09 05:37:18.386658 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:18.386518 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c659facb-644a-4c14-9ccc-2152877a75bb-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795nm9vb\" (UID: \"c659facb-644a-4c14-9ccc-2152877a75bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795nm9vb" Jun 09 05:37:18.386658 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:18.386554 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c659facb-644a-4c14-9ccc-2152877a75bb-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795nm9vb\" (UID: \"c659facb-644a-4c14-9ccc-2152877a75bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795nm9vb" Jun 09 05:37:18.487359 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:18.487335 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcs6d\" (UniqueName: \"kubernetes.io/projected/c659facb-644a-4c14-9ccc-2152877a75bb-kube-api-access-zcs6d\") pod \"data-science-gateway-data-science-gateway-class-74759f9795nm9vb\" (UID: \"c659facb-644a-4c14-9ccc-2152877a75bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795nm9vb" Jun 09 05:37:18.487479 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:18.487366 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c659facb-644a-4c14-9ccc-2152877a75bb-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795nm9vb\" (UID: \"c659facb-644a-4c14-9ccc-2152877a75bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795nm9vb" Jun 09 05:37:18.487479 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:18.487386 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c659facb-644a-4c14-9ccc-2152877a75bb-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795nm9vb\" (UID: \"c659facb-644a-4c14-9ccc-2152877a75bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795nm9vb" Jun 09 05:37:18.487479 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:18.487406 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c659facb-644a-4c14-9ccc-2152877a75bb-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795nm9vb\" (UID: \"c659facb-644a-4c14-9ccc-2152877a75bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795nm9vb" Jun 09 05:37:18.487656 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:18.487589 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c659facb-644a-4c14-9ccc-2152877a75bb-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795nm9vb\" (UID: \"c659facb-644a-4c14-9ccc-2152877a75bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795nm9vb" Jun 09 05:37:18.487656 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:18.487626 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c659facb-644a-4c14-9ccc-2152877a75bb-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795nm9vb\" (UID: \"c659facb-644a-4c14-9ccc-2152877a75bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795nm9vb" Jun 09 05:37:18.487759 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:18.487660 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c659facb-644a-4c14-9ccc-2152877a75bb-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795nm9vb\" (UID: \"c659facb-644a-4c14-9ccc-2152877a75bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795nm9vb" Jun 09 05:37:18.487759 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:18.487731 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c659facb-644a-4c14-9ccc-2152877a75bb-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795nm9vb\" (UID: \"c659facb-644a-4c14-9ccc-2152877a75bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795nm9vb" Jun 09 05:37:18.488051 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:18.487767 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c659facb-644a-4c14-9ccc-2152877a75bb-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795nm9vb\" (UID: \"c659facb-644a-4c14-9ccc-2152877a75bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795nm9vb" Jun 09 05:37:18.488051 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:18.487871 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c659facb-644a-4c14-9ccc-2152877a75bb-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795nm9vb\" (UID: \"c659facb-644a-4c14-9ccc-2152877a75bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795nm9vb" Jun 09 05:37:18.488051 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:18.487996 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c659facb-644a-4c14-9ccc-2152877a75bb-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795nm9vb\" (UID: \"c659facb-644a-4c14-9ccc-2152877a75bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795nm9vb" Jun 09 05:37:18.488221 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:18.488103 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c659facb-644a-4c14-9ccc-2152877a75bb-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795nm9vb\" (UID: \"c659facb-644a-4c14-9ccc-2152877a75bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795nm9vb" Jun 09 05:37:18.488381 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:18.488353 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c659facb-644a-4c14-9ccc-2152877a75bb-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795nm9vb\" (UID: \"c659facb-644a-4c14-9ccc-2152877a75bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795nm9vb" Jun 09 05:37:18.488497 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:18.488357 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c659facb-644a-4c14-9ccc-2152877a75bb-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795nm9vb\" (UID: \"c659facb-644a-4c14-9ccc-2152877a75bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795nm9vb" Jun 09 05:37:18.489907 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:18.489868 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c659facb-644a-4c14-9ccc-2152877a75bb-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795nm9vb\" (UID: \"c659facb-644a-4c14-9ccc-2152877a75bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795nm9vb" Jun 09 05:37:18.490145 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:18.490128 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c659facb-644a-4c14-9ccc-2152877a75bb-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795nm9vb\" (UID: \"c659facb-644a-4c14-9ccc-2152877a75bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795nm9vb" Jun 09 05:37:18.495226 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:18.495209 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcs6d\" (UniqueName: \"kubernetes.io/projected/c659facb-644a-4c14-9ccc-2152877a75bb-kube-api-access-zcs6d\") pod \"data-science-gateway-data-science-gateway-class-74759f9795nm9vb\" (UID: \"c659facb-644a-4c14-9ccc-2152877a75bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795nm9vb" Jun 09 05:37:18.495312 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:18.495291 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c659facb-644a-4c14-9ccc-2152877a75bb-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795nm9vb\" (UID: \"c659facb-644a-4c14-9ccc-2152877a75bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795nm9vb" Jun 09 05:37:18.605030 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:18.604979 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795nm9vb" Jun 09 05:37:18.740807 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:18.740764 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795nm9vb"] Jun 09 05:37:18.741991 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:37:18.741966 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc659facb_644a_4c14_9ccc_2152877a75bb.slice/crio-965226ffcddec5748f89519ef078080bfc2d661c4fb55253b3cb5d7c2e7d16a9 WatchSource:0}: Error finding container 965226ffcddec5748f89519ef078080bfc2d661c4fb55253b3cb5d7c2e7d16a9: Status 404 returned error can't find the container with id 965226ffcddec5748f89519ef078080bfc2d661c4fb55253b3cb5d7c2e7d16a9 Jun 09 05:37:19.400081 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:19.400043 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795nm9vb" event={"ID":"c659facb-644a-4c14-9ccc-2152877a75bb","Type":"ContainerStarted","Data":"965226ffcddec5748f89519ef078080bfc2d661c4fb55253b3cb5d7c2e7d16a9"} Jun 09 05:37:21.225605 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:21.225571 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 09 05:37:21.225867 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:21.225651 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 09 05:37:21.225867 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:21.225678 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 09 05:37:21.415335 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:21.415297 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795nm9vb" event={"ID":"c659facb-644a-4c14-9ccc-2152877a75bb","Type":"ContainerStarted","Data":"d798e5acca1c5d3f724f9c45ea025a04bf69c58d339e818c87711d88df81bbd2"} Jun 09 05:37:21.435578 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:21.435521 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795nm9vb" podStartSLOduration=0.954288853 podStartE2EDuration="3.435500695s" totalImagesPullingTime="2.481211842s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 05:37:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 05:37:21.432713044 +0000 UTC m=+491.515364807" watchObservedRunningTime="2026-06-09 05:37:21.435500695 +0000 UTC m=+491.518152434" Jun 09 05:37:21.605385 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:21.605356 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795nm9vb" Jun 09 05:37:22.610068 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:22.610037 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795nm9vb" Jun 09 05:37:23.424610 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:23.424576 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795nm9vb" Jun 09 05:37:23.425596 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:23.425580 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795nm9vb" Jun 09 05:37:36.583177 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:36.583145 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pdsq4"] Jun 09 05:37:36.586468 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:36.586430 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-pdsq4" Jun 09 05:37:36.589082 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:36.589056 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 09 05:37:36.589238 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:36.589102 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-b42mt\"" Jun 09 05:37:36.589728 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:36.589705 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 09 05:37:36.595573 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:36.595557 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pdsq4"] Jun 09 05:37:36.734753 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:36.734726 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqrz5\" (UniqueName: \"kubernetes.io/projected/2b221ca3-778a-4e4e-b84c-c30dee549880-kube-api-access-fqrz5\") pod \"kuadrant-operator-catalog-pdsq4\" (UID: \"2b221ca3-778a-4e4e-b84c-c30dee549880\") " pod="kuadrant-system/kuadrant-operator-catalog-pdsq4" Jun 09 05:37:36.835651 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:36.835576 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqrz5\" (UniqueName: \"kubernetes.io/projected/2b221ca3-778a-4e4e-b84c-c30dee549880-kube-api-access-fqrz5\") pod \"kuadrant-operator-catalog-pdsq4\" (UID: \"2b221ca3-778a-4e4e-b84c-c30dee549880\") " pod="kuadrant-system/kuadrant-operator-catalog-pdsq4" Jun 09 05:37:36.846688 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:36.846660 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqrz5\" (UniqueName: \"kubernetes.io/projected/2b221ca3-778a-4e4e-b84c-c30dee549880-kube-api-access-fqrz5\") pod \"kuadrant-operator-catalog-pdsq4\" (UID: \"2b221ca3-778a-4e4e-b84c-c30dee549880\") " pod="kuadrant-system/kuadrant-operator-catalog-pdsq4" Jun 09 05:37:36.899757 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:36.899724 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-pdsq4" Jun 09 05:37:37.030932 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:37.030901 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pdsq4"] Jun 09 05:37:37.032332 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:37:37.032300 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b221ca3_778a_4e4e_b84c_c30dee549880.slice/crio-8c3c792930330d601d333a85320eda7be9bf80f1d6cc27e6af425fd62aa3e065 WatchSource:0}: Error finding container 8c3c792930330d601d333a85320eda7be9bf80f1d6cc27e6af425fd62aa3e065: Status 404 returned error can't find the container with id 8c3c792930330d601d333a85320eda7be9bf80f1d6cc27e6af425fd62aa3e065 Jun 09 05:37:37.178964 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:37.178878 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pdsq4"] Jun 09 05:37:37.194287 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:37.194260 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-55hlq"] Jun 09 05:37:37.197420 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:37.197404 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-55hlq" Jun 09 05:37:37.204243 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:37.204221 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-55hlq"] Jun 09 05:37:37.341348 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:37.341325 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bb5b\" (UniqueName: \"kubernetes.io/projected/52720fc9-54ee-4eea-bc9a-8578b31277e6-kube-api-access-4bb5b\") pod \"kuadrant-operator-catalog-55hlq\" (UID: \"52720fc9-54ee-4eea-bc9a-8578b31277e6\") " pod="kuadrant-system/kuadrant-operator-catalog-55hlq" Jun 09 05:37:37.442638 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:37.442582 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bb5b\" (UniqueName: \"kubernetes.io/projected/52720fc9-54ee-4eea-bc9a-8578b31277e6-kube-api-access-4bb5b\") pod \"kuadrant-operator-catalog-55hlq\" (UID: \"52720fc9-54ee-4eea-bc9a-8578b31277e6\") " pod="kuadrant-system/kuadrant-operator-catalog-55hlq" Jun 09 05:37:37.450735 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:37.450713 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bb5b\" (UniqueName: \"kubernetes.io/projected/52720fc9-54ee-4eea-bc9a-8578b31277e6-kube-api-access-4bb5b\") pod \"kuadrant-operator-catalog-55hlq\" (UID: \"52720fc9-54ee-4eea-bc9a-8578b31277e6\") " pod="kuadrant-system/kuadrant-operator-catalog-55hlq" Jun 09 05:37:37.504468 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:37.504441 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-pdsq4" event={"ID":"2b221ca3-778a-4e4e-b84c-c30dee549880","Type":"ContainerStarted","Data":"8c3c792930330d601d333a85320eda7be9bf80f1d6cc27e6af425fd62aa3e065"} Jun 09 05:37:37.507986 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:37.507754 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-55hlq" Jun 09 05:37:37.769089 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:37.769065 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-55hlq"] Jun 09 05:37:37.794889 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:37:37.794860 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52720fc9_54ee_4eea_bc9a_8578b31277e6.slice/crio-49f4006c494197064f1153f0fa44462fb86a1047047e100aea85d99de443ed34 WatchSource:0}: Error finding container 49f4006c494197064f1153f0fa44462fb86a1047047e100aea85d99de443ed34: Status 404 returned error can't find the container with id 49f4006c494197064f1153f0fa44462fb86a1047047e100aea85d99de443ed34 Jun 09 05:37:38.512302 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:38.512261 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-55hlq" event={"ID":"52720fc9-54ee-4eea-bc9a-8578b31277e6","Type":"ContainerStarted","Data":"49f4006c494197064f1153f0fa44462fb86a1047047e100aea85d99de443ed34"} Jun 09 05:37:39.518756 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:39.518721 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-55hlq" event={"ID":"52720fc9-54ee-4eea-bc9a-8578b31277e6","Type":"ContainerStarted","Data":"1ffaf78c79e468dfa729a13ea3f84aef367ea86be1357833bab3061a6c0b3bb2"} Jun 09 05:37:39.520266 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:39.520238 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-pdsq4" event={"ID":"2b221ca3-778a-4e4e-b84c-c30dee549880","Type":"ContainerStarted","Data":"3209ae6572ef8c6aabf497d1285779e57e1506b1186337e6895c28003131c354"} Jun 09 05:37:39.520380 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:39.520278 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-pdsq4" podUID="2b221ca3-778a-4e4e-b84c-c30dee549880" containerName="registry-server" containerID="cri-o://3209ae6572ef8c6aabf497d1285779e57e1506b1186337e6895c28003131c354" gracePeriod=2 Jun 09 05:37:39.533991 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:39.533891 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-55hlq" podStartSLOduration=1.364241323 podStartE2EDuration="2.53387204s" totalImagesPullingTime="1.169630717s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 05:37:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 05:37:39.532043275 +0000 UTC m=+509.614695036" watchObservedRunningTime="2026-06-09 05:37:39.53387204 +0000 UTC m=+509.616523777" Jun 09 05:37:39.547822 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:39.544764 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-pdsq4" podStartSLOduration=1.615154966 podStartE2EDuration="3.544741396s" totalImagesPullingTime="1.92958643s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 05:37:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 05:37:39.544637059 +0000 UTC m=+509.627288796" watchObservedRunningTime="2026-06-09 05:37:39.544741396 +0000 UTC m=+509.627393132" Jun 09 05:37:39.763548 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:39.763527 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-pdsq4" Jun 09 05:37:39.864742 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:39.864718 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fqrz5\" (UniqueName: \"kubernetes.io/projected/2b221ca3-778a-4e4e-b84c-c30dee549880-kube-api-access-fqrz5\") pod \"2b221ca3-778a-4e4e-b84c-c30dee549880\" (UID: \"2b221ca3-778a-4e4e-b84c-c30dee549880\") " Jun 09 05:37:39.866766 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:39.866744 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b221ca3-778a-4e4e-b84c-c30dee549880-kube-api-access-fqrz5" (OuterVolumeSpecName: "kube-api-access-fqrz5") pod "2b221ca3-778a-4e4e-b84c-c30dee549880" (UID: "2b221ca3-778a-4e4e-b84c-c30dee549880"). InnerVolumeSpecName "kube-api-access-fqrz5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 05:37:39.966328 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:39.966295 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fqrz5\" (UniqueName: \"kubernetes.io/projected/2b221ca3-778a-4e4e-b84c-c30dee549880-kube-api-access-fqrz5\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:37:40.527332 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:40.527295 2564 generic.go:356] "Generic (PLEG): container finished" podID="2b221ca3-778a-4e4e-b84c-c30dee549880" containerID="3209ae6572ef8c6aabf497d1285779e57e1506b1186337e6895c28003131c354" exitCode=0 Jun 09 05:37:40.527710 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:40.527358 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-pdsq4" Jun 09 05:37:40.527710 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:40.527374 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-pdsq4" event={"ID":"2b221ca3-778a-4e4e-b84c-c30dee549880","Type":"ContainerDied","Data":"3209ae6572ef8c6aabf497d1285779e57e1506b1186337e6895c28003131c354"} Jun 09 05:37:40.527710 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:40.527446 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-pdsq4" event={"ID":"2b221ca3-778a-4e4e-b84c-c30dee549880","Type":"ContainerDied","Data":"8c3c792930330d601d333a85320eda7be9bf80f1d6cc27e6af425fd62aa3e065"} Jun 09 05:37:40.527710 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:40.527465 2564 scope.go:117] "RemoveContainer" containerID="3209ae6572ef8c6aabf497d1285779e57e1506b1186337e6895c28003131c354" Jun 09 05:37:40.536963 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:40.536945 2564 scope.go:117] "RemoveContainer" containerID="3209ae6572ef8c6aabf497d1285779e57e1506b1186337e6895c28003131c354" Jun 09 05:37:40.537241 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:37:40.537220 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3209ae6572ef8c6aabf497d1285779e57e1506b1186337e6895c28003131c354\": container with ID starting with 3209ae6572ef8c6aabf497d1285779e57e1506b1186337e6895c28003131c354 not found: ID does not exist" containerID="3209ae6572ef8c6aabf497d1285779e57e1506b1186337e6895c28003131c354" Jun 09 05:37:40.537327 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:40.537246 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3209ae6572ef8c6aabf497d1285779e57e1506b1186337e6895c28003131c354"} err="failed to get container status \"3209ae6572ef8c6aabf497d1285779e57e1506b1186337e6895c28003131c354\": rpc error: code = NotFound desc = could not find container \"3209ae6572ef8c6aabf497d1285779e57e1506b1186337e6895c28003131c354\": container with ID starting with 3209ae6572ef8c6aabf497d1285779e57e1506b1186337e6895c28003131c354 not found: ID does not exist" Jun 09 05:37:40.542217 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:40.542195 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pdsq4"] Jun 09 05:37:40.547700 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:40.547680 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pdsq4"] Jun 09 05:37:42.346030 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:42.345997 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b221ca3-778a-4e4e-b84c-c30dee549880" path="/var/lib/kubelet/pods/2b221ca3-778a-4e4e-b84c-c30dee549880/volumes" Jun 09 05:37:47.508095 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:47.508060 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-55hlq" Jun 09 05:37:47.508553 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:47.508124 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-55hlq" Jun 09 05:37:47.530495 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:47.530467 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-55hlq" Jun 09 05:37:47.585819 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:47.585775 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-55hlq" Jun 09 05:37:52.483117 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:52.483081 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e079qrm"] Jun 09 05:37:52.483597 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:52.483442 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b221ca3-778a-4e4e-b84c-c30dee549880" containerName="registry-server" Jun 09 05:37:52.483597 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:52.483452 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b221ca3-778a-4e4e-b84c-c30dee549880" containerName="registry-server" Jun 09 05:37:52.483597 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:52.483513 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b221ca3-778a-4e4e-b84c-c30dee549880" containerName="registry-server" Jun 09 05:37:52.486738 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:52.486717 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e079qrm" Jun 09 05:37:52.488996 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:52.488978 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-kcv5g\"" Jun 09 05:37:52.496528 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:52.496506 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e079qrm"] Jun 09 05:37:52.565881 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:52.565844 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d2c4bf80-db15-435e-9806-46844ba1132e-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e079qrm\" (UID: \"d2c4bf80-db15-435e-9806-46844ba1132e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e079qrm" Jun 09 05:37:52.566071 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:52.565910 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldk9x\" (UniqueName: \"kubernetes.io/projected/d2c4bf80-db15-435e-9806-46844ba1132e-kube-api-access-ldk9x\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e079qrm\" (UID: \"d2c4bf80-db15-435e-9806-46844ba1132e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e079qrm" Jun 09 05:37:52.566071 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:52.565956 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d2c4bf80-db15-435e-9806-46844ba1132e-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e079qrm\" (UID: \"d2c4bf80-db15-435e-9806-46844ba1132e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e079qrm" Jun 09 05:37:52.667143 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:52.667091 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldk9x\" (UniqueName: \"kubernetes.io/projected/d2c4bf80-db15-435e-9806-46844ba1132e-kube-api-access-ldk9x\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e079qrm\" (UID: \"d2c4bf80-db15-435e-9806-46844ba1132e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e079qrm" Jun 09 05:37:52.667331 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:52.667238 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d2c4bf80-db15-435e-9806-46844ba1132e-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e079qrm\" (UID: \"d2c4bf80-db15-435e-9806-46844ba1132e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e079qrm" Jun 09 05:37:52.667331 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:52.667294 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d2c4bf80-db15-435e-9806-46844ba1132e-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e079qrm\" (UID: \"d2c4bf80-db15-435e-9806-46844ba1132e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e079qrm" Jun 09 05:37:52.667621 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:52.667605 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d2c4bf80-db15-435e-9806-46844ba1132e-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e079qrm\" (UID: \"d2c4bf80-db15-435e-9806-46844ba1132e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e079qrm" Jun 09 05:37:52.667659 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:52.667635 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d2c4bf80-db15-435e-9806-46844ba1132e-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e079qrm\" (UID: \"d2c4bf80-db15-435e-9806-46844ba1132e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e079qrm" Jun 09 05:37:52.674663 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:52.674636 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldk9x\" (UniqueName: \"kubernetes.io/projected/d2c4bf80-db15-435e-9806-46844ba1132e-kube-api-access-ldk9x\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e079qrm\" (UID: \"d2c4bf80-db15-435e-9806-46844ba1132e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e079qrm" Jun 09 05:37:52.796840 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:52.796787 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e079qrm" Jun 09 05:37:52.925035 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:52.924997 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e079qrm"] Jun 09 05:37:52.926057 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:37:52.926031 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2c4bf80_db15_435e_9806_46844ba1132e.slice/crio-ee757b827ea46f01022e0d10222c7ed11862bed389ca098932aca03ef0d8578a WatchSource:0}: Error finding container ee757b827ea46f01022e0d10222c7ed11862bed389ca098932aca03ef0d8578a: Status 404 returned error can't find the container with id ee757b827ea46f01022e0d10222c7ed11862bed389ca098932aca03ef0d8578a Jun 09 05:37:53.082125 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:53.082057 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14t7rg"] Jun 09 05:37:53.085922 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:53.085906 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14t7rg" Jun 09 05:37:53.092280 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:53.092258 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14t7rg"] Jun 09 05:37:53.172201 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:53.172170 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/62c203f8-168f-4c1e-9867-c6ac44d61757-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14t7rg\" (UID: \"62c203f8-168f-4c1e-9867-c6ac44d61757\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14t7rg" Jun 09 05:37:53.172391 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:53.172212 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5n7k\" (UniqueName: \"kubernetes.io/projected/62c203f8-168f-4c1e-9867-c6ac44d61757-kube-api-access-z5n7k\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14t7rg\" (UID: \"62c203f8-168f-4c1e-9867-c6ac44d61757\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14t7rg" Jun 09 05:37:53.172391 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:53.172268 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/62c203f8-168f-4c1e-9867-c6ac44d61757-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14t7rg\" (UID: \"62c203f8-168f-4c1e-9867-c6ac44d61757\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14t7rg" Jun 09 05:37:53.273185 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:53.273135 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5n7k\" (UniqueName: \"kubernetes.io/projected/62c203f8-168f-4c1e-9867-c6ac44d61757-kube-api-access-z5n7k\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14t7rg\" (UID: \"62c203f8-168f-4c1e-9867-c6ac44d61757\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14t7rg" Jun 09 05:37:53.273391 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:53.273202 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/62c203f8-168f-4c1e-9867-c6ac44d61757-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14t7rg\" (UID: \"62c203f8-168f-4c1e-9867-c6ac44d61757\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14t7rg" Jun 09 05:37:53.273391 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:53.273297 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/62c203f8-168f-4c1e-9867-c6ac44d61757-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14t7rg\" (UID: \"62c203f8-168f-4c1e-9867-c6ac44d61757\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14t7rg" Jun 09 05:37:53.273653 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:53.273630 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/62c203f8-168f-4c1e-9867-c6ac44d61757-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14t7rg\" (UID: \"62c203f8-168f-4c1e-9867-c6ac44d61757\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14t7rg" Jun 09 05:37:53.273726 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:53.273663 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/62c203f8-168f-4c1e-9867-c6ac44d61757-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14t7rg\" (UID: \"62c203f8-168f-4c1e-9867-c6ac44d61757\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14t7rg" Jun 09 05:37:53.280756 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:53.280735 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5n7k\" (UniqueName: \"kubernetes.io/projected/62c203f8-168f-4c1e-9867-c6ac44d61757-kube-api-access-z5n7k\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14t7rg\" (UID: \"62c203f8-168f-4c1e-9867-c6ac44d61757\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14t7rg" Jun 09 05:37:53.396308 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:53.396226 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14t7rg" Jun 09 05:37:53.485382 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:53.485352 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zbjqr"] Jun 09 05:37:53.490258 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:53.490237 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zbjqr" Jun 09 05:37:53.497253 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:53.497217 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zbjqr"] Jun 09 05:37:53.529080 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:53.529059 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14t7rg"] Jun 09 05:37:53.530436 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:37:53.530408 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62c203f8_168f_4c1e_9867_c6ac44d61757.slice/crio-64ff1e9824e14ac502207456f53c803d37db66f341f7db7a6140b51924c74b58 WatchSource:0}: Error finding container 64ff1e9824e14ac502207456f53c803d37db66f341f7db7a6140b51924c74b58: Status 404 returned error can't find the container with id 64ff1e9824e14ac502207456f53c803d37db66f341f7db7a6140b51924c74b58 Jun 09 05:37:53.574945 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:53.574922 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/867fbd6e-5cde-48ef-bfb0-163b0efdd429-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zbjqr\" (UID: \"867fbd6e-5cde-48ef-bfb0-163b0efdd429\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zbjqr" Jun 09 05:37:53.575034 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:53.575011 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/867fbd6e-5cde-48ef-bfb0-163b0efdd429-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zbjqr\" (UID: \"867fbd6e-5cde-48ef-bfb0-163b0efdd429\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zbjqr" Jun 09 05:37:53.575082 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:53.575039 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gthr\" (UniqueName: \"kubernetes.io/projected/867fbd6e-5cde-48ef-bfb0-163b0efdd429-kube-api-access-5gthr\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zbjqr\" (UID: \"867fbd6e-5cde-48ef-bfb0-163b0efdd429\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zbjqr" Jun 09 05:37:53.598176 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:53.598152 2564 generic.go:356] "Generic (PLEG): container finished" podID="d2c4bf80-db15-435e-9806-46844ba1132e" containerID="9c90cdcff011fee948d0884a80a45a3e7ffea1751c84a1d537b89f7828199f53" exitCode=0 Jun 09 05:37:53.598296 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:53.598235 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e079qrm" event={"ID":"d2c4bf80-db15-435e-9806-46844ba1132e","Type":"ContainerDied","Data":"9c90cdcff011fee948d0884a80a45a3e7ffea1751c84a1d537b89f7828199f53"} Jun 09 05:37:53.598296 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:53.598278 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e079qrm" event={"ID":"d2c4bf80-db15-435e-9806-46844ba1132e","Type":"ContainerStarted","Data":"ee757b827ea46f01022e0d10222c7ed11862bed389ca098932aca03ef0d8578a"} Jun 09 05:37:53.599898 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:53.599879 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14t7rg" event={"ID":"62c203f8-168f-4c1e-9867-c6ac44d61757","Type":"ContainerStarted","Data":"2271247eb9509cc23a0d7e3ed0f7e93bb3ededb7f7c0bbfc1f596b5ebf6aa5eb"} Jun 09 05:37:53.599980 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:53.599919 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14t7rg" event={"ID":"62c203f8-168f-4c1e-9867-c6ac44d61757","Type":"ContainerStarted","Data":"64ff1e9824e14ac502207456f53c803d37db66f341f7db7a6140b51924c74b58"} Jun 09 05:37:53.675855 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:53.675771 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/867fbd6e-5cde-48ef-bfb0-163b0efdd429-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zbjqr\" (UID: \"867fbd6e-5cde-48ef-bfb0-163b0efdd429\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zbjqr" Jun 09 05:37:53.675855 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:53.675815 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gthr\" (UniqueName: \"kubernetes.io/projected/867fbd6e-5cde-48ef-bfb0-163b0efdd429-kube-api-access-5gthr\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zbjqr\" (UID: \"867fbd6e-5cde-48ef-bfb0-163b0efdd429\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zbjqr" Jun 09 05:37:53.676076 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:53.675953 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/867fbd6e-5cde-48ef-bfb0-163b0efdd429-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zbjqr\" (UID: \"867fbd6e-5cde-48ef-bfb0-163b0efdd429\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zbjqr" Jun 09 05:37:53.676221 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:53.676199 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/867fbd6e-5cde-48ef-bfb0-163b0efdd429-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zbjqr\" (UID: \"867fbd6e-5cde-48ef-bfb0-163b0efdd429\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zbjqr" Jun 09 05:37:53.676391 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:53.676373 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/867fbd6e-5cde-48ef-bfb0-163b0efdd429-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zbjqr\" (UID: \"867fbd6e-5cde-48ef-bfb0-163b0efdd429\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zbjqr" Jun 09 05:37:53.683719 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:53.683702 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gthr\" (UniqueName: \"kubernetes.io/projected/867fbd6e-5cde-48ef-bfb0-163b0efdd429-kube-api-access-5gthr\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zbjqr\" (UID: \"867fbd6e-5cde-48ef-bfb0-163b0efdd429\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zbjqr" Jun 09 05:37:53.803357 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:53.803311 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zbjqr" Jun 09 05:37:53.885216 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:53.885175 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592g9t2"] Jun 09 05:37:53.890400 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:53.890380 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592g9t2" Jun 09 05:37:53.895143 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:53.895119 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592g9t2"] Jun 09 05:37:53.937442 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:53.937419 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zbjqr"] Jun 09 05:37:53.938818 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:37:53.938776 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod867fbd6e_5cde_48ef_bfb0_163b0efdd429.slice/crio-a7478bc5ea2dc1f121a04f451f2269ff42f98ed483dd7bba664ac5fb90d4b8ce WatchSource:0}: Error finding container a7478bc5ea2dc1f121a04f451f2269ff42f98ed483dd7bba664ac5fb90d4b8ce: Status 404 returned error can't find the container with id a7478bc5ea2dc1f121a04f451f2269ff42f98ed483dd7bba664ac5fb90d4b8ce Jun 09 05:37:53.979515 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:53.979483 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8sgq8\" (UniqueName: \"kubernetes.io/projected/919ca8ed-5772-44d2-899c-2aa46bcada61-kube-api-access-8sgq8\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592g9t2\" (UID: \"919ca8ed-5772-44d2-899c-2aa46bcada61\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592g9t2" Jun 09 05:37:53.979641 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:53.979549 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/919ca8ed-5772-44d2-899c-2aa46bcada61-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592g9t2\" (UID: \"919ca8ed-5772-44d2-899c-2aa46bcada61\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592g9t2" Jun 09 05:37:53.979641 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:53.979575 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/919ca8ed-5772-44d2-899c-2aa46bcada61-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592g9t2\" (UID: \"919ca8ed-5772-44d2-899c-2aa46bcada61\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592g9t2" Jun 09 05:37:54.080863 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:54.080828 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/919ca8ed-5772-44d2-899c-2aa46bcada61-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592g9t2\" (UID: \"919ca8ed-5772-44d2-899c-2aa46bcada61\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592g9t2" Jun 09 05:37:54.080863 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:54.080862 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/919ca8ed-5772-44d2-899c-2aa46bcada61-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592g9t2\" (UID: \"919ca8ed-5772-44d2-899c-2aa46bcada61\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592g9t2" Jun 09 05:37:54.081103 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:54.080922 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8sgq8\" (UniqueName: \"kubernetes.io/projected/919ca8ed-5772-44d2-899c-2aa46bcada61-kube-api-access-8sgq8\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592g9t2\" (UID: \"919ca8ed-5772-44d2-899c-2aa46bcada61\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592g9t2" Jun 09 05:37:54.081197 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:54.081174 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/919ca8ed-5772-44d2-899c-2aa46bcada61-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592g9t2\" (UID: \"919ca8ed-5772-44d2-899c-2aa46bcada61\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592g9t2" Jun 09 05:37:54.081279 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:54.081257 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/919ca8ed-5772-44d2-899c-2aa46bcada61-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592g9t2\" (UID: \"919ca8ed-5772-44d2-899c-2aa46bcada61\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592g9t2" Jun 09 05:37:54.088289 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:54.088264 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8sgq8\" (UniqueName: \"kubernetes.io/projected/919ca8ed-5772-44d2-899c-2aa46bcada61-kube-api-access-8sgq8\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592g9t2\" (UID: \"919ca8ed-5772-44d2-899c-2aa46bcada61\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592g9t2" Jun 09 05:37:54.203726 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:54.203643 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592g9t2" Jun 09 05:37:54.358109 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:54.358081 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592g9t2"] Jun 09 05:37:54.607019 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:54.606986 2564 generic.go:356] "Generic (PLEG): container finished" podID="d2c4bf80-db15-435e-9806-46844ba1132e" containerID="a9d54030b758128ae1150cdb4a67eb6572a9154f3590e007f61fae47c4b31f2a" exitCode=0 Jun 09 05:37:54.607451 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:54.607056 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e079qrm" event={"ID":"d2c4bf80-db15-435e-9806-46844ba1132e","Type":"ContainerDied","Data":"a9d54030b758128ae1150cdb4a67eb6572a9154f3590e007f61fae47c4b31f2a"} Jun 09 05:37:54.608619 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:54.608596 2564 generic.go:356] "Generic (PLEG): container finished" podID="867fbd6e-5cde-48ef-bfb0-163b0efdd429" containerID="e92e77653a7d6d10c96a71a4a1da54563ec619e9f3a0bb76155861e25a3c4524" exitCode=0 Jun 09 05:37:54.608746 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:54.608678 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zbjqr" event={"ID":"867fbd6e-5cde-48ef-bfb0-163b0efdd429","Type":"ContainerDied","Data":"e92e77653a7d6d10c96a71a4a1da54563ec619e9f3a0bb76155861e25a3c4524"} Jun 09 05:37:54.608746 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:54.608728 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zbjqr" event={"ID":"867fbd6e-5cde-48ef-bfb0-163b0efdd429","Type":"ContainerStarted","Data":"a7478bc5ea2dc1f121a04f451f2269ff42f98ed483dd7bba664ac5fb90d4b8ce"} Jun 09 05:37:54.610312 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:54.610293 2564 generic.go:356] "Generic (PLEG): container finished" podID="919ca8ed-5772-44d2-899c-2aa46bcada61" containerID="77a77850af76c7c37b5cfd565b58d87cff17f96e54485551ecbeebfb5ddd47cd" exitCode=0 Jun 09 05:37:54.610426 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:54.610407 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592g9t2" event={"ID":"919ca8ed-5772-44d2-899c-2aa46bcada61","Type":"ContainerDied","Data":"77a77850af76c7c37b5cfd565b58d87cff17f96e54485551ecbeebfb5ddd47cd"} Jun 09 05:37:54.610492 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:54.610471 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592g9t2" event={"ID":"919ca8ed-5772-44d2-899c-2aa46bcada61","Type":"ContainerStarted","Data":"a33977a0ff54b06c099efa33456f938f0f2daecec9418cc0f2c2b4280aa36e7b"} Jun 09 05:37:54.612104 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:54.612079 2564 generic.go:356] "Generic (PLEG): container finished" podID="62c203f8-168f-4c1e-9867-c6ac44d61757" containerID="2271247eb9509cc23a0d7e3ed0f7e93bb3ededb7f7c0bbfc1f596b5ebf6aa5eb" exitCode=0 Jun 09 05:37:54.612203 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:54.612134 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14t7rg" event={"ID":"62c203f8-168f-4c1e-9867-c6ac44d61757","Type":"ContainerDied","Data":"2271247eb9509cc23a0d7e3ed0f7e93bb3ededb7f7c0bbfc1f596b5ebf6aa5eb"} Jun 09 05:37:55.621952 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:55.621905 2564 generic.go:356] "Generic (PLEG): container finished" podID="d2c4bf80-db15-435e-9806-46844ba1132e" containerID="0bbe41b24bd325fb58702fbaceb9400b24fb0860c383cba02e0a76f697b851f2" exitCode=0 Jun 09 05:37:55.622324 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:55.621997 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e079qrm" event={"ID":"d2c4bf80-db15-435e-9806-46844ba1132e","Type":"ContainerDied","Data":"0bbe41b24bd325fb58702fbaceb9400b24fb0860c383cba02e0a76f697b851f2"} Jun 09 05:37:56.635322 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:56.635284 2564 generic.go:356] "Generic (PLEG): container finished" podID="919ca8ed-5772-44d2-899c-2aa46bcada61" containerID="7c890b2e5af141bdfe082895db61b467cff744a38f9a58e33382bd357140c54c" exitCode=0 Jun 09 05:37:56.635732 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:56.635355 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592g9t2" event={"ID":"919ca8ed-5772-44d2-899c-2aa46bcada61","Type":"ContainerDied","Data":"7c890b2e5af141bdfe082895db61b467cff744a38f9a58e33382bd357140c54c"} Jun 09 05:37:56.637184 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:56.637164 2564 generic.go:356] "Generic (PLEG): container finished" podID="62c203f8-168f-4c1e-9867-c6ac44d61757" containerID="d86edc14532a56c8ef8af5cbedc4e15c0542c60ced1a7feebb56f633ea4c7e6e" exitCode=0 Jun 09 05:37:56.637257 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:56.637235 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14t7rg" event={"ID":"62c203f8-168f-4c1e-9867-c6ac44d61757","Type":"ContainerDied","Data":"d86edc14532a56c8ef8af5cbedc4e15c0542c60ced1a7feebb56f633ea4c7e6e"} Jun 09 05:37:56.639312 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:56.639293 2564 generic.go:356] "Generic (PLEG): container finished" podID="867fbd6e-5cde-48ef-bfb0-163b0efdd429" containerID="8258ce6fd601b3dc18574eabb04166f5feb3db6645552e36e13f12e0eedaea2f" exitCode=0 Jun 09 05:37:56.639399 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:56.639363 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zbjqr" event={"ID":"867fbd6e-5cde-48ef-bfb0-163b0efdd429","Type":"ContainerDied","Data":"8258ce6fd601b3dc18574eabb04166f5feb3db6645552e36e13f12e0eedaea2f"} Jun 09 05:37:56.797352 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:56.797325 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e079qrm" Jun 09 05:37:56.910009 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:56.909986 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d2c4bf80-db15-435e-9806-46844ba1132e-bundle\") pod \"d2c4bf80-db15-435e-9806-46844ba1132e\" (UID: \"d2c4bf80-db15-435e-9806-46844ba1132e\") " Jun 09 05:37:56.910132 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:56.910029 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d2c4bf80-db15-435e-9806-46844ba1132e-util\") pod \"d2c4bf80-db15-435e-9806-46844ba1132e\" (UID: \"d2c4bf80-db15-435e-9806-46844ba1132e\") " Jun 09 05:37:56.910132 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:56.910070 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ldk9x\" (UniqueName: \"kubernetes.io/projected/d2c4bf80-db15-435e-9806-46844ba1132e-kube-api-access-ldk9x\") pod \"d2c4bf80-db15-435e-9806-46844ba1132e\" (UID: \"d2c4bf80-db15-435e-9806-46844ba1132e\") " Jun 09 05:37:56.910483 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:56.910454 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2c4bf80-db15-435e-9806-46844ba1132e-bundle" (OuterVolumeSpecName: "bundle") pod "d2c4bf80-db15-435e-9806-46844ba1132e" (UID: "d2c4bf80-db15-435e-9806-46844ba1132e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 05:37:56.912104 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:56.912080 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2c4bf80-db15-435e-9806-46844ba1132e-kube-api-access-ldk9x" (OuterVolumeSpecName: "kube-api-access-ldk9x") pod "d2c4bf80-db15-435e-9806-46844ba1132e" (UID: "d2c4bf80-db15-435e-9806-46844ba1132e"). InnerVolumeSpecName "kube-api-access-ldk9x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 05:37:56.915748 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:56.915725 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2c4bf80-db15-435e-9806-46844ba1132e-util" (OuterVolumeSpecName: "util") pod "d2c4bf80-db15-435e-9806-46844ba1132e" (UID: "d2c4bf80-db15-435e-9806-46844ba1132e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 05:37:57.011293 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:57.011267 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d2c4bf80-db15-435e-9806-46844ba1132e-bundle\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:37:57.011293 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:57.011292 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d2c4bf80-db15-435e-9806-46844ba1132e-util\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:37:57.011426 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:57.011302 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ldk9x\" (UniqueName: \"kubernetes.io/projected/d2c4bf80-db15-435e-9806-46844ba1132e-kube-api-access-ldk9x\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:37:57.646671 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:57.646638 2564 generic.go:356] "Generic (PLEG): container finished" podID="867fbd6e-5cde-48ef-bfb0-163b0efdd429" containerID="7fbf9f7ec7e7ed0aa5c3a29c5bd5c78878893b43159bd238af4fc905f3d37d56" exitCode=0 Jun 09 05:37:57.647115 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:57.646725 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zbjqr" event={"ID":"867fbd6e-5cde-48ef-bfb0-163b0efdd429","Type":"ContainerDied","Data":"7fbf9f7ec7e7ed0aa5c3a29c5bd5c78878893b43159bd238af4fc905f3d37d56"} Jun 09 05:37:57.648755 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:57.648734 2564 generic.go:356] "Generic (PLEG): container finished" podID="919ca8ed-5772-44d2-899c-2aa46bcada61" containerID="1dfa32eb7e4bb8519e206727bc3466be3d8517ae2c0ebd1f9bf0539b037a9ce1" exitCode=0 Jun 09 05:37:57.648873 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:57.648826 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592g9t2" event={"ID":"919ca8ed-5772-44d2-899c-2aa46bcada61","Type":"ContainerDied","Data":"1dfa32eb7e4bb8519e206727bc3466be3d8517ae2c0ebd1f9bf0539b037a9ce1"} Jun 09 05:37:57.657364 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:57.657343 2564 generic.go:356] "Generic (PLEG): container finished" podID="62c203f8-168f-4c1e-9867-c6ac44d61757" containerID="94218c9b508141b7f1f81d94087c4100c7c341b01bebd343ff1d593469c400f8" exitCode=0 Jun 09 05:37:57.657463 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:57.657417 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14t7rg" event={"ID":"62c203f8-168f-4c1e-9867-c6ac44d61757","Type":"ContainerDied","Data":"94218c9b508141b7f1f81d94087c4100c7c341b01bebd343ff1d593469c400f8"} Jun 09 05:37:57.659315 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:57.659296 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e079qrm" event={"ID":"d2c4bf80-db15-435e-9806-46844ba1132e","Type":"ContainerDied","Data":"ee757b827ea46f01022e0d10222c7ed11862bed389ca098932aca03ef0d8578a"} Jun 09 05:37:57.659390 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:57.659331 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e079qrm" Jun 09 05:37:57.659445 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:57.659332 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ee757b827ea46f01022e0d10222c7ed11862bed389ca098932aca03ef0d8578a" Jun 09 05:37:58.807640 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:58.807615 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zbjqr" Jun 09 05:37:58.856144 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:58.856119 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592g9t2" Jun 09 05:37:58.859286 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:58.859267 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14t7rg" Jun 09 05:37:58.928333 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:58.928270 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/919ca8ed-5772-44d2-899c-2aa46bcada61-bundle\") pod \"919ca8ed-5772-44d2-899c-2aa46bcada61\" (UID: \"919ca8ed-5772-44d2-899c-2aa46bcada61\") " Jun 09 05:37:58.928333 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:58.928300 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/919ca8ed-5772-44d2-899c-2aa46bcada61-util\") pod \"919ca8ed-5772-44d2-899c-2aa46bcada61\" (UID: \"919ca8ed-5772-44d2-899c-2aa46bcada61\") " Jun 09 05:37:58.928333 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:58.928330 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5gthr\" (UniqueName: \"kubernetes.io/projected/867fbd6e-5cde-48ef-bfb0-163b0efdd429-kube-api-access-5gthr\") pod \"867fbd6e-5cde-48ef-bfb0-163b0efdd429\" (UID: \"867fbd6e-5cde-48ef-bfb0-163b0efdd429\") " Jun 09 05:37:58.928542 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:58.928424 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/867fbd6e-5cde-48ef-bfb0-163b0efdd429-bundle\") pod \"867fbd6e-5cde-48ef-bfb0-163b0efdd429\" (UID: \"867fbd6e-5cde-48ef-bfb0-163b0efdd429\") " Jun 09 05:37:58.928542 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:58.928478 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/867fbd6e-5cde-48ef-bfb0-163b0efdd429-util\") pod \"867fbd6e-5cde-48ef-bfb0-163b0efdd429\" (UID: \"867fbd6e-5cde-48ef-bfb0-163b0efdd429\") " Jun 09 05:37:58.928542 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:58.928503 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z5n7k\" (UniqueName: \"kubernetes.io/projected/62c203f8-168f-4c1e-9867-c6ac44d61757-kube-api-access-z5n7k\") pod \"62c203f8-168f-4c1e-9867-c6ac44d61757\" (UID: \"62c203f8-168f-4c1e-9867-c6ac44d61757\") " Jun 09 05:37:58.928542 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:58.928529 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/62c203f8-168f-4c1e-9867-c6ac44d61757-util\") pod \"62c203f8-168f-4c1e-9867-c6ac44d61757\" (UID: \"62c203f8-168f-4c1e-9867-c6ac44d61757\") " Jun 09 05:37:58.928718 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:58.928557 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8sgq8\" (UniqueName: \"kubernetes.io/projected/919ca8ed-5772-44d2-899c-2aa46bcada61-kube-api-access-8sgq8\") pod \"919ca8ed-5772-44d2-899c-2aa46bcada61\" (UID: \"919ca8ed-5772-44d2-899c-2aa46bcada61\") " Jun 09 05:37:58.930616 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:58.928902 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/919ca8ed-5772-44d2-899c-2aa46bcada61-bundle" (OuterVolumeSpecName: "bundle") pod "919ca8ed-5772-44d2-899c-2aa46bcada61" (UID: "919ca8ed-5772-44d2-899c-2aa46bcada61"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 05:37:58.930616 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:58.929660 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/867fbd6e-5cde-48ef-bfb0-163b0efdd429-bundle" (OuterVolumeSpecName: "bundle") pod "867fbd6e-5cde-48ef-bfb0-163b0efdd429" (UID: "867fbd6e-5cde-48ef-bfb0-163b0efdd429"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 05:37:58.931032 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:58.931012 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/62c203f8-168f-4c1e-9867-c6ac44d61757-bundle\") pod \"62c203f8-168f-4c1e-9867-c6ac44d61757\" (UID: \"62c203f8-168f-4c1e-9867-c6ac44d61757\") " Jun 09 05:37:58.931330 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:58.931312 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/919ca8ed-5772-44d2-899c-2aa46bcada61-bundle\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:37:58.931330 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:58.931332 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/867fbd6e-5cde-48ef-bfb0-163b0efdd429-bundle\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:37:58.931629 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:58.931591 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62c203f8-168f-4c1e-9867-c6ac44d61757-bundle" (OuterVolumeSpecName: "bundle") pod "62c203f8-168f-4c1e-9867-c6ac44d61757" (UID: "62c203f8-168f-4c1e-9867-c6ac44d61757"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 05:37:58.931857 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:58.931830 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62c203f8-168f-4c1e-9867-c6ac44d61757-kube-api-access-z5n7k" (OuterVolumeSpecName: "kube-api-access-z5n7k") pod "62c203f8-168f-4c1e-9867-c6ac44d61757" (UID: "62c203f8-168f-4c1e-9867-c6ac44d61757"). InnerVolumeSpecName "kube-api-access-z5n7k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 05:37:58.931958 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:58.931882 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/867fbd6e-5cde-48ef-bfb0-163b0efdd429-kube-api-access-5gthr" (OuterVolumeSpecName: "kube-api-access-5gthr") pod "867fbd6e-5cde-48ef-bfb0-163b0efdd429" (UID: "867fbd6e-5cde-48ef-bfb0-163b0efdd429"). InnerVolumeSpecName "kube-api-access-5gthr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 05:37:58.932023 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:58.931987 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/919ca8ed-5772-44d2-899c-2aa46bcada61-kube-api-access-8sgq8" (OuterVolumeSpecName: "kube-api-access-8sgq8") pod "919ca8ed-5772-44d2-899c-2aa46bcada61" (UID: "919ca8ed-5772-44d2-899c-2aa46bcada61"). InnerVolumeSpecName "kube-api-access-8sgq8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 05:37:58.935485 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:58.935463 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/867fbd6e-5cde-48ef-bfb0-163b0efdd429-util" (OuterVolumeSpecName: "util") pod "867fbd6e-5cde-48ef-bfb0-163b0efdd429" (UID: "867fbd6e-5cde-48ef-bfb0-163b0efdd429"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 05:37:58.937228 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:58.937206 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62c203f8-168f-4c1e-9867-c6ac44d61757-util" (OuterVolumeSpecName: "util") pod "62c203f8-168f-4c1e-9867-c6ac44d61757" (UID: "62c203f8-168f-4c1e-9867-c6ac44d61757"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 05:37:58.937446 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:58.937431 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/919ca8ed-5772-44d2-899c-2aa46bcada61-util" (OuterVolumeSpecName: "util") pod "919ca8ed-5772-44d2-899c-2aa46bcada61" (UID: "919ca8ed-5772-44d2-899c-2aa46bcada61"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 05:37:59.032025 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:59.032003 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5gthr\" (UniqueName: \"kubernetes.io/projected/867fbd6e-5cde-48ef-bfb0-163b0efdd429-kube-api-access-5gthr\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:37:59.032025 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:59.032025 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/867fbd6e-5cde-48ef-bfb0-163b0efdd429-util\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:37:59.032163 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:59.032036 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z5n7k\" (UniqueName: \"kubernetes.io/projected/62c203f8-168f-4c1e-9867-c6ac44d61757-kube-api-access-z5n7k\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:37:59.032163 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:59.032044 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/62c203f8-168f-4c1e-9867-c6ac44d61757-util\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:37:59.032163 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:59.032053 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8sgq8\" (UniqueName: \"kubernetes.io/projected/919ca8ed-5772-44d2-899c-2aa46bcada61-kube-api-access-8sgq8\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:37:59.032163 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:59.032061 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/62c203f8-168f-4c1e-9867-c6ac44d61757-bundle\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:37:59.032163 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:59.032068 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/919ca8ed-5772-44d2-899c-2aa46bcada61-util\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:37:59.671111 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:59.671080 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zbjqr" Jun 09 05:37:59.671282 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:59.671085 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zbjqr" event={"ID":"867fbd6e-5cde-48ef-bfb0-163b0efdd429","Type":"ContainerDied","Data":"a7478bc5ea2dc1f121a04f451f2269ff42f98ed483dd7bba664ac5fb90d4b8ce"} Jun 09 05:37:59.671282 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:59.671210 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a7478bc5ea2dc1f121a04f451f2269ff42f98ed483dd7bba664ac5fb90d4b8ce" Jun 09 05:37:59.672900 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:59.672875 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592g9t2" Jun 09 05:37:59.673045 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:59.672905 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592g9t2" event={"ID":"919ca8ed-5772-44d2-899c-2aa46bcada61","Type":"ContainerDied","Data":"a33977a0ff54b06c099efa33456f938f0f2daecec9418cc0f2c2b4280aa36e7b"} Jun 09 05:37:59.673045 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:59.672939 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a33977a0ff54b06c099efa33456f938f0f2daecec9418cc0f2c2b4280aa36e7b" Jun 09 05:37:59.674882 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:59.674867 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14t7rg" Jun 09 05:37:59.674882 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:59.674875 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14t7rg" event={"ID":"62c203f8-168f-4c1e-9867-c6ac44d61757","Type":"ContainerDied","Data":"64ff1e9824e14ac502207456f53c803d37db66f341f7db7a6140b51924c74b58"} Jun 09 05:37:59.675044 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:37:59.674905 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="64ff1e9824e14ac502207456f53c803d37db66f341f7db7a6140b51924c74b58" Jun 09 05:38:10.059837 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:10.059785 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xvb9m"] Jun 09 05:38:10.060222 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:10.060151 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62c203f8-168f-4c1e-9867-c6ac44d61757" containerName="extract" Jun 09 05:38:10.060222 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:10.060162 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="62c203f8-168f-4c1e-9867-c6ac44d61757" containerName="extract" Jun 09 05:38:10.060222 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:10.060171 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="867fbd6e-5cde-48ef-bfb0-163b0efdd429" containerName="util" Jun 09 05:38:10.060222 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:10.060176 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="867fbd6e-5cde-48ef-bfb0-163b0efdd429" containerName="util" Jun 09 05:38:10.060222 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:10.060193 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2c4bf80-db15-435e-9806-46844ba1132e" containerName="util" Jun 09 05:38:10.060222 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:10.060199 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2c4bf80-db15-435e-9806-46844ba1132e" containerName="util" Jun 09 05:38:10.060222 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:10.060204 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="919ca8ed-5772-44d2-899c-2aa46bcada61" containerName="util" Jun 09 05:38:10.060222 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:10.060209 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="919ca8ed-5772-44d2-899c-2aa46bcada61" containerName="util" Jun 09 05:38:10.060222 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:10.060214 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="919ca8ed-5772-44d2-899c-2aa46bcada61" containerName="extract" Jun 09 05:38:10.060222 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:10.060221 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="919ca8ed-5772-44d2-899c-2aa46bcada61" containerName="extract" Jun 09 05:38:10.060222 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:10.060228 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="867fbd6e-5cde-48ef-bfb0-163b0efdd429" containerName="extract" Jun 09 05:38:10.060592 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:10.060233 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="867fbd6e-5cde-48ef-bfb0-163b0efdd429" containerName="extract" Jun 09 05:38:10.060592 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:10.060239 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2c4bf80-db15-435e-9806-46844ba1132e" containerName="pull" Jun 09 05:38:10.060592 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:10.060245 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2c4bf80-db15-435e-9806-46844ba1132e" containerName="pull" Jun 09 05:38:10.060592 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:10.060252 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2c4bf80-db15-435e-9806-46844ba1132e" containerName="extract" Jun 09 05:38:10.060592 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:10.060257 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2c4bf80-db15-435e-9806-46844ba1132e" containerName="extract" Jun 09 05:38:10.060592 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:10.060263 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="867fbd6e-5cde-48ef-bfb0-163b0efdd429" containerName="pull" Jun 09 05:38:10.060592 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:10.060268 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="867fbd6e-5cde-48ef-bfb0-163b0efdd429" containerName="pull" Jun 09 05:38:10.060592 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:10.060274 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62c203f8-168f-4c1e-9867-c6ac44d61757" containerName="pull" Jun 09 05:38:10.060592 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:10.060278 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="62c203f8-168f-4c1e-9867-c6ac44d61757" containerName="pull" Jun 09 05:38:10.060592 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:10.060285 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="919ca8ed-5772-44d2-899c-2aa46bcada61" containerName="pull" Jun 09 05:38:10.060592 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:10.060289 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="919ca8ed-5772-44d2-899c-2aa46bcada61" containerName="pull" Jun 09 05:38:10.060592 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:10.060299 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62c203f8-168f-4c1e-9867-c6ac44d61757" containerName="util" Jun 09 05:38:10.060592 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:10.060304 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="62c203f8-168f-4c1e-9867-c6ac44d61757" containerName="util" Jun 09 05:38:10.060592 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:10.060356 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2c4bf80-db15-435e-9806-46844ba1132e" containerName="extract" Jun 09 05:38:10.060592 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:10.060364 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="919ca8ed-5772-44d2-899c-2aa46bcada61" containerName="extract" Jun 09 05:38:10.060592 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:10.060370 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="62c203f8-168f-4c1e-9867-c6ac44d61757" containerName="extract" Jun 09 05:38:10.060592 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:10.060375 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="867fbd6e-5cde-48ef-bfb0-163b0efdd429" containerName="extract" Jun 09 05:38:10.064751 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:10.064735 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xvb9m" Jun 09 05:38:10.067264 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:10.067245 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-7xl4l\"" Jun 09 05:38:10.078241 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:10.078212 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xvb9m"] Jun 09 05:38:10.116828 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:10.116786 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2rz4\" (UniqueName: \"kubernetes.io/projected/bed26e9a-ede1-4e31-9b6f-bb4cf141bc34-kube-api-access-s2rz4\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xvb9m\" (UID: \"bed26e9a-ede1-4e31-9b6f-bb4cf141bc34\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xvb9m" Jun 09 05:38:10.116912 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:10.116846 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bed26e9a-ede1-4e31-9b6f-bb4cf141bc34-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xvb9m\" (UID: \"bed26e9a-ede1-4e31-9b6f-bb4cf141bc34\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xvb9m" Jun 09 05:38:10.217839 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:10.217815 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2rz4\" (UniqueName: \"kubernetes.io/projected/bed26e9a-ede1-4e31-9b6f-bb4cf141bc34-kube-api-access-s2rz4\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xvb9m\" (UID: \"bed26e9a-ede1-4e31-9b6f-bb4cf141bc34\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xvb9m" Jun 09 05:38:10.217932 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:10.217860 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bed26e9a-ede1-4e31-9b6f-bb4cf141bc34-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xvb9m\" (UID: \"bed26e9a-ede1-4e31-9b6f-bb4cf141bc34\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xvb9m" Jun 09 05:38:10.218244 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:10.218225 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bed26e9a-ede1-4e31-9b6f-bb4cf141bc34-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xvb9m\" (UID: \"bed26e9a-ede1-4e31-9b6f-bb4cf141bc34\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xvb9m" Jun 09 05:38:10.232405 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:10.232380 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2rz4\" (UniqueName: \"kubernetes.io/projected/bed26e9a-ede1-4e31-9b6f-bb4cf141bc34-kube-api-access-s2rz4\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xvb9m\" (UID: \"bed26e9a-ede1-4e31-9b6f-bb4cf141bc34\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xvb9m" Jun 09 05:38:10.380186 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:10.380154 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-7xl4l\"" Jun 09 05:38:10.385360 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:10.385341 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xvb9m" Jun 09 05:38:10.529695 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:10.529670 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xvb9m"] Jun 09 05:38:10.532512 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:38:10.532485 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbed26e9a_ede1_4e31_9b6f_bb4cf141bc34.slice/crio-2d3a4d52723a3f8941e567f24ca659d7f788a287c0bed11e4d37e4d84c571bd3 WatchSource:0}: Error finding container 2d3a4d52723a3f8941e567f24ca659d7f788a287c0bed11e4d37e4d84c571bd3: Status 404 returned error can't find the container with id 2d3a4d52723a3f8941e567f24ca659d7f788a287c0bed11e4d37e4d84c571bd3 Jun 09 05:38:10.732704 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:10.732629 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xvb9m" event={"ID":"bed26e9a-ede1-4e31-9b6f-bb4cf141bc34","Type":"ContainerStarted","Data":"2d3a4d52723a3f8941e567f24ca659d7f788a287c0bed11e4d37e4d84c571bd3"} Jun 09 05:38:12.030970 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:12.030935 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-jhcql"] Jun 09 05:38:12.033674 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:12.033657 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jhcql" Jun 09 05:38:12.036421 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:12.036395 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 09 05:38:12.036608 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:12.036588 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-76qsv\"" Jun 09 05:38:12.045245 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:12.045227 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-jhcql"] Jun 09 05:38:12.132423 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:12.132394 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hf8np\" (UniqueName: \"kubernetes.io/projected/2322b5ed-5bed-40eb-93c1-fd5b491c0776-kube-api-access-hf8np\") pod \"dns-operator-controller-manager-864dd78c4c-jhcql\" (UID: \"2322b5ed-5bed-40eb-93c1-fd5b491c0776\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jhcql" Jun 09 05:38:12.233778 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:12.233750 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hf8np\" (UniqueName: \"kubernetes.io/projected/2322b5ed-5bed-40eb-93c1-fd5b491c0776-kube-api-access-hf8np\") pod \"dns-operator-controller-manager-864dd78c4c-jhcql\" (UID: \"2322b5ed-5bed-40eb-93c1-fd5b491c0776\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jhcql" Jun 09 05:38:12.241970 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:12.241938 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hf8np\" (UniqueName: \"kubernetes.io/projected/2322b5ed-5bed-40eb-93c1-fd5b491c0776-kube-api-access-hf8np\") pod \"dns-operator-controller-manager-864dd78c4c-jhcql\" (UID: \"2322b5ed-5bed-40eb-93c1-fd5b491c0776\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jhcql" Jun 09 05:38:12.344874 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:12.344853 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jhcql" Jun 09 05:38:12.477144 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:12.477083 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-jhcql"] Jun 09 05:38:12.477533 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:38:12.477505 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2322b5ed_5bed_40eb_93c1_fd5b491c0776.slice/crio-07eb83df9fceb812e7da3298356e18f583eabfef6643c55c9c3ae9cd64e9d947 WatchSource:0}: Error finding container 07eb83df9fceb812e7da3298356e18f583eabfef6643c55c9c3ae9cd64e9d947: Status 404 returned error can't find the container with id 07eb83df9fceb812e7da3298356e18f583eabfef6643c55c9c3ae9cd64e9d947 Jun 09 05:38:12.744276 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:12.744204 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jhcql" event={"ID":"2322b5ed-5bed-40eb-93c1-fd5b491c0776","Type":"ContainerStarted","Data":"07eb83df9fceb812e7da3298356e18f583eabfef6643c55c9c3ae9cd64e9d947"} Jun 09 05:38:15.330920 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:15.330882 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-zppbx"] Jun 09 05:38:15.334445 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:15.334430 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-zppbx" Jun 09 05:38:15.336869 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:15.336850 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-r5xgf\"" Jun 09 05:38:15.344171 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:15.344150 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-zppbx"] Jun 09 05:38:15.462009 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:15.461984 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vr2wx\" (UniqueName: \"kubernetes.io/projected/eb84cdf5-1b9e-42d7-8841-be7dd1a4f438-kube-api-access-vr2wx\") pod \"authorino-operator-75cc8d5cb7-zppbx\" (UID: \"eb84cdf5-1b9e-42d7-8841-be7dd1a4f438\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-zppbx" Jun 09 05:38:15.562583 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:15.562558 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vr2wx\" (UniqueName: \"kubernetes.io/projected/eb84cdf5-1b9e-42d7-8841-be7dd1a4f438-kube-api-access-vr2wx\") pod \"authorino-operator-75cc8d5cb7-zppbx\" (UID: \"eb84cdf5-1b9e-42d7-8841-be7dd1a4f438\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-zppbx" Jun 09 05:38:15.573753 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:15.573729 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vr2wx\" (UniqueName: \"kubernetes.io/projected/eb84cdf5-1b9e-42d7-8841-be7dd1a4f438-kube-api-access-vr2wx\") pod \"authorino-operator-75cc8d5cb7-zppbx\" (UID: \"eb84cdf5-1b9e-42d7-8841-be7dd1a4f438\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-zppbx" Jun 09 05:38:15.645203 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:15.645149 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-zppbx" Jun 09 05:38:15.767866 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:15.767828 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jhcql" event={"ID":"2322b5ed-5bed-40eb-93c1-fd5b491c0776","Type":"ContainerStarted","Data":"9bee5d4feb82addd963240e3a9e4d3498bdd98439d37c86f82c4e7b95146155b"} Jun 09 05:38:15.768026 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:15.767939 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jhcql" Jun 09 05:38:15.777336 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:15.777315 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-zppbx"] Jun 09 05:38:15.778982 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:38:15.778962 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb84cdf5_1b9e_42d7_8841_be7dd1a4f438.slice/crio-4a2a6ea13d0a86b2c2f3591366f3b2ab8381cfdbb98f6f780f617997ca73d33d WatchSource:0}: Error finding container 4a2a6ea13d0a86b2c2f3591366f3b2ab8381cfdbb98f6f780f617997ca73d33d: Status 404 returned error can't find the container with id 4a2a6ea13d0a86b2c2f3591366f3b2ab8381cfdbb98f6f780f617997ca73d33d Jun 09 05:38:15.790351 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:15.790313 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jhcql" podStartSLOduration=1.430881832 podStartE2EDuration="3.790298871s" totalImagesPullingTime="2.359417039s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 05:38:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 05:38:15.787830845 +0000 UTC m=+545.870482582" watchObservedRunningTime="2026-06-09 05:38:15.790298871 +0000 UTC m=+545.872950606" Jun 09 05:38:16.776813 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:16.776761 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-zppbx" event={"ID":"eb84cdf5-1b9e-42d7-8841-be7dd1a4f438","Type":"ContainerStarted","Data":"4a2a6ea13d0a86b2c2f3591366f3b2ab8381cfdbb98f6f780f617997ca73d33d"} Jun 09 05:38:18.325537 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:18.325471 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7458cbf459-pxlxj"] Jun 09 05:38:18.328815 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:18.328768 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7458cbf459-pxlxj" Jun 09 05:38:18.348466 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:18.348443 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7458cbf459-pxlxj"] Jun 09 05:38:18.386496 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:18.386471 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9e6684bc-ff7e-4cae-8c33-084c439dbbb3-service-ca\") pod \"console-7458cbf459-pxlxj\" (UID: \"9e6684bc-ff7e-4cae-8c33-084c439dbbb3\") " pod="openshift-console/console-7458cbf459-pxlxj" Jun 09 05:38:18.386614 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:18.386508 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9e6684bc-ff7e-4cae-8c33-084c439dbbb3-console-oauth-config\") pod \"console-7458cbf459-pxlxj\" (UID: \"9e6684bc-ff7e-4cae-8c33-084c439dbbb3\") " pod="openshift-console/console-7458cbf459-pxlxj" Jun 09 05:38:18.386614 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:18.386574 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9e6684bc-ff7e-4cae-8c33-084c439dbbb3-console-config\") pod \"console-7458cbf459-pxlxj\" (UID: \"9e6684bc-ff7e-4cae-8c33-084c439dbbb3\") " pod="openshift-console/console-7458cbf459-pxlxj" Jun 09 05:38:18.386749 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:18.386628 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sctcw\" (UniqueName: \"kubernetes.io/projected/9e6684bc-ff7e-4cae-8c33-084c439dbbb3-kube-api-access-sctcw\") pod \"console-7458cbf459-pxlxj\" (UID: \"9e6684bc-ff7e-4cae-8c33-084c439dbbb3\") " pod="openshift-console/console-7458cbf459-pxlxj" Jun 09 05:38:18.386749 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:18.386705 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9e6684bc-ff7e-4cae-8c33-084c439dbbb3-console-serving-cert\") pod \"console-7458cbf459-pxlxj\" (UID: \"9e6684bc-ff7e-4cae-8c33-084c439dbbb3\") " pod="openshift-console/console-7458cbf459-pxlxj" Jun 09 05:38:18.386749 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:18.386730 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9e6684bc-ff7e-4cae-8c33-084c439dbbb3-oauth-serving-cert\") pod \"console-7458cbf459-pxlxj\" (UID: \"9e6684bc-ff7e-4cae-8c33-084c439dbbb3\") " pod="openshift-console/console-7458cbf459-pxlxj" Jun 09 05:38:18.386927 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:18.386766 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e6684bc-ff7e-4cae-8c33-084c439dbbb3-trusted-ca-bundle\") pod \"console-7458cbf459-pxlxj\" (UID: \"9e6684bc-ff7e-4cae-8c33-084c439dbbb3\") " pod="openshift-console/console-7458cbf459-pxlxj" Jun 09 05:38:18.487695 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:18.487665 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9e6684bc-ff7e-4cae-8c33-084c439dbbb3-console-serving-cert\") pod \"console-7458cbf459-pxlxj\" (UID: \"9e6684bc-ff7e-4cae-8c33-084c439dbbb3\") " pod="openshift-console/console-7458cbf459-pxlxj" Jun 09 05:38:18.487695 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:18.487697 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9e6684bc-ff7e-4cae-8c33-084c439dbbb3-oauth-serving-cert\") pod \"console-7458cbf459-pxlxj\" (UID: \"9e6684bc-ff7e-4cae-8c33-084c439dbbb3\") " pod="openshift-console/console-7458cbf459-pxlxj" Jun 09 05:38:18.487936 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:18.487722 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e6684bc-ff7e-4cae-8c33-084c439dbbb3-trusted-ca-bundle\") pod \"console-7458cbf459-pxlxj\" (UID: \"9e6684bc-ff7e-4cae-8c33-084c439dbbb3\") " pod="openshift-console/console-7458cbf459-pxlxj" Jun 09 05:38:18.487936 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:18.487772 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9e6684bc-ff7e-4cae-8c33-084c439dbbb3-service-ca\") pod \"console-7458cbf459-pxlxj\" (UID: \"9e6684bc-ff7e-4cae-8c33-084c439dbbb3\") " pod="openshift-console/console-7458cbf459-pxlxj" Jun 09 05:38:18.487936 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:18.487825 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9e6684bc-ff7e-4cae-8c33-084c439dbbb3-console-oauth-config\") pod \"console-7458cbf459-pxlxj\" (UID: \"9e6684bc-ff7e-4cae-8c33-084c439dbbb3\") " pod="openshift-console/console-7458cbf459-pxlxj" Jun 09 05:38:18.487936 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:18.487864 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9e6684bc-ff7e-4cae-8c33-084c439dbbb3-console-config\") pod \"console-7458cbf459-pxlxj\" (UID: \"9e6684bc-ff7e-4cae-8c33-084c439dbbb3\") " pod="openshift-console/console-7458cbf459-pxlxj" Jun 09 05:38:18.487936 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:18.487910 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sctcw\" (UniqueName: \"kubernetes.io/projected/9e6684bc-ff7e-4cae-8c33-084c439dbbb3-kube-api-access-sctcw\") pod \"console-7458cbf459-pxlxj\" (UID: \"9e6684bc-ff7e-4cae-8c33-084c439dbbb3\") " pod="openshift-console/console-7458cbf459-pxlxj" Jun 09 05:38:18.488631 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:18.488580 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9e6684bc-ff7e-4cae-8c33-084c439dbbb3-oauth-serving-cert\") pod \"console-7458cbf459-pxlxj\" (UID: \"9e6684bc-ff7e-4cae-8c33-084c439dbbb3\") " pod="openshift-console/console-7458cbf459-pxlxj" Jun 09 05:38:18.488746 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:18.488696 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e6684bc-ff7e-4cae-8c33-084c439dbbb3-trusted-ca-bundle\") pod \"console-7458cbf459-pxlxj\" (UID: \"9e6684bc-ff7e-4cae-8c33-084c439dbbb3\") " pod="openshift-console/console-7458cbf459-pxlxj" Jun 09 05:38:18.488923 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:18.488901 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9e6684bc-ff7e-4cae-8c33-084c439dbbb3-console-config\") pod \"console-7458cbf459-pxlxj\" (UID: \"9e6684bc-ff7e-4cae-8c33-084c439dbbb3\") " pod="openshift-console/console-7458cbf459-pxlxj" Jun 09 05:38:18.488982 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:18.488969 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9e6684bc-ff7e-4cae-8c33-084c439dbbb3-service-ca\") pod \"console-7458cbf459-pxlxj\" (UID: \"9e6684bc-ff7e-4cae-8c33-084c439dbbb3\") " pod="openshift-console/console-7458cbf459-pxlxj" Jun 09 05:38:18.490617 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:18.490598 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9e6684bc-ff7e-4cae-8c33-084c439dbbb3-console-serving-cert\") pod \"console-7458cbf459-pxlxj\" (UID: \"9e6684bc-ff7e-4cae-8c33-084c439dbbb3\") " pod="openshift-console/console-7458cbf459-pxlxj" Jun 09 05:38:18.490809 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:18.490775 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9e6684bc-ff7e-4cae-8c33-084c439dbbb3-console-oauth-config\") pod \"console-7458cbf459-pxlxj\" (UID: \"9e6684bc-ff7e-4cae-8c33-084c439dbbb3\") " pod="openshift-console/console-7458cbf459-pxlxj" Jun 09 05:38:18.496337 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:18.496313 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sctcw\" (UniqueName: \"kubernetes.io/projected/9e6684bc-ff7e-4cae-8c33-084c439dbbb3-kube-api-access-sctcw\") pod \"console-7458cbf459-pxlxj\" (UID: \"9e6684bc-ff7e-4cae-8c33-084c439dbbb3\") " pod="openshift-console/console-7458cbf459-pxlxj" Jun 09 05:38:18.639322 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:18.639291 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7458cbf459-pxlxj" Jun 09 05:38:18.787001 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:18.786979 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7458cbf459-pxlxj"] Jun 09 05:38:18.788716 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:38:18.788692 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e6684bc_ff7e_4cae_8c33_084c439dbbb3.slice/crio-047ce4d5bfa55c2521610cf162a01edf9ea430155960b41003be265cfb3226bd WatchSource:0}: Error finding container 047ce4d5bfa55c2521610cf162a01edf9ea430155960b41003be265cfb3226bd: Status 404 returned error can't find the container with id 047ce4d5bfa55c2521610cf162a01edf9ea430155960b41003be265cfb3226bd Jun 09 05:38:18.792434 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:18.792407 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-zppbx" event={"ID":"eb84cdf5-1b9e-42d7-8841-be7dd1a4f438","Type":"ContainerStarted","Data":"04348212b8509dd8705cccb5f95c4b5b073f305f97eae062e316e13e0bd6d7f3"} Jun 09 05:38:18.794023 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:18.794001 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xvb9m" event={"ID":"bed26e9a-ede1-4e31-9b6f-bb4cf141bc34","Type":"ContainerStarted","Data":"87b0039f0414ddb3ac62887b5f00afd4276191d7344a9ac65458b6c562081fa2"} Jun 09 05:38:18.794759 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:18.794735 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-zppbx" Jun 09 05:38:18.794931 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:18.794904 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xvb9m" Jun 09 05:38:18.810894 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:18.810854 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xvb9m" podStartSLOduration=0.740078328 podStartE2EDuration="8.810837959s" totalImagesPullingTime="8.070759631s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 05:38:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 05:38:18.809980649 +0000 UTC m=+548.892632385" watchObservedRunningTime="2026-06-09 05:38:18.810837959 +0000 UTC m=+548.893489695" Jun 09 05:38:18.826181 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:18.826136 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-zppbx" podStartSLOduration=0.962706469 podStartE2EDuration="3.826124219s" totalImagesPullingTime="2.86341775s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 05:38:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 05:38:18.825442253 +0000 UTC m=+548.908093990" watchObservedRunningTime="2026-06-09 05:38:18.826124219 +0000 UTC m=+548.908775956" Jun 09 05:38:19.802515 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:19.802473 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7458cbf459-pxlxj" event={"ID":"9e6684bc-ff7e-4cae-8c33-084c439dbbb3","Type":"ContainerStarted","Data":"77155a7ae255462b72748cfa8d8376b2cc575284e2f89e46c9ef69407996dd91"} Jun 09 05:38:19.802981 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:19.802523 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7458cbf459-pxlxj" event={"ID":"9e6684bc-ff7e-4cae-8c33-084c439dbbb3","Type":"ContainerStarted","Data":"047ce4d5bfa55c2521610cf162a01edf9ea430155960b41003be265cfb3226bd"} Jun 09 05:38:19.819541 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:19.819493 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7458cbf459-pxlxj" podStartSLOduration=1.8194748029999999 podStartE2EDuration="1.819474803s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 05:38:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 05:38:19.8190042 +0000 UTC m=+549.901655936" watchObservedRunningTime="2026-06-09 05:38:19.819474803 +0000 UTC m=+549.902126559" Jun 09 05:38:26.779350 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:26.779318 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jhcql" Jun 09 05:38:28.640369 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:28.640326 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7458cbf459-pxlxj" Jun 09 05:38:28.640846 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:28.640392 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7458cbf459-pxlxj" Jun 09 05:38:28.645208 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:28.645185 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7458cbf459-pxlxj" Jun 09 05:38:28.856108 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:28.856081 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7458cbf459-pxlxj" Jun 09 05:38:28.904164 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:28.904074 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-67f6b6b44f-jx5hm"] Jun 09 05:38:29.804870 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:29.804840 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-zppbx" Jun 09 05:38:29.805274 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:29.804995 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xvb9m" Jun 09 05:38:31.509620 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:31.509585 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xvb9m"] Jun 09 05:38:31.510029 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:31.509742 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xvb9m" podUID="bed26e9a-ede1-4e31-9b6f-bb4cf141bc34" containerName="manager" containerID="cri-o://87b0039f0414ddb3ac62887b5f00afd4276191d7344a9ac65458b6c562081fa2" gracePeriod=2 Jun 09 05:38:31.512250 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:38:31.512210 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xvb9m\" is forbidden: User \"system:node:ip-10-0-130-106.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-106.ec2.internal' and this object" podUID="bed26e9a-ede1-4e31-9b6f-bb4cf141bc34" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xvb9m" Jun 09 05:38:31.513891 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:31.513868 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xvb9m"] Jun 09 05:38:31.541338 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:31.541304 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5cpsd"] Jun 09 05:38:31.541957 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:31.541936 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bed26e9a-ede1-4e31-9b6f-bb4cf141bc34" containerName="manager" Jun 09 05:38:31.542037 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:31.541961 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="bed26e9a-ede1-4e31-9b6f-bb4cf141bc34" containerName="manager" Jun 09 05:38:31.542078 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:31.542070 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="bed26e9a-ede1-4e31-9b6f-bb4cf141bc34" containerName="manager" Jun 09 05:38:31.545710 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:31.545689 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5cpsd" Jun 09 05:38:31.547891 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:38:31.547859 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xvb9m\" is forbidden: User \"system:node:ip-10-0-130-106.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-106.ec2.internal' and this object" podUID="bed26e9a-ede1-4e31-9b6f-bb4cf141bc34" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xvb9m" Jun 09 05:38:31.556700 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:31.556672 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dfzwb"] Jun 09 05:38:31.563198 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:31.563175 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dfzwb" Jun 09 05:38:31.564593 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:31.564567 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5cpsd"] Jun 09 05:38:31.583960 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:31.580310 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dfzwb"] Jun 09 05:38:31.604526 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:38:31.600994 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xvb9m\" is forbidden: User \"system:node:ip-10-0-130-106.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-106.ec2.internal' and this object" podUID="bed26e9a-ede1-4e31-9b6f-bb4cf141bc34" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xvb9m" Jun 09 05:38:31.703622 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:31.703591 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0e647237-f2ec-4c24-81b0-303784382c2e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5cpsd\" (UID: \"0e647237-f2ec-4c24-81b0-303784382c2e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5cpsd" Jun 09 05:38:31.703762 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:31.703646 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mznb\" (UniqueName: \"kubernetes.io/projected/2d408766-0c9f-43fa-a59f-448ed410b555-kube-api-access-4mznb\") pod \"kuadrant-operator-controller-manager-86878c769f-dfzwb\" (UID: \"2d408766-0c9f-43fa-a59f-448ed410b555\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dfzwb" Jun 09 05:38:31.703762 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:31.703674 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2d408766-0c9f-43fa-a59f-448ed410b555-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-dfzwb\" (UID: \"2d408766-0c9f-43fa-a59f-448ed410b555\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dfzwb" Jun 09 05:38:31.703762 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:31.703732 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxcvw\" (UniqueName: \"kubernetes.io/projected/0e647237-f2ec-4c24-81b0-303784382c2e-kube-api-access-gxcvw\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5cpsd\" (UID: \"0e647237-f2ec-4c24-81b0-303784382c2e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5cpsd" Jun 09 05:38:31.752592 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:31.752571 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xvb9m" Jun 09 05:38:31.754616 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:38:31.754592 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xvb9m\" is forbidden: User \"system:node:ip-10-0-130-106.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-106.ec2.internal' and this object" podUID="bed26e9a-ede1-4e31-9b6f-bb4cf141bc34" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xvb9m" Jun 09 05:38:31.804703 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:31.804674 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2d408766-0c9f-43fa-a59f-448ed410b555-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-dfzwb\" (UID: \"2d408766-0c9f-43fa-a59f-448ed410b555\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dfzwb" Jun 09 05:38:31.804856 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:31.804724 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxcvw\" (UniqueName: \"kubernetes.io/projected/0e647237-f2ec-4c24-81b0-303784382c2e-kube-api-access-gxcvw\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5cpsd\" (UID: \"0e647237-f2ec-4c24-81b0-303784382c2e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5cpsd" Jun 09 05:38:31.804856 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:31.804767 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0e647237-f2ec-4c24-81b0-303784382c2e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5cpsd\" (UID: \"0e647237-f2ec-4c24-81b0-303784382c2e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5cpsd" Jun 09 05:38:31.804856 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:31.804831 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mznb\" (UniqueName: \"kubernetes.io/projected/2d408766-0c9f-43fa-a59f-448ed410b555-kube-api-access-4mznb\") pod \"kuadrant-operator-controller-manager-86878c769f-dfzwb\" (UID: \"2d408766-0c9f-43fa-a59f-448ed410b555\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dfzwb" Jun 09 05:38:31.805169 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:31.805144 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2d408766-0c9f-43fa-a59f-448ed410b555-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-dfzwb\" (UID: \"2d408766-0c9f-43fa-a59f-448ed410b555\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dfzwb" Jun 09 05:38:31.805248 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:31.805156 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0e647237-f2ec-4c24-81b0-303784382c2e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5cpsd\" (UID: \"0e647237-f2ec-4c24-81b0-303784382c2e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5cpsd" Jun 09 05:38:31.812306 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:31.812287 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mznb\" (UniqueName: \"kubernetes.io/projected/2d408766-0c9f-43fa-a59f-448ed410b555-kube-api-access-4mznb\") pod \"kuadrant-operator-controller-manager-86878c769f-dfzwb\" (UID: \"2d408766-0c9f-43fa-a59f-448ed410b555\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dfzwb" Jun 09 05:38:31.812394 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:31.812339 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxcvw\" (UniqueName: \"kubernetes.io/projected/0e647237-f2ec-4c24-81b0-303784382c2e-kube-api-access-gxcvw\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5cpsd\" (UID: \"0e647237-f2ec-4c24-81b0-303784382c2e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5cpsd" Jun 09 05:38:31.872428 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:31.872399 2564 generic.go:356] "Generic (PLEG): container finished" podID="bed26e9a-ede1-4e31-9b6f-bb4cf141bc34" containerID="87b0039f0414ddb3ac62887b5f00afd4276191d7344a9ac65458b6c562081fa2" exitCode=0 Jun 09 05:38:31.872574 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:31.872441 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xvb9m" Jun 09 05:38:31.872574 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:31.872509 2564 scope.go:117] "RemoveContainer" containerID="87b0039f0414ddb3ac62887b5f00afd4276191d7344a9ac65458b6c562081fa2" Jun 09 05:38:31.874645 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:38:31.874615 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xvb9m\" is forbidden: User \"system:node:ip-10-0-130-106.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-106.ec2.internal' and this object" podUID="bed26e9a-ede1-4e31-9b6f-bb4cf141bc34" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xvb9m" Jun 09 05:38:31.881605 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:31.881590 2564 scope.go:117] "RemoveContainer" containerID="87b0039f0414ddb3ac62887b5f00afd4276191d7344a9ac65458b6c562081fa2" Jun 09 05:38:31.881889 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:38:31.881871 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"87b0039f0414ddb3ac62887b5f00afd4276191d7344a9ac65458b6c562081fa2\": container with ID starting with 87b0039f0414ddb3ac62887b5f00afd4276191d7344a9ac65458b6c562081fa2 not found: ID does not exist" containerID="87b0039f0414ddb3ac62887b5f00afd4276191d7344a9ac65458b6c562081fa2" Jun 09 05:38:31.881951 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:31.881897 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87b0039f0414ddb3ac62887b5f00afd4276191d7344a9ac65458b6c562081fa2"} err="failed to get container status \"87b0039f0414ddb3ac62887b5f00afd4276191d7344a9ac65458b6c562081fa2\": rpc error: code = NotFound desc = could not find container \"87b0039f0414ddb3ac62887b5f00afd4276191d7344a9ac65458b6c562081fa2\": container with ID starting with 87b0039f0414ddb3ac62887b5f00afd4276191d7344a9ac65458b6c562081fa2 not found: ID does not exist" Jun 09 05:38:31.905458 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:31.905438 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5cpsd" Jun 09 05:38:31.905548 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:31.905534 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s2rz4\" (UniqueName: \"kubernetes.io/projected/bed26e9a-ede1-4e31-9b6f-bb4cf141bc34-kube-api-access-s2rz4\") pod \"bed26e9a-ede1-4e31-9b6f-bb4cf141bc34\" (UID: \"bed26e9a-ede1-4e31-9b6f-bb4cf141bc34\") " Jun 09 05:38:31.905587 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:31.905567 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bed26e9a-ede1-4e31-9b6f-bb4cf141bc34-extensions-socket-volume\") pod \"bed26e9a-ede1-4e31-9b6f-bb4cf141bc34\" (UID: \"bed26e9a-ede1-4e31-9b6f-bb4cf141bc34\") " Jun 09 05:38:31.906052 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:31.906034 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bed26e9a-ede1-4e31-9b6f-bb4cf141bc34-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "bed26e9a-ede1-4e31-9b6f-bb4cf141bc34" (UID: "bed26e9a-ede1-4e31-9b6f-bb4cf141bc34"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 05:38:31.907500 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:31.907480 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bed26e9a-ede1-4e31-9b6f-bb4cf141bc34-kube-api-access-s2rz4" (OuterVolumeSpecName: "kube-api-access-s2rz4") pod "bed26e9a-ede1-4e31-9b6f-bb4cf141bc34" (UID: "bed26e9a-ede1-4e31-9b6f-bb4cf141bc34"). InnerVolumeSpecName "kube-api-access-s2rz4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 05:38:31.910664 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:31.910649 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dfzwb" Jun 09 05:38:32.007177 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:32.007151 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s2rz4\" (UniqueName: \"kubernetes.io/projected/bed26e9a-ede1-4e31-9b6f-bb4cf141bc34-kube-api-access-s2rz4\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:38:32.007177 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:32.007176 2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bed26e9a-ede1-4e31-9b6f-bb4cf141bc34-extensions-socket-volume\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:38:32.057444 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:32.057376 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5cpsd"] Jun 09 05:38:32.060869 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:38:32.060842 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e647237_f2ec_4c24_81b0_303784382c2e.slice/crio-20658e851e701c789a2d0f886462d5d97763885e469734ef256b19c1b07b59ec WatchSource:0}: Error finding container 20658e851e701c789a2d0f886462d5d97763885e469734ef256b19c1b07b59ec: Status 404 returned error can't find the container with id 20658e851e701c789a2d0f886462d5d97763885e469734ef256b19c1b07b59ec Jun 09 05:38:32.075987 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:32.075967 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dfzwb"] Jun 09 05:38:32.076445 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:38:32.076421 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d408766_0c9f_43fa_a59f_448ed410b555.slice/crio-bd7e4b5b9d2368bc50d61b6a0c6f14af1768ac39fda6fa148d2b1f1dea591627 WatchSource:0}: Error finding container bd7e4b5b9d2368bc50d61b6a0c6f14af1768ac39fda6fa148d2b1f1dea591627: Status 404 returned error can't find the container with id bd7e4b5b9d2368bc50d61b6a0c6f14af1768ac39fda6fa148d2b1f1dea591627 Jun 09 05:38:32.182643 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:38:32.182618 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xvb9m\" is forbidden: User \"system:node:ip-10-0-130-106.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-106.ec2.internal' and this object" podUID="bed26e9a-ede1-4e31-9b6f-bb4cf141bc34" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xvb9m" Jun 09 05:38:32.348834 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:32.348754 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bed26e9a-ede1-4e31-9b6f-bb4cf141bc34" path="/var/lib/kubelet/pods/bed26e9a-ede1-4e31-9b6f-bb4cf141bc34/volumes" Jun 09 05:38:32.880782 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:32.880747 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5cpsd" event={"ID":"0e647237-f2ec-4c24-81b0-303784382c2e","Type":"ContainerStarted","Data":"dbb663d6aa12d65d45cdda96fa09160368707b3c2ec5b968579490813f7b844a"} Jun 09 05:38:32.881240 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:32.880826 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5cpsd" Jun 09 05:38:32.881240 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:32.880855 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5cpsd" event={"ID":"0e647237-f2ec-4c24-81b0-303784382c2e","Type":"ContainerStarted","Data":"20658e851e701c789a2d0f886462d5d97763885e469734ef256b19c1b07b59ec"} Jun 09 05:38:32.882382 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:32.882356 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dfzwb" event={"ID":"2d408766-0c9f-43fa-a59f-448ed410b555","Type":"ContainerStarted","Data":"20da5409bf7b59f918d2678b4489191cb79dc3888ec554d666c512ffd1b29ca4"} Jun 09 05:38:32.882496 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:32.882401 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dfzwb" event={"ID":"2d408766-0c9f-43fa-a59f-448ed410b555","Type":"ContainerStarted","Data":"bd7e4b5b9d2368bc50d61b6a0c6f14af1768ac39fda6fa148d2b1f1dea591627"} Jun 09 05:38:32.882496 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:32.882434 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dfzwb" Jun 09 05:38:32.902477 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:32.902429 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5cpsd" podStartSLOduration=1.902415844 podStartE2EDuration="1.902415844s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 05:38:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 05:38:32.901423167 +0000 UTC m=+562.984074922" watchObservedRunningTime="2026-06-09 05:38:32.902415844 +0000 UTC m=+562.985067579" Jun 09 05:38:32.919629 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:32.919587 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dfzwb" podStartSLOduration=1.919574281 podStartE2EDuration="1.919574281s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 05:38:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 05:38:32.917204212 +0000 UTC m=+562.999855947" watchObservedRunningTime="2026-06-09 05:38:32.919574281 +0000 UTC m=+563.002226026" Jun 09 05:38:43.891365 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:43.891337 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5cpsd" Jun 09 05:38:43.891873 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:43.891412 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dfzwb" Jun 09 05:38:43.938376 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:43.938343 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5cpsd"] Jun 09 05:38:43.945459 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:43.945405 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5cpsd" podUID="0e647237-f2ec-4c24-81b0-303784382c2e" containerName="manager" containerID="cri-o://dbb663d6aa12d65d45cdda96fa09160368707b3c2ec5b968579490813f7b844a" gracePeriod=10 Jun 09 05:38:44.207368 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:44.207333 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5cpsd" Jun 09 05:38:44.302370 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:44.302338 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gxcvw\" (UniqueName: \"kubernetes.io/projected/0e647237-f2ec-4c24-81b0-303784382c2e-kube-api-access-gxcvw\") pod \"0e647237-f2ec-4c24-81b0-303784382c2e\" (UID: \"0e647237-f2ec-4c24-81b0-303784382c2e\") " Jun 09 05:38:44.302525 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:44.302392 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0e647237-f2ec-4c24-81b0-303784382c2e-extensions-socket-volume\") pod \"0e647237-f2ec-4c24-81b0-303784382c2e\" (UID: \"0e647237-f2ec-4c24-81b0-303784382c2e\") " Jun 09 05:38:44.302828 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:44.302781 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e647237-f2ec-4c24-81b0-303784382c2e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "0e647237-f2ec-4c24-81b0-303784382c2e" (UID: "0e647237-f2ec-4c24-81b0-303784382c2e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 05:38:44.304381 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:44.304357 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e647237-f2ec-4c24-81b0-303784382c2e-kube-api-access-gxcvw" (OuterVolumeSpecName: "kube-api-access-gxcvw") pod "0e647237-f2ec-4c24-81b0-303784382c2e" (UID: "0e647237-f2ec-4c24-81b0-303784382c2e"). InnerVolumeSpecName "kube-api-access-gxcvw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 05:38:44.403205 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:44.403172 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gxcvw\" (UniqueName: \"kubernetes.io/projected/0e647237-f2ec-4c24-81b0-303784382c2e-kube-api-access-gxcvw\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:38:44.403205 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:44.403201 2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0e647237-f2ec-4c24-81b0-303784382c2e-extensions-socket-volume\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:38:44.952371 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:44.952338 2564 generic.go:356] "Generic (PLEG): container finished" podID="0e647237-f2ec-4c24-81b0-303784382c2e" containerID="dbb663d6aa12d65d45cdda96fa09160368707b3c2ec5b968579490813f7b844a" exitCode=0 Jun 09 05:38:44.952757 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:44.952379 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5cpsd" Jun 09 05:38:44.952757 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:44.952417 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5cpsd" event={"ID":"0e647237-f2ec-4c24-81b0-303784382c2e","Type":"ContainerDied","Data":"dbb663d6aa12d65d45cdda96fa09160368707b3c2ec5b968579490813f7b844a"} Jun 09 05:38:44.952757 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:44.952473 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5cpsd" event={"ID":"0e647237-f2ec-4c24-81b0-303784382c2e","Type":"ContainerDied","Data":"20658e851e701c789a2d0f886462d5d97763885e469734ef256b19c1b07b59ec"} Jun 09 05:38:44.952757 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:44.952496 2564 scope.go:117] "RemoveContainer" containerID="dbb663d6aa12d65d45cdda96fa09160368707b3c2ec5b968579490813f7b844a" Jun 09 05:38:44.961806 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:44.961774 2564 scope.go:117] "RemoveContainer" containerID="dbb663d6aa12d65d45cdda96fa09160368707b3c2ec5b968579490813f7b844a" Jun 09 05:38:44.962087 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:38:44.962068 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dbb663d6aa12d65d45cdda96fa09160368707b3c2ec5b968579490813f7b844a\": container with ID starting with dbb663d6aa12d65d45cdda96fa09160368707b3c2ec5b968579490813f7b844a not found: ID does not exist" containerID="dbb663d6aa12d65d45cdda96fa09160368707b3c2ec5b968579490813f7b844a" Jun 09 05:38:44.962141 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:44.962097 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbb663d6aa12d65d45cdda96fa09160368707b3c2ec5b968579490813f7b844a"} err="failed to get container status \"dbb663d6aa12d65d45cdda96fa09160368707b3c2ec5b968579490813f7b844a\": rpc error: code = NotFound desc = could not find container \"dbb663d6aa12d65d45cdda96fa09160368707b3c2ec5b968579490813f7b844a\": container with ID starting with dbb663d6aa12d65d45cdda96fa09160368707b3c2ec5b968579490813f7b844a not found: ID does not exist" Jun 09 05:38:44.970307 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:44.970281 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5cpsd"] Jun 09 05:38:44.975722 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:44.975694 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5cpsd"] Jun 09 05:38:46.347605 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:46.347571 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e647237-f2ec-4c24-81b0-303784382c2e" path="/var/lib/kubelet/pods/0e647237-f2ec-4c24-81b0-303784382c2e/volumes" Jun 09 05:38:53.924541 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:53.924498 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-67f6b6b44f-jx5hm" podUID="99652907-c47f-4688-9f58-44fc647c50f5" containerName="console" containerID="cri-o://8d733dce355af750a7e92b1000d0ad674d5c068bc7b286377cbd9c629b47f3ae" gracePeriod=15 Jun 09 05:38:54.175263 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:54.175208 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67f6b6b44f-jx5hm" Jun 09 05:38:54.281660 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:54.281631 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/99652907-c47f-4688-9f58-44fc647c50f5-trusted-ca-bundle\") pod \"99652907-c47f-4688-9f58-44fc647c50f5\" (UID: \"99652907-c47f-4688-9f58-44fc647c50f5\") " Jun 09 05:38:54.281790 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:54.281696 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/99652907-c47f-4688-9f58-44fc647c50f5-console-config\") pod \"99652907-c47f-4688-9f58-44fc647c50f5\" (UID: \"99652907-c47f-4688-9f58-44fc647c50f5\") " Jun 09 05:38:54.281790 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:54.281744 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/99652907-c47f-4688-9f58-44fc647c50f5-console-oauth-config\") pod \"99652907-c47f-4688-9f58-44fc647c50f5\" (UID: \"99652907-c47f-4688-9f58-44fc647c50f5\") " Jun 09 05:38:54.281790 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:54.281774 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/99652907-c47f-4688-9f58-44fc647c50f5-service-ca\") pod \"99652907-c47f-4688-9f58-44fc647c50f5\" (UID: \"99652907-c47f-4688-9f58-44fc647c50f5\") " Jun 09 05:38:54.282014 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:54.281990 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/99652907-c47f-4688-9f58-44fc647c50f5-oauth-serving-cert\") pod \"99652907-c47f-4688-9f58-44fc647c50f5\" (UID: \"99652907-c47f-4688-9f58-44fc647c50f5\") " Jun 09 05:38:54.282116 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:54.282096 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8mccf\" (UniqueName: \"kubernetes.io/projected/99652907-c47f-4688-9f58-44fc647c50f5-kube-api-access-8mccf\") pod \"99652907-c47f-4688-9f58-44fc647c50f5\" (UID: \"99652907-c47f-4688-9f58-44fc647c50f5\") " Jun 09 05:38:54.282189 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:54.282135 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/99652907-c47f-4688-9f58-44fc647c50f5-console-serving-cert\") pod \"99652907-c47f-4688-9f58-44fc647c50f5\" (UID: \"99652907-c47f-4688-9f58-44fc647c50f5\") " Jun 09 05:38:54.282189 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:54.282147 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/99652907-c47f-4688-9f58-44fc647c50f5-console-config" (OuterVolumeSpecName: "console-config") pod "99652907-c47f-4688-9f58-44fc647c50f5" (UID: "99652907-c47f-4688-9f58-44fc647c50f5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 05:38:54.282299 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:54.282176 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/99652907-c47f-4688-9f58-44fc647c50f5-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "99652907-c47f-4688-9f58-44fc647c50f5" (UID: "99652907-c47f-4688-9f58-44fc647c50f5"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 05:38:54.282346 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:54.282295 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/99652907-c47f-4688-9f58-44fc647c50f5-service-ca" (OuterVolumeSpecName: "service-ca") pod "99652907-c47f-4688-9f58-44fc647c50f5" (UID: "99652907-c47f-4688-9f58-44fc647c50f5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 05:38:54.282346 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:54.282318 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/99652907-c47f-4688-9f58-44fc647c50f5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "99652907-c47f-4688-9f58-44fc647c50f5" (UID: "99652907-c47f-4688-9f58-44fc647c50f5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 05:38:54.282463 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:54.282448 2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/99652907-c47f-4688-9f58-44fc647c50f5-service-ca\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:38:54.282514 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:54.282467 2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/99652907-c47f-4688-9f58-44fc647c50f5-oauth-serving-cert\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:38:54.282514 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:54.282477 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/99652907-c47f-4688-9f58-44fc647c50f5-trusted-ca-bundle\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:38:54.282514 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:54.282486 2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/99652907-c47f-4688-9f58-44fc647c50f5-console-config\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:38:54.283877 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:54.283858 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/99652907-c47f-4688-9f58-44fc647c50f5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "99652907-c47f-4688-9f58-44fc647c50f5" (UID: "99652907-c47f-4688-9f58-44fc647c50f5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 05:38:54.284137 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:54.284117 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99652907-c47f-4688-9f58-44fc647c50f5-kube-api-access-8mccf" (OuterVolumeSpecName: "kube-api-access-8mccf") pod "99652907-c47f-4688-9f58-44fc647c50f5" (UID: "99652907-c47f-4688-9f58-44fc647c50f5"). InnerVolumeSpecName "kube-api-access-8mccf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 05:38:54.284197 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:54.284150 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/99652907-c47f-4688-9f58-44fc647c50f5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "99652907-c47f-4688-9f58-44fc647c50f5" (UID: "99652907-c47f-4688-9f58-44fc647c50f5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 05:38:54.383299 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:54.383263 2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/99652907-c47f-4688-9f58-44fc647c50f5-console-serving-cert\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:38:54.383299 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:54.383285 2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/99652907-c47f-4688-9f58-44fc647c50f5-console-oauth-config\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:38:54.383299 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:54.383294 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8mccf\" (UniqueName: \"kubernetes.io/projected/99652907-c47f-4688-9f58-44fc647c50f5-kube-api-access-8mccf\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:38:55.013726 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:55.013695 2564 generic.go:356] "Generic (PLEG): container finished" podID="99652907-c47f-4688-9f58-44fc647c50f5" containerID="8d733dce355af750a7e92b1000d0ad674d5c068bc7b286377cbd9c629b47f3ae" exitCode=0 Jun 09 05:38:55.014155 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:55.013736 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67f6b6b44f-jx5hm" Jun 09 05:38:55.014155 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:55.013748 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67f6b6b44f-jx5hm" event={"ID":"99652907-c47f-4688-9f58-44fc647c50f5","Type":"ContainerDied","Data":"8d733dce355af750a7e92b1000d0ad674d5c068bc7b286377cbd9c629b47f3ae"} Jun 09 05:38:55.014155 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:55.013787 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67f6b6b44f-jx5hm" event={"ID":"99652907-c47f-4688-9f58-44fc647c50f5","Type":"ContainerDied","Data":"5beb68114ae21272109e90fdf0adf4744974f28fc17d73ac598b377d671001c3"} Jun 09 05:38:55.014155 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:55.013823 2564 scope.go:117] "RemoveContainer" containerID="8d733dce355af750a7e92b1000d0ad674d5c068bc7b286377cbd9c629b47f3ae" Jun 09 05:38:55.022642 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:55.022625 2564 scope.go:117] "RemoveContainer" containerID="8d733dce355af750a7e92b1000d0ad674d5c068bc7b286377cbd9c629b47f3ae" Jun 09 05:38:55.022915 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:38:55.022889 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d733dce355af750a7e92b1000d0ad674d5c068bc7b286377cbd9c629b47f3ae\": container with ID starting with 8d733dce355af750a7e92b1000d0ad674d5c068bc7b286377cbd9c629b47f3ae not found: ID does not exist" containerID="8d733dce355af750a7e92b1000d0ad674d5c068bc7b286377cbd9c629b47f3ae" Jun 09 05:38:55.022983 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:55.022927 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d733dce355af750a7e92b1000d0ad674d5c068bc7b286377cbd9c629b47f3ae"} err="failed to get container status \"8d733dce355af750a7e92b1000d0ad674d5c068bc7b286377cbd9c629b47f3ae\": rpc error: code = NotFound desc = could not find container \"8d733dce355af750a7e92b1000d0ad674d5c068bc7b286377cbd9c629b47f3ae\": container with ID starting with 8d733dce355af750a7e92b1000d0ad674d5c068bc7b286377cbd9c629b47f3ae not found: ID does not exist" Jun 09 05:38:55.035722 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:55.035701 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-67f6b6b44f-jx5hm"] Jun 09 05:38:55.040179 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:55.040159 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-67f6b6b44f-jx5hm"] Jun 09 05:38:56.346755 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:38:56.346724 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="99652907-c47f-4688-9f58-44fc647c50f5" path="/var/lib/kubelet/pods/99652907-c47f-4688-9f58-44fc647c50f5/volumes" Jun 09 05:39:05.001269 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:39:05.001233 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k7wbp"] Jun 09 05:39:05.001677 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:39:05.001667 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e647237-f2ec-4c24-81b0-303784382c2e" containerName="manager" Jun 09 05:39:05.001720 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:39:05.001679 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e647237-f2ec-4c24-81b0-303784382c2e" containerName="manager" Jun 09 05:39:05.001720 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:39:05.001694 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99652907-c47f-4688-9f58-44fc647c50f5" containerName="console" Jun 09 05:39:05.001720 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:39:05.001700 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="99652907-c47f-4688-9f58-44fc647c50f5" containerName="console" Jun 09 05:39:05.001847 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:39:05.001777 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e647237-f2ec-4c24-81b0-303784382c2e" containerName="manager" Jun 09 05:39:05.001847 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:39:05.001788 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="99652907-c47f-4688-9f58-44fc647c50f5" containerName="console" Jun 09 05:39:05.005146 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:39:05.005123 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-k7wbp" Jun 09 05:39:05.007507 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:39:05.007482 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 09 05:39:05.007611 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:39:05.007569 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-kcv5g\"" Jun 09 05:39:05.015116 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:39:05.015092 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k7wbp"] Jun 09 05:39:05.040266 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:39:05.040240 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k7wbp"] Jun 09 05:39:05.065167 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:39:05.065131 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkc8l\" (UniqueName: \"kubernetes.io/projected/ca590af8-3cb9-4ef3-af62-669a704c4ffe-kube-api-access-pkc8l\") pod \"limitador-limitador-54d6d988d5-k7wbp\" (UID: \"ca590af8-3cb9-4ef3-af62-669a704c4ffe\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-k7wbp" Jun 09 05:39:05.065316 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:39:05.065299 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ca590af8-3cb9-4ef3-af62-669a704c4ffe-config-file\") pod \"limitador-limitador-54d6d988d5-k7wbp\" (UID: \"ca590af8-3cb9-4ef3-af62-669a704c4ffe\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-k7wbp" Jun 09 05:39:05.165978 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:39:05.165949 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ca590af8-3cb9-4ef3-af62-669a704c4ffe-config-file\") pod \"limitador-limitador-54d6d988d5-k7wbp\" (UID: \"ca590af8-3cb9-4ef3-af62-669a704c4ffe\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-k7wbp" Jun 09 05:39:05.166092 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:39:05.166015 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkc8l\" (UniqueName: \"kubernetes.io/projected/ca590af8-3cb9-4ef3-af62-669a704c4ffe-kube-api-access-pkc8l\") pod \"limitador-limitador-54d6d988d5-k7wbp\" (UID: \"ca590af8-3cb9-4ef3-af62-669a704c4ffe\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-k7wbp" Jun 09 05:39:05.166534 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:39:05.166509 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ca590af8-3cb9-4ef3-af62-669a704c4ffe-config-file\") pod \"limitador-limitador-54d6d988d5-k7wbp\" (UID: \"ca590af8-3cb9-4ef3-af62-669a704c4ffe\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-k7wbp" Jun 09 05:39:05.174122 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:39:05.174096 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkc8l\" (UniqueName: \"kubernetes.io/projected/ca590af8-3cb9-4ef3-af62-669a704c4ffe-kube-api-access-pkc8l\") pod \"limitador-limitador-54d6d988d5-k7wbp\" (UID: \"ca590af8-3cb9-4ef3-af62-669a704c4ffe\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-k7wbp" Jun 09 05:39:05.316032 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:39:05.316006 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-k7wbp" Jun 09 05:39:05.439274 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:39:05.439245 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-7cq59"] Jun 09 05:39:05.442604 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:39:05.442586 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-7cq59" Jun 09 05:39:05.445034 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:39:05.445001 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-9dpmn\"" Jun 09 05:39:05.446786 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:39:05.446765 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-7cq59"] Jun 09 05:39:05.456782 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:39:05.456764 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k7wbp"] Jun 09 05:39:05.458402 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:39:05.458379 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca590af8_3cb9_4ef3_af62_669a704c4ffe.slice/crio-5a93c0aecd0a5dfa7e3fb771676b4711b76bfa0086a15c2d0b6800b199b53054 WatchSource:0}: Error finding container 5a93c0aecd0a5dfa7e3fb771676b4711b76bfa0086a15c2d0b6800b199b53054: Status 404 returned error can't find the container with id 5a93c0aecd0a5dfa7e3fb771676b4711b76bfa0086a15c2d0b6800b199b53054 Jun 09 05:39:05.468621 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:39:05.468603 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7q2k\" (UniqueName: \"kubernetes.io/projected/86d9797a-293b-459c-8e6a-34fabc44d3cb-kube-api-access-s7q2k\") pod \"authorino-58cd955675-7cq59\" (UID: \"86d9797a-293b-459c-8e6a-34fabc44d3cb\") " pod="kuadrant-system/authorino-58cd955675-7cq59" Jun 09 05:39:05.569962 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:39:05.569898 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7q2k\" (UniqueName: \"kubernetes.io/projected/86d9797a-293b-459c-8e6a-34fabc44d3cb-kube-api-access-s7q2k\") pod \"authorino-58cd955675-7cq59\" (UID: \"86d9797a-293b-459c-8e6a-34fabc44d3cb\") " pod="kuadrant-system/authorino-58cd955675-7cq59" Jun 09 05:39:05.577708 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:39:05.577679 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7q2k\" (UniqueName: \"kubernetes.io/projected/86d9797a-293b-459c-8e6a-34fabc44d3cb-kube-api-access-s7q2k\") pod \"authorino-58cd955675-7cq59\" (UID: \"86d9797a-293b-459c-8e6a-34fabc44d3cb\") " pod="kuadrant-system/authorino-58cd955675-7cq59" Jun 09 05:39:05.755393 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:39:05.755364 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-7cq59" Jun 09 05:39:05.926464 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:39:05.926421 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-7cq59"] Jun 09 05:39:05.928508 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:39:05.928480 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod86d9797a_293b_459c_8e6a_34fabc44d3cb.slice/crio-6b0394aebe8452b2ca9d26664c556a42c172da18ffb1de24740c63c3e51aeac2 WatchSource:0}: Error finding container 6b0394aebe8452b2ca9d26664c556a42c172da18ffb1de24740c63c3e51aeac2: Status 404 returned error can't find the container with id 6b0394aebe8452b2ca9d26664c556a42c172da18ffb1de24740c63c3e51aeac2 Jun 09 05:39:06.079368 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:39:06.079310 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-7cq59" event={"ID":"86d9797a-293b-459c-8e6a-34fabc44d3cb","Type":"ContainerStarted","Data":"6b0394aebe8452b2ca9d26664c556a42c172da18ffb1de24740c63c3e51aeac2"} Jun 09 05:39:06.081788 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:39:06.081703 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-k7wbp" event={"ID":"ca590af8-3cb9-4ef3-af62-669a704c4ffe","Type":"ContainerStarted","Data":"5a93c0aecd0a5dfa7e3fb771676b4711b76bfa0086a15c2d0b6800b199b53054"} Jun 09 05:39:09.197384 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:39:09.197346 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-7cq59"] Jun 09 05:39:10.110250 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:39:10.110215 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-7cq59" event={"ID":"86d9797a-293b-459c-8e6a-34fabc44d3cb","Type":"ContainerStarted","Data":"ae1542a4fa0bff352d5a3545401b3d6aa5f91d6beb8751a51de1ddf8a7f425e8"} Jun 09 05:39:10.110438 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:39:10.110274 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-7cq59" podUID="86d9797a-293b-459c-8e6a-34fabc44d3cb" containerName="authorino" containerID="cri-o://ae1542a4fa0bff352d5a3545401b3d6aa5f91d6beb8751a51de1ddf8a7f425e8" gracePeriod=30 Jun 09 05:39:10.111968 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:39:10.111942 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-k7wbp" event={"ID":"ca590af8-3cb9-4ef3-af62-669a704c4ffe","Type":"ContainerStarted","Data":"b4b9696cf882aa82fbc9a3bc69ecb76daa5e352d73c82f9d254b273cd1b6ba27"} Jun 09 05:39:10.112089 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:39:10.112038 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-k7wbp" Jun 09 05:39:10.126135 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:39:10.126095 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-7cq59" podStartSLOduration=1.426101788 podStartE2EDuration="5.126080941s" totalImagesPullingTime="3.699979153s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 05:39:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 05:39:10.123373239 +0000 UTC m=+600.206024974" watchObservedRunningTime="2026-06-09 05:39:10.126080941 +0000 UTC m=+600.208732704" Jun 09 05:39:10.138763 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:39:10.138722 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-k7wbp" podStartSLOduration=1.9713814539999999 podStartE2EDuration="6.138709631s" totalImagesPullingTime="4.167328177s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 05:39:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 05:39:10.136867442 +0000 UTC m=+600.219519213" watchObservedRunningTime="2026-06-09 05:39:10.138709631 +0000 UTC m=+600.221361366" Jun 09 05:39:10.297849 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:39:10.297820 2564 info.go:109] Failed to get network devices: open /sys/class/net/6b0394aebe8452b/address: no such file or directory Jun 09 05:39:10.354129 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:39:10.354105 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-42h5b_02c37648-4419-4ff7-a316-568fa0510cee/ovn-acl-logging/0.log" Jun 09 05:39:10.354332 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:39:10.354309 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-42h5b_02c37648-4419-4ff7-a316-568fa0510cee/ovn-acl-logging/0.log" Jun 09 05:39:10.375196 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:39:10.375180 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-7cq59" Jun 09 05:39:10.411415 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:39:10.411395 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s7q2k\" (UniqueName: \"kubernetes.io/projected/86d9797a-293b-459c-8e6a-34fabc44d3cb-kube-api-access-s7q2k\") pod \"86d9797a-293b-459c-8e6a-34fabc44d3cb\" (UID: \"86d9797a-293b-459c-8e6a-34fabc44d3cb\") " Jun 09 05:39:10.413356 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:39:10.413329 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86d9797a-293b-459c-8e6a-34fabc44d3cb-kube-api-access-s7q2k" (OuterVolumeSpecName: "kube-api-access-s7q2k") pod "86d9797a-293b-459c-8e6a-34fabc44d3cb" (UID: "86d9797a-293b-459c-8e6a-34fabc44d3cb"). InnerVolumeSpecName "kube-api-access-s7q2k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 05:39:10.512513 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:39:10.512483 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s7q2k\" (UniqueName: \"kubernetes.io/projected/86d9797a-293b-459c-8e6a-34fabc44d3cb-kube-api-access-s7q2k\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:39:11.124906 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:39:11.124880 2564 generic.go:356] "Generic (PLEG): container finished" podID="86d9797a-293b-459c-8e6a-34fabc44d3cb" containerID="ae1542a4fa0bff352d5a3545401b3d6aa5f91d6beb8751a51de1ddf8a7f425e8" exitCode=0 Jun 09 05:39:11.125087 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:39:11.124944 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-7cq59" Jun 09 05:39:11.125087 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:39:11.124945 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-7cq59" event={"ID":"86d9797a-293b-459c-8e6a-34fabc44d3cb","Type":"ContainerDied","Data":"ae1542a4fa0bff352d5a3545401b3d6aa5f91d6beb8751a51de1ddf8a7f425e8"} Jun 09 05:39:11.125087 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:39:11.124984 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-7cq59" event={"ID":"86d9797a-293b-459c-8e6a-34fabc44d3cb","Type":"ContainerDied","Data":"6b0394aebe8452b2ca9d26664c556a42c172da18ffb1de24740c63c3e51aeac2"} Jun 09 05:39:11.125087 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:39:11.125000 2564 scope.go:117] "RemoveContainer" containerID="ae1542a4fa0bff352d5a3545401b3d6aa5f91d6beb8751a51de1ddf8a7f425e8" Jun 09 05:39:11.133862 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:39:11.133846 2564 scope.go:117] "RemoveContainer" containerID="ae1542a4fa0bff352d5a3545401b3d6aa5f91d6beb8751a51de1ddf8a7f425e8" Jun 09 05:39:11.134104 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:39:11.134088 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae1542a4fa0bff352d5a3545401b3d6aa5f91d6beb8751a51de1ddf8a7f425e8\": container with ID starting with ae1542a4fa0bff352d5a3545401b3d6aa5f91d6beb8751a51de1ddf8a7f425e8 not found: ID does not exist" containerID="ae1542a4fa0bff352d5a3545401b3d6aa5f91d6beb8751a51de1ddf8a7f425e8" Jun 09 05:39:11.134162 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:39:11.134109 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae1542a4fa0bff352d5a3545401b3d6aa5f91d6beb8751a51de1ddf8a7f425e8"} err="failed to get container status \"ae1542a4fa0bff352d5a3545401b3d6aa5f91d6beb8751a51de1ddf8a7f425e8\": rpc error: code = NotFound desc = could not find container \"ae1542a4fa0bff352d5a3545401b3d6aa5f91d6beb8751a51de1ddf8a7f425e8\": container with ID starting with ae1542a4fa0bff352d5a3545401b3d6aa5f91d6beb8751a51de1ddf8a7f425e8 not found: ID does not exist" Jun 09 05:39:11.145127 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:39:11.145104 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-7cq59"] Jun 09 05:39:11.148289 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:39:11.148270 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-7cq59"] Jun 09 05:39:12.347452 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:39:12.347420 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86d9797a-293b-459c-8e6a-34fabc44d3cb" path="/var/lib/kubelet/pods/86d9797a-293b-459c-8e6a-34fabc44d3cb/volumes" Jun 09 05:39:21.125899 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:39:21.125819 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-k7wbp" Jun 09 05:39:36.591114 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:39:36.591079 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748bx8qp"] Jun 09 05:39:36.598031 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:39:36.591474 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86d9797a-293b-459c-8e6a-34fabc44d3cb" containerName="authorino" Jun 09 05:39:36.598031 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:39:36.591485 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="86d9797a-293b-459c-8e6a-34fabc44d3cb" containerName="authorino" Jun 09 05:39:36.598031 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:39:36.591574 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="86d9797a-293b-459c-8e6a-34fabc44d3cb" containerName="authorino" Jun 09 05:39:36.601502 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:39:36.601471 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748bx8qp" Jun 09 05:39:36.603150 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:39:36.603123 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748bx8qp"] Jun 09 05:39:36.604175 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:39:36.604145 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 05:39:36.604983 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:39:36.604956 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 05:39:36.605091 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:39:36.605037 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-pcs6v\"" Jun 09 05:39:36.718872 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:39:36.718844 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ae7ac21-239f-4792-a17e-e09314403141-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748bx8qp\" (UID: \"4ae7ac21-239f-4792-a17e-e09314403141\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748bx8qp" Jun 09 05:39:36.718980 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:39:36.718897 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ae7ac21-239f-4792-a17e-e09314403141-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748bx8qp\" (UID: \"4ae7ac21-239f-4792-a17e-e09314403141\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748bx8qp" Jun 09 05:39:36.719033 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:39:36.718992 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4d7fr\" (UniqueName: \"kubernetes.io/projected/4ae7ac21-239f-4792-a17e-e09314403141-kube-api-access-4d7fr\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748bx8qp\" (UID: \"4ae7ac21-239f-4792-a17e-e09314403141\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748bx8qp" Jun 09 05:39:36.819722 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:39:36.819693 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ae7ac21-239f-4792-a17e-e09314403141-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748bx8qp\" (UID: \"4ae7ac21-239f-4792-a17e-e09314403141\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748bx8qp" Jun 09 05:39:36.819870 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:39:36.819744 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ae7ac21-239f-4792-a17e-e09314403141-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748bx8qp\" (UID: \"4ae7ac21-239f-4792-a17e-e09314403141\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748bx8qp" Jun 09 05:39:36.819870 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:39:36.819818 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4d7fr\" (UniqueName: \"kubernetes.io/projected/4ae7ac21-239f-4792-a17e-e09314403141-kube-api-access-4d7fr\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748bx8qp\" (UID: \"4ae7ac21-239f-4792-a17e-e09314403141\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748bx8qp" Jun 09 05:39:36.820052 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:39:36.820033 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ae7ac21-239f-4792-a17e-e09314403141-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748bx8qp\" (UID: \"4ae7ac21-239f-4792-a17e-e09314403141\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748bx8qp" Jun 09 05:39:36.820121 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:39:36.820073 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ae7ac21-239f-4792-a17e-e09314403141-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748bx8qp\" (UID: \"4ae7ac21-239f-4792-a17e-e09314403141\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748bx8qp" Jun 09 05:39:36.829541 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:39:36.829518 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4d7fr\" (UniqueName: \"kubernetes.io/projected/4ae7ac21-239f-4792-a17e-e09314403141-kube-api-access-4d7fr\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748bx8qp\" (UID: \"4ae7ac21-239f-4792-a17e-e09314403141\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748bx8qp" Jun 09 05:39:36.912228 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:39:36.912175 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748bx8qp" Jun 09 05:39:37.041233 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:39:37.041210 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748bx8qp"] Jun 09 05:39:37.042764 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:39:37.042744 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ae7ac21_239f_4792_a17e_e09314403141.slice/crio-e2d5bc24a02e1877125d9c2824cc797fd0c71b23b66523ab458e8a9c256758a2 WatchSource:0}: Error finding container e2d5bc24a02e1877125d9c2824cc797fd0c71b23b66523ab458e8a9c256758a2: Status 404 returned error can't find the container with id e2d5bc24a02e1877125d9c2824cc797fd0c71b23b66523ab458e8a9c256758a2 Jun 09 05:39:37.272363 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:39:37.272307 2564 generic.go:356] "Generic (PLEG): container finished" podID="4ae7ac21-239f-4792-a17e-e09314403141" containerID="a325075232aa56d262d4726d0a7fdd5a20001b47dc2d9725b2b0a1624112f848" exitCode=0 Jun 09 05:39:37.272469 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:39:37.272395 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748bx8qp" event={"ID":"4ae7ac21-239f-4792-a17e-e09314403141","Type":"ContainerDied","Data":"a325075232aa56d262d4726d0a7fdd5a20001b47dc2d9725b2b0a1624112f848"} Jun 09 05:39:37.272469 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:39:37.272452 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748bx8qp" event={"ID":"4ae7ac21-239f-4792-a17e-e09314403141","Type":"ContainerStarted","Data":"e2d5bc24a02e1877125d9c2824cc797fd0c71b23b66523ab458e8a9c256758a2"} Jun 09 05:39:38.280764 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:39:38.280688 2564 generic.go:356] "Generic (PLEG): container finished" podID="4ae7ac21-239f-4792-a17e-e09314403141" containerID="b3ccaaf0f01ba99cbed52dbdfd93cb6018bad20c7926973ad474f83d19e29f5c" exitCode=0 Jun 09 05:39:38.281159 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:39:38.280765 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748bx8qp" event={"ID":"4ae7ac21-239f-4792-a17e-e09314403141","Type":"ContainerDied","Data":"b3ccaaf0f01ba99cbed52dbdfd93cb6018bad20c7926973ad474f83d19e29f5c"} Jun 09 05:39:39.288974 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:39:39.288940 2564 generic.go:356] "Generic (PLEG): container finished" podID="4ae7ac21-239f-4792-a17e-e09314403141" containerID="ffe2ef407ecf9aae4aa118bfe828d190e797548d58f5a1341fa8f6e36d1f5712" exitCode=0 Jun 09 05:39:39.289350 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:39:39.289065 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748bx8qp" event={"ID":"4ae7ac21-239f-4792-a17e-e09314403141","Type":"ContainerDied","Data":"ffe2ef407ecf9aae4aa118bfe828d190e797548d58f5a1341fa8f6e36d1f5712"} Jun 09 05:39:40.429153 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:39:40.429130 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748bx8qp" Jun 09 05:39:40.552518 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:39:40.552444 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ae7ac21-239f-4792-a17e-e09314403141-util\") pod \"4ae7ac21-239f-4792-a17e-e09314403141\" (UID: \"4ae7ac21-239f-4792-a17e-e09314403141\") " Jun 09 05:39:40.552518 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:39:40.552507 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4d7fr\" (UniqueName: \"kubernetes.io/projected/4ae7ac21-239f-4792-a17e-e09314403141-kube-api-access-4d7fr\") pod \"4ae7ac21-239f-4792-a17e-e09314403141\" (UID: \"4ae7ac21-239f-4792-a17e-e09314403141\") " Jun 09 05:39:40.552729 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:39:40.552552 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ae7ac21-239f-4792-a17e-e09314403141-bundle\") pod \"4ae7ac21-239f-4792-a17e-e09314403141\" (UID: \"4ae7ac21-239f-4792-a17e-e09314403141\") " Jun 09 05:39:40.553046 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:39:40.553022 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ae7ac21-239f-4792-a17e-e09314403141-bundle" (OuterVolumeSpecName: "bundle") pod "4ae7ac21-239f-4792-a17e-e09314403141" (UID: "4ae7ac21-239f-4792-a17e-e09314403141"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 05:39:40.554331 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:39:40.554311 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ae7ac21-239f-4792-a17e-e09314403141-kube-api-access-4d7fr" (OuterVolumeSpecName: "kube-api-access-4d7fr") pod "4ae7ac21-239f-4792-a17e-e09314403141" (UID: "4ae7ac21-239f-4792-a17e-e09314403141"). InnerVolumeSpecName "kube-api-access-4d7fr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 05:39:40.561205 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:39:40.561187 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ae7ac21-239f-4792-a17e-e09314403141-util" (OuterVolumeSpecName: "util") pod "4ae7ac21-239f-4792-a17e-e09314403141" (UID: "4ae7ac21-239f-4792-a17e-e09314403141"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 05:39:40.653256 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:39:40.653232 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ae7ac21-239f-4792-a17e-e09314403141-bundle\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:39:40.653256 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:39:40.653251 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ae7ac21-239f-4792-a17e-e09314403141-util\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:39:40.653397 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:39:40.653260 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4d7fr\" (UniqueName: \"kubernetes.io/projected/4ae7ac21-239f-4792-a17e-e09314403141-kube-api-access-4d7fr\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:39:41.302311 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:39:41.302281 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748bx8qp" Jun 09 05:39:41.302311 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:39:41.302302 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748bx8qp" event={"ID":"4ae7ac21-239f-4792-a17e-e09314403141","Type":"ContainerDied","Data":"e2d5bc24a02e1877125d9c2824cc797fd0c71b23b66523ab458e8a9c256758a2"} Jun 09 05:39:41.302569 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:39:41.302364 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e2d5bc24a02e1877125d9c2824cc797fd0c71b23b66523ab458e8a9c256758a2" Jun 09 05:40:29.062712 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:40:29.062677 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-lsbfv"] Jun 09 05:40:29.063217 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:40:29.063098 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ae7ac21-239f-4792-a17e-e09314403141" containerName="util" Jun 09 05:40:29.063217 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:40:29.063112 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ae7ac21-239f-4792-a17e-e09314403141" containerName="util" Jun 09 05:40:29.063217 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:40:29.063128 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ae7ac21-239f-4792-a17e-e09314403141" containerName="extract" Jun 09 05:40:29.063217 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:40:29.063134 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ae7ac21-239f-4792-a17e-e09314403141" containerName="extract" Jun 09 05:40:29.063217 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:40:29.063151 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ae7ac21-239f-4792-a17e-e09314403141" containerName="pull" Jun 09 05:40:29.063217 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:40:29.063156 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ae7ac21-239f-4792-a17e-e09314403141" containerName="pull" Jun 09 05:40:29.063423 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:40:29.063227 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ae7ac21-239f-4792-a17e-e09314403141" containerName="extract" Jun 09 05:40:29.066276 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:40:29.066261 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-lsbfv" Jun 09 05:40:29.068450 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:40:29.068428 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-9dpmn\"" Jun 09 05:40:29.073716 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:40:29.073212 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-lsbfv"] Jun 09 05:40:29.114692 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:40:29.114669 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6h5nd\" (UniqueName: \"kubernetes.io/projected/0da66c39-b0aa-4ee7-9b90-3e6334e1755b-kube-api-access-6h5nd\") pod \"authorino-5d4b67c446-lsbfv\" (UID: \"0da66c39-b0aa-4ee7-9b90-3e6334e1755b\") " pod="kuadrant-system/authorino-5d4b67c446-lsbfv" Jun 09 05:40:29.215081 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:40:29.215057 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6h5nd\" (UniqueName: \"kubernetes.io/projected/0da66c39-b0aa-4ee7-9b90-3e6334e1755b-kube-api-access-6h5nd\") pod \"authorino-5d4b67c446-lsbfv\" (UID: \"0da66c39-b0aa-4ee7-9b90-3e6334e1755b\") " pod="kuadrant-system/authorino-5d4b67c446-lsbfv" Jun 09 05:40:29.226775 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:40:29.226753 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6h5nd\" (UniqueName: \"kubernetes.io/projected/0da66c39-b0aa-4ee7-9b90-3e6334e1755b-kube-api-access-6h5nd\") pod \"authorino-5d4b67c446-lsbfv\" (UID: \"0da66c39-b0aa-4ee7-9b90-3e6334e1755b\") " pod="kuadrant-system/authorino-5d4b67c446-lsbfv" Jun 09 05:40:29.294774 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:40:29.294740 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-lsbfv"] Jun 09 05:40:29.294995 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:40:29.294981 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-lsbfv" Jun 09 05:40:29.320297 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:40:29.320235 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-64f45fddf6-z62px"] Jun 09 05:40:29.324195 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:40:29.324170 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-64f45fddf6-z62px" Jun 09 05:40:29.332523 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:40:29.332500 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-64f45fddf6-z62px"] Jun 09 05:40:29.416409 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:40:29.416379 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bbjw\" (UniqueName: \"kubernetes.io/projected/2a9efab8-8aee-41d0-a828-a6358689bf6f-kube-api-access-4bbjw\") pod \"authorino-64f45fddf6-z62px\" (UID: \"2a9efab8-8aee-41d0-a828-a6358689bf6f\") " pod="kuadrant-system/authorino-64f45fddf6-z62px" Jun 09 05:40:29.454634 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:40:29.454612 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-lsbfv"] Jun 09 05:40:29.456516 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:40:29.456489 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0da66c39_b0aa_4ee7_9b90_3e6334e1755b.slice/crio-1e90b0abcfef3781c2f371eb6d9a99b631a8d1b628c7c16b17f922b02f5a4b5f WatchSource:0}: Error finding container 1e90b0abcfef3781c2f371eb6d9a99b631a8d1b628c7c16b17f922b02f5a4b5f: Status 404 returned error can't find the container with id 1e90b0abcfef3781c2f371eb6d9a99b631a8d1b628c7c16b17f922b02f5a4b5f Jun 09 05:40:29.457844 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:40:29.457826 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 05:40:29.516997 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:40:29.516972 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bbjw\" (UniqueName: \"kubernetes.io/projected/2a9efab8-8aee-41d0-a828-a6358689bf6f-kube-api-access-4bbjw\") pod \"authorino-64f45fddf6-z62px\" (UID: \"2a9efab8-8aee-41d0-a828-a6358689bf6f\") " pod="kuadrant-system/authorino-64f45fddf6-z62px" Jun 09 05:40:29.526194 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:40:29.526161 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bbjw\" (UniqueName: \"kubernetes.io/projected/2a9efab8-8aee-41d0-a828-a6358689bf6f-kube-api-access-4bbjw\") pod \"authorino-64f45fddf6-z62px\" (UID: \"2a9efab8-8aee-41d0-a828-a6358689bf6f\") " pod="kuadrant-system/authorino-64f45fddf6-z62px" Jun 09 05:40:29.571663 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:40:29.571606 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-lsbfv" event={"ID":"0da66c39-b0aa-4ee7-9b90-3e6334e1755b","Type":"ContainerStarted","Data":"1e90b0abcfef3781c2f371eb6d9a99b631a8d1b628c7c16b17f922b02f5a4b5f"} Jun 09 05:40:29.634397 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:40:29.634378 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-64f45fddf6-z62px" Jun 09 05:40:29.765584 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:40:29.765561 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-64f45fddf6-z62px"] Jun 09 05:40:29.767141 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:40:29.767115 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2a9efab8_8aee_41d0_a828_a6358689bf6f.slice/crio-573127fcf1d66d225c8b50f730449255f00267ee22be20792e5af53130376a25 WatchSource:0}: Error finding container 573127fcf1d66d225c8b50f730449255f00267ee22be20792e5af53130376a25: Status 404 returned error can't find the container with id 573127fcf1d66d225c8b50f730449255f00267ee22be20792e5af53130376a25 Jun 09 05:40:29.914374 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:40:29.914343 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-64f45fddf6-z62px"] Jun 09 05:40:29.944043 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:40:29.944008 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-865486fc4d-4blrg"] Jun 09 05:40:29.949099 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:40:29.949073 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-865486fc4d-4blrg" Jun 09 05:40:29.951034 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:40:29.951010 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-865486fc4d-4blrg"] Jun 09 05:40:29.951430 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:40:29.951413 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 09 05:40:30.022927 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:40:30.022890 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/74a171e1-f016-4f6f-ad00-d9cdf4e10382-tls-cert\") pod \"authorino-865486fc4d-4blrg\" (UID: \"74a171e1-f016-4f6f-ad00-d9cdf4e10382\") " pod="kuadrant-system/authorino-865486fc4d-4blrg" Jun 09 05:40:30.023128 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:40:30.023105 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pw8l\" (UniqueName: \"kubernetes.io/projected/74a171e1-f016-4f6f-ad00-d9cdf4e10382-kube-api-access-8pw8l\") pod \"authorino-865486fc4d-4blrg\" (UID: \"74a171e1-f016-4f6f-ad00-d9cdf4e10382\") " pod="kuadrant-system/authorino-865486fc4d-4blrg" Jun 09 05:40:30.123993 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:40:30.123970 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pw8l\" (UniqueName: \"kubernetes.io/projected/74a171e1-f016-4f6f-ad00-d9cdf4e10382-kube-api-access-8pw8l\") pod \"authorino-865486fc4d-4blrg\" (UID: \"74a171e1-f016-4f6f-ad00-d9cdf4e10382\") " pod="kuadrant-system/authorino-865486fc4d-4blrg" Jun 09 05:40:30.124259 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:40:30.124013 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/74a171e1-f016-4f6f-ad00-d9cdf4e10382-tls-cert\") pod \"authorino-865486fc4d-4blrg\" (UID: \"74a171e1-f016-4f6f-ad00-d9cdf4e10382\") " pod="kuadrant-system/authorino-865486fc4d-4blrg" Jun 09 05:40:30.126265 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:40:30.126241 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/74a171e1-f016-4f6f-ad00-d9cdf4e10382-tls-cert\") pod \"authorino-865486fc4d-4blrg\" (UID: \"74a171e1-f016-4f6f-ad00-d9cdf4e10382\") " pod="kuadrant-system/authorino-865486fc4d-4blrg" Jun 09 05:40:30.131280 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:40:30.131261 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pw8l\" (UniqueName: \"kubernetes.io/projected/74a171e1-f016-4f6f-ad00-d9cdf4e10382-kube-api-access-8pw8l\") pod \"authorino-865486fc4d-4blrg\" (UID: \"74a171e1-f016-4f6f-ad00-d9cdf4e10382\") " pod="kuadrant-system/authorino-865486fc4d-4blrg" Jun 09 05:40:30.259783 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:40:30.259753 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-865486fc4d-4blrg" Jun 09 05:40:30.397504 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:40:30.397477 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-865486fc4d-4blrg"] Jun 09 05:40:30.400048 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:40:30.400022 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod74a171e1_f016_4f6f_ad00_d9cdf4e10382.slice/crio-a470e7f9338c0dadd914199fab1bb9db5bd12a2674850b2d8412aebbab987d89 WatchSource:0}: Error finding container a470e7f9338c0dadd914199fab1bb9db5bd12a2674850b2d8412aebbab987d89: Status 404 returned error can't find the container with id a470e7f9338c0dadd914199fab1bb9db5bd12a2674850b2d8412aebbab987d89 Jun 09 05:40:30.578459 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:40:30.578430 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-lsbfv" event={"ID":"0da66c39-b0aa-4ee7-9b90-3e6334e1755b","Type":"ContainerStarted","Data":"e4f09f32cfa39dc0ede1e3465ff2fa2ba58eadb62a40453b52acee216634fead"} Jun 09 05:40:30.578564 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:40:30.578497 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-lsbfv" podUID="0da66c39-b0aa-4ee7-9b90-3e6334e1755b" containerName="authorino" containerID="cri-o://e4f09f32cfa39dc0ede1e3465ff2fa2ba58eadb62a40453b52acee216634fead" gracePeriod=30 Jun 09 05:40:30.580185 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:40:30.580160 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-64f45fddf6-z62px" event={"ID":"2a9efab8-8aee-41d0-a828-a6358689bf6f","Type":"ContainerStarted","Data":"fab4b61e61bf1d8389844c09189f12ca71802943065d1546218a350408fac592"} Jun 09 05:40:30.580292 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:40:30.580197 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-64f45fddf6-z62px" event={"ID":"2a9efab8-8aee-41d0-a828-a6358689bf6f","Type":"ContainerStarted","Data":"573127fcf1d66d225c8b50f730449255f00267ee22be20792e5af53130376a25"} Jun 09 05:40:30.580292 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:40:30.580159 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-64f45fddf6-z62px" podUID="2a9efab8-8aee-41d0-a828-a6358689bf6f" containerName="authorino" containerID="cri-o://fab4b61e61bf1d8389844c09189f12ca71802943065d1546218a350408fac592" gracePeriod=30 Jun 09 05:40:30.581669 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:40:30.581646 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-865486fc4d-4blrg" event={"ID":"74a171e1-f016-4f6f-ad00-d9cdf4e10382","Type":"ContainerStarted","Data":"a470e7f9338c0dadd914199fab1bb9db5bd12a2674850b2d8412aebbab987d89"} Jun 09 05:40:30.594146 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:40:30.593977 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-lsbfv" podStartSLOduration=1.247030679 podStartE2EDuration="1.593964946s" totalImagesPullingTime="346.934267ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 05:40:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 05:40:30.593049067 +0000 UTC m=+680.675700806" watchObservedRunningTime="2026-06-09 05:40:30.593964946 +0000 UTC m=+680.676616681" Jun 09 05:40:30.605357 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:40:30.605279 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-64f45fddf6-z62px" podStartSLOduration=1.296216373 podStartE2EDuration="1.605263478s" totalImagesPullingTime="309.047105ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 05:40:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 05:40:30.604955781 +0000 UTC m=+680.687607517" watchObservedRunningTime="2026-06-09 05:40:30.605263478 +0000 UTC m=+680.687915215" Jun 09 05:40:30.846381 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:40:30.846355 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-64f45fddf6-z62px" Jun 09 05:40:30.850693 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:40:30.850174 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-lsbfv" Jun 09 05:40:30.929615 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:40:30.929534 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4bbjw\" (UniqueName: \"kubernetes.io/projected/2a9efab8-8aee-41d0-a828-a6358689bf6f-kube-api-access-4bbjw\") pod \"2a9efab8-8aee-41d0-a828-a6358689bf6f\" (UID: \"2a9efab8-8aee-41d0-a828-a6358689bf6f\") " Jun 09 05:40:30.929615 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:40:30.929590 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6h5nd\" (UniqueName: \"kubernetes.io/projected/0da66c39-b0aa-4ee7-9b90-3e6334e1755b-kube-api-access-6h5nd\") pod \"0da66c39-b0aa-4ee7-9b90-3e6334e1755b\" (UID: \"0da66c39-b0aa-4ee7-9b90-3e6334e1755b\") " Jun 09 05:40:30.931585 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:40:30.931551 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a9efab8-8aee-41d0-a828-a6358689bf6f-kube-api-access-4bbjw" (OuterVolumeSpecName: "kube-api-access-4bbjw") pod "2a9efab8-8aee-41d0-a828-a6358689bf6f" (UID: "2a9efab8-8aee-41d0-a828-a6358689bf6f"). InnerVolumeSpecName "kube-api-access-4bbjw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 05:40:30.931707 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:40:30.931618 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0da66c39-b0aa-4ee7-9b90-3e6334e1755b-kube-api-access-6h5nd" (OuterVolumeSpecName: "kube-api-access-6h5nd") pod "0da66c39-b0aa-4ee7-9b90-3e6334e1755b" (UID: "0da66c39-b0aa-4ee7-9b90-3e6334e1755b"). InnerVolumeSpecName "kube-api-access-6h5nd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 05:40:31.030303 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:40:31.030276 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4bbjw\" (UniqueName: \"kubernetes.io/projected/2a9efab8-8aee-41d0-a828-a6358689bf6f-kube-api-access-4bbjw\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:40:31.030303 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:40:31.030299 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6h5nd\" (UniqueName: \"kubernetes.io/projected/0da66c39-b0aa-4ee7-9b90-3e6334e1755b-kube-api-access-6h5nd\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:40:31.590538 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:40:31.590502 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-865486fc4d-4blrg" event={"ID":"74a171e1-f016-4f6f-ad00-d9cdf4e10382","Type":"ContainerStarted","Data":"9770644a4a24131a279b0d376c29c42489d1df37ffeba769a0a86dd8778d201c"} Jun 09 05:40:31.591628 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:40:31.591604 2564 generic.go:356] "Generic (PLEG): container finished" podID="0da66c39-b0aa-4ee7-9b90-3e6334e1755b" containerID="e4f09f32cfa39dc0ede1e3465ff2fa2ba58eadb62a40453b52acee216634fead" exitCode=0 Jun 09 05:40:31.591759 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:40:31.591634 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-lsbfv" Jun 09 05:40:31.591759 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:40:31.591684 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-lsbfv" event={"ID":"0da66c39-b0aa-4ee7-9b90-3e6334e1755b","Type":"ContainerDied","Data":"e4f09f32cfa39dc0ede1e3465ff2fa2ba58eadb62a40453b52acee216634fead"} Jun 09 05:40:31.591759 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:40:31.591726 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-lsbfv" event={"ID":"0da66c39-b0aa-4ee7-9b90-3e6334e1755b","Type":"ContainerDied","Data":"1e90b0abcfef3781c2f371eb6d9a99b631a8d1b628c7c16b17f922b02f5a4b5f"} Jun 09 05:40:31.591759 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:40:31.591748 2564 scope.go:117] "RemoveContainer" containerID="e4f09f32cfa39dc0ede1e3465ff2fa2ba58eadb62a40453b52acee216634fead" Jun 09 05:40:31.593009 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:40:31.592969 2564 generic.go:356] "Generic (PLEG): container finished" podID="2a9efab8-8aee-41d0-a828-a6358689bf6f" containerID="fab4b61e61bf1d8389844c09189f12ca71802943065d1546218a350408fac592" exitCode=0 Jun 09 05:40:31.593068 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:40:31.593011 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-64f45fddf6-z62px" Jun 09 05:40:31.593068 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:40:31.593024 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-64f45fddf6-z62px" event={"ID":"2a9efab8-8aee-41d0-a828-a6358689bf6f","Type":"ContainerDied","Data":"fab4b61e61bf1d8389844c09189f12ca71802943065d1546218a350408fac592"} Jun 09 05:40:31.593146 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:40:31.593044 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-64f45fddf6-z62px" event={"ID":"2a9efab8-8aee-41d0-a828-a6358689bf6f","Type":"ContainerDied","Data":"573127fcf1d66d225c8b50f730449255f00267ee22be20792e5af53130376a25"} Jun 09 05:40:31.603205 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:40:31.603187 2564 scope.go:117] "RemoveContainer" containerID="e4f09f32cfa39dc0ede1e3465ff2fa2ba58eadb62a40453b52acee216634fead" Jun 09 05:40:31.603575 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:40:31.603556 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4f09f32cfa39dc0ede1e3465ff2fa2ba58eadb62a40453b52acee216634fead\": container with ID starting with e4f09f32cfa39dc0ede1e3465ff2fa2ba58eadb62a40453b52acee216634fead not found: ID does not exist" containerID="e4f09f32cfa39dc0ede1e3465ff2fa2ba58eadb62a40453b52acee216634fead" Jun 09 05:40:31.603654 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:40:31.603581 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4f09f32cfa39dc0ede1e3465ff2fa2ba58eadb62a40453b52acee216634fead"} err="failed to get container status \"e4f09f32cfa39dc0ede1e3465ff2fa2ba58eadb62a40453b52acee216634fead\": rpc error: code = NotFound desc = could not find container \"e4f09f32cfa39dc0ede1e3465ff2fa2ba58eadb62a40453b52acee216634fead\": container with ID starting with e4f09f32cfa39dc0ede1e3465ff2fa2ba58eadb62a40453b52acee216634fead not found: ID does not exist" Jun 09 05:40:31.603654 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:40:31.603596 2564 scope.go:117] "RemoveContainer" containerID="fab4b61e61bf1d8389844c09189f12ca71802943065d1546218a350408fac592" Jun 09 05:40:31.606023 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:40:31.605987 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-865486fc4d-4blrg" podStartSLOduration=2.282504834 podStartE2EDuration="2.605974076s" totalImagesPullingTime="323.469242ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 05:40:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 05:40:31.604630624 +0000 UTC m=+681.687282361" watchObservedRunningTime="2026-06-09 05:40:31.605974076 +0000 UTC m=+681.688625812" Jun 09 05:40:31.612109 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:40:31.612085 2564 scope.go:117] "RemoveContainer" containerID="fab4b61e61bf1d8389844c09189f12ca71802943065d1546218a350408fac592" Jun 09 05:40:31.612398 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:40:31.612362 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fab4b61e61bf1d8389844c09189f12ca71802943065d1546218a350408fac592\": container with ID starting with fab4b61e61bf1d8389844c09189f12ca71802943065d1546218a350408fac592 not found: ID does not exist" containerID="fab4b61e61bf1d8389844c09189f12ca71802943065d1546218a350408fac592" Jun 09 05:40:31.612398 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:40:31.612393 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fab4b61e61bf1d8389844c09189f12ca71802943065d1546218a350408fac592"} err="failed to get container status \"fab4b61e61bf1d8389844c09189f12ca71802943065d1546218a350408fac592\": rpc error: code = NotFound desc = could not find container \"fab4b61e61bf1d8389844c09189f12ca71802943065d1546218a350408fac592\": container with ID starting with fab4b61e61bf1d8389844c09189f12ca71802943065d1546218a350408fac592 not found: ID does not exist" Jun 09 05:40:31.625154 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:40:31.625130 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-64f45fddf6-z62px"] Jun 09 05:40:31.627790 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:40:31.627772 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-64f45fddf6-z62px"] Jun 09 05:40:31.641810 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:40:31.641773 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-lsbfv"] Jun 09 05:40:31.646417 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:40:31.646392 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-lsbfv"] Jun 09 05:40:32.354386 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:40:32.354348 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0da66c39-b0aa-4ee7-9b90-3e6334e1755b" path="/var/lib/kubelet/pods/0da66c39-b0aa-4ee7-9b90-3e6334e1755b/volumes" Jun 09 05:40:32.354722 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:40:32.354708 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a9efab8-8aee-41d0-a828-a6358689bf6f" path="/var/lib/kubelet/pods/2a9efab8-8aee-41d0-a828-a6358689bf6f/volumes" Jun 09 05:41:09.970490 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:41:09.970456 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k7wbp"] Jun 09 05:41:58.008810 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:41:58.008705 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75bc595c54-fnk2r"] Jun 09 05:41:58.009446 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:41:58.009422 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0da66c39-b0aa-4ee7-9b90-3e6334e1755b" containerName="authorino" Jun 09 05:41:58.009536 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:41:58.009448 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="0da66c39-b0aa-4ee7-9b90-3e6334e1755b" containerName="authorino" Jun 09 05:41:58.009536 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:41:58.009462 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a9efab8-8aee-41d0-a828-a6358689bf6f" containerName="authorino" Jun 09 05:41:58.009536 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:41:58.009470 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a9efab8-8aee-41d0-a828-a6358689bf6f" containerName="authorino" Jun 09 05:41:58.009691 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:41:58.009589 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="0da66c39-b0aa-4ee7-9b90-3e6334e1755b" containerName="authorino" Jun 09 05:41:58.009691 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:41:58.009610 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a9efab8-8aee-41d0-a828-a6358689bf6f" containerName="authorino" Jun 09 05:41:58.012770 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:41:58.012750 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75bc595c54-fnk2r" Jun 09 05:41:58.015569 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:41:58.015368 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 09 05:41:58.021634 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:41:58.021611 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75bc595c54-fnk2r"] Jun 09 05:41:58.168228 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:41:58.168200 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/066a971b-7e7f-4226-b995-2601ce2f4f89-oidc-ca\") pod \"authorino-75bc595c54-fnk2r\" (UID: \"066a971b-7e7f-4226-b995-2601ce2f4f89\") " pod="kuadrant-system/authorino-75bc595c54-fnk2r" Jun 09 05:41:58.168353 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:41:58.168247 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/066a971b-7e7f-4226-b995-2601ce2f4f89-tls-cert\") pod \"authorino-75bc595c54-fnk2r\" (UID: \"066a971b-7e7f-4226-b995-2601ce2f4f89\") " pod="kuadrant-system/authorino-75bc595c54-fnk2r" Jun 09 05:41:58.168353 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:41:58.168272 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjwfz\" (UniqueName: \"kubernetes.io/projected/066a971b-7e7f-4226-b995-2601ce2f4f89-kube-api-access-gjwfz\") pod \"authorino-75bc595c54-fnk2r\" (UID: \"066a971b-7e7f-4226-b995-2601ce2f4f89\") " pod="kuadrant-system/authorino-75bc595c54-fnk2r" Jun 09 05:41:58.268830 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:41:58.268747 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/066a971b-7e7f-4226-b995-2601ce2f4f89-tls-cert\") pod \"authorino-75bc595c54-fnk2r\" (UID: \"066a971b-7e7f-4226-b995-2601ce2f4f89\") " pod="kuadrant-system/authorino-75bc595c54-fnk2r" Jun 09 05:41:58.268830 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:41:58.268817 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjwfz\" (UniqueName: \"kubernetes.io/projected/066a971b-7e7f-4226-b995-2601ce2f4f89-kube-api-access-gjwfz\") pod \"authorino-75bc595c54-fnk2r\" (UID: \"066a971b-7e7f-4226-b995-2601ce2f4f89\") " pod="kuadrant-system/authorino-75bc595c54-fnk2r" Jun 09 05:41:58.268981 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:41:58.268891 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/066a971b-7e7f-4226-b995-2601ce2f4f89-oidc-ca\") pod \"authorino-75bc595c54-fnk2r\" (UID: \"066a971b-7e7f-4226-b995-2601ce2f4f89\") " pod="kuadrant-system/authorino-75bc595c54-fnk2r" Jun 09 05:41:58.269526 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:41:58.269504 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/066a971b-7e7f-4226-b995-2601ce2f4f89-oidc-ca\") pod \"authorino-75bc595c54-fnk2r\" (UID: \"066a971b-7e7f-4226-b995-2601ce2f4f89\") " pod="kuadrant-system/authorino-75bc595c54-fnk2r" Jun 09 05:41:58.271130 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:41:58.271105 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/066a971b-7e7f-4226-b995-2601ce2f4f89-tls-cert\") pod \"authorino-75bc595c54-fnk2r\" (UID: \"066a971b-7e7f-4226-b995-2601ce2f4f89\") " pod="kuadrant-system/authorino-75bc595c54-fnk2r" Jun 09 05:41:58.276617 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:41:58.276595 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjwfz\" (UniqueName: \"kubernetes.io/projected/066a971b-7e7f-4226-b995-2601ce2f4f89-kube-api-access-gjwfz\") pod \"authorino-75bc595c54-fnk2r\" (UID: \"066a971b-7e7f-4226-b995-2601ce2f4f89\") " pod="kuadrant-system/authorino-75bc595c54-fnk2r" Jun 09 05:41:58.329578 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:41:58.329556 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75bc595c54-fnk2r" Jun 09 05:41:58.462211 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:41:58.462179 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75bc595c54-fnk2r"] Jun 09 05:41:58.463330 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:41:58.463307 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod066a971b_7e7f_4226_b995_2601ce2f4f89.slice/crio-e735eb238ea74f68e2d9ec74d3520011e72e9a85cf40484291f5a54540d31b2b WatchSource:0}: Error finding container e735eb238ea74f68e2d9ec74d3520011e72e9a85cf40484291f5a54540d31b2b: Status 404 returned error can't find the container with id e735eb238ea74f68e2d9ec74d3520011e72e9a85cf40484291f5a54540d31b2b Jun 09 05:41:59.102586 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:41:59.102552 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75bc595c54-fnk2r" event={"ID":"066a971b-7e7f-4226-b995-2601ce2f4f89","Type":"ContainerStarted","Data":"de1e5849303ac1f5fb84ddf75d1c2bd4c5fbba98ccf0d83d355fe005d8913cc3"} Jun 09 05:41:59.102993 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:41:59.102603 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75bc595c54-fnk2r" event={"ID":"066a971b-7e7f-4226-b995-2601ce2f4f89","Type":"ContainerStarted","Data":"e735eb238ea74f68e2d9ec74d3520011e72e9a85cf40484291f5a54540d31b2b"} Jun 09 05:41:59.118441 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:41:59.118391 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75bc595c54-fnk2r" podStartSLOduration=1.66562999 podStartE2EDuration="2.118375417s" totalImagesPullingTime="452.745427ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 05:41:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 05:41:59.115740608 +0000 UTC m=+769.198392344" watchObservedRunningTime="2026-06-09 05:41:59.118375417 +0000 UTC m=+769.201027153" Jun 09 05:41:59.142964 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:41:59.142928 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-865486fc4d-4blrg"] Jun 09 05:41:59.143172 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:41:59.143145 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-865486fc4d-4blrg" podUID="74a171e1-f016-4f6f-ad00-d9cdf4e10382" containerName="authorino" containerID="cri-o://9770644a4a24131a279b0d376c29c42489d1df37ffeba769a0a86dd8778d201c" gracePeriod=30 Jun 09 05:41:59.404200 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:41:59.404175 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-865486fc4d-4blrg" Jun 09 05:41:59.579985 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:41:59.579955 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/74a171e1-f016-4f6f-ad00-d9cdf4e10382-tls-cert\") pod \"74a171e1-f016-4f6f-ad00-d9cdf4e10382\" (UID: \"74a171e1-f016-4f6f-ad00-d9cdf4e10382\") " Jun 09 05:41:59.580153 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:41:59.580027 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8pw8l\" (UniqueName: \"kubernetes.io/projected/74a171e1-f016-4f6f-ad00-d9cdf4e10382-kube-api-access-8pw8l\") pod \"74a171e1-f016-4f6f-ad00-d9cdf4e10382\" (UID: \"74a171e1-f016-4f6f-ad00-d9cdf4e10382\") " Jun 09 05:41:59.581993 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:41:59.581961 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74a171e1-f016-4f6f-ad00-d9cdf4e10382-kube-api-access-8pw8l" (OuterVolumeSpecName: "kube-api-access-8pw8l") pod "74a171e1-f016-4f6f-ad00-d9cdf4e10382" (UID: "74a171e1-f016-4f6f-ad00-d9cdf4e10382"). InnerVolumeSpecName "kube-api-access-8pw8l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 05:41:59.590096 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:41:59.590075 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74a171e1-f016-4f6f-ad00-d9cdf4e10382-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "74a171e1-f016-4f6f-ad00-d9cdf4e10382" (UID: "74a171e1-f016-4f6f-ad00-d9cdf4e10382"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 05:41:59.680868 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:41:59.680845 2564 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/74a171e1-f016-4f6f-ad00-d9cdf4e10382-tls-cert\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:41:59.680868 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:41:59.680868 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8pw8l\" (UniqueName: \"kubernetes.io/projected/74a171e1-f016-4f6f-ad00-d9cdf4e10382-kube-api-access-8pw8l\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:42:00.109710 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:42:00.109677 2564 generic.go:356] "Generic (PLEG): container finished" podID="74a171e1-f016-4f6f-ad00-d9cdf4e10382" containerID="9770644a4a24131a279b0d376c29c42489d1df37ffeba769a0a86dd8778d201c" exitCode=0 Jun 09 05:42:00.110119 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:42:00.109716 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-865486fc4d-4blrg" Jun 09 05:42:00.110119 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:42:00.109758 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-865486fc4d-4blrg" event={"ID":"74a171e1-f016-4f6f-ad00-d9cdf4e10382","Type":"ContainerDied","Data":"9770644a4a24131a279b0d376c29c42489d1df37ffeba769a0a86dd8778d201c"} Jun 09 05:42:00.110119 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:42:00.109817 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-865486fc4d-4blrg" event={"ID":"74a171e1-f016-4f6f-ad00-d9cdf4e10382","Type":"ContainerDied","Data":"a470e7f9338c0dadd914199fab1bb9db5bd12a2674850b2d8412aebbab987d89"} Jun 09 05:42:00.110119 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:42:00.109836 2564 scope.go:117] "RemoveContainer" containerID="9770644a4a24131a279b0d376c29c42489d1df37ffeba769a0a86dd8778d201c" Jun 09 05:42:00.119655 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:42:00.119641 2564 scope.go:117] "RemoveContainer" containerID="9770644a4a24131a279b0d376c29c42489d1df37ffeba769a0a86dd8778d201c" Jun 09 05:42:00.119927 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:42:00.119904 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9770644a4a24131a279b0d376c29c42489d1df37ffeba769a0a86dd8778d201c\": container with ID starting with 9770644a4a24131a279b0d376c29c42489d1df37ffeba769a0a86dd8778d201c not found: ID does not exist" containerID="9770644a4a24131a279b0d376c29c42489d1df37ffeba769a0a86dd8778d201c" Jun 09 05:42:00.119992 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:42:00.119936 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9770644a4a24131a279b0d376c29c42489d1df37ffeba769a0a86dd8778d201c"} err="failed to get container status \"9770644a4a24131a279b0d376c29c42489d1df37ffeba769a0a86dd8778d201c\": rpc error: code = NotFound desc = could not find container \"9770644a4a24131a279b0d376c29c42489d1df37ffeba769a0a86dd8778d201c\": container with ID starting with 9770644a4a24131a279b0d376c29c42489d1df37ffeba769a0a86dd8778d201c not found: ID does not exist" Jun 09 05:42:00.139622 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:42:00.139599 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-865486fc4d-4blrg"] Jun 09 05:42:00.147116 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:42:00.147097 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-865486fc4d-4blrg"] Jun 09 05:42:00.347611 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:42:00.347587 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74a171e1-f016-4f6f-ad00-d9cdf4e10382" path="/var/lib/kubelet/pods/74a171e1-f016-4f6f-ad00-d9cdf4e10382/volumes" Jun 09 05:42:16.872249 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:42:16.872205 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k7wbp"] Jun 09 05:43:03.417999 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:43:03.417966 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k7wbp"] Jun 09 05:43:10.477016 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:43:10.476982 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k7wbp"] Jun 09 05:43:15.270830 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:43:15.270783 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k7wbp"] Jun 09 05:43:19.272740 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:43:19.272708 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k7wbp"] Jun 09 05:43:23.877594 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:43:23.877556 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k7wbp"] Jun 09 05:44:10.395234 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:44:10.395206 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-42h5b_02c37648-4419-4ff7-a316-568fa0510cee/ovn-acl-logging/0.log" Jun 09 05:44:10.397786 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:44:10.397766 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-42h5b_02c37648-4419-4ff7-a316-568fa0510cee/ovn-acl-logging/0.log" Jun 09 05:44:19.240159 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:44:19.240125 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6d8d8c54c-6zt5d"] Jun 09 05:44:19.240519 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:44:19.240510 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74a171e1-f016-4f6f-ad00-d9cdf4e10382" containerName="authorino" Jun 09 05:44:19.240562 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:44:19.240523 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="74a171e1-f016-4f6f-ad00-d9cdf4e10382" containerName="authorino" Jun 09 05:44:19.240597 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:44:19.240587 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="74a171e1-f016-4f6f-ad00-d9cdf4e10382" containerName="authorino" Jun 09 05:44:19.243703 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:44:19.243685 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d8d8c54c-6zt5d" Jun 09 05:44:19.253907 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:44:19.253881 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d8d8c54c-6zt5d"] Jun 09 05:44:19.400007 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:44:19.399984 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tl9x\" (UniqueName: \"kubernetes.io/projected/7ed1aa9e-7404-473e-9d05-1d34cc058a52-kube-api-access-7tl9x\") pod \"authorino-6d8d8c54c-6zt5d\" (UID: \"7ed1aa9e-7404-473e-9d05-1d34cc058a52\") " pod="kuadrant-system/authorino-6d8d8c54c-6zt5d" Jun 09 05:44:19.400142 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:44:19.400025 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/7ed1aa9e-7404-473e-9d05-1d34cc058a52-oidc-ca\") pod \"authorino-6d8d8c54c-6zt5d\" (UID: \"7ed1aa9e-7404-473e-9d05-1d34cc058a52\") " pod="kuadrant-system/authorino-6d8d8c54c-6zt5d" Jun 09 05:44:19.400142 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:44:19.400052 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7ed1aa9e-7404-473e-9d05-1d34cc058a52-tls-cert\") pod \"authorino-6d8d8c54c-6zt5d\" (UID: \"7ed1aa9e-7404-473e-9d05-1d34cc058a52\") " pod="kuadrant-system/authorino-6d8d8c54c-6zt5d" Jun 09 05:44:19.501131 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:44:19.501070 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7ed1aa9e-7404-473e-9d05-1d34cc058a52-tls-cert\") pod \"authorino-6d8d8c54c-6zt5d\" (UID: \"7ed1aa9e-7404-473e-9d05-1d34cc058a52\") " pod="kuadrant-system/authorino-6d8d8c54c-6zt5d" Jun 09 05:44:19.501254 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:44:19.501205 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tl9x\" (UniqueName: \"kubernetes.io/projected/7ed1aa9e-7404-473e-9d05-1d34cc058a52-kube-api-access-7tl9x\") pod \"authorino-6d8d8c54c-6zt5d\" (UID: \"7ed1aa9e-7404-473e-9d05-1d34cc058a52\") " pod="kuadrant-system/authorino-6d8d8c54c-6zt5d" Jun 09 05:44:19.501327 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:44:19.501300 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/7ed1aa9e-7404-473e-9d05-1d34cc058a52-oidc-ca\") pod \"authorino-6d8d8c54c-6zt5d\" (UID: \"7ed1aa9e-7404-473e-9d05-1d34cc058a52\") " pod="kuadrant-system/authorino-6d8d8c54c-6zt5d" Jun 09 05:44:19.501983 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:44:19.501954 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/7ed1aa9e-7404-473e-9d05-1d34cc058a52-oidc-ca\") pod \"authorino-6d8d8c54c-6zt5d\" (UID: \"7ed1aa9e-7404-473e-9d05-1d34cc058a52\") " pod="kuadrant-system/authorino-6d8d8c54c-6zt5d" Jun 09 05:44:19.503727 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:44:19.503704 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7ed1aa9e-7404-473e-9d05-1d34cc058a52-tls-cert\") pod \"authorino-6d8d8c54c-6zt5d\" (UID: \"7ed1aa9e-7404-473e-9d05-1d34cc058a52\") " pod="kuadrant-system/authorino-6d8d8c54c-6zt5d" Jun 09 05:44:19.508487 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:44:19.508466 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tl9x\" (UniqueName: \"kubernetes.io/projected/7ed1aa9e-7404-473e-9d05-1d34cc058a52-kube-api-access-7tl9x\") pod \"authorino-6d8d8c54c-6zt5d\" (UID: \"7ed1aa9e-7404-473e-9d05-1d34cc058a52\") " pod="kuadrant-system/authorino-6d8d8c54c-6zt5d" Jun 09 05:44:19.554963 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:44:19.554943 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d8d8c54c-6zt5d" Jun 09 05:44:19.691784 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:44:19.691756 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d8d8c54c-6zt5d"] Jun 09 05:44:19.693057 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:44:19.693023 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7ed1aa9e_7404_473e_9d05_1d34cc058a52.slice/crio-7ad4f431929d9ffc1add12e3d897eec9d4128ee67c89e89d539c2a420eb653c8 WatchSource:0}: Error finding container 7ad4f431929d9ffc1add12e3d897eec9d4128ee67c89e89d539c2a420eb653c8: Status 404 returned error can't find the container with id 7ad4f431929d9ffc1add12e3d897eec9d4128ee67c89e89d539c2a420eb653c8 Jun 09 05:44:19.909750 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:44:19.909723 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6d8d8c54c-6zt5d" event={"ID":"7ed1aa9e-7404-473e-9d05-1d34cc058a52","Type":"ContainerStarted","Data":"7ad4f431929d9ffc1add12e3d897eec9d4128ee67c89e89d539c2a420eb653c8"} Jun 09 05:44:20.917762 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:44:20.917730 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6d8d8c54c-6zt5d" event={"ID":"7ed1aa9e-7404-473e-9d05-1d34cc058a52","Type":"ContainerStarted","Data":"701b40214d800de442b44f4882a32ce87731d7c029e69f3d6368afee57e77c2b"} Jun 09 05:44:20.934918 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:44:20.934877 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6d8d8c54c-6zt5d" podStartSLOduration=1.582175187 podStartE2EDuration="1.934851794s" totalImagesPullingTime="352.676607ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 05:44:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 05:44:20.934323733 +0000 UTC m=+911.016975469" watchObservedRunningTime="2026-06-09 05:44:20.934851794 +0000 UTC m=+911.017503530" Jun 09 05:44:20.964182 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:44:20.964153 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75bc595c54-fnk2r"] Jun 09 05:44:20.964392 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:44:20.964368 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75bc595c54-fnk2r" podUID="066a971b-7e7f-4226-b995-2601ce2f4f89" containerName="authorino" containerID="cri-o://de1e5849303ac1f5fb84ddf75d1c2bd4c5fbba98ccf0d83d355fe005d8913cc3" gracePeriod=30 Jun 09 05:44:21.223636 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:44:21.223604 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75bc595c54-fnk2r" Jun 09 05:44:21.315725 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:44:21.315700 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/066a971b-7e7f-4226-b995-2601ce2f4f89-oidc-ca\") pod \"066a971b-7e7f-4226-b995-2601ce2f4f89\" (UID: \"066a971b-7e7f-4226-b995-2601ce2f4f89\") " Jun 09 05:44:21.315892 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:44:21.315733 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gjwfz\" (UniqueName: \"kubernetes.io/projected/066a971b-7e7f-4226-b995-2601ce2f4f89-kube-api-access-gjwfz\") pod \"066a971b-7e7f-4226-b995-2601ce2f4f89\" (UID: \"066a971b-7e7f-4226-b995-2601ce2f4f89\") " Jun 09 05:44:21.315892 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:44:21.315814 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/066a971b-7e7f-4226-b995-2601ce2f4f89-tls-cert\") pod \"066a971b-7e7f-4226-b995-2601ce2f4f89\" (UID: \"066a971b-7e7f-4226-b995-2601ce2f4f89\") " Jun 09 05:44:21.317689 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:44:21.317659 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/066a971b-7e7f-4226-b995-2601ce2f4f89-kube-api-access-gjwfz" (OuterVolumeSpecName: "kube-api-access-gjwfz") pod "066a971b-7e7f-4226-b995-2601ce2f4f89" (UID: "066a971b-7e7f-4226-b995-2601ce2f4f89"). InnerVolumeSpecName "kube-api-access-gjwfz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 05:44:21.320692 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:44:21.320664 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/066a971b-7e7f-4226-b995-2601ce2f4f89-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "066a971b-7e7f-4226-b995-2601ce2f4f89" (UID: "066a971b-7e7f-4226-b995-2601ce2f4f89"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 05:44:21.327842 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:44:21.327821 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/066a971b-7e7f-4226-b995-2601ce2f4f89-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "066a971b-7e7f-4226-b995-2601ce2f4f89" (UID: "066a971b-7e7f-4226-b995-2601ce2f4f89"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 05:44:21.417172 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:44:21.417145 2564 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/066a971b-7e7f-4226-b995-2601ce2f4f89-tls-cert\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:44:21.417263 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:44:21.417174 2564 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/066a971b-7e7f-4226-b995-2601ce2f4f89-oidc-ca\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:44:21.417263 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:44:21.417189 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gjwfz\" (UniqueName: \"kubernetes.io/projected/066a971b-7e7f-4226-b995-2601ce2f4f89-kube-api-access-gjwfz\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:44:21.925526 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:44:21.925497 2564 generic.go:356] "Generic (PLEG): container finished" podID="066a971b-7e7f-4226-b995-2601ce2f4f89" containerID="de1e5849303ac1f5fb84ddf75d1c2bd4c5fbba98ccf0d83d355fe005d8913cc3" exitCode=0 Jun 09 05:44:21.925981 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:44:21.925542 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75bc595c54-fnk2r" Jun 09 05:44:21.925981 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:44:21.925588 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75bc595c54-fnk2r" event={"ID":"066a971b-7e7f-4226-b995-2601ce2f4f89","Type":"ContainerDied","Data":"de1e5849303ac1f5fb84ddf75d1c2bd4c5fbba98ccf0d83d355fe005d8913cc3"} Jun 09 05:44:21.925981 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:44:21.925627 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75bc595c54-fnk2r" event={"ID":"066a971b-7e7f-4226-b995-2601ce2f4f89","Type":"ContainerDied","Data":"e735eb238ea74f68e2d9ec74d3520011e72e9a85cf40484291f5a54540d31b2b"} Jun 09 05:44:21.925981 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:44:21.925640 2564 scope.go:117] "RemoveContainer" containerID="de1e5849303ac1f5fb84ddf75d1c2bd4c5fbba98ccf0d83d355fe005d8913cc3" Jun 09 05:44:21.936002 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:44:21.935984 2564 scope.go:117] "RemoveContainer" containerID="de1e5849303ac1f5fb84ddf75d1c2bd4c5fbba98ccf0d83d355fe005d8913cc3" Jun 09 05:44:21.936314 ip-10-0-130-106 kubenswrapper[2564]: E0609 05:44:21.936289 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de1e5849303ac1f5fb84ddf75d1c2bd4c5fbba98ccf0d83d355fe005d8913cc3\": container with ID starting with de1e5849303ac1f5fb84ddf75d1c2bd4c5fbba98ccf0d83d355fe005d8913cc3 not found: ID does not exist" containerID="de1e5849303ac1f5fb84ddf75d1c2bd4c5fbba98ccf0d83d355fe005d8913cc3" Jun 09 05:44:21.936435 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:44:21.936321 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de1e5849303ac1f5fb84ddf75d1c2bd4c5fbba98ccf0d83d355fe005d8913cc3"} err="failed to get container status \"de1e5849303ac1f5fb84ddf75d1c2bd4c5fbba98ccf0d83d355fe005d8913cc3\": rpc error: code = NotFound desc = could not find container \"de1e5849303ac1f5fb84ddf75d1c2bd4c5fbba98ccf0d83d355fe005d8913cc3\": container with ID starting with de1e5849303ac1f5fb84ddf75d1c2bd4c5fbba98ccf0d83d355fe005d8913cc3 not found: ID does not exist" Jun 09 05:44:21.947093 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:44:21.947074 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75bc595c54-fnk2r"] Jun 09 05:44:21.952974 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:44:21.952950 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75bc595c54-fnk2r"] Jun 09 05:44:22.348835 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:44:22.348776 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="066a971b-7e7f-4226-b995-2601ce2f4f89" path="/var/lib/kubelet/pods/066a971b-7e7f-4226-b995-2601ce2f4f89/volumes" Jun 09 05:44:50.879325 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:44:50.879290 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k7wbp"] Jun 09 05:45:00.139156 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:45:00.139123 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29683065-qwgd4"] Jun 09 05:45:00.139688 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:45:00.139674 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="066a971b-7e7f-4226-b995-2601ce2f4f89" containerName="authorino" Jun 09 05:45:00.139732 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:45:00.139691 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="066a971b-7e7f-4226-b995-2601ce2f4f89" containerName="authorino" Jun 09 05:45:00.139860 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:45:00.139848 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="066a971b-7e7f-4226-b995-2601ce2f4f89" containerName="authorino" Jun 09 05:45:00.142990 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:45:00.142972 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29683065-qwgd4" Jun 09 05:45:00.145760 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:45:00.145468 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-w8scx\"" Jun 09 05:45:00.148513 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:45:00.148492 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29683065-qwgd4"] Jun 09 05:45:00.215894 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:45:00.215868 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qr9m\" (UniqueName: \"kubernetes.io/projected/c17f8e8a-dcbc-4240-bc92-d7e08db1ebcb-kube-api-access-9qr9m\") pod \"maas-api-key-cleanup-29683065-qwgd4\" (UID: \"c17f8e8a-dcbc-4240-bc92-d7e08db1ebcb\") " pod="opendatahub/maas-api-key-cleanup-29683065-qwgd4" Jun 09 05:45:00.316414 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:45:00.316389 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qr9m\" (UniqueName: \"kubernetes.io/projected/c17f8e8a-dcbc-4240-bc92-d7e08db1ebcb-kube-api-access-9qr9m\") pod \"maas-api-key-cleanup-29683065-qwgd4\" (UID: \"c17f8e8a-dcbc-4240-bc92-d7e08db1ebcb\") " pod="opendatahub/maas-api-key-cleanup-29683065-qwgd4" Jun 09 05:45:00.324525 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:45:00.324502 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qr9m\" (UniqueName: \"kubernetes.io/projected/c17f8e8a-dcbc-4240-bc92-d7e08db1ebcb-kube-api-access-9qr9m\") pod \"maas-api-key-cleanup-29683065-qwgd4\" (UID: \"c17f8e8a-dcbc-4240-bc92-d7e08db1ebcb\") " pod="opendatahub/maas-api-key-cleanup-29683065-qwgd4" Jun 09 05:45:00.456193 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:45:00.456125 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29683065-qwgd4" Jun 09 05:45:00.591625 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:45:00.591594 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29683065-qwgd4"] Jun 09 05:45:00.593201 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:45:00.593172 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc17f8e8a_dcbc_4240_bc92_d7e08db1ebcb.slice/crio-466092f4475cc8df79cbe5d74c1c03ace852df87b82bed6e705305547c04bb1b WatchSource:0}: Error finding container 466092f4475cc8df79cbe5d74c1c03ace852df87b82bed6e705305547c04bb1b: Status 404 returned error can't find the container with id 466092f4475cc8df79cbe5d74c1c03ace852df87b82bed6e705305547c04bb1b Jun 09 05:45:00.974157 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:45:00.974121 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k7wbp"] Jun 09 05:45:01.162490 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:45:01.162456 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29683065-qwgd4" event={"ID":"c17f8e8a-dcbc-4240-bc92-d7e08db1ebcb","Type":"ContainerStarted","Data":"466092f4475cc8df79cbe5d74c1c03ace852df87b82bed6e705305547c04bb1b"} Jun 09 05:45:03.176715 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:45:03.176647 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29683065-qwgd4" event={"ID":"c17f8e8a-dcbc-4240-bc92-d7e08db1ebcb","Type":"ContainerStarted","Data":"20276c0d751269203669589cfdc6c271ee8f0e48a99109bf3f509df46a0e7fa1"} Jun 09 05:45:03.190821 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:45:03.190766 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29683065-qwgd4" podStartSLOduration=0.946152175 podStartE2EDuration="3.190750326s" totalImagesPullingTime="2.244598151s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 05:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 05:45:03.189759229 +0000 UTC m=+953.272410966" watchObservedRunningTime="2026-06-09 05:45:03.190750326 +0000 UTC m=+953.273402062" Jun 09 05:45:04.184176 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:45:04.184143 2564 generic.go:356] "Generic (PLEG): container finished" podID="c17f8e8a-dcbc-4240-bc92-d7e08db1ebcb" containerID="20276c0d751269203669589cfdc6c271ee8f0e48a99109bf3f509df46a0e7fa1" exitCode=0 Jun 09 05:45:04.184571 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:45:04.184224 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29683065-qwgd4" event={"ID":"c17f8e8a-dcbc-4240-bc92-d7e08db1ebcb","Type":"ContainerDied","Data":"20276c0d751269203669589cfdc6c271ee8f0e48a99109bf3f509df46a0e7fa1"} Jun 09 05:45:05.322773 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:45:05.322750 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29683065-qwgd4" Jun 09 05:45:05.460194 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:45:05.460137 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9qr9m\" (UniqueName: \"kubernetes.io/projected/c17f8e8a-dcbc-4240-bc92-d7e08db1ebcb-kube-api-access-9qr9m\") pod \"c17f8e8a-dcbc-4240-bc92-d7e08db1ebcb\" (UID: \"c17f8e8a-dcbc-4240-bc92-d7e08db1ebcb\") " Jun 09 05:45:05.462240 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:45:05.462215 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c17f8e8a-dcbc-4240-bc92-d7e08db1ebcb-kube-api-access-9qr9m" (OuterVolumeSpecName: "kube-api-access-9qr9m") pod "c17f8e8a-dcbc-4240-bc92-d7e08db1ebcb" (UID: "c17f8e8a-dcbc-4240-bc92-d7e08db1ebcb"). InnerVolumeSpecName "kube-api-access-9qr9m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 05:45:05.560735 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:45:05.560708 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9qr9m\" (UniqueName: \"kubernetes.io/projected/c17f8e8a-dcbc-4240-bc92-d7e08db1ebcb-kube-api-access-9qr9m\") on node \"ip-10-0-130-106.ec2.internal\" DevicePath \"\"" Jun 09 05:45:06.203260 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:45:06.203228 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29683065-qwgd4" Jun 09 05:45:06.203433 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:45:06.203259 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29683065-qwgd4" event={"ID":"c17f8e8a-dcbc-4240-bc92-d7e08db1ebcb","Type":"ContainerDied","Data":"466092f4475cc8df79cbe5d74c1c03ace852df87b82bed6e705305547c04bb1b"} Jun 09 05:45:06.203433 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:45:06.203334 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="466092f4475cc8df79cbe5d74c1c03ace852df87b82bed6e705305547c04bb1b" Jun 09 05:45:09.877454 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:45:09.877417 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k7wbp"] Jun 09 05:45:19.977931 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:45:19.977841 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k7wbp"] Jun 09 05:45:29.574115 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:45:29.574082 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k7wbp"] Jun 09 05:45:39.480748 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:45:39.480713 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k7wbp"] Jun 09 05:45:48.931453 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:45:48.931415 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6cbcff6cff-sgnwm"] Jun 09 05:45:48.931932 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:45:48.931854 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c17f8e8a-dcbc-4240-bc92-d7e08db1ebcb" containerName="cleanup" Jun 09 05:45:48.931932 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:45:48.931870 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c17f8e8a-dcbc-4240-bc92-d7e08db1ebcb" containerName="cleanup" Jun 09 05:45:48.932024 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:45:48.931949 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="c17f8e8a-dcbc-4240-bc92-d7e08db1ebcb" containerName="cleanup" Jun 09 05:45:48.939288 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:45:48.939267 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6cbcff6cff-sgnwm" Jun 09 05:45:48.942117 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:45:48.942094 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-xfcpb\"" Jun 09 05:45:48.943117 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:45:48.943090 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 09 05:45:48.943288 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:45:48.943262 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 09 05:45:48.947538 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:45:48.947338 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6cbcff6cff-sgnwm"] Jun 09 05:45:49.024651 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:45:49.024615 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrsd7\" (UniqueName: \"kubernetes.io/projected/a6bde9fd-9bbf-4a78-826d-bb58c1d73196-kube-api-access-mrsd7\") pod \"maas-controller-6cbcff6cff-sgnwm\" (UID: \"a6bde9fd-9bbf-4a78-826d-bb58c1d73196\") " pod="opendatahub/maas-controller-6cbcff6cff-sgnwm" Jun 09 05:45:49.024862 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:45:49.024686 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a6bde9fd-9bbf-4a78-826d-bb58c1d73196-webhook-cert\") pod \"maas-controller-6cbcff6cff-sgnwm\" (UID: \"a6bde9fd-9bbf-4a78-826d-bb58c1d73196\") " pod="opendatahub/maas-controller-6cbcff6cff-sgnwm" Jun 09 05:45:49.126098 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:45:49.126057 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a6bde9fd-9bbf-4a78-826d-bb58c1d73196-webhook-cert\") pod \"maas-controller-6cbcff6cff-sgnwm\" (UID: \"a6bde9fd-9bbf-4a78-826d-bb58c1d73196\") " pod="opendatahub/maas-controller-6cbcff6cff-sgnwm" Jun 09 05:45:49.126270 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:45:49.126136 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrsd7\" (UniqueName: \"kubernetes.io/projected/a6bde9fd-9bbf-4a78-826d-bb58c1d73196-kube-api-access-mrsd7\") pod \"maas-controller-6cbcff6cff-sgnwm\" (UID: \"a6bde9fd-9bbf-4a78-826d-bb58c1d73196\") " pod="opendatahub/maas-controller-6cbcff6cff-sgnwm" Jun 09 05:45:49.128667 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:45:49.128635 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a6bde9fd-9bbf-4a78-826d-bb58c1d73196-webhook-cert\") pod \"maas-controller-6cbcff6cff-sgnwm\" (UID: \"a6bde9fd-9bbf-4a78-826d-bb58c1d73196\") " pod="opendatahub/maas-controller-6cbcff6cff-sgnwm" Jun 09 05:45:49.136318 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:45:49.136293 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrsd7\" (UniqueName: \"kubernetes.io/projected/a6bde9fd-9bbf-4a78-826d-bb58c1d73196-kube-api-access-mrsd7\") pod \"maas-controller-6cbcff6cff-sgnwm\" (UID: \"a6bde9fd-9bbf-4a78-826d-bb58c1d73196\") " pod="opendatahub/maas-controller-6cbcff6cff-sgnwm" Jun 09 05:45:49.251515 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:45:49.251435 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6cbcff6cff-sgnwm" Jun 09 05:45:49.386326 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:45:49.386304 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6cbcff6cff-sgnwm"] Jun 09 05:45:49.388145 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:45:49.388118 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6bde9fd_9bbf_4a78_826d_bb58c1d73196.slice/crio-223118b5558200b798522e4dc7ed5bb66521ad833fd454e1dd9bc7906cf0fc31 WatchSource:0}: Error finding container 223118b5558200b798522e4dc7ed5bb66521ad833fd454e1dd9bc7906cf0fc31: Status 404 returned error can't find the container with id 223118b5558200b798522e4dc7ed5bb66521ad833fd454e1dd9bc7906cf0fc31 Jun 09 05:45:49.389564 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:45:49.389548 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 05:45:49.454932 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:45:49.454902 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6cbcff6cff-sgnwm" event={"ID":"a6bde9fd-9bbf-4a78-826d-bb58c1d73196","Type":"ContainerStarted","Data":"223118b5558200b798522e4dc7ed5bb66521ad833fd454e1dd9bc7906cf0fc31"} Jun 09 05:45:52.477822 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:45:52.477760 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6cbcff6cff-sgnwm" event={"ID":"a6bde9fd-9bbf-4a78-826d-bb58c1d73196","Type":"ContainerStarted","Data":"2983be55d7adbda4c6587fbb9ba0c8f3a10e2af206a66b6d242823a8da4e203a"} Jun 09 05:45:52.478251 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:45:52.477861 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6cbcff6cff-sgnwm" Jun 09 05:45:52.499264 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:45:52.499213 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6cbcff6cff-sgnwm" podStartSLOduration=2.111996198 podStartE2EDuration="4.499197982s" totalImagesPullingTime="2.387201784s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 05:45:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 05:45:52.494948965 +0000 UTC m=+1002.577600702" watchObservedRunningTime="2026-06-09 05:45:52.499197982 +0000 UTC m=+1002.581849717" Jun 09 05:46:03.489993 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:46:03.489967 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6cbcff6cff-sgnwm" Jun 09 05:46:14.598041 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:46:14.598010 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k7wbp"] Jun 09 05:46:18.076212 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:46:18.076172 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k7wbp"] Jun 09 05:46:54.780407 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:46:54.780370 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k7wbp"] Jun 09 05:47:11.099846 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:47:11.099806 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k7wbp"] Jun 09 05:47:49.288972 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:47:49.288924 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k7wbp"] Jun 09 05:48:06.272368 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:48:06.272330 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k7wbp"] Jun 09 05:48:20.281167 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:48:20.281083 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k7wbp"] Jun 09 05:48:36.480211 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:48:36.480175 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k7wbp"] Jun 09 05:48:39.175158 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:48:39.175128 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k7wbp"] Jun 09 05:49:10.435169 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:49:10.435142 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-42h5b_02c37648-4419-4ff7-a316-568fa0510cee/ovn-acl-logging/0.log" Jun 09 05:49:10.439689 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:49:10.439665 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-42h5b_02c37648-4419-4ff7-a316-568fa0510cee/ovn-acl-logging/0.log" Jun 09 05:49:14.676713 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:49:14.676681 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k7wbp"] Jun 09 05:49:18.081947 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:49:18.081907 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k7wbp"] Jun 09 05:49:39.974179 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:49:39.974149 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k7wbp"] Jun 09 05:49:49.171162 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:49:49.171128 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k7wbp"] Jun 09 05:50:05.675489 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:50:05.675453 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k7wbp"] Jun 09 05:50:14.375507 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:50:14.375473 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k7wbp"] Jun 09 05:50:22.479444 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:50:22.479410 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k7wbp"] Jun 09 05:51:03.377476 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:51:03.377440 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k7wbp"] Jun 09 05:51:12.875870 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:51:12.875834 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k7wbp"] Jun 09 05:51:20.885079 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:51:20.884997 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k7wbp"] Jun 09 05:51:52.975545 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:51:52.975505 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k7wbp"] Jun 09 05:52:01.785134 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:52:01.785099 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k7wbp"] Jun 09 05:52:10.479234 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:52:10.479198 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k7wbp"] Jun 09 05:52:18.269805 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:52:18.269761 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k7wbp"] Jun 09 05:52:26.578988 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:52:26.578956 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k7wbp"] Jun 09 05:52:35.279511 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:52:35.279474 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k7wbp"] Jun 09 05:52:38.282530 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:52:38.282495 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k7wbp"] Jun 09 05:52:43.772130 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:52:43.772088 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k7wbp"] Jun 09 05:52:52.967366 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:52:52.967330 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k7wbp"] Jun 09 05:53:30.572008 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:53:30.571966 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k7wbp"] Jun 09 05:53:32.877313 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:53:32.877277 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k7wbp"] Jun 09 05:53:57.963249 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:53:57.963206 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6d8d8c54c-6zt5d_7ed1aa9e-7404-473e-9d05-1d34cc058a52/authorino/0.log" Jun 09 05:54:02.524312 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:02.524279 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-85965bc8b6-r96rp_46835475-9e02-4acc-9987-c3420f9751e9/nginx/0.log" Jun 09 05:54:02.972219 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:02.972195 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29683065-qwgd4_c17f8e8a-dcbc-4240-bc92-d7e08db1ebcb/cleanup/0.log" Jun 09 05:54:03.087284 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:03.087250 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6cbcff6cff-sgnwm_a6bde9fd-9bbf-4a78-826d-bb58c1d73196/manager/0.log" Jun 09 05:54:03.201745 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:03.201720 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-dsxmv_f51482b8-edfb-4f94-8a31-2b615a67d304/server/0.log" Jun 09 05:54:03.315394 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:03.315366 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-kv94q_4fbcde52-a813-40c6-ab57-9b47f9eb6bee/manager/0.log" Jun 09 05:54:03.424282 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:03.424260 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-66ccd5c574-4wl8b_9a99d12a-707c-428e-9f95-a7c904ca4240/copy-manifests/0.log" Jun 09 05:54:03.437334 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:03.437318 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-66ccd5c574-4wl8b_9a99d12a-707c-428e-9f95-a7c904ca4240/manager/0.log" Jun 09 05:54:04.538192 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:04.538157 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592g9t2_919ca8ed-5772-44d2-899c-2aa46bcada61/pull/0.log" Jun 09 05:54:04.545317 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:04.545300 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592g9t2_919ca8ed-5772-44d2-899c-2aa46bcada61/extract/0.log" Jun 09 05:54:04.551949 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:04.551930 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592g9t2_919ca8ed-5772-44d2-899c-2aa46bcada61/util/0.log" Jun 09 05:54:04.664234 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:04.664204 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e079qrm_d2c4bf80-db15-435e-9806-46844ba1132e/util/0.log" Jun 09 05:54:04.671133 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:04.671105 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e079qrm_d2c4bf80-db15-435e-9806-46844ba1132e/pull/0.log" Jun 09 05:54:04.677272 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:04.677250 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e079qrm_d2c4bf80-db15-435e-9806-46844ba1132e/extract/0.log" Jun 09 05:54:04.781343 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:04.781318 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zbjqr_867fbd6e-5cde-48ef-bfb0-163b0efdd429/util/0.log" Jun 09 05:54:04.787306 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:04.787287 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zbjqr_867fbd6e-5cde-48ef-bfb0-163b0efdd429/pull/0.log" Jun 09 05:54:04.792843 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:04.792780 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zbjqr_867fbd6e-5cde-48ef-bfb0-163b0efdd429/extract/0.log" Jun 09 05:54:04.899376 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:04.899353 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14t7rg_62c203f8-168f-4c1e-9867-c6ac44d61757/util/0.log" Jun 09 05:54:04.906026 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:04.906006 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14t7rg_62c203f8-168f-4c1e-9867-c6ac44d61757/pull/0.log" Jun 09 05:54:04.912019 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:04.911997 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14t7rg_62c203f8-168f-4c1e-9867-c6ac44d61757/extract/0.log" Jun 09 05:54:05.027506 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:05.027479 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6d8d8c54c-6zt5d_7ed1aa9e-7404-473e-9d05-1d34cc058a52/authorino/0.log" Jun 09 05:54:05.150249 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:05.150165 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-zppbx_eb84cdf5-1b9e-42d7-8841-be7dd1a4f438/manager/0.log" Jun 09 05:54:05.256195 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:05.256166 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-jhcql_2322b5ed-5bed-40eb-93c1-fd5b491c0776/manager/0.log" Jun 09 05:54:05.474226 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:05.474151 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-55hlq_52720fc9-54ee-4eea-bc9a-8578b31277e6/registry-server/0.log" Jun 09 05:54:05.588641 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:05.588613 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-dfzwb_2d408766-0c9f-43fa-a59f-448ed410b555/manager/0.log" Jun 09 05:54:05.698509 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:05.698485 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-k7wbp_ca590af8-3cb9-4ef3-af62-669a704c4ffe/limitador/0.log" Jun 09 05:54:06.148134 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:06.148103 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795nm9vb_c659facb-644a-4c14-9ccc-2152877a75bb/istio-proxy/0.log" Jun 09 05:54:10.476985 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:10.476960 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-42h5b_02c37648-4419-4ff7-a316-568fa0510cee/ovn-acl-logging/0.log" Jun 09 05:54:10.485029 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:10.485006 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-42h5b_02c37648-4419-4ff7-a316-568fa0510cee/ovn-acl-logging/0.log" Jun 09 05:54:12.140905 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:12.140845 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4628p/must-gather-h7nr7"] Jun 09 05:54:12.144952 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:12.144932 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4628p/must-gather-h7nr7" Jun 09 05:54:12.147378 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:12.147354 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4628p\"/\"openshift-service-ca.crt\"" Jun 09 05:54:12.148266 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:12.148249 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4628p\"/\"kube-root-ca.crt\"" Jun 09 05:54:12.148368 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:12.148274 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-4628p\"/\"default-dockercfg-pnvwv\"" Jun 09 05:54:12.153400 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:12.153381 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4628p/must-gather-h7nr7"] Jun 09 05:54:12.251301 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:12.251272 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/bb9c326d-3fa9-437f-9c5d-b70ae26ec00d-must-gather-output\") pod \"must-gather-h7nr7\" (UID: \"bb9c326d-3fa9-437f-9c5d-b70ae26ec00d\") " pod="openshift-must-gather-4628p/must-gather-h7nr7" Jun 09 05:54:12.251452 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:12.251343 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w75p5\" (UniqueName: \"kubernetes.io/projected/bb9c326d-3fa9-437f-9c5d-b70ae26ec00d-kube-api-access-w75p5\") pod \"must-gather-h7nr7\" (UID: \"bb9c326d-3fa9-437f-9c5d-b70ae26ec00d\") " pod="openshift-must-gather-4628p/must-gather-h7nr7" Jun 09 05:54:12.352667 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:12.352640 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w75p5\" (UniqueName: \"kubernetes.io/projected/bb9c326d-3fa9-437f-9c5d-b70ae26ec00d-kube-api-access-w75p5\") pod \"must-gather-h7nr7\" (UID: \"bb9c326d-3fa9-437f-9c5d-b70ae26ec00d\") " pod="openshift-must-gather-4628p/must-gather-h7nr7" Jun 09 05:54:12.352869 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:12.352734 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/bb9c326d-3fa9-437f-9c5d-b70ae26ec00d-must-gather-output\") pod \"must-gather-h7nr7\" (UID: \"bb9c326d-3fa9-437f-9c5d-b70ae26ec00d\") " pod="openshift-must-gather-4628p/must-gather-h7nr7" Jun 09 05:54:12.353085 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:12.353065 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/bb9c326d-3fa9-437f-9c5d-b70ae26ec00d-must-gather-output\") pod \"must-gather-h7nr7\" (UID: \"bb9c326d-3fa9-437f-9c5d-b70ae26ec00d\") " pod="openshift-must-gather-4628p/must-gather-h7nr7" Jun 09 05:54:12.366165 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:12.366132 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w75p5\" (UniqueName: \"kubernetes.io/projected/bb9c326d-3fa9-437f-9c5d-b70ae26ec00d-kube-api-access-w75p5\") pod \"must-gather-h7nr7\" (UID: \"bb9c326d-3fa9-437f-9c5d-b70ae26ec00d\") " pod="openshift-must-gather-4628p/must-gather-h7nr7" Jun 09 05:54:12.455417 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:12.455349 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4628p/must-gather-h7nr7" Jun 09 05:54:12.592417 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:12.592393 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4628p/must-gather-h7nr7"] Jun 09 05:54:12.594290 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:54:12.594264 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbb9c326d_3fa9_437f_9c5d_b70ae26ec00d.slice/crio-580f6f393ef3e933e4992b6e2bd8a8b421ac456d83a21bdeb2f72f479524b178 WatchSource:0}: Error finding container 580f6f393ef3e933e4992b6e2bd8a8b421ac456d83a21bdeb2f72f479524b178: Status 404 returned error can't find the container with id 580f6f393ef3e933e4992b6e2bd8a8b421ac456d83a21bdeb2f72f479524b178 Jun 09 05:54:12.596136 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:12.596122 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 05:54:13.427914 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:13.427879 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4628p/must-gather-h7nr7" event={"ID":"bb9c326d-3fa9-437f-9c5d-b70ae26ec00d","Type":"ContainerStarted","Data":"580f6f393ef3e933e4992b6e2bd8a8b421ac456d83a21bdeb2f72f479524b178"} Jun 09 05:54:14.437924 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:14.437894 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4628p/must-gather-h7nr7" event={"ID":"bb9c326d-3fa9-437f-9c5d-b70ae26ec00d","Type":"ContainerStarted","Data":"2233ca4de5208011929b92946b7e32b34dfac05d5178e6fac97555d8bb41b7b8"} Jun 09 05:54:14.438368 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:14.437933 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4628p/must-gather-h7nr7" event={"ID":"bb9c326d-3fa9-437f-9c5d-b70ae26ec00d","Type":"ContainerStarted","Data":"a7e89ee1f64f3edec4870f773ec1236c2babf7ee10c140045fec00816925bb21"} Jun 09 05:54:14.455318 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:14.455251 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-4628p/must-gather-h7nr7" podStartSLOduration=1.569363378 podStartE2EDuration="2.455229138s" totalImagesPullingTime="885.86576ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 05:54:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 05:54:14.453409637 +0000 UTC m=+1504.536061367" watchObservedRunningTime="2026-06-09 05:54:14.455229138 +0000 UTC m=+1504.537880875" Jun 09 05:54:15.253924 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:15.253898 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-c5rjt_0fe11a08-fb62-4c73-bbd8-f595316df872/global-pull-secret-syncer/0.log" Jun 09 05:54:15.393601 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:15.393573 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-qr8vr_1165c84b-2a43-44a3-9537-cd4fb2a25489/konnectivity-agent/0.log" Jun 09 05:54:15.415114 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:15.415088 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-106.ec2.internal_508e38f1dea9898446f7e228709d5418/haproxy/0.log" Jun 09 05:54:19.489374 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:19.489248 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592g9t2_919ca8ed-5772-44d2-899c-2aa46bcada61/extract/0.log" Jun 09 05:54:19.528369 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:19.528346 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592g9t2_919ca8ed-5772-44d2-899c-2aa46bcada61/util/0.log" Jun 09 05:54:19.553160 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:19.553048 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592g9t2_919ca8ed-5772-44d2-899c-2aa46bcada61/pull/0.log" Jun 09 05:54:19.587417 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:19.587392 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e079qrm_d2c4bf80-db15-435e-9806-46844ba1132e/extract/0.log" Jun 09 05:54:19.622126 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:19.622103 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e079qrm_d2c4bf80-db15-435e-9806-46844ba1132e/util/0.log" Jun 09 05:54:19.662825 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:19.662777 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e079qrm_d2c4bf80-db15-435e-9806-46844ba1132e/pull/0.log" Jun 09 05:54:19.700522 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:19.700475 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zbjqr_867fbd6e-5cde-48ef-bfb0-163b0efdd429/extract/0.log" Jun 09 05:54:19.731339 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:19.731307 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zbjqr_867fbd6e-5cde-48ef-bfb0-163b0efdd429/util/0.log" Jun 09 05:54:19.761057 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:19.760972 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zbjqr_867fbd6e-5cde-48ef-bfb0-163b0efdd429/pull/0.log" Jun 09 05:54:19.792272 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:19.792246 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14t7rg_62c203f8-168f-4c1e-9867-c6ac44d61757/extract/0.log" Jun 09 05:54:19.818404 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:19.818377 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14t7rg_62c203f8-168f-4c1e-9867-c6ac44d61757/util/0.log" Jun 09 05:54:19.841448 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:19.841419 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef14t7rg_62c203f8-168f-4c1e-9867-c6ac44d61757/pull/0.log" Jun 09 05:54:19.971448 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:19.971161 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6d8d8c54c-6zt5d_7ed1aa9e-7404-473e-9d05-1d34cc058a52/authorino/0.log" Jun 09 05:54:20.002695 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:20.002660 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-zppbx_eb84cdf5-1b9e-42d7-8841-be7dd1a4f438/manager/0.log" Jun 09 05:54:20.029518 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:20.029412 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-jhcql_2322b5ed-5bed-40eb-93c1-fd5b491c0776/manager/0.log" Jun 09 05:54:20.097617 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:20.097577 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-55hlq_52720fc9-54ee-4eea-bc9a-8578b31277e6/registry-server/0.log" Jun 09 05:54:20.171605 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:20.171568 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-dfzwb_2d408766-0c9f-43fa-a59f-448ed410b555/manager/0.log" Jun 09 05:54:20.194018 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:20.193957 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-k7wbp_ca590af8-3cb9-4ef3-af62-669a704c4ffe/limitador/0.log" Jun 09 05:54:21.998688 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:21.998663 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7cf449ec-e48b-4347-85bc-028c682e3080/alertmanager/0.log" Jun 09 05:54:22.023218 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:22.023184 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7cf449ec-e48b-4347-85bc-028c682e3080/config-reloader/0.log" Jun 09 05:54:22.047692 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:22.047664 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7cf449ec-e48b-4347-85bc-028c682e3080/kube-rbac-proxy-web/0.log" Jun 09 05:54:22.073072 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:22.073039 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7cf449ec-e48b-4347-85bc-028c682e3080/kube-rbac-proxy/0.log" Jun 09 05:54:22.096298 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:22.096273 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7cf449ec-e48b-4347-85bc-028c682e3080/kube-rbac-proxy-metric/0.log" Jun 09 05:54:22.121987 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:22.121963 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7cf449ec-e48b-4347-85bc-028c682e3080/prom-label-proxy/0.log" Jun 09 05:54:22.147856 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:22.147831 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7cf449ec-e48b-4347-85bc-028c682e3080/init-config-reloader/0.log" Jun 09 05:54:22.359734 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:22.359694 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-25bwf_3837e945-5f86-443f-b2c1-a68dca1b5d7d/node-exporter/0.log" Jun 09 05:54:22.382391 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:22.382323 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-25bwf_3837e945-5f86-443f-b2c1-a68dca1b5d7d/kube-rbac-proxy/0.log" Jun 09 05:54:22.410477 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:22.410446 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-25bwf_3837e945-5f86-443f-b2c1-a68dca1b5d7d/init-textfile/0.log" Jun 09 05:54:22.611817 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:22.611698 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-rnsbg_73457598-81c7-40a6-8ac6-f3e89ce31b36/kube-rbac-proxy-main/0.log" Jun 09 05:54:22.643077 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:22.643053 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-rnsbg_73457598-81c7-40a6-8ac6-f3e89ce31b36/kube-rbac-proxy-self/0.log" Jun 09 05:54:22.668142 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:22.668069 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-rnsbg_73457598-81c7-40a6-8ac6-f3e89ce31b36/openshift-state-metrics/0.log" Jun 09 05:54:22.938517 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:22.938420 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-khfkm_59b54565-7d99-4561-9b2d-b26a494a8fef/prometheus-operator-admission-webhook/0.log" Jun 09 05:54:22.988949 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:22.988920 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5fb7fdf4f6-jkkh6_6a1defc2-44e5-4f25-8e0d-99026af777db/telemeter-client/0.log" Jun 09 05:54:23.025949 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:23.025923 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5fb7fdf4f6-jkkh6_6a1defc2-44e5-4f25-8e0d-99026af777db/reload/0.log" Jun 09 05:54:23.062868 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:23.062840 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5fb7fdf4f6-jkkh6_6a1defc2-44e5-4f25-8e0d-99026af777db/kube-rbac-proxy/0.log" Jun 09 05:54:24.711998 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:24.711970 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-kwf45_75d2abf6-37dc-42d2-875e-1cb1b449f1f4/networking-console-plugin/0.log" Jun 09 05:54:25.990318 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:25.990292 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7458cbf459-pxlxj_9e6684bc-ff7e-4cae-8c33-084c439dbbb3/console/0.log" Jun 09 05:54:26.147114 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:26.147073 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4628p/perf-node-gather-daemonset-2b2sj"] Jun 09 05:54:26.153431 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:26.153397 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4628p/perf-node-gather-daemonset-2b2sj" Jun 09 05:54:26.164563 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:26.164528 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4628p/perf-node-gather-daemonset-2b2sj"] Jun 09 05:54:26.207643 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:26.207593 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1437e6ca-c3f5-4585-9073-cecf981af79d-sys\") pod \"perf-node-gather-daemonset-2b2sj\" (UID: \"1437e6ca-c3f5-4585-9073-cecf981af79d\") " pod="openshift-must-gather-4628p/perf-node-gather-daemonset-2b2sj" Jun 09 05:54:26.207643 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:26.207644 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbtsj\" (UniqueName: \"kubernetes.io/projected/1437e6ca-c3f5-4585-9073-cecf981af79d-kube-api-access-cbtsj\") pod \"perf-node-gather-daemonset-2b2sj\" (UID: \"1437e6ca-c3f5-4585-9073-cecf981af79d\") " pod="openshift-must-gather-4628p/perf-node-gather-daemonset-2b2sj" Jun 09 05:54:26.207925 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:26.207679 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1437e6ca-c3f5-4585-9073-cecf981af79d-proc\") pod \"perf-node-gather-daemonset-2b2sj\" (UID: \"1437e6ca-c3f5-4585-9073-cecf981af79d\") " pod="openshift-must-gather-4628p/perf-node-gather-daemonset-2b2sj" Jun 09 05:54:26.207925 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:26.207721 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1437e6ca-c3f5-4585-9073-cecf981af79d-podres\") pod \"perf-node-gather-daemonset-2b2sj\" (UID: \"1437e6ca-c3f5-4585-9073-cecf981af79d\") " pod="openshift-must-gather-4628p/perf-node-gather-daemonset-2b2sj" Jun 09 05:54:26.207925 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:26.207736 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1437e6ca-c3f5-4585-9073-cecf981af79d-lib-modules\") pod \"perf-node-gather-daemonset-2b2sj\" (UID: \"1437e6ca-c3f5-4585-9073-cecf981af79d\") " pod="openshift-must-gather-4628p/perf-node-gather-daemonset-2b2sj" Jun 09 05:54:26.308594 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:26.308547 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1437e6ca-c3f5-4585-9073-cecf981af79d-proc\") pod \"perf-node-gather-daemonset-2b2sj\" (UID: \"1437e6ca-c3f5-4585-9073-cecf981af79d\") " pod="openshift-must-gather-4628p/perf-node-gather-daemonset-2b2sj" Jun 09 05:54:26.308827 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:26.308635 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1437e6ca-c3f5-4585-9073-cecf981af79d-podres\") pod \"perf-node-gather-daemonset-2b2sj\" (UID: \"1437e6ca-c3f5-4585-9073-cecf981af79d\") " pod="openshift-must-gather-4628p/perf-node-gather-daemonset-2b2sj" Jun 09 05:54:26.308827 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:26.308667 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1437e6ca-c3f5-4585-9073-cecf981af79d-lib-modules\") pod \"perf-node-gather-daemonset-2b2sj\" (UID: \"1437e6ca-c3f5-4585-9073-cecf981af79d\") " pod="openshift-must-gather-4628p/perf-node-gather-daemonset-2b2sj" Jun 09 05:54:26.308827 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:26.308756 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1437e6ca-c3f5-4585-9073-cecf981af79d-sys\") pod \"perf-node-gather-daemonset-2b2sj\" (UID: \"1437e6ca-c3f5-4585-9073-cecf981af79d\") " pod="openshift-must-gather-4628p/perf-node-gather-daemonset-2b2sj" Jun 09 05:54:26.308827 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:26.308786 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbtsj\" (UniqueName: \"kubernetes.io/projected/1437e6ca-c3f5-4585-9073-cecf981af79d-kube-api-access-cbtsj\") pod \"perf-node-gather-daemonset-2b2sj\" (UID: \"1437e6ca-c3f5-4585-9073-cecf981af79d\") " pod="openshift-must-gather-4628p/perf-node-gather-daemonset-2b2sj" Jun 09 05:54:26.309324 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:26.309298 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1437e6ca-c3f5-4585-9073-cecf981af79d-proc\") pod \"perf-node-gather-daemonset-2b2sj\" (UID: \"1437e6ca-c3f5-4585-9073-cecf981af79d\") " pod="openshift-must-gather-4628p/perf-node-gather-daemonset-2b2sj" Jun 09 05:54:26.309448 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:26.309431 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1437e6ca-c3f5-4585-9073-cecf981af79d-podres\") pod \"perf-node-gather-daemonset-2b2sj\" (UID: \"1437e6ca-c3f5-4585-9073-cecf981af79d\") " pod="openshift-must-gather-4628p/perf-node-gather-daemonset-2b2sj" Jun 09 05:54:26.309542 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:26.309524 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1437e6ca-c3f5-4585-9073-cecf981af79d-lib-modules\") pod \"perf-node-gather-daemonset-2b2sj\" (UID: \"1437e6ca-c3f5-4585-9073-cecf981af79d\") " pod="openshift-must-gather-4628p/perf-node-gather-daemonset-2b2sj" Jun 09 05:54:26.309611 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:26.309580 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1437e6ca-c3f5-4585-9073-cecf981af79d-sys\") pod \"perf-node-gather-daemonset-2b2sj\" (UID: \"1437e6ca-c3f5-4585-9073-cecf981af79d\") " pod="openshift-must-gather-4628p/perf-node-gather-daemonset-2b2sj" Jun 09 05:54:26.317673 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:26.317633 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbtsj\" (UniqueName: \"kubernetes.io/projected/1437e6ca-c3f5-4585-9073-cecf981af79d-kube-api-access-cbtsj\") pod \"perf-node-gather-daemonset-2b2sj\" (UID: \"1437e6ca-c3f5-4585-9073-cecf981af79d\") " pod="openshift-must-gather-4628p/perf-node-gather-daemonset-2b2sj" Jun 09 05:54:26.474780 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:26.474746 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4628p/perf-node-gather-daemonset-2b2sj" Jun 09 05:54:26.683966 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:26.683922 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4628p/perf-node-gather-daemonset-2b2sj"] Jun 09 05:54:26.684676 ip-10-0-130-106 kubenswrapper[2564]: W0609 05:54:26.684630 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod1437e6ca_c3f5_4585_9073_cecf981af79d.slice/crio-327b33b0ea05d60919b9a907ce9a92841b9a30bfba5578f9d624b09c520679b2 WatchSource:0}: Error finding container 327b33b0ea05d60919b9a907ce9a92841b9a30bfba5578f9d624b09c520679b2: Status 404 returned error can't find the container with id 327b33b0ea05d60919b9a907ce9a92841b9a30bfba5578f9d624b09c520679b2 Jun 09 05:54:26.808582 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:26.808550 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78dd696465-6jn5z_51e3be8b-37d4-49d8-ad17-ac56f6d1223a/volume-data-source-validator/0.log" Jun 09 05:54:27.560894 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:27.560764 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4628p/perf-node-gather-daemonset-2b2sj" event={"ID":"1437e6ca-c3f5-4585-9073-cecf981af79d","Type":"ContainerStarted","Data":"436a1141424d0fae31ac12ec04dead2a9e7443829da037c5b1804e4a5b099da7"} Jun 09 05:54:27.560894 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:27.560856 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4628p/perf-node-gather-daemonset-2b2sj" event={"ID":"1437e6ca-c3f5-4585-9073-cecf981af79d","Type":"ContainerStarted","Data":"327b33b0ea05d60919b9a907ce9a92841b9a30bfba5578f9d624b09c520679b2"} Jun 09 05:54:27.581748 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:27.577856 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-4628p/perf-node-gather-daemonset-2b2sj" podStartSLOduration=1.57783139 podStartE2EDuration="1.57783139s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 05:54:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 05:54:27.576948315 +0000 UTC m=+1517.659600079" watchObservedRunningTime="2026-06-09 05:54:27.57783139 +0000 UTC m=+1517.660483126" Jun 09 05:54:28.091842 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:28.091818 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xv6r9_516d15e3-b193-4355-8f8d-991da86b5526/dns/0.log" Jun 09 05:54:28.113842 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:28.113790 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xv6r9_516d15e3-b193-4355-8f8d-991da86b5526/kube-rbac-proxy/0.log" Jun 09 05:54:28.187086 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:28.187061 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-n8vqj_50e77e00-d2c2-45fa-9095-05a6d05a90e4/dns-node-resolver/0.log" Jun 09 05:54:28.571819 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:28.571774 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-4628p/perf-node-gather-daemonset-2b2sj" Jun 09 05:54:28.808705 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:28.808678 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zbjvr_da2e480a-b5b6-44d9-a94c-0ad232ec311c/node-ca/0.log" Jun 09 05:54:29.740398 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:29.740370 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795nm9vb_c659facb-644a-4c14-9ccc-2152877a75bb/istio-proxy/0.log" Jun 09 05:54:30.639314 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:30.639286 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kvqjb_b6726283-2599-497d-a285-634461e11061/serve-healthcheck-canary/0.log" Jun 09 05:54:31.142574 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:31.142545 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-r4vnz_5aadd1b0-611a-48e8-bde8-9fbb65562c69/insights-operator/0.log" Jun 09 05:54:31.144466 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:31.144444 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-r4vnz_5aadd1b0-611a-48e8-bde8-9fbb65562c69/insights-operator/1.log" Jun 09 05:54:31.239628 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:31.239596 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cbktn_88b8a41e-19a5-4323-b7d1-387ae87392ee/kube-rbac-proxy/0.log" Jun 09 05:54:31.263523 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:31.263493 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cbktn_88b8a41e-19a5-4323-b7d1-387ae87392ee/exporter/0.log" Jun 09 05:54:31.288568 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:31.288539 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cbktn_88b8a41e-19a5-4323-b7d1-387ae87392ee/extractor/0.log" Jun 09 05:54:33.558361 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:33.558332 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-85965bc8b6-r96rp_46835475-9e02-4acc-9987-c3420f9751e9/nginx/0.log" Jun 09 05:54:33.685616 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:33.685592 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29683065-qwgd4_c17f8e8a-dcbc-4240-bc92-d7e08db1ebcb/cleanup/0.log" Jun 09 05:54:33.727302 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:33.727262 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6cbcff6cff-sgnwm_a6bde9fd-9bbf-4a78-826d-bb58c1d73196/manager/0.log" Jun 09 05:54:33.749372 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:33.749345 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-dsxmv_f51482b8-edfb-4f94-8a31-2b615a67d304/server/0.log" Jun 09 05:54:33.800727 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:33.800693 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-kv94q_4fbcde52-a813-40c6-ab57-9b47f9eb6bee/manager/0.log" Jun 09 05:54:33.891482 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:33.891387 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-66ccd5c574-4wl8b_9a99d12a-707c-428e-9f95-a7c904ca4240/manager/0.log" Jun 09 05:54:33.908854 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:33.908825 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-66ccd5c574-4wl8b_9a99d12a-707c-428e-9f95-a7c904ca4240/copy-manifests/0.log" Jun 09 05:54:34.592597 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:34.592564 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-4628p/perf-node-gather-daemonset-2b2sj" Jun 09 05:54:35.626698 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:35.626667 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-55f7df5cdd-bl8zr_6885e467-ada1-464d-8e7b-7513ec056df0/manager/0.log" Jun 09 05:54:35.679644 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:35.679617 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-ptwzv_45d4dc70-6973-499d-b170-32092e1f35d3/openshift-lws-operator/0.log" Jun 09 05:54:40.548749 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:40.548713 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795nm9vb_c659facb-644a-4c14-9ccc-2152877a75bb/istio-proxy/0.log" Jun 09 05:54:41.465369 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:41.465330 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-lx6qd_105c1a70-a1c8-478d-982a-41a350a2dbd2/kube-storage-version-migrator-operator/1.log" Jun 09 05:54:41.466296 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:41.466265 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-lx6qd_105c1a70-a1c8-478d-982a-41a350a2dbd2/kube-storage-version-migrator-operator/0.log" Jun 09 05:54:41.801887 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:41.801860 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795nm9vb_c659facb-644a-4c14-9ccc-2152877a75bb/istio-proxy/0.log" Jun 09 05:54:42.604899 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:42.604869 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-7x4c6_f0b74df6-4873-4f9c-b0f5-9dc2da97c37d/kube-multus/0.log" Jun 09 05:54:42.964907 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:42.964830 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qmt9g_04cabc1f-f6d7-4aa2-a53e-06946b3655a7/kube-multus-additional-cni-plugins/0.log" Jun 09 05:54:42.986660 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:42.986636 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qmt9g_04cabc1f-f6d7-4aa2-a53e-06946b3655a7/egress-router-binary-copy/0.log" Jun 09 05:54:43.011198 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:43.011178 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qmt9g_04cabc1f-f6d7-4aa2-a53e-06946b3655a7/cni-plugins/0.log" Jun 09 05:54:43.033562 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:43.033536 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qmt9g_04cabc1f-f6d7-4aa2-a53e-06946b3655a7/bond-cni-plugin/0.log" Jun 09 05:54:43.054744 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:43.054718 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qmt9g_04cabc1f-f6d7-4aa2-a53e-06946b3655a7/routeoverride-cni/0.log" Jun 09 05:54:43.077843 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:43.077823 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qmt9g_04cabc1f-f6d7-4aa2-a53e-06946b3655a7/whereabouts-cni-bincopy/0.log" Jun 09 05:54:43.099404 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:43.099379 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qmt9g_04cabc1f-f6d7-4aa2-a53e-06946b3655a7/whereabouts-cni/0.log" Jun 09 05:54:43.161575 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:43.161549 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-g2vt2_73b6af10-58e6-4c5f-bcfc-083f82dfc9db/network-metrics-daemon/0.log" Jun 09 05:54:43.183675 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:43.183642 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-g2vt2_73b6af10-58e6-4c5f-bcfc-083f82dfc9db/kube-rbac-proxy/0.log" Jun 09 05:54:43.498930 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:43.498894 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795nm9vb_c659facb-644a-4c14-9ccc-2152877a75bb/istio-proxy/0.log" Jun 09 05:54:44.220268 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:44.220239 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-42h5b_02c37648-4419-4ff7-a316-568fa0510cee/ovn-controller/0.log" Jun 09 05:54:44.240407 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:44.240384 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-42h5b_02c37648-4419-4ff7-a316-568fa0510cee/ovn-acl-logging/0.log" Jun 09 05:54:44.240571 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:44.240438 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-42h5b_02c37648-4419-4ff7-a316-568fa0510cee/ovn-acl-logging/1.log" Jun 09 05:54:44.263080 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:44.263061 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-42h5b_02c37648-4419-4ff7-a316-568fa0510cee/kube-rbac-proxy-node/0.log" Jun 09 05:54:44.285762 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:44.285743 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-42h5b_02c37648-4419-4ff7-a316-568fa0510cee/kube-rbac-proxy-ovn-metrics/0.log" Jun 09 05:54:44.303349 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:44.303332 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-42h5b_02c37648-4419-4ff7-a316-568fa0510cee/northd/0.log" Jun 09 05:54:44.324738 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:44.324717 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-42h5b_02c37648-4419-4ff7-a316-568fa0510cee/nbdb/0.log" Jun 09 05:54:44.347400 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:44.347383 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-42h5b_02c37648-4419-4ff7-a316-568fa0510cee/sbdb/0.log" Jun 09 05:54:44.400543 ip-10-0-130-106 kubenswrapper[2564]: I0609 05:54:44.400460 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-42h5b_02c37648-4419-4ff7-a316-568fa0510cee/ovnkube-controller/0.log"