Jun 09 15:14:39.077495 ip-10-0-129-139 systemd[1]: Starting Kubernetes Kubelet... Jun 09 15:14:39.466576 ip-10-0-129-139 kubenswrapper[2611]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 15:14:39.466576 ip-10-0-129-139 kubenswrapper[2611]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 09 15:14:39.466576 ip-10-0-129-139 kubenswrapper[2611]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 15:14:39.466576 ip-10-0-129-139 kubenswrapper[2611]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 09 15:14:39.466576 ip-10-0-129-139 kubenswrapper[2611]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 15:14:39.467712 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.467562 2611 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 09 15:14:39.471664 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471647 2611 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 15:14:39.471664 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471664 2611 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 15:14:39.471732 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471668 2611 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 15:14:39.471732 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471671 2611 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 15:14:39.471732 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471674 2611 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 15:14:39.471732 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471677 2611 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 15:14:39.471732 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471680 2611 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 15:14:39.471732 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471683 2611 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 15:14:39.471732 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471686 2611 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 15:14:39.471732 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471688 2611 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 15:14:39.471732 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471691 2611 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 15:14:39.471732 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471693 2611 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 15:14:39.471732 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471696 2611 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 15:14:39.471732 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471698 2611 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 15:14:39.471732 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471701 2611 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 15:14:39.471732 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471704 2611 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 15:14:39.471732 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471706 2611 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 15:14:39.471732 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471709 2611 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 15:14:39.471732 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471711 2611 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 15:14:39.471732 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471715 2611 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 15:14:39.471732 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471717 2611 feature_gate.go:328] unrecognized feature gate: Example Jun 09 15:14:39.471732 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471720 2611 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 15:14:39.472256 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471722 2611 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 15:14:39.472256 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471725 2611 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 15:14:39.472256 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471729 2611 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 15:14:39.472256 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471733 2611 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 15:14:39.472256 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471737 2611 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 15:14:39.472256 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471741 2611 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 15:14:39.472256 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471744 2611 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 15:14:39.472256 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471748 2611 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 15:14:39.472256 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471751 2611 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 15:14:39.472256 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471754 2611 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 15:14:39.472256 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471757 2611 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 15:14:39.472256 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471759 2611 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 15:14:39.472256 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471762 2611 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 15:14:39.472256 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471765 2611 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 15:14:39.472256 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471768 2611 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 15:14:39.472256 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471770 2611 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 15:14:39.472256 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471772 2611 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 15:14:39.472256 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471775 2611 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 15:14:39.472256 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471778 2611 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 15:14:39.472709 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471780 2611 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 15:14:39.472709 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471782 2611 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 15:14:39.472709 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471785 2611 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 15:14:39.472709 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471787 2611 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 15:14:39.472709 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471790 2611 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 15:14:39.472709 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471793 2611 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 15:14:39.472709 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471795 2611 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 15:14:39.472709 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471798 2611 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 15:14:39.472709 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471800 2611 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 15:14:39.472709 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471803 2611 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 15:14:39.472709 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471806 2611 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 15:14:39.472709 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471808 2611 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 15:14:39.472709 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471811 2611 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 15:14:39.472709 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471813 2611 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 15:14:39.472709 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471816 2611 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 15:14:39.472709 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471819 2611 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 15:14:39.472709 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471822 2611 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 15:14:39.472709 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471825 2611 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 15:14:39.472709 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471828 2611 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 15:14:39.472709 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471830 2611 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 15:14:39.473222 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471833 2611 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 15:14:39.473222 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471835 2611 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 15:14:39.473222 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471839 2611 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 15:14:39.473222 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471841 2611 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 15:14:39.473222 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471844 2611 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 15:14:39.473222 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471846 2611 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 15:14:39.473222 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471848 2611 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 15:14:39.473222 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471851 2611 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 15:14:39.473222 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471854 2611 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 15:14:39.473222 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471856 2611 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 15:14:39.473222 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471859 2611 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 15:14:39.473222 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471861 2611 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 15:14:39.473222 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471864 2611 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 15:14:39.473222 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471867 2611 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 15:14:39.473222 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471870 2611 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 15:14:39.473222 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471872 2611 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 15:14:39.473222 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471875 2611 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 15:14:39.473222 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471877 2611 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 15:14:39.473222 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471880 2611 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 15:14:39.473222 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471882 2611 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 15:14:39.473704 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471885 2611 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 15:14:39.473704 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471888 2611 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 15:14:39.473704 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471890 2611 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 15:14:39.473704 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471894 2611 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 15:14:39.473704 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471896 2611 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 15:14:39.473704 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471899 2611 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 15:14:39.473704 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471902 2611 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 15:14:39.473704 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471907 2611 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 15:14:39.473704 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471909 2611 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 15:14:39.473704 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471912 2611 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 15:14:39.473704 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471915 2611 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 15:14:39.473704 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471918 2611 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 15:14:39.473704 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471920 2611 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 15:14:39.473704 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471923 2611 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 15:14:39.473704 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471927 2611 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 15:14:39.473704 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471931 2611 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 15:14:39.473704 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471934 2611 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 15:14:39.473704 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.471938 2611 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 15:14:39.473704 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472674 2611 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 15:14:39.474191 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472681 2611 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 15:14:39.474191 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472684 2611 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 15:14:39.474191 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472688 2611 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 15:14:39.474191 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472691 2611 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 15:14:39.474191 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472694 2611 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 15:14:39.474191 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472696 2611 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 15:14:39.474191 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472699 2611 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 15:14:39.474191 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472702 2611 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 15:14:39.474191 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472705 2611 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 15:14:39.474191 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472708 2611 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 15:14:39.474191 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472710 2611 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 15:14:39.474191 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472713 2611 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 15:14:39.474191 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472716 2611 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 15:14:39.474191 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472719 2611 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 15:14:39.474191 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472723 2611 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 15:14:39.474191 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472727 2611 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 15:14:39.474191 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472730 2611 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 15:14:39.474191 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472733 2611 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 15:14:39.474191 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472735 2611 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 15:14:39.474701 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472739 2611 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 15:14:39.474701 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472741 2611 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 15:14:39.474701 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472745 2611 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 15:14:39.474701 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472747 2611 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 15:14:39.474701 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472750 2611 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 15:14:39.474701 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472752 2611 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 15:14:39.474701 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472755 2611 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 15:14:39.474701 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472757 2611 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 15:14:39.474701 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472760 2611 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 15:14:39.474701 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472762 2611 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 15:14:39.474701 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472765 2611 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 15:14:39.474701 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472767 2611 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 15:14:39.474701 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472770 2611 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 15:14:39.474701 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472772 2611 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 15:14:39.474701 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472775 2611 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 15:14:39.474701 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472778 2611 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 15:14:39.474701 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472780 2611 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 15:14:39.474701 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472784 2611 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 15:14:39.474701 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472786 2611 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 15:14:39.474701 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472789 2611 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 15:14:39.475215 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472792 2611 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 15:14:39.475215 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472794 2611 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 15:14:39.475215 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472796 2611 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 15:14:39.475215 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472799 2611 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 15:14:39.475215 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472801 2611 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 15:14:39.475215 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472804 2611 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 15:14:39.475215 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472806 2611 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 15:14:39.475215 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472809 2611 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 15:14:39.475215 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472812 2611 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 15:14:39.475215 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472814 2611 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 15:14:39.475215 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472817 2611 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 15:14:39.475215 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472819 2611 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 15:14:39.475215 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472823 2611 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 15:14:39.475215 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472826 2611 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 15:14:39.475215 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472828 2611 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 15:14:39.475215 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472831 2611 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 15:14:39.475215 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472834 2611 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 15:14:39.475215 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472836 2611 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 15:14:39.475215 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472839 2611 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 15:14:39.475215 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472841 2611 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 15:14:39.475716 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472844 2611 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 15:14:39.475716 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472846 2611 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 15:14:39.475716 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472849 2611 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 15:14:39.475716 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472852 2611 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 15:14:39.475716 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472856 2611 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 15:14:39.475716 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472858 2611 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 15:14:39.475716 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472861 2611 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 15:14:39.475716 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472863 2611 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 15:14:39.475716 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472866 2611 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 15:14:39.475716 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472868 2611 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 15:14:39.475716 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472871 2611 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 15:14:39.475716 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472873 2611 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 15:14:39.475716 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472876 2611 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 15:14:39.475716 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472878 2611 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 15:14:39.475716 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472881 2611 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 15:14:39.475716 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472883 2611 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 15:14:39.475716 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472887 2611 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 15:14:39.475716 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472889 2611 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 15:14:39.475716 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472892 2611 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 15:14:39.476203 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472895 2611 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 15:14:39.476203 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472897 2611 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 15:14:39.476203 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472900 2611 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 15:14:39.476203 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472903 2611 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 15:14:39.476203 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472906 2611 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 15:14:39.476203 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472909 2611 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 15:14:39.476203 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472912 2611 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 15:14:39.476203 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472915 2611 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 15:14:39.476203 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472917 2611 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 15:14:39.476203 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472920 2611 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 15:14:39.476203 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472922 2611 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 15:14:39.476203 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472925 2611 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 15:14:39.476203 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472927 2611 feature_gate.go:328] unrecognized feature gate: Example Jun 09 15:14:39.476203 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472930 2611 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 15:14:39.476203 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472933 2611 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 15:14:39.476203 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472935 2611 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 15:14:39.476203 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472938 2611 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 15:14:39.476203 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472942 2611 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 15:14:39.476203 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472946 2611 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 15:14:39.476669 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.472948 2611 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 15:14:39.476669 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473366 2611 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 15:14:39.476669 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473372 2611 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 15:14:39.476669 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473375 2611 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 15:14:39.476669 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473378 2611 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 15:14:39.476669 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473381 2611 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 15:14:39.476669 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473384 2611 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 15:14:39.476669 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473386 2611 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 15:14:39.476669 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473389 2611 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 15:14:39.476669 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473392 2611 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 15:14:39.476669 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473395 2611 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 15:14:39.476669 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473398 2611 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 15:14:39.476669 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473400 2611 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 15:14:39.476669 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473403 2611 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 15:14:39.476669 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473406 2611 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 15:14:39.476669 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473414 2611 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 15:14:39.476669 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473417 2611 feature_gate.go:328] unrecognized feature gate: Example Jun 09 15:14:39.476669 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473420 2611 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 15:14:39.476669 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473428 2611 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 15:14:39.476669 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473431 2611 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 15:14:39.477180 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473434 2611 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 15:14:39.477180 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473436 2611 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 15:14:39.477180 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473439 2611 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 15:14:39.477180 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473441 2611 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 15:14:39.477180 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473445 2611 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 15:14:39.477180 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473449 2611 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 15:14:39.477180 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473452 2611 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 15:14:39.477180 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473455 2611 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 15:14:39.477180 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473458 2611 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 15:14:39.477180 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473460 2611 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 15:14:39.477180 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473463 2611 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 15:14:39.477180 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473466 2611 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 15:14:39.477180 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473468 2611 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 15:14:39.477180 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473471 2611 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 15:14:39.477180 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473473 2611 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 15:14:39.477180 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473476 2611 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 15:14:39.477180 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473479 2611 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 15:14:39.477180 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473481 2611 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 15:14:39.477180 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473484 2611 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 15:14:39.477639 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473486 2611 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 15:14:39.477639 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473489 2611 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 15:14:39.477639 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473492 2611 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 15:14:39.477639 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473494 2611 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 15:14:39.477639 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473497 2611 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 15:14:39.477639 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473500 2611 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 15:14:39.477639 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473502 2611 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 15:14:39.477639 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473505 2611 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 15:14:39.477639 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473508 2611 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 15:14:39.477639 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473516 2611 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 15:14:39.477639 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473519 2611 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 15:14:39.477639 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473521 2611 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 15:14:39.477639 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473524 2611 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 15:14:39.477639 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473527 2611 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 15:14:39.477639 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473530 2611 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 15:14:39.477639 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473533 2611 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 15:14:39.477639 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473535 2611 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 15:14:39.477639 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473538 2611 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 15:14:39.477639 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473541 2611 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 15:14:39.477639 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473543 2611 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 15:14:39.478142 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473546 2611 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 15:14:39.478142 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473548 2611 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 15:14:39.478142 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473551 2611 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 15:14:39.478142 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473553 2611 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 15:14:39.478142 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473556 2611 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 15:14:39.478142 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473558 2611 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 15:14:39.478142 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473561 2611 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 15:14:39.478142 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473563 2611 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 15:14:39.478142 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473565 2611 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 15:14:39.478142 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473569 2611 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 15:14:39.478142 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473571 2611 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 15:14:39.478142 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473574 2611 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 15:14:39.478142 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473576 2611 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 15:14:39.478142 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473579 2611 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 15:14:39.478142 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473582 2611 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 15:14:39.478142 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473584 2611 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 15:14:39.478142 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473587 2611 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 15:14:39.478142 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473589 2611 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 15:14:39.478142 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473596 2611 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 15:14:39.478142 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473599 2611 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 15:14:39.478658 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473601 2611 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 15:14:39.478658 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473604 2611 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 15:14:39.478658 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473616 2611 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 15:14:39.478658 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473619 2611 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 15:14:39.478658 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473621 2611 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 15:14:39.478658 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473623 2611 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 15:14:39.478658 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473626 2611 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 15:14:39.478658 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473629 2611 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 15:14:39.478658 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473631 2611 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 15:14:39.478658 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473634 2611 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 15:14:39.478658 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473636 2611 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 15:14:39.478658 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473639 2611 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 15:14:39.478658 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473641 2611 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 15:14:39.478658 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473645 2611 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 15:14:39.478658 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473647 2611 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 15:14:39.478658 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473651 2611 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 15:14:39.478658 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473654 2611 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 15:14:39.478658 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473657 2611 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 15:14:39.478658 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473659 2611 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 15:14:39.479117 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473662 2611 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 15:14:39.479117 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.473666 2611 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 15:14:39.479117 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.473744 2611 flags.go:64] FLAG: --address="0.0.0.0" Jun 09 15:14:39.479117 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.473758 2611 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 09 15:14:39.479117 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474302 2611 flags.go:64] FLAG: --anonymous-auth="true" Jun 09 15:14:39.479117 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474307 2611 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 09 15:14:39.479117 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474312 2611 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 09 15:14:39.479117 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474315 2611 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 09 15:14:39.479117 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474320 2611 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 09 15:14:39.479117 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474324 2611 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 09 15:14:39.479117 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474328 2611 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 09 15:14:39.479117 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474332 2611 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 09 15:14:39.479117 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474335 2611 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 09 15:14:39.479117 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474338 2611 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 09 15:14:39.479117 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474341 2611 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 09 15:14:39.479117 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474344 2611 flags.go:64] FLAG: --cgroup-root="" Jun 09 15:14:39.479117 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474353 2611 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 09 15:14:39.479117 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474357 2611 flags.go:64] FLAG: --client-ca-file="" Jun 09 15:14:39.479117 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474359 2611 flags.go:64] FLAG: --cloud-provider="external" Jun 09 15:14:39.479117 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474362 2611 flags.go:64] FLAG: --cluster-dns="[]" Jun 09 15:14:39.479117 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474369 2611 flags.go:64] FLAG: --cluster-domain="" Jun 09 15:14:39.479117 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474372 2611 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 09 15:14:39.479117 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474375 2611 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 09 15:14:39.479694 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474380 2611 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 09 15:14:39.479694 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474383 2611 flags.go:64] FLAG: --container-log-max-files="5" Jun 09 15:14:39.479694 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474387 2611 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 09 15:14:39.479694 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474390 2611 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 09 15:14:39.479694 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474393 2611 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 09 15:14:39.479694 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474396 2611 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 09 15:14:39.479694 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474399 2611 flags.go:64] FLAG: --contention-profiling="false" Jun 09 15:14:39.479694 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474402 2611 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 09 15:14:39.479694 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474405 2611 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 09 15:14:39.479694 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474408 2611 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 09 15:14:39.479694 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474411 2611 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 09 15:14:39.479694 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474415 2611 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 09 15:14:39.479694 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474418 2611 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 09 15:14:39.479694 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474421 2611 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 09 15:14:39.479694 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474424 2611 flags.go:64] FLAG: --enable-load-reader="false" Jun 09 15:14:39.479694 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474427 2611 flags.go:64] FLAG: --enable-server="true" Jun 09 15:14:39.479694 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474430 2611 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 09 15:14:39.479694 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474437 2611 flags.go:64] FLAG: --event-burst="100" Jun 09 15:14:39.479694 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474440 2611 flags.go:64] FLAG: --event-qps="50" Jun 09 15:14:39.479694 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474443 2611 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 09 15:14:39.479694 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474447 2611 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 09 15:14:39.479694 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474450 2611 flags.go:64] FLAG: --eviction-hard="" Jun 09 15:14:39.479694 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474454 2611 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 09 15:14:39.479694 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474457 2611 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 09 15:14:39.480326 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474460 2611 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 09 15:14:39.480326 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474463 2611 flags.go:64] FLAG: --eviction-soft="" Jun 09 15:14:39.480326 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474471 2611 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 09 15:14:39.480326 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474474 2611 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 09 15:14:39.480326 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474477 2611 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 09 15:14:39.480326 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474480 2611 flags.go:64] FLAG: --experimental-mounter-path="" Jun 09 15:14:39.480326 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474483 2611 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 09 15:14:39.480326 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474486 2611 flags.go:64] FLAG: --fail-swap-on="true" Jun 09 15:14:39.480326 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474491 2611 flags.go:64] FLAG: --feature-gates="" Jun 09 15:14:39.480326 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474495 2611 flags.go:64] FLAG: --file-check-frequency="20s" Jun 09 15:14:39.480326 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474498 2611 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 09 15:14:39.480326 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474501 2611 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 09 15:14:39.480326 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474504 2611 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 09 15:14:39.480326 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474507 2611 flags.go:64] FLAG: --healthz-port="10248" Jun 09 15:14:39.480326 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474510 2611 flags.go:64] FLAG: --help="false" Jun 09 15:14:39.480326 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474513 2611 flags.go:64] FLAG: --hostname-override="ip-10-0-129-139.ec2.internal" Jun 09 15:14:39.480326 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474517 2611 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 09 15:14:39.480326 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474520 2611 flags.go:64] FLAG: --http-check-frequency="20s" Jun 09 15:14:39.480326 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474523 2611 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 09 15:14:39.480326 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474526 2611 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 09 15:14:39.480326 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474530 2611 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 09 15:14:39.480326 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474532 2611 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 09 15:14:39.480326 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474535 2611 flags.go:64] FLAG: --image-service-endpoint="" Jun 09 15:14:39.480934 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474538 2611 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 09 15:14:39.480934 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474541 2611 flags.go:64] FLAG: --kube-api-burst="100" Jun 09 15:14:39.480934 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474544 2611 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 09 15:14:39.480934 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474547 2611 flags.go:64] FLAG: --kube-api-qps="50" Jun 09 15:14:39.480934 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474550 2611 flags.go:64] FLAG: --kube-reserved="" Jun 09 15:14:39.480934 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474553 2611 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 09 15:14:39.480934 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474556 2611 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 09 15:14:39.480934 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474559 2611 flags.go:64] FLAG: --kubelet-cgroups="" Jun 09 15:14:39.480934 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474562 2611 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 09 15:14:39.480934 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474565 2611 flags.go:64] FLAG: --lock-file="" Jun 09 15:14:39.480934 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474568 2611 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 09 15:14:39.480934 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474571 2611 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 09 15:14:39.480934 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474580 2611 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 09 15:14:39.480934 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474586 2611 flags.go:64] FLAG: --log-json-split-stream="false" Jun 09 15:14:39.480934 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474589 2611 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 09 15:14:39.480934 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474592 2611 flags.go:64] FLAG: --log-text-split-stream="false" Jun 09 15:14:39.480934 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474595 2611 flags.go:64] FLAG: --logging-format="text" Jun 09 15:14:39.480934 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474599 2611 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 09 15:14:39.480934 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474602 2611 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 09 15:14:39.480934 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474605 2611 flags.go:64] FLAG: --manifest-url="" Jun 09 15:14:39.480934 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474608 2611 flags.go:64] FLAG: --manifest-url-header="" Jun 09 15:14:39.480934 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474613 2611 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 09 15:14:39.480934 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474616 2611 flags.go:64] FLAG: --max-open-files="1000000" Jun 09 15:14:39.480934 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474620 2611 flags.go:64] FLAG: --max-pods="110" Jun 09 15:14:39.480934 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474624 2611 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 09 15:14:39.481644 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474627 2611 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 09 15:14:39.481644 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474630 2611 flags.go:64] FLAG: --memory-manager-policy="None" Jun 09 15:14:39.481644 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474633 2611 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 09 15:14:39.481644 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474636 2611 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 09 15:14:39.481644 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474639 2611 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 09 15:14:39.481644 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474642 2611 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 09 15:14:39.481644 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474650 2611 flags.go:64] FLAG: --node-status-max-images="50" Jun 09 15:14:39.481644 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474652 2611 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 09 15:14:39.481644 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474656 2611 flags.go:64] FLAG: --oom-score-adj="-999" Jun 09 15:14:39.481644 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474659 2611 flags.go:64] FLAG: --pod-cidr="" Jun 09 15:14:39.481644 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474661 2611 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 09 15:14:39.481644 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474667 2611 flags.go:64] FLAG: --pod-manifest-path="" Jun 09 15:14:39.481644 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474669 2611 flags.go:64] FLAG: --pod-max-pids="-1" Jun 09 15:14:39.481644 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474672 2611 flags.go:64] FLAG: --pods-per-core="0" Jun 09 15:14:39.481644 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474676 2611 flags.go:64] FLAG: --port="10250" Jun 09 15:14:39.481644 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474679 2611 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 09 15:14:39.481644 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474681 2611 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-02f721f5af2f9096b" Jun 09 15:14:39.481644 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474684 2611 flags.go:64] FLAG: --qos-reserved="" Jun 09 15:14:39.481644 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474687 2611 flags.go:64] FLAG: --read-only-port="10255" Jun 09 15:14:39.481644 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474690 2611 flags.go:64] FLAG: --register-node="true" Jun 09 15:14:39.481644 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474699 2611 flags.go:64] FLAG: --register-with-taints="" Jun 09 15:14:39.481644 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474703 2611 flags.go:64] FLAG: --registry-burst="10" Jun 09 15:14:39.481644 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474706 2611 flags.go:64] FLAG: --registry-qps="5" Jun 09 15:14:39.481644 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474709 2611 flags.go:64] FLAG: --reserved-cpus="" Jun 09 15:14:39.482257 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474718 2611 flags.go:64] FLAG: --reserved-memory="" Jun 09 15:14:39.482257 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474722 2611 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 09 15:14:39.482257 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474725 2611 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 09 15:14:39.482257 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474728 2611 flags.go:64] FLAG: --rotate-certificates="false" Jun 09 15:14:39.482257 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474730 2611 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 09 15:14:39.482257 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474733 2611 flags.go:64] FLAG: --runonce="false" Jun 09 15:14:39.482257 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474736 2611 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 09 15:14:39.482257 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474739 2611 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 09 15:14:39.482257 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474743 2611 flags.go:64] FLAG: --seccomp-default="false" Jun 09 15:14:39.482257 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474746 2611 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 09 15:14:39.482257 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474749 2611 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 09 15:14:39.482257 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474752 2611 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 09 15:14:39.482257 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474755 2611 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 09 15:14:39.482257 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474758 2611 flags.go:64] FLAG: --storage-driver-password="root" Jun 09 15:14:39.482257 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474761 2611 flags.go:64] FLAG: --storage-driver-secure="false" Jun 09 15:14:39.482257 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474764 2611 flags.go:64] FLAG: --storage-driver-table="stats" Jun 09 15:14:39.482257 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474767 2611 flags.go:64] FLAG: --storage-driver-user="root" Jun 09 15:14:39.482257 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474771 2611 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 09 15:14:39.482257 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474774 2611 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 09 15:14:39.482257 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474777 2611 flags.go:64] FLAG: --system-cgroups="" Jun 09 15:14:39.482257 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474780 2611 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 09 15:14:39.482257 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474785 2611 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 09 15:14:39.482257 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474788 2611 flags.go:64] FLAG: --tls-cert-file="" Jun 09 15:14:39.482257 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474791 2611 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 09 15:14:39.482257 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474797 2611 flags.go:64] FLAG: --tls-min-version="" Jun 09 15:14:39.483087 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474800 2611 flags.go:64] FLAG: --tls-private-key-file="" Jun 09 15:14:39.483087 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474803 2611 flags.go:64] FLAG: --topology-manager-policy="none" Jun 09 15:14:39.483087 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474806 2611 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 09 15:14:39.483087 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474809 2611 flags.go:64] FLAG: --topology-manager-scope="container" Jun 09 15:14:39.483087 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474823 2611 flags.go:64] FLAG: --v="2" Jun 09 15:14:39.483087 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474827 2611 flags.go:64] FLAG: --version="false" Jun 09 15:14:39.483087 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474831 2611 flags.go:64] FLAG: --vmodule="" Jun 09 15:14:39.483087 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474836 2611 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 09 15:14:39.483087 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.474839 2611 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 09 15:14:39.483087 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475023 2611 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 15:14:39.483087 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475027 2611 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 15:14:39.483087 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475060 2611 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 15:14:39.483087 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475076 2611 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 15:14:39.483087 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475081 2611 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 15:14:39.483087 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475086 2611 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 15:14:39.483087 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475089 2611 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 15:14:39.483087 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475092 2611 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 15:14:39.483087 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475095 2611 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 15:14:39.483087 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475098 2611 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 15:14:39.483087 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475101 2611 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 15:14:39.483087 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475104 2611 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 15:14:39.483932 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475107 2611 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 15:14:39.483932 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475109 2611 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 15:14:39.483932 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475112 2611 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 15:14:39.483932 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475115 2611 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 15:14:39.483932 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475117 2611 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 15:14:39.483932 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475120 2611 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 15:14:39.483932 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475123 2611 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 15:14:39.483932 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475127 2611 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 15:14:39.483932 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475129 2611 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 15:14:39.483932 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475132 2611 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 15:14:39.483932 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475135 2611 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 15:14:39.483932 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475137 2611 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 15:14:39.483932 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475140 2611 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 15:14:39.483932 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475143 2611 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 15:14:39.483932 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475145 2611 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 15:14:39.483932 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475148 2611 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 15:14:39.483932 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475151 2611 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 15:14:39.483932 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475164 2611 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 15:14:39.483932 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475167 2611 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 15:14:39.483932 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475169 2611 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 15:14:39.484482 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475172 2611 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 15:14:39.484482 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475174 2611 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 15:14:39.484482 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475178 2611 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 15:14:39.484482 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475183 2611 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 15:14:39.484482 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475186 2611 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 15:14:39.484482 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475189 2611 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 15:14:39.484482 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475191 2611 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 15:14:39.484482 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475194 2611 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 15:14:39.484482 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475197 2611 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 15:14:39.484482 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475199 2611 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 15:14:39.484482 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475202 2611 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 15:14:39.484482 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475205 2611 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 15:14:39.484482 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475208 2611 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 15:14:39.484482 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475211 2611 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 15:14:39.484482 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475213 2611 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 15:14:39.484482 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475216 2611 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 15:14:39.484482 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475219 2611 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 15:14:39.484482 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475222 2611 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 15:14:39.484482 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475225 2611 feature_gate.go:328] unrecognized feature gate: Example Jun 09 15:14:39.484960 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475227 2611 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 15:14:39.484960 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475230 2611 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 15:14:39.484960 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475233 2611 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 15:14:39.484960 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475236 2611 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 15:14:39.484960 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475239 2611 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 15:14:39.484960 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475241 2611 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 15:14:39.484960 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475244 2611 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 15:14:39.484960 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475248 2611 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 15:14:39.484960 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475254 2611 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 15:14:39.484960 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475257 2611 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 15:14:39.484960 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475260 2611 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 15:14:39.484960 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475263 2611 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 15:14:39.484960 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475266 2611 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 15:14:39.484960 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475269 2611 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 15:14:39.484960 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475272 2611 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 15:14:39.484960 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475275 2611 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 15:14:39.484960 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475282 2611 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 15:14:39.484960 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475286 2611 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 15:14:39.484960 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475290 2611 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 15:14:39.485661 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475294 2611 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 15:14:39.485661 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475297 2611 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 15:14:39.485661 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475300 2611 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 15:14:39.485661 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475303 2611 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 15:14:39.485661 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475306 2611 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 15:14:39.485661 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475309 2611 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 15:14:39.485661 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475312 2611 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 15:14:39.485661 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475315 2611 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 15:14:39.485661 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475318 2611 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 15:14:39.485661 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475320 2611 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 15:14:39.485661 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475323 2611 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 15:14:39.485661 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475326 2611 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 15:14:39.485661 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475329 2611 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 15:14:39.485661 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475332 2611 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 15:14:39.485661 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475335 2611 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 15:14:39.485661 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475338 2611 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 15:14:39.485661 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475340 2611 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 15:14:39.485661 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475343 2611 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 15:14:39.485661 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475347 2611 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 15:14:39.485661 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475349 2611 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 15:14:39.486148 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475352 2611 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 15:14:39.486148 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475355 2611 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 15:14:39.486148 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475358 2611 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 15:14:39.486148 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475360 2611 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 15:14:39.486148 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475363 2611 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 15:14:39.486148 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475367 2611 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 15:14:39.486148 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475371 2611 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 15:14:39.486148 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475373 2611 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 15:14:39.486148 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.475376 2611 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 15:14:39.486148 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.475384 2611 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 15:14:39.486148 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.482598 2611 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 09 15:14:39.486148 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.482621 2611 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 09 15:14:39.486148 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.483525 2611 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 09 15:14:39.486148 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.483621 2611 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 09 15:14:39.486551 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484030 2611 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 15:14:39.486551 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484203 2611 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 15:14:39.486551 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484208 2611 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 15:14:39.486551 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484212 2611 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 15:14:39.486551 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484217 2611 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 15:14:39.486551 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484222 2611 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 15:14:39.486551 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484227 2611 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 15:14:39.486551 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484231 2611 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 15:14:39.486551 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484235 2611 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 15:14:39.486551 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484240 2611 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 15:14:39.486551 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484244 2611 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 15:14:39.486551 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484247 2611 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 15:14:39.486551 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484250 2611 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 15:14:39.486551 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484253 2611 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 15:14:39.486551 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484256 2611 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 15:14:39.486551 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484258 2611 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 15:14:39.486551 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484261 2611 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 15:14:39.486551 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484264 2611 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 15:14:39.486551 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484266 2611 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 15:14:39.487023 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484269 2611 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 15:14:39.487023 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484272 2611 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 15:14:39.487023 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484274 2611 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 15:14:39.487023 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484277 2611 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 15:14:39.487023 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484280 2611 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 15:14:39.487023 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484284 2611 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 15:14:39.487023 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484287 2611 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 15:14:39.487023 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484290 2611 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 15:14:39.487023 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484292 2611 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 15:14:39.487023 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484295 2611 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 15:14:39.487023 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484297 2611 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 15:14:39.487023 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484300 2611 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 15:14:39.487023 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484303 2611 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 15:14:39.487023 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484305 2611 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 15:14:39.487023 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484309 2611 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 15:14:39.487023 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484312 2611 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 15:14:39.487023 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484315 2611 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 15:14:39.487023 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484319 2611 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 15:14:39.487023 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484322 2611 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 15:14:39.487023 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484325 2611 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 15:14:39.487530 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484329 2611 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 15:14:39.487530 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484331 2611 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 15:14:39.487530 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484334 2611 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 15:14:39.487530 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484337 2611 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 15:14:39.487530 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484340 2611 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 15:14:39.487530 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484342 2611 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 15:14:39.487530 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484345 2611 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 15:14:39.487530 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484348 2611 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 15:14:39.487530 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484351 2611 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 15:14:39.487530 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484353 2611 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 15:14:39.487530 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484356 2611 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 15:14:39.487530 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484359 2611 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 15:14:39.487530 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484362 2611 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 15:14:39.487530 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484366 2611 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 15:14:39.487530 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484369 2611 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 15:14:39.487530 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484373 2611 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 15:14:39.487530 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484399 2611 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 15:14:39.487530 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484403 2611 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 15:14:39.487530 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484406 2611 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 15:14:39.487530 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484410 2611 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 15:14:39.488056 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484412 2611 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 15:14:39.488056 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484415 2611 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 15:14:39.488056 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484419 2611 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 15:14:39.488056 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484421 2611 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 15:14:39.488056 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484424 2611 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 15:14:39.488056 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484427 2611 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 15:14:39.488056 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484430 2611 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 15:14:39.488056 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484433 2611 feature_gate.go:328] unrecognized feature gate: Example Jun 09 15:14:39.488056 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484435 2611 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 15:14:39.488056 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484438 2611 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 15:14:39.488056 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484440 2611 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 15:14:39.488056 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484443 2611 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 15:14:39.488056 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484446 2611 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 15:14:39.488056 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484448 2611 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 15:14:39.488056 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484452 2611 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 15:14:39.488056 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484455 2611 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 15:14:39.488056 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484457 2611 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 15:14:39.488056 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484460 2611 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 15:14:39.488056 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484462 2611 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 15:14:39.488056 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484465 2611 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 15:14:39.488556 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484467 2611 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 15:14:39.488556 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484470 2611 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 15:14:39.488556 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484473 2611 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 15:14:39.488556 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484475 2611 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 15:14:39.488556 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484478 2611 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 15:14:39.488556 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484481 2611 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 15:14:39.488556 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484483 2611 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 15:14:39.488556 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484486 2611 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 15:14:39.488556 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484489 2611 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 15:14:39.488556 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484492 2611 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 15:14:39.488556 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484495 2611 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 15:14:39.488556 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484497 2611 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 15:14:39.488556 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484500 2611 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 15:14:39.488556 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484503 2611 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 15:14:39.488556 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484505 2611 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 15:14:39.488556 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484508 2611 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 15:14:39.488556 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484511 2611 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 15:14:39.488556 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484514 2611 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 15:14:39.488556 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484517 2611 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 15:14:39.489025 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484520 2611 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 15:14:39.489025 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.484525 2611 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 15:14:39.489025 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484659 2611 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 15:14:39.489025 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484663 2611 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 15:14:39.489025 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484666 2611 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 15:14:39.489025 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484670 2611 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 15:14:39.489025 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484675 2611 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 15:14:39.489025 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484677 2611 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 15:14:39.489025 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484680 2611 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 15:14:39.489025 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484683 2611 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 15:14:39.489025 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484686 2611 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 15:14:39.489025 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484688 2611 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 15:14:39.489025 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484691 2611 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 15:14:39.489025 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484694 2611 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 15:14:39.489025 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484696 2611 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 15:14:39.489497 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484699 2611 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 15:14:39.489497 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484701 2611 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 15:14:39.489497 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484704 2611 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 15:14:39.489497 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484706 2611 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 15:14:39.489497 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484709 2611 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 15:14:39.489497 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484712 2611 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 15:14:39.489497 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484714 2611 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 15:14:39.489497 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484717 2611 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 15:14:39.489497 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484719 2611 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 15:14:39.489497 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484722 2611 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 15:14:39.489497 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484724 2611 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 15:14:39.489497 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484728 2611 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 15:14:39.489497 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484731 2611 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 15:14:39.489497 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484734 2611 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 15:14:39.489497 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484738 2611 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 15:14:39.489497 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484740 2611 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 15:14:39.489497 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484744 2611 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 15:14:39.489497 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484747 2611 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 15:14:39.489497 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484750 2611 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 15:14:39.489959 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484753 2611 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 15:14:39.489959 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484756 2611 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 15:14:39.489959 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484759 2611 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 15:14:39.489959 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484761 2611 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 15:14:39.489959 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484765 2611 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 15:14:39.489959 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484769 2611 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 15:14:39.489959 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484772 2611 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 15:14:39.489959 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484775 2611 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 15:14:39.489959 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484777 2611 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 15:14:39.489959 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484780 2611 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 15:14:39.489959 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484782 2611 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 15:14:39.489959 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484785 2611 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 15:14:39.489959 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484788 2611 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 15:14:39.489959 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484790 2611 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 15:14:39.489959 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484793 2611 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 15:14:39.489959 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484796 2611 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 15:14:39.489959 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484798 2611 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 15:14:39.489959 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484801 2611 feature_gate.go:328] unrecognized feature gate: Example Jun 09 15:14:39.489959 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484804 2611 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 15:14:39.489959 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484806 2611 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 15:14:39.490480 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484809 2611 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 15:14:39.490480 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484811 2611 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 15:14:39.490480 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484814 2611 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 15:14:39.490480 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484816 2611 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 15:14:39.490480 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484819 2611 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 15:14:39.490480 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484822 2611 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 15:14:39.490480 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484825 2611 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 15:14:39.490480 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484827 2611 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 15:14:39.490480 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484830 2611 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 15:14:39.490480 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484833 2611 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 15:14:39.490480 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484835 2611 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 15:14:39.490480 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484838 2611 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 15:14:39.490480 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484841 2611 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 15:14:39.490480 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484843 2611 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 15:14:39.490480 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484846 2611 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 15:14:39.490480 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484848 2611 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 15:14:39.490480 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484851 2611 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 15:14:39.490480 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484853 2611 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 15:14:39.490480 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484855 2611 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 15:14:39.490480 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484858 2611 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 15:14:39.490969 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484860 2611 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 15:14:39.490969 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484862 2611 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 15:14:39.490969 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484865 2611 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 15:14:39.490969 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484867 2611 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 15:14:39.490969 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484870 2611 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 15:14:39.490969 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484873 2611 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 15:14:39.490969 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484876 2611 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 15:14:39.490969 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484878 2611 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 15:14:39.490969 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484881 2611 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 15:14:39.490969 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484883 2611 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 15:14:39.490969 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484886 2611 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 15:14:39.490969 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484888 2611 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 15:14:39.490969 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484891 2611 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 15:14:39.490969 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484893 2611 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 15:14:39.490969 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484896 2611 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 15:14:39.490969 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484898 2611 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 15:14:39.490969 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484900 2611 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 15:14:39.490969 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484903 2611 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 15:14:39.490969 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484906 2611 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 15:14:39.490969 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484908 2611 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 15:14:39.491466 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484911 2611 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 15:14:39.491466 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484913 2611 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 15:14:39.491466 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484916 2611 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 15:14:39.491466 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484918 2611 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 15:14:39.491466 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484921 2611 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 15:14:39.491466 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484924 2611 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 15:14:39.491466 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:39.484926 2611 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 15:14:39.491466 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.484931 2611 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 15:14:39.491466 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.485054 2611 server.go:962] "Client rotation is on, will bootstrap in background" Jun 09 15:14:39.491466 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.487952 2611 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 09 15:14:39.491466 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.489789 2611 server.go:1019] "Starting client certificate rotation" Jun 09 15:14:39.491466 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.489895 2611 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 15:14:39.491466 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.489930 2611 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 15:14:39.492398 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.492382 2611 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 15:14:39.494060 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.494042 2611 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 15:14:39.504300 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.504280 2611 log.go:25] "Validated CRI v1 runtime API" Jun 09 15:14:39.507374 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.507357 2611 log.go:25] "Validated CRI v1 image API" Jun 09 15:14:39.508236 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.508211 2611 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 09 15:14:39.512407 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.512381 2611 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 b6306c97-2f6a-420c-9947-a1e4eaee35b9:/dev/nvme0n1p4 c9171184-065f-4812-a9fc-beae888f167a:/dev/nvme0n1p3] Jun 09 15:14:39.512513 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.512405 2611 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 09 15:14:39.514771 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.514752 2611 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 15:14:39.518194 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.518057 2611 manager.go:216] Machine: {Timestamp:2026-06-09 15:14:39.516832289 +0000 UTC m=+0.322524507 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3134565 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2cfc4e36269323605f43326fe750ae SystemUUID:ec2cfc4e-3626-9323-605f-43326fe750ae BootID:3784b08f-93fd-4781-a51a-c361a1d7f0ba Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:9f:01:36:e7:63 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:9f:01:36:e7:63 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:f6:52:4c:37:23:ae Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 09 15:14:39.518194 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.518189 2611 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 09 15:14:39.518312 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.518278 2611 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 09 15:14:39.521074 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.521046 2611 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 09 15:14:39.521267 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.521077 2611 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-139.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 09 15:14:39.521925 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.521912 2611 topology_manager.go:138] "Creating topology manager with none policy" Jun 09 15:14:39.521988 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.521932 2611 container_manager_linux.go:309] "Creating device plugin manager" Jun 09 15:14:39.521988 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.521942 2611 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 15:14:39.522725 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.522711 2611 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 15:14:39.523894 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.523881 2611 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 09 15:14:39.527711 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.527695 2611 state_mem.go:36] "Initialized new in-memory state store" Jun 09 15:14:39.527870 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.527858 2611 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 09 15:14:39.527928 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.527900 2611 kubelet.go:486] "Attempting to sync node with API server" Jun 09 15:14:39.527928 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.527920 2611 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 09 15:14:39.528031 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.527939 2611 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 09 15:14:39.528031 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.527953 2611 kubelet.go:398] "Adding apiserver pod source" Jun 09 15:14:39.528031 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.527967 2611 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 09 15:14:39.528466 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.528450 2611 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 15:14:39.528546 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.528476 2611 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 15:14:39.531566 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.531545 2611 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 09 15:14:39.533739 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.533722 2611 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 09 15:14:39.533802 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.533753 2611 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 09 15:14:39.534337 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.534323 2611 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 09 15:14:39.534387 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.534340 2611 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 09 15:14:39.534387 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.534347 2611 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 09 15:14:39.534387 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.534352 2611 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 09 15:14:39.534387 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.534360 2611 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 09 15:14:39.534387 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.534365 2611 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 09 15:14:39.534387 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.534373 2611 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 09 15:14:39.534387 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.534378 2611 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 09 15:14:39.534387 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.534384 2611 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 09 15:14:39.534387 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.534390 2611 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 09 15:14:39.534614 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.534399 2611 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 09 15:14:39.534614 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.534404 2611 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 09 15:14:39.535194 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.535183 2611 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 09 15:14:39.535194 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.535193 2611 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 09 15:14:39.538456 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.538433 2611 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-139.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 09 15:14:39.538554 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.538486 2611 server.go:1268] "Started kubelet" Jun 09 15:14:39.538621 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.538578 2611 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 09 15:14:39.539210 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.538567 2611 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 09 15:14:39.539210 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:39.539042 2611 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-139.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 09 15:14:39.539210 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:39.539042 2611 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 09 15:14:39.539210 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.539076 2611 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 09 15:14:39.539354 ip-10-0-129-139 systemd[1]: Started Kubernetes Kubelet. Jun 09 15:14:39.540839 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.540823 2611 server.go:310] "Adding debug handlers to kubelet server" Jun 09 15:14:39.540993 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.540978 2611 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 09 15:14:39.541507 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.541484 2611 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-krt5b" Jun 09 15:14:39.543047 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:39.542349 2611 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-139.ec2.internal.18b77281d17030b1 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-139.ec2.internal,UID:ip-10-0-129-139.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-139.ec2.internal,},FirstTimestamp:2026-06-09 15:14:39.538458801 +0000 UTC m=+0.344151059,LastTimestamp:2026-06-09 15:14:39.538458801 +0000 UTC m=+0.344151059,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-139.ec2.internal,}" Jun 09 15:14:39.545701 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:39.545654 2611 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 09 15:14:39.547088 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.547075 2611 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-krt5b" Jun 09 15:14:39.548551 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.548530 2611 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 09 15:14:39.548551 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.548550 2611 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 09 15:14:39.548710 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:39.548682 2611 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-139.ec2.internal\" not found" Jun 09 15:14:39.549297 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.549271 2611 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 09 15:14:39.549297 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.549298 2611 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 09 15:14:39.549459 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.549309 2611 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 09 15:14:39.549459 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.549389 2611 factory.go:55] Registering systemd factory Jun 09 15:14:39.549459 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.549403 2611 factory.go:223] Registration of the systemd container factory successfully Jun 09 15:14:39.549459 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.549434 2611 reconstruct.go:97] "Volume reconstruction finished" Jun 09 15:14:39.549459 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.549443 2611 reconciler.go:29] "Reconciler: start to sync state" Jun 09 15:14:39.549661 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.549647 2611 factory.go:153] Registering CRI-O factory Jun 09 15:14:39.549707 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.549664 2611 factory.go:223] Registration of the crio container factory successfully Jun 09 15:14:39.549756 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.549714 2611 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 09 15:14:39.549756 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.549736 2611 factory.go:103] Registering Raw factory Jun 09 15:14:39.549756 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.549751 2611 manager.go:1196] Started watching for new ooms in manager Jun 09 15:14:39.550512 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.550499 2611 manager.go:349] Starting recovery of all containers Jun 09 15:14:39.559355 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.559310 2611 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 15:14:39.561775 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:39.561611 2611 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-129-139.ec2.internal\" not found" node="ip-10-0-129-139.ec2.internal" Jun 09 15:14:39.562875 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.562860 2611 manager.go:354] Recovery completed Jun 09 15:14:39.567446 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.567435 2611 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 15:14:39.569228 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.569210 2611 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-139.ec2.internal" event="NodeHasSufficientMemory" Jun 09 15:14:39.569285 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.569241 2611 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-139.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 15:14:39.569285 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.569252 2611 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-139.ec2.internal" event="NodeHasSufficientPID" Jun 09 15:14:39.569823 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.569810 2611 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 09 15:14:39.569823 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.569818 2611 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 15:14:39.569931 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.569824 2611 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 09 15:14:39.569931 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.569841 2611 state_mem.go:36] "Initialized new in-memory state store" Jun 09 15:14:39.570584 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.570570 2611 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-139.ec2.internal" event="NodeHasSufficientMemory" Jun 09 15:14:39.570638 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.570595 2611 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-139.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 15:14:39.570638 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.570605 2611 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-139.ec2.internal" event="NodeHasSufficientPID" Jun 09 15:14:39.571061 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.571046 2611 policy_none.go:49] "None policy: Start" Jun 09 15:14:39.571095 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.571070 2611 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 09 15:14:39.571095 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.571086 2611 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 09 15:14:39.572302 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.572287 2611 policy_none.go:47] "Start" Jun 09 15:14:39.617836 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.617817 2611 manager.go:337] "Starting Device Plugin manager" Jun 09 15:14:39.626871 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:39.617860 2611 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 09 15:14:39.626871 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.617876 2611 server.go:87] "Starting device plugin registration server" Jun 09 15:14:39.626871 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.618203 2611 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 09 15:14:39.626871 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.618218 2611 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 09 15:14:39.626871 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.618493 2611 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 09 15:14:39.626871 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.618565 2611 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 09 15:14:39.626871 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.618573 2611 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 09 15:14:39.626871 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:39.619671 2611 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 09 15:14:39.626871 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:39.619713 2611 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-139.ec2.internal\" not found" Jun 09 15:14:39.626871 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.624884 2611 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 09 15:14:39.626871 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.625998 2611 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 09 15:14:39.626871 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.626040 2611 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 09 15:14:39.626871 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.626059 2611 kubelet.go:2448] "Starting kubelet main sync loop" Jun 09 15:14:39.626871 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:39.626091 2611 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 09 15:14:39.628271 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.628245 2611 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 15:14:39.719243 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.719170 2611 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 15:14:39.720203 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.720184 2611 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-139.ec2.internal" event="NodeHasSufficientMemory" Jun 09 15:14:39.720287 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.720223 2611 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-139.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 15:14:39.720287 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.720234 2611 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-139.ec2.internal" event="NodeHasSufficientPID" Jun 09 15:14:39.720287 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.720255 2611 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-139.ec2.internal" Jun 09 15:14:39.726475 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.726457 2611 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-129-139.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-139.ec2.internal"] Jun 09 15:14:39.726549 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.726512 2611 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 15:14:39.727552 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.727533 2611 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-139.ec2.internal" event="NodeHasSufficientMemory" Jun 09 15:14:39.727652 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.727564 2611 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-139.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 15:14:39.727652 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.727575 2611 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-139.ec2.internal" event="NodeHasSufficientPID" Jun 09 15:14:39.727840 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.727827 2611 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-139.ec2.internal" Jun 09 15:14:39.727876 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:39.727847 2611 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-139.ec2.internal\": node \"ip-10-0-129-139.ec2.internal\" not found" Jun 09 15:14:39.728830 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.728816 2611 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 15:14:39.728931 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.728915 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-139.ec2.internal" Jun 09 15:14:39.728968 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.728948 2611 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 15:14:39.729774 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.729760 2611 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-139.ec2.internal" event="NodeHasSufficientMemory" Jun 09 15:14:39.729835 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.729788 2611 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-139.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 15:14:39.729835 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.729799 2611 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-139.ec2.internal" event="NodeHasSufficientPID" Jun 09 15:14:39.729835 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.729764 2611 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-139.ec2.internal" event="NodeHasSufficientMemory" Jun 09 15:14:39.729835 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.729829 2611 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-139.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 15:14:39.729963 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.729845 2611 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-139.ec2.internal" event="NodeHasSufficientPID" Jun 09 15:14:39.730955 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.730937 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-139.ec2.internal" Jun 09 15:14:39.731052 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.730971 2611 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 15:14:39.731577 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.731563 2611 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-139.ec2.internal" event="NodeHasSufficientMemory" Jun 09 15:14:39.731670 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.731590 2611 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-139.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 15:14:39.731670 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.731603 2611 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-139.ec2.internal" event="NodeHasSufficientPID" Jun 09 15:14:39.743929 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:39.743914 2611 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-139.ec2.internal\" not found" Jun 09 15:14:39.762963 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:39.762936 2611 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-139.ec2.internal\" not found" node="ip-10-0-129-139.ec2.internal" Jun 09 15:14:39.767542 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:39.767528 2611 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-139.ec2.internal\" not found" node="ip-10-0-129-139.ec2.internal" Jun 09 15:14:39.844217 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:39.844187 2611 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-139.ec2.internal\" not found" Jun 09 15:14:39.850487 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.850453 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/33e4799e2cf9d90f29ee83bae71e9e5d-config\") pod \"kube-apiserver-proxy-ip-10-0-129-139.ec2.internal\" (UID: \"33e4799e2cf9d90f29ee83bae71e9e5d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-139.ec2.internal" Jun 09 15:14:39.850487 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.850487 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/802ce0072bc35220ef07e5a5529f3ab8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-139.ec2.internal\" (UID: \"802ce0072bc35220ef07e5a5529f3ab8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-139.ec2.internal" Jun 09 15:14:39.850645 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.850508 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/802ce0072bc35220ef07e5a5529f3ab8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-139.ec2.internal\" (UID: \"802ce0072bc35220ef07e5a5529f3ab8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-139.ec2.internal" Jun 09 15:14:39.944660 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:39.944628 2611 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-139.ec2.internal\" not found" Jun 09 15:14:39.950934 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.950916 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/33e4799e2cf9d90f29ee83bae71e9e5d-config\") pod \"kube-apiserver-proxy-ip-10-0-129-139.ec2.internal\" (UID: \"33e4799e2cf9d90f29ee83bae71e9e5d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-139.ec2.internal" Jun 09 15:14:39.951010 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.950961 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/33e4799e2cf9d90f29ee83bae71e9e5d-config\") pod \"kube-apiserver-proxy-ip-10-0-129-139.ec2.internal\" (UID: \"33e4799e2cf9d90f29ee83bae71e9e5d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-139.ec2.internal" Jun 09 15:14:39.951010 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.950992 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/802ce0072bc35220ef07e5a5529f3ab8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-139.ec2.internal\" (UID: \"802ce0072bc35220ef07e5a5529f3ab8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-139.ec2.internal" Jun 09 15:14:39.951085 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.951010 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/802ce0072bc35220ef07e5a5529f3ab8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-139.ec2.internal\" (UID: \"802ce0072bc35220ef07e5a5529f3ab8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-139.ec2.internal" Jun 09 15:14:39.951085 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.951033 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/802ce0072bc35220ef07e5a5529f3ab8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-139.ec2.internal\" (UID: \"802ce0072bc35220ef07e5a5529f3ab8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-139.ec2.internal" Jun 09 15:14:39.951085 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:39.951053 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/802ce0072bc35220ef07e5a5529f3ab8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-139.ec2.internal\" (UID: \"802ce0072bc35220ef07e5a5529f3ab8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-139.ec2.internal" Jun 09 15:14:40.045436 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:40.045358 2611 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-139.ec2.internal\" not found" Jun 09 15:14:40.067858 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.067830 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-139.ec2.internal" Jun 09 15:14:40.072573 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.072551 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-139.ec2.internal" Jun 09 15:14:40.146329 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:40.146291 2611 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-139.ec2.internal\" not found" Jun 09 15:14:40.246816 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:40.246780 2611 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-139.ec2.internal\" not found" Jun 09 15:14:40.347333 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:40.347271 2611 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-139.ec2.internal\" not found" Jun 09 15:14:40.399293 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.399270 2611 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 15:14:40.448898 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.448871 2611 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-139.ec2.internal" Jun 09 15:14:40.458349 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.458318 2611 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 15:14:40.460069 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.460053 2611 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-139.ec2.internal" Jun 09 15:14:40.470719 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.470692 2611 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 15:14:40.488860 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.488833 2611 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 09 15:14:40.489053 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.489032 2611 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 15:14:40.489123 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.489024 2611 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 15:14:40.489123 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.489002 2611 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 15:14:40.529187 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.529145 2611 apiserver.go:52] "Watching apiserver" Jun 09 15:14:40.545471 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.545438 2611 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 09 15:14:40.547134 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.547095 2611 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gc7lq","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-139.ec2.internal","openshift-multus/multus-additional-cni-plugins-tgv5l","openshift-multus/multus-w7zzp","openshift-network-diagnostics/network-check-target-twwpl","openshift-network-operator/iptables-alerter-rkm8t","kube-system/konnectivity-agent-nqshb","kube-system/kube-apiserver-proxy-ip-10-0-129-139.ec2.internal","openshift-cluster-node-tuning-operator/tuned-2q6n7","openshift-dns/node-resolver-q9x7l","openshift-image-registry/node-ca-zv9fh","openshift-multus/network-metrics-daemon-mfj2k","openshift-ovn-kubernetes/ovnkube-node-4vsgw","kube-system/global-pull-secret-syncer-29gkx"] Jun 09 15:14:40.548508 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.548492 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gc7lq" Jun 09 15:14:40.548745 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.548728 2611 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 09 15:14:40.548819 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.548706 2611 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-08 15:09:39 +0000 UTC" deadline="2027-11-28 09:27:34.528692159 +0000 UTC" Jun 09 15:14:40.548819 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.548756 2611 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12882h12m53.979939508s" Jun 09 15:14:40.549836 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.549602 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4vsgw" Jun 09 15:14:40.550713 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.550693 2611 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 09 15:14:40.550893 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.550875 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tgv5l" Jun 09 15:14:40.551010 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.550916 2611 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 09 15:14:40.551010 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.550927 2611 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-9gszz\"" Jun 09 15:14:40.551336 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.551320 2611 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 09 15:14:40.551682 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.551665 2611 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 09 15:14:40.552000 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.551980 2611 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 09 15:14:40.552201 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.552184 2611 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-5wwwr\"" Jun 09 15:14:40.552276 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.552217 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zv9fh" Jun 09 15:14:40.552334 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.552310 2611 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 09 15:14:40.552334 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.552318 2611 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 09 15:14:40.552624 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.552604 2611 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 09 15:14:40.552683 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.552627 2611 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 09 15:14:40.552891 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.552875 2611 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 09 15:14:40.553122 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.553109 2611 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 09 15:14:40.553201 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.553119 2611 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 09 15:14:40.553201 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.553138 2611 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 09 15:14:40.553201 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.553122 2611 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-x6nb5\"" Jun 09 15:14:40.553201 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.553179 2611 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 09 15:14:40.553506 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.553492 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-twwpl" Jun 09 15:14:40.553586 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:40.553568 2611 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-twwpl" podUID="977ddaaf-4c0e-4fa9-8d02-4fb9c5448e06" Jun 09 15:14:40.554326 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.554307 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/aa94098e-7a90-4a75-9b97-74e10b75695b-node-log\") pod \"ovnkube-node-4vsgw\" (UID: \"aa94098e-7a90-4a75-9b97-74e10b75695b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vsgw" Jun 09 15:14:40.554393 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.554340 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/aa94098e-7a90-4a75-9b97-74e10b75695b-systemd-units\") pod \"ovnkube-node-4vsgw\" (UID: \"aa94098e-7a90-4a75-9b97-74e10b75695b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vsgw" Jun 09 15:14:40.554393 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.554360 2611 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 09 15:14:40.554393 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.554365 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/aa94098e-7a90-4a75-9b97-74e10b75695b-host-slash\") pod \"ovnkube-node-4vsgw\" (UID: \"aa94098e-7a90-4a75-9b97-74e10b75695b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vsgw" Jun 09 15:14:40.554536 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.554400 2611 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 09 15:14:40.554536 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.554408 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/aa94098e-7a90-4a75-9b97-74e10b75695b-host-run-netns\") pod \"ovnkube-node-4vsgw\" (UID: \"aa94098e-7a90-4a75-9b97-74e10b75695b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vsgw" Jun 09 15:14:40.554536 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.554436 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/aa94098e-7a90-4a75-9b97-74e10b75695b-run-ovn\") pod \"ovnkube-node-4vsgw\" (UID: \"aa94098e-7a90-4a75-9b97-74e10b75695b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vsgw" Jun 09 15:14:40.554536 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.554451 2611 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 09 15:14:40.554536 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.554461 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aa94098e-7a90-4a75-9b97-74e10b75695b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4vsgw\" (UID: \"aa94098e-7a90-4a75-9b97-74e10b75695b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vsgw" Jun 09 15:14:40.554536 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.554405 2611 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-b9cb6\"" Jun 09 15:14:40.554536 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.554489 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/aa94098e-7a90-4a75-9b97-74e10b75695b-env-overrides\") pod \"ovnkube-node-4vsgw\" (UID: \"aa94098e-7a90-4a75-9b97-74e10b75695b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vsgw" Jun 09 15:14:40.554536 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.554514 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpbxg\" (UniqueName: \"kubernetes.io/projected/aa94098e-7a90-4a75-9b97-74e10b75695b-kube-api-access-kpbxg\") pod \"ovnkube-node-4vsgw\" (UID: \"aa94098e-7a90-4a75-9b97-74e10b75695b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vsgw" Jun 09 15:14:40.554536 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.554538 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/aa94098e-7a90-4a75-9b97-74e10b75695b-log-socket\") pod \"ovnkube-node-4vsgw\" (UID: \"aa94098e-7a90-4a75-9b97-74e10b75695b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vsgw" Jun 09 15:14:40.554863 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.554574 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aa94098e-7a90-4a75-9b97-74e10b75695b-run-openvswitch\") pod \"ovnkube-node-4vsgw\" (UID: \"aa94098e-7a90-4a75-9b97-74e10b75695b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vsgw" Jun 09 15:14:40.554863 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.554617 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aa94098e-7a90-4a75-9b97-74e10b75695b-host-run-ovn-kubernetes\") pod \"ovnkube-node-4vsgw\" (UID: \"aa94098e-7a90-4a75-9b97-74e10b75695b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vsgw" Jun 09 15:14:40.554863 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.554645 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/861a0219-329a-4a23-a03e-139931dba78f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gc7lq\" (UID: \"861a0219-329a-4a23-a03e-139931dba78f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gc7lq" Jun 09 15:14:40.554863 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.554657 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2q6n7" Jun 09 15:14:40.554863 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.554671 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/861a0219-329a-4a23-a03e-139931dba78f-device-dir\") pod \"aws-ebs-csi-driver-node-gc7lq\" (UID: \"861a0219-329a-4a23-a03e-139931dba78f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gc7lq" Jun 09 15:14:40.554863 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.554694 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aa94098e-7a90-4a75-9b97-74e10b75695b-var-lib-openvswitch\") pod \"ovnkube-node-4vsgw\" (UID: \"aa94098e-7a90-4a75-9b97-74e10b75695b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vsgw" Jun 09 15:14:40.554863 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.554716 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aa94098e-7a90-4a75-9b97-74e10b75695b-etc-openvswitch\") pod \"ovnkube-node-4vsgw\" (UID: \"aa94098e-7a90-4a75-9b97-74e10b75695b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vsgw" Jun 09 15:14:40.554863 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.554754 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/aa94098e-7a90-4a75-9b97-74e10b75695b-host-cni-bin\") pod \"ovnkube-node-4vsgw\" (UID: \"aa94098e-7a90-4a75-9b97-74e10b75695b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vsgw" Jun 09 15:14:40.554863 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.554784 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbbwj\" (UniqueName: \"kubernetes.io/projected/861a0219-329a-4a23-a03e-139931dba78f-kube-api-access-hbbwj\") pod \"aws-ebs-csi-driver-node-gc7lq\" (UID: \"861a0219-329a-4a23-a03e-139931dba78f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gc7lq" Jun 09 15:14:40.554863 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.554813 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/861a0219-329a-4a23-a03e-139931dba78f-socket-dir\") pod \"aws-ebs-csi-driver-node-gc7lq\" (UID: \"861a0219-329a-4a23-a03e-139931dba78f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gc7lq" Jun 09 15:14:40.554863 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.554838 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/861a0219-329a-4a23-a03e-139931dba78f-registration-dir\") pod \"aws-ebs-csi-driver-node-gc7lq\" (UID: \"861a0219-329a-4a23-a03e-139931dba78f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gc7lq" Jun 09 15:14:40.554863 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.554859 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/aa94098e-7a90-4a75-9b97-74e10b75695b-host-kubelet\") pod \"ovnkube-node-4vsgw\" (UID: \"aa94098e-7a90-4a75-9b97-74e10b75695b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vsgw" Jun 09 15:14:40.555414 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.554898 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/aa94098e-7a90-4a75-9b97-74e10b75695b-run-systemd\") pod \"ovnkube-node-4vsgw\" (UID: \"aa94098e-7a90-4a75-9b97-74e10b75695b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vsgw" Jun 09 15:14:40.555414 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.554931 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/aa94098e-7a90-4a75-9b97-74e10b75695b-ovn-node-metrics-cert\") pod \"ovnkube-node-4vsgw\" (UID: \"aa94098e-7a90-4a75-9b97-74e10b75695b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vsgw" Jun 09 15:14:40.555414 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.554958 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/861a0219-329a-4a23-a03e-139931dba78f-etc-selinux\") pod \"aws-ebs-csi-driver-node-gc7lq\" (UID: \"861a0219-329a-4a23-a03e-139931dba78f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gc7lq" Jun 09 15:14:40.555414 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.554981 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/aa94098e-7a90-4a75-9b97-74e10b75695b-host-cni-netd\") pod \"ovnkube-node-4vsgw\" (UID: \"aa94098e-7a90-4a75-9b97-74e10b75695b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vsgw" Jun 09 15:14:40.555414 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.555005 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/aa94098e-7a90-4a75-9b97-74e10b75695b-ovnkube-config\") pod \"ovnkube-node-4vsgw\" (UID: \"aa94098e-7a90-4a75-9b97-74e10b75695b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vsgw" Jun 09 15:14:40.555414 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.555027 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/aa94098e-7a90-4a75-9b97-74e10b75695b-ovnkube-script-lib\") pod \"ovnkube-node-4vsgw\" (UID: \"aa94098e-7a90-4a75-9b97-74e10b75695b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vsgw" Jun 09 15:14:40.555414 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.555054 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/861a0219-329a-4a23-a03e-139931dba78f-sys-fs\") pod \"aws-ebs-csi-driver-node-gc7lq\" (UID: \"861a0219-329a-4a23-a03e-139931dba78f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gc7lq" Jun 09 15:14:40.556137 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.556118 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nqshb" Jun 09 15:14:40.556708 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.556689 2611 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-8vzb4\"" Jun 09 15:14:40.556788 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.556773 2611 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 09 15:14:40.556883 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.556864 2611 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 09 15:14:40.557508 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.557492 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rkm8t" Jun 09 15:14:40.558134 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.558111 2611 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-btlcm\"" Jun 09 15:14:40.558350 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.558337 2611 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 09 15:14:40.558447 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.558430 2611 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 09 15:14:40.558823 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.558810 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-q9x7l" Jun 09 15:14:40.559496 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.559481 2611 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 09 15:14:40.559574 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.559546 2611 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 09 15:14:40.559679 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.559665 2611 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-vlm9p\"" Jun 09 15:14:40.559756 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.559741 2611 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 09 15:14:40.560370 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.560352 2611 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 15:14:40.560572 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.560551 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-w7zzp" Jun 09 15:14:40.560693 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.560677 2611 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 09 15:14:40.560874 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.560855 2611 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-kcft2\"" Jun 09 15:14:40.560956 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.560886 2611 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 09 15:14:40.562559 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.562539 2611 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 09 15:14:40.562663 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.562616 2611 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-wh5nc\"" Jun 09 15:14:40.562874 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.562858 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mfj2k" Jun 09 15:14:40.562952 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:40.562929 2611 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mfj2k" podUID="9f450cf6-c990-47e4-a16a-5d0a4ff36581" Jun 09 15:14:40.565187 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.564204 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-29gkx" Jun 09 15:14:40.565187 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:40.564299 2611 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-29gkx" podUID="5d4f5486-7d40-4141-b905-204512cddc9e" Jun 09 15:14:40.590386 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:40.590349 2611 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod802ce0072bc35220ef07e5a5529f3ab8.slice/crio-6d01468dad84c93c36ea7f0a5376d6273fc0728fafabab3855241f082f9b63f1 WatchSource:0}: Error finding container 6d01468dad84c93c36ea7f0a5376d6273fc0728fafabab3855241f082f9b63f1: Status 404 returned error can't find the container with id 6d01468dad84c93c36ea7f0a5376d6273fc0728fafabab3855241f082f9b63f1 Jun 09 15:14:40.590625 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:40.590607 2611 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33e4799e2cf9d90f29ee83bae71e9e5d.slice/crio-86b8ab340936cd5fc35c82d317c635af8625042558add2c0317c37a92f9b215b WatchSource:0}: Error finding container 86b8ab340936cd5fc35c82d317c635af8625042558add2c0317c37a92f9b215b: Status 404 returned error can't find the container with id 86b8ab340936cd5fc35c82d317c635af8625042558add2c0317c37a92f9b215b Jun 09 15:14:40.594068 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.593578 2611 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-nn494" Jun 09 15:14:40.596832 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.596815 2611 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 15:14:40.599845 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.599827 2611 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-nn494" Jun 09 15:14:40.630536 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.630499 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-139.ec2.internal" event={"ID":"802ce0072bc35220ef07e5a5529f3ab8","Type":"ContainerStarted","Data":"6d01468dad84c93c36ea7f0a5376d6273fc0728fafabab3855241f082f9b63f1"} Jun 09 15:14:40.631545 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.631526 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-139.ec2.internal" event={"ID":"33e4799e2cf9d90f29ee83bae71e9e5d","Type":"ContainerStarted","Data":"86b8ab340936cd5fc35c82d317c635af8625042558add2c0317c37a92f9b215b"} Jun 09 15:14:40.650795 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.650777 2611 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 09 15:14:40.655789 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.655769 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aa94098e-7a90-4a75-9b97-74e10b75695b-var-lib-openvswitch\") pod \"ovnkube-node-4vsgw\" (UID: \"aa94098e-7a90-4a75-9b97-74e10b75695b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vsgw" Jun 09 15:14:40.655881 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.655795 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aa94098e-7a90-4a75-9b97-74e10b75695b-etc-openvswitch\") pod \"ovnkube-node-4vsgw\" (UID: \"aa94098e-7a90-4a75-9b97-74e10b75695b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vsgw" Jun 09 15:14:40.655881 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.655811 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbbwj\" (UniqueName: \"kubernetes.io/projected/861a0219-329a-4a23-a03e-139931dba78f-kube-api-access-hbbwj\") pod \"aws-ebs-csi-driver-node-gc7lq\" (UID: \"861a0219-329a-4a23-a03e-139931dba78f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gc7lq" Jun 09 15:14:40.655881 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.655831 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c26ef062-04a7-4c4f-a597-c5d097f59914-os-release\") pod \"multus-additional-cni-plugins-tgv5l\" (UID: \"c26ef062-04a7-4c4f-a597-c5d097f59914\") " pod="openshift-multus/multus-additional-cni-plugins-tgv5l" Jun 09 15:14:40.655881 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.655852 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9f6b7e7c-1047-4269-9e0b-462798a87429-var-lib-kubelet\") pod \"tuned-2q6n7\" (UID: \"9f6b7e7c-1047-4269-9e0b-462798a87429\") " pod="openshift-cluster-node-tuning-operator/tuned-2q6n7" Jun 09 15:14:40.655881 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.655875 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1f78ec9a-bb04-4826-98ea-3f1abeb1f823-multus-daemon-config\") pod \"multus-w7zzp\" (UID: \"1f78ec9a-bb04-4826-98ea-3f1abeb1f823\") " pod="openshift-multus/multus-w7zzp" Jun 09 15:14:40.656113 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.655876 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aa94098e-7a90-4a75-9b97-74e10b75695b-var-lib-openvswitch\") pod \"ovnkube-node-4vsgw\" (UID: \"aa94098e-7a90-4a75-9b97-74e10b75695b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vsgw" Jun 09 15:14:40.656113 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.655900 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/861a0219-329a-4a23-a03e-139931dba78f-registration-dir\") pod \"aws-ebs-csi-driver-node-gc7lq\" (UID: \"861a0219-329a-4a23-a03e-139931dba78f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gc7lq" Jun 09 15:14:40.656113 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.655908 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aa94098e-7a90-4a75-9b97-74e10b75695b-etc-openvswitch\") pod \"ovnkube-node-4vsgw\" (UID: \"aa94098e-7a90-4a75-9b97-74e10b75695b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vsgw" Jun 09 15:14:40.656113 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.655922 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5d4f5486-7d40-4141-b905-204512cddc9e-dbus\") pod \"global-pull-secret-syncer-29gkx\" (UID: \"5d4f5486-7d40-4141-b905-204512cddc9e\") " pod="kube-system/global-pull-secret-syncer-29gkx" Jun 09 15:14:40.656113 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.655965 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1f78ec9a-bb04-4826-98ea-3f1abeb1f823-multus-cni-dir\") pod \"multus-w7zzp\" (UID: \"1f78ec9a-bb04-4826-98ea-3f1abeb1f823\") " pod="openshift-multus/multus-w7zzp" Jun 09 15:14:40.656113 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.655971 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/861a0219-329a-4a23-a03e-139931dba78f-registration-dir\") pod \"aws-ebs-csi-driver-node-gc7lq\" (UID: \"861a0219-329a-4a23-a03e-139931dba78f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gc7lq" Jun 09 15:14:40.656113 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.655987 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1f78ec9a-bb04-4826-98ea-3f1abeb1f823-multus-conf-dir\") pod \"multus-w7zzp\" (UID: \"1f78ec9a-bb04-4826-98ea-3f1abeb1f823\") " pod="openshift-multus/multus-w7zzp" Jun 09 15:14:40.656113 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.656010 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hr2jf\" (UniqueName: \"kubernetes.io/projected/c9ad8e96-7211-48f9-be18-365a42d1a24f-kube-api-access-hr2jf\") pod \"node-resolver-q9x7l\" (UID: \"c9ad8e96-7211-48f9-be18-365a42d1a24f\") " pod="openshift-dns/node-resolver-q9x7l" Jun 09 15:14:40.656113 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.656027 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/aa94098e-7a90-4a75-9b97-74e10b75695b-ovn-node-metrics-cert\") pod \"ovnkube-node-4vsgw\" (UID: \"aa94098e-7a90-4a75-9b97-74e10b75695b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vsgw" Jun 09 15:14:40.656113 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.656055 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/861a0219-329a-4a23-a03e-139931dba78f-etc-selinux\") pod \"aws-ebs-csi-driver-node-gc7lq\" (UID: \"861a0219-329a-4a23-a03e-139931dba78f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gc7lq" Jun 09 15:14:40.656500 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.656175 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c9ad8e96-7211-48f9-be18-365a42d1a24f-tmp-dir\") pod \"node-resolver-q9x7l\" (UID: \"c9ad8e96-7211-48f9-be18-365a42d1a24f\") " pod="openshift-dns/node-resolver-q9x7l" Jun 09 15:14:40.656500 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.656199 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/aa94098e-7a90-4a75-9b97-74e10b75695b-host-cni-netd\") pod \"ovnkube-node-4vsgw\" (UID: \"aa94098e-7a90-4a75-9b97-74e10b75695b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vsgw" Jun 09 15:14:40.656500 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.656224 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c26ef062-04a7-4c4f-a597-c5d097f59914-cni-binary-copy\") pod \"multus-additional-cni-plugins-tgv5l\" (UID: \"c26ef062-04a7-4c4f-a597-c5d097f59914\") " pod="openshift-multus/multus-additional-cni-plugins-tgv5l" Jun 09 15:14:40.656500 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.656235 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/861a0219-329a-4a23-a03e-139931dba78f-etc-selinux\") pod \"aws-ebs-csi-driver-node-gc7lq\" (UID: \"861a0219-329a-4a23-a03e-139931dba78f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gc7lq" Jun 09 15:14:40.656500 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.656247 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9f6b7e7c-1047-4269-9e0b-462798a87429-sys\") pod \"tuned-2q6n7\" (UID: \"9f6b7e7c-1047-4269-9e0b-462798a87429\") " pod="openshift-cluster-node-tuning-operator/tuned-2q6n7" Jun 09 15:14:40.656500 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.656278 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/aa94098e-7a90-4a75-9b97-74e10b75695b-host-run-netns\") pod \"ovnkube-node-4vsgw\" (UID: \"aa94098e-7a90-4a75-9b97-74e10b75695b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vsgw" Jun 09 15:14:40.656500 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.656279 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/aa94098e-7a90-4a75-9b97-74e10b75695b-host-cni-netd\") pod \"ovnkube-node-4vsgw\" (UID: \"aa94098e-7a90-4a75-9b97-74e10b75695b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vsgw" Jun 09 15:14:40.656500 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.656301 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c9ad8e96-7211-48f9-be18-365a42d1a24f-hosts-file\") pod \"node-resolver-q9x7l\" (UID: \"c9ad8e96-7211-48f9-be18-365a42d1a24f\") " pod="openshift-dns/node-resolver-q9x7l" Jun 09 15:14:40.656500 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.656316 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5d1837fb-ae3e-4519-b6f9-a444b41583cc-agent-certs\") pod \"konnectivity-agent-nqshb\" (UID: \"5d1837fb-ae3e-4519-b6f9-a444b41583cc\") " pod="kube-system/konnectivity-agent-nqshb" Jun 09 15:14:40.656500 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.656329 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/aa94098e-7a90-4a75-9b97-74e10b75695b-host-run-netns\") pod \"ovnkube-node-4vsgw\" (UID: \"aa94098e-7a90-4a75-9b97-74e10b75695b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vsgw" Jun 09 15:14:40.656500 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.656339 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m46nr\" (UniqueName: \"kubernetes.io/projected/1f78ec9a-bb04-4826-98ea-3f1abeb1f823-kube-api-access-m46nr\") pod \"multus-w7zzp\" (UID: \"1f78ec9a-bb04-4826-98ea-3f1abeb1f823\") " pod="openshift-multus/multus-w7zzp" Jun 09 15:14:40.656500 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.656339 2611 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 09 15:14:40.656500 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.656368 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/aa94098e-7a90-4a75-9b97-74e10b75695b-run-ovn\") pod \"ovnkube-node-4vsgw\" (UID: \"aa94098e-7a90-4a75-9b97-74e10b75695b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vsgw" Jun 09 15:14:40.656500 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.656387 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/aa94098e-7a90-4a75-9b97-74e10b75695b-env-overrides\") pod \"ovnkube-node-4vsgw\" (UID: \"aa94098e-7a90-4a75-9b97-74e10b75695b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vsgw" Jun 09 15:14:40.656500 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.656403 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9f6b7e7c-1047-4269-9e0b-462798a87429-etc-sysconfig\") pod \"tuned-2q6n7\" (UID: \"9f6b7e7c-1047-4269-9e0b-462798a87429\") " pod="openshift-cluster-node-tuning-operator/tuned-2q6n7" Jun 09 15:14:40.656500 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.656422 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8tq9\" (UniqueName: \"kubernetes.io/projected/9f450cf6-c990-47e4-a16a-5d0a4ff36581-kube-api-access-f8tq9\") pod \"network-metrics-daemon-mfj2k\" (UID: \"9f450cf6-c990-47e4-a16a-5d0a4ff36581\") " pod="openshift-multus/network-metrics-daemon-mfj2k" Jun 09 15:14:40.656500 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.656433 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/aa94098e-7a90-4a75-9b97-74e10b75695b-run-ovn\") pod \"ovnkube-node-4vsgw\" (UID: \"aa94098e-7a90-4a75-9b97-74e10b75695b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vsgw" Jun 09 15:14:40.657284 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.656437 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/aa94098e-7a90-4a75-9b97-74e10b75695b-log-socket\") pod \"ovnkube-node-4vsgw\" (UID: \"aa94098e-7a90-4a75-9b97-74e10b75695b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vsgw" Jun 09 15:14:40.657284 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.656471 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aa94098e-7a90-4a75-9b97-74e10b75695b-host-run-ovn-kubernetes\") pod \"ovnkube-node-4vsgw\" (UID: \"aa94098e-7a90-4a75-9b97-74e10b75695b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vsgw" Jun 09 15:14:40.657284 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.656493 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/616fe554-fdb6-442f-a5c5-5b7dd67f09f1-host-slash\") pod \"iptables-alerter-rkm8t\" (UID: \"616fe554-fdb6-442f-a5c5-5b7dd67f09f1\") " pod="openshift-network-operator/iptables-alerter-rkm8t" Jun 09 15:14:40.657284 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.656529 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9f6b7e7c-1047-4269-9e0b-462798a87429-etc-sysctl-d\") pod \"tuned-2q6n7\" (UID: \"9f6b7e7c-1047-4269-9e0b-462798a87429\") " pod="openshift-cluster-node-tuning-operator/tuned-2q6n7" Jun 09 15:14:40.657284 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.656531 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/aa94098e-7a90-4a75-9b97-74e10b75695b-log-socket\") pod \"ovnkube-node-4vsgw\" (UID: \"aa94098e-7a90-4a75-9b97-74e10b75695b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vsgw" Jun 09 15:14:40.657284 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.656536 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aa94098e-7a90-4a75-9b97-74e10b75695b-host-run-ovn-kubernetes\") pod \"ovnkube-node-4vsgw\" (UID: \"aa94098e-7a90-4a75-9b97-74e10b75695b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vsgw" Jun 09 15:14:40.657284 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.656569 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9f6b7e7c-1047-4269-9e0b-462798a87429-etc-sysctl-conf\") pod \"tuned-2q6n7\" (UID: \"9f6b7e7c-1047-4269-9e0b-462798a87429\") " pod="openshift-cluster-node-tuning-operator/tuned-2q6n7" Jun 09 15:14:40.657284 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.656589 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/861a0219-329a-4a23-a03e-139931dba78f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gc7lq\" (UID: \"861a0219-329a-4a23-a03e-139931dba78f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gc7lq" Jun 09 15:14:40.657284 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.656625 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/861a0219-329a-4a23-a03e-139931dba78f-device-dir\") pod \"aws-ebs-csi-driver-node-gc7lq\" (UID: \"861a0219-329a-4a23-a03e-139931dba78f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gc7lq" Jun 09 15:14:40.657284 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.656631 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/861a0219-329a-4a23-a03e-139931dba78f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gc7lq\" (UID: \"861a0219-329a-4a23-a03e-139931dba78f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gc7lq" Jun 09 15:14:40.657284 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.656654 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c26ef062-04a7-4c4f-a597-c5d097f59914-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tgv5l\" (UID: \"c26ef062-04a7-4c4f-a597-c5d097f59914\") " pod="openshift-multus/multus-additional-cni-plugins-tgv5l" Jun 09 15:14:40.657284 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.656665 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/861a0219-329a-4a23-a03e-139931dba78f-device-dir\") pod \"aws-ebs-csi-driver-node-gc7lq\" (UID: \"861a0219-329a-4a23-a03e-139931dba78f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gc7lq" Jun 09 15:14:40.657284 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.656684 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/42130943-9472-4e99-901d-84460ecdc92e-host\") pod \"node-ca-zv9fh\" (UID: \"42130943-9472-4e99-901d-84460ecdc92e\") " pod="openshift-image-registry/node-ca-zv9fh" Jun 09 15:14:40.657284 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.656712 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9f6b7e7c-1047-4269-9e0b-462798a87429-run\") pod \"tuned-2q6n7\" (UID: \"9f6b7e7c-1047-4269-9e0b-462798a87429\") " pod="openshift-cluster-node-tuning-operator/tuned-2q6n7" Jun 09 15:14:40.657284 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.656747 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1f78ec9a-bb04-4826-98ea-3f1abeb1f823-cnibin\") pod \"multus-w7zzp\" (UID: \"1f78ec9a-bb04-4826-98ea-3f1abeb1f823\") " pod="openshift-multus/multus-w7zzp" Jun 09 15:14:40.657284 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.656774 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1f78ec9a-bb04-4826-98ea-3f1abeb1f823-multus-socket-dir-parent\") pod \"multus-w7zzp\" (UID: \"1f78ec9a-bb04-4826-98ea-3f1abeb1f823\") " pod="openshift-multus/multus-w7zzp" Jun 09 15:14:40.657284 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.656799 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/aa94098e-7a90-4a75-9b97-74e10b75695b-host-cni-bin\") pod \"ovnkube-node-4vsgw\" (UID: \"aa94098e-7a90-4a75-9b97-74e10b75695b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vsgw" Jun 09 15:14:40.658083 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.656853 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c26ef062-04a7-4c4f-a597-c5d097f59914-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tgv5l\" (UID: \"c26ef062-04a7-4c4f-a597-c5d097f59914\") " pod="openshift-multus/multus-additional-cni-plugins-tgv5l" Jun 09 15:14:40.658083 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.656866 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/aa94098e-7a90-4a75-9b97-74e10b75695b-env-overrides\") pod \"ovnkube-node-4vsgw\" (UID: \"aa94098e-7a90-4a75-9b97-74e10b75695b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vsgw" Jun 09 15:14:40.658083 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.656875 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xsc74\" (UniqueName: \"kubernetes.io/projected/42130943-9472-4e99-901d-84460ecdc92e-kube-api-access-xsc74\") pod \"node-ca-zv9fh\" (UID: \"42130943-9472-4e99-901d-84460ecdc92e\") " pod="openshift-image-registry/node-ca-zv9fh" Jun 09 15:14:40.658083 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.656886 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/aa94098e-7a90-4a75-9b97-74e10b75695b-host-cni-bin\") pod \"ovnkube-node-4vsgw\" (UID: \"aa94098e-7a90-4a75-9b97-74e10b75695b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vsgw" Jun 09 15:14:40.658083 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.656908 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9f6b7e7c-1047-4269-9e0b-462798a87429-host\") pod \"tuned-2q6n7\" (UID: \"9f6b7e7c-1047-4269-9e0b-462798a87429\") " pod="openshift-cluster-node-tuning-operator/tuned-2q6n7" Jun 09 15:14:40.658083 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.656941 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5d1837fb-ae3e-4519-b6f9-a444b41583cc-konnectivity-ca\") pod \"konnectivity-agent-nqshb\" (UID: \"5d1837fb-ae3e-4519-b6f9-a444b41583cc\") " pod="kube-system/konnectivity-agent-nqshb" Jun 09 15:14:40.658083 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.656975 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1f78ec9a-bb04-4826-98ea-3f1abeb1f823-host-run-k8s-cni-cncf-io\") pod \"multus-w7zzp\" (UID: \"1f78ec9a-bb04-4826-98ea-3f1abeb1f823\") " pod="openshift-multus/multus-w7zzp" Jun 09 15:14:40.658083 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.656999 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1f78ec9a-bb04-4826-98ea-3f1abeb1f823-host-run-netns\") pod \"multus-w7zzp\" (UID: \"1f78ec9a-bb04-4826-98ea-3f1abeb1f823\") " pod="openshift-multus/multus-w7zzp" Jun 09 15:14:40.658083 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.657023 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1f78ec9a-bb04-4826-98ea-3f1abeb1f823-host-var-lib-kubelet\") pod \"multus-w7zzp\" (UID: \"1f78ec9a-bb04-4826-98ea-3f1abeb1f823\") " pod="openshift-multus/multus-w7zzp" Jun 09 15:14:40.658083 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.657048 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/861a0219-329a-4a23-a03e-139931dba78f-socket-dir\") pod \"aws-ebs-csi-driver-node-gc7lq\" (UID: \"861a0219-329a-4a23-a03e-139931dba78f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gc7lq" Jun 09 15:14:40.658083 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.657073 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c26ef062-04a7-4c4f-a597-c5d097f59914-cnibin\") pod \"multus-additional-cni-plugins-tgv5l\" (UID: \"c26ef062-04a7-4c4f-a597-c5d097f59914\") " pod="openshift-multus/multus-additional-cni-plugins-tgv5l" Jun 09 15:14:40.658083 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.657098 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1f78ec9a-bb04-4826-98ea-3f1abeb1f823-host-var-lib-cni-bin\") pod \"multus-w7zzp\" (UID: \"1f78ec9a-bb04-4826-98ea-3f1abeb1f823\") " pod="openshift-multus/multus-w7zzp" Jun 09 15:14:40.658083 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.657123 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1f78ec9a-bb04-4826-98ea-3f1abeb1f823-etc-kubernetes\") pod \"multus-w7zzp\" (UID: \"1f78ec9a-bb04-4826-98ea-3f1abeb1f823\") " pod="openshift-multus/multus-w7zzp" Jun 09 15:14:40.658083 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.657148 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5d4f5486-7d40-4141-b905-204512cddc9e-original-pull-secret\") pod \"global-pull-secret-syncer-29gkx\" (UID: \"5d4f5486-7d40-4141-b905-204512cddc9e\") " pod="kube-system/global-pull-secret-syncer-29gkx" Jun 09 15:14:40.658083 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.657193 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/aa94098e-7a90-4a75-9b97-74e10b75695b-host-kubelet\") pod \"ovnkube-node-4vsgw\" (UID: \"aa94098e-7a90-4a75-9b97-74e10b75695b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vsgw" Jun 09 15:14:40.658083 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.657203 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/861a0219-329a-4a23-a03e-139931dba78f-socket-dir\") pod \"aws-ebs-csi-driver-node-gc7lq\" (UID: \"861a0219-329a-4a23-a03e-139931dba78f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gc7lq" Jun 09 15:14:40.658083 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.657221 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/aa94098e-7a90-4a75-9b97-74e10b75695b-run-systemd\") pod \"ovnkube-node-4vsgw\" (UID: \"aa94098e-7a90-4a75-9b97-74e10b75695b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vsgw" Jun 09 15:14:40.658647 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.657267 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/aa94098e-7a90-4a75-9b97-74e10b75695b-run-systemd\") pod \"ovnkube-node-4vsgw\" (UID: \"aa94098e-7a90-4a75-9b97-74e10b75695b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vsgw" Jun 09 15:14:40.658647 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.657233 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/aa94098e-7a90-4a75-9b97-74e10b75695b-host-kubelet\") pod \"ovnkube-node-4vsgw\" (UID: \"aa94098e-7a90-4a75-9b97-74e10b75695b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vsgw" Jun 09 15:14:40.658647 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.657261 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c26ef062-04a7-4c4f-a597-c5d097f59914-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tgv5l\" (UID: \"c26ef062-04a7-4c4f-a597-c5d097f59914\") " pod="openshift-multus/multus-additional-cni-plugins-tgv5l" Jun 09 15:14:40.658647 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.657313 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/616fe554-fdb6-442f-a5c5-5b7dd67f09f1-iptables-alerter-script\") pod \"iptables-alerter-rkm8t\" (UID: \"616fe554-fdb6-442f-a5c5-5b7dd67f09f1\") " pod="openshift-network-operator/iptables-alerter-rkm8t" Jun 09 15:14:40.658647 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.657349 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcp7m\" (UniqueName: \"kubernetes.io/projected/616fe554-fdb6-442f-a5c5-5b7dd67f09f1-kube-api-access-fcp7m\") pod \"iptables-alerter-rkm8t\" (UID: \"616fe554-fdb6-442f-a5c5-5b7dd67f09f1\") " pod="openshift-network-operator/iptables-alerter-rkm8t" Jun 09 15:14:40.658647 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.657381 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9f6b7e7c-1047-4269-9e0b-462798a87429-lib-modules\") pod \"tuned-2q6n7\" (UID: \"9f6b7e7c-1047-4269-9e0b-462798a87429\") " pod="openshift-cluster-node-tuning-operator/tuned-2q6n7" Jun 09 15:14:40.658647 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.657410 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1f78ec9a-bb04-4826-98ea-3f1abeb1f823-host-var-lib-cni-multus\") pod \"multus-w7zzp\" (UID: \"1f78ec9a-bb04-4826-98ea-3f1abeb1f823\") " pod="openshift-multus/multus-w7zzp" Jun 09 15:14:40.658647 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.657439 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/aa94098e-7a90-4a75-9b97-74e10b75695b-ovnkube-config\") pod \"ovnkube-node-4vsgw\" (UID: \"aa94098e-7a90-4a75-9b97-74e10b75695b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vsgw" Jun 09 15:14:40.658647 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.657463 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/aa94098e-7a90-4a75-9b97-74e10b75695b-ovnkube-script-lib\") pod \"ovnkube-node-4vsgw\" (UID: \"aa94098e-7a90-4a75-9b97-74e10b75695b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vsgw" Jun 09 15:14:40.658647 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.657487 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/861a0219-329a-4a23-a03e-139931dba78f-sys-fs\") pod \"aws-ebs-csi-driver-node-gc7lq\" (UID: \"861a0219-329a-4a23-a03e-139931dba78f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gc7lq" Jun 09 15:14:40.658647 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.657547 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/861a0219-329a-4a23-a03e-139931dba78f-sys-fs\") pod \"aws-ebs-csi-driver-node-gc7lq\" (UID: \"861a0219-329a-4a23-a03e-139931dba78f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gc7lq" Jun 09 15:14:40.658647 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.657577 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/aa94098e-7a90-4a75-9b97-74e10b75695b-node-log\") pod \"ovnkube-node-4vsgw\" (UID: \"aa94098e-7a90-4a75-9b97-74e10b75695b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vsgw" Jun 09 15:14:40.658647 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.657601 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/aa94098e-7a90-4a75-9b97-74e10b75695b-systemd-units\") pod \"ovnkube-node-4vsgw\" (UID: \"aa94098e-7a90-4a75-9b97-74e10b75695b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vsgw" Jun 09 15:14:40.658647 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.657625 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/aa94098e-7a90-4a75-9b97-74e10b75695b-host-slash\") pod \"ovnkube-node-4vsgw\" (UID: \"aa94098e-7a90-4a75-9b97-74e10b75695b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vsgw" Jun 09 15:14:40.658647 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.657662 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/42130943-9472-4e99-901d-84460ecdc92e-serviceca\") pod \"node-ca-zv9fh\" (UID: \"42130943-9472-4e99-901d-84460ecdc92e\") " pod="openshift-image-registry/node-ca-zv9fh" Jun 09 15:14:40.658647 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.657688 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9f6b7e7c-1047-4269-9e0b-462798a87429-tmp\") pod \"tuned-2q6n7\" (UID: \"9f6b7e7c-1047-4269-9e0b-462798a87429\") " pod="openshift-cluster-node-tuning-operator/tuned-2q6n7" Jun 09 15:14:40.658647 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.657689 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/aa94098e-7a90-4a75-9b97-74e10b75695b-systemd-units\") pod \"ovnkube-node-4vsgw\" (UID: \"aa94098e-7a90-4a75-9b97-74e10b75695b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vsgw" Jun 09 15:14:40.659115 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.657699 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/aa94098e-7a90-4a75-9b97-74e10b75695b-host-slash\") pod \"ovnkube-node-4vsgw\" (UID: \"aa94098e-7a90-4a75-9b97-74e10b75695b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vsgw" Jun 09 15:14:40.659115 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.657722 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45kg8\" (UniqueName: \"kubernetes.io/projected/9f6b7e7c-1047-4269-9e0b-462798a87429-kube-api-access-45kg8\") pod \"tuned-2q6n7\" (UID: \"9f6b7e7c-1047-4269-9e0b-462798a87429\") " pod="openshift-cluster-node-tuning-operator/tuned-2q6n7" Jun 09 15:14:40.659115 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.657727 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/aa94098e-7a90-4a75-9b97-74e10b75695b-node-log\") pod \"ovnkube-node-4vsgw\" (UID: \"aa94098e-7a90-4a75-9b97-74e10b75695b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vsgw" Jun 09 15:14:40.659115 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.657757 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1f78ec9a-bb04-4826-98ea-3f1abeb1f823-host-run-multus-certs\") pod \"multus-w7zzp\" (UID: \"1f78ec9a-bb04-4826-98ea-3f1abeb1f823\") " pod="openshift-multus/multus-w7zzp" Jun 09 15:14:40.659115 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.657785 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f450cf6-c990-47e4-a16a-5d0a4ff36581-metrics-certs\") pod \"network-metrics-daemon-mfj2k\" (UID: \"9f450cf6-c990-47e4-a16a-5d0a4ff36581\") " pod="openshift-multus/network-metrics-daemon-mfj2k" Jun 09 15:14:40.659115 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.657829 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aa94098e-7a90-4a75-9b97-74e10b75695b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4vsgw\" (UID: \"aa94098e-7a90-4a75-9b97-74e10b75695b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vsgw" Jun 09 15:14:40.659115 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.657855 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpbxg\" (UniqueName: \"kubernetes.io/projected/aa94098e-7a90-4a75-9b97-74e10b75695b-kube-api-access-kpbxg\") pod \"ovnkube-node-4vsgw\" (UID: \"aa94098e-7a90-4a75-9b97-74e10b75695b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vsgw" Jun 09 15:14:40.659115 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.657881 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c26ef062-04a7-4c4f-a597-c5d097f59914-system-cni-dir\") pod \"multus-additional-cni-plugins-tgv5l\" (UID: \"c26ef062-04a7-4c4f-a597-c5d097f59914\") " pod="openshift-multus/multus-additional-cni-plugins-tgv5l" Jun 09 15:14:40.659115 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.657881 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/aa94098e-7a90-4a75-9b97-74e10b75695b-ovnkube-config\") pod \"ovnkube-node-4vsgw\" (UID: \"aa94098e-7a90-4a75-9b97-74e10b75695b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vsgw" Jun 09 15:14:40.659115 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.657911 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/aa94098e-7a90-4a75-9b97-74e10b75695b-ovnkube-script-lib\") pod \"ovnkube-node-4vsgw\" (UID: \"aa94098e-7a90-4a75-9b97-74e10b75695b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vsgw" Jun 09 15:14:40.659115 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.657918 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aa94098e-7a90-4a75-9b97-74e10b75695b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4vsgw\" (UID: \"aa94098e-7a90-4a75-9b97-74e10b75695b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vsgw" Jun 09 15:14:40.659115 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.657977 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zk5h\" (UniqueName: \"kubernetes.io/projected/c26ef062-04a7-4c4f-a597-c5d097f59914-kube-api-access-2zk5h\") pod \"multus-additional-cni-plugins-tgv5l\" (UID: \"c26ef062-04a7-4c4f-a597-c5d097f59914\") " pod="openshift-multus/multus-additional-cni-plugins-tgv5l" Jun 09 15:14:40.659115 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.658000 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5d4f5486-7d40-4141-b905-204512cddc9e-kubelet-config\") pod \"global-pull-secret-syncer-29gkx\" (UID: \"5d4f5486-7d40-4141-b905-204512cddc9e\") " pod="kube-system/global-pull-secret-syncer-29gkx" Jun 09 15:14:40.659115 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.658016 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9f6b7e7c-1047-4269-9e0b-462798a87429-etc-tuned\") pod \"tuned-2q6n7\" (UID: \"9f6b7e7c-1047-4269-9e0b-462798a87429\") " pod="openshift-cluster-node-tuning-operator/tuned-2q6n7" Jun 09 15:14:40.659115 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.658037 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aa94098e-7a90-4a75-9b97-74e10b75695b-run-openvswitch\") pod \"ovnkube-node-4vsgw\" (UID: \"aa94098e-7a90-4a75-9b97-74e10b75695b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vsgw" Jun 09 15:14:40.659115 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.658062 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9f6b7e7c-1047-4269-9e0b-462798a87429-etc-modprobe-d\") pod \"tuned-2q6n7\" (UID: \"9f6b7e7c-1047-4269-9e0b-462798a87429\") " pod="openshift-cluster-node-tuning-operator/tuned-2q6n7" Jun 09 15:14:40.659597 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.658080 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1f78ec9a-bb04-4826-98ea-3f1abeb1f823-os-release\") pod \"multus-w7zzp\" (UID: \"1f78ec9a-bb04-4826-98ea-3f1abeb1f823\") " pod="openshift-multus/multus-w7zzp" Jun 09 15:14:40.659597 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.658084 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aa94098e-7a90-4a75-9b97-74e10b75695b-run-openvswitch\") pod \"ovnkube-node-4vsgw\" (UID: \"aa94098e-7a90-4a75-9b97-74e10b75695b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vsgw" Jun 09 15:14:40.659597 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.658095 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1f78ec9a-bb04-4826-98ea-3f1abeb1f823-hostroot\") pod \"multus-w7zzp\" (UID: \"1f78ec9a-bb04-4826-98ea-3f1abeb1f823\") " pod="openshift-multus/multus-w7zzp" Jun 09 15:14:40.659597 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.658121 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g29h9\" (UniqueName: \"kubernetes.io/projected/977ddaaf-4c0e-4fa9-8d02-4fb9c5448e06-kube-api-access-g29h9\") pod \"network-check-target-twwpl\" (UID: \"977ddaaf-4c0e-4fa9-8d02-4fb9c5448e06\") " pod="openshift-network-diagnostics/network-check-target-twwpl" Jun 09 15:14:40.659597 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.658144 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9f6b7e7c-1047-4269-9e0b-462798a87429-etc-kubernetes\") pod \"tuned-2q6n7\" (UID: \"9f6b7e7c-1047-4269-9e0b-462798a87429\") " pod="openshift-cluster-node-tuning-operator/tuned-2q6n7" Jun 09 15:14:40.659597 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.658181 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9f6b7e7c-1047-4269-9e0b-462798a87429-etc-systemd\") pod \"tuned-2q6n7\" (UID: \"9f6b7e7c-1047-4269-9e0b-462798a87429\") " pod="openshift-cluster-node-tuning-operator/tuned-2q6n7" Jun 09 15:14:40.659597 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.658200 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1f78ec9a-bb04-4826-98ea-3f1abeb1f823-system-cni-dir\") pod \"multus-w7zzp\" (UID: \"1f78ec9a-bb04-4826-98ea-3f1abeb1f823\") " pod="openshift-multus/multus-w7zzp" Jun 09 15:14:40.659597 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.658236 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1f78ec9a-bb04-4826-98ea-3f1abeb1f823-cni-binary-copy\") pod \"multus-w7zzp\" (UID: \"1f78ec9a-bb04-4826-98ea-3f1abeb1f823\") " pod="openshift-multus/multus-w7zzp" Jun 09 15:14:40.659597 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.659477 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/aa94098e-7a90-4a75-9b97-74e10b75695b-ovn-node-metrics-cert\") pod \"ovnkube-node-4vsgw\" (UID: \"aa94098e-7a90-4a75-9b97-74e10b75695b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vsgw" Jun 09 15:14:40.663815 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.663798 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbbwj\" (UniqueName: \"kubernetes.io/projected/861a0219-329a-4a23-a03e-139931dba78f-kube-api-access-hbbwj\") pod \"aws-ebs-csi-driver-node-gc7lq\" (UID: \"861a0219-329a-4a23-a03e-139931dba78f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gc7lq" Jun 09 15:14:40.664944 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.664927 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpbxg\" (UniqueName: \"kubernetes.io/projected/aa94098e-7a90-4a75-9b97-74e10b75695b-kube-api-access-kpbxg\") pod \"ovnkube-node-4vsgw\" (UID: \"aa94098e-7a90-4a75-9b97-74e10b75695b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4vsgw" Jun 09 15:14:40.758784 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.758757 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5d1837fb-ae3e-4519-b6f9-a444b41583cc-agent-certs\") pod \"konnectivity-agent-nqshb\" (UID: \"5d1837fb-ae3e-4519-b6f9-a444b41583cc\") " pod="kube-system/konnectivity-agent-nqshb" Jun 09 15:14:40.758784 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.758785 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m46nr\" (UniqueName: \"kubernetes.io/projected/1f78ec9a-bb04-4826-98ea-3f1abeb1f823-kube-api-access-m46nr\") pod \"multus-w7zzp\" (UID: \"1f78ec9a-bb04-4826-98ea-3f1abeb1f823\") " pod="openshift-multus/multus-w7zzp" Jun 09 15:14:40.759027 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.758803 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9f6b7e7c-1047-4269-9e0b-462798a87429-etc-sysconfig\") pod \"tuned-2q6n7\" (UID: \"9f6b7e7c-1047-4269-9e0b-462798a87429\") " pod="openshift-cluster-node-tuning-operator/tuned-2q6n7" Jun 09 15:14:40.759027 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.758818 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8tq9\" (UniqueName: \"kubernetes.io/projected/9f450cf6-c990-47e4-a16a-5d0a4ff36581-kube-api-access-f8tq9\") pod \"network-metrics-daemon-mfj2k\" (UID: \"9f450cf6-c990-47e4-a16a-5d0a4ff36581\") " pod="openshift-multus/network-metrics-daemon-mfj2k" Jun 09 15:14:40.759027 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.758873 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/616fe554-fdb6-442f-a5c5-5b7dd67f09f1-host-slash\") pod \"iptables-alerter-rkm8t\" (UID: \"616fe554-fdb6-442f-a5c5-5b7dd67f09f1\") " pod="openshift-network-operator/iptables-alerter-rkm8t" Jun 09 15:14:40.759027 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.758920 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9f6b7e7c-1047-4269-9e0b-462798a87429-etc-sysctl-d\") pod \"tuned-2q6n7\" (UID: \"9f6b7e7c-1047-4269-9e0b-462798a87429\") " pod="openshift-cluster-node-tuning-operator/tuned-2q6n7" Jun 09 15:14:40.759027 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.758937 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9f6b7e7c-1047-4269-9e0b-462798a87429-etc-sysctl-conf\") pod \"tuned-2q6n7\" (UID: \"9f6b7e7c-1047-4269-9e0b-462798a87429\") " pod="openshift-cluster-node-tuning-operator/tuned-2q6n7" Jun 09 15:14:40.759027 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.758940 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/616fe554-fdb6-442f-a5c5-5b7dd67f09f1-host-slash\") pod \"iptables-alerter-rkm8t\" (UID: \"616fe554-fdb6-442f-a5c5-5b7dd67f09f1\") " pod="openshift-network-operator/iptables-alerter-rkm8t" Jun 09 15:14:40.759027 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.758955 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c26ef062-04a7-4c4f-a597-c5d097f59914-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tgv5l\" (UID: \"c26ef062-04a7-4c4f-a597-c5d097f59914\") " pod="openshift-multus/multus-additional-cni-plugins-tgv5l" Jun 09 15:14:40.759027 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.758881 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9f6b7e7c-1047-4269-9e0b-462798a87429-etc-sysconfig\") pod \"tuned-2q6n7\" (UID: \"9f6b7e7c-1047-4269-9e0b-462798a87429\") " pod="openshift-cluster-node-tuning-operator/tuned-2q6n7" Jun 09 15:14:40.759027 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.758989 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/42130943-9472-4e99-901d-84460ecdc92e-host\") pod \"node-ca-zv9fh\" (UID: \"42130943-9472-4e99-901d-84460ecdc92e\") " pod="openshift-image-registry/node-ca-zv9fh" Jun 09 15:14:40.759027 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.759010 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9f6b7e7c-1047-4269-9e0b-462798a87429-run\") pod \"tuned-2q6n7\" (UID: \"9f6b7e7c-1047-4269-9e0b-462798a87429\") " pod="openshift-cluster-node-tuning-operator/tuned-2q6n7" Jun 09 15:14:40.759027 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.759027 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/42130943-9472-4e99-901d-84460ecdc92e-host\") pod \"node-ca-zv9fh\" (UID: \"42130943-9472-4e99-901d-84460ecdc92e\") " pod="openshift-image-registry/node-ca-zv9fh" Jun 09 15:14:40.759534 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.759030 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1f78ec9a-bb04-4826-98ea-3f1abeb1f823-cnibin\") pod \"multus-w7zzp\" (UID: \"1f78ec9a-bb04-4826-98ea-3f1abeb1f823\") " pod="openshift-multus/multus-w7zzp" Jun 09 15:14:40.759534 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.759070 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1f78ec9a-bb04-4826-98ea-3f1abeb1f823-multus-socket-dir-parent\") pod \"multus-w7zzp\" (UID: \"1f78ec9a-bb04-4826-98ea-3f1abeb1f823\") " pod="openshift-multus/multus-w7zzp" Jun 09 15:14:40.759534 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.759075 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1f78ec9a-bb04-4826-98ea-3f1abeb1f823-cnibin\") pod \"multus-w7zzp\" (UID: \"1f78ec9a-bb04-4826-98ea-3f1abeb1f823\") " pod="openshift-multus/multus-w7zzp" Jun 09 15:14:40.759534 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.759105 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9f6b7e7c-1047-4269-9e0b-462798a87429-etc-sysctl-d\") pod \"tuned-2q6n7\" (UID: \"9f6b7e7c-1047-4269-9e0b-462798a87429\") " pod="openshift-cluster-node-tuning-operator/tuned-2q6n7" Jun 09 15:14:40.759534 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.759129 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1f78ec9a-bb04-4826-98ea-3f1abeb1f823-multus-socket-dir-parent\") pod \"multus-w7zzp\" (UID: \"1f78ec9a-bb04-4826-98ea-3f1abeb1f823\") " pod="openshift-multus/multus-w7zzp" Jun 09 15:14:40.759534 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.759134 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9f6b7e7c-1047-4269-9e0b-462798a87429-etc-sysctl-conf\") pod \"tuned-2q6n7\" (UID: \"9f6b7e7c-1047-4269-9e0b-462798a87429\") " pod="openshift-cluster-node-tuning-operator/tuned-2q6n7" Jun 09 15:14:40.759534 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.759192 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9f6b7e7c-1047-4269-9e0b-462798a87429-run\") pod \"tuned-2q6n7\" (UID: \"9f6b7e7c-1047-4269-9e0b-462798a87429\") " pod="openshift-cluster-node-tuning-operator/tuned-2q6n7" Jun 09 15:14:40.759534 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.759190 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c26ef062-04a7-4c4f-a597-c5d097f59914-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tgv5l\" (UID: \"c26ef062-04a7-4c4f-a597-c5d097f59914\") " pod="openshift-multus/multus-additional-cni-plugins-tgv5l" Jun 09 15:14:40.759534 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.759224 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xsc74\" (UniqueName: \"kubernetes.io/projected/42130943-9472-4e99-901d-84460ecdc92e-kube-api-access-xsc74\") pod \"node-ca-zv9fh\" (UID: \"42130943-9472-4e99-901d-84460ecdc92e\") " pod="openshift-image-registry/node-ca-zv9fh" Jun 09 15:14:40.759534 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.759248 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9f6b7e7c-1047-4269-9e0b-462798a87429-host\") pod \"tuned-2q6n7\" (UID: \"9f6b7e7c-1047-4269-9e0b-462798a87429\") " pod="openshift-cluster-node-tuning-operator/tuned-2q6n7" Jun 09 15:14:40.759534 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.759271 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5d1837fb-ae3e-4519-b6f9-a444b41583cc-konnectivity-ca\") pod \"konnectivity-agent-nqshb\" (UID: \"5d1837fb-ae3e-4519-b6f9-a444b41583cc\") " pod="kube-system/konnectivity-agent-nqshb" Jun 09 15:14:40.759534 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.759297 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1f78ec9a-bb04-4826-98ea-3f1abeb1f823-host-run-k8s-cni-cncf-io\") pod \"multus-w7zzp\" (UID: \"1f78ec9a-bb04-4826-98ea-3f1abeb1f823\") " pod="openshift-multus/multus-w7zzp" Jun 09 15:14:40.759534 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.759320 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1f78ec9a-bb04-4826-98ea-3f1abeb1f823-host-run-netns\") pod \"multus-w7zzp\" (UID: \"1f78ec9a-bb04-4826-98ea-3f1abeb1f823\") " pod="openshift-multus/multus-w7zzp" Jun 09 15:14:40.759534 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.759327 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c26ef062-04a7-4c4f-a597-c5d097f59914-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tgv5l\" (UID: \"c26ef062-04a7-4c4f-a597-c5d097f59914\") " pod="openshift-multus/multus-additional-cni-plugins-tgv5l" Jun 09 15:14:40.759534 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.759366 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1f78ec9a-bb04-4826-98ea-3f1abeb1f823-host-run-k8s-cni-cncf-io\") pod \"multus-w7zzp\" (UID: \"1f78ec9a-bb04-4826-98ea-3f1abeb1f823\") " pod="openshift-multus/multus-w7zzp" Jun 09 15:14:40.759534 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.759370 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9f6b7e7c-1047-4269-9e0b-462798a87429-host\") pod \"tuned-2q6n7\" (UID: \"9f6b7e7c-1047-4269-9e0b-462798a87429\") " pod="openshift-cluster-node-tuning-operator/tuned-2q6n7" Jun 09 15:14:40.759534 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.759432 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1f78ec9a-bb04-4826-98ea-3f1abeb1f823-host-var-lib-kubelet\") pod \"multus-w7zzp\" (UID: \"1f78ec9a-bb04-4826-98ea-3f1abeb1f823\") " pod="openshift-multus/multus-w7zzp" Jun 09 15:14:40.759534 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.759438 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1f78ec9a-bb04-4826-98ea-3f1abeb1f823-host-run-netns\") pod \"multus-w7zzp\" (UID: \"1f78ec9a-bb04-4826-98ea-3f1abeb1f823\") " pod="openshift-multus/multus-w7zzp" Jun 09 15:14:40.760434 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.759465 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c26ef062-04a7-4c4f-a597-c5d097f59914-cnibin\") pod \"multus-additional-cni-plugins-tgv5l\" (UID: \"c26ef062-04a7-4c4f-a597-c5d097f59914\") " pod="openshift-multus/multus-additional-cni-plugins-tgv5l" Jun 09 15:14:40.760434 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.759490 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1f78ec9a-bb04-4826-98ea-3f1abeb1f823-host-var-lib-kubelet\") pod \"multus-w7zzp\" (UID: \"1f78ec9a-bb04-4826-98ea-3f1abeb1f823\") " pod="openshift-multus/multus-w7zzp" Jun 09 15:14:40.760434 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.759497 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1f78ec9a-bb04-4826-98ea-3f1abeb1f823-host-var-lib-cni-bin\") pod \"multus-w7zzp\" (UID: \"1f78ec9a-bb04-4826-98ea-3f1abeb1f823\") " pod="openshift-multus/multus-w7zzp" Jun 09 15:14:40.760434 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.759523 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1f78ec9a-bb04-4826-98ea-3f1abeb1f823-etc-kubernetes\") pod \"multus-w7zzp\" (UID: \"1f78ec9a-bb04-4826-98ea-3f1abeb1f823\") " pod="openshift-multus/multus-w7zzp" Jun 09 15:14:40.760434 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.759539 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c26ef062-04a7-4c4f-a597-c5d097f59914-cnibin\") pod \"multus-additional-cni-plugins-tgv5l\" (UID: \"c26ef062-04a7-4c4f-a597-c5d097f59914\") " pod="openshift-multus/multus-additional-cni-plugins-tgv5l" Jun 09 15:14:40.760434 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.759540 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c26ef062-04a7-4c4f-a597-c5d097f59914-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tgv5l\" (UID: \"c26ef062-04a7-4c4f-a597-c5d097f59914\") " pod="openshift-multus/multus-additional-cni-plugins-tgv5l" Jun 09 15:14:40.760434 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.759562 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1f78ec9a-bb04-4826-98ea-3f1abeb1f823-host-var-lib-cni-bin\") pod \"multus-w7zzp\" (UID: \"1f78ec9a-bb04-4826-98ea-3f1abeb1f823\") " pod="openshift-multus/multus-w7zzp" Jun 09 15:14:40.760434 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.759548 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5d4f5486-7d40-4141-b905-204512cddc9e-original-pull-secret\") pod \"global-pull-secret-syncer-29gkx\" (UID: \"5d4f5486-7d40-4141-b905-204512cddc9e\") " pod="kube-system/global-pull-secret-syncer-29gkx" Jun 09 15:14:40.760434 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.759603 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c26ef062-04a7-4c4f-a597-c5d097f59914-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tgv5l\" (UID: \"c26ef062-04a7-4c4f-a597-c5d097f59914\") " pod="openshift-multus/multus-additional-cni-plugins-tgv5l" Jun 09 15:14:40.760434 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.759622 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/616fe554-fdb6-442f-a5c5-5b7dd67f09f1-iptables-alerter-script\") pod \"iptables-alerter-rkm8t\" (UID: \"616fe554-fdb6-442f-a5c5-5b7dd67f09f1\") " pod="openshift-network-operator/iptables-alerter-rkm8t" Jun 09 15:14:40.760434 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:40.759626 2611 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 15:14:40.760434 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.759661 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1f78ec9a-bb04-4826-98ea-3f1abeb1f823-etc-kubernetes\") pod \"multus-w7zzp\" (UID: \"1f78ec9a-bb04-4826-98ea-3f1abeb1f823\") " pod="openshift-multus/multus-w7zzp" Jun 09 15:14:40.760434 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:40.759689 2611 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d4f5486-7d40-4141-b905-204512cddc9e-original-pull-secret podName:5d4f5486-7d40-4141-b905-204512cddc9e nodeName:}" failed. No retries permitted until 2026-06-09 15:14:41.259666136 +0000 UTC m=+2.065358345 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5d4f5486-7d40-4141-b905-204512cddc9e-original-pull-secret") pod "global-pull-secret-syncer-29gkx" (UID: "5d4f5486-7d40-4141-b905-204512cddc9e") : object "kube-system"/"original-pull-secret" not registered Jun 09 15:14:40.760434 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.759734 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcp7m\" (UniqueName: \"kubernetes.io/projected/616fe554-fdb6-442f-a5c5-5b7dd67f09f1-kube-api-access-fcp7m\") pod \"iptables-alerter-rkm8t\" (UID: \"616fe554-fdb6-442f-a5c5-5b7dd67f09f1\") " pod="openshift-network-operator/iptables-alerter-rkm8t" Jun 09 15:14:40.760434 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.759762 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9f6b7e7c-1047-4269-9e0b-462798a87429-lib-modules\") pod \"tuned-2q6n7\" (UID: \"9f6b7e7c-1047-4269-9e0b-462798a87429\") " pod="openshift-cluster-node-tuning-operator/tuned-2q6n7" Jun 09 15:14:40.760434 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.759788 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1f78ec9a-bb04-4826-98ea-3f1abeb1f823-host-var-lib-cni-multus\") pod \"multus-w7zzp\" (UID: \"1f78ec9a-bb04-4826-98ea-3f1abeb1f823\") " pod="openshift-multus/multus-w7zzp" Jun 09 15:14:40.760434 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.759817 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/42130943-9472-4e99-901d-84460ecdc92e-serviceca\") pod \"node-ca-zv9fh\" (UID: \"42130943-9472-4e99-901d-84460ecdc92e\") " pod="openshift-image-registry/node-ca-zv9fh" Jun 09 15:14:40.761259 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.759826 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5d1837fb-ae3e-4519-b6f9-a444b41583cc-konnectivity-ca\") pod \"konnectivity-agent-nqshb\" (UID: \"5d1837fb-ae3e-4519-b6f9-a444b41583cc\") " pod="kube-system/konnectivity-agent-nqshb" Jun 09 15:14:40.761259 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.759842 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9f6b7e7c-1047-4269-9e0b-462798a87429-tmp\") pod \"tuned-2q6n7\" (UID: \"9f6b7e7c-1047-4269-9e0b-462798a87429\") " pod="openshift-cluster-node-tuning-operator/tuned-2q6n7" Jun 09 15:14:40.761259 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.759867 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45kg8\" (UniqueName: \"kubernetes.io/projected/9f6b7e7c-1047-4269-9e0b-462798a87429-kube-api-access-45kg8\") pod \"tuned-2q6n7\" (UID: \"9f6b7e7c-1047-4269-9e0b-462798a87429\") " pod="openshift-cluster-node-tuning-operator/tuned-2q6n7" Jun 09 15:14:40.761259 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.759877 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1f78ec9a-bb04-4826-98ea-3f1abeb1f823-host-var-lib-cni-multus\") pod \"multus-w7zzp\" (UID: \"1f78ec9a-bb04-4826-98ea-3f1abeb1f823\") " pod="openshift-multus/multus-w7zzp" Jun 09 15:14:40.761259 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.759891 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1f78ec9a-bb04-4826-98ea-3f1abeb1f823-host-run-multus-certs\") pod \"multus-w7zzp\" (UID: \"1f78ec9a-bb04-4826-98ea-3f1abeb1f823\") " pod="openshift-multus/multus-w7zzp" Jun 09 15:14:40.761259 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.759915 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f450cf6-c990-47e4-a16a-5d0a4ff36581-metrics-certs\") pod \"network-metrics-daemon-mfj2k\" (UID: \"9f450cf6-c990-47e4-a16a-5d0a4ff36581\") " pod="openshift-multus/network-metrics-daemon-mfj2k" Jun 09 15:14:40.761259 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.759928 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9f6b7e7c-1047-4269-9e0b-462798a87429-lib-modules\") pod \"tuned-2q6n7\" (UID: \"9f6b7e7c-1047-4269-9e0b-462798a87429\") " pod="openshift-cluster-node-tuning-operator/tuned-2q6n7" Jun 09 15:14:40.761259 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.759944 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c26ef062-04a7-4c4f-a597-c5d097f59914-system-cni-dir\") pod \"multus-additional-cni-plugins-tgv5l\" (UID: \"c26ef062-04a7-4c4f-a597-c5d097f59914\") " pod="openshift-multus/multus-additional-cni-plugins-tgv5l" Jun 09 15:14:40.761259 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.759972 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zk5h\" (UniqueName: \"kubernetes.io/projected/c26ef062-04a7-4c4f-a597-c5d097f59914-kube-api-access-2zk5h\") pod \"multus-additional-cni-plugins-tgv5l\" (UID: \"c26ef062-04a7-4c4f-a597-c5d097f59914\") " pod="openshift-multus/multus-additional-cni-plugins-tgv5l" Jun 09 15:14:40.761259 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.759982 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1f78ec9a-bb04-4826-98ea-3f1abeb1f823-host-run-multus-certs\") pod \"multus-w7zzp\" (UID: \"1f78ec9a-bb04-4826-98ea-3f1abeb1f823\") " pod="openshift-multus/multus-w7zzp" Jun 09 15:14:40.761259 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.759999 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5d4f5486-7d40-4141-b905-204512cddc9e-kubelet-config\") pod \"global-pull-secret-syncer-29gkx\" (UID: \"5d4f5486-7d40-4141-b905-204512cddc9e\") " pod="kube-system/global-pull-secret-syncer-29gkx" Jun 09 15:14:40.761259 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.760022 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9f6b7e7c-1047-4269-9e0b-462798a87429-etc-tuned\") pod \"tuned-2q6n7\" (UID: \"9f6b7e7c-1047-4269-9e0b-462798a87429\") " pod="openshift-cluster-node-tuning-operator/tuned-2q6n7" Jun 09 15:14:40.761259 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.760046 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9f6b7e7c-1047-4269-9e0b-462798a87429-etc-modprobe-d\") pod \"tuned-2q6n7\" (UID: \"9f6b7e7c-1047-4269-9e0b-462798a87429\") " pod="openshift-cluster-node-tuning-operator/tuned-2q6n7" Jun 09 15:14:40.761259 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.760107 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1f78ec9a-bb04-4826-98ea-3f1abeb1f823-os-release\") pod \"multus-w7zzp\" (UID: \"1f78ec9a-bb04-4826-98ea-3f1abeb1f823\") " pod="openshift-multus/multus-w7zzp" Jun 09 15:14:40.761259 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.760122 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c26ef062-04a7-4c4f-a597-c5d097f59914-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tgv5l\" (UID: \"c26ef062-04a7-4c4f-a597-c5d097f59914\") " pod="openshift-multus/multus-additional-cni-plugins-tgv5l" Jun 09 15:14:40.761259 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.760135 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1f78ec9a-bb04-4826-98ea-3f1abeb1f823-hostroot\") pod \"multus-w7zzp\" (UID: \"1f78ec9a-bb04-4826-98ea-3f1abeb1f823\") " pod="openshift-multus/multus-w7zzp" Jun 09 15:14:40.761259 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.760141 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/616fe554-fdb6-442f-a5c5-5b7dd67f09f1-iptables-alerter-script\") pod \"iptables-alerter-rkm8t\" (UID: \"616fe554-fdb6-442f-a5c5-5b7dd67f09f1\") " pod="openshift-network-operator/iptables-alerter-rkm8t" Jun 09 15:14:40.762020 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.760197 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1f78ec9a-bb04-4826-98ea-3f1abeb1f823-hostroot\") pod \"multus-w7zzp\" (UID: \"1f78ec9a-bb04-4826-98ea-3f1abeb1f823\") " pod="openshift-multus/multus-w7zzp" Jun 09 15:14:40.762020 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.760196 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g29h9\" (UniqueName: \"kubernetes.io/projected/977ddaaf-4c0e-4fa9-8d02-4fb9c5448e06-kube-api-access-g29h9\") pod \"network-check-target-twwpl\" (UID: \"977ddaaf-4c0e-4fa9-8d02-4fb9c5448e06\") " pod="openshift-network-diagnostics/network-check-target-twwpl" Jun 09 15:14:40.762020 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.760224 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c26ef062-04a7-4c4f-a597-c5d097f59914-system-cni-dir\") pod \"multus-additional-cni-plugins-tgv5l\" (UID: \"c26ef062-04a7-4c4f-a597-c5d097f59914\") " pod="openshift-multus/multus-additional-cni-plugins-tgv5l" Jun 09 15:14:40.762020 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.760240 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9f6b7e7c-1047-4269-9e0b-462798a87429-etc-kubernetes\") pod \"tuned-2q6n7\" (UID: \"9f6b7e7c-1047-4269-9e0b-462798a87429\") " pod="openshift-cluster-node-tuning-operator/tuned-2q6n7" Jun 09 15:14:40.762020 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.760271 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9f6b7e7c-1047-4269-9e0b-462798a87429-etc-systemd\") pod \"tuned-2q6n7\" (UID: \"9f6b7e7c-1047-4269-9e0b-462798a87429\") " pod="openshift-cluster-node-tuning-operator/tuned-2q6n7" Jun 09 15:14:40.762020 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.760271 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/42130943-9472-4e99-901d-84460ecdc92e-serviceca\") pod \"node-ca-zv9fh\" (UID: \"42130943-9472-4e99-901d-84460ecdc92e\") " pod="openshift-image-registry/node-ca-zv9fh" Jun 09 15:14:40.762020 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.760297 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1f78ec9a-bb04-4826-98ea-3f1abeb1f823-system-cni-dir\") pod \"multus-w7zzp\" (UID: \"1f78ec9a-bb04-4826-98ea-3f1abeb1f823\") " pod="openshift-multus/multus-w7zzp" Jun 09 15:14:40.762020 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.760320 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1f78ec9a-bb04-4826-98ea-3f1abeb1f823-cni-binary-copy\") pod \"multus-w7zzp\" (UID: \"1f78ec9a-bb04-4826-98ea-3f1abeb1f823\") " pod="openshift-multus/multus-w7zzp" Jun 09 15:14:40.762020 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:40.760336 2611 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:14:40.762020 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.760352 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1f78ec9a-bb04-4826-98ea-3f1abeb1f823-os-release\") pod \"multus-w7zzp\" (UID: \"1f78ec9a-bb04-4826-98ea-3f1abeb1f823\") " pod="openshift-multus/multus-w7zzp" Jun 09 15:14:40.762020 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.760358 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9f6b7e7c-1047-4269-9e0b-462798a87429-etc-systemd\") pod \"tuned-2q6n7\" (UID: \"9f6b7e7c-1047-4269-9e0b-462798a87429\") " pod="openshift-cluster-node-tuning-operator/tuned-2q6n7" Jun 09 15:14:40.762020 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.760377 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c26ef062-04a7-4c4f-a597-c5d097f59914-os-release\") pod \"multus-additional-cni-plugins-tgv5l\" (UID: \"c26ef062-04a7-4c4f-a597-c5d097f59914\") " pod="openshift-multus/multus-additional-cni-plugins-tgv5l" Jun 09 15:14:40.762020 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:40.760385 2611 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f450cf6-c990-47e4-a16a-5d0a4ff36581-metrics-certs podName:9f450cf6-c990-47e4-a16a-5d0a4ff36581 nodeName:}" failed. No retries permitted until 2026-06-09 15:14:41.260368762 +0000 UTC m=+2.066060960 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9f450cf6-c990-47e4-a16a-5d0a4ff36581-metrics-certs") pod "network-metrics-daemon-mfj2k" (UID: "9f450cf6-c990-47e4-a16a-5d0a4ff36581") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:14:40.762020 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.760272 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5d4f5486-7d40-4141-b905-204512cddc9e-kubelet-config\") pod \"global-pull-secret-syncer-29gkx\" (UID: \"5d4f5486-7d40-4141-b905-204512cddc9e\") " pod="kube-system/global-pull-secret-syncer-29gkx" Jun 09 15:14:40.762020 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.760408 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9f6b7e7c-1047-4269-9e0b-462798a87429-etc-kubernetes\") pod \"tuned-2q6n7\" (UID: \"9f6b7e7c-1047-4269-9e0b-462798a87429\") " pod="openshift-cluster-node-tuning-operator/tuned-2q6n7" Jun 09 15:14:40.762020 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.760454 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9f6b7e7c-1047-4269-9e0b-462798a87429-var-lib-kubelet\") pod \"tuned-2q6n7\" (UID: \"9f6b7e7c-1047-4269-9e0b-462798a87429\") " pod="openshift-cluster-node-tuning-operator/tuned-2q6n7" Jun 09 15:14:40.762020 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.760469 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c26ef062-04a7-4c4f-a597-c5d097f59914-os-release\") pod \"multus-additional-cni-plugins-tgv5l\" (UID: \"c26ef062-04a7-4c4f-a597-c5d097f59914\") " pod="openshift-multus/multus-additional-cni-plugins-tgv5l" Jun 09 15:14:40.762933 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.760482 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1f78ec9a-bb04-4826-98ea-3f1abeb1f823-multus-daemon-config\") pod \"multus-w7zzp\" (UID: \"1f78ec9a-bb04-4826-98ea-3f1abeb1f823\") " pod="openshift-multus/multus-w7zzp" Jun 09 15:14:40.762933 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.760496 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9f6b7e7c-1047-4269-9e0b-462798a87429-etc-modprobe-d\") pod \"tuned-2q6n7\" (UID: \"9f6b7e7c-1047-4269-9e0b-462798a87429\") " pod="openshift-cluster-node-tuning-operator/tuned-2q6n7" Jun 09 15:14:40.762933 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.760508 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5d4f5486-7d40-4141-b905-204512cddc9e-dbus\") pod \"global-pull-secret-syncer-29gkx\" (UID: \"5d4f5486-7d40-4141-b905-204512cddc9e\") " pod="kube-system/global-pull-secret-syncer-29gkx" Jun 09 15:14:40.762933 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.760525 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9f6b7e7c-1047-4269-9e0b-462798a87429-var-lib-kubelet\") pod \"tuned-2q6n7\" (UID: \"9f6b7e7c-1047-4269-9e0b-462798a87429\") " pod="openshift-cluster-node-tuning-operator/tuned-2q6n7" Jun 09 15:14:40.762933 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.760533 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1f78ec9a-bb04-4826-98ea-3f1abeb1f823-multus-cni-dir\") pod \"multus-w7zzp\" (UID: \"1f78ec9a-bb04-4826-98ea-3f1abeb1f823\") " pod="openshift-multus/multus-w7zzp" Jun 09 15:14:40.762933 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.760559 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1f78ec9a-bb04-4826-98ea-3f1abeb1f823-multus-conf-dir\") pod \"multus-w7zzp\" (UID: \"1f78ec9a-bb04-4826-98ea-3f1abeb1f823\") " pod="openshift-multus/multus-w7zzp" Jun 09 15:14:40.762933 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.760562 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1f78ec9a-bb04-4826-98ea-3f1abeb1f823-system-cni-dir\") pod \"multus-w7zzp\" (UID: \"1f78ec9a-bb04-4826-98ea-3f1abeb1f823\") " pod="openshift-multus/multus-w7zzp" Jun 09 15:14:40.762933 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.760588 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hr2jf\" (UniqueName: \"kubernetes.io/projected/c9ad8e96-7211-48f9-be18-365a42d1a24f-kube-api-access-hr2jf\") pod \"node-resolver-q9x7l\" (UID: \"c9ad8e96-7211-48f9-be18-365a42d1a24f\") " pod="openshift-dns/node-resolver-q9x7l" Jun 09 15:14:40.762933 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.760599 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1f78ec9a-bb04-4826-98ea-3f1abeb1f823-multus-conf-dir\") pod \"multus-w7zzp\" (UID: \"1f78ec9a-bb04-4826-98ea-3f1abeb1f823\") " pod="openshift-multus/multus-w7zzp" Jun 09 15:14:40.762933 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.760616 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c9ad8e96-7211-48f9-be18-365a42d1a24f-tmp-dir\") pod \"node-resolver-q9x7l\" (UID: \"c9ad8e96-7211-48f9-be18-365a42d1a24f\") " pod="openshift-dns/node-resolver-q9x7l" Jun 09 15:14:40.762933 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.760645 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c26ef062-04a7-4c4f-a597-c5d097f59914-cni-binary-copy\") pod \"multus-additional-cni-plugins-tgv5l\" (UID: \"c26ef062-04a7-4c4f-a597-c5d097f59914\") " pod="openshift-multus/multus-additional-cni-plugins-tgv5l" Jun 09 15:14:40.762933 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.760669 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9f6b7e7c-1047-4269-9e0b-462798a87429-sys\") pod \"tuned-2q6n7\" (UID: \"9f6b7e7c-1047-4269-9e0b-462798a87429\") " pod="openshift-cluster-node-tuning-operator/tuned-2q6n7" Jun 09 15:14:40.762933 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.760695 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c9ad8e96-7211-48f9-be18-365a42d1a24f-hosts-file\") pod \"node-resolver-q9x7l\" (UID: \"c9ad8e96-7211-48f9-be18-365a42d1a24f\") " pod="openshift-dns/node-resolver-q9x7l" Jun 09 15:14:40.762933 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.760771 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c9ad8e96-7211-48f9-be18-365a42d1a24f-hosts-file\") pod \"node-resolver-q9x7l\" (UID: \"c9ad8e96-7211-48f9-be18-365a42d1a24f\") " pod="openshift-dns/node-resolver-q9x7l" Jun 09 15:14:40.762933 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.760775 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5d4f5486-7d40-4141-b905-204512cddc9e-dbus\") pod \"global-pull-secret-syncer-29gkx\" (UID: \"5d4f5486-7d40-4141-b905-204512cddc9e\") " pod="kube-system/global-pull-secret-syncer-29gkx" Jun 09 15:14:40.762933 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.760829 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1f78ec9a-bb04-4826-98ea-3f1abeb1f823-multus-cni-dir\") pod \"multus-w7zzp\" (UID: \"1f78ec9a-bb04-4826-98ea-3f1abeb1f823\") " pod="openshift-multus/multus-w7zzp" Jun 09 15:14:40.762933 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.760850 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1f78ec9a-bb04-4826-98ea-3f1abeb1f823-cni-binary-copy\") pod \"multus-w7zzp\" (UID: \"1f78ec9a-bb04-4826-98ea-3f1abeb1f823\") " pod="openshift-multus/multus-w7zzp" Jun 09 15:14:40.762933 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.760909 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9f6b7e7c-1047-4269-9e0b-462798a87429-sys\") pod \"tuned-2q6n7\" (UID: \"9f6b7e7c-1047-4269-9e0b-462798a87429\") " pod="openshift-cluster-node-tuning-operator/tuned-2q6n7" Jun 09 15:14:40.763546 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.761070 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c9ad8e96-7211-48f9-be18-365a42d1a24f-tmp-dir\") pod \"node-resolver-q9x7l\" (UID: \"c9ad8e96-7211-48f9-be18-365a42d1a24f\") " pod="openshift-dns/node-resolver-q9x7l" Jun 09 15:14:40.763546 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.761293 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c26ef062-04a7-4c4f-a597-c5d097f59914-cni-binary-copy\") pod \"multus-additional-cni-plugins-tgv5l\" (UID: \"c26ef062-04a7-4c4f-a597-c5d097f59914\") " pod="openshift-multus/multus-additional-cni-plugins-tgv5l" Jun 09 15:14:40.763546 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.761628 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1f78ec9a-bb04-4826-98ea-3f1abeb1f823-multus-daemon-config\") pod \"multus-w7zzp\" (UID: \"1f78ec9a-bb04-4826-98ea-3f1abeb1f823\") " pod="openshift-multus/multus-w7zzp" Jun 09 15:14:40.763546 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.761660 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5d1837fb-ae3e-4519-b6f9-a444b41583cc-agent-certs\") pod \"konnectivity-agent-nqshb\" (UID: \"5d1837fb-ae3e-4519-b6f9-a444b41583cc\") " pod="kube-system/konnectivity-agent-nqshb" Jun 09 15:14:40.763546 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.762418 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9f6b7e7c-1047-4269-9e0b-462798a87429-tmp\") pod \"tuned-2q6n7\" (UID: \"9f6b7e7c-1047-4269-9e0b-462798a87429\") " pod="openshift-cluster-node-tuning-operator/tuned-2q6n7" Jun 09 15:14:40.763546 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.762455 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9f6b7e7c-1047-4269-9e0b-462798a87429-etc-tuned\") pod \"tuned-2q6n7\" (UID: \"9f6b7e7c-1047-4269-9e0b-462798a87429\") " pod="openshift-cluster-node-tuning-operator/tuned-2q6n7" Jun 09 15:14:40.766943 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:40.766923 2611 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 15:14:40.767121 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:40.767105 2611 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 15:14:40.767269 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:40.767258 2611 projected.go:196] Error preparing data for projected volume kube-api-access-g29h9 for pod openshift-network-diagnostics/network-check-target-twwpl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:14:40.767486 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:40.767465 2611 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/977ddaaf-4c0e-4fa9-8d02-4fb9c5448e06-kube-api-access-g29h9 podName:977ddaaf-4c0e-4fa9-8d02-4fb9c5448e06 nodeName:}" failed. No retries permitted until 2026-06-09 15:14:41.267410891 +0000 UTC m=+2.073103089 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-g29h9" (UniqueName: "kubernetes.io/projected/977ddaaf-4c0e-4fa9-8d02-4fb9c5448e06-kube-api-access-g29h9") pod "network-check-target-twwpl" (UID: "977ddaaf-4c0e-4fa9-8d02-4fb9c5448e06") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:14:40.767801 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.767682 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8tq9\" (UniqueName: \"kubernetes.io/projected/9f450cf6-c990-47e4-a16a-5d0a4ff36581-kube-api-access-f8tq9\") pod \"network-metrics-daemon-mfj2k\" (UID: \"9f450cf6-c990-47e4-a16a-5d0a4ff36581\") " pod="openshift-multus/network-metrics-daemon-mfj2k" Jun 09 15:14:40.768401 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.768377 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m46nr\" (UniqueName: \"kubernetes.io/projected/1f78ec9a-bb04-4826-98ea-3f1abeb1f823-kube-api-access-m46nr\") pod \"multus-w7zzp\" (UID: \"1f78ec9a-bb04-4826-98ea-3f1abeb1f823\") " pod="openshift-multus/multus-w7zzp" Jun 09 15:14:40.768502 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.768455 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xsc74\" (UniqueName: \"kubernetes.io/projected/42130943-9472-4e99-901d-84460ecdc92e-kube-api-access-xsc74\") pod \"node-ca-zv9fh\" (UID: \"42130943-9472-4e99-901d-84460ecdc92e\") " pod="openshift-image-registry/node-ca-zv9fh" Jun 09 15:14:40.769052 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.769032 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-45kg8\" (UniqueName: \"kubernetes.io/projected/9f6b7e7c-1047-4269-9e0b-462798a87429-kube-api-access-45kg8\") pod \"tuned-2q6n7\" (UID: \"9f6b7e7c-1047-4269-9e0b-462798a87429\") " pod="openshift-cluster-node-tuning-operator/tuned-2q6n7" Jun 09 15:14:40.769172 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.769139 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcp7m\" (UniqueName: \"kubernetes.io/projected/616fe554-fdb6-442f-a5c5-5b7dd67f09f1-kube-api-access-fcp7m\") pod \"iptables-alerter-rkm8t\" (UID: \"616fe554-fdb6-442f-a5c5-5b7dd67f09f1\") " pod="openshift-network-operator/iptables-alerter-rkm8t" Jun 09 15:14:40.769448 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.769430 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zk5h\" (UniqueName: \"kubernetes.io/projected/c26ef062-04a7-4c4f-a597-c5d097f59914-kube-api-access-2zk5h\") pod \"multus-additional-cni-plugins-tgv5l\" (UID: \"c26ef062-04a7-4c4f-a597-c5d097f59914\") " pod="openshift-multus/multus-additional-cni-plugins-tgv5l" Jun 09 15:14:40.769840 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.769821 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hr2jf\" (UniqueName: \"kubernetes.io/projected/c9ad8e96-7211-48f9-be18-365a42d1a24f-kube-api-access-hr2jf\") pod \"node-resolver-q9x7l\" (UID: \"c9ad8e96-7211-48f9-be18-365a42d1a24f\") " pod="openshift-dns/node-resolver-q9x7l" Jun 09 15:14:40.808260 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.808231 2611 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 15:14:40.866318 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.866239 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gc7lq" Jun 09 15:14:40.875415 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:40.875390 2611 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod861a0219_329a_4a23_a03e_139931dba78f.slice/crio-382dd8294cb29a3a788bbaa0daf2bc000c979ed796dc50d7f3e1217e2d33438f WatchSource:0}: Error finding container 382dd8294cb29a3a788bbaa0daf2bc000c979ed796dc50d7f3e1217e2d33438f: Status 404 returned error can't find the container with id 382dd8294cb29a3a788bbaa0daf2bc000c979ed796dc50d7f3e1217e2d33438f Jun 09 15:14:40.891467 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.891446 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4vsgw" Jun 09 15:14:40.898333 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:40.898311 2611 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa94098e_7a90_4a75_9b97_74e10b75695b.slice/crio-1d9913a9aa0989d1e62d214753469844faed4b8a8b61ea32c30d83067c2f7b15 WatchSource:0}: Error finding container 1d9913a9aa0989d1e62d214753469844faed4b8a8b61ea32c30d83067c2f7b15: Status 404 returned error can't find the container with id 1d9913a9aa0989d1e62d214753469844faed4b8a8b61ea32c30d83067c2f7b15 Jun 09 15:14:40.899193 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.899175 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tgv5l" Jun 09 15:14:40.904959 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.904939 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zv9fh" Jun 09 15:14:40.906520 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:40.906503 2611 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc26ef062_04a7_4c4f_a597_c5d097f59914.slice/crio-3075b9e17e2dacf56a0570b4f4efe381aabe971ebcdef55e65ef59c6b0f89104 WatchSource:0}: Error finding container 3075b9e17e2dacf56a0570b4f4efe381aabe971ebcdef55e65ef59c6b0f89104: Status 404 returned error can't find the container with id 3075b9e17e2dacf56a0570b4f4efe381aabe971ebcdef55e65ef59c6b0f89104 Jun 09 15:14:40.909494 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.909409 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2q6n7" Jun 09 15:14:40.914058 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:40.914035 2611 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42130943_9472_4e99_901d_84460ecdc92e.slice/crio-adb32f877f69f5a8b456e96297f59ce1b7f66b466f2003f94dcb35667984a2b6 WatchSource:0}: Error finding container adb32f877f69f5a8b456e96297f59ce1b7f66b466f2003f94dcb35667984a2b6: Status 404 returned error can't find the container with id adb32f877f69f5a8b456e96297f59ce1b7f66b466f2003f94dcb35667984a2b6 Jun 09 15:14:40.914738 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.914720 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nqshb" Jun 09 15:14:40.918916 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:40.918890 2611 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f6b7e7c_1047_4269_9e0b_462798a87429.slice/crio-80eaa0995e2937f79a86830f6af3b4173fce98b9003dec9f3942854f5b478170 WatchSource:0}: Error finding container 80eaa0995e2937f79a86830f6af3b4173fce98b9003dec9f3942854f5b478170: Status 404 returned error can't find the container with id 80eaa0995e2937f79a86830f6af3b4173fce98b9003dec9f3942854f5b478170 Jun 09 15:14:40.920482 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.920346 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rkm8t" Jun 09 15:14:40.926394 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.926376 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-q9x7l" Jun 09 15:14:40.927006 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:40.926982 2611 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d1837fb_ae3e_4519_b6f9_a444b41583cc.slice/crio-d4da5f7f224afd6ac36efd8380fb07d04e90e285960f911f41fe0655132a9e1c WatchSource:0}: Error finding container d4da5f7f224afd6ac36efd8380fb07d04e90e285960f911f41fe0655132a9e1c: Status 404 returned error can't find the container with id d4da5f7f224afd6ac36efd8380fb07d04e90e285960f911f41fe0655132a9e1c Jun 09 15:14:40.930086 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:40.929941 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-w7zzp" Jun 09 15:14:40.930302 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:40.930277 2611 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod616fe554_fdb6_442f_a5c5_5b7dd67f09f1.slice/crio-3d7d346d2f91a8d84d96f4ffe670b07d2d8218a380c366fe367e9657552cd766 WatchSource:0}: Error finding container 3d7d346d2f91a8d84d96f4ffe670b07d2d8218a380c366fe367e9657552cd766: Status 404 returned error can't find the container with id 3d7d346d2f91a8d84d96f4ffe670b07d2d8218a380c366fe367e9657552cd766 Jun 09 15:14:40.936636 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:40.936619 2611 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9ad8e96_7211_48f9_be18_365a42d1a24f.slice/crio-a7b25c2f0bf1f99d5fd5fa525a8050212efd9facc37eaa085632fc048eadc4b1 WatchSource:0}: Error finding container a7b25c2f0bf1f99d5fd5fa525a8050212efd9facc37eaa085632fc048eadc4b1: Status 404 returned error can't find the container with id a7b25c2f0bf1f99d5fd5fa525a8050212efd9facc37eaa085632fc048eadc4b1 Jun 09 15:14:40.939168 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:14:40.939130 2611 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f78ec9a_bb04_4826_98ea_3f1abeb1f823.slice/crio-5911f816c27d603bbec50f6d0c7a52840ecae020bd523e6b0bab7aab38ccc4a6 WatchSource:0}: Error finding container 5911f816c27d603bbec50f6d0c7a52840ecae020bd523e6b0bab7aab38ccc4a6: Status 404 returned error can't find the container with id 5911f816c27d603bbec50f6d0c7a52840ecae020bd523e6b0bab7aab38ccc4a6 Jun 09 15:14:41.264533 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:41.264497 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5d4f5486-7d40-4141-b905-204512cddc9e-original-pull-secret\") pod \"global-pull-secret-syncer-29gkx\" (UID: \"5d4f5486-7d40-4141-b905-204512cddc9e\") " pod="kube-system/global-pull-secret-syncer-29gkx" Jun 09 15:14:41.264707 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:41.264549 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f450cf6-c990-47e4-a16a-5d0a4ff36581-metrics-certs\") pod \"network-metrics-daemon-mfj2k\" (UID: \"9f450cf6-c990-47e4-a16a-5d0a4ff36581\") " pod="openshift-multus/network-metrics-daemon-mfj2k" Jun 09 15:14:41.264707 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:41.264673 2611 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:14:41.264792 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:41.264729 2611 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f450cf6-c990-47e4-a16a-5d0a4ff36581-metrics-certs podName:9f450cf6-c990-47e4-a16a-5d0a4ff36581 nodeName:}" failed. No retries permitted until 2026-06-09 15:14:42.264711564 +0000 UTC m=+3.070403766 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9f450cf6-c990-47e4-a16a-5d0a4ff36581-metrics-certs") pod "network-metrics-daemon-mfj2k" (UID: "9f450cf6-c990-47e4-a16a-5d0a4ff36581") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:14:41.265004 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:41.264980 2611 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 15:14:41.265069 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:41.265050 2611 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d4f5486-7d40-4141-b905-204512cddc9e-original-pull-secret podName:5d4f5486-7d40-4141-b905-204512cddc9e nodeName:}" failed. No retries permitted until 2026-06-09 15:14:42.265032712 +0000 UTC m=+3.070724912 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5d4f5486-7d40-4141-b905-204512cddc9e-original-pull-secret") pod "global-pull-secret-syncer-29gkx" (UID: "5d4f5486-7d40-4141-b905-204512cddc9e") : object "kube-system"/"original-pull-secret" not registered Jun 09 15:14:41.364959 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:41.364922 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g29h9\" (UniqueName: \"kubernetes.io/projected/977ddaaf-4c0e-4fa9-8d02-4fb9c5448e06-kube-api-access-g29h9\") pod \"network-check-target-twwpl\" (UID: \"977ddaaf-4c0e-4fa9-8d02-4fb9c5448e06\") " pod="openshift-network-diagnostics/network-check-target-twwpl" Jun 09 15:14:41.365140 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:41.365079 2611 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 15:14:41.365140 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:41.365100 2611 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 15:14:41.365140 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:41.365112 2611 projected.go:196] Error preparing data for projected volume kube-api-access-g29h9 for pod openshift-network-diagnostics/network-check-target-twwpl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:14:41.365330 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:41.365190 2611 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/977ddaaf-4c0e-4fa9-8d02-4fb9c5448e06-kube-api-access-g29h9 podName:977ddaaf-4c0e-4fa9-8d02-4fb9c5448e06 nodeName:}" failed. No retries permitted until 2026-06-09 15:14:42.365151223 +0000 UTC m=+3.170843424 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-g29h9" (UniqueName: "kubernetes.io/projected/977ddaaf-4c0e-4fa9-8d02-4fb9c5448e06-kube-api-access-g29h9") pod "network-check-target-twwpl" (UID: "977ddaaf-4c0e-4fa9-8d02-4fb9c5448e06") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:14:41.602800 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:41.602696 2611 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 15:09:40 +0000 UTC" deadline="2028-03-20 06:52:52.532587374 +0000 UTC" Jun 09 15:14:41.602800 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:41.602742 2611 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15591h38m10.929851482s" Jun 09 15:14:41.630145 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:41.629526 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-29gkx" Jun 09 15:14:41.630145 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:41.629699 2611 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-29gkx" podUID="5d4f5486-7d40-4141-b905-204512cddc9e" Jun 09 15:14:41.647503 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:41.647454 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tgv5l" event={"ID":"c26ef062-04a7-4c4f-a597-c5d097f59914","Type":"ContainerStarted","Data":"3075b9e17e2dacf56a0570b4f4efe381aabe971ebcdef55e65ef59c6b0f89104"} Jun 09 15:14:41.649848 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:41.649651 2611 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 15:14:41.653247 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:41.653212 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gc7lq" event={"ID":"861a0219-329a-4a23-a03e-139931dba78f","Type":"ContainerStarted","Data":"382dd8294cb29a3a788bbaa0daf2bc000c979ed796dc50d7f3e1217e2d33438f"} Jun 09 15:14:41.661425 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:41.661354 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-w7zzp" event={"ID":"1f78ec9a-bb04-4826-98ea-3f1abeb1f823","Type":"ContainerStarted","Data":"5911f816c27d603bbec50f6d0c7a52840ecae020bd523e6b0bab7aab38ccc4a6"} Jun 09 15:14:41.673407 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:41.673332 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2q6n7" event={"ID":"9f6b7e7c-1047-4269-9e0b-462798a87429","Type":"ContainerStarted","Data":"80eaa0995e2937f79a86830f6af3b4173fce98b9003dec9f3942854f5b478170"} Jun 09 15:14:41.676415 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:41.676276 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zv9fh" event={"ID":"42130943-9472-4e99-901d-84460ecdc92e","Type":"ContainerStarted","Data":"adb32f877f69f5a8b456e96297f59ce1b7f66b466f2003f94dcb35667984a2b6"} Jun 09 15:14:41.693735 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:41.693610 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4vsgw" event={"ID":"aa94098e-7a90-4a75-9b97-74e10b75695b","Type":"ContainerStarted","Data":"1d9913a9aa0989d1e62d214753469844faed4b8a8b61ea32c30d83067c2f7b15"} Jun 09 15:14:41.698257 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:41.696605 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-q9x7l" event={"ID":"c9ad8e96-7211-48f9-be18-365a42d1a24f","Type":"ContainerStarted","Data":"a7b25c2f0bf1f99d5fd5fa525a8050212efd9facc37eaa085632fc048eadc4b1"} Jun 09 15:14:41.700620 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:41.700586 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rkm8t" event={"ID":"616fe554-fdb6-442f-a5c5-5b7dd67f09f1","Type":"ContainerStarted","Data":"3d7d346d2f91a8d84d96f4ffe670b07d2d8218a380c366fe367e9657552cd766"} Jun 09 15:14:41.703828 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:41.703800 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nqshb" event={"ID":"5d1837fb-ae3e-4519-b6f9-a444b41583cc","Type":"ContainerStarted","Data":"d4da5f7f224afd6ac36efd8380fb07d04e90e285960f911f41fe0655132a9e1c"} Jun 09 15:14:42.054190 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:42.054139 2611 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 15:14:42.273979 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:42.273939 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5d4f5486-7d40-4141-b905-204512cddc9e-original-pull-secret\") pod \"global-pull-secret-syncer-29gkx\" (UID: \"5d4f5486-7d40-4141-b905-204512cddc9e\") " pod="kube-system/global-pull-secret-syncer-29gkx" Jun 09 15:14:42.274147 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:42.274005 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f450cf6-c990-47e4-a16a-5d0a4ff36581-metrics-certs\") pod \"network-metrics-daemon-mfj2k\" (UID: \"9f450cf6-c990-47e4-a16a-5d0a4ff36581\") " pod="openshift-multus/network-metrics-daemon-mfj2k" Jun 09 15:14:42.274147 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:42.274110 2611 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 15:14:42.274147 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:42.274147 2611 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:14:42.274363 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:42.274214 2611 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d4f5486-7d40-4141-b905-204512cddc9e-original-pull-secret podName:5d4f5486-7d40-4141-b905-204512cddc9e nodeName:}" failed. No retries permitted until 2026-06-09 15:14:44.274185077 +0000 UTC m=+5.079877291 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5d4f5486-7d40-4141-b905-204512cddc9e-original-pull-secret") pod "global-pull-secret-syncer-29gkx" (UID: "5d4f5486-7d40-4141-b905-204512cddc9e") : object "kube-system"/"original-pull-secret" not registered Jun 09 15:14:42.274363 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:42.274236 2611 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f450cf6-c990-47e4-a16a-5d0a4ff36581-metrics-certs podName:9f450cf6-c990-47e4-a16a-5d0a4ff36581 nodeName:}" failed. No retries permitted until 2026-06-09 15:14:44.27422565 +0000 UTC m=+5.079917860 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9f450cf6-c990-47e4-a16a-5d0a4ff36581-metrics-certs") pod "network-metrics-daemon-mfj2k" (UID: "9f450cf6-c990-47e4-a16a-5d0a4ff36581") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:14:42.375236 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:42.375137 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g29h9\" (UniqueName: \"kubernetes.io/projected/977ddaaf-4c0e-4fa9-8d02-4fb9c5448e06-kube-api-access-g29h9\") pod \"network-check-target-twwpl\" (UID: \"977ddaaf-4c0e-4fa9-8d02-4fb9c5448e06\") " pod="openshift-network-diagnostics/network-check-target-twwpl" Jun 09 15:14:42.375402 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:42.375378 2611 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 15:14:42.375402 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:42.375397 2611 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 15:14:42.375541 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:42.375409 2611 projected.go:196] Error preparing data for projected volume kube-api-access-g29h9 for pod openshift-network-diagnostics/network-check-target-twwpl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:14:42.375541 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:42.375466 2611 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/977ddaaf-4c0e-4fa9-8d02-4fb9c5448e06-kube-api-access-g29h9 podName:977ddaaf-4c0e-4fa9-8d02-4fb9c5448e06 nodeName:}" failed. No retries permitted until 2026-06-09 15:14:44.375447623 +0000 UTC m=+5.181139822 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-g29h9" (UniqueName: "kubernetes.io/projected/977ddaaf-4c0e-4fa9-8d02-4fb9c5448e06-kube-api-access-g29h9") pod "network-check-target-twwpl" (UID: "977ddaaf-4c0e-4fa9-8d02-4fb9c5448e06") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:14:42.603143 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:42.603043 2611 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 15:09:40 +0000 UTC" deadline="2027-11-20 22:29:42.998064365 +0000 UTC" Jun 09 15:14:42.603143 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:42.603107 2611 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12703h15m0.394961696s" Jun 09 15:14:42.627904 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:42.627188 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-twwpl" Jun 09 15:14:42.627904 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:42.627313 2611 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-twwpl" podUID="977ddaaf-4c0e-4fa9-8d02-4fb9c5448e06" Jun 09 15:14:42.627904 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:42.627706 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mfj2k" Jun 09 15:14:42.627904 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:42.627813 2611 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mfj2k" podUID="9f450cf6-c990-47e4-a16a-5d0a4ff36581" Jun 09 15:14:43.583480 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:43.583221 2611 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 15:14:43.629846 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:43.629390 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-29gkx" Jun 09 15:14:43.629846 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:43.629521 2611 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-29gkx" podUID="5d4f5486-7d40-4141-b905-204512cddc9e" Jun 09 15:14:44.289889 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:44.289079 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f450cf6-c990-47e4-a16a-5d0a4ff36581-metrics-certs\") pod \"network-metrics-daemon-mfj2k\" (UID: \"9f450cf6-c990-47e4-a16a-5d0a4ff36581\") " pod="openshift-multus/network-metrics-daemon-mfj2k" Jun 09 15:14:44.289889 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:44.289203 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5d4f5486-7d40-4141-b905-204512cddc9e-original-pull-secret\") pod \"global-pull-secret-syncer-29gkx\" (UID: \"5d4f5486-7d40-4141-b905-204512cddc9e\") " pod="kube-system/global-pull-secret-syncer-29gkx" Jun 09 15:14:44.289889 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:44.289354 2611 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 15:14:44.289889 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:44.289423 2611 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d4f5486-7d40-4141-b905-204512cddc9e-original-pull-secret podName:5d4f5486-7d40-4141-b905-204512cddc9e nodeName:}" failed. No retries permitted until 2026-06-09 15:14:48.289401132 +0000 UTC m=+9.095093330 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5d4f5486-7d40-4141-b905-204512cddc9e-original-pull-secret") pod "global-pull-secret-syncer-29gkx" (UID: "5d4f5486-7d40-4141-b905-204512cddc9e") : object "kube-system"/"original-pull-secret" not registered Jun 09 15:14:44.289889 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:44.289808 2611 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:14:44.289889 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:44.289861 2611 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f450cf6-c990-47e4-a16a-5d0a4ff36581-metrics-certs podName:9f450cf6-c990-47e4-a16a-5d0a4ff36581 nodeName:}" failed. No retries permitted until 2026-06-09 15:14:48.289843646 +0000 UTC m=+9.095535844 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9f450cf6-c990-47e4-a16a-5d0a4ff36581-metrics-certs") pod "network-metrics-daemon-mfj2k" (UID: "9f450cf6-c990-47e4-a16a-5d0a4ff36581") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:14:44.390452 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:44.390417 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g29h9\" (UniqueName: \"kubernetes.io/projected/977ddaaf-4c0e-4fa9-8d02-4fb9c5448e06-kube-api-access-g29h9\") pod \"network-check-target-twwpl\" (UID: \"977ddaaf-4c0e-4fa9-8d02-4fb9c5448e06\") " pod="openshift-network-diagnostics/network-check-target-twwpl" Jun 09 15:14:44.390616 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:44.390577 2611 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 15:14:44.390616 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:44.390604 2611 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 15:14:44.390616 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:44.390618 2611 projected.go:196] Error preparing data for projected volume kube-api-access-g29h9 for pod openshift-network-diagnostics/network-check-target-twwpl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:14:44.390798 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:44.390687 2611 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/977ddaaf-4c0e-4fa9-8d02-4fb9c5448e06-kube-api-access-g29h9 podName:977ddaaf-4c0e-4fa9-8d02-4fb9c5448e06 nodeName:}" failed. No retries permitted until 2026-06-09 15:14:48.39066634 +0000 UTC m=+9.196358542 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-g29h9" (UniqueName: "kubernetes.io/projected/977ddaaf-4c0e-4fa9-8d02-4fb9c5448e06-kube-api-access-g29h9") pod "network-check-target-twwpl" (UID: "977ddaaf-4c0e-4fa9-8d02-4fb9c5448e06") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:14:44.627023 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:44.626882 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-twwpl" Jun 09 15:14:44.627210 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:44.627112 2611 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-twwpl" podUID="977ddaaf-4c0e-4fa9-8d02-4fb9c5448e06" Jun 09 15:14:44.627298 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:44.627221 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mfj2k" Jun 09 15:14:44.627389 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:44.627348 2611 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mfj2k" podUID="9f450cf6-c990-47e4-a16a-5d0a4ff36581" Jun 09 15:14:45.627295 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:45.627261 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-29gkx" Jun 09 15:14:45.627756 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:45.627402 2611 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-29gkx" podUID="5d4f5486-7d40-4141-b905-204512cddc9e" Jun 09 15:14:46.626615 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:46.626577 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-twwpl" Jun 09 15:14:46.626802 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:46.626626 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mfj2k" Jun 09 15:14:46.626802 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:46.626717 2611 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-twwpl" podUID="977ddaaf-4c0e-4fa9-8d02-4fb9c5448e06" Jun 09 15:14:46.626906 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:46.626853 2611 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mfj2k" podUID="9f450cf6-c990-47e4-a16a-5d0a4ff36581" Jun 09 15:14:47.627115 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:47.627027 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-29gkx" Jun 09 15:14:47.627593 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:47.627180 2611 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-29gkx" podUID="5d4f5486-7d40-4141-b905-204512cddc9e" Jun 09 15:14:48.322674 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:48.322636 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5d4f5486-7d40-4141-b905-204512cddc9e-original-pull-secret\") pod \"global-pull-secret-syncer-29gkx\" (UID: \"5d4f5486-7d40-4141-b905-204512cddc9e\") " pod="kube-system/global-pull-secret-syncer-29gkx" Jun 09 15:14:48.322853 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:48.322695 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f450cf6-c990-47e4-a16a-5d0a4ff36581-metrics-certs\") pod \"network-metrics-daemon-mfj2k\" (UID: \"9f450cf6-c990-47e4-a16a-5d0a4ff36581\") " pod="openshift-multus/network-metrics-daemon-mfj2k" Jun 09 15:14:48.322933 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:48.322848 2611 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 15:14:48.322933 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:48.322863 2611 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:14:48.322933 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:48.322928 2611 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d4f5486-7d40-4141-b905-204512cddc9e-original-pull-secret podName:5d4f5486-7d40-4141-b905-204512cddc9e nodeName:}" failed. No retries permitted until 2026-06-09 15:14:56.322907437 +0000 UTC m=+17.128599641 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5d4f5486-7d40-4141-b905-204512cddc9e-original-pull-secret") pod "global-pull-secret-syncer-29gkx" (UID: "5d4f5486-7d40-4141-b905-204512cddc9e") : object "kube-system"/"original-pull-secret" not registered Jun 09 15:14:48.323093 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:48.322950 2611 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f450cf6-c990-47e4-a16a-5d0a4ff36581-metrics-certs podName:9f450cf6-c990-47e4-a16a-5d0a4ff36581 nodeName:}" failed. No retries permitted until 2026-06-09 15:14:56.322939618 +0000 UTC m=+17.128631820 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9f450cf6-c990-47e4-a16a-5d0a4ff36581-metrics-certs") pod "network-metrics-daemon-mfj2k" (UID: "9f450cf6-c990-47e4-a16a-5d0a4ff36581") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:14:48.423505 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:48.423470 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g29h9\" (UniqueName: \"kubernetes.io/projected/977ddaaf-4c0e-4fa9-8d02-4fb9c5448e06-kube-api-access-g29h9\") pod \"network-check-target-twwpl\" (UID: \"977ddaaf-4c0e-4fa9-8d02-4fb9c5448e06\") " pod="openshift-network-diagnostics/network-check-target-twwpl" Jun 09 15:14:48.423703 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:48.423643 2611 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 15:14:48.423703 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:48.423663 2611 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 15:14:48.423703 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:48.423675 2611 projected.go:196] Error preparing data for projected volume kube-api-access-g29h9 for pod openshift-network-diagnostics/network-check-target-twwpl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:14:48.423859 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:48.423722 2611 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/977ddaaf-4c0e-4fa9-8d02-4fb9c5448e06-kube-api-access-g29h9 podName:977ddaaf-4c0e-4fa9-8d02-4fb9c5448e06 nodeName:}" failed. No retries permitted until 2026-06-09 15:14:56.423709095 +0000 UTC m=+17.229401292 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-g29h9" (UniqueName: "kubernetes.io/projected/977ddaaf-4c0e-4fa9-8d02-4fb9c5448e06-kube-api-access-g29h9") pod "network-check-target-twwpl" (UID: "977ddaaf-4c0e-4fa9-8d02-4fb9c5448e06") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:14:48.626313 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:48.626234 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-twwpl" Jun 09 15:14:48.626463 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:48.626373 2611 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-twwpl" podUID="977ddaaf-4c0e-4fa9-8d02-4fb9c5448e06" Jun 09 15:14:48.626463 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:48.626245 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mfj2k" Jun 09 15:14:48.626581 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:48.626554 2611 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mfj2k" podUID="9f450cf6-c990-47e4-a16a-5d0a4ff36581" Jun 09 15:14:49.627781 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:49.627049 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-29gkx" Jun 09 15:14:49.627781 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:49.627413 2611 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-29gkx" podUID="5d4f5486-7d40-4141-b905-204512cddc9e" Jun 09 15:14:50.627133 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:50.627093 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mfj2k" Jun 09 15:14:50.627314 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:50.627141 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-twwpl" Jun 09 15:14:50.627314 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:50.627263 2611 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mfj2k" podUID="9f450cf6-c990-47e4-a16a-5d0a4ff36581" Jun 09 15:14:50.627445 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:50.627394 2611 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-twwpl" podUID="977ddaaf-4c0e-4fa9-8d02-4fb9c5448e06" Jun 09 15:14:51.627298 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:51.627261 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-29gkx" Jun 09 15:14:51.627761 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:51.627458 2611 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-29gkx" podUID="5d4f5486-7d40-4141-b905-204512cddc9e" Jun 09 15:14:52.626994 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:52.626957 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mfj2k" Jun 09 15:14:52.626994 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:52.626993 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-twwpl" Jun 09 15:14:52.627251 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:52.627100 2611 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mfj2k" podUID="9f450cf6-c990-47e4-a16a-5d0a4ff36581" Jun 09 15:14:52.627308 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:52.627254 2611 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-twwpl" podUID="977ddaaf-4c0e-4fa9-8d02-4fb9c5448e06" Jun 09 15:14:53.626688 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:53.626651 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-29gkx" Jun 09 15:14:53.627189 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:53.626788 2611 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-29gkx" podUID="5d4f5486-7d40-4141-b905-204512cddc9e" Jun 09 15:14:54.626440 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:54.626410 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mfj2k" Jun 09 15:14:54.626632 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:54.626546 2611 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mfj2k" podUID="9f450cf6-c990-47e4-a16a-5d0a4ff36581" Jun 09 15:14:54.626632 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:54.626586 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-twwpl" Jun 09 15:14:54.626744 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:54.626653 2611 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-twwpl" podUID="977ddaaf-4c0e-4fa9-8d02-4fb9c5448e06" Jun 09 15:14:55.627390 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:55.627351 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-29gkx" Jun 09 15:14:55.627806 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:55.627479 2611 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-29gkx" podUID="5d4f5486-7d40-4141-b905-204512cddc9e" Jun 09 15:14:56.384906 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:56.384863 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5d4f5486-7d40-4141-b905-204512cddc9e-original-pull-secret\") pod \"global-pull-secret-syncer-29gkx\" (UID: \"5d4f5486-7d40-4141-b905-204512cddc9e\") " pod="kube-system/global-pull-secret-syncer-29gkx" Jun 09 15:14:56.385134 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:56.384923 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f450cf6-c990-47e4-a16a-5d0a4ff36581-metrics-certs\") pod \"network-metrics-daemon-mfj2k\" (UID: \"9f450cf6-c990-47e4-a16a-5d0a4ff36581\") " pod="openshift-multus/network-metrics-daemon-mfj2k" Jun 09 15:14:56.385134 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:56.385040 2611 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:14:56.385134 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:56.385040 2611 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 15:14:56.385134 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:56.385103 2611 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f450cf6-c990-47e4-a16a-5d0a4ff36581-metrics-certs podName:9f450cf6-c990-47e4-a16a-5d0a4ff36581 nodeName:}" failed. No retries permitted until 2026-06-09 15:15:12.385083789 +0000 UTC m=+33.190775987 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9f450cf6-c990-47e4-a16a-5d0a4ff36581-metrics-certs") pod "network-metrics-daemon-mfj2k" (UID: "9f450cf6-c990-47e4-a16a-5d0a4ff36581") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:14:56.385134 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:56.385119 2611 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d4f5486-7d40-4141-b905-204512cddc9e-original-pull-secret podName:5d4f5486-7d40-4141-b905-204512cddc9e nodeName:}" failed. No retries permitted until 2026-06-09 15:15:12.385110973 +0000 UTC m=+33.190803169 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5d4f5486-7d40-4141-b905-204512cddc9e-original-pull-secret") pod "global-pull-secret-syncer-29gkx" (UID: "5d4f5486-7d40-4141-b905-204512cddc9e") : object "kube-system"/"original-pull-secret" not registered Jun 09 15:14:56.486254 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:56.486203 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g29h9\" (UniqueName: \"kubernetes.io/projected/977ddaaf-4c0e-4fa9-8d02-4fb9c5448e06-kube-api-access-g29h9\") pod \"network-check-target-twwpl\" (UID: \"977ddaaf-4c0e-4fa9-8d02-4fb9c5448e06\") " pod="openshift-network-diagnostics/network-check-target-twwpl" Jun 09 15:14:56.486433 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:56.486412 2611 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 15:14:56.486433 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:56.486435 2611 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 15:14:56.486527 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:56.486448 2611 projected.go:196] Error preparing data for projected volume kube-api-access-g29h9 for pod openshift-network-diagnostics/network-check-target-twwpl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:14:56.486527 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:56.486515 2611 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/977ddaaf-4c0e-4fa9-8d02-4fb9c5448e06-kube-api-access-g29h9 podName:977ddaaf-4c0e-4fa9-8d02-4fb9c5448e06 nodeName:}" failed. No retries permitted until 2026-06-09 15:15:12.486497331 +0000 UTC m=+33.292189537 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-g29h9" (UniqueName: "kubernetes.io/projected/977ddaaf-4c0e-4fa9-8d02-4fb9c5448e06-kube-api-access-g29h9") pod "network-check-target-twwpl" (UID: "977ddaaf-4c0e-4fa9-8d02-4fb9c5448e06") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:14:56.627184 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:56.627139 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-twwpl" Jun 09 15:14:56.627396 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:56.627196 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mfj2k" Jun 09 15:14:56.627396 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:56.627282 2611 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-twwpl" podUID="977ddaaf-4c0e-4fa9-8d02-4fb9c5448e06" Jun 09 15:14:56.627396 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:56.627373 2611 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mfj2k" podUID="9f450cf6-c990-47e4-a16a-5d0a4ff36581" Jun 09 15:14:57.627308 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:57.627269 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-29gkx" Jun 09 15:14:57.627542 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:57.627408 2611 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-29gkx" podUID="5d4f5486-7d40-4141-b905-204512cddc9e" Jun 09 15:14:58.627002 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:58.626963 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mfj2k" Jun 09 15:14:58.627002 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:58.626995 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-twwpl" Jun 09 15:14:58.627239 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:58.627118 2611 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mfj2k" podUID="9f450cf6-c990-47e4-a16a-5d0a4ff36581" Jun 09 15:14:58.627239 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:58.627227 2611 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-twwpl" podUID="977ddaaf-4c0e-4fa9-8d02-4fb9c5448e06" Jun 09 15:14:59.629257 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:14:59.629221 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-29gkx" Jun 09 15:14:59.629740 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:14:59.629350 2611 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-29gkx" podUID="5d4f5486-7d40-4141-b905-204512cddc9e" Jun 09 15:15:00.628238 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:00.626416 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mfj2k" Jun 09 15:15:00.628238 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:15:00.626593 2611 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mfj2k" podUID="9f450cf6-c990-47e4-a16a-5d0a4ff36581" Jun 09 15:15:00.628238 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:00.626780 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-twwpl" Jun 09 15:15:00.628238 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:15:00.627094 2611 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-twwpl" podUID="977ddaaf-4c0e-4fa9-8d02-4fb9c5448e06" Jun 09 15:15:00.770629 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:00.770591 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-w7zzp" event={"ID":"1f78ec9a-bb04-4826-98ea-3f1abeb1f823","Type":"ContainerStarted","Data":"6c7aeb8200a24264b48a4e67f960c0772efab785101de6a3fc27edcf0f176a26"} Jun 09 15:15:00.772255 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:00.772223 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2q6n7" event={"ID":"9f6b7e7c-1047-4269-9e0b-462798a87429","Type":"ContainerStarted","Data":"93d37ce16074a8edd07f1691d4a9b9b399dcfea271aeadd60cf5bf5587b5641a"} Jun 09 15:15:00.774807 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:00.774786 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4vsgw_aa94098e-7a90-4a75-9b97-74e10b75695b/ovn-acl-logging/0.log" Jun 09 15:15:00.775172 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:00.775134 2611 generic.go:356] "Generic (PLEG): container finished" podID="aa94098e-7a90-4a75-9b97-74e10b75695b" containerID="6dd4edb0d068c0d12986bbd9df97f9ea6a003ff661be541b333afb54b80f9b95" exitCode=1 Jun 09 15:15:00.775255 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:00.775183 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4vsgw" event={"ID":"aa94098e-7a90-4a75-9b97-74e10b75695b","Type":"ContainerStarted","Data":"79a53dd8e49480217798eeaf8e30b58a4653e3ea70aa6f85733ce4ce52ed202f"} Jun 09 15:15:00.775308 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:00.775257 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4vsgw" event={"ID":"aa94098e-7a90-4a75-9b97-74e10b75695b","Type":"ContainerStarted","Data":"b73b03e7287e6103d526dbf981e87df78813fbd9a4596be33e0f48148092303f"} Jun 09 15:15:00.775308 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:00.775303 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4vsgw" event={"ID":"aa94098e-7a90-4a75-9b97-74e10b75695b","Type":"ContainerStarted","Data":"e8ff0d8a021edc32b1431103361e035014672073309c38db9070e0646de7f784"} Jun 09 15:15:00.775406 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:00.775351 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4vsgw" event={"ID":"aa94098e-7a90-4a75-9b97-74e10b75695b","Type":"ContainerDied","Data":"6dd4edb0d068c0d12986bbd9df97f9ea6a003ff661be541b333afb54b80f9b95"} Jun 09 15:15:00.775406 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:00.775390 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4vsgw" event={"ID":"aa94098e-7a90-4a75-9b97-74e10b75695b","Type":"ContainerStarted","Data":"d027964af21e2b1d1e5d9a3125e3127e6b27a765d95be0d9ed50cd0597387e34"} Jun 09 15:15:00.777911 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:00.777888 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-139.ec2.internal" event={"ID":"33e4799e2cf9d90f29ee83bae71e9e5d","Type":"ContainerStarted","Data":"d3def02338e5a04243aeaefc7cee58d7d38a80b47683c8053af286c5ba35fd97"} Jun 09 15:15:00.787416 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:00.787325 2611 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-w7zzp" podStartSLOduration=1.211976455 podStartE2EDuration="20.787311818s" totalImagesPullingTime="19.575335363s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:14:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:15:00.787295363 +0000 UTC m=+21.592987583" watchObservedRunningTime="2026-06-09 15:15:00.787311818 +0000 UTC m=+21.593004048" Jun 09 15:15:00.811516 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:00.811471 2611 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-2q6n7" podStartSLOduration=2.4555888 podStartE2EDuration="21.811452807s" totalImagesPullingTime="19.355864007s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:14:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:15:00.810690187 +0000 UTC m=+21.616382408" watchObservedRunningTime="2026-06-09 15:15:00.811452807 +0000 UTC m=+21.617145025" Jun 09 15:15:01.626884 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:01.626835 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-29gkx" Jun 09 15:15:01.627021 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:15:01.626992 2611 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-29gkx" podUID="5d4f5486-7d40-4141-b905-204512cddc9e" Jun 09 15:15:01.783581 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:01.783558 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4vsgw_aa94098e-7a90-4a75-9b97-74e10b75695b/ovn-acl-logging/0.log" Jun 09 15:15:01.784118 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:01.784043 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4vsgw" event={"ID":"aa94098e-7a90-4a75-9b97-74e10b75695b","Type":"ContainerStarted","Data":"5c1a99d2505e121f835d8cf6988f172ae7e2133279933473a83de7902542740f"} Jun 09 15:15:01.785766 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:01.785742 2611 generic.go:356] "Generic (PLEG): container finished" podID="802ce0072bc35220ef07e5a5529f3ab8" containerID="f195175ee45d8aba87af261d9dc46c93afa4e855b8300271c79cf9420c7087ee" exitCode=0 Jun 09 15:15:01.785872 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:01.785829 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-139.ec2.internal" event={"ID":"802ce0072bc35220ef07e5a5529f3ab8","Type":"ContainerDied","Data":"f195175ee45d8aba87af261d9dc46c93afa4e855b8300271c79cf9420c7087ee"} Jun 09 15:15:01.787370 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:01.787344 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-q9x7l" event={"ID":"c9ad8e96-7211-48f9-be18-365a42d1a24f","Type":"ContainerStarted","Data":"60bf5cf330bce0486488b14ecf625bdb02b276adbacbd93cca5917aac54914b2"} Jun 09 15:15:01.789252 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:01.789226 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rkm8t" event={"ID":"616fe554-fdb6-442f-a5c5-5b7dd67f09f1","Type":"ContainerStarted","Data":"1986193540ea2ec1faec4a95f8c6e6db4d8f91c4baaf0688dec0b280d56e4adb"} Jun 09 15:15:01.792728 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:01.792704 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nqshb" event={"ID":"5d1837fb-ae3e-4519-b6f9-a444b41583cc","Type":"ContainerStarted","Data":"9e1d5861e5e2d4145becee707f379943ad3383de38b59f66ddb0e6a271188488"} Jun 09 15:15:01.794409 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:01.794380 2611 generic.go:356] "Generic (PLEG): container finished" podID="c26ef062-04a7-4c4f-a597-c5d097f59914" containerID="3fc63dacdbd963a10f14cd8af153bc539efc3869eac8c46e8e5e98ad067efe82" exitCode=0 Jun 09 15:15:01.794501 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:01.794440 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tgv5l" event={"ID":"c26ef062-04a7-4c4f-a597-c5d097f59914","Type":"ContainerDied","Data":"3fc63dacdbd963a10f14cd8af153bc539efc3869eac8c46e8e5e98ad067efe82"} Jun 09 15:15:01.796302 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:01.796279 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gc7lq" event={"ID":"861a0219-329a-4a23-a03e-139931dba78f","Type":"ContainerStarted","Data":"ad86f6c500dad096b4fcab462c1018c6843065a4fc0ba04f60f7d6c635524258"} Jun 09 15:15:01.797783 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:01.797760 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zv9fh" event={"ID":"42130943-9472-4e99-901d-84460ecdc92e","Type":"ContainerStarted","Data":"42470e4f77e63102b16c625ab80cf31b4bb3adcf1af22c391725333e008f500f"} Jun 09 15:15:01.801145 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:01.801099 2611 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-139.ec2.internal" podStartSLOduration=21.80108413 podStartE2EDuration="21.80108413s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:14:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:15:00.822514959 +0000 UTC m=+21.628207206" watchObservedRunningTime="2026-06-09 15:15:01.80108413 +0000 UTC m=+22.606776349" Jun 09 15:15:01.812729 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:01.812692 2611 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-nqshb" podStartSLOduration=2.463682439 podStartE2EDuration="21.812679994s" totalImagesPullingTime="19.348997555s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:14:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:15:01.812455666 +0000 UTC m=+22.618147886" watchObservedRunningTime="2026-06-09 15:15:01.812679994 +0000 UTC m=+22.618372234" Jun 09 15:15:01.846021 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:01.845968 2611 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-rkm8t" podStartSLOduration=2.500878437 podStartE2EDuration="21.8459485s" totalImagesPullingTime="19.345070063s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:14:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:15:01.845505804 +0000 UTC m=+22.651198023" watchObservedRunningTime="2026-06-09 15:15:01.8459485 +0000 UTC m=+22.651640722" Jun 09 15:15:01.858923 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:01.858828 2611 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-q9x7l" podStartSLOduration=7.076286542 podStartE2EDuration="21.858815314s" totalImagesPullingTime="14.782528772s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:14:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:15:01.858807483 +0000 UTC m=+22.664499704" watchObservedRunningTime="2026-06-09 15:15:01.858815314 +0000 UTC m=+22.664507532" Jun 09 15:15:01.871688 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:01.871646 2611 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-zv9fh" podStartSLOduration=3.509797748 podStartE2EDuration="22.871632461s" totalImagesPullingTime="19.361834713s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:14:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:15:01.871487758 +0000 UTC m=+22.677179978" watchObservedRunningTime="2026-06-09 15:15:01.871632461 +0000 UTC m=+22.677324722" Jun 09 15:15:02.592562 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:02.592533 2611 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 09 15:15:02.627060 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:02.627023 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mfj2k" Jun 09 15:15:02.627231 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:02.627062 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-twwpl" Jun 09 15:15:02.627231 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:15:02.627151 2611 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mfj2k" podUID="9f450cf6-c990-47e4-a16a-5d0a4ff36581" Jun 09 15:15:02.627366 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:15:02.627312 2611 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-twwpl" podUID="977ddaaf-4c0e-4fa9-8d02-4fb9c5448e06" Jun 09 15:15:02.628091 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:02.627988 2611 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-09T15:15:02.592556842Z","UUID":"6fd5c6c1-1ce1-42bc-9888-faa227819ab8","Handler":null,"Name":"","Endpoint":""} Jun 09 15:15:02.629608 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:02.629586 2611 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 09 15:15:02.629713 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:02.629628 2611 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 09 15:15:02.802256 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:02.802146 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-139.ec2.internal" event={"ID":"802ce0072bc35220ef07e5a5529f3ab8","Type":"ContainerStarted","Data":"943d57892deeab4ce415ec7c48bb1480bcd7276a234944d89cd232ac74837074"} Jun 09 15:15:02.804406 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:02.804376 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gc7lq" event={"ID":"861a0219-329a-4a23-a03e-139931dba78f","Type":"ContainerStarted","Data":"793278674b2b48dd8200c39fd91d21bcf19611111fad1b4c997dd9cb35e0b792"} Jun 09 15:15:03.627348 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:03.627131 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-29gkx" Jun 09 15:15:03.627348 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:15:03.627297 2611 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-29gkx" podUID="5d4f5486-7d40-4141-b905-204512cddc9e" Jun 09 15:15:03.812411 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:03.812384 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4vsgw_aa94098e-7a90-4a75-9b97-74e10b75695b/ovn-acl-logging/0.log" Jun 09 15:15:03.812867 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:03.812831 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4vsgw" event={"ID":"aa94098e-7a90-4a75-9b97-74e10b75695b","Type":"ContainerStarted","Data":"41081fef702cb317f0f9bb805286c4fab689d425c72d0d31009cb5b4182e527b"} Jun 09 15:15:04.626526 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:04.626493 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-twwpl" Jun 09 15:15:04.626695 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:15:04.626626 2611 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-twwpl" podUID="977ddaaf-4c0e-4fa9-8d02-4fb9c5448e06" Jun 09 15:15:04.626850 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:04.626785 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mfj2k" Jun 09 15:15:04.626966 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:15:04.626938 2611 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mfj2k" podUID="9f450cf6-c990-47e4-a16a-5d0a4ff36581" Jun 09 15:15:04.817946 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:04.817912 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gc7lq" event={"ID":"861a0219-329a-4a23-a03e-139931dba78f","Type":"ContainerStarted","Data":"366778f0e21aeb1189dffe63343e23c4841f2fca8f3f9ea4dd150d49254bf895"} Jun 09 15:15:04.835079 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:04.835030 2611 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-139.ec2.internal" podStartSLOduration=24.83500812 podStartE2EDuration="24.83500812s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:14:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:15:02.815800145 +0000 UTC m=+23.621492365" watchObservedRunningTime="2026-06-09 15:15:04.83500812 +0000 UTC m=+25.640700332" Jun 09 15:15:04.836061 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:04.836026 2611 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gc7lq" podStartSLOduration=3.898941269 podStartE2EDuration="25.836010535s" totalImagesPullingTime="21.937069266s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:14:39 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:15:04.83393548 +0000 UTC m=+25.639627701" watchObservedRunningTime="2026-06-09 15:15:04.836010535 +0000 UTC m=+25.641702754" Jun 09 15:15:05.630525 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:05.630340 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-29gkx" Jun 09 15:15:05.630690 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:15:05.630610 2611 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-29gkx" podUID="5d4f5486-7d40-4141-b905-204512cddc9e" Jun 09 15:15:05.814347 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:05.814315 2611 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-nqshb" Jun 09 15:15:05.814930 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:05.814907 2611 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-nqshb" Jun 09 15:15:05.820229 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:05.820195 2611 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-nqshb" Jun 09 15:15:05.820709 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:05.820693 2611 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-nqshb" Jun 09 15:15:06.626612 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:06.626581 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-twwpl" Jun 09 15:15:06.626612 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:06.626625 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mfj2k" Jun 09 15:15:06.626860 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:15:06.626702 2611 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-twwpl" podUID="977ddaaf-4c0e-4fa9-8d02-4fb9c5448e06" Jun 09 15:15:06.626860 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:15:06.626799 2611 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mfj2k" podUID="9f450cf6-c990-47e4-a16a-5d0a4ff36581" Jun 09 15:15:06.824046 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:06.824011 2611 generic.go:356] "Generic (PLEG): container finished" podID="c26ef062-04a7-4c4f-a597-c5d097f59914" containerID="77db6c5c603ec279298d03a9906e3b4359a457a8949722d86db5ba4d5f218ff4" exitCode=0 Jun 09 15:15:06.824897 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:06.824097 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tgv5l" event={"ID":"c26ef062-04a7-4c4f-a597-c5d097f59914","Type":"ContainerDied","Data":"77db6c5c603ec279298d03a9906e3b4359a457a8949722d86db5ba4d5f218ff4"} Jun 09 15:15:06.827614 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:06.827596 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4vsgw_aa94098e-7a90-4a75-9b97-74e10b75695b/ovn-acl-logging/0.log" Jun 09 15:15:06.827963 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:06.827938 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4vsgw" event={"ID":"aa94098e-7a90-4a75-9b97-74e10b75695b","Type":"ContainerStarted","Data":"7db27cdc676b3e0af5aa5080cf3e48851ab186a4931d02ee33b62e0ae89e8f7c"} Jun 09 15:15:06.828416 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:06.828399 2611 scope.go:117] "RemoveContainer" containerID="6dd4edb0d068c0d12986bbd9df97f9ea6a003ff661be541b333afb54b80f9b95" Jun 09 15:15:07.626801 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:07.626615 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-29gkx" Jun 09 15:15:07.627040 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:15:07.626881 2611 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-29gkx" podUID="5d4f5486-7d40-4141-b905-204512cddc9e" Jun 09 15:15:07.835603 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:07.835576 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4vsgw_aa94098e-7a90-4a75-9b97-74e10b75695b/ovn-acl-logging/0.log" Jun 09 15:15:07.836022 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:07.835990 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4vsgw" event={"ID":"aa94098e-7a90-4a75-9b97-74e10b75695b","Type":"ContainerStarted","Data":"2507a8ce9230f4d09d353fa947da5f49a5cc3e7d61d02b939665e1ff2aa10170"} Jun 09 15:15:07.836508 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:07.836482 2611 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4vsgw" Jun 09 15:15:07.836611 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:07.836550 2611 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4vsgw" Jun 09 15:15:07.836611 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:07.836598 2611 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4vsgw" Jun 09 15:15:07.838505 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:07.838480 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tgv5l" event={"ID":"c26ef062-04a7-4c4f-a597-c5d097f59914","Type":"ContainerStarted","Data":"f67150c6e23d4dc2515caf19056ecebfaffb43f104cdc41bee8d4ed64d67e62e"} Jun 09 15:15:07.854657 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:07.854632 2611 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4vsgw" Jun 09 15:15:07.854874 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:07.854863 2611 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4vsgw" Jun 09 15:15:07.883506 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:07.883372 2611 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-4vsgw" podStartSLOduration=9.442102344 podStartE2EDuration="28.883353406s" totalImagesPullingTime="19.441251062s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:14:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:15:07.879929706 +0000 UTC m=+28.685621987" watchObservedRunningTime="2026-06-09 15:15:07.883353406 +0000 UTC m=+28.689045627" Jun 09 15:15:08.119174 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:08.119127 2611 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-29gkx"] Jun 09 15:15:08.119374 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:08.119269 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-29gkx" Jun 09 15:15:08.119424 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:15:08.119366 2611 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-29gkx" podUID="5d4f5486-7d40-4141-b905-204512cddc9e" Jun 09 15:15:08.121998 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:08.121962 2611 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mfj2k"] Jun 09 15:15:08.122141 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:08.122098 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mfj2k" Jun 09 15:15:08.122241 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:15:08.122218 2611 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mfj2k" podUID="9f450cf6-c990-47e4-a16a-5d0a4ff36581" Jun 09 15:15:08.122577 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:08.122553 2611 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-twwpl"] Jun 09 15:15:08.122690 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:08.122639 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-twwpl" Jun 09 15:15:08.122750 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:15:08.122731 2611 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-twwpl" podUID="977ddaaf-4c0e-4fa9-8d02-4fb9c5448e06" Jun 09 15:15:08.842606 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:08.842569 2611 generic.go:356] "Generic (PLEG): container finished" podID="c26ef062-04a7-4c4f-a597-c5d097f59914" containerID="f67150c6e23d4dc2515caf19056ecebfaffb43f104cdc41bee8d4ed64d67e62e" exitCode=0 Jun 09 15:15:08.842977 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:08.842643 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tgv5l" event={"ID":"c26ef062-04a7-4c4f-a597-c5d097f59914","Type":"ContainerDied","Data":"f67150c6e23d4dc2515caf19056ecebfaffb43f104cdc41bee8d4ed64d67e62e"} Jun 09 15:15:09.627238 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:09.627201 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-twwpl" Jun 09 15:15:09.627420 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:15:09.627306 2611 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-twwpl" podUID="977ddaaf-4c0e-4fa9-8d02-4fb9c5448e06" Jun 09 15:15:09.627420 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:09.627345 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-29gkx" Jun 09 15:15:09.627527 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:15:09.627454 2611 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-29gkx" podUID="5d4f5486-7d40-4141-b905-204512cddc9e" Jun 09 15:15:09.628042 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:09.628017 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mfj2k" Jun 09 15:15:09.628205 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:15:09.628184 2611 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mfj2k" podUID="9f450cf6-c990-47e4-a16a-5d0a4ff36581" Jun 09 15:15:10.850234 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:10.850005 2611 generic.go:356] "Generic (PLEG): container finished" podID="c26ef062-04a7-4c4f-a597-c5d097f59914" containerID="b600010873b9d5f2ad69785fb252b10357296f76b14fe7dda901f3cd85e69278" exitCode=0 Jun 09 15:15:10.850234 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:10.850103 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tgv5l" event={"ID":"c26ef062-04a7-4c4f-a597-c5d097f59914","Type":"ContainerDied","Data":"b600010873b9d5f2ad69785fb252b10357296f76b14fe7dda901f3cd85e69278"} Jun 09 15:15:11.626654 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:11.626619 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-29gkx" Jun 09 15:15:11.626813 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:11.626619 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-twwpl" Jun 09 15:15:11.626813 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:11.626738 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mfj2k" Jun 09 15:15:11.626813 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:15:11.626743 2611 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-29gkx" podUID="5d4f5486-7d40-4141-b905-204512cddc9e" Jun 09 15:15:11.626813 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:15:11.626805 2611 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-twwpl" podUID="977ddaaf-4c0e-4fa9-8d02-4fb9c5448e06" Jun 09 15:15:11.626959 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:15:11.626870 2611 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mfj2k" podUID="9f450cf6-c990-47e4-a16a-5d0a4ff36581" Jun 09 15:15:12.403094 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:12.403055 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5d4f5486-7d40-4141-b905-204512cddc9e-original-pull-secret\") pod \"global-pull-secret-syncer-29gkx\" (UID: \"5d4f5486-7d40-4141-b905-204512cddc9e\") " pod="kube-system/global-pull-secret-syncer-29gkx" Jun 09 15:15:12.403577 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:12.403114 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f450cf6-c990-47e4-a16a-5d0a4ff36581-metrics-certs\") pod \"network-metrics-daemon-mfj2k\" (UID: \"9f450cf6-c990-47e4-a16a-5d0a4ff36581\") " pod="openshift-multus/network-metrics-daemon-mfj2k" Jun 09 15:15:12.403577 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:15:12.403228 2611 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 15:15:12.403577 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:15:12.403254 2611 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:15:12.403577 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:15:12.403293 2611 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d4f5486-7d40-4141-b905-204512cddc9e-original-pull-secret podName:5d4f5486-7d40-4141-b905-204512cddc9e nodeName:}" failed. No retries permitted until 2026-06-09 15:15:44.403275286 +0000 UTC m=+65.208967504 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5d4f5486-7d40-4141-b905-204512cddc9e-original-pull-secret") pod "global-pull-secret-syncer-29gkx" (UID: "5d4f5486-7d40-4141-b905-204512cddc9e") : object "kube-system"/"original-pull-secret" not registered Jun 09 15:15:12.403577 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:15:12.403314 2611 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f450cf6-c990-47e4-a16a-5d0a4ff36581-metrics-certs podName:9f450cf6-c990-47e4-a16a-5d0a4ff36581 nodeName:}" failed. No retries permitted until 2026-06-09 15:15:44.403304053 +0000 UTC m=+65.208996250 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9f450cf6-c990-47e4-a16a-5d0a4ff36581-metrics-certs") pod "network-metrics-daemon-mfj2k" (UID: "9f450cf6-c990-47e4-a16a-5d0a4ff36581") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 15:15:12.506977 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:12.504686 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g29h9\" (UniqueName: \"kubernetes.io/projected/977ddaaf-4c0e-4fa9-8d02-4fb9c5448e06-kube-api-access-g29h9\") pod \"network-check-target-twwpl\" (UID: \"977ddaaf-4c0e-4fa9-8d02-4fb9c5448e06\") " pod="openshift-network-diagnostics/network-check-target-twwpl" Jun 09 15:15:12.506977 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:15:12.504765 2611 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 15:15:12.506977 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:15:12.504787 2611 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 15:15:12.506977 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:15:12.504810 2611 projected.go:196] Error preparing data for projected volume kube-api-access-g29h9 for pod openshift-network-diagnostics/network-check-target-twwpl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:15:12.506977 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:15:12.504874 2611 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/977ddaaf-4c0e-4fa9-8d02-4fb9c5448e06-kube-api-access-g29h9 podName:977ddaaf-4c0e-4fa9-8d02-4fb9c5448e06 nodeName:}" failed. No retries permitted until 2026-06-09 15:15:44.504850075 +0000 UTC m=+65.310542271 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-g29h9" (UniqueName: "kubernetes.io/projected/977ddaaf-4c0e-4fa9-8d02-4fb9c5448e06-kube-api-access-g29h9") pod "network-check-target-twwpl" (UID: "977ddaaf-4c0e-4fa9-8d02-4fb9c5448e06") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 15:15:13.010130 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:13.010074 2611 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-139.ec2.internal" event="NodeReady" Jun 09 15:15:13.010364 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:13.010340 2611 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 09 15:15:13.052241 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:13.052204 2611 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-5wxnd"] Jun 09 15:15:13.054412 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:13.054311 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5wxnd" Jun 09 15:15:13.055218 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:13.055193 2611 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-88h8k"] Jun 09 15:15:13.057044 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:13.057015 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-88h8k" Jun 09 15:15:13.057174 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:13.057121 2611 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 09 15:15:13.057313 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:13.057238 2611 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-wh9pq\"" Jun 09 15:15:13.057415 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:13.057388 2611 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 09 15:15:13.057584 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:13.057564 2611 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 09 15:15:13.059367 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:13.059346 2611 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 09 15:15:13.059367 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:13.059365 2611 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dfk2j\"" Jun 09 15:15:13.059501 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:13.059374 2611 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 09 15:15:13.064849 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:13.064790 2611 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5wxnd"] Jun 09 15:15:13.066813 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:13.066788 2611 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-88h8k"] Jun 09 15:15:13.209739 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:13.209660 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a97cd107-7aa2-4279-8024-d6584468fd66-tmp-dir\") pod \"dns-default-88h8k\" (UID: \"a97cd107-7aa2-4279-8024-d6584468fd66\") " pod="openshift-dns/dns-default-88h8k" Jun 09 15:15:13.209739 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:13.209721 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a97cd107-7aa2-4279-8024-d6584468fd66-metrics-tls\") pod \"dns-default-88h8k\" (UID: \"a97cd107-7aa2-4279-8024-d6584468fd66\") " pod="openshift-dns/dns-default-88h8k" Jun 09 15:15:13.209924 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:13.209744 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a97cd107-7aa2-4279-8024-d6584468fd66-config-volume\") pod \"dns-default-88h8k\" (UID: \"a97cd107-7aa2-4279-8024-d6584468fd66\") " pod="openshift-dns/dns-default-88h8k" Jun 09 15:15:13.209924 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:13.209761 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e3fbb074-05b5-48f8-b2cc-e1aaa57723c4-cert\") pod \"ingress-canary-5wxnd\" (UID: \"e3fbb074-05b5-48f8-b2cc-e1aaa57723c4\") " pod="openshift-ingress-canary/ingress-canary-5wxnd" Jun 09 15:15:13.209924 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:13.209779 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22529\" (UniqueName: \"kubernetes.io/projected/a97cd107-7aa2-4279-8024-d6584468fd66-kube-api-access-22529\") pod \"dns-default-88h8k\" (UID: \"a97cd107-7aa2-4279-8024-d6584468fd66\") " pod="openshift-dns/dns-default-88h8k" Jun 09 15:15:13.209924 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:13.209818 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5bj7\" (UniqueName: \"kubernetes.io/projected/e3fbb074-05b5-48f8-b2cc-e1aaa57723c4-kube-api-access-r5bj7\") pod \"ingress-canary-5wxnd\" (UID: \"e3fbb074-05b5-48f8-b2cc-e1aaa57723c4\") " pod="openshift-ingress-canary/ingress-canary-5wxnd" Jun 09 15:15:13.310695 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:13.310654 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22529\" (UniqueName: \"kubernetes.io/projected/a97cd107-7aa2-4279-8024-d6584468fd66-kube-api-access-22529\") pod \"dns-default-88h8k\" (UID: \"a97cd107-7aa2-4279-8024-d6584468fd66\") " pod="openshift-dns/dns-default-88h8k" Jun 09 15:15:13.310915 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:13.310729 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5bj7\" (UniqueName: \"kubernetes.io/projected/e3fbb074-05b5-48f8-b2cc-e1aaa57723c4-kube-api-access-r5bj7\") pod \"ingress-canary-5wxnd\" (UID: \"e3fbb074-05b5-48f8-b2cc-e1aaa57723c4\") " pod="openshift-ingress-canary/ingress-canary-5wxnd" Jun 09 15:15:13.310915 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:13.310769 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a97cd107-7aa2-4279-8024-d6584468fd66-tmp-dir\") pod \"dns-default-88h8k\" (UID: \"a97cd107-7aa2-4279-8024-d6584468fd66\") " pod="openshift-dns/dns-default-88h8k" Jun 09 15:15:13.310915 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:13.310909 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a97cd107-7aa2-4279-8024-d6584468fd66-metrics-tls\") pod \"dns-default-88h8k\" (UID: \"a97cd107-7aa2-4279-8024-d6584468fd66\") " pod="openshift-dns/dns-default-88h8k" Jun 09 15:15:13.311113 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:13.310950 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a97cd107-7aa2-4279-8024-d6584468fd66-config-volume\") pod \"dns-default-88h8k\" (UID: \"a97cd107-7aa2-4279-8024-d6584468fd66\") " pod="openshift-dns/dns-default-88h8k" Jun 09 15:15:13.311113 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:13.310982 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e3fbb074-05b5-48f8-b2cc-e1aaa57723c4-cert\") pod \"ingress-canary-5wxnd\" (UID: \"e3fbb074-05b5-48f8-b2cc-e1aaa57723c4\") " pod="openshift-ingress-canary/ingress-canary-5wxnd" Jun 09 15:15:13.311113 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:15:13.311023 2611 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 15:15:13.311113 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:15:13.311088 2611 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a97cd107-7aa2-4279-8024-d6584468fd66-metrics-tls podName:a97cd107-7aa2-4279-8024-d6584468fd66 nodeName:}" failed. No retries permitted until 2026-06-09 15:15:13.811066796 +0000 UTC m=+34.616758999 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a97cd107-7aa2-4279-8024-d6584468fd66-metrics-tls") pod "dns-default-88h8k" (UID: "a97cd107-7aa2-4279-8024-d6584468fd66") : secret "dns-default-metrics-tls" not found Jun 09 15:15:13.311280 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:13.311193 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a97cd107-7aa2-4279-8024-d6584468fd66-tmp-dir\") pod \"dns-default-88h8k\" (UID: \"a97cd107-7aa2-4279-8024-d6584468fd66\") " pod="openshift-dns/dns-default-88h8k" Jun 09 15:15:13.311596 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:13.311539 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a97cd107-7aa2-4279-8024-d6584468fd66-config-volume\") pod \"dns-default-88h8k\" (UID: \"a97cd107-7aa2-4279-8024-d6584468fd66\") " pod="openshift-dns/dns-default-88h8k" Jun 09 15:15:13.315736 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:13.315712 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e3fbb074-05b5-48f8-b2cc-e1aaa57723c4-cert\") pod \"ingress-canary-5wxnd\" (UID: \"e3fbb074-05b5-48f8-b2cc-e1aaa57723c4\") " pod="openshift-ingress-canary/ingress-canary-5wxnd" Jun 09 15:15:13.318879 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:13.318834 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-22529\" (UniqueName: \"kubernetes.io/projected/a97cd107-7aa2-4279-8024-d6584468fd66-kube-api-access-22529\") pod \"dns-default-88h8k\" (UID: \"a97cd107-7aa2-4279-8024-d6584468fd66\") " pod="openshift-dns/dns-default-88h8k" Jun 09 15:15:13.319366 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:13.319342 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5bj7\" (UniqueName: \"kubernetes.io/projected/e3fbb074-05b5-48f8-b2cc-e1aaa57723c4-kube-api-access-r5bj7\") pod \"ingress-canary-5wxnd\" (UID: \"e3fbb074-05b5-48f8-b2cc-e1aaa57723c4\") " pod="openshift-ingress-canary/ingress-canary-5wxnd" Jun 09 15:15:13.368781 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:13.368748 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5wxnd" Jun 09 15:15:13.516292 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:13.516260 2611 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5wxnd"] Jun 09 15:15:13.521266 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:15:13.521082 2611 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3fbb074_05b5_48f8_b2cc_e1aaa57723c4.slice/crio-64dfe7318688ab54167acfc3f2470c10286f4049ce44df255a57227b767be6b2 WatchSource:0}: Error finding container 64dfe7318688ab54167acfc3f2470c10286f4049ce44df255a57227b767be6b2: Status 404 returned error can't find the container with id 64dfe7318688ab54167acfc3f2470c10286f4049ce44df255a57227b767be6b2 Jun 09 15:15:13.627288 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:13.627257 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-twwpl" Jun 09 15:15:13.627471 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:13.627299 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mfj2k" Jun 09 15:15:13.627471 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:13.627257 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-29gkx" Jun 09 15:15:13.630222 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:13.630080 2611 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 15:15:13.630222 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:13.630136 2611 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-p4lvv\"" Jun 09 15:15:13.630905 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:13.630688 2611 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 15:15:13.630905 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:13.630702 2611 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 15:15:13.630905 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:13.630689 2611 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 15:15:13.630905 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:13.630710 2611 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zqn65\"" Jun 09 15:15:13.816337 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:13.816219 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a97cd107-7aa2-4279-8024-d6584468fd66-metrics-tls\") pod \"dns-default-88h8k\" (UID: \"a97cd107-7aa2-4279-8024-d6584468fd66\") " pod="openshift-dns/dns-default-88h8k" Jun 09 15:15:13.816506 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:15:13.816387 2611 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 15:15:13.816506 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:15:13.816465 2611 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a97cd107-7aa2-4279-8024-d6584468fd66-metrics-tls podName:a97cd107-7aa2-4279-8024-d6584468fd66 nodeName:}" failed. No retries permitted until 2026-06-09 15:15:14.816443829 +0000 UTC m=+35.622136043 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a97cd107-7aa2-4279-8024-d6584468fd66-metrics-tls") pod "dns-default-88h8k" (UID: "a97cd107-7aa2-4279-8024-d6584468fd66") : secret "dns-default-metrics-tls" not found Jun 09 15:15:13.859587 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:13.859550 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5wxnd" event={"ID":"e3fbb074-05b5-48f8-b2cc-e1aaa57723c4","Type":"ContainerStarted","Data":"64dfe7318688ab54167acfc3f2470c10286f4049ce44df255a57227b767be6b2"} Jun 09 15:15:14.825238 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:14.825194 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a97cd107-7aa2-4279-8024-d6584468fd66-metrics-tls\") pod \"dns-default-88h8k\" (UID: \"a97cd107-7aa2-4279-8024-d6584468fd66\") " pod="openshift-dns/dns-default-88h8k" Jun 09 15:15:14.825680 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:15:14.825366 2611 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 15:15:14.825680 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:15:14.825440 2611 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a97cd107-7aa2-4279-8024-d6584468fd66-metrics-tls podName:a97cd107-7aa2-4279-8024-d6584468fd66 nodeName:}" failed. No retries permitted until 2026-06-09 15:15:16.825423307 +0000 UTC m=+37.631115503 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a97cd107-7aa2-4279-8024-d6584468fd66-metrics-tls") pod "dns-default-88h8k" (UID: "a97cd107-7aa2-4279-8024-d6584468fd66") : secret "dns-default-metrics-tls" not found Jun 09 15:15:16.843723 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:16.843655 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a97cd107-7aa2-4279-8024-d6584468fd66-metrics-tls\") pod \"dns-default-88h8k\" (UID: \"a97cd107-7aa2-4279-8024-d6584468fd66\") " pod="openshift-dns/dns-default-88h8k" Jun 09 15:15:16.844337 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:15:16.843847 2611 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 15:15:16.844337 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:15:16.843932 2611 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a97cd107-7aa2-4279-8024-d6584468fd66-metrics-tls podName:a97cd107-7aa2-4279-8024-d6584468fd66 nodeName:}" failed. No retries permitted until 2026-06-09 15:15:20.843911535 +0000 UTC m=+41.649603747 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a97cd107-7aa2-4279-8024-d6584468fd66-metrics-tls") pod "dns-default-88h8k" (UID: "a97cd107-7aa2-4279-8024-d6584468fd66") : secret "dns-default-metrics-tls" not found Jun 09 15:15:16.868877 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:16.868846 2611 generic.go:356] "Generic (PLEG): container finished" podID="c26ef062-04a7-4c4f-a597-c5d097f59914" containerID="95dea7dc7120714205f0b506fac2da67fda315f080f9b5599573d2eed7bbb5b1" exitCode=0 Jun 09 15:15:16.869016 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:16.868922 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tgv5l" event={"ID":"c26ef062-04a7-4c4f-a597-c5d097f59914","Type":"ContainerDied","Data":"95dea7dc7120714205f0b506fac2da67fda315f080f9b5599573d2eed7bbb5b1"} Jun 09 15:15:16.870462 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:16.870432 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5wxnd" event={"ID":"e3fbb074-05b5-48f8-b2cc-e1aaa57723c4","Type":"ContainerStarted","Data":"b7576d5a0393a72a138cd1217e29830a7c99238a6e9a8663ad0b85c02908dc78"} Jun 09 15:15:16.904269 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:16.904220 2611 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-5wxnd" podStartSLOduration=1.027197646 podStartE2EDuration="3.904198907s" totalImagesPullingTime="2.877001261s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:15:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:15:16.903525617 +0000 UTC m=+37.709217837" watchObservedRunningTime="2026-06-09 15:15:16.904198907 +0000 UTC m=+37.709891129" Jun 09 15:15:16.993773 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:16.993744 2611 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d7d899c9b-zh85h"] Jun 09 15:15:17.007560 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:17.007294 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d7d899c9b-zh85h" Jun 09 15:15:17.007905 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:17.007869 2611 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d7d899c9b-zh85h"] Jun 09 15:15:17.010054 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:17.010029 2611 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 09 15:15:17.010054 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:17.010051 2611 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 09 15:15:17.010287 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:17.010266 2611 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 09 15:15:17.010542 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:17.010525 2611 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-nsgnj\"" Jun 09 15:15:17.010642 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:17.010605 2611 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 09 15:15:17.145556 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:17.145462 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/134ecc9f-4194-4ecd-a90e-2e84e7dfecb7-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5d7d899c9b-zh85h\" (UID: \"134ecc9f-4194-4ecd-a90e-2e84e7dfecb7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d7d899c9b-zh85h" Jun 09 15:15:17.145556 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:17.145530 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bq9cp\" (UniqueName: \"kubernetes.io/projected/134ecc9f-4194-4ecd-a90e-2e84e7dfecb7-kube-api-access-bq9cp\") pod \"managed-serviceaccount-addon-agent-5d7d899c9b-zh85h\" (UID: \"134ecc9f-4194-4ecd-a90e-2e84e7dfecb7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d7d899c9b-zh85h" Jun 09 15:15:17.246428 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:17.246386 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/134ecc9f-4194-4ecd-a90e-2e84e7dfecb7-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5d7d899c9b-zh85h\" (UID: \"134ecc9f-4194-4ecd-a90e-2e84e7dfecb7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d7d899c9b-zh85h" Jun 09 15:15:17.246618 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:17.246459 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bq9cp\" (UniqueName: \"kubernetes.io/projected/134ecc9f-4194-4ecd-a90e-2e84e7dfecb7-kube-api-access-bq9cp\") pod \"managed-serviceaccount-addon-agent-5d7d899c9b-zh85h\" (UID: \"134ecc9f-4194-4ecd-a90e-2e84e7dfecb7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d7d899c9b-zh85h" Jun 09 15:15:17.250765 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:17.250736 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/134ecc9f-4194-4ecd-a90e-2e84e7dfecb7-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5d7d899c9b-zh85h\" (UID: \"134ecc9f-4194-4ecd-a90e-2e84e7dfecb7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d7d899c9b-zh85h" Jun 09 15:15:17.254470 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:17.254446 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bq9cp\" (UniqueName: \"kubernetes.io/projected/134ecc9f-4194-4ecd-a90e-2e84e7dfecb7-kube-api-access-bq9cp\") pod \"managed-serviceaccount-addon-agent-5d7d899c9b-zh85h\" (UID: \"134ecc9f-4194-4ecd-a90e-2e84e7dfecb7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d7d899c9b-zh85h" Jun 09 15:15:17.329425 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:17.329387 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d7d899c9b-zh85h" Jun 09 15:15:17.465239 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:17.465025 2611 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d7d899c9b-zh85h"] Jun 09 15:15:17.485394 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:15:17.485366 2611 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod134ecc9f_4194_4ecd_a90e_2e84e7dfecb7.slice/crio-b0187371264853792684fa853c0e51a6ab3d79631f9d0653f556242b843cc463 WatchSource:0}: Error finding container b0187371264853792684fa853c0e51a6ab3d79631f9d0653f556242b843cc463: Status 404 returned error can't find the container with id b0187371264853792684fa853c0e51a6ab3d79631f9d0653f556242b843cc463 Jun 09 15:15:17.875528 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:17.875497 2611 generic.go:356] "Generic (PLEG): container finished" podID="c26ef062-04a7-4c4f-a597-c5d097f59914" containerID="c6a7802ac0fd7aa20d642e31879e392bca88683a8bbfed7d6347209263a7a188" exitCode=0 Jun 09 15:15:17.876225 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:17.875572 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tgv5l" event={"ID":"c26ef062-04a7-4c4f-a597-c5d097f59914","Type":"ContainerDied","Data":"c6a7802ac0fd7aa20d642e31879e392bca88683a8bbfed7d6347209263a7a188"} Jun 09 15:15:17.876700 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:17.876674 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d7d899c9b-zh85h" event={"ID":"134ecc9f-4194-4ecd-a90e-2e84e7dfecb7","Type":"ContainerStarted","Data":"b0187371264853792684fa853c0e51a6ab3d79631f9d0653f556242b843cc463"} Jun 09 15:15:18.884078 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:18.884037 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tgv5l" event={"ID":"c26ef062-04a7-4c4f-a597-c5d097f59914","Type":"ContainerStarted","Data":"a745f12ac56885ef1a44a1f9d8bf914dcb9fb5b18af918324cf5123384737f8a"} Jun 09 15:15:18.907638 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:18.907572 2611 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-tgv5l" podStartSLOduration=8.685820736 podStartE2EDuration="39.907550977s" totalImagesPullingTime="31.221730241s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:14:39 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:15:18.905800411 +0000 UTC m=+39.711492633" watchObservedRunningTime="2026-06-09 15:15:18.907550977 +0000 UTC m=+39.713243199" Jun 09 15:15:20.875031 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:20.874994 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a97cd107-7aa2-4279-8024-d6584468fd66-metrics-tls\") pod \"dns-default-88h8k\" (UID: \"a97cd107-7aa2-4279-8024-d6584468fd66\") " pod="openshift-dns/dns-default-88h8k" Jun 09 15:15:20.875431 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:15:20.875124 2611 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 15:15:20.875431 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:15:20.875201 2611 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a97cd107-7aa2-4279-8024-d6584468fd66-metrics-tls podName:a97cd107-7aa2-4279-8024-d6584468fd66 nodeName:}" failed. No retries permitted until 2026-06-09 15:15:28.875183604 +0000 UTC m=+49.680875803 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a97cd107-7aa2-4279-8024-d6584468fd66-metrics-tls") pod "dns-default-88h8k" (UID: "a97cd107-7aa2-4279-8024-d6584468fd66") : secret "dns-default-metrics-tls" not found Jun 09 15:15:21.892962 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:21.892922 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d7d899c9b-zh85h" event={"ID":"134ecc9f-4194-4ecd-a90e-2e84e7dfecb7","Type":"ContainerStarted","Data":"21199b9aa831a4be2a3fdebd7c1bd4d1852aeee3ce3e5fde02a14c7358a161a2"} Jun 09 15:15:21.927310 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:21.927261 2611 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d7d899c9b-zh85h" podStartSLOduration=2.474953202 podStartE2EDuration="5.927245901s" totalImagesPullingTime="3.452292699s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:15:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:15:21.926716851 +0000 UTC m=+42.732409070" watchObservedRunningTime="2026-06-09 15:15:21.927245901 +0000 UTC m=+42.732938119" Jun 09 15:15:28.931826 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:28.931788 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a97cd107-7aa2-4279-8024-d6584468fd66-metrics-tls\") pod \"dns-default-88h8k\" (UID: \"a97cd107-7aa2-4279-8024-d6584468fd66\") " pod="openshift-dns/dns-default-88h8k" Jun 09 15:15:28.932328 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:15:28.931956 2611 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 15:15:28.932328 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:15:28.932020 2611 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a97cd107-7aa2-4279-8024-d6584468fd66-metrics-tls podName:a97cd107-7aa2-4279-8024-d6584468fd66 nodeName:}" failed. No retries permitted until 2026-06-09 15:15:44.932005046 +0000 UTC m=+65.737697243 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a97cd107-7aa2-4279-8024-d6584468fd66-metrics-tls") pod "dns-default-88h8k" (UID: "a97cd107-7aa2-4279-8024-d6584468fd66") : secret "dns-default-metrics-tls" not found Jun 09 15:15:39.856695 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:39.856658 2611 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4vsgw" Jun 09 15:15:44.441561 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:44.441499 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5d4f5486-7d40-4141-b905-204512cddc9e-original-pull-secret\") pod \"global-pull-secret-syncer-29gkx\" (UID: \"5d4f5486-7d40-4141-b905-204512cddc9e\") " pod="kube-system/global-pull-secret-syncer-29gkx" Jun 09 15:15:44.441561 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:44.441575 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f450cf6-c990-47e4-a16a-5d0a4ff36581-metrics-certs\") pod \"network-metrics-daemon-mfj2k\" (UID: \"9f450cf6-c990-47e4-a16a-5d0a4ff36581\") " pod="openshift-multus/network-metrics-daemon-mfj2k" Jun 09 15:15:44.443956 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:44.443928 2611 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 15:15:44.444027 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:44.444008 2611 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 15:15:44.452791 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:15:44.452766 2611 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 15:15:44.452862 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:15:44.452851 2611 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f450cf6-c990-47e4-a16a-5d0a4ff36581-metrics-certs podName:9f450cf6-c990-47e4-a16a-5d0a4ff36581 nodeName:}" failed. No retries permitted until 2026-06-09 15:16:48.452831054 +0000 UTC m=+129.258523252 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9f450cf6-c990-47e4-a16a-5d0a4ff36581-metrics-certs") pod "network-metrics-daemon-mfj2k" (UID: "9f450cf6-c990-47e4-a16a-5d0a4ff36581") : secret "metrics-daemon-secret" not found Jun 09 15:15:44.455424 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:44.455402 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5d4f5486-7d40-4141-b905-204512cddc9e-original-pull-secret\") pod \"global-pull-secret-syncer-29gkx\" (UID: \"5d4f5486-7d40-4141-b905-204512cddc9e\") " pod="kube-system/global-pull-secret-syncer-29gkx" Jun 09 15:15:44.541961 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:44.541901 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g29h9\" (UniqueName: \"kubernetes.io/projected/977ddaaf-4c0e-4fa9-8d02-4fb9c5448e06-kube-api-access-g29h9\") pod \"network-check-target-twwpl\" (UID: \"977ddaaf-4c0e-4fa9-8d02-4fb9c5448e06\") " pod="openshift-network-diagnostics/network-check-target-twwpl" Jun 09 15:15:44.544644 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:44.544624 2611 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 15:15:44.549524 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:44.549507 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-29gkx" Jun 09 15:15:44.554783 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:44.554754 2611 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 15:15:44.565664 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:44.565617 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g29h9\" (UniqueName: \"kubernetes.io/projected/977ddaaf-4c0e-4fa9-8d02-4fb9c5448e06-kube-api-access-g29h9\") pod \"network-check-target-twwpl\" (UID: \"977ddaaf-4c0e-4fa9-8d02-4fb9c5448e06\") " pod="openshift-network-diagnostics/network-check-target-twwpl" Jun 09 15:15:44.674390 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:44.674359 2611 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-29gkx"] Jun 09 15:15:44.677804 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:15:44.677769 2611 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d4f5486_7d40_4141_b905_204512cddc9e.slice/crio-e5831ec0ebede759a3e2781f9a7d20e3afbedee483d436c1ae50ab66b861be78 WatchSource:0}: Error finding container e5831ec0ebede759a3e2781f9a7d20e3afbedee483d436c1ae50ab66b861be78: Status 404 returned error can't find the container with id e5831ec0ebede759a3e2781f9a7d20e3afbedee483d436c1ae50ab66b861be78 Jun 09 15:15:44.843389 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:44.843304 2611 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zqn65\"" Jun 09 15:15:44.851423 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:44.851386 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-twwpl" Jun 09 15:15:44.946125 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:44.946085 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a97cd107-7aa2-4279-8024-d6584468fd66-metrics-tls\") pod \"dns-default-88h8k\" (UID: \"a97cd107-7aa2-4279-8024-d6584468fd66\") " pod="openshift-dns/dns-default-88h8k" Jun 09 15:15:44.948000 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:15:44.947003 2611 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 15:15:44.948000 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:15:44.947080 2611 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a97cd107-7aa2-4279-8024-d6584468fd66-metrics-tls podName:a97cd107-7aa2-4279-8024-d6584468fd66 nodeName:}" failed. No retries permitted until 2026-06-09 15:16:16.947058081 +0000 UTC m=+97.752750294 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a97cd107-7aa2-4279-8024-d6584468fd66-metrics-tls") pod "dns-default-88h8k" (UID: "a97cd107-7aa2-4279-8024-d6584468fd66") : secret "dns-default-metrics-tls" not found Jun 09 15:15:44.967284 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:44.967196 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-29gkx" event={"ID":"5d4f5486-7d40-4141-b905-204512cddc9e","Type":"ContainerStarted","Data":"e5831ec0ebede759a3e2781f9a7d20e3afbedee483d436c1ae50ab66b861be78"} Jun 09 15:15:45.033261 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:45.033222 2611 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-twwpl"] Jun 09 15:15:45.036733 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:15:45.036691 2611 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod977ddaaf_4c0e_4fa9_8d02_4fb9c5448e06.slice/crio-a5092ec777889282b94e4520f23844c2493290dbb911371c5064b259bff66855 WatchSource:0}: Error finding container a5092ec777889282b94e4520f23844c2493290dbb911371c5064b259bff66855: Status 404 returned error can't find the container with id a5092ec777889282b94e4520f23844c2493290dbb911371c5064b259bff66855 Jun 09 15:15:45.970762 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:45.970713 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-twwpl" event={"ID":"977ddaaf-4c0e-4fa9-8d02-4fb9c5448e06","Type":"ContainerStarted","Data":"a5092ec777889282b94e4520f23844c2493290dbb911371c5064b259bff66855"} Jun 09 15:15:49.982678 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:49.982640 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-29gkx" event={"ID":"5d4f5486-7d40-4141-b905-204512cddc9e","Type":"ContainerStarted","Data":"2ff0f6797f65a9cbd8241345d2a388a369bac9a42efb511674bfd5cd25c837c5"} Jun 09 15:15:49.984117 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:49.984094 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-twwpl" event={"ID":"977ddaaf-4c0e-4fa9-8d02-4fb9c5448e06","Type":"ContainerStarted","Data":"c80078915cf69f34b5301c908b04c460725018947011a38f890977581b123cf7"} Jun 09 15:15:49.984236 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:49.984193 2611 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-twwpl" Jun 09 15:15:49.998249 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:49.998185 2611 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-29gkx" podStartSLOduration=64.868570008 podStartE2EDuration="1m9.998140234s" totalImagesPullingTime="5.129570226s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:14:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:15:49.99728405 +0000 UTC m=+70.802976302" watchObservedRunningTime="2026-06-09 15:15:49.998140234 +0000 UTC m=+70.803832452" Jun 09 15:15:50.011737 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:15:50.011697 2611 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-twwpl" podStartSLOduration=66.242370997 podStartE2EDuration="1m11.011686963s" totalImagesPullingTime="4.769315966s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:14:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:15:50.011070183 +0000 UTC m=+70.816762402" watchObservedRunningTime="2026-06-09 15:15:50.011686963 +0000 UTC m=+70.817379183" Jun 09 15:16:16.958447 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:16:16.958317 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a97cd107-7aa2-4279-8024-d6584468fd66-metrics-tls\") pod \"dns-default-88h8k\" (UID: \"a97cd107-7aa2-4279-8024-d6584468fd66\") " pod="openshift-dns/dns-default-88h8k" Jun 09 15:16:16.958931 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:16:16.958465 2611 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 15:16:16.958931 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:16:16.958537 2611 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a97cd107-7aa2-4279-8024-d6584468fd66-metrics-tls podName:a97cd107-7aa2-4279-8024-d6584468fd66 nodeName:}" failed. No retries permitted until 2026-06-09 15:17:20.958519449 +0000 UTC m=+161.764211649 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a97cd107-7aa2-4279-8024-d6584468fd66-metrics-tls") pod "dns-default-88h8k" (UID: "a97cd107-7aa2-4279-8024-d6584468fd66") : secret "dns-default-metrics-tls" not found Jun 09 15:16:20.989859 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:16:20.989828 2611 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-twwpl" Jun 09 15:16:48.474287 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:16:48.474241 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f450cf6-c990-47e4-a16a-5d0a4ff36581-metrics-certs\") pod \"network-metrics-daemon-mfj2k\" (UID: \"9f450cf6-c990-47e4-a16a-5d0a4ff36581\") " pod="openshift-multus/network-metrics-daemon-mfj2k" Jun 09 15:16:48.474794 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:16:48.474772 2611 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 15:16:48.474854 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:16:48.474844 2611 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f450cf6-c990-47e4-a16a-5d0a4ff36581-metrics-certs podName:9f450cf6-c990-47e4-a16a-5d0a4ff36581 nodeName:}" failed. No retries permitted until 2026-06-09 15:18:50.474828738 +0000 UTC m=+251.280520934 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9f450cf6-c990-47e4-a16a-5d0a4ff36581-metrics-certs") pod "network-metrics-daemon-mfj2k" (UID: "9f450cf6-c990-47e4-a16a-5d0a4ff36581") : secret "metrics-daemon-secret" not found Jun 09 15:17:16.074882 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:17:16.074838 2611 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-88h8k" podUID="a97cd107-7aa2-4279-8024-d6584468fd66" Jun 09 15:17:16.196196 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:17:16.196149 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-88h8k" Jun 09 15:17:16.655977 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:17:16.655926 2611 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-mfj2k" podUID="9f450cf6-c990-47e4-a16a-5d0a4ff36581" Jun 09 15:17:21.013481 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:17:21.013426 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a97cd107-7aa2-4279-8024-d6584468fd66-metrics-tls\") pod \"dns-default-88h8k\" (UID: \"a97cd107-7aa2-4279-8024-d6584468fd66\") " pod="openshift-dns/dns-default-88h8k" Jun 09 15:17:21.013890 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:17:21.013584 2611 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 15:17:21.013890 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:17:21.013656 2611 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a97cd107-7aa2-4279-8024-d6584468fd66-metrics-tls podName:a97cd107-7aa2-4279-8024-d6584468fd66 nodeName:}" failed. No retries permitted until 2026-06-09 15:19:23.01363948 +0000 UTC m=+283.819331677 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a97cd107-7aa2-4279-8024-d6584468fd66-metrics-tls") pod "dns-default-88h8k" (UID: "a97cd107-7aa2-4279-8024-d6584468fd66") : secret "dns-default-metrics-tls" not found Jun 09 15:17:21.209730 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:17:21.209694 2611 generic.go:356] "Generic (PLEG): container finished" podID="134ecc9f-4194-4ecd-a90e-2e84e7dfecb7" containerID="21199b9aa831a4be2a3fdebd7c1bd4d1852aeee3ce3e5fde02a14c7358a161a2" exitCode=255 Jun 09 15:17:21.209893 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:17:21.209769 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d7d899c9b-zh85h" event={"ID":"134ecc9f-4194-4ecd-a90e-2e84e7dfecb7","Type":"ContainerDied","Data":"21199b9aa831a4be2a3fdebd7c1bd4d1852aeee3ce3e5fde02a14c7358a161a2"} Jun 09 15:17:21.215335 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:17:21.215313 2611 scope.go:117] "RemoveContainer" containerID="21199b9aa831a4be2a3fdebd7c1bd4d1852aeee3ce3e5fde02a14c7358a161a2" Jun 09 15:17:22.218435 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:17:22.218394 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d7d899c9b-zh85h" event={"ID":"134ecc9f-4194-4ecd-a90e-2e84e7dfecb7","Type":"ContainerStarted","Data":"43150a87bf3a3f140b76033ab50e5c7ee560e7050a643546327a8a8b221d7d9f"} Jun 09 15:17:27.626811 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:17:27.626773 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mfj2k" Jun 09 15:18:02.792005 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:02.791970 2611 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-85c449f8d5-nz5ns"] Jun 09 15:18:02.794993 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:02.794971 2611 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-pjtxf"] Jun 09 15:18:02.795129 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:02.795097 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-85c449f8d5-nz5ns" Jun 09 15:18:02.797712 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:02.797692 2611 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-bzcwf"] Jun 09 15:18:02.797829 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:02.797812 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-pjtxf" Jun 09 15:18:02.797970 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:02.797950 2611 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 09 15:18:02.798082 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:02.797952 2611 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 09 15:18:02.798082 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:02.797980 2611 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 09 15:18:02.798421 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:02.798404 2611 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-47qsb\"" Jun 09 15:18:02.798633 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:02.798619 2611 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 09 15:18:02.799456 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:02.799427 2611 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 09 15:18:02.799549 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:02.799465 2611 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 09 15:18:02.799804 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:02.799789 2611 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-qckc6\"" Jun 09 15:18:02.800436 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:02.800417 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-bzcwf" Jun 09 15:18:02.804019 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:02.804002 2611 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 09 15:18:02.805114 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:02.805096 2611 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 09 15:18:02.805357 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:02.805341 2611 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 09 15:18:02.805409 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:02.805345 2611 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 09 15:18:02.805409 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:02.805390 2611 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-98fv6\"" Jun 09 15:18:02.812440 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:02.812419 2611 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-pjtxf"] Jun 09 15:18:02.817387 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:02.817362 2611 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-bzcwf"] Jun 09 15:18:02.821366 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:02.821345 2611 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-85c449f8d5-nz5ns"] Jun 09 15:18:02.880578 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:02.880546 2611 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-9xrjx"] Jun 09 15:18:02.883472 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:02.883449 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-9xrjx" Jun 09 15:18:02.884341 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:02.884301 2611 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-9b4t9"] Jun 09 15:18:02.885874 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:02.885852 2611 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 09 15:18:02.886052 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:02.886025 2611 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 09 15:18:02.886120 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:02.886029 2611 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-5mjf5\"" Jun 09 15:18:02.886120 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:02.886067 2611 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 09 15:18:02.886402 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:02.886385 2611 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 09 15:18:02.887122 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:02.887104 2611 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6f98c4fd9-72cfs"] Jun 09 15:18:02.887253 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:02.887238 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-9b4t9" Jun 09 15:18:02.889652 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:02.889626 2611 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-kzxcz"] Jun 09 15:18:02.889756 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:02.889746 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f98c4fd9-72cfs" Jun 09 15:18:02.889807 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:02.889752 2611 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 09 15:18:02.890298 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:02.890283 2611 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 09 15:18:02.890604 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:02.890587 2611 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-czl4q\"" Jun 09 15:18:02.890821 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:02.890804 2611 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 09 15:18:02.891715 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:02.891696 2611 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 09 15:18:02.892140 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:02.892124 2611 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 09 15:18:02.892503 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:02.892487 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-kzxcz" Jun 09 15:18:02.894911 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:02.894890 2611 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 09 15:18:02.894998 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:02.894923 2611 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 09 15:18:02.894998 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:02.894934 2611 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 09 15:18:02.894998 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:02.894961 2611 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 09 15:18:02.895348 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:02.895332 2611 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-mbhxv\"" Jun 09 15:18:02.895348 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:02.895345 2611 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 09 15:18:02.895759 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:02.895740 2611 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 09 15:18:02.895857 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:02.895836 2611 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-qv5j5\"" Jun 09 15:18:02.899997 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:02.899976 2611 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 09 15:18:02.900144 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:02.900125 2611 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-9xrjx"] Jun 09 15:18:02.903259 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:02.903236 2611 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 09 15:18:02.903830 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:02.903808 2611 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-9b4t9"] Jun 09 15:18:02.905999 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:02.905974 2611 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-kzxcz"] Jun 09 15:18:02.906637 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:02.906613 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6d68g\" (UniqueName: \"kubernetes.io/projected/bc96cce3-fc15-408b-8d4c-a77efa86e343-kube-api-access-6d68g\") pod \"network-check-source-dbd9cf844-pjtxf\" (UID: \"bc96cce3-fc15-408b-8d4c-a77efa86e343\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-pjtxf" Jun 09 15:18:02.906717 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:02.906655 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/34359b10-878f-4c43-9182-99889baf81b7-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-bzcwf\" (UID: \"34359b10-878f-4c43-9182-99889baf81b7\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-bzcwf" Jun 09 15:18:02.906717 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:02.906693 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5-default-certificate\") pod \"router-default-85c449f8d5-nz5ns\" (UID: \"2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5\") " pod="openshift-ingress/router-default-85c449f8d5-nz5ns" Jun 09 15:18:02.906831 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:02.906736 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5-metrics-certs\") pod \"router-default-85c449f8d5-nz5ns\" (UID: \"2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5\") " pod="openshift-ingress/router-default-85c449f8d5-nz5ns" Jun 09 15:18:02.906831 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:02.906778 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vll84\" (UniqueName: \"kubernetes.io/projected/2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5-kube-api-access-vll84\") pod \"router-default-85c449f8d5-nz5ns\" (UID: \"2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5\") " pod="openshift-ingress/router-default-85c449f8d5-nz5ns" Jun 09 15:18:02.906950 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:02.906841 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5-service-ca-bundle\") pod \"router-default-85c449f8d5-nz5ns\" (UID: \"2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5\") " pod="openshift-ingress/router-default-85c449f8d5-nz5ns" Jun 09 15:18:02.906950 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:02.906880 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/34359b10-878f-4c43-9182-99889baf81b7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-bzcwf\" (UID: \"34359b10-878f-4c43-9182-99889baf81b7\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-bzcwf" Jun 09 15:18:02.906950 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:02.906909 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mbc4\" (UniqueName: \"kubernetes.io/projected/34359b10-878f-4c43-9182-99889baf81b7-kube-api-access-2mbc4\") pod \"cluster-monitoring-operator-74bbf69bbb-bzcwf\" (UID: \"34359b10-878f-4c43-9182-99889baf81b7\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-bzcwf" Jun 09 15:18:02.907121 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:02.906984 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5-stats-auth\") pod \"router-default-85c449f8d5-nz5ns\" (UID: \"2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5\") " pod="openshift-ingress/router-default-85c449f8d5-nz5ns" Jun 09 15:18:02.908723 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:02.908703 2611 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6f98c4fd9-72cfs"] Jun 09 15:18:03.008092 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:03.008053 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5-default-certificate\") pod \"router-default-85c449f8d5-nz5ns\" (UID: \"2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5\") " pod="openshift-ingress/router-default-85c449f8d5-nz5ns" Jun 09 15:18:03.008092 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:03.008096 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7a9cdcf8-af9d-474c-9f46-4099925e11fc-trusted-ca\") pod \"console-operator-668fdbf85c-9b4t9\" (UID: \"7a9cdcf8-af9d-474c-9f46-4099925e11fc\") " pod="openshift-console-operator/console-operator-668fdbf85c-9b4t9" Jun 09 15:18:03.008390 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:03.008148 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5-service-ca-bundle\") pod \"router-default-85c449f8d5-nz5ns\" (UID: \"2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5\") " pod="openshift-ingress/router-default-85c449f8d5-nz5ns" Jun 09 15:18:03.008390 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:03.008197 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c5f897b6-d89e-42d5-8839-c44fe76224d5-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-kzxcz\" (UID: \"c5f897b6-d89e-42d5-8839-c44fe76224d5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-kzxcz" Jun 09 15:18:03.008390 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:03.008220 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nd69m\" (UniqueName: \"kubernetes.io/projected/b0379b61-8878-47c5-8ccd-e73c7a859bef-kube-api-access-nd69m\") pod \"image-registry-6f98c4fd9-72cfs\" (UID: \"b0379b61-8878-47c5-8ccd-e73c7a859bef\") " pod="openshift-image-registry/image-registry-6f98c4fd9-72cfs" Jun 09 15:18:03.008390 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:03.008245 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7vvt\" (UniqueName: \"kubernetes.io/projected/7a9cdcf8-af9d-474c-9f46-4099925e11fc-kube-api-access-d7vvt\") pod \"console-operator-668fdbf85c-9b4t9\" (UID: \"7a9cdcf8-af9d-474c-9f46-4099925e11fc\") " pod="openshift-console-operator/console-operator-668fdbf85c-9b4t9" Jun 09 15:18:03.008390 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:03.008266 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b0379b61-8878-47c5-8ccd-e73c7a859bef-registry-tls\") pod \"image-registry-6f98c4fd9-72cfs\" (UID: \"b0379b61-8878-47c5-8ccd-e73c7a859bef\") " pod="openshift-image-registry/image-registry-6f98c4fd9-72cfs" Jun 09 15:18:03.008390 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:03.008290 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/34359b10-878f-4c43-9182-99889baf81b7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-bzcwf\" (UID: \"34359b10-878f-4c43-9182-99889baf81b7\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-bzcwf" Jun 09 15:18:03.008390 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:18:03.008310 2611 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5-service-ca-bundle podName:2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5 nodeName:}" failed. No retries permitted until 2026-06-09 15:18:03.50828762 +0000 UTC m=+204.313979817 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5-service-ca-bundle") pod "router-default-85c449f8d5-nz5ns" (UID: "2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5") : configmap references non-existent config key: service-ca.crt Jun 09 15:18:03.008726 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:18:03.008394 2611 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 15:18:03.008726 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:03.008419 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mbc4\" (UniqueName: \"kubernetes.io/projected/34359b10-878f-4c43-9182-99889baf81b7-kube-api-access-2mbc4\") pod \"cluster-monitoring-operator-74bbf69bbb-bzcwf\" (UID: \"34359b10-878f-4c43-9182-99889baf81b7\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-bzcwf" Jun 09 15:18:03.008726 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:18:03.008483 2611 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34359b10-878f-4c43-9182-99889baf81b7-cluster-monitoring-operator-tls podName:34359b10-878f-4c43-9182-99889baf81b7 nodeName:}" failed. No retries permitted until 2026-06-09 15:18:03.508464374 +0000 UTC m=+204.314156573 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/34359b10-878f-4c43-9182-99889baf81b7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-bzcwf" (UID: "34359b10-878f-4c43-9182-99889baf81b7") : secret "cluster-monitoring-operator-tls" not found Jun 09 15:18:03.008726 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:03.008552 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7a9cdcf8-af9d-474c-9f46-4099925e11fc-serving-cert\") pod \"console-operator-668fdbf85c-9b4t9\" (UID: \"7a9cdcf8-af9d-474c-9f46-4099925e11fc\") " pod="openshift-console-operator/console-operator-668fdbf85c-9b4t9" Jun 09 15:18:03.008726 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:03.008604 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7a9cdcf8-af9d-474c-9f46-4099925e11fc-config\") pod \"console-operator-668fdbf85c-9b4t9\" (UID: \"7a9cdcf8-af9d-474c-9f46-4099925e11fc\") " pod="openshift-console-operator/console-operator-668fdbf85c-9b4t9" Jun 09 15:18:03.008726 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:03.008623 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjddf\" (UniqueName: \"kubernetes.io/projected/89d039e4-83e1-4441-a3f1-b22bc7c4ed18-kube-api-access-bjddf\") pod \"service-ca-operator-6bc5ff68f5-9xrjx\" (UID: \"89d039e4-83e1-4441-a3f1-b22bc7c4ed18\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-9xrjx" Jun 09 15:18:03.008726 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:03.008648 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6d68g\" (UniqueName: \"kubernetes.io/projected/bc96cce3-fc15-408b-8d4c-a77efa86e343-kube-api-access-6d68g\") pod \"network-check-source-dbd9cf844-pjtxf\" (UID: \"bc96cce3-fc15-408b-8d4c-a77efa86e343\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-pjtxf" Jun 09 15:18:03.008726 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:03.008675 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/89d039e4-83e1-4441-a3f1-b22bc7c4ed18-config\") pod \"service-ca-operator-6bc5ff68f5-9xrjx\" (UID: \"89d039e4-83e1-4441-a3f1-b22bc7c4ed18\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-9xrjx" Jun 09 15:18:03.008726 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:03.008695 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b0379b61-8878-47c5-8ccd-e73c7a859bef-trusted-ca\") pod \"image-registry-6f98c4fd9-72cfs\" (UID: \"b0379b61-8878-47c5-8ccd-e73c7a859bef\") " pod="openshift-image-registry/image-registry-6f98c4fd9-72cfs" Jun 09 15:18:03.008726 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:03.008710 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/89d039e4-83e1-4441-a3f1-b22bc7c4ed18-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-9xrjx\" (UID: \"89d039e4-83e1-4441-a3f1-b22bc7c4ed18\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-9xrjx" Jun 09 15:18:03.008726 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:03.008732 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5-metrics-certs\") pod \"router-default-85c449f8d5-nz5ns\" (UID: \"2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5\") " pod="openshift-ingress/router-default-85c449f8d5-nz5ns" Jun 09 15:18:03.009192 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:03.008778 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vll84\" (UniqueName: \"kubernetes.io/projected/2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5-kube-api-access-vll84\") pod \"router-default-85c449f8d5-nz5ns\" (UID: \"2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5\") " pod="openshift-ingress/router-default-85c449f8d5-nz5ns" Jun 09 15:18:03.009192 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:18:03.008805 2611 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 09 15:18:03.009192 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:03.008873 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b0379b61-8878-47c5-8ccd-e73c7a859bef-ca-trust-extracted\") pod \"image-registry-6f98c4fd9-72cfs\" (UID: \"b0379b61-8878-47c5-8ccd-e73c7a859bef\") " pod="openshift-image-registry/image-registry-6f98c4fd9-72cfs" Jun 09 15:18:03.009192 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:18:03.008926 2611 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5-metrics-certs podName:2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5 nodeName:}" failed. No retries permitted until 2026-06-09 15:18:03.508912755 +0000 UTC m=+204.314604951 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5-metrics-certs") pod "router-default-85c449f8d5-nz5ns" (UID: "2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5") : secret "router-metrics-certs-default" not found Jun 09 15:18:03.009192 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:03.008974 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c5f897b6-d89e-42d5-8839-c44fe76224d5-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-kzxcz\" (UID: \"c5f897b6-d89e-42d5-8839-c44fe76224d5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-kzxcz" Jun 09 15:18:03.009192 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:03.009001 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b0379b61-8878-47c5-8ccd-e73c7a859bef-image-registry-private-configuration\") pod \"image-registry-6f98c4fd9-72cfs\" (UID: \"b0379b61-8878-47c5-8ccd-e73c7a859bef\") " pod="openshift-image-registry/image-registry-6f98c4fd9-72cfs" Jun 09 15:18:03.009192 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:03.009025 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b0379b61-8878-47c5-8ccd-e73c7a859bef-registry-certificates\") pod \"image-registry-6f98c4fd9-72cfs\" (UID: \"b0379b61-8878-47c5-8ccd-e73c7a859bef\") " pod="openshift-image-registry/image-registry-6f98c4fd9-72cfs" Jun 09 15:18:03.009192 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:03.009066 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5-stats-auth\") pod \"router-default-85c449f8d5-nz5ns\" (UID: \"2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5\") " pod="openshift-ingress/router-default-85c449f8d5-nz5ns" Jun 09 15:18:03.009192 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:03.009085 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sl9zs\" (UniqueName: \"kubernetes.io/projected/c5f897b6-d89e-42d5-8839-c44fe76224d5-kube-api-access-sl9zs\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-kzxcz\" (UID: \"c5f897b6-d89e-42d5-8839-c44fe76224d5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-kzxcz" Jun 09 15:18:03.009192 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:03.009144 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/34359b10-878f-4c43-9182-99889baf81b7-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-bzcwf\" (UID: \"34359b10-878f-4c43-9182-99889baf81b7\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-bzcwf" Jun 09 15:18:03.009192 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:03.009180 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b0379b61-8878-47c5-8ccd-e73c7a859bef-installation-pull-secrets\") pod \"image-registry-6f98c4fd9-72cfs\" (UID: \"b0379b61-8878-47c5-8ccd-e73c7a859bef\") " pod="openshift-image-registry/image-registry-6f98c4fd9-72cfs" Jun 09 15:18:03.009635 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:03.009204 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b0379b61-8878-47c5-8ccd-e73c7a859bef-bound-sa-token\") pod \"image-registry-6f98c4fd9-72cfs\" (UID: \"b0379b61-8878-47c5-8ccd-e73c7a859bef\") " pod="openshift-image-registry/image-registry-6f98c4fd9-72cfs" Jun 09 15:18:03.009747 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:03.009729 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/34359b10-878f-4c43-9182-99889baf81b7-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-bzcwf\" (UID: \"34359b10-878f-4c43-9182-99889baf81b7\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-bzcwf" Jun 09 15:18:03.010833 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:03.010807 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5-default-certificate\") pod \"router-default-85c449f8d5-nz5ns\" (UID: \"2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5\") " pod="openshift-ingress/router-default-85c449f8d5-nz5ns" Jun 09 15:18:03.011420 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:03.011397 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5-stats-auth\") pod \"router-default-85c449f8d5-nz5ns\" (UID: \"2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5\") " pod="openshift-ingress/router-default-85c449f8d5-nz5ns" Jun 09 15:18:03.019939 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:03.019917 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6d68g\" (UniqueName: \"kubernetes.io/projected/bc96cce3-fc15-408b-8d4c-a77efa86e343-kube-api-access-6d68g\") pod \"network-check-source-dbd9cf844-pjtxf\" (UID: \"bc96cce3-fc15-408b-8d4c-a77efa86e343\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-pjtxf" Jun 09 15:18:03.021865 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:03.021841 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mbc4\" (UniqueName: \"kubernetes.io/projected/34359b10-878f-4c43-9182-99889baf81b7-kube-api-access-2mbc4\") pod \"cluster-monitoring-operator-74bbf69bbb-bzcwf\" (UID: \"34359b10-878f-4c43-9182-99889baf81b7\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-bzcwf" Jun 09 15:18:03.022077 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:03.022059 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vll84\" (UniqueName: \"kubernetes.io/projected/2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5-kube-api-access-vll84\") pod \"router-default-85c449f8d5-nz5ns\" (UID: \"2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5\") " pod="openshift-ingress/router-default-85c449f8d5-nz5ns" Jun 09 15:18:03.110234 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:03.110114 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sl9zs\" (UniqueName: \"kubernetes.io/projected/c5f897b6-d89e-42d5-8839-c44fe76224d5-kube-api-access-sl9zs\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-kzxcz\" (UID: \"c5f897b6-d89e-42d5-8839-c44fe76224d5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-kzxcz" Jun 09 15:18:03.110402 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:03.110278 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b0379b61-8878-47c5-8ccd-e73c7a859bef-installation-pull-secrets\") pod \"image-registry-6f98c4fd9-72cfs\" (UID: \"b0379b61-8878-47c5-8ccd-e73c7a859bef\") " pod="openshift-image-registry/image-registry-6f98c4fd9-72cfs" Jun 09 15:18:03.110402 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:03.110309 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b0379b61-8878-47c5-8ccd-e73c7a859bef-bound-sa-token\") pod \"image-registry-6f98c4fd9-72cfs\" (UID: \"b0379b61-8878-47c5-8ccd-e73c7a859bef\") " pod="openshift-image-registry/image-registry-6f98c4fd9-72cfs" Jun 09 15:18:03.110402 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:03.110332 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7a9cdcf8-af9d-474c-9f46-4099925e11fc-trusted-ca\") pod \"console-operator-668fdbf85c-9b4t9\" (UID: \"7a9cdcf8-af9d-474c-9f46-4099925e11fc\") " pod="openshift-console-operator/console-operator-668fdbf85c-9b4t9" Jun 09 15:18:03.110402 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:03.110376 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c5f897b6-d89e-42d5-8839-c44fe76224d5-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-kzxcz\" (UID: \"c5f897b6-d89e-42d5-8839-c44fe76224d5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-kzxcz" Jun 09 15:18:03.110402 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:03.110400 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nd69m\" (UniqueName: \"kubernetes.io/projected/b0379b61-8878-47c5-8ccd-e73c7a859bef-kube-api-access-nd69m\") pod \"image-registry-6f98c4fd9-72cfs\" (UID: \"b0379b61-8878-47c5-8ccd-e73c7a859bef\") " pod="openshift-image-registry/image-registry-6f98c4fd9-72cfs" Jun 09 15:18:03.110638 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:03.110426 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7vvt\" (UniqueName: \"kubernetes.io/projected/7a9cdcf8-af9d-474c-9f46-4099925e11fc-kube-api-access-d7vvt\") pod \"console-operator-668fdbf85c-9b4t9\" (UID: \"7a9cdcf8-af9d-474c-9f46-4099925e11fc\") " pod="openshift-console-operator/console-operator-668fdbf85c-9b4t9" Jun 09 15:18:03.110638 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:03.110477 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b0379b61-8878-47c5-8ccd-e73c7a859bef-registry-tls\") pod \"image-registry-6f98c4fd9-72cfs\" (UID: \"b0379b61-8878-47c5-8ccd-e73c7a859bef\") " pod="openshift-image-registry/image-registry-6f98c4fd9-72cfs" Jun 09 15:18:03.110638 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:03.110540 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7a9cdcf8-af9d-474c-9f46-4099925e11fc-serving-cert\") pod \"console-operator-668fdbf85c-9b4t9\" (UID: \"7a9cdcf8-af9d-474c-9f46-4099925e11fc\") " pod="openshift-console-operator/console-operator-668fdbf85c-9b4t9" Jun 09 15:18:03.110638 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:18:03.110585 2611 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 15:18:03.110638 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:18:03.110602 2611 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f98c4fd9-72cfs: secret "image-registry-tls" not found Jun 09 15:18:03.110870 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:18:03.110668 2611 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b0379b61-8878-47c5-8ccd-e73c7a859bef-registry-tls podName:b0379b61-8878-47c5-8ccd-e73c7a859bef nodeName:}" failed. No retries permitted until 2026-06-09 15:18:03.610648513 +0000 UTC m=+204.416340725 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b0379b61-8878-47c5-8ccd-e73c7a859bef-registry-tls") pod "image-registry-6f98c4fd9-72cfs" (UID: "b0379b61-8878-47c5-8ccd-e73c7a859bef") : secret "image-registry-tls" not found Jun 09 15:18:03.110870 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:03.110585 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7a9cdcf8-af9d-474c-9f46-4099925e11fc-config\") pod \"console-operator-668fdbf85c-9b4t9\" (UID: \"7a9cdcf8-af9d-474c-9f46-4099925e11fc\") " pod="openshift-console-operator/console-operator-668fdbf85c-9b4t9" Jun 09 15:18:03.110870 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:03.110698 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjddf\" (UniqueName: \"kubernetes.io/projected/89d039e4-83e1-4441-a3f1-b22bc7c4ed18-kube-api-access-bjddf\") pod \"service-ca-operator-6bc5ff68f5-9xrjx\" (UID: \"89d039e4-83e1-4441-a3f1-b22bc7c4ed18\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-9xrjx" Jun 09 15:18:03.110870 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:03.110730 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/89d039e4-83e1-4441-a3f1-b22bc7c4ed18-config\") pod \"service-ca-operator-6bc5ff68f5-9xrjx\" (UID: \"89d039e4-83e1-4441-a3f1-b22bc7c4ed18\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-9xrjx" Jun 09 15:18:03.110870 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:03.110758 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b0379b61-8878-47c5-8ccd-e73c7a859bef-trusted-ca\") pod \"image-registry-6f98c4fd9-72cfs\" (UID: \"b0379b61-8878-47c5-8ccd-e73c7a859bef\") " pod="openshift-image-registry/image-registry-6f98c4fd9-72cfs" Jun 09 15:18:03.110870 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:03.110779 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/89d039e4-83e1-4441-a3f1-b22bc7c4ed18-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-9xrjx\" (UID: \"89d039e4-83e1-4441-a3f1-b22bc7c4ed18\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-9xrjx" Jun 09 15:18:03.110870 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:03.110815 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b0379b61-8878-47c5-8ccd-e73c7a859bef-ca-trust-extracted\") pod \"image-registry-6f98c4fd9-72cfs\" (UID: \"b0379b61-8878-47c5-8ccd-e73c7a859bef\") " pod="openshift-image-registry/image-registry-6f98c4fd9-72cfs" Jun 09 15:18:03.111230 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:03.110988 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c5f897b6-d89e-42d5-8839-c44fe76224d5-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-kzxcz\" (UID: \"c5f897b6-d89e-42d5-8839-c44fe76224d5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-kzxcz" Jun 09 15:18:03.111230 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:03.111207 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b0379b61-8878-47c5-8ccd-e73c7a859bef-ca-trust-extracted\") pod \"image-registry-6f98c4fd9-72cfs\" (UID: \"b0379b61-8878-47c5-8ccd-e73c7a859bef\") " pod="openshift-image-registry/image-registry-6f98c4fd9-72cfs" Jun 09 15:18:03.111334 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:03.111279 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-pjtxf" Jun 09 15:18:03.111445 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:03.111420 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c5f897b6-d89e-42d5-8839-c44fe76224d5-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-kzxcz\" (UID: \"c5f897b6-d89e-42d5-8839-c44fe76224d5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-kzxcz" Jun 09 15:18:03.111505 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:03.111473 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b0379b61-8878-47c5-8ccd-e73c7a859bef-image-registry-private-configuration\") pod \"image-registry-6f98c4fd9-72cfs\" (UID: \"b0379b61-8878-47c5-8ccd-e73c7a859bef\") " pod="openshift-image-registry/image-registry-6f98c4fd9-72cfs" Jun 09 15:18:03.111505 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:03.111425 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/89d039e4-83e1-4441-a3f1-b22bc7c4ed18-config\") pod \"service-ca-operator-6bc5ff68f5-9xrjx\" (UID: \"89d039e4-83e1-4441-a3f1-b22bc7c4ed18\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-9xrjx" Jun 09 15:18:03.111612 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:03.111503 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b0379b61-8878-47c5-8ccd-e73c7a859bef-registry-certificates\") pod \"image-registry-6f98c4fd9-72cfs\" (UID: \"b0379b61-8878-47c5-8ccd-e73c7a859bef\") " pod="openshift-image-registry/image-registry-6f98c4fd9-72cfs" Jun 09 15:18:03.111612 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:03.111558 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7a9cdcf8-af9d-474c-9f46-4099925e11fc-config\") pod \"console-operator-668fdbf85c-9b4t9\" (UID: \"7a9cdcf8-af9d-474c-9f46-4099925e11fc\") " pod="openshift-console-operator/console-operator-668fdbf85c-9b4t9" Jun 09 15:18:03.111865 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:03.111840 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b0379b61-8878-47c5-8ccd-e73c7a859bef-trusted-ca\") pod \"image-registry-6f98c4fd9-72cfs\" (UID: \"b0379b61-8878-47c5-8ccd-e73c7a859bef\") " pod="openshift-image-registry/image-registry-6f98c4fd9-72cfs" Jun 09 15:18:03.112067 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:03.112015 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b0379b61-8878-47c5-8ccd-e73c7a859bef-registry-certificates\") pod \"image-registry-6f98c4fd9-72cfs\" (UID: \"b0379b61-8878-47c5-8ccd-e73c7a859bef\") " pod="openshift-image-registry/image-registry-6f98c4fd9-72cfs" Jun 09 15:18:03.112278 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:03.112255 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7a9cdcf8-af9d-474c-9f46-4099925e11fc-trusted-ca\") pod \"console-operator-668fdbf85c-9b4t9\" (UID: \"7a9cdcf8-af9d-474c-9f46-4099925e11fc\") " pod="openshift-console-operator/console-operator-668fdbf85c-9b4t9" Jun 09 15:18:03.113276 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:03.113254 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b0379b61-8878-47c5-8ccd-e73c7a859bef-installation-pull-secrets\") pod \"image-registry-6f98c4fd9-72cfs\" (UID: \"b0379b61-8878-47c5-8ccd-e73c7a859bef\") " pod="openshift-image-registry/image-registry-6f98c4fd9-72cfs" Jun 09 15:18:03.113844 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:03.113824 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/89d039e4-83e1-4441-a3f1-b22bc7c4ed18-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-9xrjx\" (UID: \"89d039e4-83e1-4441-a3f1-b22bc7c4ed18\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-9xrjx" Jun 09 15:18:03.113921 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:03.113856 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7a9cdcf8-af9d-474c-9f46-4099925e11fc-serving-cert\") pod \"console-operator-668fdbf85c-9b4t9\" (UID: \"7a9cdcf8-af9d-474c-9f46-4099925e11fc\") " pod="openshift-console-operator/console-operator-668fdbf85c-9b4t9" Jun 09 15:18:03.113921 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:03.113876 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c5f897b6-d89e-42d5-8839-c44fe76224d5-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-kzxcz\" (UID: \"c5f897b6-d89e-42d5-8839-c44fe76224d5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-kzxcz" Jun 09 15:18:03.113921 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:03.113883 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b0379b61-8878-47c5-8ccd-e73c7a859bef-image-registry-private-configuration\") pod \"image-registry-6f98c4fd9-72cfs\" (UID: \"b0379b61-8878-47c5-8ccd-e73c7a859bef\") " pod="openshift-image-registry/image-registry-6f98c4fd9-72cfs" Jun 09 15:18:03.120974 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:03.120949 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sl9zs\" (UniqueName: \"kubernetes.io/projected/c5f897b6-d89e-42d5-8839-c44fe76224d5-kube-api-access-sl9zs\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-kzxcz\" (UID: \"c5f897b6-d89e-42d5-8839-c44fe76224d5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-kzxcz" Jun 09 15:18:03.121962 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:03.121912 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjddf\" (UniqueName: \"kubernetes.io/projected/89d039e4-83e1-4441-a3f1-b22bc7c4ed18-kube-api-access-bjddf\") pod \"service-ca-operator-6bc5ff68f5-9xrjx\" (UID: \"89d039e4-83e1-4441-a3f1-b22bc7c4ed18\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-9xrjx" Jun 09 15:18:03.122107 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:03.122053 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7vvt\" (UniqueName: \"kubernetes.io/projected/7a9cdcf8-af9d-474c-9f46-4099925e11fc-kube-api-access-d7vvt\") pod \"console-operator-668fdbf85c-9b4t9\" (UID: \"7a9cdcf8-af9d-474c-9f46-4099925e11fc\") " pod="openshift-console-operator/console-operator-668fdbf85c-9b4t9" Jun 09 15:18:03.122622 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:03.122603 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b0379b61-8878-47c5-8ccd-e73c7a859bef-bound-sa-token\") pod \"image-registry-6f98c4fd9-72cfs\" (UID: \"b0379b61-8878-47c5-8ccd-e73c7a859bef\") " pod="openshift-image-registry/image-registry-6f98c4fd9-72cfs" Jun 09 15:18:03.122734 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:03.122665 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nd69m\" (UniqueName: \"kubernetes.io/projected/b0379b61-8878-47c5-8ccd-e73c7a859bef-kube-api-access-nd69m\") pod \"image-registry-6f98c4fd9-72cfs\" (UID: \"b0379b61-8878-47c5-8ccd-e73c7a859bef\") " pod="openshift-image-registry/image-registry-6f98c4fd9-72cfs" Jun 09 15:18:03.195486 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:03.195451 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-9xrjx" Jun 09 15:18:03.202650 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:03.202630 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-9b4t9" Jun 09 15:18:03.216825 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:03.216798 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-kzxcz" Jun 09 15:18:03.242815 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:03.242774 2611 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-pjtxf"] Jun 09 15:18:03.246730 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:18:03.246698 2611 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc96cce3_fc15_408b_8d4c_a77efa86e343.slice/crio-2399d6f3069f01be88d2639bc8334bad766b096d6dd6d28bc333eec2c9bdcef2 WatchSource:0}: Error finding container 2399d6f3069f01be88d2639bc8334bad766b096d6dd6d28bc333eec2c9bdcef2: Status 404 returned error can't find the container with id 2399d6f3069f01be88d2639bc8334bad766b096d6dd6d28bc333eec2c9bdcef2 Jun 09 15:18:03.336816 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:03.336787 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-pjtxf" event={"ID":"bc96cce3-fc15-408b-8d4c-a77efa86e343","Type":"ContainerStarted","Data":"2399d6f3069f01be88d2639bc8334bad766b096d6dd6d28bc333eec2c9bdcef2"} Jun 09 15:18:03.343684 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:03.343641 2611 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-9xrjx"] Jun 09 15:18:03.346725 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:18:03.346698 2611 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89d039e4_83e1_4441_a3f1_b22bc7c4ed18.slice/crio-e61dfc02e5044602c855b819e50eb35a8d984e5fef232801ad357ff5432bca9e WatchSource:0}: Error finding container e61dfc02e5044602c855b819e50eb35a8d984e5fef232801ad357ff5432bca9e: Status 404 returned error can't find the container with id e61dfc02e5044602c855b819e50eb35a8d984e5fef232801ad357ff5432bca9e Jun 09 15:18:03.369141 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:03.369069 2611 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-9b4t9"] Jun 09 15:18:03.373325 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:18:03.373295 2611 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a9cdcf8_af9d_474c_9f46_4099925e11fc.slice/crio-008ecbfaf89d84b431cd0bdac743fbb8aa5b0fe9e023a13d1361f996d32dae68 WatchSource:0}: Error finding container 008ecbfaf89d84b431cd0bdac743fbb8aa5b0fe9e023a13d1361f996d32dae68: Status 404 returned error can't find the container with id 008ecbfaf89d84b431cd0bdac743fbb8aa5b0fe9e023a13d1361f996d32dae68 Jun 09 15:18:03.396066 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:03.396034 2611 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-kzxcz"] Jun 09 15:18:03.399142 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:18:03.399103 2611 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5f897b6_d89e_42d5_8839_c44fe76224d5.slice/crio-c37ae8a41e05bef12abb700f640174fba2db25c72c40fc2bd55c7a24c27a0e15 WatchSource:0}: Error finding container c37ae8a41e05bef12abb700f640174fba2db25c72c40fc2bd55c7a24c27a0e15: Status 404 returned error can't find the container with id c37ae8a41e05bef12abb700f640174fba2db25c72c40fc2bd55c7a24c27a0e15 Jun 09 15:18:03.514859 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:03.514819 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5-metrics-certs\") pod \"router-default-85c449f8d5-nz5ns\" (UID: \"2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5\") " pod="openshift-ingress/router-default-85c449f8d5-nz5ns" Jun 09 15:18:03.515022 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:03.514890 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5-service-ca-bundle\") pod \"router-default-85c449f8d5-nz5ns\" (UID: \"2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5\") " pod="openshift-ingress/router-default-85c449f8d5-nz5ns" Jun 09 15:18:03.515022 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:03.514917 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/34359b10-878f-4c43-9182-99889baf81b7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-bzcwf\" (UID: \"34359b10-878f-4c43-9182-99889baf81b7\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-bzcwf" Jun 09 15:18:03.515022 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:18:03.514986 2611 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 09 15:18:03.515022 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:18:03.515020 2611 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 15:18:03.515148 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:18:03.515057 2611 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5-service-ca-bundle podName:2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5 nodeName:}" failed. No retries permitted until 2026-06-09 15:18:04.515041826 +0000 UTC m=+205.320734028 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5-service-ca-bundle") pod "router-default-85c449f8d5-nz5ns" (UID: "2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5") : configmap references non-existent config key: service-ca.crt Jun 09 15:18:03.515148 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:18:03.515076 2611 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34359b10-878f-4c43-9182-99889baf81b7-cluster-monitoring-operator-tls podName:34359b10-878f-4c43-9182-99889baf81b7 nodeName:}" failed. No retries permitted until 2026-06-09 15:18:04.515070097 +0000 UTC m=+205.320762297 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/34359b10-878f-4c43-9182-99889baf81b7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-bzcwf" (UID: "34359b10-878f-4c43-9182-99889baf81b7") : secret "cluster-monitoring-operator-tls" not found Jun 09 15:18:03.515148 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:18:03.515092 2611 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5-metrics-certs podName:2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5 nodeName:}" failed. No retries permitted until 2026-06-09 15:18:04.515083119 +0000 UTC m=+205.320775322 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5-metrics-certs") pod "router-default-85c449f8d5-nz5ns" (UID: "2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5") : secret "router-metrics-certs-default" not found Jun 09 15:18:03.616135 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:03.616104 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b0379b61-8878-47c5-8ccd-e73c7a859bef-registry-tls\") pod \"image-registry-6f98c4fd9-72cfs\" (UID: \"b0379b61-8878-47c5-8ccd-e73c7a859bef\") " pod="openshift-image-registry/image-registry-6f98c4fd9-72cfs" Jun 09 15:18:03.616333 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:18:03.616288 2611 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 15:18:03.616333 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:18:03.616309 2611 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f98c4fd9-72cfs: secret "image-registry-tls" not found Jun 09 15:18:03.616401 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:18:03.616377 2611 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b0379b61-8878-47c5-8ccd-e73c7a859bef-registry-tls podName:b0379b61-8878-47c5-8ccd-e73c7a859bef nodeName:}" failed. No retries permitted until 2026-06-09 15:18:04.616356399 +0000 UTC m=+205.422048599 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b0379b61-8878-47c5-8ccd-e73c7a859bef-registry-tls") pod "image-registry-6f98c4fd9-72cfs" (UID: "b0379b61-8878-47c5-8ccd-e73c7a859bef") : secret "image-registry-tls" not found Jun 09 15:18:04.343292 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:04.343205 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-kzxcz" event={"ID":"c5f897b6-d89e-42d5-8839-c44fe76224d5","Type":"ContainerStarted","Data":"c37ae8a41e05bef12abb700f640174fba2db25c72c40fc2bd55c7a24c27a0e15"} Jun 09 15:18:04.345289 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:04.345261 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-9b4t9" event={"ID":"7a9cdcf8-af9d-474c-9f46-4099925e11fc","Type":"ContainerStarted","Data":"008ecbfaf89d84b431cd0bdac743fbb8aa5b0fe9e023a13d1361f996d32dae68"} Jun 09 15:18:04.348599 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:04.348575 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-9xrjx" event={"ID":"89d039e4-83e1-4441-a3f1-b22bc7c4ed18","Type":"ContainerStarted","Data":"e61dfc02e5044602c855b819e50eb35a8d984e5fef232801ad357ff5432bca9e"} Jun 09 15:18:04.350743 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:04.350712 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-pjtxf" event={"ID":"bc96cce3-fc15-408b-8d4c-a77efa86e343","Type":"ContainerStarted","Data":"6fc129f388b0df96f75432d6f58557eba5efee544a24ff91e61444539bfe3af0"} Jun 09 15:18:04.371978 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:04.371853 2611 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-pjtxf" podStartSLOduration=2.371831582 podStartE2EDuration="2.371831582s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:18:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:18:04.36989563 +0000 UTC m=+205.175587852" watchObservedRunningTime="2026-06-09 15:18:04.371831582 +0000 UTC m=+205.177523802" Jun 09 15:18:04.525408 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:04.525370 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5-service-ca-bundle\") pod \"router-default-85c449f8d5-nz5ns\" (UID: \"2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5\") " pod="openshift-ingress/router-default-85c449f8d5-nz5ns" Jun 09 15:18:04.525408 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:04.525421 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/34359b10-878f-4c43-9182-99889baf81b7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-bzcwf\" (UID: \"34359b10-878f-4c43-9182-99889baf81b7\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-bzcwf" Jun 09 15:18:04.525626 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:04.525470 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5-metrics-certs\") pod \"router-default-85c449f8d5-nz5ns\" (UID: \"2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5\") " pod="openshift-ingress/router-default-85c449f8d5-nz5ns" Jun 09 15:18:04.525626 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:18:04.525556 2611 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5-service-ca-bundle podName:2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5 nodeName:}" failed. No retries permitted until 2026-06-09 15:18:06.525534748 +0000 UTC m=+207.331226950 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5-service-ca-bundle") pod "router-default-85c449f8d5-nz5ns" (UID: "2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5") : configmap references non-existent config key: service-ca.crt Jun 09 15:18:04.525626 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:18:04.525574 2611 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 09 15:18:04.525626 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:18:04.525590 2611 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 15:18:04.525626 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:18:04.525625 2611 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5-metrics-certs podName:2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5 nodeName:}" failed. No retries permitted until 2026-06-09 15:18:06.525609981 +0000 UTC m=+207.331302178 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5-metrics-certs") pod "router-default-85c449f8d5-nz5ns" (UID: "2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5") : secret "router-metrics-certs-default" not found Jun 09 15:18:04.525783 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:18:04.525641 2611 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34359b10-878f-4c43-9182-99889baf81b7-cluster-monitoring-operator-tls podName:34359b10-878f-4c43-9182-99889baf81b7 nodeName:}" failed. No retries permitted until 2026-06-09 15:18:06.525634866 +0000 UTC m=+207.331327062 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/34359b10-878f-4c43-9182-99889baf81b7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-bzcwf" (UID: "34359b10-878f-4c43-9182-99889baf81b7") : secret "cluster-monitoring-operator-tls" not found Jun 09 15:18:04.626287 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:04.626147 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b0379b61-8878-47c5-8ccd-e73c7a859bef-registry-tls\") pod \"image-registry-6f98c4fd9-72cfs\" (UID: \"b0379b61-8878-47c5-8ccd-e73c7a859bef\") " pod="openshift-image-registry/image-registry-6f98c4fd9-72cfs" Jun 09 15:18:04.626457 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:18:04.626299 2611 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 15:18:04.626457 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:18:04.626323 2611 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f98c4fd9-72cfs: secret "image-registry-tls" not found Jun 09 15:18:04.626457 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:18:04.626384 2611 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b0379b61-8878-47c5-8ccd-e73c7a859bef-registry-tls podName:b0379b61-8878-47c5-8ccd-e73c7a859bef nodeName:}" failed. No retries permitted until 2026-06-09 15:18:06.626368746 +0000 UTC m=+207.432060943 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b0379b61-8878-47c5-8ccd-e73c7a859bef-registry-tls") pod "image-registry-6f98c4fd9-72cfs" (UID: "b0379b61-8878-47c5-8ccd-e73c7a859bef") : secret "image-registry-tls" not found Jun 09 15:18:06.544673 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:06.544638 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5-metrics-certs\") pod \"router-default-85c449f8d5-nz5ns\" (UID: \"2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5\") " pod="openshift-ingress/router-default-85c449f8d5-nz5ns" Jun 09 15:18:06.545078 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:06.544704 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5-service-ca-bundle\") pod \"router-default-85c449f8d5-nz5ns\" (UID: \"2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5\") " pod="openshift-ingress/router-default-85c449f8d5-nz5ns" Jun 09 15:18:06.545078 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:06.544734 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/34359b10-878f-4c43-9182-99889baf81b7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-bzcwf\" (UID: \"34359b10-878f-4c43-9182-99889baf81b7\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-bzcwf" Jun 09 15:18:06.545078 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:18:06.544816 2611 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 15:18:06.545078 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:18:06.544821 2611 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 09 15:18:06.545078 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:18:06.544815 2611 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5-service-ca-bundle podName:2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5 nodeName:}" failed. No retries permitted until 2026-06-09 15:18:10.54479412 +0000 UTC m=+211.350486317 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5-service-ca-bundle") pod "router-default-85c449f8d5-nz5ns" (UID: "2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5") : configmap references non-existent config key: service-ca.crt Jun 09 15:18:06.545078 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:18:06.544896 2611 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34359b10-878f-4c43-9182-99889baf81b7-cluster-monitoring-operator-tls podName:34359b10-878f-4c43-9182-99889baf81b7 nodeName:}" failed. No retries permitted until 2026-06-09 15:18:10.544850959 +0000 UTC m=+211.350543156 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/34359b10-878f-4c43-9182-99889baf81b7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-bzcwf" (UID: "34359b10-878f-4c43-9182-99889baf81b7") : secret "cluster-monitoring-operator-tls" not found Jun 09 15:18:06.545078 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:18:06.544926 2611 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5-metrics-certs podName:2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5 nodeName:}" failed. No retries permitted until 2026-06-09 15:18:10.54490706 +0000 UTC m=+211.350599262 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5-metrics-certs") pod "router-default-85c449f8d5-nz5ns" (UID: "2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5") : secret "router-metrics-certs-default" not found Jun 09 15:18:06.646219 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:06.646178 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b0379b61-8878-47c5-8ccd-e73c7a859bef-registry-tls\") pod \"image-registry-6f98c4fd9-72cfs\" (UID: \"b0379b61-8878-47c5-8ccd-e73c7a859bef\") " pod="openshift-image-registry/image-registry-6f98c4fd9-72cfs" Jun 09 15:18:06.646401 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:18:06.646374 2611 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 15:18:06.646401 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:18:06.646401 2611 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f98c4fd9-72cfs: secret "image-registry-tls" not found Jun 09 15:18:06.646505 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:18:06.646472 2611 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b0379b61-8878-47c5-8ccd-e73c7a859bef-registry-tls podName:b0379b61-8878-47c5-8ccd-e73c7a859bef nodeName:}" failed. No retries permitted until 2026-06-09 15:18:10.646450677 +0000 UTC m=+211.452142880 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b0379b61-8878-47c5-8ccd-e73c7a859bef-registry-tls") pod "image-registry-6f98c4fd9-72cfs" (UID: "b0379b61-8878-47c5-8ccd-e73c7a859bef") : secret "image-registry-tls" not found Jun 09 15:18:07.363423 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:07.363343 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-9b4t9_7a9cdcf8-af9d-474c-9f46-4099925e11fc/console-operator/0.log" Jun 09 15:18:07.363423 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:07.363392 2611 generic.go:356] "Generic (PLEG): container finished" podID="7a9cdcf8-af9d-474c-9f46-4099925e11fc" containerID="8d2791a61cbebcb65b49f7639fb7a418c56a45dfab1bcf13e88fcaa4937d48c4" exitCode=255 Jun 09 15:18:07.363645 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:07.363489 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-9b4t9" event={"ID":"7a9cdcf8-af9d-474c-9f46-4099925e11fc","Type":"ContainerDied","Data":"8d2791a61cbebcb65b49f7639fb7a418c56a45dfab1bcf13e88fcaa4937d48c4"} Jun 09 15:18:07.363937 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:07.363916 2611 scope.go:117] "RemoveContainer" containerID="8d2791a61cbebcb65b49f7639fb7a418c56a45dfab1bcf13e88fcaa4937d48c4" Jun 09 15:18:07.365189 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:07.365128 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-9xrjx" event={"ID":"89d039e4-83e1-4441-a3f1-b22bc7c4ed18","Type":"ContainerStarted","Data":"01b9036f9d29dfd73f7bf8e88933bf5e905432338f84b44da0f0fbe9a3360cfb"} Jun 09 15:18:07.366731 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:07.366706 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-kzxcz" event={"ID":"c5f897b6-d89e-42d5-8839-c44fe76224d5","Type":"ContainerStarted","Data":"d0f64e0ee613bfb8acff3faf4774cc0500ef0cd6cc93b40c84f43073e2457617"} Jun 09 15:18:07.405416 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:07.405372 2611 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-kzxcz" podStartSLOduration=1.702479957 podStartE2EDuration="5.405354616s" totalImagesPullingTime="3.702874659s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:18:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:18:07.404669344 +0000 UTC m=+208.210361578" watchObservedRunningTime="2026-06-09 15:18:07.405354616 +0000 UTC m=+208.211046835" Jun 09 15:18:08.371720 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:08.371646 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-9b4t9_7a9cdcf8-af9d-474c-9f46-4099925e11fc/console-operator/1.log" Jun 09 15:18:08.372127 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:08.372093 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-9b4t9_7a9cdcf8-af9d-474c-9f46-4099925e11fc/console-operator/0.log" Jun 09 15:18:08.372203 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:08.372130 2611 generic.go:356] "Generic (PLEG): container finished" podID="7a9cdcf8-af9d-474c-9f46-4099925e11fc" containerID="1fb3c948cfa1e4f0b8bdc9498f03e94eff6930bb6130145fbb6edbd4463455e7" exitCode=255 Jun 09 15:18:08.372269 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:08.372239 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-9b4t9" event={"ID":"7a9cdcf8-af9d-474c-9f46-4099925e11fc","Type":"ContainerDied","Data":"1fb3c948cfa1e4f0b8bdc9498f03e94eff6930bb6130145fbb6edbd4463455e7"} Jun 09 15:18:08.372323 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:08.372313 2611 scope.go:117] "RemoveContainer" containerID="8d2791a61cbebcb65b49f7639fb7a418c56a45dfab1bcf13e88fcaa4937d48c4" Jun 09 15:18:08.372577 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:08.372553 2611 scope.go:117] "RemoveContainer" containerID="1fb3c948cfa1e4f0b8bdc9498f03e94eff6930bb6130145fbb6edbd4463455e7" Jun 09 15:18:08.372754 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:18:08.372734 2611 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-9b4t9_openshift-console-operator(7a9cdcf8-af9d-474c-9f46-4099925e11fc)\"" pod="openshift-console-operator/console-operator-668fdbf85c-9b4t9" podUID="7a9cdcf8-af9d-474c-9f46-4099925e11fc" Jun 09 15:18:08.394968 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:08.394917 2611 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-9xrjx" podStartSLOduration=2.63399891 podStartE2EDuration="6.394899595s" totalImagesPullingTime="3.760900685s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:18:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:18:07.42442064 +0000 UTC m=+208.230112860" watchObservedRunningTime="2026-06-09 15:18:08.394899595 +0000 UTC m=+209.200591792" Jun 09 15:18:08.503604 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:08.503576 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-q9x7l_c9ad8e96-7211-48f9-be18-365a42d1a24f/dns-node-resolver/0.log" Jun 09 15:18:09.376949 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:09.376916 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-9b4t9_7a9cdcf8-af9d-474c-9f46-4099925e11fc/console-operator/1.log" Jun 09 15:18:09.377362 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:09.377262 2611 scope.go:117] "RemoveContainer" containerID="1fb3c948cfa1e4f0b8bdc9498f03e94eff6930bb6130145fbb6edbd4463455e7" Jun 09 15:18:09.377425 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:18:09.377406 2611 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-9b4t9_openshift-console-operator(7a9cdcf8-af9d-474c-9f46-4099925e11fc)\"" pod="openshift-console-operator/console-operator-668fdbf85c-9b4t9" podUID="7a9cdcf8-af9d-474c-9f46-4099925e11fc" Jun 09 15:18:09.894285 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:09.894255 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zv9fh_42130943-9472-4e99-901d-84460ecdc92e/node-ca/0.log" Jun 09 15:18:10.293961 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:10.293932 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5wxnd_e3fbb074-05b5-48f8-b2cc-e1aaa57723c4/serve-healthcheck-canary/0.log" Jun 09 15:18:10.576864 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:10.576769 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5-service-ca-bundle\") pod \"router-default-85c449f8d5-nz5ns\" (UID: \"2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5\") " pod="openshift-ingress/router-default-85c449f8d5-nz5ns" Jun 09 15:18:10.576864 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:10.576818 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/34359b10-878f-4c43-9182-99889baf81b7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-bzcwf\" (UID: \"34359b10-878f-4c43-9182-99889baf81b7\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-bzcwf" Jun 09 15:18:10.576864 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:10.576860 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5-metrics-certs\") pod \"router-default-85c449f8d5-nz5ns\" (UID: \"2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5\") " pod="openshift-ingress/router-default-85c449f8d5-nz5ns" Jun 09 15:18:10.577332 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:18:10.576954 2611 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5-service-ca-bundle podName:2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5 nodeName:}" failed. No retries permitted until 2026-06-09 15:18:18.576930727 +0000 UTC m=+219.382622928 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5-service-ca-bundle") pod "router-default-85c449f8d5-nz5ns" (UID: "2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5") : configmap references non-existent config key: service-ca.crt Jun 09 15:18:10.577332 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:18:10.576959 2611 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 09 15:18:10.577332 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:18:10.576983 2611 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 15:18:10.577332 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:18:10.577007 2611 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5-metrics-certs podName:2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5 nodeName:}" failed. No retries permitted until 2026-06-09 15:18:18.576994839 +0000 UTC m=+219.382687058 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5-metrics-certs") pod "router-default-85c449f8d5-nz5ns" (UID: "2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5") : secret "router-metrics-certs-default" not found Jun 09 15:18:10.577332 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:18:10.577025 2611 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34359b10-878f-4c43-9182-99889baf81b7-cluster-monitoring-operator-tls podName:34359b10-878f-4c43-9182-99889baf81b7 nodeName:}" failed. No retries permitted until 2026-06-09 15:18:18.577013218 +0000 UTC m=+219.382705426 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/34359b10-878f-4c43-9182-99889baf81b7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-bzcwf" (UID: "34359b10-878f-4c43-9182-99889baf81b7") : secret "cluster-monitoring-operator-tls" not found Jun 09 15:18:10.677790 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:10.677754 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b0379b61-8878-47c5-8ccd-e73c7a859bef-registry-tls\") pod \"image-registry-6f98c4fd9-72cfs\" (UID: \"b0379b61-8878-47c5-8ccd-e73c7a859bef\") " pod="openshift-image-registry/image-registry-6f98c4fd9-72cfs" Jun 09 15:18:10.677935 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:18:10.677911 2611 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 15:18:10.677973 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:18:10.677938 2611 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f98c4fd9-72cfs: secret "image-registry-tls" not found Jun 09 15:18:10.678010 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:18:10.677996 2611 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b0379b61-8878-47c5-8ccd-e73c7a859bef-registry-tls podName:b0379b61-8878-47c5-8ccd-e73c7a859bef nodeName:}" failed. No retries permitted until 2026-06-09 15:18:18.677978421 +0000 UTC m=+219.483670619 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b0379b61-8878-47c5-8ccd-e73c7a859bef-registry-tls") pod "image-registry-6f98c4fd9-72cfs" (UID: "b0379b61-8878-47c5-8ccd-e73c7a859bef") : secret "image-registry-tls" not found Jun 09 15:18:13.203007 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:13.202962 2611 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-9b4t9" Jun 09 15:18:13.203435 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:13.203029 2611 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-9b4t9" Jun 09 15:18:13.203435 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:13.203354 2611 scope.go:117] "RemoveContainer" containerID="1fb3c948cfa1e4f0b8bdc9498f03e94eff6930bb6130145fbb6edbd4463455e7" Jun 09 15:18:13.203519 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:18:13.203499 2611 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-9b4t9_openshift-console-operator(7a9cdcf8-af9d-474c-9f46-4099925e11fc)\"" pod="openshift-console-operator/console-operator-668fdbf85c-9b4t9" podUID="7a9cdcf8-af9d-474c-9f46-4099925e11fc" Jun 09 15:18:18.647747 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:18.647687 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5-metrics-certs\") pod \"router-default-85c449f8d5-nz5ns\" (UID: \"2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5\") " pod="openshift-ingress/router-default-85c449f8d5-nz5ns" Jun 09 15:18:18.648185 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:18.647794 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5-service-ca-bundle\") pod \"router-default-85c449f8d5-nz5ns\" (UID: \"2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5\") " pod="openshift-ingress/router-default-85c449f8d5-nz5ns" Jun 09 15:18:18.648185 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:18.647826 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/34359b10-878f-4c43-9182-99889baf81b7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-bzcwf\" (UID: \"34359b10-878f-4c43-9182-99889baf81b7\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-bzcwf" Jun 09 15:18:18.648185 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:18:18.647842 2611 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 09 15:18:18.648185 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:18:18.647913 2611 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5-metrics-certs podName:2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5 nodeName:}" failed. No retries permitted until 2026-06-09 15:18:34.647897111 +0000 UTC m=+235.453589311 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5-metrics-certs") pod "router-default-85c449f8d5-nz5ns" (UID: "2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5") : secret "router-metrics-certs-default" not found Jun 09 15:18:18.648185 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:18:18.647946 2611 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 15:18:18.648185 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:18:18.647969 2611 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5-service-ca-bundle podName:2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5 nodeName:}" failed. No retries permitted until 2026-06-09 15:18:34.647951346 +0000 UTC m=+235.453643552 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5-service-ca-bundle") pod "router-default-85c449f8d5-nz5ns" (UID: "2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5") : configmap references non-existent config key: service-ca.crt Jun 09 15:18:18.648185 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:18:18.647997 2611 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34359b10-878f-4c43-9182-99889baf81b7-cluster-monitoring-operator-tls podName:34359b10-878f-4c43-9182-99889baf81b7 nodeName:}" failed. No retries permitted until 2026-06-09 15:18:34.647983766 +0000 UTC m=+235.453675966 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/34359b10-878f-4c43-9182-99889baf81b7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-bzcwf" (UID: "34359b10-878f-4c43-9182-99889baf81b7") : secret "cluster-monitoring-operator-tls" not found Jun 09 15:18:18.749244 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:18.749206 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b0379b61-8878-47c5-8ccd-e73c7a859bef-registry-tls\") pod \"image-registry-6f98c4fd9-72cfs\" (UID: \"b0379b61-8878-47c5-8ccd-e73c7a859bef\") " pod="openshift-image-registry/image-registry-6f98c4fd9-72cfs" Jun 09 15:18:18.751747 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:18.751717 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b0379b61-8878-47c5-8ccd-e73c7a859bef-registry-tls\") pod \"image-registry-6f98c4fd9-72cfs\" (UID: \"b0379b61-8878-47c5-8ccd-e73c7a859bef\") " pod="openshift-image-registry/image-registry-6f98c4fd9-72cfs" Jun 09 15:18:18.811693 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:18.811655 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f98c4fd9-72cfs" Jun 09 15:18:18.944626 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:18.944592 2611 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6f98c4fd9-72cfs"] Jun 09 15:18:18.947559 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:18:18.947528 2611 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0379b61_8878_47c5_8ccd_e73c7a859bef.slice/crio-a4089059f4b2c510bd6479664bcb80c0a824c3bb7e56476c3e1f9e124a0540ef WatchSource:0}: Error finding container a4089059f4b2c510bd6479664bcb80c0a824c3bb7e56476c3e1f9e124a0540ef: Status 404 returned error can't find the container with id a4089059f4b2c510bd6479664bcb80c0a824c3bb7e56476c3e1f9e124a0540ef Jun 09 15:18:19.406998 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:19.406906 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6f98c4fd9-72cfs" event={"ID":"b0379b61-8878-47c5-8ccd-e73c7a859bef","Type":"ContainerStarted","Data":"5c44ac663301ec0a8462f2507f67730482758f88a997a96b92706820793477e9"} Jun 09 15:18:19.406998 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:19.406959 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6f98c4fd9-72cfs" event={"ID":"b0379b61-8878-47c5-8ccd-e73c7a859bef","Type":"ContainerStarted","Data":"a4089059f4b2c510bd6479664bcb80c0a824c3bb7e56476c3e1f9e124a0540ef"} Jun 09 15:18:19.407266 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:19.407019 2611 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6f98c4fd9-72cfs" Jun 09 15:18:19.430882 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:19.430827 2611 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6f98c4fd9-72cfs" podStartSLOduration=17.430802587 podStartE2EDuration="17.430802587s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:18:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:18:19.430003178 +0000 UTC m=+220.235695399" watchObservedRunningTime="2026-06-09 15:18:19.430802587 +0000 UTC m=+220.236494806" Jun 09 15:18:27.626833 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:27.626793 2611 scope.go:117] "RemoveContainer" containerID="1fb3c948cfa1e4f0b8bdc9498f03e94eff6930bb6130145fbb6edbd4463455e7" Jun 09 15:18:28.438332 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:28.438300 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-9b4t9_7a9cdcf8-af9d-474c-9f46-4099925e11fc/console-operator/1.log" Jun 09 15:18:28.438535 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:28.438413 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-9b4t9" event={"ID":"7a9cdcf8-af9d-474c-9f46-4099925e11fc","Type":"ContainerStarted","Data":"4cbe71520c0d36e41e8b0708507cc3d426e97bf86b65792b0cc7ae6945ff777f"} Jun 09 15:18:28.438796 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:28.438769 2611 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-9b4t9" Jun 09 15:18:28.443831 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:28.443803 2611 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-668fdbf85c-9b4t9" Jun 09 15:18:28.473432 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:28.473377 2611 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-668fdbf85c-9b4t9" podStartSLOduration=22.741819231 podStartE2EDuration="26.473362372s" totalImagesPullingTime="3.731543141s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:18:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:18:28.472246015 +0000 UTC m=+229.277938235" watchObservedRunningTime="2026-06-09 15:18:28.473362372 +0000 UTC m=+229.279054590" Jun 09 15:18:32.956465 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:32.956435 2611 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6657875f97-tsgfx"] Jun 09 15:18:32.959639 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:32.959612 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-tsgfx" Jun 09 15:18:32.962204 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:32.962185 2611 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-mzv4k\"" Jun 09 15:18:32.962481 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:32.962464 2611 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 09 15:18:32.962886 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:32.962871 2611 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 09 15:18:32.966631 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:32.966612 2611 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6f98c4fd9-72cfs"] Jun 09 15:18:32.978968 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:32.978944 2611 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-tsgfx"] Jun 09 15:18:33.069727 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:33.069694 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szq8h\" (UniqueName: \"kubernetes.io/projected/59784453-eef7-4fe9-9e6a-426d89aa1361-kube-api-access-szq8h\") pod \"downloads-6657875f97-tsgfx\" (UID: \"59784453-eef7-4fe9-9e6a-426d89aa1361\") " pod="openshift-console/downloads-6657875f97-tsgfx" Jun 09 15:18:33.077886 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:33.077852 2611 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-r8ftb"] Jun 09 15:18:33.080906 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:33.080891 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-r8ftb" Jun 09 15:18:33.084258 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:33.084237 2611 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 09 15:18:33.087430 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:33.087410 2611 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 09 15:18:33.087716 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:33.087695 2611 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-dlqlf\"" Jun 09 15:18:33.087815 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:33.087777 2611 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 09 15:18:33.087815 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:33.087796 2611 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 09 15:18:33.108949 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:33.108917 2611 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-r8ftb"] Jun 09 15:18:33.170221 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:33.170184 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szq8h\" (UniqueName: \"kubernetes.io/projected/59784453-eef7-4fe9-9e6a-426d89aa1361-kube-api-access-szq8h\") pod \"downloads-6657875f97-tsgfx\" (UID: \"59784453-eef7-4fe9-9e6a-426d89aa1361\") " pod="openshift-console/downloads-6657875f97-tsgfx" Jun 09 15:18:33.181022 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:33.180996 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-szq8h\" (UniqueName: \"kubernetes.io/projected/59784453-eef7-4fe9-9e6a-426d89aa1361-kube-api-access-szq8h\") pod \"downloads-6657875f97-tsgfx\" (UID: \"59784453-eef7-4fe9-9e6a-426d89aa1361\") " pod="openshift-console/downloads-6657875f97-tsgfx" Jun 09 15:18:33.270357 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:33.270264 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-tsgfx" Jun 09 15:18:33.270551 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:33.270528 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cdf77a37-2bb2-40bb-8006-02e540cc2692-crio-socket\") pod \"insights-runtime-extractor-r8ftb\" (UID: \"cdf77a37-2bb2-40bb-8006-02e540cc2692\") " pod="openshift-insights/insights-runtime-extractor-r8ftb" Jun 09 15:18:33.270607 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:33.270591 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdm4g\" (UniqueName: \"kubernetes.io/projected/cdf77a37-2bb2-40bb-8006-02e540cc2692-kube-api-access-mdm4g\") pod \"insights-runtime-extractor-r8ftb\" (UID: \"cdf77a37-2bb2-40bb-8006-02e540cc2692\") " pod="openshift-insights/insights-runtime-extractor-r8ftb" Jun 09 15:18:33.270659 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:33.270642 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cdf77a37-2bb2-40bb-8006-02e540cc2692-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r8ftb\" (UID: \"cdf77a37-2bb2-40bb-8006-02e540cc2692\") " pod="openshift-insights/insights-runtime-extractor-r8ftb" Jun 09 15:18:33.270719 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:33.270706 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cdf77a37-2bb2-40bb-8006-02e540cc2692-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r8ftb\" (UID: \"cdf77a37-2bb2-40bb-8006-02e540cc2692\") " pod="openshift-insights/insights-runtime-extractor-r8ftb" Jun 09 15:18:33.270781 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:33.270768 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cdf77a37-2bb2-40bb-8006-02e540cc2692-data-volume\") pod \"insights-runtime-extractor-r8ftb\" (UID: \"cdf77a37-2bb2-40bb-8006-02e540cc2692\") " pod="openshift-insights/insights-runtime-extractor-r8ftb" Jun 09 15:18:33.371478 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:33.371443 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cdf77a37-2bb2-40bb-8006-02e540cc2692-data-volume\") pod \"insights-runtime-extractor-r8ftb\" (UID: \"cdf77a37-2bb2-40bb-8006-02e540cc2692\") " pod="openshift-insights/insights-runtime-extractor-r8ftb" Jun 09 15:18:33.371636 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:33.371510 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cdf77a37-2bb2-40bb-8006-02e540cc2692-crio-socket\") pod \"insights-runtime-extractor-r8ftb\" (UID: \"cdf77a37-2bb2-40bb-8006-02e540cc2692\") " pod="openshift-insights/insights-runtime-extractor-r8ftb" Jun 09 15:18:33.371636 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:33.371564 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdm4g\" (UniqueName: \"kubernetes.io/projected/cdf77a37-2bb2-40bb-8006-02e540cc2692-kube-api-access-mdm4g\") pod \"insights-runtime-extractor-r8ftb\" (UID: \"cdf77a37-2bb2-40bb-8006-02e540cc2692\") " pod="openshift-insights/insights-runtime-extractor-r8ftb" Jun 09 15:18:33.371636 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:33.371594 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cdf77a37-2bb2-40bb-8006-02e540cc2692-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r8ftb\" (UID: \"cdf77a37-2bb2-40bb-8006-02e540cc2692\") " pod="openshift-insights/insights-runtime-extractor-r8ftb" Jun 09 15:18:33.371822 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:33.371665 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cdf77a37-2bb2-40bb-8006-02e540cc2692-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r8ftb\" (UID: \"cdf77a37-2bb2-40bb-8006-02e540cc2692\") " pod="openshift-insights/insights-runtime-extractor-r8ftb" Jun 09 15:18:33.371822 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:33.371679 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cdf77a37-2bb2-40bb-8006-02e540cc2692-crio-socket\") pod \"insights-runtime-extractor-r8ftb\" (UID: \"cdf77a37-2bb2-40bb-8006-02e540cc2692\") " pod="openshift-insights/insights-runtime-extractor-r8ftb" Jun 09 15:18:33.371923 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:33.371847 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cdf77a37-2bb2-40bb-8006-02e540cc2692-data-volume\") pod \"insights-runtime-extractor-r8ftb\" (UID: \"cdf77a37-2bb2-40bb-8006-02e540cc2692\") " pod="openshift-insights/insights-runtime-extractor-r8ftb" Jun 09 15:18:33.372208 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:33.372187 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cdf77a37-2bb2-40bb-8006-02e540cc2692-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r8ftb\" (UID: \"cdf77a37-2bb2-40bb-8006-02e540cc2692\") " pod="openshift-insights/insights-runtime-extractor-r8ftb" Jun 09 15:18:33.374235 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:33.374213 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cdf77a37-2bb2-40bb-8006-02e540cc2692-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r8ftb\" (UID: \"cdf77a37-2bb2-40bb-8006-02e540cc2692\") " pod="openshift-insights/insights-runtime-extractor-r8ftb" Jun 09 15:18:33.385842 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:33.385815 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdm4g\" (UniqueName: \"kubernetes.io/projected/cdf77a37-2bb2-40bb-8006-02e540cc2692-kube-api-access-mdm4g\") pod \"insights-runtime-extractor-r8ftb\" (UID: \"cdf77a37-2bb2-40bb-8006-02e540cc2692\") " pod="openshift-insights/insights-runtime-extractor-r8ftb" Jun 09 15:18:33.389758 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:33.389737 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-r8ftb" Jun 09 15:18:33.404585 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:33.404558 2611 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-tsgfx"] Jun 09 15:18:33.406911 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:18:33.406882 2611 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59784453_eef7_4fe9_9e6a_426d89aa1361.slice/crio-9f205ef27fd6e2e6b9cbf413106be828164569b3196e7fba78bf17c3521c698a WatchSource:0}: Error finding container 9f205ef27fd6e2e6b9cbf413106be828164569b3196e7fba78bf17c3521c698a: Status 404 returned error can't find the container with id 9f205ef27fd6e2e6b9cbf413106be828164569b3196e7fba78bf17c3521c698a Jun 09 15:18:33.457282 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:33.457246 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-tsgfx" event={"ID":"59784453-eef7-4fe9-9e6a-426d89aa1361","Type":"ContainerStarted","Data":"9f205ef27fd6e2e6b9cbf413106be828164569b3196e7fba78bf17c3521c698a"} Jun 09 15:18:33.521588 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:33.521558 2611 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-r8ftb"] Jun 09 15:18:34.462612 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:34.462523 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-r8ftb" event={"ID":"cdf77a37-2bb2-40bb-8006-02e540cc2692","Type":"ContainerStarted","Data":"bb9f262366ae2ab994cc730dcc69a4f8616b5d47d439738bb6f08abd3931b512"} Jun 09 15:18:34.462612 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:34.462586 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-r8ftb" event={"ID":"cdf77a37-2bb2-40bb-8006-02e540cc2692","Type":"ContainerStarted","Data":"c7c773d4f25b8e0b96e0e1558d7d4534111f4663d3e7fb05aee99856d0eb35a1"} Jun 09 15:18:34.463031 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:34.462615 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-r8ftb" event={"ID":"cdf77a37-2bb2-40bb-8006-02e540cc2692","Type":"ContainerStarted","Data":"7b32927e7c986abc48e6efb8dcd60399d4d38ed1eeaa81d8162a60e2dfdfd367"} Jun 09 15:18:34.683872 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:34.683836 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5-metrics-certs\") pod \"router-default-85c449f8d5-nz5ns\" (UID: \"2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5\") " pod="openshift-ingress/router-default-85c449f8d5-nz5ns" Jun 09 15:18:34.684060 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:34.683939 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5-service-ca-bundle\") pod \"router-default-85c449f8d5-nz5ns\" (UID: \"2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5\") " pod="openshift-ingress/router-default-85c449f8d5-nz5ns" Jun 09 15:18:34.684060 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:34.683970 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/34359b10-878f-4c43-9182-99889baf81b7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-bzcwf\" (UID: \"34359b10-878f-4c43-9182-99889baf81b7\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-bzcwf" Jun 09 15:18:34.684717 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:34.684690 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5-service-ca-bundle\") pod \"router-default-85c449f8d5-nz5ns\" (UID: \"2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5\") " pod="openshift-ingress/router-default-85c449f8d5-nz5ns" Jun 09 15:18:34.686458 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:34.686436 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5-metrics-certs\") pod \"router-default-85c449f8d5-nz5ns\" (UID: \"2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5\") " pod="openshift-ingress/router-default-85c449f8d5-nz5ns" Jun 09 15:18:34.686554 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:34.686462 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/34359b10-878f-4c43-9182-99889baf81b7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-bzcwf\" (UID: \"34359b10-878f-4c43-9182-99889baf81b7\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-bzcwf" Jun 09 15:18:34.905287 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:34.905139 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-85c449f8d5-nz5ns" Jun 09 15:18:34.918223 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:34.918192 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-bzcwf" Jun 09 15:18:35.070358 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:35.070196 2611 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-85c449f8d5-nz5ns"] Jun 09 15:18:35.072777 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:18:35.072754 2611 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f0c6125_dc36_4ca0_ae84_3b0c9b133fb5.slice/crio-ae93ce8cf3a83bed050c4ffd7384951df9f08093049b26dc9e0f014846f2010a WatchSource:0}: Error finding container ae93ce8cf3a83bed050c4ffd7384951df9f08093049b26dc9e0f014846f2010a: Status 404 returned error can't find the container with id ae93ce8cf3a83bed050c4ffd7384951df9f08093049b26dc9e0f014846f2010a Jun 09 15:18:35.088263 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:35.088242 2611 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-bzcwf"] Jun 09 15:18:35.091526 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:18:35.091502 2611 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34359b10_878f_4c43_9182_99889baf81b7.slice/crio-8a5287ea50cff53294a68b142e57bb12be1de6823457d9482e8ac825e32a4abc WatchSource:0}: Error finding container 8a5287ea50cff53294a68b142e57bb12be1de6823457d9482e8ac825e32a4abc: Status 404 returned error can't find the container with id 8a5287ea50cff53294a68b142e57bb12be1de6823457d9482e8ac825e32a4abc Jun 09 15:18:35.468773 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:35.468727 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-85c449f8d5-nz5ns" event={"ID":"2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5","Type":"ContainerStarted","Data":"2f89276632a0c40c2ef6a25c086a160da58669a3a59bfbeff06d66c0456bd0d1"} Jun 09 15:18:35.469279 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:35.468789 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-85c449f8d5-nz5ns" event={"ID":"2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5","Type":"ContainerStarted","Data":"ae93ce8cf3a83bed050c4ffd7384951df9f08093049b26dc9e0f014846f2010a"} Jun 09 15:18:35.470000 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:35.469974 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-bzcwf" event={"ID":"34359b10-878f-4c43-9182-99889baf81b7","Type":"ContainerStarted","Data":"8a5287ea50cff53294a68b142e57bb12be1de6823457d9482e8ac825e32a4abc"} Jun 09 15:18:35.494179 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:35.494110 2611 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-85c449f8d5-nz5ns" podStartSLOduration=33.494088587 podStartE2EDuration="33.494088587s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:18:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:18:35.492830819 +0000 UTC m=+236.298523051" watchObservedRunningTime="2026-06-09 15:18:35.494088587 +0000 UTC m=+236.299780807" Jun 09 15:18:35.905663 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:35.905536 2611 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-85c449f8d5-nz5ns" Jun 09 15:18:35.908488 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:35.908457 2611 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-85c449f8d5-nz5ns" Jun 09 15:18:36.477250 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:36.477210 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-r8ftb" event={"ID":"cdf77a37-2bb2-40bb-8006-02e540cc2692","Type":"ContainerStarted","Data":"1e5614be084ac33b28ef0b269072c251f9c91e698eb05a8ef37a1fa59e496853"} Jun 09 15:18:36.477686 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:36.477540 2611 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-85c449f8d5-nz5ns" Jun 09 15:18:36.479070 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:36.479043 2611 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-85c449f8d5-nz5ns" Jun 09 15:18:36.501685 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:36.501555 2611 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-r8ftb" podStartSLOduration=0.852683623 podStartE2EDuration="3.501532482s" totalImagesPullingTime="2.648848859s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:18:33 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:18:36.499873691 +0000 UTC m=+237.305565911" watchObservedRunningTime="2026-06-09 15:18:36.501532482 +0000 UTC m=+237.307224716" Jun 09 15:18:37.494964 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:37.494862 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-bzcwf" event={"ID":"34359b10-878f-4c43-9182-99889baf81b7","Type":"ContainerStarted","Data":"3eb7ed0a9d80e3a90b52deb3c4d75e340669d378a84349d36b80383034b7494f"} Jun 09 15:18:37.518404 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:37.518344 2611 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-bzcwf" podStartSLOduration=33.609842447 podStartE2EDuration="35.518326781s" totalImagesPullingTime="1.908484334s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:18:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:18:37.516717146 +0000 UTC m=+238.322409367" watchObservedRunningTime="2026-06-09 15:18:37.518326781 +0000 UTC m=+238.324019000" Jun 09 15:18:37.917827 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:37.917749 2611 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-85f6d4689-84qgs"] Jun 09 15:18:37.921200 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:37.921175 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85f6d4689-84qgs" Jun 09 15:18:37.923654 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:37.923626 2611 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 09 15:18:37.924019 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:37.923996 2611 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 09 15:18:37.924119 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:37.924046 2611 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-9g5w9\"" Jun 09 15:18:37.924890 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:37.924657 2611 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 09 15:18:37.924890 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:37.924704 2611 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 09 15:18:37.925053 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:37.924957 2611 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 09 15:18:37.932903 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:37.932876 2611 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85f6d4689-84qgs"] Jun 09 15:18:38.014857 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:38.014811 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/adb92e20-35fa-43d9-972c-c1429343daf5-service-ca\") pod \"console-85f6d4689-84qgs\" (UID: \"adb92e20-35fa-43d9-972c-c1429343daf5\") " pod="openshift-console/console-85f6d4689-84qgs" Jun 09 15:18:38.015037 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:38.014870 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/adb92e20-35fa-43d9-972c-c1429343daf5-oauth-serving-cert\") pod \"console-85f6d4689-84qgs\" (UID: \"adb92e20-35fa-43d9-972c-c1429343daf5\") " pod="openshift-console/console-85f6d4689-84qgs" Jun 09 15:18:38.015037 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:38.014927 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9ztz\" (UniqueName: \"kubernetes.io/projected/adb92e20-35fa-43d9-972c-c1429343daf5-kube-api-access-q9ztz\") pod \"console-85f6d4689-84qgs\" (UID: \"adb92e20-35fa-43d9-972c-c1429343daf5\") " pod="openshift-console/console-85f6d4689-84qgs" Jun 09 15:18:38.015037 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:38.015025 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/adb92e20-35fa-43d9-972c-c1429343daf5-console-serving-cert\") pod \"console-85f6d4689-84qgs\" (UID: \"adb92e20-35fa-43d9-972c-c1429343daf5\") " pod="openshift-console/console-85f6d4689-84qgs" Jun 09 15:18:38.015250 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:38.015086 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/adb92e20-35fa-43d9-972c-c1429343daf5-console-oauth-config\") pod \"console-85f6d4689-84qgs\" (UID: \"adb92e20-35fa-43d9-972c-c1429343daf5\") " pod="openshift-console/console-85f6d4689-84qgs" Jun 09 15:18:38.015250 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:38.015134 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/adb92e20-35fa-43d9-972c-c1429343daf5-console-config\") pod \"console-85f6d4689-84qgs\" (UID: \"adb92e20-35fa-43d9-972c-c1429343daf5\") " pod="openshift-console/console-85f6d4689-84qgs" Jun 09 15:18:38.115867 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:38.115823 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/adb92e20-35fa-43d9-972c-c1429343daf5-service-ca\") pod \"console-85f6d4689-84qgs\" (UID: \"adb92e20-35fa-43d9-972c-c1429343daf5\") " pod="openshift-console/console-85f6d4689-84qgs" Jun 09 15:18:38.115867 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:38.115869 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/adb92e20-35fa-43d9-972c-c1429343daf5-oauth-serving-cert\") pod \"console-85f6d4689-84qgs\" (UID: \"adb92e20-35fa-43d9-972c-c1429343daf5\") " pod="openshift-console/console-85f6d4689-84qgs" Jun 09 15:18:38.116079 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:38.115890 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9ztz\" (UniqueName: \"kubernetes.io/projected/adb92e20-35fa-43d9-972c-c1429343daf5-kube-api-access-q9ztz\") pod \"console-85f6d4689-84qgs\" (UID: \"adb92e20-35fa-43d9-972c-c1429343daf5\") " pod="openshift-console/console-85f6d4689-84qgs" Jun 09 15:18:38.116079 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:38.115945 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/adb92e20-35fa-43d9-972c-c1429343daf5-console-serving-cert\") pod \"console-85f6d4689-84qgs\" (UID: \"adb92e20-35fa-43d9-972c-c1429343daf5\") " pod="openshift-console/console-85f6d4689-84qgs" Jun 09 15:18:38.116079 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:38.115988 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/adb92e20-35fa-43d9-972c-c1429343daf5-console-oauth-config\") pod \"console-85f6d4689-84qgs\" (UID: \"adb92e20-35fa-43d9-972c-c1429343daf5\") " pod="openshift-console/console-85f6d4689-84qgs" Jun 09 15:18:38.116079 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:38.116030 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/adb92e20-35fa-43d9-972c-c1429343daf5-console-config\") pod \"console-85f6d4689-84qgs\" (UID: \"adb92e20-35fa-43d9-972c-c1429343daf5\") " pod="openshift-console/console-85f6d4689-84qgs" Jun 09 15:18:38.116639 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:38.116613 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/adb92e20-35fa-43d9-972c-c1429343daf5-service-ca\") pod \"console-85f6d4689-84qgs\" (UID: \"adb92e20-35fa-43d9-972c-c1429343daf5\") " pod="openshift-console/console-85f6d4689-84qgs" Jun 09 15:18:38.116781 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:38.116757 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/adb92e20-35fa-43d9-972c-c1429343daf5-oauth-serving-cert\") pod \"console-85f6d4689-84qgs\" (UID: \"adb92e20-35fa-43d9-972c-c1429343daf5\") " pod="openshift-console/console-85f6d4689-84qgs" Jun 09 15:18:38.116849 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:38.116760 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/adb92e20-35fa-43d9-972c-c1429343daf5-console-config\") pod \"console-85f6d4689-84qgs\" (UID: \"adb92e20-35fa-43d9-972c-c1429343daf5\") " pod="openshift-console/console-85f6d4689-84qgs" Jun 09 15:18:38.118479 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:38.118459 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/adb92e20-35fa-43d9-972c-c1429343daf5-console-serving-cert\") pod \"console-85f6d4689-84qgs\" (UID: \"adb92e20-35fa-43d9-972c-c1429343daf5\") " pod="openshift-console/console-85f6d4689-84qgs" Jun 09 15:18:38.118566 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:38.118459 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/adb92e20-35fa-43d9-972c-c1429343daf5-console-oauth-config\") pod \"console-85f6d4689-84qgs\" (UID: \"adb92e20-35fa-43d9-972c-c1429343daf5\") " pod="openshift-console/console-85f6d4689-84qgs" Jun 09 15:18:38.124638 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:38.124590 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9ztz\" (UniqueName: \"kubernetes.io/projected/adb92e20-35fa-43d9-972c-c1429343daf5-kube-api-access-q9ztz\") pod \"console-85f6d4689-84qgs\" (UID: \"adb92e20-35fa-43d9-972c-c1429343daf5\") " pod="openshift-console/console-85f6d4689-84qgs" Jun 09 15:18:38.232432 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:38.232387 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85f6d4689-84qgs" Jun 09 15:18:38.378857 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:38.378828 2611 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85f6d4689-84qgs"] Jun 09 15:18:38.381566 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:18:38.381523 2611 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadb92e20_35fa_43d9_972c_c1429343daf5.slice/crio-c2269af32a2632033cf178aa5e8e2b73319b22186074cdabca8763fa4add8d78 WatchSource:0}: Error finding container c2269af32a2632033cf178aa5e8e2b73319b22186074cdabca8763fa4add8d78: Status 404 returned error can't find the container with id c2269af32a2632033cf178aa5e8e2b73319b22186074cdabca8763fa4add8d78 Jun 09 15:18:38.498771 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:38.498682 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85f6d4689-84qgs" event={"ID":"adb92e20-35fa-43d9-972c-c1429343daf5","Type":"ContainerStarted","Data":"c2269af32a2632033cf178aa5e8e2b73319b22186074cdabca8763fa4add8d78"} Jun 09 15:18:41.617317 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:41.617242 2611 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-pwkx8"] Jun 09 15:18:41.624565 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:41.624534 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-pwkx8" Jun 09 15:18:41.627624 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:41.627590 2611 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 09 15:18:41.627976 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:41.627850 2611 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-xvpt9\"" Jun 09 15:18:41.629201 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:41.628918 2611 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 09 15:18:41.629201 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:41.628987 2611 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 09 15:18:41.636890 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:41.636786 2611 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-pwkx8"] Jun 09 15:18:41.647082 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:41.647042 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/12e7cf41-621a-48a9-8e6e-10b476669bf7-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-pwkx8\" (UID: \"12e7cf41-621a-48a9-8e6e-10b476669bf7\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-pwkx8" Jun 09 15:18:41.647289 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:41.647101 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btmsq\" (UniqueName: \"kubernetes.io/projected/12e7cf41-621a-48a9-8e6e-10b476669bf7-kube-api-access-btmsq\") pod \"prometheus-operator-7f7d445d84-pwkx8\" (UID: \"12e7cf41-621a-48a9-8e6e-10b476669bf7\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-pwkx8" Jun 09 15:18:41.647289 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:41.647204 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/12e7cf41-621a-48a9-8e6e-10b476669bf7-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-pwkx8\" (UID: \"12e7cf41-621a-48a9-8e6e-10b476669bf7\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-pwkx8" Jun 09 15:18:41.647405 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:41.647311 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/12e7cf41-621a-48a9-8e6e-10b476669bf7-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-pwkx8\" (UID: \"12e7cf41-621a-48a9-8e6e-10b476669bf7\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-pwkx8" Jun 09 15:18:41.747786 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:41.747746 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/12e7cf41-621a-48a9-8e6e-10b476669bf7-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-pwkx8\" (UID: \"12e7cf41-621a-48a9-8e6e-10b476669bf7\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-pwkx8" Jun 09 15:18:41.748001 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:41.747836 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/12e7cf41-621a-48a9-8e6e-10b476669bf7-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-pwkx8\" (UID: \"12e7cf41-621a-48a9-8e6e-10b476669bf7\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-pwkx8" Jun 09 15:18:41.748001 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:41.747911 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/12e7cf41-621a-48a9-8e6e-10b476669bf7-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-pwkx8\" (UID: \"12e7cf41-621a-48a9-8e6e-10b476669bf7\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-pwkx8" Jun 09 15:18:41.748001 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:18:41.747938 2611 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jun 09 15:18:41.748178 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:41.747945 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btmsq\" (UniqueName: \"kubernetes.io/projected/12e7cf41-621a-48a9-8e6e-10b476669bf7-kube-api-access-btmsq\") pod \"prometheus-operator-7f7d445d84-pwkx8\" (UID: \"12e7cf41-621a-48a9-8e6e-10b476669bf7\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-pwkx8" Jun 09 15:18:41.748178 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:18:41.748014 2611 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12e7cf41-621a-48a9-8e6e-10b476669bf7-prometheus-operator-tls podName:12e7cf41-621a-48a9-8e6e-10b476669bf7 nodeName:}" failed. No retries permitted until 2026-06-09 15:18:42.247992676 +0000 UTC m=+243.053684878 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/12e7cf41-621a-48a9-8e6e-10b476669bf7-prometheus-operator-tls") pod "prometheus-operator-7f7d445d84-pwkx8" (UID: "12e7cf41-621a-48a9-8e6e-10b476669bf7") : secret "prometheus-operator-tls" not found Jun 09 15:18:41.748691 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:41.748665 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/12e7cf41-621a-48a9-8e6e-10b476669bf7-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-pwkx8\" (UID: \"12e7cf41-621a-48a9-8e6e-10b476669bf7\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-pwkx8" Jun 09 15:18:41.750916 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:41.750892 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/12e7cf41-621a-48a9-8e6e-10b476669bf7-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-pwkx8\" (UID: \"12e7cf41-621a-48a9-8e6e-10b476669bf7\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-pwkx8" Jun 09 15:18:41.759932 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:41.759902 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-btmsq\" (UniqueName: \"kubernetes.io/projected/12e7cf41-621a-48a9-8e6e-10b476669bf7-kube-api-access-btmsq\") pod \"prometheus-operator-7f7d445d84-pwkx8\" (UID: \"12e7cf41-621a-48a9-8e6e-10b476669bf7\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-pwkx8" Jun 09 15:18:42.253341 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:42.253248 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/12e7cf41-621a-48a9-8e6e-10b476669bf7-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-pwkx8\" (UID: \"12e7cf41-621a-48a9-8e6e-10b476669bf7\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-pwkx8" Jun 09 15:18:42.255835 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:42.255801 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/12e7cf41-621a-48a9-8e6e-10b476669bf7-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-pwkx8\" (UID: \"12e7cf41-621a-48a9-8e6e-10b476669bf7\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-pwkx8" Jun 09 15:18:42.516681 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:42.516595 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85f6d4689-84qgs" event={"ID":"adb92e20-35fa-43d9-972c-c1429343daf5","Type":"ContainerStarted","Data":"ad986a99b861fb3c11011e8f0ec8be035c218c02c61ead6d9f765232a3208d8b"} Jun 09 15:18:42.538973 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:42.538946 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-pwkx8" Jun 09 15:18:42.541509 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:42.541330 2611 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-85f6d4689-84qgs" podStartSLOduration=1.971021651 podStartE2EDuration="5.541308749s" totalImagesPullingTime="3.570287098s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:18:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:18:42.541053264 +0000 UTC m=+243.346745499" watchObservedRunningTime="2026-06-09 15:18:42.541308749 +0000 UTC m=+243.347000968" Jun 09 15:18:42.699904 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:42.699867 2611 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-pwkx8"] Jun 09 15:18:42.703313 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:18:42.703283 2611 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12e7cf41_621a_48a9_8e6e_10b476669bf7.slice/crio-61da60bd36e1155153afd20fda335de867311a198175dfb37ed98c50e4a53c26 WatchSource:0}: Error finding container 61da60bd36e1155153afd20fda335de867311a198175dfb37ed98c50e4a53c26: Status 404 returned error can't find the container with id 61da60bd36e1155153afd20fda335de867311a198175dfb37ed98c50e4a53c26 Jun 09 15:18:42.971727 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:42.971692 2611 patch_prober.go:28] interesting pod/image-registry-6f98c4fd9-72cfs container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 15:18:42.971876 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:42.971746 2611 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6f98c4fd9-72cfs" podUID="b0379b61-8878-47c5-8ccd-e73c7a859bef" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 15:18:43.521882 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:43.521831 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-pwkx8" event={"ID":"12e7cf41-621a-48a9-8e6e-10b476669bf7","Type":"ContainerStarted","Data":"61da60bd36e1155153afd20fda335de867311a198175dfb37ed98c50e4a53c26"} Jun 09 15:18:44.528323 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:44.528283 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-pwkx8" event={"ID":"12e7cf41-621a-48a9-8e6e-10b476669bf7","Type":"ContainerStarted","Data":"9df19e90e18dfb391178e7795f00f3b41adce081b7eff0ab96a7b734ac957188"} Jun 09 15:18:44.528706 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:44.528348 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-pwkx8" event={"ID":"12e7cf41-621a-48a9-8e6e-10b476669bf7","Type":"ContainerStarted","Data":"455d0265df8ed315ba25f4251009f2d3f6a845ca5e3fcd04393c7fb765ef3c70"} Jun 09 15:18:44.550623 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:44.550564 2611 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7f7d445d84-pwkx8" podStartSLOduration=2.434298928 podStartE2EDuration="3.55054442s" totalImagesPullingTime="1.116245492s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:18:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:18:44.550369966 +0000 UTC m=+245.356062212" watchObservedRunningTime="2026-06-09 15:18:44.55054442 +0000 UTC m=+245.356236640" Jun 09 15:18:46.118690 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:46.118653 2611 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-wvthr"] Jun 09 15:18:46.121206 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:46.121184 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-wvthr" Jun 09 15:18:46.124992 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:46.124967 2611 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 09 15:18:46.125325 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:46.125310 2611 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 09 15:18:46.125669 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:46.125654 2611 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-7n7hq\"" Jun 09 15:18:46.125878 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:46.125864 2611 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 09 15:18:46.146387 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:46.146353 2611 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-wvthr"] Jun 09 15:18:46.147490 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:46.147465 2611 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-q4xv9"] Jun 09 15:18:46.150070 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:46.150045 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-q4xv9" Jun 09 15:18:46.153187 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:46.153149 2611 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 09 15:18:46.153781 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:46.153755 2611 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 09 15:18:46.153892 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:46.153859 2611 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-zzjz7\"" Jun 09 15:18:46.153968 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:46.153932 2611 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 09 15:18:46.189940 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:46.189897 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/22c64d94-7b96-4095-9224-bc6c0365167e-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-wvthr\" (UID: \"22c64d94-7b96-4095-9224-bc6c0365167e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-wvthr" Jun 09 15:18:46.190127 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:46.189949 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7hwv\" (UniqueName: \"kubernetes.io/projected/22c64d94-7b96-4095-9224-bc6c0365167e-kube-api-access-x7hwv\") pod \"kube-state-metrics-57bbf8bfb5-wvthr\" (UID: \"22c64d94-7b96-4095-9224-bc6c0365167e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-wvthr" Jun 09 15:18:46.190127 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:46.190023 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e2af3552-72ed-4ef4-9424-a5f200d2a794-sys\") pod \"node-exporter-q4xv9\" (UID: \"e2af3552-72ed-4ef4-9424-a5f200d2a794\") " pod="openshift-monitoring/node-exporter-q4xv9" Jun 09 15:18:46.190127 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:46.190067 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e2af3552-72ed-4ef4-9424-a5f200d2a794-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-q4xv9\" (UID: \"e2af3552-72ed-4ef4-9424-a5f200d2a794\") " pod="openshift-monitoring/node-exporter-q4xv9" Jun 09 15:18:46.190127 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:46.190119 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e2af3552-72ed-4ef4-9424-a5f200d2a794-node-exporter-textfile\") pod \"node-exporter-q4xv9\" (UID: \"e2af3552-72ed-4ef4-9424-a5f200d2a794\") " pod="openshift-monitoring/node-exporter-q4xv9" Jun 09 15:18:46.190380 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:46.190135 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e2af3552-72ed-4ef4-9424-a5f200d2a794-node-exporter-tls\") pod \"node-exporter-q4xv9\" (UID: \"e2af3552-72ed-4ef4-9424-a5f200d2a794\") " pod="openshift-monitoring/node-exporter-q4xv9" Jun 09 15:18:46.190380 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:46.190174 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e2af3552-72ed-4ef4-9424-a5f200d2a794-node-exporter-accelerators-collector-config\") pod \"node-exporter-q4xv9\" (UID: \"e2af3552-72ed-4ef4-9424-a5f200d2a794\") " pod="openshift-monitoring/node-exporter-q4xv9" Jun 09 15:18:46.190380 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:46.190262 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-th5bd\" (UniqueName: \"kubernetes.io/projected/e2af3552-72ed-4ef4-9424-a5f200d2a794-kube-api-access-th5bd\") pod \"node-exporter-q4xv9\" (UID: \"e2af3552-72ed-4ef4-9424-a5f200d2a794\") " pod="openshift-monitoring/node-exporter-q4xv9" Jun 09 15:18:46.190380 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:46.190289 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/22c64d94-7b96-4095-9224-bc6c0365167e-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-wvthr\" (UID: \"22c64d94-7b96-4095-9224-bc6c0365167e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-wvthr" Jun 09 15:18:46.190380 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:46.190321 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e2af3552-72ed-4ef4-9424-a5f200d2a794-metrics-client-ca\") pod \"node-exporter-q4xv9\" (UID: \"e2af3552-72ed-4ef4-9424-a5f200d2a794\") " pod="openshift-monitoring/node-exporter-q4xv9" Jun 09 15:18:46.190380 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:46.190347 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/22c64d94-7b96-4095-9224-bc6c0365167e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-wvthr\" (UID: \"22c64d94-7b96-4095-9224-bc6c0365167e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-wvthr" Jun 09 15:18:46.190646 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:46.190404 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e2af3552-72ed-4ef4-9424-a5f200d2a794-node-exporter-wtmp\") pod \"node-exporter-q4xv9\" (UID: \"e2af3552-72ed-4ef4-9424-a5f200d2a794\") " pod="openshift-monitoring/node-exporter-q4xv9" Jun 09 15:18:46.190646 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:46.190443 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/22c64d94-7b96-4095-9224-bc6c0365167e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-wvthr\" (UID: \"22c64d94-7b96-4095-9224-bc6c0365167e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-wvthr" Jun 09 15:18:46.190646 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:46.190528 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/22c64d94-7b96-4095-9224-bc6c0365167e-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-wvthr\" (UID: \"22c64d94-7b96-4095-9224-bc6c0365167e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-wvthr" Jun 09 15:18:46.190646 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:46.190555 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e2af3552-72ed-4ef4-9424-a5f200d2a794-root\") pod \"node-exporter-q4xv9\" (UID: \"e2af3552-72ed-4ef4-9424-a5f200d2a794\") " pod="openshift-monitoring/node-exporter-q4xv9" Jun 09 15:18:46.291229 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:46.291194 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-th5bd\" (UniqueName: \"kubernetes.io/projected/e2af3552-72ed-4ef4-9424-a5f200d2a794-kube-api-access-th5bd\") pod \"node-exporter-q4xv9\" (UID: \"e2af3552-72ed-4ef4-9424-a5f200d2a794\") " pod="openshift-monitoring/node-exporter-q4xv9" Jun 09 15:18:46.291229 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:46.291230 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/22c64d94-7b96-4095-9224-bc6c0365167e-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-wvthr\" (UID: \"22c64d94-7b96-4095-9224-bc6c0365167e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-wvthr" Jun 09 15:18:46.291473 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:46.291249 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e2af3552-72ed-4ef4-9424-a5f200d2a794-metrics-client-ca\") pod \"node-exporter-q4xv9\" (UID: \"e2af3552-72ed-4ef4-9424-a5f200d2a794\") " pod="openshift-monitoring/node-exporter-q4xv9" Jun 09 15:18:46.291473 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:46.291268 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/22c64d94-7b96-4095-9224-bc6c0365167e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-wvthr\" (UID: \"22c64d94-7b96-4095-9224-bc6c0365167e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-wvthr" Jun 09 15:18:46.291473 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:46.291429 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e2af3552-72ed-4ef4-9424-a5f200d2a794-node-exporter-wtmp\") pod \"node-exporter-q4xv9\" (UID: \"e2af3552-72ed-4ef4-9424-a5f200d2a794\") " pod="openshift-monitoring/node-exporter-q4xv9" Jun 09 15:18:46.291633 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:46.291470 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/22c64d94-7b96-4095-9224-bc6c0365167e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-wvthr\" (UID: \"22c64d94-7b96-4095-9224-bc6c0365167e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-wvthr" Jun 09 15:18:46.291633 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:46.291532 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/22c64d94-7b96-4095-9224-bc6c0365167e-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-wvthr\" (UID: \"22c64d94-7b96-4095-9224-bc6c0365167e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-wvthr" Jun 09 15:18:46.291633 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:46.291563 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e2af3552-72ed-4ef4-9424-a5f200d2a794-root\") pod \"node-exporter-q4xv9\" (UID: \"e2af3552-72ed-4ef4-9424-a5f200d2a794\") " pod="openshift-monitoring/node-exporter-q4xv9" Jun 09 15:18:46.291633 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:46.291592 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/22c64d94-7b96-4095-9224-bc6c0365167e-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-wvthr\" (UID: \"22c64d94-7b96-4095-9224-bc6c0365167e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-wvthr" Jun 09 15:18:46.291633 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:46.291620 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7hwv\" (UniqueName: \"kubernetes.io/projected/22c64d94-7b96-4095-9224-bc6c0365167e-kube-api-access-x7hwv\") pod \"kube-state-metrics-57bbf8bfb5-wvthr\" (UID: \"22c64d94-7b96-4095-9224-bc6c0365167e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-wvthr" Jun 09 15:18:46.291867 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:46.291643 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e2af3552-72ed-4ef4-9424-a5f200d2a794-node-exporter-wtmp\") pod \"node-exporter-q4xv9\" (UID: \"e2af3552-72ed-4ef4-9424-a5f200d2a794\") " pod="openshift-monitoring/node-exporter-q4xv9" Jun 09 15:18:46.291867 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:46.291658 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e2af3552-72ed-4ef4-9424-a5f200d2a794-sys\") pod \"node-exporter-q4xv9\" (UID: \"e2af3552-72ed-4ef4-9424-a5f200d2a794\") " pod="openshift-monitoring/node-exporter-q4xv9" Jun 09 15:18:46.291867 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:46.291681 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/22c64d94-7b96-4095-9224-bc6c0365167e-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-wvthr\" (UID: \"22c64d94-7b96-4095-9224-bc6c0365167e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-wvthr" Jun 09 15:18:46.291867 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:46.291704 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e2af3552-72ed-4ef4-9424-a5f200d2a794-sys\") pod \"node-exporter-q4xv9\" (UID: \"e2af3552-72ed-4ef4-9424-a5f200d2a794\") " pod="openshift-monitoring/node-exporter-q4xv9" Jun 09 15:18:46.291867 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:46.291708 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e2af3552-72ed-4ef4-9424-a5f200d2a794-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-q4xv9\" (UID: \"e2af3552-72ed-4ef4-9424-a5f200d2a794\") " pod="openshift-monitoring/node-exporter-q4xv9" Jun 09 15:18:46.291867 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:46.291742 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e2af3552-72ed-4ef4-9424-a5f200d2a794-root\") pod \"node-exporter-q4xv9\" (UID: \"e2af3552-72ed-4ef4-9424-a5f200d2a794\") " pod="openshift-monitoring/node-exporter-q4xv9" Jun 09 15:18:46.291867 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:46.291784 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e2af3552-72ed-4ef4-9424-a5f200d2a794-node-exporter-textfile\") pod \"node-exporter-q4xv9\" (UID: \"e2af3552-72ed-4ef4-9424-a5f200d2a794\") " pod="openshift-monitoring/node-exporter-q4xv9" Jun 09 15:18:46.291867 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:46.291807 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e2af3552-72ed-4ef4-9424-a5f200d2a794-node-exporter-tls\") pod \"node-exporter-q4xv9\" (UID: \"e2af3552-72ed-4ef4-9424-a5f200d2a794\") " pod="openshift-monitoring/node-exporter-q4xv9" Jun 09 15:18:46.291867 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:46.291833 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e2af3552-72ed-4ef4-9424-a5f200d2a794-node-exporter-accelerators-collector-config\") pod \"node-exporter-q4xv9\" (UID: \"e2af3552-72ed-4ef4-9424-a5f200d2a794\") " pod="openshift-monitoring/node-exporter-q4xv9" Jun 09 15:18:46.292340 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:46.291936 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e2af3552-72ed-4ef4-9424-a5f200d2a794-metrics-client-ca\") pod \"node-exporter-q4xv9\" (UID: \"e2af3552-72ed-4ef4-9424-a5f200d2a794\") " pod="openshift-monitoring/node-exporter-q4xv9" Jun 09 15:18:46.292340 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:46.292027 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/22c64d94-7b96-4095-9224-bc6c0365167e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-wvthr\" (UID: \"22c64d94-7b96-4095-9224-bc6c0365167e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-wvthr" Jun 09 15:18:46.292340 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:46.292295 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e2af3552-72ed-4ef4-9424-a5f200d2a794-node-exporter-textfile\") pod \"node-exporter-q4xv9\" (UID: \"e2af3552-72ed-4ef4-9424-a5f200d2a794\") " pod="openshift-monitoring/node-exporter-q4xv9" Jun 09 15:18:46.292504 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:46.292335 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/22c64d94-7b96-4095-9224-bc6c0365167e-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-wvthr\" (UID: \"22c64d94-7b96-4095-9224-bc6c0365167e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-wvthr" Jun 09 15:18:46.292504 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:46.292367 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e2af3552-72ed-4ef4-9424-a5f200d2a794-node-exporter-accelerators-collector-config\") pod \"node-exporter-q4xv9\" (UID: \"e2af3552-72ed-4ef4-9424-a5f200d2a794\") " pod="openshift-monitoring/node-exporter-q4xv9" Jun 09 15:18:46.294636 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:46.294607 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/22c64d94-7b96-4095-9224-bc6c0365167e-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-wvthr\" (UID: \"22c64d94-7b96-4095-9224-bc6c0365167e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-wvthr" Jun 09 15:18:46.294636 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:46.294628 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/22c64d94-7b96-4095-9224-bc6c0365167e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-wvthr\" (UID: \"22c64d94-7b96-4095-9224-bc6c0365167e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-wvthr" Jun 09 15:18:46.294817 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:46.294617 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e2af3552-72ed-4ef4-9424-a5f200d2a794-node-exporter-tls\") pod \"node-exporter-q4xv9\" (UID: \"e2af3552-72ed-4ef4-9424-a5f200d2a794\") " pod="openshift-monitoring/node-exporter-q4xv9" Jun 09 15:18:46.294817 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:46.294648 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e2af3552-72ed-4ef4-9424-a5f200d2a794-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-q4xv9\" (UID: \"e2af3552-72ed-4ef4-9424-a5f200d2a794\") " pod="openshift-monitoring/node-exporter-q4xv9" Jun 09 15:18:46.305044 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:46.305020 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-th5bd\" (UniqueName: \"kubernetes.io/projected/e2af3552-72ed-4ef4-9424-a5f200d2a794-kube-api-access-th5bd\") pod \"node-exporter-q4xv9\" (UID: \"e2af3552-72ed-4ef4-9424-a5f200d2a794\") " pod="openshift-monitoring/node-exporter-q4xv9" Jun 09 15:18:46.305494 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:46.305472 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7hwv\" (UniqueName: \"kubernetes.io/projected/22c64d94-7b96-4095-9224-bc6c0365167e-kube-api-access-x7hwv\") pod \"kube-state-metrics-57bbf8bfb5-wvthr\" (UID: \"22c64d94-7b96-4095-9224-bc6c0365167e\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-wvthr" Jun 09 15:18:46.430749 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:46.430721 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-wvthr" Jun 09 15:18:46.461566 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:46.461534 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-q4xv9" Jun 09 15:18:46.472145 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:18:46.472119 2611 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2af3552_72ed_4ef4_9424_a5f200d2a794.slice/crio-0d69e6dbf5e64748232a38b4dfae7d6361dd78fef27194487b484ec4c49a4f2e WatchSource:0}: Error finding container 0d69e6dbf5e64748232a38b4dfae7d6361dd78fef27194487b484ec4c49a4f2e: Status 404 returned error can't find the container with id 0d69e6dbf5e64748232a38b4dfae7d6361dd78fef27194487b484ec4c49a4f2e Jun 09 15:18:46.537846 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:46.537798 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-q4xv9" event={"ID":"e2af3552-72ed-4ef4-9424-a5f200d2a794","Type":"ContainerStarted","Data":"0d69e6dbf5e64748232a38b4dfae7d6361dd78fef27194487b484ec4c49a4f2e"} Jun 09 15:18:46.604394 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:46.604358 2611 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-wvthr"] Jun 09 15:18:46.607221 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:18:46.607190 2611 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22c64d94_7b96_4095_9224_bc6c0365167e.slice/crio-93c225c86fbc38a2ce42d6673d17e9968037437fba578e3b20afb37078f4c889 WatchSource:0}: Error finding container 93c225c86fbc38a2ce42d6673d17e9968037437fba578e3b20afb37078f4c889: Status 404 returned error can't find the container with id 93c225c86fbc38a2ce42d6673d17e9968037437fba578e3b20afb37078f4c889 Jun 09 15:18:47.543128 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:47.543091 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-wvthr" event={"ID":"22c64d94-7b96-4095-9224-bc6c0365167e","Type":"ContainerStarted","Data":"93c225c86fbc38a2ce42d6673d17e9968037437fba578e3b20afb37078f4c889"} Jun 09 15:18:47.546850 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:47.546818 2611 generic.go:356] "Generic (PLEG): container finished" podID="e2af3552-72ed-4ef4-9424-a5f200d2a794" containerID="df1745b4e5483287fd80f7920d9a177b50e3c4dd8e55142a75ff7235f6bea9a5" exitCode=0 Jun 09 15:18:47.546994 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:47.546864 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-q4xv9" event={"ID":"e2af3552-72ed-4ef4-9424-a5f200d2a794","Type":"ContainerDied","Data":"df1745b4e5483287fd80f7920d9a177b50e3c4dd8e55142a75ff7235f6bea9a5"} Jun 09 15:18:48.233183 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:48.233129 2611 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-85f6d4689-84qgs" Jun 09 15:18:48.233341 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:48.233216 2611 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-85f6d4689-84qgs" Jun 09 15:18:48.235090 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:48.235004 2611 patch_prober.go:28] interesting pod/console-85f6d4689-84qgs container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.18:8443/health\": dial tcp 10.134.0.18:8443: connect: connection refused" start-of-body= Jun 09 15:18:48.235090 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:48.235067 2611 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-85f6d4689-84qgs" podUID="adb92e20-35fa-43d9-972c-c1429343daf5" containerName="console" probeResult="failure" output="Get \"https://10.134.0.18:8443/health\": dial tcp 10.134.0.18:8443: connect: connection refused" Jun 09 15:18:48.555281 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:48.555192 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-q4xv9" event={"ID":"e2af3552-72ed-4ef4-9424-a5f200d2a794","Type":"ContainerStarted","Data":"bf8f7e0024473a8756408585ad8dacd36adf969bd3d861a678063e31bc4bff15"} Jun 09 15:18:50.532418 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:50.532377 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f450cf6-c990-47e4-a16a-5d0a4ff36581-metrics-certs\") pod \"network-metrics-daemon-mfj2k\" (UID: \"9f450cf6-c990-47e4-a16a-5d0a4ff36581\") " pod="openshift-multus/network-metrics-daemon-mfj2k" Jun 09 15:18:50.534839 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:50.534812 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f450cf6-c990-47e4-a16a-5d0a4ff36581-metrics-certs\") pod \"network-metrics-daemon-mfj2k\" (UID: \"9f450cf6-c990-47e4-a16a-5d0a4ff36581\") " pod="openshift-multus/network-metrics-daemon-mfj2k" Jun 09 15:18:50.732402 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:50.732334 2611 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-p4lvv\"" Jun 09 15:18:50.738213 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:50.738179 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mfj2k" Jun 09 15:18:50.881002 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:50.880922 2611 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-85f6d4689-84qgs"] Jun 09 15:18:52.972287 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:52.972246 2611 patch_prober.go:28] interesting pod/image-registry-6f98c4fd9-72cfs container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 15:18:52.972763 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:52.972310 2611 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6f98c4fd9-72cfs" podUID="b0379b61-8878-47c5-8ccd-e73c7a859bef" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 15:18:55.306641 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:55.306610 2611 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mfj2k"] Jun 09 15:18:55.312542 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:18:55.312023 2611 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f450cf6_c990_47e4_a16a_5d0a4ff36581.slice/crio-c74d16edf004ae6068a7c0b7bbe6928435b2f77652ba2316357915474e8b862d WatchSource:0}: Error finding container c74d16edf004ae6068a7c0b7bbe6928435b2f77652ba2316357915474e8b862d: Status 404 returned error can't find the container with id c74d16edf004ae6068a7c0b7bbe6928435b2f77652ba2316357915474e8b862d Jun 09 15:18:55.587146 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:55.587053 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mfj2k" event={"ID":"9f450cf6-c990-47e4-a16a-5d0a4ff36581","Type":"ContainerStarted","Data":"c74d16edf004ae6068a7c0b7bbe6928435b2f77652ba2316357915474e8b862d"} Jun 09 15:18:55.589754 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:55.589697 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-wvthr" event={"ID":"22c64d94-7b96-4095-9224-bc6c0365167e","Type":"ContainerStarted","Data":"6b673eb384686d67e308c34d877bf6b9ee97de5b45586a00b189a749e5743e02"} Jun 09 15:18:55.590049 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:55.589961 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-wvthr" event={"ID":"22c64d94-7b96-4095-9224-bc6c0365167e","Type":"ContainerStarted","Data":"d7a5db4c27ef8da2e7369569edc3b62f77ac10fb05953b8b31c689932df8ff3c"} Jun 09 15:18:55.590049 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:55.590009 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-wvthr" event={"ID":"22c64d94-7b96-4095-9224-bc6c0365167e","Type":"ContainerStarted","Data":"5b61211c7902bfbf93e840339c28b1e21c5da847766d8e7aaa20289f38b72365"} Jun 09 15:18:55.591893 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:55.591505 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-tsgfx" event={"ID":"59784453-eef7-4fe9-9e6a-426d89aa1361","Type":"ContainerStarted","Data":"7db44740c1a72f87c89598f93135f657015f7a315f7adc7e5d074d02eeac6d5e"} Jun 09 15:18:55.591893 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:55.591757 2611 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6657875f97-tsgfx" Jun 09 15:18:55.595604 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:55.595018 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-q4xv9" event={"ID":"e2af3552-72ed-4ef4-9424-a5f200d2a794","Type":"ContainerStarted","Data":"aebf3ad1c8f900b383b3a6bae76e49bc78f26d927bffb29d1b51aa88968c9284"} Jun 09 15:18:55.601700 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:55.601634 2611 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6657875f97-tsgfx" Jun 09 15:18:55.615742 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:55.615672 2611 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-wvthr" podStartSLOduration=1.078123962 podStartE2EDuration="9.615648601s" totalImagesPullingTime="8.537524639s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:18:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:18:55.613971586 +0000 UTC m=+256.419663806" watchObservedRunningTime="2026-06-09 15:18:55.615648601 +0000 UTC m=+256.421340824" Jun 09 15:18:55.646280 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:55.646139 2611 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6657875f97-tsgfx" podStartSLOduration=1.845707405 podStartE2EDuration="23.64611685s" totalImagesPullingTime="21.800409445s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:18:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:18:55.645615951 +0000 UTC m=+256.451308183" watchObservedRunningTime="2026-06-09 15:18:55.64611685 +0000 UTC m=+256.451809083" Jun 09 15:18:55.706653 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:55.704769 2611 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-q4xv9" podStartSLOduration=8.730898524 podStartE2EDuration="9.704745936s" totalImagesPullingTime="889.204897ms" totalInitContainerRuntime="84.642515ms" isStatefulPod=true podCreationTimestamp="2026-06-09 15:18:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:18:55.703349932 +0000 UTC m=+256.509042152" watchObservedRunningTime="2026-06-09 15:18:55.704745936 +0000 UTC m=+256.510438156" Jun 09 15:18:57.607712 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:57.607599 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mfj2k" event={"ID":"9f450cf6-c990-47e4-a16a-5d0a4ff36581","Type":"ContainerStarted","Data":"8277b3dbc3a691194ffe4c42a0adf3239038862290750ab6482da48b77a9c1ce"} Jun 09 15:18:57.607712 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:57.607658 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mfj2k" event={"ID":"9f450cf6-c990-47e4-a16a-5d0a4ff36581","Type":"ContainerStarted","Data":"384fb6f5ac2c2b8a5076c6c20f7a6bb2a831abe9c98da5208806e0f587e5386d"} Jun 09 15:18:57.640443 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:57.640390 2611 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-mfj2k" podStartSLOduration=256.329390123 podStartE2EDuration="4m17.640367907s" totalImagesPullingTime="1.310977784s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:14:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:18:57.637981024 +0000 UTC m=+258.443673244" watchObservedRunningTime="2026-06-09 15:18:57.640367907 +0000 UTC m=+258.446060125" Jun 09 15:18:57.986404 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:57.986349 2611 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6f98c4fd9-72cfs" podUID="b0379b61-8878-47c5-8ccd-e73c7a859bef" containerName="registry" containerID="cri-o://5c44ac663301ec0a8462f2507f67730482758f88a997a96b92706820793477e9" gracePeriod=30 Jun 09 15:18:58.288464 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:58.288432 2611 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f98c4fd9-72cfs" Jun 09 15:18:58.408423 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:58.408335 2611 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b0379b61-8878-47c5-8ccd-e73c7a859bef-registry-tls\") pod \"b0379b61-8878-47c5-8ccd-e73c7a859bef\" (UID: \"b0379b61-8878-47c5-8ccd-e73c7a859bef\") " Jun 09 15:18:58.408423 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:58.408395 2611 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b0379b61-8878-47c5-8ccd-e73c7a859bef-image-registry-private-configuration\") pod \"b0379b61-8878-47c5-8ccd-e73c7a859bef\" (UID: \"b0379b61-8878-47c5-8ccd-e73c7a859bef\") " Jun 09 15:18:58.408423 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:58.408425 2611 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b0379b61-8878-47c5-8ccd-e73c7a859bef-bound-sa-token\") pod \"b0379b61-8878-47c5-8ccd-e73c7a859bef\" (UID: \"b0379b61-8878-47c5-8ccd-e73c7a859bef\") " Jun 09 15:18:58.408723 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:58.408460 2611 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b0379b61-8878-47c5-8ccd-e73c7a859bef-trusted-ca\") pod \"b0379b61-8878-47c5-8ccd-e73c7a859bef\" (UID: \"b0379b61-8878-47c5-8ccd-e73c7a859bef\") " Jun 09 15:18:58.408723 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:58.408507 2611 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nd69m\" (UniqueName: \"kubernetes.io/projected/b0379b61-8878-47c5-8ccd-e73c7a859bef-kube-api-access-nd69m\") pod \"b0379b61-8878-47c5-8ccd-e73c7a859bef\" (UID: \"b0379b61-8878-47c5-8ccd-e73c7a859bef\") " Jun 09 15:18:58.408723 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:58.408530 2611 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b0379b61-8878-47c5-8ccd-e73c7a859bef-installation-pull-secrets\") pod \"b0379b61-8878-47c5-8ccd-e73c7a859bef\" (UID: \"b0379b61-8878-47c5-8ccd-e73c7a859bef\") " Jun 09 15:18:58.408723 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:58.408561 2611 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b0379b61-8878-47c5-8ccd-e73c7a859bef-ca-trust-extracted\") pod \"b0379b61-8878-47c5-8ccd-e73c7a859bef\" (UID: \"b0379b61-8878-47c5-8ccd-e73c7a859bef\") " Jun 09 15:18:58.408723 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:58.408642 2611 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b0379b61-8878-47c5-8ccd-e73c7a859bef-registry-certificates\") pod \"b0379b61-8878-47c5-8ccd-e73c7a859bef\" (UID: \"b0379b61-8878-47c5-8ccd-e73c7a859bef\") " Jun 09 15:18:58.409227 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:58.409191 2611 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0379b61-8878-47c5-8ccd-e73c7a859bef-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "b0379b61-8878-47c5-8ccd-e73c7a859bef" (UID: "b0379b61-8878-47c5-8ccd-e73c7a859bef"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 15:18:58.409820 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:58.409760 2611 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0379b61-8878-47c5-8ccd-e73c7a859bef-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "b0379b61-8878-47c5-8ccd-e73c7a859bef" (UID: "b0379b61-8878-47c5-8ccd-e73c7a859bef"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 15:18:58.414553 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:58.414528 2611 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0379b61-8878-47c5-8ccd-e73c7a859bef-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "b0379b61-8878-47c5-8ccd-e73c7a859bef" (UID: "b0379b61-8878-47c5-8ccd-e73c7a859bef"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 15:18:58.414679 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:58.414524 2611 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0379b61-8878-47c5-8ccd-e73c7a859bef-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "b0379b61-8878-47c5-8ccd-e73c7a859bef" (UID: "b0379b61-8878-47c5-8ccd-e73c7a859bef"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 15:18:58.415335 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:58.415224 2611 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0379b61-8878-47c5-8ccd-e73c7a859bef-kube-api-access-nd69m" (OuterVolumeSpecName: "kube-api-access-nd69m") pod "b0379b61-8878-47c5-8ccd-e73c7a859bef" (UID: "b0379b61-8878-47c5-8ccd-e73c7a859bef"). InnerVolumeSpecName "kube-api-access-nd69m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 15:18:58.416230 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:58.416128 2611 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0379b61-8878-47c5-8ccd-e73c7a859bef-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "b0379b61-8878-47c5-8ccd-e73c7a859bef" (UID: "b0379b61-8878-47c5-8ccd-e73c7a859bef"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 15:18:58.419795 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:58.419765 2611 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0379b61-8878-47c5-8ccd-e73c7a859bef-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "b0379b61-8878-47c5-8ccd-e73c7a859bef" (UID: "b0379b61-8878-47c5-8ccd-e73c7a859bef"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 15:18:58.421860 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:58.421829 2611 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0379b61-8878-47c5-8ccd-e73c7a859bef-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "b0379b61-8878-47c5-8ccd-e73c7a859bef" (UID: "b0379b61-8878-47c5-8ccd-e73c7a859bef"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 15:18:58.510207 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:58.510099 2611 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b0379b61-8878-47c5-8ccd-e73c7a859bef-bound-sa-token\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 09 15:18:58.510207 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:58.510134 2611 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b0379b61-8878-47c5-8ccd-e73c7a859bef-trusted-ca\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 09 15:18:58.510207 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:58.510147 2611 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nd69m\" (UniqueName: \"kubernetes.io/projected/b0379b61-8878-47c5-8ccd-e73c7a859bef-kube-api-access-nd69m\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 09 15:18:58.510207 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:58.510174 2611 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b0379b61-8878-47c5-8ccd-e73c7a859bef-installation-pull-secrets\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 09 15:18:58.510207 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:58.510191 2611 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b0379b61-8878-47c5-8ccd-e73c7a859bef-ca-trust-extracted\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 09 15:18:58.510207 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:58.510205 2611 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b0379b61-8878-47c5-8ccd-e73c7a859bef-registry-certificates\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 09 15:18:58.510614 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:58.510217 2611 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b0379b61-8878-47c5-8ccd-e73c7a859bef-registry-tls\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 09 15:18:58.510614 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:58.510230 2611 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b0379b61-8878-47c5-8ccd-e73c7a859bef-image-registry-private-configuration\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 09 15:18:58.612464 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:58.612423 2611 generic.go:356] "Generic (PLEG): container finished" podID="b0379b61-8878-47c5-8ccd-e73c7a859bef" containerID="5c44ac663301ec0a8462f2507f67730482758f88a997a96b92706820793477e9" exitCode=0 Jun 09 15:18:58.612947 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:58.612483 2611 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f98c4fd9-72cfs" Jun 09 15:18:58.612947 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:58.612522 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6f98c4fd9-72cfs" event={"ID":"b0379b61-8878-47c5-8ccd-e73c7a859bef","Type":"ContainerDied","Data":"5c44ac663301ec0a8462f2507f67730482758f88a997a96b92706820793477e9"} Jun 09 15:18:58.612947 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:58.612575 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6f98c4fd9-72cfs" event={"ID":"b0379b61-8878-47c5-8ccd-e73c7a859bef","Type":"ContainerDied","Data":"a4089059f4b2c510bd6479664bcb80c0a824c3bb7e56476c3e1f9e124a0540ef"} Jun 09 15:18:58.612947 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:58.612600 2611 scope.go:117] "RemoveContainer" containerID="5c44ac663301ec0a8462f2507f67730482758f88a997a96b92706820793477e9" Jun 09 15:18:58.625424 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:58.625382 2611 scope.go:117] "RemoveContainer" containerID="5c44ac663301ec0a8462f2507f67730482758f88a997a96b92706820793477e9" Jun 09 15:18:58.625828 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:18:58.625788 2611 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c44ac663301ec0a8462f2507f67730482758f88a997a96b92706820793477e9\": container with ID starting with 5c44ac663301ec0a8462f2507f67730482758f88a997a96b92706820793477e9 not found: ID does not exist" containerID="5c44ac663301ec0a8462f2507f67730482758f88a997a96b92706820793477e9" Jun 09 15:18:58.625915 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:58.625835 2611 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c44ac663301ec0a8462f2507f67730482758f88a997a96b92706820793477e9"} err="failed to get container status \"5c44ac663301ec0a8462f2507f67730482758f88a997a96b92706820793477e9\": rpc error: code = NotFound desc = could not find container \"5c44ac663301ec0a8462f2507f67730482758f88a997a96b92706820793477e9\": container with ID starting with 5c44ac663301ec0a8462f2507f67730482758f88a997a96b92706820793477e9 not found: ID does not exist" Jun 09 15:18:58.655562 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:58.655521 2611 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6f98c4fd9-72cfs"] Jun 09 15:18:58.664145 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:58.664105 2611 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6f98c4fd9-72cfs"] Jun 09 15:18:59.632997 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:18:59.632963 2611 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0379b61-8878-47c5-8ccd-e73c7a859bef" path="/var/lib/kubelet/pods/b0379b61-8878-47c5-8ccd-e73c7a859bef/volumes" Jun 09 15:19:15.906938 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:19:15.906894 2611 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-85f6d4689-84qgs" podUID="adb92e20-35fa-43d9-972c-c1429343daf5" containerName="console" containerID="cri-o://ad986a99b861fb3c11011e8f0ec8be035c218c02c61ead6d9f765232a3208d8b" gracePeriod=15 Jun 09 15:19:16.178110 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:19:16.178074 2611 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85f6d4689-84qgs" Jun 09 15:19:16.263970 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:19:16.263934 2611 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/adb92e20-35fa-43d9-972c-c1429343daf5-service-ca\") pod \"adb92e20-35fa-43d9-972c-c1429343daf5\" (UID: \"adb92e20-35fa-43d9-972c-c1429343daf5\") " Jun 09 15:19:16.263970 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:19:16.263980 2611 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/adb92e20-35fa-43d9-972c-c1429343daf5-console-config\") pod \"adb92e20-35fa-43d9-972c-c1429343daf5\" (UID: \"adb92e20-35fa-43d9-972c-c1429343daf5\") " Jun 09 15:19:16.264231 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:19:16.264047 2611 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q9ztz\" (UniqueName: \"kubernetes.io/projected/adb92e20-35fa-43d9-972c-c1429343daf5-kube-api-access-q9ztz\") pod \"adb92e20-35fa-43d9-972c-c1429343daf5\" (UID: \"adb92e20-35fa-43d9-972c-c1429343daf5\") " Jun 09 15:19:16.264231 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:19:16.264073 2611 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/adb92e20-35fa-43d9-972c-c1429343daf5-console-serving-cert\") pod \"adb92e20-35fa-43d9-972c-c1429343daf5\" (UID: \"adb92e20-35fa-43d9-972c-c1429343daf5\") " Jun 09 15:19:16.264231 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:19:16.264096 2611 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/adb92e20-35fa-43d9-972c-c1429343daf5-console-oauth-config\") pod \"adb92e20-35fa-43d9-972c-c1429343daf5\" (UID: \"adb92e20-35fa-43d9-972c-c1429343daf5\") " Jun 09 15:19:16.264231 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:19:16.264121 2611 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/adb92e20-35fa-43d9-972c-c1429343daf5-oauth-serving-cert\") pod \"adb92e20-35fa-43d9-972c-c1429343daf5\" (UID: \"adb92e20-35fa-43d9-972c-c1429343daf5\") " Jun 09 15:19:16.264517 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:19:16.264486 2611 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/adb92e20-35fa-43d9-972c-c1429343daf5-service-ca" (OuterVolumeSpecName: "service-ca") pod "adb92e20-35fa-43d9-972c-c1429343daf5" (UID: "adb92e20-35fa-43d9-972c-c1429343daf5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 15:19:16.264600 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:19:16.264494 2611 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/adb92e20-35fa-43d9-972c-c1429343daf5-console-config" (OuterVolumeSpecName: "console-config") pod "adb92e20-35fa-43d9-972c-c1429343daf5" (UID: "adb92e20-35fa-43d9-972c-c1429343daf5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 15:19:16.264600 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:19:16.264539 2611 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/adb92e20-35fa-43d9-972c-c1429343daf5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "adb92e20-35fa-43d9-972c-c1429343daf5" (UID: "adb92e20-35fa-43d9-972c-c1429343daf5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 15:19:16.266400 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:19:16.266372 2611 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/adb92e20-35fa-43d9-972c-c1429343daf5-kube-api-access-q9ztz" (OuterVolumeSpecName: "kube-api-access-q9ztz") pod "adb92e20-35fa-43d9-972c-c1429343daf5" (UID: "adb92e20-35fa-43d9-972c-c1429343daf5"). InnerVolumeSpecName "kube-api-access-q9ztz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 15:19:16.266497 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:19:16.266411 2611 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/adb92e20-35fa-43d9-972c-c1429343daf5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "adb92e20-35fa-43d9-972c-c1429343daf5" (UID: "adb92e20-35fa-43d9-972c-c1429343daf5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 15:19:16.266497 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:19:16.266425 2611 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/adb92e20-35fa-43d9-972c-c1429343daf5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "adb92e20-35fa-43d9-972c-c1429343daf5" (UID: "adb92e20-35fa-43d9-972c-c1429343daf5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 15:19:16.365549 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:19:16.365509 2611 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/adb92e20-35fa-43d9-972c-c1429343daf5-oauth-serving-cert\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 09 15:19:16.365549 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:19:16.365542 2611 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/adb92e20-35fa-43d9-972c-c1429343daf5-service-ca\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 09 15:19:16.365549 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:19:16.365553 2611 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/adb92e20-35fa-43d9-972c-c1429343daf5-console-config\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 09 15:19:16.365549 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:19:16.365561 2611 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q9ztz\" (UniqueName: \"kubernetes.io/projected/adb92e20-35fa-43d9-972c-c1429343daf5-kube-api-access-q9ztz\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 09 15:19:16.365806 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:19:16.365571 2611 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/adb92e20-35fa-43d9-972c-c1429343daf5-console-serving-cert\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 09 15:19:16.365806 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:19:16.365579 2611 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/adb92e20-35fa-43d9-972c-c1429343daf5-console-oauth-config\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 09 15:19:16.681693 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:19:16.681654 2611 generic.go:356] "Generic (PLEG): container finished" podID="adb92e20-35fa-43d9-972c-c1429343daf5" containerID="ad986a99b861fb3c11011e8f0ec8be035c218c02c61ead6d9f765232a3208d8b" exitCode=0 Jun 09 15:19:16.681878 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:19:16.681699 2611 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85f6d4689-84qgs" Jun 09 15:19:16.681878 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:19:16.681743 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85f6d4689-84qgs" event={"ID":"adb92e20-35fa-43d9-972c-c1429343daf5","Type":"ContainerDied","Data":"ad986a99b861fb3c11011e8f0ec8be035c218c02c61ead6d9f765232a3208d8b"} Jun 09 15:19:16.681878 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:19:16.681794 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85f6d4689-84qgs" event={"ID":"adb92e20-35fa-43d9-972c-c1429343daf5","Type":"ContainerDied","Data":"c2269af32a2632033cf178aa5e8e2b73319b22186074cdabca8763fa4add8d78"} Jun 09 15:19:16.681878 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:19:16.681815 2611 scope.go:117] "RemoveContainer" containerID="ad986a99b861fb3c11011e8f0ec8be035c218c02c61ead6d9f765232a3208d8b" Jun 09 15:19:16.690733 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:19:16.690710 2611 scope.go:117] "RemoveContainer" containerID="ad986a99b861fb3c11011e8f0ec8be035c218c02c61ead6d9f765232a3208d8b" Jun 09 15:19:16.691010 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:19:16.690990 2611 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad986a99b861fb3c11011e8f0ec8be035c218c02c61ead6d9f765232a3208d8b\": container with ID starting with ad986a99b861fb3c11011e8f0ec8be035c218c02c61ead6d9f765232a3208d8b not found: ID does not exist" containerID="ad986a99b861fb3c11011e8f0ec8be035c218c02c61ead6d9f765232a3208d8b" Jun 09 15:19:16.691057 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:19:16.691018 2611 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad986a99b861fb3c11011e8f0ec8be035c218c02c61ead6d9f765232a3208d8b"} err="failed to get container status \"ad986a99b861fb3c11011e8f0ec8be035c218c02c61ead6d9f765232a3208d8b\": rpc error: code = NotFound desc = could not find container \"ad986a99b861fb3c11011e8f0ec8be035c218c02c61ead6d9f765232a3208d8b\": container with ID starting with ad986a99b861fb3c11011e8f0ec8be035c218c02c61ead6d9f765232a3208d8b not found: ID does not exist" Jun 09 15:19:16.703578 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:19:16.703485 2611 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-85f6d4689-84qgs"] Jun 09 15:19:16.709721 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:19:16.709690 2611 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-85f6d4689-84qgs"] Jun 09 15:19:17.631841 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:19:17.631804 2611 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="adb92e20-35fa-43d9-972c-c1429343daf5" path="/var/lib/kubelet/pods/adb92e20-35fa-43d9-972c-c1429343daf5/volumes" Jun 09 15:19:19.197004 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:19:19.196955 2611 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-88h8k" podUID="a97cd107-7aa2-4279-8024-d6584468fd66" Jun 09 15:19:19.693440 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:19:19.693404 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-88h8k" Jun 09 15:19:23.022728 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:19:23.022680 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a97cd107-7aa2-4279-8024-d6584468fd66-metrics-tls\") pod \"dns-default-88h8k\" (UID: \"a97cd107-7aa2-4279-8024-d6584468fd66\") " pod="openshift-dns/dns-default-88h8k" Jun 09 15:19:23.025111 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:19:23.025063 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a97cd107-7aa2-4279-8024-d6584468fd66-metrics-tls\") pod \"dns-default-88h8k\" (UID: \"a97cd107-7aa2-4279-8024-d6584468fd66\") " pod="openshift-dns/dns-default-88h8k" Jun 09 15:19:23.296563 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:19:23.296483 2611 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dfk2j\"" Jun 09 15:19:23.304478 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:19:23.304450 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-88h8k" Jun 09 15:19:23.477048 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:19:23.476979 2611 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-88h8k"] Jun 09 15:19:23.479991 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:19:23.479958 2611 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda97cd107_7aa2_4279_8024_d6584468fd66.slice/crio-04d917947fb20afdfd399cfcd9de5efd810891bd0439594dae82fee2fd9aa436 WatchSource:0}: Error finding container 04d917947fb20afdfd399cfcd9de5efd810891bd0439594dae82fee2fd9aa436: Status 404 returned error can't find the container with id 04d917947fb20afdfd399cfcd9de5efd810891bd0439594dae82fee2fd9aa436 Jun 09 15:19:23.710431 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:19:23.710393 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-88h8k" event={"ID":"a97cd107-7aa2-4279-8024-d6584468fd66","Type":"ContainerStarted","Data":"04d917947fb20afdfd399cfcd9de5efd810891bd0439594dae82fee2fd9aa436"} Jun 09 15:19:25.720567 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:19:25.720536 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-88h8k" event={"ID":"a97cd107-7aa2-4279-8024-d6584468fd66","Type":"ContainerStarted","Data":"2f6db26cb23f6e203c929cd1c695d157c9904810c94f400bd7c15de79b6634dd"} Jun 09 15:19:25.720882 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:19:25.720589 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-88h8k" event={"ID":"a97cd107-7aa2-4279-8024-d6584468fd66","Type":"ContainerStarted","Data":"bd6b1bd9b6a101c96c1b77df8442216b0d42b539c723c40f669cb3a0f3d49201"} Jun 09 15:19:26.724135 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:19:26.724102 2611 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-88h8k" Jun 09 15:19:26.768773 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:19:26.768712 2611 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-88h8k" podStartSLOduration=251.819063391 podStartE2EDuration="4m13.768693866s" totalImagesPullingTime="1.949630475s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:15:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:19:26.767689129 +0000 UTC m=+287.573381373" watchObservedRunningTime="2026-06-09 15:19:26.768693866 +0000 UTC m=+287.574386086" Jun 09 15:19:27.601791 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:19:27.601763 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-85c449f8d5-nz5ns_2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5/router/0.log" Jun 09 15:19:27.621174 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:19:27.621136 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5wxnd_e3fbb074-05b5-48f8-b2cc-e1aaa57723c4/serve-healthcheck-canary/0.log" Jun 09 15:19:28.736042 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:19:28.735998 2611 generic.go:356] "Generic (PLEG): container finished" podID="89d039e4-83e1-4441-a3f1-b22bc7c4ed18" containerID="01b9036f9d29dfd73f7bf8e88933bf5e905432338f84b44da0f0fbe9a3360cfb" exitCode=0 Jun 09 15:19:28.736454 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:19:28.736072 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-9xrjx" event={"ID":"89d039e4-83e1-4441-a3f1-b22bc7c4ed18","Type":"ContainerDied","Data":"01b9036f9d29dfd73f7bf8e88933bf5e905432338f84b44da0f0fbe9a3360cfb"} Jun 09 15:19:28.736497 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:19:28.736458 2611 scope.go:117] "RemoveContainer" containerID="01b9036f9d29dfd73f7bf8e88933bf5e905432338f84b44da0f0fbe9a3360cfb" Jun 09 15:19:29.741138 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:19:29.741100 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-9xrjx" event={"ID":"89d039e4-83e1-4441-a3f1-b22bc7c4ed18","Type":"ContainerStarted","Data":"852edd808f89c7096d1d663910399164a4a7aafda80ebc7bb64f040174a1e273"} Jun 09 15:19:36.730060 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:19:36.730026 2611 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-88h8k" Jun 09 15:19:37.778438 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:19:37.778401 2611 generic.go:356] "Generic (PLEG): container finished" podID="c5f897b6-d89e-42d5-8839-c44fe76224d5" containerID="d0f64e0ee613bfb8acff3faf4774cc0500ef0cd6cc93b40c84f43073e2457617" exitCode=0 Jun 09 15:19:37.778849 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:19:37.778470 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-kzxcz" event={"ID":"c5f897b6-d89e-42d5-8839-c44fe76224d5","Type":"ContainerDied","Data":"d0f64e0ee613bfb8acff3faf4774cc0500ef0cd6cc93b40c84f43073e2457617"} Jun 09 15:19:37.778849 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:19:37.778814 2611 scope.go:117] "RemoveContainer" containerID="d0f64e0ee613bfb8acff3faf4774cc0500ef0cd6cc93b40c84f43073e2457617" Jun 09 15:19:38.784583 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:19:38.784550 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-kzxcz" event={"ID":"c5f897b6-d89e-42d5-8839-c44fe76224d5","Type":"ContainerStarted","Data":"8adaa108b35125839d625e5c80d267d6321380833b4ed26e71492fb219e7070c"} Jun 09 15:19:39.563698 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:19:39.563668 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-9b4t9_7a9cdcf8-af9d-474c-9f46-4099925e11fc/console-operator/1.log" Jun 09 15:19:39.568351 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:19:39.568214 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-9b4t9_7a9cdcf8-af9d-474c-9f46-4099925e11fc/console-operator/1.log" Jun 09 15:19:39.573918 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:19:39.573895 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4vsgw_aa94098e-7a90-4a75-9b97-74e10b75695b/ovn-acl-logging/0.log" Jun 09 15:19:39.578270 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:19:39.578227 2611 kubelet.go:1648] "Image garbage collection succeeded" Jun 09 15:19:39.579317 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:19:39.579297 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4vsgw_aa94098e-7a90-4a75-9b97-74e10b75695b/ovn-acl-logging/0.log" Jun 09 15:20:28.798981 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:20:28.798898 2611 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-55767d7ffb-whfn5"] Jun 09 15:20:28.799474 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:20:28.799211 2611 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="adb92e20-35fa-43d9-972c-c1429343daf5" containerName="console" Jun 09 15:20:28.799474 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:20:28.799228 2611 state_mem.go:107] "Deleted CPUSet assignment" podUID="adb92e20-35fa-43d9-972c-c1429343daf5" containerName="console" Jun 09 15:20:28.799474 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:20:28.799283 2611 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0379b61-8878-47c5-8ccd-e73c7a859bef" containerName="registry" Jun 09 15:20:28.799474 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:20:28.799294 2611 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0379b61-8878-47c5-8ccd-e73c7a859bef" containerName="registry" Jun 09 15:20:28.799474 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:20:28.799364 2611 memory_manager.go:368] "RemoveStaleState removing state" podUID="adb92e20-35fa-43d9-972c-c1429343daf5" containerName="console" Jun 09 15:20:28.799474 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:20:28.799378 2611 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0379b61-8878-47c5-8ccd-e73c7a859bef" containerName="registry" Jun 09 15:20:28.801829 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:20:28.801805 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55767d7ffb-whfn5" Jun 09 15:20:28.804518 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:20:28.804485 2611 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 09 15:20:28.804632 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:20:28.804591 2611 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 09 15:20:28.805369 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:20:28.805347 2611 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 09 15:20:28.805507 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:20:28.805389 2611 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-9g5w9\"" Jun 09 15:20:28.805507 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:20:28.805394 2611 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 09 15:20:28.805716 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:20:28.805687 2611 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 09 15:20:28.810956 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:20:28.810922 2611 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 09 15:20:28.817343 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:20:28.817318 2611 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55767d7ffb-whfn5"] Jun 09 15:20:28.947510 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:20:28.947463 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f-service-ca\") pod \"console-55767d7ffb-whfn5\" (UID: \"01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f\") " pod="openshift-console/console-55767d7ffb-whfn5" Jun 09 15:20:28.947696 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:20:28.947534 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f-trusted-ca-bundle\") pod \"console-55767d7ffb-whfn5\" (UID: \"01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f\") " pod="openshift-console/console-55767d7ffb-whfn5" Jun 09 15:20:28.947696 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:20:28.947562 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f-console-oauth-config\") pod \"console-55767d7ffb-whfn5\" (UID: \"01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f\") " pod="openshift-console/console-55767d7ffb-whfn5" Jun 09 15:20:28.947696 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:20:28.947661 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2w66d\" (UniqueName: \"kubernetes.io/projected/01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f-kube-api-access-2w66d\") pod \"console-55767d7ffb-whfn5\" (UID: \"01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f\") " pod="openshift-console/console-55767d7ffb-whfn5" Jun 09 15:20:28.947899 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:20:28.947712 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f-console-serving-cert\") pod \"console-55767d7ffb-whfn5\" (UID: \"01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f\") " pod="openshift-console/console-55767d7ffb-whfn5" Jun 09 15:20:28.947899 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:20:28.947763 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f-oauth-serving-cert\") pod \"console-55767d7ffb-whfn5\" (UID: \"01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f\") " pod="openshift-console/console-55767d7ffb-whfn5" Jun 09 15:20:28.947899 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:20:28.947812 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f-console-config\") pod \"console-55767d7ffb-whfn5\" (UID: \"01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f\") " pod="openshift-console/console-55767d7ffb-whfn5" Jun 09 15:20:29.048212 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:20:29.048148 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f-service-ca\") pod \"console-55767d7ffb-whfn5\" (UID: \"01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f\") " pod="openshift-console/console-55767d7ffb-whfn5" Jun 09 15:20:29.048392 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:20:29.048228 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f-trusted-ca-bundle\") pod \"console-55767d7ffb-whfn5\" (UID: \"01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f\") " pod="openshift-console/console-55767d7ffb-whfn5" Jun 09 15:20:29.048392 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:20:29.048249 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f-console-oauth-config\") pod \"console-55767d7ffb-whfn5\" (UID: \"01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f\") " pod="openshift-console/console-55767d7ffb-whfn5" Jun 09 15:20:29.048392 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:20:29.048270 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2w66d\" (UniqueName: \"kubernetes.io/projected/01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f-kube-api-access-2w66d\") pod \"console-55767d7ffb-whfn5\" (UID: \"01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f\") " pod="openshift-console/console-55767d7ffb-whfn5" Jun 09 15:20:29.048392 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:20:29.048286 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f-console-serving-cert\") pod \"console-55767d7ffb-whfn5\" (UID: \"01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f\") " pod="openshift-console/console-55767d7ffb-whfn5" Jun 09 15:20:29.048554 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:20:29.048477 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f-oauth-serving-cert\") pod \"console-55767d7ffb-whfn5\" (UID: \"01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f\") " pod="openshift-console/console-55767d7ffb-whfn5" Jun 09 15:20:29.048554 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:20:29.048537 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f-console-config\") pod \"console-55767d7ffb-whfn5\" (UID: \"01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f\") " pod="openshift-console/console-55767d7ffb-whfn5" Jun 09 15:20:29.048971 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:20:29.048944 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f-service-ca\") pod \"console-55767d7ffb-whfn5\" (UID: \"01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f\") " pod="openshift-console/console-55767d7ffb-whfn5" Jun 09 15:20:29.049218 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:20:29.049173 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f-console-config\") pod \"console-55767d7ffb-whfn5\" (UID: \"01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f\") " pod="openshift-console/console-55767d7ffb-whfn5" Jun 09 15:20:29.049218 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:20:29.049149 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f-trusted-ca-bundle\") pod \"console-55767d7ffb-whfn5\" (UID: \"01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f\") " pod="openshift-console/console-55767d7ffb-whfn5" Jun 09 15:20:29.049318 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:20:29.049250 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f-oauth-serving-cert\") pod \"console-55767d7ffb-whfn5\" (UID: \"01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f\") " pod="openshift-console/console-55767d7ffb-whfn5" Jun 09 15:20:29.050971 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:20:29.050941 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f-console-serving-cert\") pod \"console-55767d7ffb-whfn5\" (UID: \"01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f\") " pod="openshift-console/console-55767d7ffb-whfn5" Jun 09 15:20:29.051058 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:20:29.050941 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f-console-oauth-config\") pod \"console-55767d7ffb-whfn5\" (UID: \"01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f\") " pod="openshift-console/console-55767d7ffb-whfn5" Jun 09 15:20:29.056973 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:20:29.056939 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2w66d\" (UniqueName: \"kubernetes.io/projected/01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f-kube-api-access-2w66d\") pod \"console-55767d7ffb-whfn5\" (UID: \"01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f\") " pod="openshift-console/console-55767d7ffb-whfn5" Jun 09 15:20:29.117884 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:20:29.117844 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55767d7ffb-whfn5" Jun 09 15:20:29.249771 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:20:29.249726 2611 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55767d7ffb-whfn5"] Jun 09 15:20:29.256033 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:20:29.253675 2611 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01ae4bd3_bc3b_4607_ae3c_7eda92a4e17f.slice/crio-721f3a0af778bd25cb9c5a97f16550d01dc5b9dc8ad95e108293ca6977fbb705 WatchSource:0}: Error finding container 721f3a0af778bd25cb9c5a97f16550d01dc5b9dc8ad95e108293ca6977fbb705: Status 404 returned error can't find the container with id 721f3a0af778bd25cb9c5a97f16550d01dc5b9dc8ad95e108293ca6977fbb705 Jun 09 15:20:29.975991 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:20:29.975955 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55767d7ffb-whfn5" event={"ID":"01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f","Type":"ContainerStarted","Data":"a1633cbbed9e6605d11e82a936ba16813816409c48850d69e3f31ee0b3aa4aea"} Jun 09 15:20:29.976399 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:20:29.976005 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55767d7ffb-whfn5" event={"ID":"01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f","Type":"ContainerStarted","Data":"721f3a0af778bd25cb9c5a97f16550d01dc5b9dc8ad95e108293ca6977fbb705"} Jun 09 15:20:29.994249 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:20:29.994197 2611 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-55767d7ffb-whfn5" podStartSLOduration=1.994182876 podStartE2EDuration="1.994182876s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:20:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:20:29.992951185 +0000 UTC m=+350.798643432" watchObservedRunningTime="2026-06-09 15:20:29.994182876 +0000 UTC m=+350.799875094" Jun 09 15:20:39.118257 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:20:39.118212 2611 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-55767d7ffb-whfn5" Jun 09 15:20:39.118257 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:20:39.118271 2611 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-55767d7ffb-whfn5" Jun 09 15:20:39.123116 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:20:39.123091 2611 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-55767d7ffb-whfn5" Jun 09 15:20:40.015007 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:20:40.014975 2611 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-55767d7ffb-whfn5" Jun 09 15:22:13.037210 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:13.037129 2611 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d45qfl"] Jun 09 15:22:13.039328 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:13.039306 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d45qfl" Jun 09 15:22:13.041928 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:13.041906 2611 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xcgzc\"" Jun 09 15:22:13.042056 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:13.041909 2611 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 15:22:13.042750 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:13.042725 2611 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 15:22:13.051477 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:13.051451 2611 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d45qfl"] Jun 09 15:22:13.187143 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:13.187100 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/886b2c83-8989-49e1-a9de-8bf3e66f859e-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d45qfl\" (UID: \"886b2c83-8989-49e1-a9de-8bf3e66f859e\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d45qfl" Jun 09 15:22:13.187143 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:13.187144 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/886b2c83-8989-49e1-a9de-8bf3e66f859e-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d45qfl\" (UID: \"886b2c83-8989-49e1-a9de-8bf3e66f859e\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d45qfl" Jun 09 15:22:13.187375 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:13.187245 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rd8p\" (UniqueName: \"kubernetes.io/projected/886b2c83-8989-49e1-a9de-8bf3e66f859e-kube-api-access-2rd8p\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d45qfl\" (UID: \"886b2c83-8989-49e1-a9de-8bf3e66f859e\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d45qfl" Jun 09 15:22:13.288601 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:13.288505 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/886b2c83-8989-49e1-a9de-8bf3e66f859e-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d45qfl\" (UID: \"886b2c83-8989-49e1-a9de-8bf3e66f859e\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d45qfl" Jun 09 15:22:13.288601 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:13.288565 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rd8p\" (UniqueName: \"kubernetes.io/projected/886b2c83-8989-49e1-a9de-8bf3e66f859e-kube-api-access-2rd8p\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d45qfl\" (UID: \"886b2c83-8989-49e1-a9de-8bf3e66f859e\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d45qfl" Jun 09 15:22:13.288866 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:13.288633 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/886b2c83-8989-49e1-a9de-8bf3e66f859e-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d45qfl\" (UID: \"886b2c83-8989-49e1-a9de-8bf3e66f859e\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d45qfl" Jun 09 15:22:13.288920 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:13.288905 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/886b2c83-8989-49e1-a9de-8bf3e66f859e-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d45qfl\" (UID: \"886b2c83-8989-49e1-a9de-8bf3e66f859e\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d45qfl" Jun 09 15:22:13.288968 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:13.288934 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/886b2c83-8989-49e1-a9de-8bf3e66f859e-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d45qfl\" (UID: \"886b2c83-8989-49e1-a9de-8bf3e66f859e\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d45qfl" Jun 09 15:22:13.305996 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:13.305965 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rd8p\" (UniqueName: \"kubernetes.io/projected/886b2c83-8989-49e1-a9de-8bf3e66f859e-kube-api-access-2rd8p\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d45qfl\" (UID: \"886b2c83-8989-49e1-a9de-8bf3e66f859e\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d45qfl" Jun 09 15:22:13.348683 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:13.348637 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d45qfl" Jun 09 15:22:13.484095 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:13.484068 2611 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d45qfl"] Jun 09 15:22:13.486527 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:22:13.486501 2611 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod886b2c83_8989_49e1_a9de_8bf3e66f859e.slice/crio-0573f4218e3664b6026381a62331c461161a0e4f0d4fcddb5c60cab0be9e7acd WatchSource:0}: Error finding container 0573f4218e3664b6026381a62331c461161a0e4f0d4fcddb5c60cab0be9e7acd: Status 404 returned error can't find the container with id 0573f4218e3664b6026381a62331c461161a0e4f0d4fcddb5c60cab0be9e7acd Jun 09 15:22:13.488538 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:13.488520 2611 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 15:22:14.359669 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:14.359631 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d45qfl" event={"ID":"886b2c83-8989-49e1-a9de-8bf3e66f859e","Type":"ContainerStarted","Data":"0573f4218e3664b6026381a62331c461161a0e4f0d4fcddb5c60cab0be9e7acd"} Jun 09 15:22:24.407511 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:24.407471 2611 generic.go:356] "Generic (PLEG): container finished" podID="886b2c83-8989-49e1-a9de-8bf3e66f859e" containerID="77337ded332491e8b87bd6be59cdffe9d8a2b30307584c367d160e4187345565" exitCode=0 Jun 09 15:22:24.407893 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:24.407556 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d45qfl" event={"ID":"886b2c83-8989-49e1-a9de-8bf3e66f859e","Type":"ContainerDied","Data":"77337ded332491e8b87bd6be59cdffe9d8a2b30307584c367d160e4187345565"} Jun 09 15:22:25.414798 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:25.414754 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d45qfl" event={"ID":"886b2c83-8989-49e1-a9de-8bf3e66f859e","Type":"ContainerStarted","Data":"bd571ccd570ddbba97c2baf1cdb6c5b5c0e82896dad047c119182c3a64d521c7"} Jun 09 15:22:26.420592 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:26.420558 2611 generic.go:356] "Generic (PLEG): container finished" podID="886b2c83-8989-49e1-a9de-8bf3e66f859e" containerID="bd571ccd570ddbba97c2baf1cdb6c5b5c0e82896dad047c119182c3a64d521c7" exitCode=0 Jun 09 15:22:26.421070 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:26.420612 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d45qfl" event={"ID":"886b2c83-8989-49e1-a9de-8bf3e66f859e","Type":"ContainerDied","Data":"bd571ccd570ddbba97c2baf1cdb6c5b5c0e82896dad047c119182c3a64d521c7"} Jun 09 15:22:35.459266 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:35.459230 2611 generic.go:356] "Generic (PLEG): container finished" podID="886b2c83-8989-49e1-a9de-8bf3e66f859e" containerID="2aee0563dec6f60a3edfc45f3d3fef8956dd9d3ddb9a09aacfd30655cea58572" exitCode=0 Jun 09 15:22:35.459639 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:35.459313 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d45qfl" event={"ID":"886b2c83-8989-49e1-a9de-8bf3e66f859e","Type":"ContainerDied","Data":"2aee0563dec6f60a3edfc45f3d3fef8956dd9d3ddb9a09aacfd30655cea58572"} Jun 09 15:22:36.596062 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:36.596035 2611 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d45qfl" Jun 09 15:22:36.691019 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:36.690982 2611 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/886b2c83-8989-49e1-a9de-8bf3e66f859e-util\") pod \"886b2c83-8989-49e1-a9de-8bf3e66f859e\" (UID: \"886b2c83-8989-49e1-a9de-8bf3e66f859e\") " Jun 09 15:22:36.691019 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:36.691024 2611 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2rd8p\" (UniqueName: \"kubernetes.io/projected/886b2c83-8989-49e1-a9de-8bf3e66f859e-kube-api-access-2rd8p\") pod \"886b2c83-8989-49e1-a9de-8bf3e66f859e\" (UID: \"886b2c83-8989-49e1-a9de-8bf3e66f859e\") " Jun 09 15:22:36.691268 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:36.691093 2611 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/886b2c83-8989-49e1-a9de-8bf3e66f859e-bundle\") pod \"886b2c83-8989-49e1-a9de-8bf3e66f859e\" (UID: \"886b2c83-8989-49e1-a9de-8bf3e66f859e\") " Jun 09 15:22:36.691864 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:36.691830 2611 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/886b2c83-8989-49e1-a9de-8bf3e66f859e-bundle" (OuterVolumeSpecName: "bundle") pod "886b2c83-8989-49e1-a9de-8bf3e66f859e" (UID: "886b2c83-8989-49e1-a9de-8bf3e66f859e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 15:22:36.693452 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:36.693423 2611 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/886b2c83-8989-49e1-a9de-8bf3e66f859e-kube-api-access-2rd8p" (OuterVolumeSpecName: "kube-api-access-2rd8p") pod "886b2c83-8989-49e1-a9de-8bf3e66f859e" (UID: "886b2c83-8989-49e1-a9de-8bf3e66f859e"). InnerVolumeSpecName "kube-api-access-2rd8p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 15:22:36.695927 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:36.695905 2611 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/886b2c83-8989-49e1-a9de-8bf3e66f859e-util" (OuterVolumeSpecName: "util") pod "886b2c83-8989-49e1-a9de-8bf3e66f859e" (UID: "886b2c83-8989-49e1-a9de-8bf3e66f859e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 15:22:36.792450 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:36.792355 2611 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/886b2c83-8989-49e1-a9de-8bf3e66f859e-bundle\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 09 15:22:36.792450 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:36.792386 2611 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/886b2c83-8989-49e1-a9de-8bf3e66f859e-util\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 09 15:22:36.792450 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:36.792396 2611 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2rd8p\" (UniqueName: \"kubernetes.io/projected/886b2c83-8989-49e1-a9de-8bf3e66f859e-kube-api-access-2rd8p\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 09 15:22:37.468657 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:37.468629 2611 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d45qfl" Jun 09 15:22:37.468657 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:37.468642 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d45qfl" event={"ID":"886b2c83-8989-49e1-a9de-8bf3e66f859e","Type":"ContainerDied","Data":"0573f4218e3664b6026381a62331c461161a0e4f0d4fcddb5c60cab0be9e7acd"} Jun 09 15:22:37.468875 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:37.468685 2611 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0573f4218e3664b6026381a62331c461161a0e4f0d4fcddb5c60cab0be9e7acd" Jun 09 15:22:41.283385 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:41.283351 2611 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-p5tr6"] Jun 09 15:22:41.283762 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:41.283629 2611 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="886b2c83-8989-49e1-a9de-8bf3e66f859e" containerName="pull" Jun 09 15:22:41.283762 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:41.283640 2611 state_mem.go:107] "Deleted CPUSet assignment" podUID="886b2c83-8989-49e1-a9de-8bf3e66f859e" containerName="pull" Jun 09 15:22:41.283762 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:41.283658 2611 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="886b2c83-8989-49e1-a9de-8bf3e66f859e" containerName="util" Jun 09 15:22:41.283762 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:41.283664 2611 state_mem.go:107] "Deleted CPUSet assignment" podUID="886b2c83-8989-49e1-a9de-8bf3e66f859e" containerName="util" Jun 09 15:22:41.283762 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:41.283670 2611 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="886b2c83-8989-49e1-a9de-8bf3e66f859e" containerName="extract" Jun 09 15:22:41.283762 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:41.283675 2611 state_mem.go:107] "Deleted CPUSet assignment" podUID="886b2c83-8989-49e1-a9de-8bf3e66f859e" containerName="extract" Jun 09 15:22:41.283762 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:41.283724 2611 memory_manager.go:368] "RemoveStaleState removing state" podUID="886b2c83-8989-49e1-a9de-8bf3e66f859e" containerName="extract" Jun 09 15:22:41.317280 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:41.317250 2611 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-p5tr6"] Jun 09 15:22:41.317415 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:41.317347 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-p5tr6" Jun 09 15:22:41.320074 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:41.320050 2611 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 09 15:22:41.320218 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:41.320080 2611 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 09 15:22:41.320471 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:41.320455 2611 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-vkdgv\"" Jun 09 15:22:41.428314 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:41.428272 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qj9g\" (UniqueName: \"kubernetes.io/projected/956036f5-8813-48e4-9d97-9a9ce09c4acd-kube-api-access-9qj9g\") pod \"cert-manager-operator-controller-manager-57757f7cfc-p5tr6\" (UID: \"956036f5-8813-48e4-9d97-9a9ce09c4acd\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-p5tr6" Jun 09 15:22:41.428481 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:41.428336 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/956036f5-8813-48e4-9d97-9a9ce09c4acd-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-p5tr6\" (UID: \"956036f5-8813-48e4-9d97-9a9ce09c4acd\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-p5tr6" Jun 09 15:22:41.529336 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:41.529285 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/956036f5-8813-48e4-9d97-9a9ce09c4acd-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-p5tr6\" (UID: \"956036f5-8813-48e4-9d97-9a9ce09c4acd\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-p5tr6" Jun 09 15:22:41.529503 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:41.529398 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qj9g\" (UniqueName: \"kubernetes.io/projected/956036f5-8813-48e4-9d97-9a9ce09c4acd-kube-api-access-9qj9g\") pod \"cert-manager-operator-controller-manager-57757f7cfc-p5tr6\" (UID: \"956036f5-8813-48e4-9d97-9a9ce09c4acd\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-p5tr6" Jun 09 15:22:41.529771 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:41.529748 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/956036f5-8813-48e4-9d97-9a9ce09c4acd-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-p5tr6\" (UID: \"956036f5-8813-48e4-9d97-9a9ce09c4acd\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-p5tr6" Jun 09 15:22:41.540369 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:41.540309 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qj9g\" (UniqueName: \"kubernetes.io/projected/956036f5-8813-48e4-9d97-9a9ce09c4acd-kube-api-access-9qj9g\") pod \"cert-manager-operator-controller-manager-57757f7cfc-p5tr6\" (UID: \"956036f5-8813-48e4-9d97-9a9ce09c4acd\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-p5tr6" Jun 09 15:22:41.626885 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:41.626846 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-p5tr6" Jun 09 15:22:41.774261 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:41.774225 2611 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-p5tr6"] Jun 09 15:22:41.777727 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:22:41.777693 2611 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod956036f5_8813_48e4_9d97_9a9ce09c4acd.slice/crio-34f780372f0d3b3c6a3cc177a1c0932c28820562d5d5a57ac0a97b9284320c68 WatchSource:0}: Error finding container 34f780372f0d3b3c6a3cc177a1c0932c28820562d5d5a57ac0a97b9284320c68: Status 404 returned error can't find the container with id 34f780372f0d3b3c6a3cc177a1c0932c28820562d5d5a57ac0a97b9284320c68 Jun 09 15:22:42.491011 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:42.490973 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-p5tr6" event={"ID":"956036f5-8813-48e4-9d97-9a9ce09c4acd","Type":"ContainerStarted","Data":"34f780372f0d3b3c6a3cc177a1c0932c28820562d5d5a57ac0a97b9284320c68"} Jun 09 15:22:44.502040 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:44.501999 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-p5tr6" event={"ID":"956036f5-8813-48e4-9d97-9a9ce09c4acd","Type":"ContainerStarted","Data":"12aecb051888a56fab0bca97fd883efab035367bffbf74712b9b9e564fa59d24"} Jun 09 15:22:44.524703 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:44.524639 2611 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-p5tr6" podStartSLOduration=1.216263272 podStartE2EDuration="3.524616846s" totalImagesPullingTime="2.308353574s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:22:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:22:44.522862521 +0000 UTC m=+485.328554740" watchObservedRunningTime="2026-06-09 15:22:44.524616846 +0000 UTC m=+485.330309061" Jun 09 15:22:45.221212 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:45.221175 2611 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdltvk"] Jun 09 15:22:45.248295 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:45.248262 2611 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdltvk"] Jun 09 15:22:45.248453 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:45.248378 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdltvk" Jun 09 15:22:45.251870 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:45.251833 2611 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xcgzc\"" Jun 09 15:22:45.252024 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:45.251958 2611 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 15:22:45.254645 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:45.254620 2611 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 15:22:45.366998 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:45.366954 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1e915b69-a220-4aa8-aadf-124a1d610d67-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdltvk\" (UID: \"1e915b69-a220-4aa8-aadf-124a1d610d67\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdltvk" Jun 09 15:22:45.367210 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:45.367011 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1e915b69-a220-4aa8-aadf-124a1d610d67-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdltvk\" (UID: \"1e915b69-a220-4aa8-aadf-124a1d610d67\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdltvk" Jun 09 15:22:45.367210 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:45.367116 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pt2h9\" (UniqueName: \"kubernetes.io/projected/1e915b69-a220-4aa8-aadf-124a1d610d67-kube-api-access-pt2h9\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdltvk\" (UID: \"1e915b69-a220-4aa8-aadf-124a1d610d67\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdltvk" Jun 09 15:22:45.468347 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:45.468303 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pt2h9\" (UniqueName: \"kubernetes.io/projected/1e915b69-a220-4aa8-aadf-124a1d610d67-kube-api-access-pt2h9\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdltvk\" (UID: \"1e915b69-a220-4aa8-aadf-124a1d610d67\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdltvk" Jun 09 15:22:45.468347 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:45.468348 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1e915b69-a220-4aa8-aadf-124a1d610d67-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdltvk\" (UID: \"1e915b69-a220-4aa8-aadf-124a1d610d67\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdltvk" Jun 09 15:22:45.468556 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:45.468386 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1e915b69-a220-4aa8-aadf-124a1d610d67-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdltvk\" (UID: \"1e915b69-a220-4aa8-aadf-124a1d610d67\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdltvk" Jun 09 15:22:45.468784 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:45.468762 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1e915b69-a220-4aa8-aadf-124a1d610d67-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdltvk\" (UID: \"1e915b69-a220-4aa8-aadf-124a1d610d67\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdltvk" Jun 09 15:22:45.468849 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:45.468781 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1e915b69-a220-4aa8-aadf-124a1d610d67-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdltvk\" (UID: \"1e915b69-a220-4aa8-aadf-124a1d610d67\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdltvk" Jun 09 15:22:45.487286 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:45.487204 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pt2h9\" (UniqueName: \"kubernetes.io/projected/1e915b69-a220-4aa8-aadf-124a1d610d67-kube-api-access-pt2h9\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdltvk\" (UID: \"1e915b69-a220-4aa8-aadf-124a1d610d67\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdltvk" Jun 09 15:22:45.558244 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:45.558207 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdltvk" Jun 09 15:22:45.736426 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:45.736382 2611 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdltvk"] Jun 09 15:22:45.739687 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:22:45.739655 2611 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e915b69_a220_4aa8_aadf_124a1d610d67.slice/crio-a0ce0d55df042ebf9de7c2dfefac374d7c98925eaba635a5d1175fc8f2c5ec28 WatchSource:0}: Error finding container a0ce0d55df042ebf9de7c2dfefac374d7c98925eaba635a5d1175fc8f2c5ec28: Status 404 returned error can't find the container with id a0ce0d55df042ebf9de7c2dfefac374d7c98925eaba635a5d1175fc8f2c5ec28 Jun 09 15:22:46.511231 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:46.511191 2611 generic.go:356] "Generic (PLEG): container finished" podID="1e915b69-a220-4aa8-aadf-124a1d610d67" containerID="0cb4e07c71ad005dc062bf43549d79db715f3e0f17be5554ee364a152f927581" exitCode=0 Jun 09 15:22:46.511390 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:46.511283 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdltvk" event={"ID":"1e915b69-a220-4aa8-aadf-124a1d610d67","Type":"ContainerDied","Data":"0cb4e07c71ad005dc062bf43549d79db715f3e0f17be5554ee364a152f927581"} Jun 09 15:22:46.511390 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:46.511335 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdltvk" event={"ID":"1e915b69-a220-4aa8-aadf-124a1d610d67","Type":"ContainerStarted","Data":"a0ce0d55df042ebf9de7c2dfefac374d7c98925eaba635a5d1175fc8f2c5ec28"} Jun 09 15:22:48.522210 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:48.522177 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdltvk" event={"ID":"1e915b69-a220-4aa8-aadf-124a1d610d67","Type":"ContainerStarted","Data":"faff330f0e3cc4d5916f7bd4bfc30a67a730f9653c848208fa93c4367c34292d"} Jun 09 15:22:49.528353 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:49.528318 2611 generic.go:356] "Generic (PLEG): container finished" podID="1e915b69-a220-4aa8-aadf-124a1d610d67" containerID="faff330f0e3cc4d5916f7bd4bfc30a67a730f9653c848208fa93c4367c34292d" exitCode=0 Jun 09 15:22:49.528731 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:49.528401 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdltvk" event={"ID":"1e915b69-a220-4aa8-aadf-124a1d610d67","Type":"ContainerDied","Data":"faff330f0e3cc4d5916f7bd4bfc30a67a730f9653c848208fa93c4367c34292d"} Jun 09 15:22:50.534784 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:50.534747 2611 generic.go:356] "Generic (PLEG): container finished" podID="1e915b69-a220-4aa8-aadf-124a1d610d67" containerID="6bfd9fb82be89679bc10ff9b8eac0140514eeb44a8db070741de6e880c84657f" exitCode=0 Jun 09 15:22:50.535174 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:50.534816 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdltvk" event={"ID":"1e915b69-a220-4aa8-aadf-124a1d610d67","Type":"ContainerDied","Data":"6bfd9fb82be89679bc10ff9b8eac0140514eeb44a8db070741de6e880c84657f"} Jun 09 15:22:51.659686 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:51.659660 2611 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdltvk" Jun 09 15:22:51.726369 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:51.726335 2611 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pt2h9\" (UniqueName: \"kubernetes.io/projected/1e915b69-a220-4aa8-aadf-124a1d610d67-kube-api-access-pt2h9\") pod \"1e915b69-a220-4aa8-aadf-124a1d610d67\" (UID: \"1e915b69-a220-4aa8-aadf-124a1d610d67\") " Jun 09 15:22:51.726543 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:51.726386 2611 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1e915b69-a220-4aa8-aadf-124a1d610d67-util\") pod \"1e915b69-a220-4aa8-aadf-124a1d610d67\" (UID: \"1e915b69-a220-4aa8-aadf-124a1d610d67\") " Jun 09 15:22:51.726543 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:51.726439 2611 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1e915b69-a220-4aa8-aadf-124a1d610d67-bundle\") pod \"1e915b69-a220-4aa8-aadf-124a1d610d67\" (UID: \"1e915b69-a220-4aa8-aadf-124a1d610d67\") " Jun 09 15:22:51.726835 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:51.726811 2611 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e915b69-a220-4aa8-aadf-124a1d610d67-bundle" (OuterVolumeSpecName: "bundle") pod "1e915b69-a220-4aa8-aadf-124a1d610d67" (UID: "1e915b69-a220-4aa8-aadf-124a1d610d67"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 15:22:51.728544 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:51.728514 2611 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e915b69-a220-4aa8-aadf-124a1d610d67-kube-api-access-pt2h9" (OuterVolumeSpecName: "kube-api-access-pt2h9") pod "1e915b69-a220-4aa8-aadf-124a1d610d67" (UID: "1e915b69-a220-4aa8-aadf-124a1d610d67"). InnerVolumeSpecName "kube-api-access-pt2h9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 15:22:51.731250 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:51.731230 2611 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e915b69-a220-4aa8-aadf-124a1d610d67-util" (OuterVolumeSpecName: "util") pod "1e915b69-a220-4aa8-aadf-124a1d610d67" (UID: "1e915b69-a220-4aa8-aadf-124a1d610d67"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 15:22:51.827861 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:51.827769 2611 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pt2h9\" (UniqueName: \"kubernetes.io/projected/1e915b69-a220-4aa8-aadf-124a1d610d67-kube-api-access-pt2h9\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 09 15:22:51.827861 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:51.827801 2611 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1e915b69-a220-4aa8-aadf-124a1d610d67-util\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 09 15:22:51.827861 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:51.827814 2611 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1e915b69-a220-4aa8-aadf-124a1d610d67-bundle\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 09 15:22:52.545834 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:52.545804 2611 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdltvk" Jun 09 15:22:52.545834 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:52.545815 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdltvk" event={"ID":"1e915b69-a220-4aa8-aadf-124a1d610d67","Type":"ContainerDied","Data":"a0ce0d55df042ebf9de7c2dfefac374d7c98925eaba635a5d1175fc8f2c5ec28"} Jun 09 15:22:52.546030 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:52.545858 2611 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a0ce0d55df042ebf9de7c2dfefac374d7c98925eaba635a5d1175fc8f2c5ec28" Jun 09 15:22:58.780366 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:58.780327 2611 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6b7g5"] Jun 09 15:22:58.780739 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:58.780597 2611 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e915b69-a220-4aa8-aadf-124a1d610d67" containerName="pull" Jun 09 15:22:58.780739 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:58.780607 2611 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e915b69-a220-4aa8-aadf-124a1d610d67" containerName="pull" Jun 09 15:22:58.780739 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:58.780623 2611 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e915b69-a220-4aa8-aadf-124a1d610d67" containerName="extract" Jun 09 15:22:58.780739 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:58.780628 2611 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e915b69-a220-4aa8-aadf-124a1d610d67" containerName="extract" Jun 09 15:22:58.780739 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:58.780637 2611 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e915b69-a220-4aa8-aadf-124a1d610d67" containerName="util" Jun 09 15:22:58.780739 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:58.780643 2611 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e915b69-a220-4aa8-aadf-124a1d610d67" containerName="util" Jun 09 15:22:58.780739 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:58.780689 2611 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e915b69-a220-4aa8-aadf-124a1d610d67" containerName="extract" Jun 09 15:22:58.782746 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:58.782726 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6b7g5" Jun 09 15:22:58.785328 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:58.785307 2611 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-f4m86\"" Jun 09 15:22:58.786248 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:58.786230 2611 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 09 15:22:58.786352 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:58.786238 2611 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 09 15:22:58.801034 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:58.800998 2611 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6b7g5"] Jun 09 15:22:58.890564 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:58.890527 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/64429271-3695-4cb9-82f3-ec0f94ff3fbf-tmp\") pod \"openshift-lws-operator-fd8ccff4c-6b7g5\" (UID: \"64429271-3695-4cb9-82f3-ec0f94ff3fbf\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6b7g5" Jun 09 15:22:58.890755 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:58.890596 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbgxr\" (UniqueName: \"kubernetes.io/projected/64429271-3695-4cb9-82f3-ec0f94ff3fbf-kube-api-access-cbgxr\") pod \"openshift-lws-operator-fd8ccff4c-6b7g5\" (UID: \"64429271-3695-4cb9-82f3-ec0f94ff3fbf\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6b7g5" Jun 09 15:22:58.991891 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:58.991847 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbgxr\" (UniqueName: \"kubernetes.io/projected/64429271-3695-4cb9-82f3-ec0f94ff3fbf-kube-api-access-cbgxr\") pod \"openshift-lws-operator-fd8ccff4c-6b7g5\" (UID: \"64429271-3695-4cb9-82f3-ec0f94ff3fbf\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6b7g5" Jun 09 15:22:58.992092 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:58.991919 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/64429271-3695-4cb9-82f3-ec0f94ff3fbf-tmp\") pod \"openshift-lws-operator-fd8ccff4c-6b7g5\" (UID: \"64429271-3695-4cb9-82f3-ec0f94ff3fbf\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6b7g5" Jun 09 15:22:58.992355 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:58.992332 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/64429271-3695-4cb9-82f3-ec0f94ff3fbf-tmp\") pod \"openshift-lws-operator-fd8ccff4c-6b7g5\" (UID: \"64429271-3695-4cb9-82f3-ec0f94ff3fbf\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6b7g5" Jun 09 15:22:59.001214 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:59.001192 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbgxr\" (UniqueName: \"kubernetes.io/projected/64429271-3695-4cb9-82f3-ec0f94ff3fbf-kube-api-access-cbgxr\") pod \"openshift-lws-operator-fd8ccff4c-6b7g5\" (UID: \"64429271-3695-4cb9-82f3-ec0f94ff3fbf\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6b7g5" Jun 09 15:22:59.092387 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:59.092293 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6b7g5" Jun 09 15:22:59.229987 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:59.229952 2611 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6b7g5"] Jun 09 15:22:59.232942 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:22:59.232914 2611 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod64429271_3695_4cb9_82f3_ec0f94ff3fbf.slice/crio-210816224fe568be3324b4300d260c20795ac67a74620fa0d31b19adfb167c6a WatchSource:0}: Error finding container 210816224fe568be3324b4300d260c20795ac67a74620fa0d31b19adfb167c6a: Status 404 returned error can't find the container with id 210816224fe568be3324b4300d260c20795ac67a74620fa0d31b19adfb167c6a Jun 09 15:22:59.580623 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:22:59.580584 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6b7g5" event={"ID":"64429271-3695-4cb9-82f3-ec0f94ff3fbf","Type":"ContainerStarted","Data":"210816224fe568be3324b4300d260c20795ac67a74620fa0d31b19adfb167c6a"} Jun 09 15:23:02.595716 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:02.595678 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6b7g5" event={"ID":"64429271-3695-4cb9-82f3-ec0f94ff3fbf","Type":"ContainerStarted","Data":"5cee3571c3161bbf2d76e6b6ef048df6f97176c805f4ae1a3625f64b8a8e21da"} Jun 09 15:23:02.620190 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:02.620116 2611 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6b7g5" podStartSLOduration=1.3571821210000001 podStartE2EDuration="4.620099984s" totalImagesPullingTime="3.262917863s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:22:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:23:02.618270859 +0000 UTC m=+503.423963080" watchObservedRunningTime="2026-06-09 15:23:02.620099984 +0000 UTC m=+503.425792203" Jun 09 15:23:06.366804 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:06.366766 2611 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdp5k2q"] Jun 09 15:23:06.369286 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:06.369261 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdp5k2q" Jun 09 15:23:06.371615 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:06.371592 2611 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 15:23:06.371749 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:06.371673 2611 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xcgzc\"" Jun 09 15:23:06.372555 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:06.372540 2611 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 15:23:06.377702 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:06.377673 2611 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdp5k2q"] Jun 09 15:23:06.552488 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:06.552439 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/98085375-ccb4-4d16-8ddb-07a42a0a67c4-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdp5k2q\" (UID: \"98085375-ccb4-4d16-8ddb-07a42a0a67c4\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdp5k2q" Jun 09 15:23:06.552488 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:06.552493 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/98085375-ccb4-4d16-8ddb-07a42a0a67c4-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdp5k2q\" (UID: \"98085375-ccb4-4d16-8ddb-07a42a0a67c4\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdp5k2q" Jun 09 15:23:06.552705 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:06.552528 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwznl\" (UniqueName: \"kubernetes.io/projected/98085375-ccb4-4d16-8ddb-07a42a0a67c4-kube-api-access-vwznl\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdp5k2q\" (UID: \"98085375-ccb4-4d16-8ddb-07a42a0a67c4\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdp5k2q" Jun 09 15:23:06.653990 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:06.653885 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/98085375-ccb4-4d16-8ddb-07a42a0a67c4-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdp5k2q\" (UID: \"98085375-ccb4-4d16-8ddb-07a42a0a67c4\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdp5k2q" Jun 09 15:23:06.653990 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:06.653949 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/98085375-ccb4-4d16-8ddb-07a42a0a67c4-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdp5k2q\" (UID: \"98085375-ccb4-4d16-8ddb-07a42a0a67c4\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdp5k2q" Jun 09 15:23:06.654276 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:06.653995 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwznl\" (UniqueName: \"kubernetes.io/projected/98085375-ccb4-4d16-8ddb-07a42a0a67c4-kube-api-access-vwznl\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdp5k2q\" (UID: \"98085375-ccb4-4d16-8ddb-07a42a0a67c4\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdp5k2q" Jun 09 15:23:06.654341 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:06.654307 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/98085375-ccb4-4d16-8ddb-07a42a0a67c4-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdp5k2q\" (UID: \"98085375-ccb4-4d16-8ddb-07a42a0a67c4\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdp5k2q" Jun 09 15:23:06.654399 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:06.654345 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/98085375-ccb4-4d16-8ddb-07a42a0a67c4-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdp5k2q\" (UID: \"98085375-ccb4-4d16-8ddb-07a42a0a67c4\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdp5k2q" Jun 09 15:23:06.662953 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:06.662919 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwznl\" (UniqueName: \"kubernetes.io/projected/98085375-ccb4-4d16-8ddb-07a42a0a67c4-kube-api-access-vwznl\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdp5k2q\" (UID: \"98085375-ccb4-4d16-8ddb-07a42a0a67c4\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdp5k2q" Jun 09 15:23:06.678844 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:06.678808 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdp5k2q" Jun 09 15:23:06.814601 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:06.814569 2611 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdp5k2q"] Jun 09 15:23:06.816956 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:23:06.816928 2611 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98085375_ccb4_4d16_8ddb_07a42a0a67c4.slice/crio-7f435447ee436aa03f677c9321843c331b8069b1adc4add5e5d56e1e20cbff66 WatchSource:0}: Error finding container 7f435447ee436aa03f677c9321843c331b8069b1adc4add5e5d56e1e20cbff66: Status 404 returned error can't find the container with id 7f435447ee436aa03f677c9321843c331b8069b1adc4add5e5d56e1e20cbff66 Jun 09 15:23:07.620021 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:07.619984 2611 generic.go:356] "Generic (PLEG): container finished" podID="98085375-ccb4-4d16-8ddb-07a42a0a67c4" containerID="4ec128146d68245a62f3387d58d45323b65ed53d4db5b99ecc5b19ea3c0ce587" exitCode=0 Jun 09 15:23:07.620516 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:07.620078 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdp5k2q" event={"ID":"98085375-ccb4-4d16-8ddb-07a42a0a67c4","Type":"ContainerDied","Data":"4ec128146d68245a62f3387d58d45323b65ed53d4db5b99ecc5b19ea3c0ce587"} Jun 09 15:23:07.620516 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:07.620128 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdp5k2q" event={"ID":"98085375-ccb4-4d16-8ddb-07a42a0a67c4","Type":"ContainerStarted","Data":"7f435447ee436aa03f677c9321843c331b8069b1adc4add5e5d56e1e20cbff66"} Jun 09 15:23:08.626479 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:08.626386 2611 generic.go:356] "Generic (PLEG): container finished" podID="98085375-ccb4-4d16-8ddb-07a42a0a67c4" containerID="ab42f94e2f14748fc0111b14db3345dcb1ed03de6ea906697eecbc349cfac9d5" exitCode=0 Jun 09 15:23:08.626845 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:08.626469 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdp5k2q" event={"ID":"98085375-ccb4-4d16-8ddb-07a42a0a67c4","Type":"ContainerDied","Data":"ab42f94e2f14748fc0111b14db3345dcb1ed03de6ea906697eecbc349cfac9d5"} Jun 09 15:23:09.633965 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:09.633924 2611 generic.go:356] "Generic (PLEG): container finished" podID="98085375-ccb4-4d16-8ddb-07a42a0a67c4" containerID="03e19fd5055a41b01bcd0fee27f56137fff83d82e7279c0e00a70d074889e2cb" exitCode=0 Jun 09 15:23:09.634415 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:09.634006 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdp5k2q" event={"ID":"98085375-ccb4-4d16-8ddb-07a42a0a67c4","Type":"ContainerDied","Data":"03e19fd5055a41b01bcd0fee27f56137fff83d82e7279c0e00a70d074889e2cb"} Jun 09 15:23:10.771964 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:10.771938 2611 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdp5k2q" Jun 09 15:23:10.891955 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:10.891866 2611 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/98085375-ccb4-4d16-8ddb-07a42a0a67c4-bundle\") pod \"98085375-ccb4-4d16-8ddb-07a42a0a67c4\" (UID: \"98085375-ccb4-4d16-8ddb-07a42a0a67c4\") " Jun 09 15:23:10.891955 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:10.891938 2611 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vwznl\" (UniqueName: \"kubernetes.io/projected/98085375-ccb4-4d16-8ddb-07a42a0a67c4-kube-api-access-vwznl\") pod \"98085375-ccb4-4d16-8ddb-07a42a0a67c4\" (UID: \"98085375-ccb4-4d16-8ddb-07a42a0a67c4\") " Jun 09 15:23:10.892152 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:10.891963 2611 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/98085375-ccb4-4d16-8ddb-07a42a0a67c4-util\") pod \"98085375-ccb4-4d16-8ddb-07a42a0a67c4\" (UID: \"98085375-ccb4-4d16-8ddb-07a42a0a67c4\") " Jun 09 15:23:10.892609 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:10.892565 2611 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98085375-ccb4-4d16-8ddb-07a42a0a67c4-bundle" (OuterVolumeSpecName: "bundle") pod "98085375-ccb4-4d16-8ddb-07a42a0a67c4" (UID: "98085375-ccb4-4d16-8ddb-07a42a0a67c4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 15:23:10.894034 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:10.894001 2611 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98085375-ccb4-4d16-8ddb-07a42a0a67c4-kube-api-access-vwznl" (OuterVolumeSpecName: "kube-api-access-vwznl") pod "98085375-ccb4-4d16-8ddb-07a42a0a67c4" (UID: "98085375-ccb4-4d16-8ddb-07a42a0a67c4"). InnerVolumeSpecName "kube-api-access-vwznl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 15:23:10.897491 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:10.897469 2611 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98085375-ccb4-4d16-8ddb-07a42a0a67c4-util" (OuterVolumeSpecName: "util") pod "98085375-ccb4-4d16-8ddb-07a42a0a67c4" (UID: "98085375-ccb4-4d16-8ddb-07a42a0a67c4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 15:23:10.993204 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:10.993147 2611 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vwznl\" (UniqueName: \"kubernetes.io/projected/98085375-ccb4-4d16-8ddb-07a42a0a67c4-kube-api-access-vwznl\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 09 15:23:10.993204 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:10.993196 2611 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/98085375-ccb4-4d16-8ddb-07a42a0a67c4-util\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 09 15:23:10.993204 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:10.993208 2611 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/98085375-ccb4-4d16-8ddb-07a42a0a67c4-bundle\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 09 15:23:11.644426 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:11.644394 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdp5k2q" event={"ID":"98085375-ccb4-4d16-8ddb-07a42a0a67c4","Type":"ContainerDied","Data":"7f435447ee436aa03f677c9321843c331b8069b1adc4add5e5d56e1e20cbff66"} Jun 09 15:23:11.644583 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:11.644438 2611 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdp5k2q" Jun 09 15:23:11.644583 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:11.644447 2611 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7f435447ee436aa03f677c9321843c331b8069b1adc4add5e5d56e1e20cbff66" Jun 09 15:23:21.902173 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:21.902131 2611 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-f5f495f5c-x2f56"] Jun 09 15:23:21.902575 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:21.902437 2611 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98085375-ccb4-4d16-8ddb-07a42a0a67c4" containerName="extract" Jun 09 15:23:21.902575 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:21.902449 2611 state_mem.go:107] "Deleted CPUSet assignment" podUID="98085375-ccb4-4d16-8ddb-07a42a0a67c4" containerName="extract" Jun 09 15:23:21.902575 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:21.902464 2611 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98085375-ccb4-4d16-8ddb-07a42a0a67c4" containerName="util" Jun 09 15:23:21.902575 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:21.902469 2611 state_mem.go:107] "Deleted CPUSet assignment" podUID="98085375-ccb4-4d16-8ddb-07a42a0a67c4" containerName="util" Jun 09 15:23:21.902575 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:21.902483 2611 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98085375-ccb4-4d16-8ddb-07a42a0a67c4" containerName="pull" Jun 09 15:23:21.902575 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:21.902489 2611 state_mem.go:107] "Deleted CPUSet assignment" podUID="98085375-ccb4-4d16-8ddb-07a42a0a67c4" containerName="pull" Jun 09 15:23:21.902575 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:21.902540 2611 memory_manager.go:368] "RemoveStaleState removing state" podUID="98085375-ccb4-4d16-8ddb-07a42a0a67c4" containerName="extract" Jun 09 15:23:21.909348 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:21.909315 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-f5f495f5c-x2f56" Jun 09 15:23:21.913084 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:21.913058 2611 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 09 15:23:21.913263 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:21.913211 2611 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 09 15:23:21.913328 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:21.913275 2611 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 09 15:23:21.913919 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:21.913898 2611 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-d92l8\"" Jun 09 15:23:21.913919 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:21.913919 2611 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 09 15:23:21.919979 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:21.919955 2611 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-f5f495f5c-x2f56"] Jun 09 15:23:21.980019 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:21.979984 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3f79969f-a29c-4b5e-8d75-91aac69cf584-manifests\") pod \"opendatahub-operator-controller-manager-f5f495f5c-x2f56\" (UID: \"3f79969f-a29c-4b5e-8d75-91aac69cf584\") " pod="opendatahub/opendatahub-operator-controller-manager-f5f495f5c-x2f56" Jun 09 15:23:21.980019 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:21.980021 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3f79969f-a29c-4b5e-8d75-91aac69cf584-apiservice-cert\") pod \"opendatahub-operator-controller-manager-f5f495f5c-x2f56\" (UID: \"3f79969f-a29c-4b5e-8d75-91aac69cf584\") " pod="opendatahub/opendatahub-operator-controller-manager-f5f495f5c-x2f56" Jun 09 15:23:21.980241 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:21.980058 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhlh2\" (UniqueName: \"kubernetes.io/projected/3f79969f-a29c-4b5e-8d75-91aac69cf584-kube-api-access-jhlh2\") pod \"opendatahub-operator-controller-manager-f5f495f5c-x2f56\" (UID: \"3f79969f-a29c-4b5e-8d75-91aac69cf584\") " pod="opendatahub/opendatahub-operator-controller-manager-f5f495f5c-x2f56" Jun 09 15:23:21.980241 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:21.980112 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3f79969f-a29c-4b5e-8d75-91aac69cf584-tmp\") pod \"opendatahub-operator-controller-manager-f5f495f5c-x2f56\" (UID: \"3f79969f-a29c-4b5e-8d75-91aac69cf584\") " pod="opendatahub/opendatahub-operator-controller-manager-f5f495f5c-x2f56" Jun 09 15:23:21.980241 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:21.980205 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3f79969f-a29c-4b5e-8d75-91aac69cf584-webhook-cert\") pod \"opendatahub-operator-controller-manager-f5f495f5c-x2f56\" (UID: \"3f79969f-a29c-4b5e-8d75-91aac69cf584\") " pod="opendatahub/opendatahub-operator-controller-manager-f5f495f5c-x2f56" Jun 09 15:23:22.080587 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:22.080541 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3f79969f-a29c-4b5e-8d75-91aac69cf584-apiservice-cert\") pod \"opendatahub-operator-controller-manager-f5f495f5c-x2f56\" (UID: \"3f79969f-a29c-4b5e-8d75-91aac69cf584\") " pod="opendatahub/opendatahub-operator-controller-manager-f5f495f5c-x2f56" Jun 09 15:23:22.080771 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:22.080602 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhlh2\" (UniqueName: \"kubernetes.io/projected/3f79969f-a29c-4b5e-8d75-91aac69cf584-kube-api-access-jhlh2\") pod \"opendatahub-operator-controller-manager-f5f495f5c-x2f56\" (UID: \"3f79969f-a29c-4b5e-8d75-91aac69cf584\") " pod="opendatahub/opendatahub-operator-controller-manager-f5f495f5c-x2f56" Jun 09 15:23:22.080771 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:22.080633 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3f79969f-a29c-4b5e-8d75-91aac69cf584-tmp\") pod \"opendatahub-operator-controller-manager-f5f495f5c-x2f56\" (UID: \"3f79969f-a29c-4b5e-8d75-91aac69cf584\") " pod="opendatahub/opendatahub-operator-controller-manager-f5f495f5c-x2f56" Jun 09 15:23:22.080771 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:22.080675 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3f79969f-a29c-4b5e-8d75-91aac69cf584-webhook-cert\") pod \"opendatahub-operator-controller-manager-f5f495f5c-x2f56\" (UID: \"3f79969f-a29c-4b5e-8d75-91aac69cf584\") " pod="opendatahub/opendatahub-operator-controller-manager-f5f495f5c-x2f56" Jun 09 15:23:22.080771 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:22.080708 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3f79969f-a29c-4b5e-8d75-91aac69cf584-manifests\") pod \"opendatahub-operator-controller-manager-f5f495f5c-x2f56\" (UID: \"3f79969f-a29c-4b5e-8d75-91aac69cf584\") " pod="opendatahub/opendatahub-operator-controller-manager-f5f495f5c-x2f56" Jun 09 15:23:22.081181 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:22.081136 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3f79969f-a29c-4b5e-8d75-91aac69cf584-manifests\") pod \"opendatahub-operator-controller-manager-f5f495f5c-x2f56\" (UID: \"3f79969f-a29c-4b5e-8d75-91aac69cf584\") " pod="opendatahub/opendatahub-operator-controller-manager-f5f495f5c-x2f56" Jun 09 15:23:22.082895 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:22.082864 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3f79969f-a29c-4b5e-8d75-91aac69cf584-tmp\") pod \"opendatahub-operator-controller-manager-f5f495f5c-x2f56\" (UID: \"3f79969f-a29c-4b5e-8d75-91aac69cf584\") " pod="opendatahub/opendatahub-operator-controller-manager-f5f495f5c-x2f56" Jun 09 15:23:22.083125 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:22.083106 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3f79969f-a29c-4b5e-8d75-91aac69cf584-apiservice-cert\") pod \"opendatahub-operator-controller-manager-f5f495f5c-x2f56\" (UID: \"3f79969f-a29c-4b5e-8d75-91aac69cf584\") " pod="opendatahub/opendatahub-operator-controller-manager-f5f495f5c-x2f56" Jun 09 15:23:22.083125 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:22.083117 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3f79969f-a29c-4b5e-8d75-91aac69cf584-webhook-cert\") pod \"opendatahub-operator-controller-manager-f5f495f5c-x2f56\" (UID: \"3f79969f-a29c-4b5e-8d75-91aac69cf584\") " pod="opendatahub/opendatahub-operator-controller-manager-f5f495f5c-x2f56" Jun 09 15:23:22.090033 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:22.090004 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhlh2\" (UniqueName: \"kubernetes.io/projected/3f79969f-a29c-4b5e-8d75-91aac69cf584-kube-api-access-jhlh2\") pod \"opendatahub-operator-controller-manager-f5f495f5c-x2f56\" (UID: \"3f79969f-a29c-4b5e-8d75-91aac69cf584\") " pod="opendatahub/opendatahub-operator-controller-manager-f5f495f5c-x2f56" Jun 09 15:23:22.221377 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:22.221335 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-f5f495f5c-x2f56" Jun 09 15:23:22.385359 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:22.385326 2611 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-f5f495f5c-x2f56"] Jun 09 15:23:22.388066 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:23:22.388030 2611 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f79969f_a29c_4b5e_8d75_91aac69cf584.slice/crio-c30d944f790eec16829c156df373c8a290c4ffbe8010592f041666902569eee7 WatchSource:0}: Error finding container c30d944f790eec16829c156df373c8a290c4ffbe8010592f041666902569eee7: Status 404 returned error can't find the container with id c30d944f790eec16829c156df373c8a290c4ffbe8010592f041666902569eee7 Jun 09 15:23:22.692716 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:22.692685 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f5f495f5c-x2f56" event={"ID":"3f79969f-a29c-4b5e-8d75-91aac69cf584","Type":"ContainerStarted","Data":"c30d944f790eec16829c156df373c8a290c4ffbe8010592f041666902569eee7"} Jun 09 15:23:25.709274 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:25.709233 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f5f495f5c-x2f56" event={"ID":"3f79969f-a29c-4b5e-8d75-91aac69cf584","Type":"ContainerStarted","Data":"dae5066ad85c333ed8091141c8a78ebfc7c68ea8077e0b296ff006920b32a325"} Jun 09 15:23:26.720524 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:26.720485 2611 generic.go:356] "Generic (PLEG): container finished" podID="3f79969f-a29c-4b5e-8d75-91aac69cf584" containerID="dae5066ad85c333ed8091141c8a78ebfc7c68ea8077e0b296ff006920b32a325" exitCode=0 Jun 09 15:23:26.720524 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:26.720527 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f5f495f5c-x2f56" event={"ID":"3f79969f-a29c-4b5e-8d75-91aac69cf584","Type":"ContainerDied","Data":"dae5066ad85c333ed8091141c8a78ebfc7c68ea8077e0b296ff006920b32a325"} Jun 09 15:23:27.727448 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:27.727411 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f5f495f5c-x2f56" event={"ID":"3f79969f-a29c-4b5e-8d75-91aac69cf584","Type":"ContainerStarted","Data":"a1fa3107f59aef58674ddb2c7cd019486ca3c6f0313beecc187f11e87f482ba8"} Jun 09 15:23:27.727821 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:27.727499 2611 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-f5f495f5c-x2f56" Jun 09 15:23:27.749105 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:27.749046 2611 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-f5f495f5c-x2f56" podStartSLOduration=2.4953355999999998 podStartE2EDuration="6.749030893s" totalImagesPullingTime="3.204349185s" totalInitContainerRuntime="1.049346108s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:23:21 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:23:27.74766349 +0000 UTC m=+528.553355720" watchObservedRunningTime="2026-06-09 15:23:27.749030893 +0000 UTC m=+528.554723195" Jun 09 15:23:38.733975 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:38.733937 2611 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-f5f495f5c-x2f56" Jun 09 15:23:40.898105 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:40.898070 2611 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-zfdwp"] Jun 09 15:23:40.903487 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:40.903461 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-zfdwp" Jun 09 15:23:40.905791 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:40.905769 2611 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 09 15:23:40.905860 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:40.905806 2611 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-5zxwk\"" Jun 09 15:23:40.913694 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:40.913663 2611 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-zfdwp"] Jun 09 15:23:41.040977 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:41.040940 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6s7lq\" (UniqueName: \"kubernetes.io/projected/c003e891-cb17-468f-a272-cdeddf520495-kube-api-access-6s7lq\") pod \"odh-model-controller-6dc94f689f-zfdwp\" (UID: \"c003e891-cb17-468f-a272-cdeddf520495\") " pod="opendatahub/odh-model-controller-6dc94f689f-zfdwp" Jun 09 15:23:41.041197 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:41.040982 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c003e891-cb17-468f-a272-cdeddf520495-cert\") pod \"odh-model-controller-6dc94f689f-zfdwp\" (UID: \"c003e891-cb17-468f-a272-cdeddf520495\") " pod="opendatahub/odh-model-controller-6dc94f689f-zfdwp" Jun 09 15:23:41.142146 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:41.142101 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6s7lq\" (UniqueName: \"kubernetes.io/projected/c003e891-cb17-468f-a272-cdeddf520495-kube-api-access-6s7lq\") pod \"odh-model-controller-6dc94f689f-zfdwp\" (UID: \"c003e891-cb17-468f-a272-cdeddf520495\") " pod="opendatahub/odh-model-controller-6dc94f689f-zfdwp" Jun 09 15:23:41.142378 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:41.142152 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c003e891-cb17-468f-a272-cdeddf520495-cert\") pod \"odh-model-controller-6dc94f689f-zfdwp\" (UID: \"c003e891-cb17-468f-a272-cdeddf520495\") " pod="opendatahub/odh-model-controller-6dc94f689f-zfdwp" Jun 09 15:23:41.142378 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:23:41.142313 2611 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 09 15:23:41.142476 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:23:41.142401 2611 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c003e891-cb17-468f-a272-cdeddf520495-cert podName:c003e891-cb17-468f-a272-cdeddf520495 nodeName:}" failed. No retries permitted until 2026-06-09 15:23:41.642382912 +0000 UTC m=+542.448075108 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c003e891-cb17-468f-a272-cdeddf520495-cert") pod "odh-model-controller-6dc94f689f-zfdwp" (UID: "c003e891-cb17-468f-a272-cdeddf520495") : secret "odh-model-controller-webhook-cert" not found Jun 09 15:23:41.157350 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:41.157284 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6s7lq\" (UniqueName: \"kubernetes.io/projected/c003e891-cb17-468f-a272-cdeddf520495-kube-api-access-6s7lq\") pod \"odh-model-controller-6dc94f689f-zfdwp\" (UID: \"c003e891-cb17-468f-a272-cdeddf520495\") " pod="opendatahub/odh-model-controller-6dc94f689f-zfdwp" Jun 09 15:23:41.458300 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:41.458260 2611 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-ssqnd"] Jun 09 15:23:41.460696 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:41.460677 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-ssqnd" Jun 09 15:23:41.463145 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:41.463122 2611 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 09 15:23:41.480558 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:41.480525 2611 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-ssqnd"] Jun 09 15:23:41.545408 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:41.545369 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnggq\" (UniqueName: \"kubernetes.io/projected/96e42b6a-8596-4bae-b7d9-4a50674e1946-kube-api-access-nnggq\") pod \"model-serving-api-5dd488fc48-ssqnd\" (UID: \"96e42b6a-8596-4bae-b7d9-4a50674e1946\") " pod="opendatahub/model-serving-api-5dd488fc48-ssqnd" Jun 09 15:23:41.545584 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:41.545429 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/96e42b6a-8596-4bae-b7d9-4a50674e1946-tls-certs\") pod \"model-serving-api-5dd488fc48-ssqnd\" (UID: \"96e42b6a-8596-4bae-b7d9-4a50674e1946\") " pod="opendatahub/model-serving-api-5dd488fc48-ssqnd" Jun 09 15:23:41.646490 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:41.646454 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/96e42b6a-8596-4bae-b7d9-4a50674e1946-tls-certs\") pod \"model-serving-api-5dd488fc48-ssqnd\" (UID: \"96e42b6a-8596-4bae-b7d9-4a50674e1946\") " pod="opendatahub/model-serving-api-5dd488fc48-ssqnd" Jun 09 15:23:41.646683 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:41.646531 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c003e891-cb17-468f-a272-cdeddf520495-cert\") pod \"odh-model-controller-6dc94f689f-zfdwp\" (UID: \"c003e891-cb17-468f-a272-cdeddf520495\") " pod="opendatahub/odh-model-controller-6dc94f689f-zfdwp" Jun 09 15:23:41.646683 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:41.646596 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnggq\" (UniqueName: \"kubernetes.io/projected/96e42b6a-8596-4bae-b7d9-4a50674e1946-kube-api-access-nnggq\") pod \"model-serving-api-5dd488fc48-ssqnd\" (UID: \"96e42b6a-8596-4bae-b7d9-4a50674e1946\") " pod="opendatahub/model-serving-api-5dd488fc48-ssqnd" Jun 09 15:23:41.649704 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:41.649671 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c003e891-cb17-468f-a272-cdeddf520495-cert\") pod \"odh-model-controller-6dc94f689f-zfdwp\" (UID: \"c003e891-cb17-468f-a272-cdeddf520495\") " pod="opendatahub/odh-model-controller-6dc94f689f-zfdwp" Jun 09 15:23:41.649859 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:41.649671 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/96e42b6a-8596-4bae-b7d9-4a50674e1946-tls-certs\") pod \"model-serving-api-5dd488fc48-ssqnd\" (UID: \"96e42b6a-8596-4bae-b7d9-4a50674e1946\") " pod="opendatahub/model-serving-api-5dd488fc48-ssqnd" Jun 09 15:23:41.657883 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:41.657859 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnggq\" (UniqueName: \"kubernetes.io/projected/96e42b6a-8596-4bae-b7d9-4a50674e1946-kube-api-access-nnggq\") pod \"model-serving-api-5dd488fc48-ssqnd\" (UID: \"96e42b6a-8596-4bae-b7d9-4a50674e1946\") " pod="opendatahub/model-serving-api-5dd488fc48-ssqnd" Jun 09 15:23:41.770941 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:41.770849 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-ssqnd" Jun 09 15:23:41.815466 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:41.815423 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-zfdwp" Jun 09 15:23:41.915087 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:41.914787 2611 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-ssqnd"] Jun 09 15:23:41.918297 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:23:41.918209 2611 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96e42b6a_8596_4bae_b7d9_4a50674e1946.slice/crio-5883abb6a4596cb36d2497ec7e51c99de946a90230b31207f078bc92e75b8cee WatchSource:0}: Error finding container 5883abb6a4596cb36d2497ec7e51c99de946a90230b31207f078bc92e75b8cee: Status 404 returned error can't find the container with id 5883abb6a4596cb36d2497ec7e51c99de946a90230b31207f078bc92e75b8cee Jun 09 15:23:41.963769 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:41.963740 2611 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-zfdwp"] Jun 09 15:23:41.966328 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:23:41.966286 2611 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc003e891_cb17_468f_a272_cdeddf520495.slice/crio-8d6bfb8ac51cd249eb4c662e5c1e0d9e8375d79a4ef6000369a5dbec70064534 WatchSource:0}: Error finding container 8d6bfb8ac51cd249eb4c662e5c1e0d9e8375d79a4ef6000369a5dbec70064534: Status 404 returned error can't find the container with id 8d6bfb8ac51cd249eb4c662e5c1e0d9e8375d79a4ef6000369a5dbec70064534 Jun 09 15:23:42.798673 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:42.798622 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-zfdwp" event={"ID":"c003e891-cb17-468f-a272-cdeddf520495","Type":"ContainerStarted","Data":"8d6bfb8ac51cd249eb4c662e5c1e0d9e8375d79a4ef6000369a5dbec70064534"} Jun 09 15:23:42.800961 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:42.800926 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-ssqnd" event={"ID":"96e42b6a-8596-4bae-b7d9-4a50674e1946","Type":"ContainerStarted","Data":"5883abb6a4596cb36d2497ec7e51c99de946a90230b31207f078bc92e75b8cee"} Jun 09 15:23:46.073696 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:46.073611 2611 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5dcd85bb64-nvhjb"] Jun 09 15:23:46.075925 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:46.075907 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5dcd85bb64-nvhjb" Jun 09 15:23:46.078808 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:46.078781 2611 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 09 15:23:46.078808 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:46.078805 2611 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 09 15:23:46.087452 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:46.087421 2611 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5dcd85bb64-nvhjb"] Jun 09 15:23:46.190993 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:46.190945 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/edd3056b-a539-4665-a517-9ac78f5d9d9f-tls-certs\") pod \"kube-auth-proxy-5dcd85bb64-nvhjb\" (UID: \"edd3056b-a539-4665-a517-9ac78f5d9d9f\") " pod="openshift-ingress/kube-auth-proxy-5dcd85bb64-nvhjb" Jun 09 15:23:46.190993 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:46.190992 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5t9p9\" (UniqueName: \"kubernetes.io/projected/edd3056b-a539-4665-a517-9ac78f5d9d9f-kube-api-access-5t9p9\") pod \"kube-auth-proxy-5dcd85bb64-nvhjb\" (UID: \"edd3056b-a539-4665-a517-9ac78f5d9d9f\") " pod="openshift-ingress/kube-auth-proxy-5dcd85bb64-nvhjb" Jun 09 15:23:46.191249 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:46.191054 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/edd3056b-a539-4665-a517-9ac78f5d9d9f-tmp\") pod \"kube-auth-proxy-5dcd85bb64-nvhjb\" (UID: \"edd3056b-a539-4665-a517-9ac78f5d9d9f\") " pod="openshift-ingress/kube-auth-proxy-5dcd85bb64-nvhjb" Jun 09 15:23:46.292501 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:46.292465 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/edd3056b-a539-4665-a517-9ac78f5d9d9f-tls-certs\") pod \"kube-auth-proxy-5dcd85bb64-nvhjb\" (UID: \"edd3056b-a539-4665-a517-9ac78f5d9d9f\") " pod="openshift-ingress/kube-auth-proxy-5dcd85bb64-nvhjb" Jun 09 15:23:46.292707 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:46.292515 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5t9p9\" (UniqueName: \"kubernetes.io/projected/edd3056b-a539-4665-a517-9ac78f5d9d9f-kube-api-access-5t9p9\") pod \"kube-auth-proxy-5dcd85bb64-nvhjb\" (UID: \"edd3056b-a539-4665-a517-9ac78f5d9d9f\") " pod="openshift-ingress/kube-auth-proxy-5dcd85bb64-nvhjb" Jun 09 15:23:46.292776 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:46.292710 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/edd3056b-a539-4665-a517-9ac78f5d9d9f-tmp\") pod \"kube-auth-proxy-5dcd85bb64-nvhjb\" (UID: \"edd3056b-a539-4665-a517-9ac78f5d9d9f\") " pod="openshift-ingress/kube-auth-proxy-5dcd85bb64-nvhjb" Jun 09 15:23:46.295053 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:46.295016 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/edd3056b-a539-4665-a517-9ac78f5d9d9f-tmp\") pod \"kube-auth-proxy-5dcd85bb64-nvhjb\" (UID: \"edd3056b-a539-4665-a517-9ac78f5d9d9f\") " pod="openshift-ingress/kube-auth-proxy-5dcd85bb64-nvhjb" Jun 09 15:23:46.295216 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:46.295197 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/edd3056b-a539-4665-a517-9ac78f5d9d9f-tls-certs\") pod \"kube-auth-proxy-5dcd85bb64-nvhjb\" (UID: \"edd3056b-a539-4665-a517-9ac78f5d9d9f\") " pod="openshift-ingress/kube-auth-proxy-5dcd85bb64-nvhjb" Jun 09 15:23:46.300887 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:46.300859 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5t9p9\" (UniqueName: \"kubernetes.io/projected/edd3056b-a539-4665-a517-9ac78f5d9d9f-kube-api-access-5t9p9\") pod \"kube-auth-proxy-5dcd85bb64-nvhjb\" (UID: \"edd3056b-a539-4665-a517-9ac78f5d9d9f\") " pod="openshift-ingress/kube-auth-proxy-5dcd85bb64-nvhjb" Jun 09 15:23:46.312547 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:46.312512 2611 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067rt8d"] Jun 09 15:23:46.315329 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:46.315299 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067rt8d" Jun 09 15:23:46.317726 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:46.317693 2611 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 15:23:46.317872 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:46.317740 2611 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xcgzc\"" Jun 09 15:23:46.317955 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:46.317935 2611 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 15:23:46.324801 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:46.324771 2611 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067rt8d"] Jun 09 15:23:46.386703 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:46.386662 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5dcd85bb64-nvhjb" Jun 09 15:23:46.393435 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:46.393403 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ae56acca-793d-43fb-96b2-679334578616-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067rt8d\" (UID: \"ae56acca-793d-43fb-96b2-679334578616\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067rt8d" Jun 09 15:23:46.393586 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:46.393445 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ae56acca-793d-43fb-96b2-679334578616-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067rt8d\" (UID: \"ae56acca-793d-43fb-96b2-679334578616\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067rt8d" Jun 09 15:23:46.393586 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:46.393484 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqqp4\" (UniqueName: \"kubernetes.io/projected/ae56acca-793d-43fb-96b2-679334578616-kube-api-access-cqqp4\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067rt8d\" (UID: \"ae56acca-793d-43fb-96b2-679334578616\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067rt8d" Jun 09 15:23:46.494333 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:46.494292 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ae56acca-793d-43fb-96b2-679334578616-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067rt8d\" (UID: \"ae56acca-793d-43fb-96b2-679334578616\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067rt8d" Jun 09 15:23:46.494483 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:46.494378 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ae56acca-793d-43fb-96b2-679334578616-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067rt8d\" (UID: \"ae56acca-793d-43fb-96b2-679334578616\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067rt8d" Jun 09 15:23:46.494483 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:46.494426 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqqp4\" (UniqueName: \"kubernetes.io/projected/ae56acca-793d-43fb-96b2-679334578616-kube-api-access-cqqp4\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067rt8d\" (UID: \"ae56acca-793d-43fb-96b2-679334578616\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067rt8d" Jun 09 15:23:46.494748 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:46.494727 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ae56acca-793d-43fb-96b2-679334578616-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067rt8d\" (UID: \"ae56acca-793d-43fb-96b2-679334578616\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067rt8d" Jun 09 15:23:46.494805 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:46.494765 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ae56acca-793d-43fb-96b2-679334578616-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067rt8d\" (UID: \"ae56acca-793d-43fb-96b2-679334578616\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067rt8d" Jun 09 15:23:46.505264 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:46.505204 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqqp4\" (UniqueName: \"kubernetes.io/projected/ae56acca-793d-43fb-96b2-679334578616-kube-api-access-cqqp4\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067rt8d\" (UID: \"ae56acca-793d-43fb-96b2-679334578616\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067rt8d" Jun 09 15:23:46.534251 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:46.534208 2611 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5dcd85bb64-nvhjb"] Jun 09 15:23:46.536703 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:23:46.536671 2611 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedd3056b_a539_4665_a517_9ac78f5d9d9f.slice/crio-bba53e34e55bc8c8b43ba6ae74659ea1e719cf9c6399fbe8c8c17c93d4460d33 WatchSource:0}: Error finding container bba53e34e55bc8c8b43ba6ae74659ea1e719cf9c6399fbe8c8c17c93d4460d33: Status 404 returned error can't find the container with id bba53e34e55bc8c8b43ba6ae74659ea1e719cf9c6399fbe8c8c17c93d4460d33 Jun 09 15:23:46.627452 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:46.627369 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067rt8d" Jun 09 15:23:46.773775 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:46.769189 2611 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067rt8d"] Jun 09 15:23:46.775811 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:23:46.775776 2611 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae56acca_793d_43fb_96b2_679334578616.slice/crio-83bf2ce5e3b3bdba1e1d251c35e84f416d88a8c7a4f45542f5a08237f0b8f78e WatchSource:0}: Error finding container 83bf2ce5e3b3bdba1e1d251c35e84f416d88a8c7a4f45542f5a08237f0b8f78e: Status 404 returned error can't find the container with id 83bf2ce5e3b3bdba1e1d251c35e84f416d88a8c7a4f45542f5a08237f0b8f78e Jun 09 15:23:46.823643 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:46.823612 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067rt8d" event={"ID":"ae56acca-793d-43fb-96b2-679334578616","Type":"ContainerStarted","Data":"83bf2ce5e3b3bdba1e1d251c35e84f416d88a8c7a4f45542f5a08237f0b8f78e"} Jun 09 15:23:46.824953 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:46.824920 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5dcd85bb64-nvhjb" event={"ID":"edd3056b-a539-4665-a517-9ac78f5d9d9f","Type":"ContainerStarted","Data":"bba53e34e55bc8c8b43ba6ae74659ea1e719cf9c6399fbe8c8c17c93d4460d33"} Jun 09 15:23:46.826334 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:46.826300 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-zfdwp" event={"ID":"c003e891-cb17-468f-a272-cdeddf520495","Type":"ContainerStarted","Data":"f242672ef4195ad68a72cd89319da0d3b5b3936209bce23c405c2fd0bfdf9a9b"} Jun 09 15:23:46.826456 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:46.826415 2611 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-zfdwp" Jun 09 15:23:46.827817 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:46.827795 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-ssqnd" event={"ID":"96e42b6a-8596-4bae-b7d9-4a50674e1946","Type":"ContainerStarted","Data":"2c37706efb37ed831f31e240958afe08f36ea5c588c644c47867e89c63b75d15"} Jun 09 15:23:46.827955 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:46.827936 2611 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-ssqnd" Jun 09 15:23:46.842389 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:46.842332 2611 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-zfdwp" podStartSLOduration=3.034311227 podStartE2EDuration="6.842314974s" totalImagesPullingTime="3.808003747s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:23:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:23:46.841240294 +0000 UTC m=+547.646932516" watchObservedRunningTime="2026-06-09 15:23:46.842314974 +0000 UTC m=+547.648007175" Jun 09 15:23:46.858587 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:46.858526 2611 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-ssqnd" podStartSLOduration=2.013684193 podStartE2EDuration="5.85850724s" totalImagesPullingTime="3.844823047s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:23:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:23:46.856000677 +0000 UTC m=+547.661692897" watchObservedRunningTime="2026-06-09 15:23:46.85850724 +0000 UTC m=+547.664199458" Jun 09 15:23:47.834068 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:47.834029 2611 generic.go:356] "Generic (PLEG): container finished" podID="ae56acca-793d-43fb-96b2-679334578616" containerID="0e9b760b471fc532a265b21c94edb736f7172c835ca7dad51ab99bec9d981677" exitCode=0 Jun 09 15:23:47.834529 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:47.834117 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067rt8d" event={"ID":"ae56acca-793d-43fb-96b2-679334578616","Type":"ContainerDied","Data":"0e9b760b471fc532a265b21c94edb736f7172c835ca7dad51ab99bec9d981677"} Jun 09 15:23:48.840400 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:48.840361 2611 generic.go:356] "Generic (PLEG): container finished" podID="ae56acca-793d-43fb-96b2-679334578616" containerID="30a7e753a8bd403aebdc5bb8faffe9cd85c065384a503fc619cbdecc6acd3581" exitCode=0 Jun 09 15:23:48.840831 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:48.840446 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067rt8d" event={"ID":"ae56acca-793d-43fb-96b2-679334578616","Type":"ContainerDied","Data":"30a7e753a8bd403aebdc5bb8faffe9cd85c065384a503fc619cbdecc6acd3581"} Jun 09 15:23:49.276401 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:49.276355 2611 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-565556b8fb-fm7gh"] Jun 09 15:23:49.279351 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:49.279314 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-565556b8fb-fm7gh" Jun 09 15:23:49.281754 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:49.281723 2611 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 09 15:23:49.281888 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:49.281723 2611 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 09 15:23:49.281888 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:49.281723 2611 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-swczv\"" Jun 09 15:23:49.282571 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:49.282542 2611 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 09 15:23:49.289032 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:49.289005 2611 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-565556b8fb-fm7gh"] Jun 09 15:23:49.427441 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:49.427403 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/db76c3ec-725e-4b8e-b18f-a2b8f8665547-cert\") pod \"lws-controller-manager-565556b8fb-fm7gh\" (UID: \"db76c3ec-725e-4b8e-b18f-a2b8f8665547\") " pod="openshift-lws-operator/lws-controller-manager-565556b8fb-fm7gh" Jun 09 15:23:49.427619 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:49.427458 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/db76c3ec-725e-4b8e-b18f-a2b8f8665547-metrics-cert\") pod \"lws-controller-manager-565556b8fb-fm7gh\" (UID: \"db76c3ec-725e-4b8e-b18f-a2b8f8665547\") " pod="openshift-lws-operator/lws-controller-manager-565556b8fb-fm7gh" Jun 09 15:23:49.427619 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:49.427500 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/db76c3ec-725e-4b8e-b18f-a2b8f8665547-manager-config\") pod \"lws-controller-manager-565556b8fb-fm7gh\" (UID: \"db76c3ec-725e-4b8e-b18f-a2b8f8665547\") " pod="openshift-lws-operator/lws-controller-manager-565556b8fb-fm7gh" Jun 09 15:23:49.427619 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:49.427573 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdb6z\" (UniqueName: \"kubernetes.io/projected/db76c3ec-725e-4b8e-b18f-a2b8f8665547-kube-api-access-jdb6z\") pod \"lws-controller-manager-565556b8fb-fm7gh\" (UID: \"db76c3ec-725e-4b8e-b18f-a2b8f8665547\") " pod="openshift-lws-operator/lws-controller-manager-565556b8fb-fm7gh" Jun 09 15:23:49.529061 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:49.528621 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/db76c3ec-725e-4b8e-b18f-a2b8f8665547-cert\") pod \"lws-controller-manager-565556b8fb-fm7gh\" (UID: \"db76c3ec-725e-4b8e-b18f-a2b8f8665547\") " pod="openshift-lws-operator/lws-controller-manager-565556b8fb-fm7gh" Jun 09 15:23:49.529061 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:49.528681 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/db76c3ec-725e-4b8e-b18f-a2b8f8665547-metrics-cert\") pod \"lws-controller-manager-565556b8fb-fm7gh\" (UID: \"db76c3ec-725e-4b8e-b18f-a2b8f8665547\") " pod="openshift-lws-operator/lws-controller-manager-565556b8fb-fm7gh" Jun 09 15:23:49.529061 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:49.528716 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/db76c3ec-725e-4b8e-b18f-a2b8f8665547-manager-config\") pod \"lws-controller-manager-565556b8fb-fm7gh\" (UID: \"db76c3ec-725e-4b8e-b18f-a2b8f8665547\") " pod="openshift-lws-operator/lws-controller-manager-565556b8fb-fm7gh" Jun 09 15:23:49.529061 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:49.528768 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdb6z\" (UniqueName: \"kubernetes.io/projected/db76c3ec-725e-4b8e-b18f-a2b8f8665547-kube-api-access-jdb6z\") pod \"lws-controller-manager-565556b8fb-fm7gh\" (UID: \"db76c3ec-725e-4b8e-b18f-a2b8f8665547\") " pod="openshift-lws-operator/lws-controller-manager-565556b8fb-fm7gh" Jun 09 15:23:49.529945 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:49.529889 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/db76c3ec-725e-4b8e-b18f-a2b8f8665547-manager-config\") pod \"lws-controller-manager-565556b8fb-fm7gh\" (UID: \"db76c3ec-725e-4b8e-b18f-a2b8f8665547\") " pod="openshift-lws-operator/lws-controller-manager-565556b8fb-fm7gh" Jun 09 15:23:49.532463 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:49.532405 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/db76c3ec-725e-4b8e-b18f-a2b8f8665547-cert\") pod \"lws-controller-manager-565556b8fb-fm7gh\" (UID: \"db76c3ec-725e-4b8e-b18f-a2b8f8665547\") " pod="openshift-lws-operator/lws-controller-manager-565556b8fb-fm7gh" Jun 09 15:23:49.532606 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:49.532582 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/db76c3ec-725e-4b8e-b18f-a2b8f8665547-metrics-cert\") pod \"lws-controller-manager-565556b8fb-fm7gh\" (UID: \"db76c3ec-725e-4b8e-b18f-a2b8f8665547\") " pod="openshift-lws-operator/lws-controller-manager-565556b8fb-fm7gh" Jun 09 15:23:49.538353 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:49.538267 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdb6z\" (UniqueName: \"kubernetes.io/projected/db76c3ec-725e-4b8e-b18f-a2b8f8665547-kube-api-access-jdb6z\") pod \"lws-controller-manager-565556b8fb-fm7gh\" (UID: \"db76c3ec-725e-4b8e-b18f-a2b8f8665547\") " pod="openshift-lws-operator/lws-controller-manager-565556b8fb-fm7gh" Jun 09 15:23:49.592378 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:49.592309 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-565556b8fb-fm7gh" Jun 09 15:23:49.850121 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:49.848899 2611 generic.go:356] "Generic (PLEG): container finished" podID="ae56acca-793d-43fb-96b2-679334578616" containerID="5f2ab46d12ca8a888486c3556be9be37aeedc6950cdbed5d7825a23392232287" exitCode=0 Jun 09 15:23:49.850121 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:49.849059 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067rt8d" event={"ID":"ae56acca-793d-43fb-96b2-679334578616","Type":"ContainerDied","Data":"5f2ab46d12ca8a888486c3556be9be37aeedc6950cdbed5d7825a23392232287"} Jun 09 15:23:49.961660 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:49.961564 2611 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-565556b8fb-fm7gh"] Jun 09 15:23:49.966100 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:23:49.966066 2611 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb76c3ec_725e_4b8e_b18f_a2b8f8665547.slice/crio-cb47c8ac396fb71d3117fa2bdb7e1140b7dc225d4856ac383af742bf3b223946 WatchSource:0}: Error finding container cb47c8ac396fb71d3117fa2bdb7e1140b7dc225d4856ac383af742bf3b223946: Status 404 returned error can't find the container with id cb47c8ac396fb71d3117fa2bdb7e1140b7dc225d4856ac383af742bf3b223946 Jun 09 15:23:50.855863 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:50.855823 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-565556b8fb-fm7gh" event={"ID":"db76c3ec-725e-4b8e-b18f-a2b8f8665547","Type":"ContainerStarted","Data":"cb47c8ac396fb71d3117fa2bdb7e1140b7dc225d4856ac383af742bf3b223946"} Jun 09 15:23:50.857517 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:50.857479 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5dcd85bb64-nvhjb" event={"ID":"edd3056b-a539-4665-a517-9ac78f5d9d9f","Type":"ContainerStarted","Data":"9e15efa7cb3c5e63612f0536bbed8555d86086c3c440de3dc4ebd411f80aef16"} Jun 09 15:23:50.878223 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:50.878150 2611 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5dcd85bb64-nvhjb" podStartSLOduration=1.583024719 podStartE2EDuration="4.878128939s" totalImagesPullingTime="3.29510422s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:23:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:23:50.875402677 +0000 UTC m=+551.681094933" watchObservedRunningTime="2026-06-09 15:23:50.878128939 +0000 UTC m=+551.683821158" Jun 09 15:23:51.028477 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:51.028444 2611 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067rt8d" Jun 09 15:23:51.145481 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:51.145398 2611 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ae56acca-793d-43fb-96b2-679334578616-bundle\") pod \"ae56acca-793d-43fb-96b2-679334578616\" (UID: \"ae56acca-793d-43fb-96b2-679334578616\") " Jun 09 15:23:51.145712 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:51.145520 2611 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cqqp4\" (UniqueName: \"kubernetes.io/projected/ae56acca-793d-43fb-96b2-679334578616-kube-api-access-cqqp4\") pod \"ae56acca-793d-43fb-96b2-679334578616\" (UID: \"ae56acca-793d-43fb-96b2-679334578616\") " Jun 09 15:23:51.145712 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:51.145567 2611 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ae56acca-793d-43fb-96b2-679334578616-util\") pod \"ae56acca-793d-43fb-96b2-679334578616\" (UID: \"ae56acca-793d-43fb-96b2-679334578616\") " Jun 09 15:23:51.146596 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:51.146564 2611 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae56acca-793d-43fb-96b2-679334578616-bundle" (OuterVolumeSpecName: "bundle") pod "ae56acca-793d-43fb-96b2-679334578616" (UID: "ae56acca-793d-43fb-96b2-679334578616"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 15:23:51.148248 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:51.148211 2611 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae56acca-793d-43fb-96b2-679334578616-kube-api-access-cqqp4" (OuterVolumeSpecName: "kube-api-access-cqqp4") pod "ae56acca-793d-43fb-96b2-679334578616" (UID: "ae56acca-793d-43fb-96b2-679334578616"). InnerVolumeSpecName "kube-api-access-cqqp4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 15:23:51.153378 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:51.153342 2611 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae56acca-793d-43fb-96b2-679334578616-util" (OuterVolumeSpecName: "util") pod "ae56acca-793d-43fb-96b2-679334578616" (UID: "ae56acca-793d-43fb-96b2-679334578616"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 15:23:51.246607 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:51.246561 2611 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cqqp4\" (UniqueName: \"kubernetes.io/projected/ae56acca-793d-43fb-96b2-679334578616-kube-api-access-cqqp4\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 09 15:23:51.246607 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:51.246606 2611 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ae56acca-793d-43fb-96b2-679334578616-util\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 09 15:23:51.246860 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:51.246621 2611 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ae56acca-793d-43fb-96b2-679334578616-bundle\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 09 15:23:51.863623 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:51.863579 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-565556b8fb-fm7gh" event={"ID":"db76c3ec-725e-4b8e-b18f-a2b8f8665547","Type":"ContainerStarted","Data":"12af0b69678b6b64ca019c12cec364cd21716bb7a0b72562e38267dc87ae02ab"} Jun 09 15:23:51.864073 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:51.863675 2611 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-565556b8fb-fm7gh" Jun 09 15:23:51.865533 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:51.865513 2611 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067rt8d" Jun 09 15:23:51.865688 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:51.865529 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab067rt8d" event={"ID":"ae56acca-793d-43fb-96b2-679334578616","Type":"ContainerDied","Data":"83bf2ce5e3b3bdba1e1d251c35e84f416d88a8c7a4f45542f5a08237f0b8f78e"} Jun 09 15:23:51.865688 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:51.865566 2611 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="83bf2ce5e3b3bdba1e1d251c35e84f416d88a8c7a4f45542f5a08237f0b8f78e" Jun 09 15:23:51.901802 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:51.901744 2611 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-565556b8fb-fm7gh" podStartSLOduration=1.455811452 podStartE2EDuration="2.901727768s" totalImagesPullingTime="1.445916316s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:23:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:23:51.900816656 +0000 UTC m=+552.706508875" watchObservedRunningTime="2026-06-09 15:23:51.901727768 +0000 UTC m=+552.707419987" Jun 09 15:23:57.837022 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:57.836989 2611 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-zfdwp" Jun 09 15:23:57.839457 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:23:57.839435 2611 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-ssqnd" Jun 09 15:24:00.501957 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:00.501922 2611 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6797w"] Jun 09 15:24:00.502357 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:00.502243 2611 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae56acca-793d-43fb-96b2-679334578616" containerName="pull" Jun 09 15:24:00.502357 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:00.502253 2611 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae56acca-793d-43fb-96b2-679334578616" containerName="pull" Jun 09 15:24:00.502357 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:00.502267 2611 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae56acca-793d-43fb-96b2-679334578616" containerName="extract" Jun 09 15:24:00.502357 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:00.502272 2611 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae56acca-793d-43fb-96b2-679334578616" containerName="extract" Jun 09 15:24:00.502357 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:00.502289 2611 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae56acca-793d-43fb-96b2-679334578616" containerName="util" Jun 09 15:24:00.502357 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:00.502294 2611 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae56acca-793d-43fb-96b2-679334578616" containerName="util" Jun 09 15:24:00.502357 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:00.502355 2611 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae56acca-793d-43fb-96b2-679334578616" containerName="extract" Jun 09 15:24:00.505269 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:00.505252 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6797w" Jun 09 15:24:00.508273 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:00.508254 2611 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 15:24:00.508273 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:00.508261 2611 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xcgzc\"" Jun 09 15:24:00.509166 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:00.509141 2611 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 15:24:00.522437 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:00.522411 2611 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6797w"] Jun 09 15:24:00.524543 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:00.524521 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6z9n\" (UniqueName: \"kubernetes.io/projected/d0dcf81a-e5e3-41af-8c16-07dca226db41-kube-api-access-m6z9n\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6797w\" (UID: \"d0dcf81a-e5e3-41af-8c16-07dca226db41\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6797w" Jun 09 15:24:00.524640 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:00.524569 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d0dcf81a-e5e3-41af-8c16-07dca226db41-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6797w\" (UID: \"d0dcf81a-e5e3-41af-8c16-07dca226db41\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6797w" Jun 09 15:24:00.524686 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:00.524635 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d0dcf81a-e5e3-41af-8c16-07dca226db41-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6797w\" (UID: \"d0dcf81a-e5e3-41af-8c16-07dca226db41\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6797w" Jun 09 15:24:00.625115 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:00.625076 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6z9n\" (UniqueName: \"kubernetes.io/projected/d0dcf81a-e5e3-41af-8c16-07dca226db41-kube-api-access-m6z9n\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6797w\" (UID: \"d0dcf81a-e5e3-41af-8c16-07dca226db41\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6797w" Jun 09 15:24:00.625280 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:00.625124 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d0dcf81a-e5e3-41af-8c16-07dca226db41-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6797w\" (UID: \"d0dcf81a-e5e3-41af-8c16-07dca226db41\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6797w" Jun 09 15:24:00.625280 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:00.625185 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d0dcf81a-e5e3-41af-8c16-07dca226db41-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6797w\" (UID: \"d0dcf81a-e5e3-41af-8c16-07dca226db41\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6797w" Jun 09 15:24:00.625589 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:00.625571 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d0dcf81a-e5e3-41af-8c16-07dca226db41-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6797w\" (UID: \"d0dcf81a-e5e3-41af-8c16-07dca226db41\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6797w" Jun 09 15:24:00.625630 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:00.625579 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d0dcf81a-e5e3-41af-8c16-07dca226db41-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6797w\" (UID: \"d0dcf81a-e5e3-41af-8c16-07dca226db41\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6797w" Jun 09 15:24:00.637803 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:00.637771 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6z9n\" (UniqueName: \"kubernetes.io/projected/d0dcf81a-e5e3-41af-8c16-07dca226db41-kube-api-access-m6z9n\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6797w\" (UID: \"d0dcf81a-e5e3-41af-8c16-07dca226db41\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6797w" Jun 09 15:24:00.815355 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:00.815260 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6797w" Jun 09 15:24:00.951831 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:00.951802 2611 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6797w"] Jun 09 15:24:00.954055 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:24:00.954031 2611 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0dcf81a_e5e3_41af_8c16_07dca226db41.slice/crio-0b74420a4e8ce5f52926710a4034331b1d126f3b5b96442b9e62dd1a51dd228a WatchSource:0}: Error finding container 0b74420a4e8ce5f52926710a4034331b1d126f3b5b96442b9e62dd1a51dd228a: Status 404 returned error can't find the container with id 0b74420a4e8ce5f52926710a4034331b1d126f3b5b96442b9e62dd1a51dd228a Jun 09 15:24:01.915046 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:01.914961 2611 generic.go:356] "Generic (PLEG): container finished" podID="d0dcf81a-e5e3-41af-8c16-07dca226db41" containerID="b67be1c268cba4f5e9f6a576d957f68634e997dea012178ca09ac1b6daa35414" exitCode=0 Jun 09 15:24:01.915448 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:01.915048 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6797w" event={"ID":"d0dcf81a-e5e3-41af-8c16-07dca226db41","Type":"ContainerDied","Data":"b67be1c268cba4f5e9f6a576d957f68634e997dea012178ca09ac1b6daa35414"} Jun 09 15:24:01.915448 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:01.915111 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6797w" event={"ID":"d0dcf81a-e5e3-41af-8c16-07dca226db41","Type":"ContainerStarted","Data":"0b74420a4e8ce5f52926710a4034331b1d126f3b5b96442b9e62dd1a51dd228a"} Jun 09 15:24:02.872746 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:02.872717 2611 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-565556b8fb-fm7gh" Jun 09 15:24:03.925894 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:03.925858 2611 generic.go:356] "Generic (PLEG): container finished" podID="d0dcf81a-e5e3-41af-8c16-07dca226db41" containerID="0ab8cb8ad83f13d2e7ee9a5958ff241aa69bdb1c8676529ee3a35a5a7a80e5da" exitCode=0 Jun 09 15:24:03.926345 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:03.925941 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6797w" event={"ID":"d0dcf81a-e5e3-41af-8c16-07dca226db41","Type":"ContainerDied","Data":"0ab8cb8ad83f13d2e7ee9a5958ff241aa69bdb1c8676529ee3a35a5a7a80e5da"} Jun 09 15:24:04.933416 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:04.933384 2611 generic.go:356] "Generic (PLEG): container finished" podID="d0dcf81a-e5e3-41af-8c16-07dca226db41" containerID="b41b57be2b8fe61889611473ac5512927af53fd53c93a04bb56f8a7e78bb9093" exitCode=0 Jun 09 15:24:04.933821 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:04.933477 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6797w" event={"ID":"d0dcf81a-e5e3-41af-8c16-07dca226db41","Type":"ContainerDied","Data":"b41b57be2b8fe61889611473ac5512927af53fd53c93a04bb56f8a7e78bb9093"} Jun 09 15:24:06.074195 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:06.074150 2611 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6797w" Jun 09 15:24:06.167565 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:06.167520 2611 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m6z9n\" (UniqueName: \"kubernetes.io/projected/d0dcf81a-e5e3-41af-8c16-07dca226db41-kube-api-access-m6z9n\") pod \"d0dcf81a-e5e3-41af-8c16-07dca226db41\" (UID: \"d0dcf81a-e5e3-41af-8c16-07dca226db41\") " Jun 09 15:24:06.167737 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:06.167591 2611 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d0dcf81a-e5e3-41af-8c16-07dca226db41-bundle\") pod \"d0dcf81a-e5e3-41af-8c16-07dca226db41\" (UID: \"d0dcf81a-e5e3-41af-8c16-07dca226db41\") " Jun 09 15:24:06.167737 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:06.167632 2611 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d0dcf81a-e5e3-41af-8c16-07dca226db41-util\") pod \"d0dcf81a-e5e3-41af-8c16-07dca226db41\" (UID: \"d0dcf81a-e5e3-41af-8c16-07dca226db41\") " Jun 09 15:24:06.168606 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:06.168578 2611 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0dcf81a-e5e3-41af-8c16-07dca226db41-bundle" (OuterVolumeSpecName: "bundle") pod "d0dcf81a-e5e3-41af-8c16-07dca226db41" (UID: "d0dcf81a-e5e3-41af-8c16-07dca226db41"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 15:24:06.169751 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:06.169729 2611 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0dcf81a-e5e3-41af-8c16-07dca226db41-kube-api-access-m6z9n" (OuterVolumeSpecName: "kube-api-access-m6z9n") pod "d0dcf81a-e5e3-41af-8c16-07dca226db41" (UID: "d0dcf81a-e5e3-41af-8c16-07dca226db41"). InnerVolumeSpecName "kube-api-access-m6z9n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 15:24:06.173105 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:06.173081 2611 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0dcf81a-e5e3-41af-8c16-07dca226db41-util" (OuterVolumeSpecName: "util") pod "d0dcf81a-e5e3-41af-8c16-07dca226db41" (UID: "d0dcf81a-e5e3-41af-8c16-07dca226db41"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 15:24:06.268957 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:06.268871 2611 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d0dcf81a-e5e3-41af-8c16-07dca226db41-bundle\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 09 15:24:06.268957 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:06.268901 2611 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d0dcf81a-e5e3-41af-8c16-07dca226db41-util\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 09 15:24:06.268957 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:06.268911 2611 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m6z9n\" (UniqueName: \"kubernetes.io/projected/d0dcf81a-e5e3-41af-8c16-07dca226db41-kube-api-access-m6z9n\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 09 15:24:06.945131 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:06.945091 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6797w" event={"ID":"d0dcf81a-e5e3-41af-8c16-07dca226db41","Type":"ContainerDied","Data":"0b74420a4e8ce5f52926710a4034331b1d126f3b5b96442b9e62dd1a51dd228a"} Jun 09 15:24:06.945311 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:06.945150 2611 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0b74420a4e8ce5f52926710a4034331b1d126f3b5b96442b9e62dd1a51dd228a" Jun 09 15:24:06.945311 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:06.945110 2611 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6797w" Jun 09 15:24:14.925056 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:14.925015 2611 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-55767d7ffb-whfn5"] Jun 09 15:24:39.598202 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:39.598166 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-9b4t9_7a9cdcf8-af9d-474c-9f46-4099925e11fc/console-operator/1.log" Jun 09 15:24:39.600458 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:39.600434 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-9b4t9_7a9cdcf8-af9d-474c-9f46-4099925e11fc/console-operator/1.log" Jun 09 15:24:39.606503 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:39.606478 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4vsgw_aa94098e-7a90-4a75-9b97-74e10b75695b/ovn-acl-logging/0.log" Jun 09 15:24:39.608667 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:39.608647 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4vsgw_aa94098e-7a90-4a75-9b97-74e10b75695b/ovn-acl-logging/0.log" Jun 09 15:24:39.947569 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:39.947501 2611 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-55767d7ffb-whfn5" podUID="01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f" containerName="console" containerID="cri-o://a1633cbbed9e6605d11e82a936ba16813816409c48850d69e3f31ee0b3aa4aea" gracePeriod=15 Jun 09 15:24:40.012007 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:40.011972 2611 patch_prober.go:28] interesting pod/console-55767d7ffb-whfn5 container/console namespace/openshift-console: Readiness probe status=failure output="Get \"https://10.134.0.21:8443/health\": dial tcp 10.134.0.21:8443: connect: connection refused" start-of-body= Jun 09 15:24:40.012189 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:40.012027 2611 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/console-55767d7ffb-whfn5" podUID="01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f" containerName="console" probeResult="failure" output="Get \"https://10.134.0.21:8443/health\": dial tcp 10.134.0.21:8443: connect: connection refused" Jun 09 15:24:40.104832 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:40.104799 2611 generic.go:356] "Generic (PLEG): container finished" podID="01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f" containerID="a1633cbbed9e6605d11e82a936ba16813816409c48850d69e3f31ee0b3aa4aea" exitCode=0 Jun 09 15:24:40.105033 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:40.104882 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55767d7ffb-whfn5" event={"ID":"01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f","Type":"ContainerDied","Data":"a1633cbbed9e6605d11e82a936ba16813816409c48850d69e3f31ee0b3aa4aea"} Jun 09 15:24:40.198948 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:40.198890 2611 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55767d7ffb-whfn5" Jun 09 15:24:40.368964 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:40.368927 2611 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f-service-ca\") pod \"01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f\" (UID: \"01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f\") " Jun 09 15:24:40.368964 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:40.368969 2611 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f-trusted-ca-bundle\") pod \"01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f\" (UID: \"01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f\") " Jun 09 15:24:40.369225 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:40.369024 2611 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f-console-oauth-config\") pod \"01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f\" (UID: \"01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f\") " Jun 09 15:24:40.369225 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:40.369040 2611 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f-console-serving-cert\") pod \"01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f\" (UID: \"01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f\") " Jun 09 15:24:40.369225 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:40.369147 2611 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f-console-config\") pod \"01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f\" (UID: \"01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f\") " Jun 09 15:24:40.369389 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:40.369278 2611 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2w66d\" (UniqueName: \"kubernetes.io/projected/01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f-kube-api-access-2w66d\") pod \"01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f\" (UID: \"01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f\") " Jun 09 15:24:40.369389 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:40.369314 2611 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f-oauth-serving-cert\") pod \"01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f\" (UID: \"01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f\") " Jun 09 15:24:40.369494 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:40.369468 2611 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f-service-ca" (OuterVolumeSpecName: "service-ca") pod "01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f" (UID: "01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 15:24:40.369549 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:40.369504 2611 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f" (UID: "01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 15:24:40.369549 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:40.369531 2611 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f-console-config" (OuterVolumeSpecName: "console-config") pod "01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f" (UID: "01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 15:24:40.369726 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:40.369708 2611 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f-console-config\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 09 15:24:40.369773 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:40.369733 2611 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f-service-ca\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 09 15:24:40.369773 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:40.369751 2611 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f-trusted-ca-bundle\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 09 15:24:40.369836 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:40.369775 2611 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f" (UID: "01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 15:24:40.371407 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:40.371384 2611 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f" (UID: "01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 15:24:40.371685 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:40.371663 2611 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f-kube-api-access-2w66d" (OuterVolumeSpecName: "kube-api-access-2w66d") pod "01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f" (UID: "01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f"). InnerVolumeSpecName "kube-api-access-2w66d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 15:24:40.371685 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:40.371671 2611 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f" (UID: "01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 15:24:40.471185 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:40.471065 2611 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2w66d\" (UniqueName: \"kubernetes.io/projected/01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f-kube-api-access-2w66d\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 09 15:24:40.471185 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:40.471103 2611 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f-oauth-serving-cert\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 09 15:24:40.471185 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:40.471118 2611 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f-console-oauth-config\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 09 15:24:40.471185 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:40.471131 2611 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f-console-serving-cert\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 09 15:24:41.110384 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:41.110353 2611 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55767d7ffb-whfn5" Jun 09 15:24:41.110841 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:41.110346 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55767d7ffb-whfn5" event={"ID":"01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f","Type":"ContainerDied","Data":"721f3a0af778bd25cb9c5a97f16550d01dc5b9dc8ad95e108293ca6977fbb705"} Jun 09 15:24:41.110841 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:41.110490 2611 scope.go:117] "RemoveContainer" containerID="a1633cbbed9e6605d11e82a936ba16813816409c48850d69e3f31ee0b3aa4aea" Jun 09 15:24:41.138934 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:41.138899 2611 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-55767d7ffb-whfn5"] Jun 09 15:24:41.140642 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:41.140619 2611 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-55767d7ffb-whfn5"] Jun 09 15:24:41.631990 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:41.631950 2611 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f" path="/var/lib/kubelet/pods/01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f/volumes" Jun 09 15:24:57.846138 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:57.845149 2611 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bp68k"] Jun 09 15:24:57.846138 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:57.845603 2611 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f" containerName="console" Jun 09 15:24:57.846138 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:57.845622 2611 state_mem.go:107] "Deleted CPUSet assignment" podUID="01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f" containerName="console" Jun 09 15:24:57.846138 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:57.845647 2611 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0dcf81a-e5e3-41af-8c16-07dca226db41" containerName="pull" Jun 09 15:24:57.846138 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:57.845655 2611 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0dcf81a-e5e3-41af-8c16-07dca226db41" containerName="pull" Jun 09 15:24:57.846138 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:57.845664 2611 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0dcf81a-e5e3-41af-8c16-07dca226db41" containerName="extract" Jun 09 15:24:57.846138 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:57.845672 2611 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0dcf81a-e5e3-41af-8c16-07dca226db41" containerName="extract" Jun 09 15:24:57.846138 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:57.845696 2611 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0dcf81a-e5e3-41af-8c16-07dca226db41" containerName="util" Jun 09 15:24:57.846138 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:57.845713 2611 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0dcf81a-e5e3-41af-8c16-07dca226db41" containerName="util" Jun 09 15:24:57.846138 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:57.845786 2611 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0dcf81a-e5e3-41af-8c16-07dca226db41" containerName="extract" Jun 09 15:24:57.846138 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:57.845800 2611 memory_manager.go:368] "RemoveStaleState removing state" podUID="01ae4bd3-bc3b-4607-ae3c-7eda92a4e17f" containerName="console" Jun 09 15:24:57.850929 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:57.850898 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bp68k" Jun 09 15:24:57.853474 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:57.853438 2611 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 09 15:24:57.853627 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:57.853478 2611 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 09 15:24:57.854668 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:57.854643 2611 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-j788r\"" Jun 09 15:24:57.857587 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:57.857556 2611 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bp68k"] Jun 09 15:24:57.918013 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:57.917969 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1cb643e1-ac5e-46a2-a2bc-3a04c35a23ed-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bp68k\" (UID: \"1cb643e1-ac5e-46a2-a2bc-3a04c35a23ed\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bp68k" Jun 09 15:24:57.918248 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:57.918029 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdhxw\" (UniqueName: \"kubernetes.io/projected/1cb643e1-ac5e-46a2-a2bc-3a04c35a23ed-kube-api-access-sdhxw\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bp68k\" (UID: \"1cb643e1-ac5e-46a2-a2bc-3a04c35a23ed\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bp68k" Jun 09 15:24:57.918248 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:57.918073 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1cb643e1-ac5e-46a2-a2bc-3a04c35a23ed-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bp68k\" (UID: \"1cb643e1-ac5e-46a2-a2bc-3a04c35a23ed\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bp68k" Jun 09 15:24:58.018840 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:58.018790 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1cb643e1-ac5e-46a2-a2bc-3a04c35a23ed-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bp68k\" (UID: \"1cb643e1-ac5e-46a2-a2bc-3a04c35a23ed\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bp68k" Jun 09 15:24:58.019040 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:58.018857 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdhxw\" (UniqueName: \"kubernetes.io/projected/1cb643e1-ac5e-46a2-a2bc-3a04c35a23ed-kube-api-access-sdhxw\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bp68k\" (UID: \"1cb643e1-ac5e-46a2-a2bc-3a04c35a23ed\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bp68k" Jun 09 15:24:58.019040 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:58.018889 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1cb643e1-ac5e-46a2-a2bc-3a04c35a23ed-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bp68k\" (UID: \"1cb643e1-ac5e-46a2-a2bc-3a04c35a23ed\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bp68k" Jun 09 15:24:58.019259 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:58.019236 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1cb643e1-ac5e-46a2-a2bc-3a04c35a23ed-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bp68k\" (UID: \"1cb643e1-ac5e-46a2-a2bc-3a04c35a23ed\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bp68k" Jun 09 15:24:58.019328 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:58.019264 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1cb643e1-ac5e-46a2-a2bc-3a04c35a23ed-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bp68k\" (UID: \"1cb643e1-ac5e-46a2-a2bc-3a04c35a23ed\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bp68k" Jun 09 15:24:58.027186 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:58.027139 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdhxw\" (UniqueName: \"kubernetes.io/projected/1cb643e1-ac5e-46a2-a2bc-3a04c35a23ed-kube-api-access-sdhxw\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bp68k\" (UID: \"1cb643e1-ac5e-46a2-a2bc-3a04c35a23ed\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bp68k" Jun 09 15:24:58.163082 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:58.162986 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bp68k" Jun 09 15:24:58.304151 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:58.304009 2611 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bp68k"] Jun 09 15:24:58.306344 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:24:58.306299 2611 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cb643e1_ac5e_46a2_a2bc_3a04c35a23ed.slice/crio-83797ed940ffea8b2cccd22dff5ed4759e266660a474c0dbdbb7e5fccfb8922b WatchSource:0}: Error finding container 83797ed940ffea8b2cccd22dff5ed4759e266660a474c0dbdbb7e5fccfb8922b: Status 404 returned error can't find the container with id 83797ed940ffea8b2cccd22dff5ed4759e266660a474c0dbdbb7e5fccfb8922b Jun 09 15:24:58.646927 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:58.646883 2611 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rh4w8"] Jun 09 15:24:58.650485 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:58.650462 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rh4w8" Jun 09 15:24:58.659576 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:58.659540 2611 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rh4w8"] Jun 09 15:24:58.723540 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:58.723501 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pklzq\" (UniqueName: \"kubernetes.io/projected/a0baa3c5-e6d1-4ea2-bc5b-8ab30287f2e2-kube-api-access-pklzq\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rh4w8\" (UID: \"a0baa3c5-e6d1-4ea2-bc5b-8ab30287f2e2\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rh4w8" Jun 09 15:24:58.723741 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:58.723553 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a0baa3c5-e6d1-4ea2-bc5b-8ab30287f2e2-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rh4w8\" (UID: \"a0baa3c5-e6d1-4ea2-bc5b-8ab30287f2e2\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rh4w8" Jun 09 15:24:58.723741 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:58.723594 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a0baa3c5-e6d1-4ea2-bc5b-8ab30287f2e2-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rh4w8\" (UID: \"a0baa3c5-e6d1-4ea2-bc5b-8ab30287f2e2\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rh4w8" Jun 09 15:24:58.824504 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:58.824448 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pklzq\" (UniqueName: \"kubernetes.io/projected/a0baa3c5-e6d1-4ea2-bc5b-8ab30287f2e2-kube-api-access-pklzq\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rh4w8\" (UID: \"a0baa3c5-e6d1-4ea2-bc5b-8ab30287f2e2\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rh4w8" Jun 09 15:24:58.824504 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:58.824516 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a0baa3c5-e6d1-4ea2-bc5b-8ab30287f2e2-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rh4w8\" (UID: \"a0baa3c5-e6d1-4ea2-bc5b-8ab30287f2e2\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rh4w8" Jun 09 15:24:58.824729 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:58.824543 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a0baa3c5-e6d1-4ea2-bc5b-8ab30287f2e2-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rh4w8\" (UID: \"a0baa3c5-e6d1-4ea2-bc5b-8ab30287f2e2\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rh4w8" Jun 09 15:24:58.824900 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:58.824884 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a0baa3c5-e6d1-4ea2-bc5b-8ab30287f2e2-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rh4w8\" (UID: \"a0baa3c5-e6d1-4ea2-bc5b-8ab30287f2e2\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rh4w8" Jun 09 15:24:58.824964 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:58.824943 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a0baa3c5-e6d1-4ea2-bc5b-8ab30287f2e2-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rh4w8\" (UID: \"a0baa3c5-e6d1-4ea2-bc5b-8ab30287f2e2\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rh4w8" Jun 09 15:24:58.832621 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:58.832592 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pklzq\" (UniqueName: \"kubernetes.io/projected/a0baa3c5-e6d1-4ea2-bc5b-8ab30287f2e2-kube-api-access-pklzq\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rh4w8\" (UID: \"a0baa3c5-e6d1-4ea2-bc5b-8ab30287f2e2\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rh4w8" Jun 09 15:24:58.961124 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:58.961082 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rh4w8" Jun 09 15:24:59.127899 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:59.127872 2611 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rh4w8"] Jun 09 15:24:59.129837 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:24:59.129806 2611 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0baa3c5_e6d1_4ea2_bc5b_8ab30287f2e2.slice/crio-10d6219f102862b3fc0a42bf3f9af5e6d181a084f2e619fd6e9446fc8e72683c WatchSource:0}: Error finding container 10d6219f102862b3fc0a42bf3f9af5e6d181a084f2e619fd6e9446fc8e72683c: Status 404 returned error can't find the container with id 10d6219f102862b3fc0a42bf3f9af5e6d181a084f2e619fd6e9446fc8e72683c Jun 09 15:24:59.206789 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:59.206753 2611 generic.go:356] "Generic (PLEG): container finished" podID="1cb643e1-ac5e-46a2-a2bc-3a04c35a23ed" containerID="8eb6bccbfabd386d2b62739eb36c4e9537e0913d9a519bd4f2e9423c9773343a" exitCode=0 Jun 09 15:24:59.206952 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:59.206831 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bp68k" event={"ID":"1cb643e1-ac5e-46a2-a2bc-3a04c35a23ed","Type":"ContainerDied","Data":"8eb6bccbfabd386d2b62739eb36c4e9537e0913d9a519bd4f2e9423c9773343a"} Jun 09 15:24:59.206952 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:59.206880 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bp68k" event={"ID":"1cb643e1-ac5e-46a2-a2bc-3a04c35a23ed","Type":"ContainerStarted","Data":"83797ed940ffea8b2cccd22dff5ed4759e266660a474c0dbdbb7e5fccfb8922b"} Jun 09 15:24:59.208766 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:59.208732 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rh4w8" event={"ID":"a0baa3c5-e6d1-4ea2-bc5b-8ab30287f2e2","Type":"ContainerStarted","Data":"0581b8674883ad1db1cd5f3c8278698477a69d5618c5e24c5f41e05e7094f960"} Jun 09 15:24:59.208874 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:59.208792 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rh4w8" event={"ID":"a0baa3c5-e6d1-4ea2-bc5b-8ab30287f2e2","Type":"ContainerStarted","Data":"10d6219f102862b3fc0a42bf3f9af5e6d181a084f2e619fd6e9446fc8e72683c"} Jun 09 15:24:59.257855 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:59.257824 2611 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z8jxs"] Jun 09 15:24:59.261296 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:59.261275 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z8jxs" Jun 09 15:24:59.269263 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:59.269181 2611 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z8jxs"] Jun 09 15:24:59.338337 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:59.338289 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a8b7cf0-2e3d-448b-aad6-0fc22e3bb88c-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z8jxs\" (UID: \"8a8b7cf0-2e3d-448b-aad6-0fc22e3bb88c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z8jxs" Jun 09 15:24:59.338507 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:59.338351 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a8b7cf0-2e3d-448b-aad6-0fc22e3bb88c-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z8jxs\" (UID: \"8a8b7cf0-2e3d-448b-aad6-0fc22e3bb88c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z8jxs" Jun 09 15:24:59.338507 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:59.338410 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmz2r\" (UniqueName: \"kubernetes.io/projected/8a8b7cf0-2e3d-448b-aad6-0fc22e3bb88c-kube-api-access-kmz2r\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z8jxs\" (UID: \"8a8b7cf0-2e3d-448b-aad6-0fc22e3bb88c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z8jxs" Jun 09 15:24:59.439564 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:59.439516 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmz2r\" (UniqueName: \"kubernetes.io/projected/8a8b7cf0-2e3d-448b-aad6-0fc22e3bb88c-kube-api-access-kmz2r\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z8jxs\" (UID: \"8a8b7cf0-2e3d-448b-aad6-0fc22e3bb88c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z8jxs" Jun 09 15:24:59.439737 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:59.439606 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a8b7cf0-2e3d-448b-aad6-0fc22e3bb88c-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z8jxs\" (UID: \"8a8b7cf0-2e3d-448b-aad6-0fc22e3bb88c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z8jxs" Jun 09 15:24:59.439737 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:59.439653 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a8b7cf0-2e3d-448b-aad6-0fc22e3bb88c-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z8jxs\" (UID: \"8a8b7cf0-2e3d-448b-aad6-0fc22e3bb88c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z8jxs" Jun 09 15:24:59.439982 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:59.439959 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a8b7cf0-2e3d-448b-aad6-0fc22e3bb88c-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z8jxs\" (UID: \"8a8b7cf0-2e3d-448b-aad6-0fc22e3bb88c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z8jxs" Jun 09 15:24:59.440056 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:59.440023 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a8b7cf0-2e3d-448b-aad6-0fc22e3bb88c-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z8jxs\" (UID: \"8a8b7cf0-2e3d-448b-aad6-0fc22e3bb88c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z8jxs" Jun 09 15:24:59.447538 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:59.447508 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmz2r\" (UniqueName: \"kubernetes.io/projected/8a8b7cf0-2e3d-448b-aad6-0fc22e3bb88c-kube-api-access-kmz2r\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z8jxs\" (UID: \"8a8b7cf0-2e3d-448b-aad6-0fc22e3bb88c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z8jxs" Jun 09 15:24:59.608227 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:59.608123 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z8jxs" Jun 09 15:24:59.646395 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:59.646356 2611 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e059s7f"] Jun 09 15:24:59.650223 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:59.650192 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e059s7f" Jun 09 15:24:59.659331 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:59.659300 2611 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e059s7f"] Jun 09 15:24:59.742494 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:59.742462 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/85cf8db7-d51b-4b68-aff6-bd79366b2bdb-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e059s7f\" (UID: \"85cf8db7-d51b-4b68-aff6-bd79366b2bdb\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e059s7f" Jun 09 15:24:59.742663 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:59.742518 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/85cf8db7-d51b-4b68-aff6-bd79366b2bdb-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e059s7f\" (UID: \"85cf8db7-d51b-4b68-aff6-bd79366b2bdb\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e059s7f" Jun 09 15:24:59.742663 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:59.742569 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcr5t\" (UniqueName: \"kubernetes.io/projected/85cf8db7-d51b-4b68-aff6-bd79366b2bdb-kube-api-access-gcr5t\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e059s7f\" (UID: \"85cf8db7-d51b-4b68-aff6-bd79366b2bdb\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e059s7f" Jun 09 15:24:59.750420 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:59.750391 2611 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z8jxs"] Jun 09 15:24:59.752055 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:24:59.752028 2611 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a8b7cf0_2e3d_448b_aad6_0fc22e3bb88c.slice/crio-ec1415c4eb68456d8b5a0606a125e0912f4a06d5d3bda230dda8de0206515e89 WatchSource:0}: Error finding container ec1415c4eb68456d8b5a0606a125e0912f4a06d5d3bda230dda8de0206515e89: Status 404 returned error can't find the container with id ec1415c4eb68456d8b5a0606a125e0912f4a06d5d3bda230dda8de0206515e89 Jun 09 15:24:59.843131 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:59.843096 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/85cf8db7-d51b-4b68-aff6-bd79366b2bdb-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e059s7f\" (UID: \"85cf8db7-d51b-4b68-aff6-bd79366b2bdb\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e059s7f" Jun 09 15:24:59.843131 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:59.843145 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcr5t\" (UniqueName: \"kubernetes.io/projected/85cf8db7-d51b-4b68-aff6-bd79366b2bdb-kube-api-access-gcr5t\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e059s7f\" (UID: \"85cf8db7-d51b-4b68-aff6-bd79366b2bdb\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e059s7f" Jun 09 15:24:59.843360 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:59.843215 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/85cf8db7-d51b-4b68-aff6-bd79366b2bdb-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e059s7f\" (UID: \"85cf8db7-d51b-4b68-aff6-bd79366b2bdb\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e059s7f" Jun 09 15:24:59.843634 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:59.843608 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/85cf8db7-d51b-4b68-aff6-bd79366b2bdb-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e059s7f\" (UID: \"85cf8db7-d51b-4b68-aff6-bd79366b2bdb\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e059s7f" Jun 09 15:24:59.843673 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:59.843616 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/85cf8db7-d51b-4b68-aff6-bd79366b2bdb-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e059s7f\" (UID: \"85cf8db7-d51b-4b68-aff6-bd79366b2bdb\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e059s7f" Jun 09 15:24:59.852395 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:59.852369 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcr5t\" (UniqueName: \"kubernetes.io/projected/85cf8db7-d51b-4b68-aff6-bd79366b2bdb-kube-api-access-gcr5t\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e059s7f\" (UID: \"85cf8db7-d51b-4b68-aff6-bd79366b2bdb\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e059s7f" Jun 09 15:24:59.962573 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:24:59.962529 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e059s7f" Jun 09 15:25:00.205076 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:00.205050 2611 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e059s7f"] Jun 09 15:25:00.207791 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:25:00.207749 2611 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85cf8db7_d51b_4b68_aff6_bd79366b2bdb.slice/crio-b774d64f965a1e3f23a8f27b97a0b3506f89093c627e8758d25361e3f5c0b6eb WatchSource:0}: Error finding container b774d64f965a1e3f23a8f27b97a0b3506f89093c627e8758d25361e3f5c0b6eb: Status 404 returned error can't find the container with id b774d64f965a1e3f23a8f27b97a0b3506f89093c627e8758d25361e3f5c0b6eb Jun 09 15:25:00.216483 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:00.216424 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bp68k" event={"ID":"1cb643e1-ac5e-46a2-a2bc-3a04c35a23ed","Type":"ContainerStarted","Data":"9b028cb2d8b483dcddfa4f70e2df9a400966aa2b07a2297ddcd199957ad82542"} Jun 09 15:25:00.217894 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:00.217858 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e059s7f" event={"ID":"85cf8db7-d51b-4b68-aff6-bd79366b2bdb","Type":"ContainerStarted","Data":"b774d64f965a1e3f23a8f27b97a0b3506f89093c627e8758d25361e3f5c0b6eb"} Jun 09 15:25:00.219763 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:00.219738 2611 generic.go:356] "Generic (PLEG): container finished" podID="8a8b7cf0-2e3d-448b-aad6-0fc22e3bb88c" containerID="1014a3889843b755ab012718846dcb9d2dae02676f685a1d5306e79a83ab0b49" exitCode=0 Jun 09 15:25:00.219899 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:00.219820 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z8jxs" event={"ID":"8a8b7cf0-2e3d-448b-aad6-0fc22e3bb88c","Type":"ContainerDied","Data":"1014a3889843b755ab012718846dcb9d2dae02676f685a1d5306e79a83ab0b49"} Jun 09 15:25:00.219899 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:00.219864 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z8jxs" event={"ID":"8a8b7cf0-2e3d-448b-aad6-0fc22e3bb88c","Type":"ContainerStarted","Data":"ec1415c4eb68456d8b5a0606a125e0912f4a06d5d3bda230dda8de0206515e89"} Jun 09 15:25:00.221690 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:00.221663 2611 generic.go:356] "Generic (PLEG): container finished" podID="a0baa3c5-e6d1-4ea2-bc5b-8ab30287f2e2" containerID="0581b8674883ad1db1cd5f3c8278698477a69d5618c5e24c5f41e05e7094f960" exitCode=0 Jun 09 15:25:00.221771 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:00.221729 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rh4w8" event={"ID":"a0baa3c5-e6d1-4ea2-bc5b-8ab30287f2e2","Type":"ContainerDied","Data":"0581b8674883ad1db1cd5f3c8278698477a69d5618c5e24c5f41e05e7094f960"} Jun 09 15:25:01.228902 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:01.228872 2611 generic.go:356] "Generic (PLEG): container finished" podID="1cb643e1-ac5e-46a2-a2bc-3a04c35a23ed" containerID="9b028cb2d8b483dcddfa4f70e2df9a400966aa2b07a2297ddcd199957ad82542" exitCode=0 Jun 09 15:25:01.229349 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:01.228946 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bp68k" event={"ID":"1cb643e1-ac5e-46a2-a2bc-3a04c35a23ed","Type":"ContainerDied","Data":"9b028cb2d8b483dcddfa4f70e2df9a400966aa2b07a2297ddcd199957ad82542"} Jun 09 15:25:01.230698 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:01.230677 2611 generic.go:356] "Generic (PLEG): container finished" podID="85cf8db7-d51b-4b68-aff6-bd79366b2bdb" containerID="618799ebc01044137e3d3f5e758e62994db353869922a6bb24bbc90e6124b47c" exitCode=0 Jun 09 15:25:01.230792 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:01.230760 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e059s7f" event={"ID":"85cf8db7-d51b-4b68-aff6-bd79366b2bdb","Type":"ContainerDied","Data":"618799ebc01044137e3d3f5e758e62994db353869922a6bb24bbc90e6124b47c"} Jun 09 15:25:01.232590 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:01.232536 2611 generic.go:356] "Generic (PLEG): container finished" podID="a0baa3c5-e6d1-4ea2-bc5b-8ab30287f2e2" containerID="058f0a52624bff4f45d8d77589589b4ade2df8de30de7468448e25ab5bc16505" exitCode=0 Jun 09 15:25:01.232590 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:01.232571 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rh4w8" event={"ID":"a0baa3c5-e6d1-4ea2-bc5b-8ab30287f2e2","Type":"ContainerDied","Data":"058f0a52624bff4f45d8d77589589b4ade2df8de30de7468448e25ab5bc16505"} Jun 09 15:25:02.239261 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:02.239222 2611 generic.go:356] "Generic (PLEG): container finished" podID="1cb643e1-ac5e-46a2-a2bc-3a04c35a23ed" containerID="5ae06d90bd562944bebbd33ae2b15e6c670c116c2a9db773f4c3124938a0231d" exitCode=0 Jun 09 15:25:02.239622 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:02.239288 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bp68k" event={"ID":"1cb643e1-ac5e-46a2-a2bc-3a04c35a23ed","Type":"ContainerDied","Data":"5ae06d90bd562944bebbd33ae2b15e6c670c116c2a9db773f4c3124938a0231d"} Jun 09 15:25:02.240983 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:02.240956 2611 generic.go:356] "Generic (PLEG): container finished" podID="85cf8db7-d51b-4b68-aff6-bd79366b2bdb" containerID="9def9e1bfc6ba52aaf2368c97ed8e82eb209f61a19de13969965bb4dcd262a52" exitCode=0 Jun 09 15:25:02.241102 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:02.241027 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e059s7f" event={"ID":"85cf8db7-d51b-4b68-aff6-bd79366b2bdb","Type":"ContainerDied","Data":"9def9e1bfc6ba52aaf2368c97ed8e82eb209f61a19de13969965bb4dcd262a52"} Jun 09 15:25:02.242789 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:02.242768 2611 generic.go:356] "Generic (PLEG): container finished" podID="8a8b7cf0-2e3d-448b-aad6-0fc22e3bb88c" containerID="804435801c6afe6947eba69c7a5de25fb268e80fe89f813b97fb51474168f42a" exitCode=0 Jun 09 15:25:02.242878 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:02.242793 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z8jxs" event={"ID":"8a8b7cf0-2e3d-448b-aad6-0fc22e3bb88c","Type":"ContainerDied","Data":"804435801c6afe6947eba69c7a5de25fb268e80fe89f813b97fb51474168f42a"} Jun 09 15:25:02.245040 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:02.245019 2611 generic.go:356] "Generic (PLEG): container finished" podID="a0baa3c5-e6d1-4ea2-bc5b-8ab30287f2e2" containerID="b2d4356fb09e755235f4359082d2ba314a782f7708a63aaa78277c79619e3ce2" exitCode=0 Jun 09 15:25:02.245112 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:02.245065 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rh4w8" event={"ID":"a0baa3c5-e6d1-4ea2-bc5b-8ab30287f2e2","Type":"ContainerDied","Data":"b2d4356fb09e755235f4359082d2ba314a782f7708a63aaa78277c79619e3ce2"} Jun 09 15:25:03.252878 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:03.252842 2611 generic.go:356] "Generic (PLEG): container finished" podID="85cf8db7-d51b-4b68-aff6-bd79366b2bdb" containerID="95645a1ae02daa4865b520b4ba294ef76a2ae32f99c4c92cf6fc7255156ca72c" exitCode=0 Jun 09 15:25:03.253322 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:03.252929 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e059s7f" event={"ID":"85cf8db7-d51b-4b68-aff6-bd79366b2bdb","Type":"ContainerDied","Data":"95645a1ae02daa4865b520b4ba294ef76a2ae32f99c4c92cf6fc7255156ca72c"} Jun 09 15:25:03.254962 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:03.254936 2611 generic.go:356] "Generic (PLEG): container finished" podID="8a8b7cf0-2e3d-448b-aad6-0fc22e3bb88c" containerID="c700432e558d543e66127e3cf3625a7d55063136874af761f8700f464f1df83d" exitCode=0 Jun 09 15:25:03.255071 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:03.254969 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z8jxs" event={"ID":"8a8b7cf0-2e3d-448b-aad6-0fc22e3bb88c","Type":"ContainerDied","Data":"c700432e558d543e66127e3cf3625a7d55063136874af761f8700f464f1df83d"} Jun 09 15:25:03.396886 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:03.396852 2611 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bp68k" Jun 09 15:25:03.432343 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:03.432307 2611 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rh4w8" Jun 09 15:25:03.476010 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:03.475975 2611 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1cb643e1-ac5e-46a2-a2bc-3a04c35a23ed-bundle\") pod \"1cb643e1-ac5e-46a2-a2bc-3a04c35a23ed\" (UID: \"1cb643e1-ac5e-46a2-a2bc-3a04c35a23ed\") " Jun 09 15:25:03.476279 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:03.476024 2611 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1cb643e1-ac5e-46a2-a2bc-3a04c35a23ed-util\") pod \"1cb643e1-ac5e-46a2-a2bc-3a04c35a23ed\" (UID: \"1cb643e1-ac5e-46a2-a2bc-3a04c35a23ed\") " Jun 09 15:25:03.476279 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:03.476044 2611 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sdhxw\" (UniqueName: \"kubernetes.io/projected/1cb643e1-ac5e-46a2-a2bc-3a04c35a23ed-kube-api-access-sdhxw\") pod \"1cb643e1-ac5e-46a2-a2bc-3a04c35a23ed\" (UID: \"1cb643e1-ac5e-46a2-a2bc-3a04c35a23ed\") " Jun 09 15:25:03.476279 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:03.476063 2611 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a0baa3c5-e6d1-4ea2-bc5b-8ab30287f2e2-bundle\") pod \"a0baa3c5-e6d1-4ea2-bc5b-8ab30287f2e2\" (UID: \"a0baa3c5-e6d1-4ea2-bc5b-8ab30287f2e2\") " Jun 09 15:25:03.476279 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:03.476240 2611 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pklzq\" (UniqueName: \"kubernetes.io/projected/a0baa3c5-e6d1-4ea2-bc5b-8ab30287f2e2-kube-api-access-pklzq\") pod \"a0baa3c5-e6d1-4ea2-bc5b-8ab30287f2e2\" (UID: \"a0baa3c5-e6d1-4ea2-bc5b-8ab30287f2e2\") " Jun 09 15:25:03.476279 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:03.476279 2611 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a0baa3c5-e6d1-4ea2-bc5b-8ab30287f2e2-util\") pod \"a0baa3c5-e6d1-4ea2-bc5b-8ab30287f2e2\" (UID: \"a0baa3c5-e6d1-4ea2-bc5b-8ab30287f2e2\") " Jun 09 15:25:03.476642 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:03.476616 2611 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1cb643e1-ac5e-46a2-a2bc-3a04c35a23ed-bundle" (OuterVolumeSpecName: "bundle") pod "1cb643e1-ac5e-46a2-a2bc-3a04c35a23ed" (UID: "1cb643e1-ac5e-46a2-a2bc-3a04c35a23ed"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 15:25:03.476897 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:03.476872 2611 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0baa3c5-e6d1-4ea2-bc5b-8ab30287f2e2-bundle" (OuterVolumeSpecName: "bundle") pod "a0baa3c5-e6d1-4ea2-bc5b-8ab30287f2e2" (UID: "a0baa3c5-e6d1-4ea2-bc5b-8ab30287f2e2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 15:25:03.478913 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:03.478884 2611 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0baa3c5-e6d1-4ea2-bc5b-8ab30287f2e2-kube-api-access-pklzq" (OuterVolumeSpecName: "kube-api-access-pklzq") pod "a0baa3c5-e6d1-4ea2-bc5b-8ab30287f2e2" (UID: "a0baa3c5-e6d1-4ea2-bc5b-8ab30287f2e2"). InnerVolumeSpecName "kube-api-access-pklzq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 15:25:03.478975 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:03.478932 2611 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1cb643e1-ac5e-46a2-a2bc-3a04c35a23ed-kube-api-access-sdhxw" (OuterVolumeSpecName: "kube-api-access-sdhxw") pod "1cb643e1-ac5e-46a2-a2bc-3a04c35a23ed" (UID: "1cb643e1-ac5e-46a2-a2bc-3a04c35a23ed"). InnerVolumeSpecName "kube-api-access-sdhxw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 15:25:03.482693 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:03.482656 2611 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0baa3c5-e6d1-4ea2-bc5b-8ab30287f2e2-util" (OuterVolumeSpecName: "util") pod "a0baa3c5-e6d1-4ea2-bc5b-8ab30287f2e2" (UID: "a0baa3c5-e6d1-4ea2-bc5b-8ab30287f2e2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 15:25:03.482954 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:03.482936 2611 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1cb643e1-ac5e-46a2-a2bc-3a04c35a23ed-util" (OuterVolumeSpecName: "util") pod "1cb643e1-ac5e-46a2-a2bc-3a04c35a23ed" (UID: "1cb643e1-ac5e-46a2-a2bc-3a04c35a23ed"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 15:25:03.577423 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:03.577323 2611 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1cb643e1-ac5e-46a2-a2bc-3a04c35a23ed-bundle\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 09 15:25:03.577423 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:03.577363 2611 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1cb643e1-ac5e-46a2-a2bc-3a04c35a23ed-util\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 09 15:25:03.577423 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:03.577374 2611 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sdhxw\" (UniqueName: \"kubernetes.io/projected/1cb643e1-ac5e-46a2-a2bc-3a04c35a23ed-kube-api-access-sdhxw\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 09 15:25:03.577423 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:03.577385 2611 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a0baa3c5-e6d1-4ea2-bc5b-8ab30287f2e2-bundle\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 09 15:25:03.577423 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:03.577394 2611 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pklzq\" (UniqueName: \"kubernetes.io/projected/a0baa3c5-e6d1-4ea2-bc5b-8ab30287f2e2-kube-api-access-pklzq\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 09 15:25:03.577423 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:03.577401 2611 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a0baa3c5-e6d1-4ea2-bc5b-8ab30287f2e2-util\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 09 15:25:04.262255 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:04.262227 2611 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rh4w8" Jun 09 15:25:04.262716 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:04.262267 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rh4w8" event={"ID":"a0baa3c5-e6d1-4ea2-bc5b-8ab30287f2e2","Type":"ContainerDied","Data":"10d6219f102862b3fc0a42bf3f9af5e6d181a084f2e619fd6e9446fc8e72683c"} Jun 09 15:25:04.262716 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:04.262324 2611 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="10d6219f102862b3fc0a42bf3f9af5e6d181a084f2e619fd6e9446fc8e72683c" Jun 09 15:25:04.264167 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:04.264133 2611 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bp68k" Jun 09 15:25:04.264315 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:04.264174 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bp68k" event={"ID":"1cb643e1-ac5e-46a2-a2bc-3a04c35a23ed","Type":"ContainerDied","Data":"83797ed940ffea8b2cccd22dff5ed4759e266660a474c0dbdbb7e5fccfb8922b"} Jun 09 15:25:04.264315 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:04.264216 2611 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="83797ed940ffea8b2cccd22dff5ed4759e266660a474c0dbdbb7e5fccfb8922b" Jun 09 15:25:04.401656 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:04.401584 2611 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z8jxs" Jun 09 15:25:04.416309 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:04.416281 2611 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e059s7f" Jun 09 15:25:04.483377 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:04.483343 2611 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a8b7cf0-2e3d-448b-aad6-0fc22e3bb88c-util\") pod \"8a8b7cf0-2e3d-448b-aad6-0fc22e3bb88c\" (UID: \"8a8b7cf0-2e3d-448b-aad6-0fc22e3bb88c\") " Jun 09 15:25:04.483377 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:04.483379 2611 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/85cf8db7-d51b-4b68-aff6-bd79366b2bdb-bundle\") pod \"85cf8db7-d51b-4b68-aff6-bd79366b2bdb\" (UID: \"85cf8db7-d51b-4b68-aff6-bd79366b2bdb\") " Jun 09 15:25:04.483617 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:04.483444 2611 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kmz2r\" (UniqueName: \"kubernetes.io/projected/8a8b7cf0-2e3d-448b-aad6-0fc22e3bb88c-kube-api-access-kmz2r\") pod \"8a8b7cf0-2e3d-448b-aad6-0fc22e3bb88c\" (UID: \"8a8b7cf0-2e3d-448b-aad6-0fc22e3bb88c\") " Jun 09 15:25:04.483617 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:04.483471 2611 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gcr5t\" (UniqueName: \"kubernetes.io/projected/85cf8db7-d51b-4b68-aff6-bd79366b2bdb-kube-api-access-gcr5t\") pod \"85cf8db7-d51b-4b68-aff6-bd79366b2bdb\" (UID: \"85cf8db7-d51b-4b68-aff6-bd79366b2bdb\") " Jun 09 15:25:04.483617 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:04.483521 2611 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/85cf8db7-d51b-4b68-aff6-bd79366b2bdb-util\") pod \"85cf8db7-d51b-4b68-aff6-bd79366b2bdb\" (UID: \"85cf8db7-d51b-4b68-aff6-bd79366b2bdb\") " Jun 09 15:25:04.483617 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:04.483552 2611 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a8b7cf0-2e3d-448b-aad6-0fc22e3bb88c-bundle\") pod \"8a8b7cf0-2e3d-448b-aad6-0fc22e3bb88c\" (UID: \"8a8b7cf0-2e3d-448b-aad6-0fc22e3bb88c\") " Jun 09 15:25:04.484056 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:04.484027 2611 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85cf8db7-d51b-4b68-aff6-bd79366b2bdb-bundle" (OuterVolumeSpecName: "bundle") pod "85cf8db7-d51b-4b68-aff6-bd79366b2bdb" (UID: "85cf8db7-d51b-4b68-aff6-bd79366b2bdb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 15:25:04.484275 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:04.484249 2611 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a8b7cf0-2e3d-448b-aad6-0fc22e3bb88c-bundle" (OuterVolumeSpecName: "bundle") pod "8a8b7cf0-2e3d-448b-aad6-0fc22e3bb88c" (UID: "8a8b7cf0-2e3d-448b-aad6-0fc22e3bb88c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 15:25:04.485617 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:04.485595 2611 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85cf8db7-d51b-4b68-aff6-bd79366b2bdb-kube-api-access-gcr5t" (OuterVolumeSpecName: "kube-api-access-gcr5t") pod "85cf8db7-d51b-4b68-aff6-bd79366b2bdb" (UID: "85cf8db7-d51b-4b68-aff6-bd79366b2bdb"). InnerVolumeSpecName "kube-api-access-gcr5t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 15:25:04.486000 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:04.485983 2611 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a8b7cf0-2e3d-448b-aad6-0fc22e3bb88c-kube-api-access-kmz2r" (OuterVolumeSpecName: "kube-api-access-kmz2r") pod "8a8b7cf0-2e3d-448b-aad6-0fc22e3bb88c" (UID: "8a8b7cf0-2e3d-448b-aad6-0fc22e3bb88c"). InnerVolumeSpecName "kube-api-access-kmz2r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 15:25:04.489441 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:04.489404 2611 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85cf8db7-d51b-4b68-aff6-bd79366b2bdb-util" (OuterVolumeSpecName: "util") pod "85cf8db7-d51b-4b68-aff6-bd79366b2bdb" (UID: "85cf8db7-d51b-4b68-aff6-bd79366b2bdb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 15:25:04.489971 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:04.489949 2611 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a8b7cf0-2e3d-448b-aad6-0fc22e3bb88c-util" (OuterVolumeSpecName: "util") pod "8a8b7cf0-2e3d-448b-aad6-0fc22e3bb88c" (UID: "8a8b7cf0-2e3d-448b-aad6-0fc22e3bb88c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 15:25:04.584988 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:04.584891 2611 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a8b7cf0-2e3d-448b-aad6-0fc22e3bb88c-util\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 09 15:25:04.584988 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:04.584927 2611 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/85cf8db7-d51b-4b68-aff6-bd79366b2bdb-bundle\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 09 15:25:04.584988 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:04.584937 2611 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kmz2r\" (UniqueName: \"kubernetes.io/projected/8a8b7cf0-2e3d-448b-aad6-0fc22e3bb88c-kube-api-access-kmz2r\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 09 15:25:04.584988 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:04.584948 2611 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gcr5t\" (UniqueName: \"kubernetes.io/projected/85cf8db7-d51b-4b68-aff6-bd79366b2bdb-kube-api-access-gcr5t\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 09 15:25:04.584988 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:04.584957 2611 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/85cf8db7-d51b-4b68-aff6-bd79366b2bdb-util\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 09 15:25:04.584988 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:04.584967 2611 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a8b7cf0-2e3d-448b-aad6-0fc22e3bb88c-bundle\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 09 15:25:05.270907 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:05.270863 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e059s7f" event={"ID":"85cf8db7-d51b-4b68-aff6-bd79366b2bdb","Type":"ContainerDied","Data":"b774d64f965a1e3f23a8f27b97a0b3506f89093c627e8758d25361e3f5c0b6eb"} Jun 09 15:25:05.270907 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:05.270919 2611 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b774d64f965a1e3f23a8f27b97a0b3506f89093c627e8758d25361e3f5c0b6eb" Jun 09 15:25:05.271430 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:05.270875 2611 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e059s7f" Jun 09 15:25:05.272723 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:05.272701 2611 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z8jxs" Jun 09 15:25:05.272830 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:05.272737 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z8jxs" event={"ID":"8a8b7cf0-2e3d-448b-aad6-0fc22e3bb88c","Type":"ContainerDied","Data":"ec1415c4eb68456d8b5a0606a125e0912f4a06d5d3bda230dda8de0206515e89"} Jun 09 15:25:05.272830 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:05.272773 2611 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ec1415c4eb68456d8b5a0606a125e0912f4a06d5d3bda230dda8de0206515e89" Jun 09 15:25:23.278088 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:23.278052 2611 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-rklx8"] Jun 09 15:25:23.278531 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:23.278414 2611 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85cf8db7-d51b-4b68-aff6-bd79366b2bdb" containerName="util" Jun 09 15:25:23.278531 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:23.278428 2611 state_mem.go:107] "Deleted CPUSet assignment" podUID="85cf8db7-d51b-4b68-aff6-bd79366b2bdb" containerName="util" Jun 09 15:25:23.278531 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:23.278436 2611 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a8b7cf0-2e3d-448b-aad6-0fc22e3bb88c" containerName="extract" Jun 09 15:25:23.278531 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:23.278445 2611 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a8b7cf0-2e3d-448b-aad6-0fc22e3bb88c" containerName="extract" Jun 09 15:25:23.278531 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:23.278456 2611 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0baa3c5-e6d1-4ea2-bc5b-8ab30287f2e2" containerName="extract" Jun 09 15:25:23.278531 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:23.278461 2611 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0baa3c5-e6d1-4ea2-bc5b-8ab30287f2e2" containerName="extract" Jun 09 15:25:23.278531 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:23.278471 2611 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a8b7cf0-2e3d-448b-aad6-0fc22e3bb88c" containerName="pull" Jun 09 15:25:23.278531 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:23.278477 2611 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a8b7cf0-2e3d-448b-aad6-0fc22e3bb88c" containerName="pull" Jun 09 15:25:23.278531 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:23.278483 2611 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a8b7cf0-2e3d-448b-aad6-0fc22e3bb88c" containerName="util" Jun 09 15:25:23.278531 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:23.278489 2611 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a8b7cf0-2e3d-448b-aad6-0fc22e3bb88c" containerName="util" Jun 09 15:25:23.278531 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:23.278495 2611 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1cb643e1-ac5e-46a2-a2bc-3a04c35a23ed" containerName="pull" Jun 09 15:25:23.278531 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:23.278500 2611 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cb643e1-ac5e-46a2-a2bc-3a04c35a23ed" containerName="pull" Jun 09 15:25:23.278531 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:23.278506 2611 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1cb643e1-ac5e-46a2-a2bc-3a04c35a23ed" containerName="util" Jun 09 15:25:23.278531 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:23.278511 2611 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cb643e1-ac5e-46a2-a2bc-3a04c35a23ed" containerName="util" Jun 09 15:25:23.278531 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:23.278516 2611 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85cf8db7-d51b-4b68-aff6-bd79366b2bdb" containerName="pull" Jun 09 15:25:23.278531 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:23.278521 2611 state_mem.go:107] "Deleted CPUSet assignment" podUID="85cf8db7-d51b-4b68-aff6-bd79366b2bdb" containerName="pull" Jun 09 15:25:23.278531 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:23.278526 2611 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0baa3c5-e6d1-4ea2-bc5b-8ab30287f2e2" containerName="pull" Jun 09 15:25:23.278531 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:23.278531 2611 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0baa3c5-e6d1-4ea2-bc5b-8ab30287f2e2" containerName="pull" Jun 09 15:25:23.278531 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:23.278537 2611 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0baa3c5-e6d1-4ea2-bc5b-8ab30287f2e2" containerName="util" Jun 09 15:25:23.278531 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:23.278542 2611 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0baa3c5-e6d1-4ea2-bc5b-8ab30287f2e2" containerName="util" Jun 09 15:25:23.279101 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:23.278551 2611 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85cf8db7-d51b-4b68-aff6-bd79366b2bdb" containerName="extract" Jun 09 15:25:23.279101 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:23.278556 2611 state_mem.go:107] "Deleted CPUSet assignment" podUID="85cf8db7-d51b-4b68-aff6-bd79366b2bdb" containerName="extract" Jun 09 15:25:23.279101 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:23.278564 2611 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1cb643e1-ac5e-46a2-a2bc-3a04c35a23ed" containerName="extract" Jun 09 15:25:23.279101 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:23.278569 2611 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cb643e1-ac5e-46a2-a2bc-3a04c35a23ed" containerName="extract" Jun 09 15:25:23.279101 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:23.278617 2611 memory_manager.go:368] "RemoveStaleState removing state" podUID="1cb643e1-ac5e-46a2-a2bc-3a04c35a23ed" containerName="extract" Jun 09 15:25:23.279101 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:23.278626 2611 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a8b7cf0-2e3d-448b-aad6-0fc22e3bb88c" containerName="extract" Jun 09 15:25:23.279101 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:23.278631 2611 memory_manager.go:368] "RemoveStaleState removing state" podUID="85cf8db7-d51b-4b68-aff6-bd79366b2bdb" containerName="extract" Jun 09 15:25:23.279101 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:23.278638 2611 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0baa3c5-e6d1-4ea2-bc5b-8ab30287f2e2" containerName="extract" Jun 09 15:25:23.282108 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:23.282088 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-rklx8" Jun 09 15:25:23.284704 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:23.284678 2611 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 09 15:25:23.284704 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:23.284693 2611 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 09 15:25:23.285557 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:23.285538 2611 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 09 15:25:23.285649 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:23.285564 2611 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-9w7w4\"" Jun 09 15:25:23.293487 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:23.293461 2611 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-rklx8"] Jun 09 15:25:23.344118 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:23.344020 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svtss\" (UniqueName: \"kubernetes.io/projected/1d31b525-faa3-4dcc-9da4-8d0de8f3bc4b-kube-api-access-svtss\") pod \"dns-operator-controller-manager-864dd78c4c-rklx8\" (UID: \"1d31b525-faa3-4dcc-9da4-8d0de8f3bc4b\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-rklx8" Jun 09 15:25:23.444934 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:23.444899 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svtss\" (UniqueName: \"kubernetes.io/projected/1d31b525-faa3-4dcc-9da4-8d0de8f3bc4b-kube-api-access-svtss\") pod \"dns-operator-controller-manager-864dd78c4c-rklx8\" (UID: \"1d31b525-faa3-4dcc-9da4-8d0de8f3bc4b\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-rklx8" Jun 09 15:25:23.454358 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:23.454321 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-svtss\" (UniqueName: \"kubernetes.io/projected/1d31b525-faa3-4dcc-9da4-8d0de8f3bc4b-kube-api-access-svtss\") pod \"dns-operator-controller-manager-864dd78c4c-rklx8\" (UID: \"1d31b525-faa3-4dcc-9da4-8d0de8f3bc4b\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-rklx8" Jun 09 15:25:23.593767 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:23.593708 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-rklx8" Jun 09 15:25:23.735209 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:23.735185 2611 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-rklx8"] Jun 09 15:25:23.737186 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:25:23.737142 2611 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d31b525_faa3_4dcc_9da4_8d0de8f3bc4b.slice/crio-8e83e642a93032f5f77fad8f9b2d8362b7eeba01fe5c1b0924f4caf6341bcbd1 WatchSource:0}: Error finding container 8e83e642a93032f5f77fad8f9b2d8362b7eeba01fe5c1b0924f4caf6341bcbd1: Status 404 returned error can't find the container with id 8e83e642a93032f5f77fad8f9b2d8362b7eeba01fe5c1b0924f4caf6341bcbd1 Jun 09 15:25:24.373117 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:24.373079 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-rklx8" event={"ID":"1d31b525-faa3-4dcc-9da4-8d0de8f3bc4b","Type":"ContainerStarted","Data":"8e83e642a93032f5f77fad8f9b2d8362b7eeba01fe5c1b0924f4caf6341bcbd1"} Jun 09 15:25:26.386773 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:26.386737 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-rklx8" event={"ID":"1d31b525-faa3-4dcc-9da4-8d0de8f3bc4b","Type":"ContainerStarted","Data":"00bae05cb74bbf145d931b3f0bd034b7daee241d6b4eb848ab106c682780c269"} Jun 09 15:25:26.387191 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:26.386824 2611 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-rklx8" Jun 09 15:25:26.410903 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:26.410790 2611 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-rklx8" podStartSLOduration=0.998533774 podStartE2EDuration="3.410771536s" totalImagesPullingTime="2.412237762s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:25:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:25:26.409324411 +0000 UTC m=+647.215016631" watchObservedRunningTime="2026-06-09 15:25:26.410771536 +0000 UTC m=+647.216463755" Jun 09 15:25:26.919861 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:26.919822 2611 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-8zghr"] Jun 09 15:25:26.923295 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:26.923276 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8zghr" Jun 09 15:25:26.925802 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:26.925770 2611 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 09 15:25:26.925931 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:26.925811 2611 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 09 15:25:26.925931 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:26.925822 2611 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-j788r\"" Jun 09 15:25:26.931282 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:26.931016 2611 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-8zghr"] Jun 09 15:25:27.077052 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:27.077007 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2v4n6\" (UniqueName: \"kubernetes.io/projected/5c9e72ec-61ce-478f-9487-97b26734ace3-kube-api-access-2v4n6\") pod \"kuadrant-console-plugin-66b5774985-8zghr\" (UID: \"5c9e72ec-61ce-478f-9487-97b26734ace3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8zghr" Jun 09 15:25:27.077532 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:27.077140 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/5c9e72ec-61ce-478f-9487-97b26734ace3-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-8zghr\" (UID: \"5c9e72ec-61ce-478f-9487-97b26734ace3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8zghr" Jun 09 15:25:27.077532 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:27.077224 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5c9e72ec-61ce-478f-9487-97b26734ace3-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-8zghr\" (UID: \"5c9e72ec-61ce-478f-9487-97b26734ace3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8zghr" Jun 09 15:25:27.178353 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:27.178293 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/5c9e72ec-61ce-478f-9487-97b26734ace3-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-8zghr\" (UID: \"5c9e72ec-61ce-478f-9487-97b26734ace3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8zghr" Jun 09 15:25:27.178537 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:27.178355 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5c9e72ec-61ce-478f-9487-97b26734ace3-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-8zghr\" (UID: \"5c9e72ec-61ce-478f-9487-97b26734ace3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8zghr" Jun 09 15:25:27.178537 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:27.178404 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2v4n6\" (UniqueName: \"kubernetes.io/projected/5c9e72ec-61ce-478f-9487-97b26734ace3-kube-api-access-2v4n6\") pod \"kuadrant-console-plugin-66b5774985-8zghr\" (UID: \"5c9e72ec-61ce-478f-9487-97b26734ace3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8zghr" Jun 09 15:25:27.179520 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:27.179493 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5c9e72ec-61ce-478f-9487-97b26734ace3-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-8zghr\" (UID: \"5c9e72ec-61ce-478f-9487-97b26734ace3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8zghr" Jun 09 15:25:27.181052 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:27.181024 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/5c9e72ec-61ce-478f-9487-97b26734ace3-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-8zghr\" (UID: \"5c9e72ec-61ce-478f-9487-97b26734ace3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8zghr" Jun 09 15:25:27.186206 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:27.186182 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2v4n6\" (UniqueName: \"kubernetes.io/projected/5c9e72ec-61ce-478f-9487-97b26734ace3-kube-api-access-2v4n6\") pod \"kuadrant-console-plugin-66b5774985-8zghr\" (UID: \"5c9e72ec-61ce-478f-9487-97b26734ace3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8zghr" Jun 09 15:25:27.234224 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:27.234185 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8zghr" Jun 09 15:25:27.370046 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:27.370013 2611 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-8zghr"] Jun 09 15:25:27.372043 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:25:27.372018 2611 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5c9e72ec_61ce_478f_9487_97b26734ace3.slice/crio-2e976867e24b7ffa02a8c9e062844f3f4dbed404609b4932c5772418c38310d1 WatchSource:0}: Error finding container 2e976867e24b7ffa02a8c9e062844f3f4dbed404609b4932c5772418c38310d1: Status 404 returned error can't find the container with id 2e976867e24b7ffa02a8c9e062844f3f4dbed404609b4932c5772418c38310d1 Jun 09 15:25:27.393746 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:27.393706 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8zghr" event={"ID":"5c9e72ec-61ce-478f-9487-97b26734ace3","Type":"ContainerStarted","Data":"2e976867e24b7ffa02a8c9e062844f3f4dbed404609b4932c5772418c38310d1"} Jun 09 15:25:37.396836 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:37.396800 2611 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-rklx8" Jun 09 15:25:54.558069 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:54.558030 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8zghr" event={"ID":"5c9e72ec-61ce-478f-9487-97b26734ace3","Type":"ContainerStarted","Data":"ce876ef247ca739cfb61b0b14875dd136a32bcfa462e3df0fad3e76b1d39656c"} Jun 09 15:25:54.575918 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:25:54.575864 2611 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8zghr" podStartSLOduration=1.566474586 podStartE2EDuration="28.575848522s" totalImagesPullingTime="27.009373936s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:25:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:25:54.573137503 +0000 UTC m=+675.378829721" watchObservedRunningTime="2026-06-09 15:25:54.575848522 +0000 UTC m=+675.381540740" Jun 09 15:26:10.263984 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:10.263924 2611 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-tfpnn"] Jun 09 15:26:10.281855 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:10.281821 2611 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-tfpnn"] Jun 09 15:26:10.282017 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:10.281938 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-tfpnn" Jun 09 15:26:10.284387 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:10.284368 2611 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-mgb8g\"" Jun 09 15:26:10.364727 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:10.364683 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2n5c\" (UniqueName: \"kubernetes.io/projected/1073de41-fb4a-4379-8275-6c888c71ab5d-kube-api-access-r2n5c\") pod \"authorino-58cd955675-tfpnn\" (UID: \"1073de41-fb4a-4379-8275-6c888c71ab5d\") " pod="kuadrant-system/authorino-58cd955675-tfpnn" Jun 09 15:26:10.466098 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:10.466053 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2n5c\" (UniqueName: \"kubernetes.io/projected/1073de41-fb4a-4379-8275-6c888c71ab5d-kube-api-access-r2n5c\") pod \"authorino-58cd955675-tfpnn\" (UID: \"1073de41-fb4a-4379-8275-6c888c71ab5d\") " pod="kuadrant-system/authorino-58cd955675-tfpnn" Jun 09 15:26:10.472727 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:10.472694 2611 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-m5ght"] Jun 09 15:26:10.476081 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:10.476059 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-m5ght" Jun 09 15:26:10.480470 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:10.480441 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2n5c\" (UniqueName: \"kubernetes.io/projected/1073de41-fb4a-4379-8275-6c888c71ab5d-kube-api-access-r2n5c\") pod \"authorino-58cd955675-tfpnn\" (UID: \"1073de41-fb4a-4379-8275-6c888c71ab5d\") " pod="kuadrant-system/authorino-58cd955675-tfpnn" Jun 09 15:26:10.483044 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:10.483018 2611 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-m5ght"] Jun 09 15:26:10.567616 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:10.567523 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84scv\" (UniqueName: \"kubernetes.io/projected/a7beac41-1224-4180-8a77-0eb54efdb7d7-kube-api-access-84scv\") pod \"authorino-75d556bd77-m5ght\" (UID: \"a7beac41-1224-4180-8a77-0eb54efdb7d7\") " pod="kuadrant-system/authorino-75d556bd77-m5ght" Jun 09 15:26:10.591129 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:10.591091 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-tfpnn" Jun 09 15:26:10.668505 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:10.668460 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84scv\" (UniqueName: \"kubernetes.io/projected/a7beac41-1224-4180-8a77-0eb54efdb7d7-kube-api-access-84scv\") pod \"authorino-75d556bd77-m5ght\" (UID: \"a7beac41-1224-4180-8a77-0eb54efdb7d7\") " pod="kuadrant-system/authorino-75d556bd77-m5ght" Jun 09 15:26:10.677198 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:10.677139 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-84scv\" (UniqueName: \"kubernetes.io/projected/a7beac41-1224-4180-8a77-0eb54efdb7d7-kube-api-access-84scv\") pod \"authorino-75d556bd77-m5ght\" (UID: \"a7beac41-1224-4180-8a77-0eb54efdb7d7\") " pod="kuadrant-system/authorino-75d556bd77-m5ght" Jun 09 15:26:10.733009 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:10.732980 2611 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-tfpnn"] Jun 09 15:26:10.735531 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:26:10.735502 2611 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1073de41_fb4a_4379_8275_6c888c71ab5d.slice/crio-14e973fce94be143a9979cc60953e0dd79669f201452676ba9e348cfd315dd36 WatchSource:0}: Error finding container 14e973fce94be143a9979cc60953e0dd79669f201452676ba9e348cfd315dd36: Status 404 returned error can't find the container with id 14e973fce94be143a9979cc60953e0dd79669f201452676ba9e348cfd315dd36 Jun 09 15:26:10.795041 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:10.795004 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-m5ght" Jun 09 15:26:10.932447 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:10.932421 2611 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-m5ght"] Jun 09 15:26:10.934218 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:26:10.934185 2611 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda7beac41_1224_4180_8a77_0eb54efdb7d7.slice/crio-cc874e67b4a460476019454381300bb36ab6929de7664518e454d5b93e633dc4 WatchSource:0}: Error finding container cc874e67b4a460476019454381300bb36ab6929de7664518e454d5b93e633dc4: Status 404 returned error can't find the container with id cc874e67b4a460476019454381300bb36ab6929de7664518e454d5b93e633dc4 Jun 09 15:26:11.662444 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:11.662396 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-m5ght" event={"ID":"a7beac41-1224-4180-8a77-0eb54efdb7d7","Type":"ContainerStarted","Data":"cc874e67b4a460476019454381300bb36ab6929de7664518e454d5b93e633dc4"} Jun 09 15:26:11.665654 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:11.665585 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-tfpnn" event={"ID":"1073de41-fb4a-4379-8275-6c888c71ab5d","Type":"ContainerStarted","Data":"14e973fce94be143a9979cc60953e0dd79669f201452676ba9e348cfd315dd36"} Jun 09 15:26:15.692351 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:15.692308 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-m5ght" event={"ID":"a7beac41-1224-4180-8a77-0eb54efdb7d7","Type":"ContainerStarted","Data":"7115c4b8eea84cf61f6dec36ae8e82def7732ef4a409ae8048ec8e550d425f20"} Jun 09 15:26:15.693898 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:15.693868 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-tfpnn" event={"ID":"1073de41-fb4a-4379-8275-6c888c71ab5d","Type":"ContainerStarted","Data":"e56338c9e3b7242a5a7819727ce6dec887ee46b730a702ba5726dcff4912cfa2"} Jun 09 15:26:15.710397 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:15.710344 2611 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-m5ght" podStartSLOduration=1.488753965 podStartE2EDuration="5.710328633s" totalImagesPullingTime="4.221574668s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:26:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:26:15.709352571 +0000 UTC m=+696.515044791" watchObservedRunningTime="2026-06-09 15:26:15.710328633 +0000 UTC m=+696.516020830" Jun 09 15:26:15.725646 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:15.725593 2611 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-tfpnn" podStartSLOduration=1.293103931 podStartE2EDuration="5.725575456s" totalImagesPullingTime="4.432471525s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:26:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:26:15.724246872 +0000 UTC m=+696.529939095" watchObservedRunningTime="2026-06-09 15:26:15.725575456 +0000 UTC m=+696.531267674" Jun 09 15:26:15.766000 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:15.765967 2611 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-tfpnn"] Jun 09 15:26:17.705109 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:17.705060 2611 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-tfpnn" podUID="1073de41-fb4a-4379-8275-6c888c71ab5d" containerName="authorino" containerID="cri-o://e56338c9e3b7242a5a7819727ce6dec887ee46b730a702ba5726dcff4912cfa2" gracePeriod=30 Jun 09 15:26:18.492101 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:18.492065 2611 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-tfpnn" Jun 09 15:26:18.641658 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:18.641564 2611 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r2n5c\" (UniqueName: \"kubernetes.io/projected/1073de41-fb4a-4379-8275-6c888c71ab5d-kube-api-access-r2n5c\") pod \"1073de41-fb4a-4379-8275-6c888c71ab5d\" (UID: \"1073de41-fb4a-4379-8275-6c888c71ab5d\") " Jun 09 15:26:18.643705 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:18.643676 2611 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1073de41-fb4a-4379-8275-6c888c71ab5d-kube-api-access-r2n5c" (OuterVolumeSpecName: "kube-api-access-r2n5c") pod "1073de41-fb4a-4379-8275-6c888c71ab5d" (UID: "1073de41-fb4a-4379-8275-6c888c71ab5d"). InnerVolumeSpecName "kube-api-access-r2n5c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 15:26:18.712168 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:18.712127 2611 generic.go:356] "Generic (PLEG): container finished" podID="1073de41-fb4a-4379-8275-6c888c71ab5d" containerID="e56338c9e3b7242a5a7819727ce6dec887ee46b730a702ba5726dcff4912cfa2" exitCode=0 Jun 09 15:26:18.712584 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:18.712176 2611 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-tfpnn" Jun 09 15:26:18.712584 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:18.712212 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-tfpnn" event={"ID":"1073de41-fb4a-4379-8275-6c888c71ab5d","Type":"ContainerDied","Data":"e56338c9e3b7242a5a7819727ce6dec887ee46b730a702ba5726dcff4912cfa2"} Jun 09 15:26:18.712584 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:18.712254 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-tfpnn" event={"ID":"1073de41-fb4a-4379-8275-6c888c71ab5d","Type":"ContainerDied","Data":"14e973fce94be143a9979cc60953e0dd79669f201452676ba9e348cfd315dd36"} Jun 09 15:26:18.712584 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:18.712272 2611 scope.go:117] "RemoveContainer" containerID="e56338c9e3b7242a5a7819727ce6dec887ee46b730a702ba5726dcff4912cfa2" Jun 09 15:26:18.721521 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:18.721504 2611 scope.go:117] "RemoveContainer" containerID="e56338c9e3b7242a5a7819727ce6dec887ee46b730a702ba5726dcff4912cfa2" Jun 09 15:26:18.721801 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:26:18.721782 2611 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e56338c9e3b7242a5a7819727ce6dec887ee46b730a702ba5726dcff4912cfa2\": container with ID starting with e56338c9e3b7242a5a7819727ce6dec887ee46b730a702ba5726dcff4912cfa2 not found: ID does not exist" containerID="e56338c9e3b7242a5a7819727ce6dec887ee46b730a702ba5726dcff4912cfa2" Jun 09 15:26:18.721861 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:18.721814 2611 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e56338c9e3b7242a5a7819727ce6dec887ee46b730a702ba5726dcff4912cfa2"} err="failed to get container status \"e56338c9e3b7242a5a7819727ce6dec887ee46b730a702ba5726dcff4912cfa2\": rpc error: code = NotFound desc = could not find container \"e56338c9e3b7242a5a7819727ce6dec887ee46b730a702ba5726dcff4912cfa2\": container with ID starting with e56338c9e3b7242a5a7819727ce6dec887ee46b730a702ba5726dcff4912cfa2 not found: ID does not exist" Jun 09 15:26:18.740064 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:18.740012 2611 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-tfpnn"] Jun 09 15:26:18.742556 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:18.742521 2611 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r2n5c\" (UniqueName: \"kubernetes.io/projected/1073de41-fb4a-4379-8275-6c888c71ab5d-kube-api-access-r2n5c\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 09 15:26:18.742827 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:18.742804 2611 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-tfpnn"] Jun 09 15:26:19.632351 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:19.632320 2611 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1073de41-fb4a-4379-8275-6c888c71ab5d" path="/var/lib/kubelet/pods/1073de41-fb4a-4379-8275-6c888c71ab5d/volumes" Jun 09 15:26:39.373346 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:39.373310 2611 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748rnwv4"] Jun 09 15:26:39.373853 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:39.373636 2611 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1073de41-fb4a-4379-8275-6c888c71ab5d" containerName="authorino" Jun 09 15:26:39.373853 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:39.373647 2611 state_mem.go:107] "Deleted CPUSet assignment" podUID="1073de41-fb4a-4379-8275-6c888c71ab5d" containerName="authorino" Jun 09 15:26:39.373853 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:39.373709 2611 memory_manager.go:368] "RemoveStaleState removing state" podUID="1073de41-fb4a-4379-8275-6c888c71ab5d" containerName="authorino" Jun 09 15:26:39.376503 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:39.376487 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748rnwv4" Jun 09 15:26:39.379747 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:39.379725 2611 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xcgzc\"" Jun 09 15:26:39.380633 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:39.380615 2611 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 15:26:39.380806 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:39.380793 2611 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 15:26:39.390697 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:39.390670 2611 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748rnwv4"] Jun 09 15:26:39.416662 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:39.416628 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mspt5\" (UniqueName: \"kubernetes.io/projected/ab949f16-bc0c-4941-b3a6-7dfac7853f3d-kube-api-access-mspt5\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748rnwv4\" (UID: \"ab949f16-bc0c-4941-b3a6-7dfac7853f3d\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748rnwv4" Jun 09 15:26:39.416828 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:39.416689 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ab949f16-bc0c-4941-b3a6-7dfac7853f3d-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748rnwv4\" (UID: \"ab949f16-bc0c-4941-b3a6-7dfac7853f3d\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748rnwv4" Jun 09 15:26:39.416828 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:39.416723 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ab949f16-bc0c-4941-b3a6-7dfac7853f3d-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748rnwv4\" (UID: \"ab949f16-bc0c-4941-b3a6-7dfac7853f3d\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748rnwv4" Jun 09 15:26:39.517119 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:39.517076 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mspt5\" (UniqueName: \"kubernetes.io/projected/ab949f16-bc0c-4941-b3a6-7dfac7853f3d-kube-api-access-mspt5\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748rnwv4\" (UID: \"ab949f16-bc0c-4941-b3a6-7dfac7853f3d\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748rnwv4" Jun 09 15:26:39.517352 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:39.517231 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ab949f16-bc0c-4941-b3a6-7dfac7853f3d-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748rnwv4\" (UID: \"ab949f16-bc0c-4941-b3a6-7dfac7853f3d\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748rnwv4" Jun 09 15:26:39.517352 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:39.517267 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ab949f16-bc0c-4941-b3a6-7dfac7853f3d-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748rnwv4\" (UID: \"ab949f16-bc0c-4941-b3a6-7dfac7853f3d\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748rnwv4" Jun 09 15:26:39.517720 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:39.517698 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ab949f16-bc0c-4941-b3a6-7dfac7853f3d-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748rnwv4\" (UID: \"ab949f16-bc0c-4941-b3a6-7dfac7853f3d\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748rnwv4" Jun 09 15:26:39.517720 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:39.517714 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ab949f16-bc0c-4941-b3a6-7dfac7853f3d-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748rnwv4\" (UID: \"ab949f16-bc0c-4941-b3a6-7dfac7853f3d\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748rnwv4" Jun 09 15:26:39.528263 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:39.528226 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mspt5\" (UniqueName: \"kubernetes.io/projected/ab949f16-bc0c-4941-b3a6-7dfac7853f3d-kube-api-access-mspt5\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748rnwv4\" (UID: \"ab949f16-bc0c-4941-b3a6-7dfac7853f3d\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748rnwv4" Jun 09 15:26:39.689004 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:39.688975 2611 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xcgzc\"" Jun 09 15:26:39.696588 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:39.696568 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748rnwv4" Jun 09 15:26:39.858777 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:39.858750 2611 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748rnwv4"] Jun 09 15:26:39.860737 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:26:39.860700 2611 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab949f16_bc0c_4941_b3a6_7dfac7853f3d.slice/crio-8fbfc1c9e7935cb5c1a97c4d5f638f80e53f0ee04d448e2b3c0f972f4dca60fb WatchSource:0}: Error finding container 8fbfc1c9e7935cb5c1a97c4d5f638f80e53f0ee04d448e2b3c0f972f4dca60fb: Status 404 returned error can't find the container with id 8fbfc1c9e7935cb5c1a97c4d5f638f80e53f0ee04d448e2b3c0f972f4dca60fb Jun 09 15:26:40.830051 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:40.829961 2611 generic.go:356] "Generic (PLEG): container finished" podID="ab949f16-bc0c-4941-b3a6-7dfac7853f3d" containerID="55c26c332310165dcaffad8de625c3b822ea8456dcd02de682ff96ba402b6a7d" exitCode=0 Jun 09 15:26:40.830474 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:40.830040 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748rnwv4" event={"ID":"ab949f16-bc0c-4941-b3a6-7dfac7853f3d","Type":"ContainerDied","Data":"55c26c332310165dcaffad8de625c3b822ea8456dcd02de682ff96ba402b6a7d"} Jun 09 15:26:40.830474 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:40.830098 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748rnwv4" event={"ID":"ab949f16-bc0c-4941-b3a6-7dfac7853f3d","Type":"ContainerStarted","Data":"8fbfc1c9e7935cb5c1a97c4d5f638f80e53f0ee04d448e2b3c0f972f4dca60fb"} Jun 09 15:26:41.837061 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:41.836968 2611 generic.go:356] "Generic (PLEG): container finished" podID="ab949f16-bc0c-4941-b3a6-7dfac7853f3d" containerID="f9062e7a3f9fa71c9b4088d46be9eb118107aa68027e5122aa0823dccbd067b7" exitCode=0 Jun 09 15:26:41.837061 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:41.837026 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748rnwv4" event={"ID":"ab949f16-bc0c-4941-b3a6-7dfac7853f3d","Type":"ContainerDied","Data":"f9062e7a3f9fa71c9b4088d46be9eb118107aa68027e5122aa0823dccbd067b7"} Jun 09 15:26:42.843914 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:42.843879 2611 generic.go:356] "Generic (PLEG): container finished" podID="ab949f16-bc0c-4941-b3a6-7dfac7853f3d" containerID="e150bcc09017f386251ffd39b19aad233ea782061c475cadf551babee3befa4b" exitCode=0 Jun 09 15:26:42.844325 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:42.843971 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748rnwv4" event={"ID":"ab949f16-bc0c-4941-b3a6-7dfac7853f3d","Type":"ContainerDied","Data":"e150bcc09017f386251ffd39b19aad233ea782061c475cadf551babee3befa4b"} Jun 09 15:26:43.987038 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:43.987009 2611 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748rnwv4" Jun 09 15:26:44.051899 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:44.051859 2611 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ab949f16-bc0c-4941-b3a6-7dfac7853f3d-bundle\") pod \"ab949f16-bc0c-4941-b3a6-7dfac7853f3d\" (UID: \"ab949f16-bc0c-4941-b3a6-7dfac7853f3d\") " Jun 09 15:26:44.051899 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:44.051901 2611 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ab949f16-bc0c-4941-b3a6-7dfac7853f3d-util\") pod \"ab949f16-bc0c-4941-b3a6-7dfac7853f3d\" (UID: \"ab949f16-bc0c-4941-b3a6-7dfac7853f3d\") " Jun 09 15:26:44.052101 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:44.051989 2611 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mspt5\" (UniqueName: \"kubernetes.io/projected/ab949f16-bc0c-4941-b3a6-7dfac7853f3d-kube-api-access-mspt5\") pod \"ab949f16-bc0c-4941-b3a6-7dfac7853f3d\" (UID: \"ab949f16-bc0c-4941-b3a6-7dfac7853f3d\") " Jun 09 15:26:44.052462 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:44.052434 2611 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab949f16-bc0c-4941-b3a6-7dfac7853f3d-bundle" (OuterVolumeSpecName: "bundle") pod "ab949f16-bc0c-4941-b3a6-7dfac7853f3d" (UID: "ab949f16-bc0c-4941-b3a6-7dfac7853f3d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 15:26:44.054090 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:44.054061 2611 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab949f16-bc0c-4941-b3a6-7dfac7853f3d-kube-api-access-mspt5" (OuterVolumeSpecName: "kube-api-access-mspt5") pod "ab949f16-bc0c-4941-b3a6-7dfac7853f3d" (UID: "ab949f16-bc0c-4941-b3a6-7dfac7853f3d"). InnerVolumeSpecName "kube-api-access-mspt5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 15:26:44.058472 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:44.058442 2611 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab949f16-bc0c-4941-b3a6-7dfac7853f3d-util" (OuterVolumeSpecName: "util") pod "ab949f16-bc0c-4941-b3a6-7dfac7853f3d" (UID: "ab949f16-bc0c-4941-b3a6-7dfac7853f3d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 15:26:44.153424 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:44.153330 2611 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ab949f16-bc0c-4941-b3a6-7dfac7853f3d-bundle\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 09 15:26:44.153424 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:44.153359 2611 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ab949f16-bc0c-4941-b3a6-7dfac7853f3d-util\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 09 15:26:44.153424 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:44.153368 2611 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mspt5\" (UniqueName: \"kubernetes.io/projected/ab949f16-bc0c-4941-b3a6-7dfac7853f3d-kube-api-access-mspt5\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 09 15:26:44.856401 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:44.856372 2611 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748rnwv4" Jun 09 15:26:44.856654 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:44.856367 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748rnwv4" event={"ID":"ab949f16-bc0c-4941-b3a6-7dfac7853f3d","Type":"ContainerDied","Data":"8fbfc1c9e7935cb5c1a97c4d5f638f80e53f0ee04d448e2b3c0f972f4dca60fb"} Jun 09 15:26:44.856654 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:44.856504 2611 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8fbfc1c9e7935cb5c1a97c4d5f638f80e53f0ee04d448e2b3c0f972f4dca60fb" Jun 09 15:26:49.474126 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:49.474084 2611 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-fz4kq"] Jun 09 15:26:49.474532 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:49.474495 2611 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab949f16-bc0c-4941-b3a6-7dfac7853f3d" containerName="util" Jun 09 15:26:49.474532 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:49.474512 2611 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab949f16-bc0c-4941-b3a6-7dfac7853f3d" containerName="util" Jun 09 15:26:49.474532 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:49.474522 2611 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab949f16-bc0c-4941-b3a6-7dfac7853f3d" containerName="extract" Jun 09 15:26:49.474532 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:49.474530 2611 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab949f16-bc0c-4941-b3a6-7dfac7853f3d" containerName="extract" Jun 09 15:26:49.474674 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:49.474542 2611 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab949f16-bc0c-4941-b3a6-7dfac7853f3d" containerName="pull" Jun 09 15:26:49.474674 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:49.474548 2611 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab949f16-bc0c-4941-b3a6-7dfac7853f3d" containerName="pull" Jun 09 15:26:49.474674 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:49.474620 2611 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab949f16-bc0c-4941-b3a6-7dfac7853f3d" containerName="extract" Jun 09 15:26:49.478930 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:49.478913 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-fz4kq" Jun 09 15:26:49.483019 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:26:49.482961 2611 status_manager.go:1018] "Failed to get status for pod" err="pods \"keycloak-operator-d67dbbb48-fz4kq\" is forbidden: User \"system:node:ip-10-0-129-139.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"keycloak-system\": no relationship found between node 'ip-10-0-129-139.ec2.internal' and this object" podUID="66b3f1c4-7fb3-4e0d-9910-7d73dcdc4929" pod="keycloak-system/keycloak-operator-d67dbbb48-fz4kq" Jun 09 15:26:49.483188 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:26:49.483071 2611 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-129-139.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"keycloak-system\": no relationship found between node 'ip-10-0-129-139.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" Jun 09 15:26:49.483256 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:26:49.483191 2611 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"keycloak-operator-dockercfg-gjjgl\" is forbidden: User \"system:node:ip-10-0-129-139.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"keycloak-system\": no relationship found between node 'ip-10-0-129-139.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-gjjgl\"" type="*v1.Secret" Jun 09 15:26:49.483256 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:26:49.483243 2611 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-129-139.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"keycloak-system\": no relationship found between node 'ip-10-0-129-139.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" Jun 09 15:26:49.502994 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:49.502958 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hdjs\" (UniqueName: \"kubernetes.io/projected/66b3f1c4-7fb3-4e0d-9910-7d73dcdc4929-kube-api-access-6hdjs\") pod \"keycloak-operator-d67dbbb48-fz4kq\" (UID: \"66b3f1c4-7fb3-4e0d-9910-7d73dcdc4929\") " pod="keycloak-system/keycloak-operator-d67dbbb48-fz4kq" Jun 09 15:26:49.603804 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:49.603759 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hdjs\" (UniqueName: \"kubernetes.io/projected/66b3f1c4-7fb3-4e0d-9910-7d73dcdc4929-kube-api-access-6hdjs\") pod \"keycloak-operator-d67dbbb48-fz4kq\" (UID: \"66b3f1c4-7fb3-4e0d-9910-7d73dcdc4929\") " pod="keycloak-system/keycloak-operator-d67dbbb48-fz4kq" Jun 09 15:26:49.619189 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:49.619123 2611 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-fz4kq"] Jun 09 15:26:50.392609 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:50.392576 2611 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-gjjgl\"" Jun 09 15:26:50.639981 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:26:50.639943 2611 projected.go:291] Couldn't get configMap keycloak-system/kube-root-ca.crt: failed to sync configmap cache: timed out waiting for the condition Jun 09 15:26:50.879927 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:50.879891 2611 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 09 15:26:50.900993 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:50.900960 2611 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 09 15:26:50.910936 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:26:50.910904 2611 projected.go:196] Error preparing data for projected volume kube-api-access-6hdjs for pod keycloak-system/keycloak-operator-d67dbbb48-fz4kq: failed to sync configmap cache: timed out waiting for the condition Jun 09 15:26:50.911094 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:26:50.910991 2611 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/66b3f1c4-7fb3-4e0d-9910-7d73dcdc4929-kube-api-access-6hdjs podName:66b3f1c4-7fb3-4e0d-9910-7d73dcdc4929 nodeName:}" failed. No retries permitted until 2026-06-09 15:26:51.410972776 +0000 UTC m=+732.216664973 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-6hdjs" (UniqueName: "kubernetes.io/projected/66b3f1c4-7fb3-4e0d-9910-7d73dcdc4929-kube-api-access-6hdjs") pod "keycloak-operator-d67dbbb48-fz4kq" (UID: "66b3f1c4-7fb3-4e0d-9910-7d73dcdc4929") : failed to sync configmap cache: timed out waiting for the condition Jun 09 15:26:51.419563 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:51.419519 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hdjs\" (UniqueName: \"kubernetes.io/projected/66b3f1c4-7fb3-4e0d-9910-7d73dcdc4929-kube-api-access-6hdjs\") pod \"keycloak-operator-d67dbbb48-fz4kq\" (UID: \"66b3f1c4-7fb3-4e0d-9910-7d73dcdc4929\") " pod="keycloak-system/keycloak-operator-d67dbbb48-fz4kq" Jun 09 15:26:51.422115 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:51.422088 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hdjs\" (UniqueName: \"kubernetes.io/projected/66b3f1c4-7fb3-4e0d-9910-7d73dcdc4929-kube-api-access-6hdjs\") pod \"keycloak-operator-d67dbbb48-fz4kq\" (UID: \"66b3f1c4-7fb3-4e0d-9910-7d73dcdc4929\") " pod="keycloak-system/keycloak-operator-d67dbbb48-fz4kq" Jun 09 15:26:51.593862 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:51.593818 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-fz4kq" Jun 09 15:26:51.800050 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:51.800009 2611 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-fz4kq"] Jun 09 15:26:51.802038 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:26:51.802001 2611 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66b3f1c4_7fb3_4e0d_9910_7d73dcdc4929.slice/crio-3e93ea451aa94b55f1c55a62f64ffd2cdecc565b1d72dcad6a50bf34b3606633 WatchSource:0}: Error finding container 3e93ea451aa94b55f1c55a62f64ffd2cdecc565b1d72dcad6a50bf34b3606633: Status 404 returned error can't find the container with id 3e93ea451aa94b55f1c55a62f64ffd2cdecc565b1d72dcad6a50bf34b3606633 Jun 09 15:26:51.896448 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:51.896409 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-fz4kq" event={"ID":"66b3f1c4-7fb3-4e0d-9910-7d73dcdc4929","Type":"ContainerStarted","Data":"3e93ea451aa94b55f1c55a62f64ffd2cdecc565b1d72dcad6a50bf34b3606633"} Jun 09 15:26:59.947692 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:59.947652 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-fz4kq" event={"ID":"66b3f1c4-7fb3-4e0d-9910-7d73dcdc4929","Type":"ContainerStarted","Data":"b17f3fefb82a80c15c2b66d37d5bb3d9eb3f07e0b28518c24758cf7182054bd7"} Jun 09 15:26:59.970029 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:26:59.969970 2611 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-d67dbbb48-fz4kq" podStartSLOduration=3.8856591849999997 podStartE2EDuration="10.96995203s" totalImagesPullingTime="7.084292845s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:26:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:26:59.968444721 +0000 UTC m=+740.774136941" watchObservedRunningTime="2026-06-09 15:26:59.96995203 +0000 UTC m=+740.775644249" Jun 09 15:27:39.927268 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:27:39.927230 2611 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-kw4qq"] Jun 09 15:27:39.929659 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:27:39.929641 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-kw4qq" Jun 09 15:27:39.949289 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:27:39.949260 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvkqj\" (UniqueName: \"kubernetes.io/projected/8cd5244e-ab13-4e10-887a-b3b251c3eded-kube-api-access-wvkqj\") pod \"authorino-5d4b67c446-kw4qq\" (UID: \"8cd5244e-ab13-4e10-887a-b3b251c3eded\") " pod="kuadrant-system/authorino-5d4b67c446-kw4qq" Jun 09 15:27:39.949603 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:27:39.949584 2611 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-kw4qq"] Jun 09 15:27:40.050322 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:27:40.050282 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvkqj\" (UniqueName: \"kubernetes.io/projected/8cd5244e-ab13-4e10-887a-b3b251c3eded-kube-api-access-wvkqj\") pod \"authorino-5d4b67c446-kw4qq\" (UID: \"8cd5244e-ab13-4e10-887a-b3b251c3eded\") " pod="kuadrant-system/authorino-5d4b67c446-kw4qq" Jun 09 15:27:40.066366 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:27:40.066336 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvkqj\" (UniqueName: \"kubernetes.io/projected/8cd5244e-ab13-4e10-887a-b3b251c3eded-kube-api-access-wvkqj\") pod \"authorino-5d4b67c446-kw4qq\" (UID: \"8cd5244e-ab13-4e10-887a-b3b251c3eded\") " pod="kuadrant-system/authorino-5d4b67c446-kw4qq" Jun 09 15:27:40.167493 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:27:40.167462 2611 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-kw4qq"] Jun 09 15:27:40.167718 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:27:40.167705 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-kw4qq" Jun 09 15:27:40.208321 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:27:40.208282 2611 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6bdf96b64f-5cpd7"] Jun 09 15:27:40.211542 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:27:40.211515 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6bdf96b64f-5cpd7" Jun 09 15:27:40.229800 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:27:40.229765 2611 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6bdf96b64f-5cpd7"] Jun 09 15:27:40.252268 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:27:40.252235 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8f46h\" (UniqueName: \"kubernetes.io/projected/bb2a7778-a493-48d3-aa1d-39d58b876f14-kube-api-access-8f46h\") pod \"authorino-6bdf96b64f-5cpd7\" (UID: \"bb2a7778-a493-48d3-aa1d-39d58b876f14\") " pod="kuadrant-system/authorino-6bdf96b64f-5cpd7" Jun 09 15:27:40.314836 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:27:40.314757 2611 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-kw4qq"] Jun 09 15:27:40.316762 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:27:40.316732 2611 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8cd5244e_ab13_4e10_887a_b3b251c3eded.slice/crio-57ea904e6f8c05f779590fde7eaa9a12116d5dd926be68e5171eca3d52a5d9e1 WatchSource:0}: Error finding container 57ea904e6f8c05f779590fde7eaa9a12116d5dd926be68e5171eca3d52a5d9e1: Status 404 returned error can't find the container with id 57ea904e6f8c05f779590fde7eaa9a12116d5dd926be68e5171eca3d52a5d9e1 Jun 09 15:27:40.318838 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:27:40.318819 2611 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 15:27:40.353483 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:27:40.353447 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8f46h\" (UniqueName: \"kubernetes.io/projected/bb2a7778-a493-48d3-aa1d-39d58b876f14-kube-api-access-8f46h\") pod \"authorino-6bdf96b64f-5cpd7\" (UID: \"bb2a7778-a493-48d3-aa1d-39d58b876f14\") " pod="kuadrant-system/authorino-6bdf96b64f-5cpd7" Jun 09 15:27:40.367759 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:27:40.367725 2611 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6bdf96b64f-5cpd7"] Jun 09 15:27:40.368004 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:27:40.367976 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8f46h\" (UniqueName: \"kubernetes.io/projected/bb2a7778-a493-48d3-aa1d-39d58b876f14-kube-api-access-8f46h\") pod \"authorino-6bdf96b64f-5cpd7\" (UID: \"bb2a7778-a493-48d3-aa1d-39d58b876f14\") " pod="kuadrant-system/authorino-6bdf96b64f-5cpd7" Jun 09 15:27:40.368073 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:27:40.368019 2611 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-8f46h], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-6bdf96b64f-5cpd7" podUID="bb2a7778-a493-48d3-aa1d-39d58b876f14" Jun 09 15:27:40.405420 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:27:40.405380 2611 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-55569bc78f-xxjf9"] Jun 09 15:27:40.407832 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:27:40.407808 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-55569bc78f-xxjf9" Jun 09 15:27:40.412316 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:27:40.412292 2611 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 09 15:27:40.431908 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:27:40.431831 2611 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-55569bc78f-xxjf9"] Jun 09 15:27:40.454579 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:27:40.454539 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xv8t\" (UniqueName: \"kubernetes.io/projected/93ac6e22-89d8-40cf-afb0-99049202b60d-kube-api-access-5xv8t\") pod \"authorino-55569bc78f-xxjf9\" (UID: \"93ac6e22-89d8-40cf-afb0-99049202b60d\") " pod="kuadrant-system/authorino-55569bc78f-xxjf9" Jun 09 15:27:40.454751 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:27:40.454653 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/93ac6e22-89d8-40cf-afb0-99049202b60d-tls-cert\") pod \"authorino-55569bc78f-xxjf9\" (UID: \"93ac6e22-89d8-40cf-afb0-99049202b60d\") " pod="kuadrant-system/authorino-55569bc78f-xxjf9" Jun 09 15:27:40.556082 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:27:40.556043 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xv8t\" (UniqueName: \"kubernetes.io/projected/93ac6e22-89d8-40cf-afb0-99049202b60d-kube-api-access-5xv8t\") pod \"authorino-55569bc78f-xxjf9\" (UID: \"93ac6e22-89d8-40cf-afb0-99049202b60d\") " pod="kuadrant-system/authorino-55569bc78f-xxjf9" Jun 09 15:27:40.556282 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:27:40.556129 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/93ac6e22-89d8-40cf-afb0-99049202b60d-tls-cert\") pod \"authorino-55569bc78f-xxjf9\" (UID: \"93ac6e22-89d8-40cf-afb0-99049202b60d\") " pod="kuadrant-system/authorino-55569bc78f-xxjf9" Jun 09 15:27:40.558574 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:27:40.558554 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/93ac6e22-89d8-40cf-afb0-99049202b60d-tls-cert\") pod \"authorino-55569bc78f-xxjf9\" (UID: \"93ac6e22-89d8-40cf-afb0-99049202b60d\") " pod="kuadrant-system/authorino-55569bc78f-xxjf9" Jun 09 15:27:40.564334 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:27:40.564313 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xv8t\" (UniqueName: \"kubernetes.io/projected/93ac6e22-89d8-40cf-afb0-99049202b60d-kube-api-access-5xv8t\") pod \"authorino-55569bc78f-xxjf9\" (UID: \"93ac6e22-89d8-40cf-afb0-99049202b60d\") " pod="kuadrant-system/authorino-55569bc78f-xxjf9" Jun 09 15:27:40.717497 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:27:40.717470 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-55569bc78f-xxjf9" Jun 09 15:27:40.874472 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:27:40.874445 2611 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-55569bc78f-xxjf9"] Jun 09 15:27:40.876129 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:27:40.876102 2611 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod93ac6e22_89d8_40cf_afb0_99049202b60d.slice/crio-44886a380b2985a15a774455a309aee9c0394c579926911cbbb96677da44611f WatchSource:0}: Error finding container 44886a380b2985a15a774455a309aee9c0394c579926911cbbb96677da44611f: Status 404 returned error can't find the container with id 44886a380b2985a15a774455a309aee9c0394c579926911cbbb96677da44611f Jun 09 15:27:41.164373 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:27:41.164291 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-kw4qq" event={"ID":"8cd5244e-ab13-4e10-887a-b3b251c3eded","Type":"ContainerStarted","Data":"189c0b8a9e0e74db97bb0af2795e32f821615c7b7ab0315bcd61b99913bf15d7"} Jun 09 15:27:41.164373 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:27:41.164340 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-kw4qq" event={"ID":"8cd5244e-ab13-4e10-887a-b3b251c3eded","Type":"ContainerStarted","Data":"57ea904e6f8c05f779590fde7eaa9a12116d5dd926be68e5171eca3d52a5d9e1"} Jun 09 15:27:41.164373 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:27:41.164329 2611 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-kw4qq" podUID="8cd5244e-ab13-4e10-887a-b3b251c3eded" containerName="authorino" containerID="cri-o://189c0b8a9e0e74db97bb0af2795e32f821615c7b7ab0315bcd61b99913bf15d7" gracePeriod=30 Jun 09 15:27:41.165594 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:27:41.165567 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-55569bc78f-xxjf9" event={"ID":"93ac6e22-89d8-40cf-afb0-99049202b60d","Type":"ContainerStarted","Data":"44886a380b2985a15a774455a309aee9c0394c579926911cbbb96677da44611f"} Jun 09 15:27:41.165705 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:27:41.165594 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6bdf96b64f-5cpd7" Jun 09 15:27:41.189806 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:27:41.189755 2611 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-kw4qq" podStartSLOduration=1.8333273490000002 podStartE2EDuration="2.189738541s" totalImagesPullingTime="356.411192ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:27:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:27:41.187682692 +0000 UTC m=+781.993374913" watchObservedRunningTime="2026-06-09 15:27:41.189738541 +0000 UTC m=+781.995430760" Jun 09 15:27:41.244622 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:27:41.244599 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6bdf96b64f-5cpd7" Jun 09 15:27:41.363037 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:27:41.363004 2611 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8f46h\" (UniqueName: \"kubernetes.io/projected/bb2a7778-a493-48d3-aa1d-39d58b876f14-kube-api-access-8f46h\") pod \"bb2a7778-a493-48d3-aa1d-39d58b876f14\" (UID: \"bb2a7778-a493-48d3-aa1d-39d58b876f14\") " Jun 09 15:27:41.365812 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:27:41.365776 2611 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb2a7778-a493-48d3-aa1d-39d58b876f14-kube-api-access-8f46h" (OuterVolumeSpecName: "kube-api-access-8f46h") pod "bb2a7778-a493-48d3-aa1d-39d58b876f14" (UID: "bb2a7778-a493-48d3-aa1d-39d58b876f14"). InnerVolumeSpecName "kube-api-access-8f46h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 15:27:41.409083 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:27:41.409056 2611 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-kw4qq" Jun 09 15:27:41.464363 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:27:41.464329 2611 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wvkqj\" (UniqueName: \"kubernetes.io/projected/8cd5244e-ab13-4e10-887a-b3b251c3eded-kube-api-access-wvkqj\") pod \"8cd5244e-ab13-4e10-887a-b3b251c3eded\" (UID: \"8cd5244e-ab13-4e10-887a-b3b251c3eded\") " Jun 09 15:27:41.464576 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:27:41.464560 2611 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8f46h\" (UniqueName: \"kubernetes.io/projected/bb2a7778-a493-48d3-aa1d-39d58b876f14-kube-api-access-8f46h\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 09 15:27:41.466353 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:27:41.466331 2611 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8cd5244e-ab13-4e10-887a-b3b251c3eded-kube-api-access-wvkqj" (OuterVolumeSpecName: "kube-api-access-wvkqj") pod "8cd5244e-ab13-4e10-887a-b3b251c3eded" (UID: "8cd5244e-ab13-4e10-887a-b3b251c3eded"). InnerVolumeSpecName "kube-api-access-wvkqj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 15:27:41.565107 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:27:41.565067 2611 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wvkqj\" (UniqueName: \"kubernetes.io/projected/8cd5244e-ab13-4e10-887a-b3b251c3eded-kube-api-access-wvkqj\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 09 15:27:41.640383 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:27:41.640352 2611 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbb2a7778_a493_48d3_aa1d_39d58b876f14.slice\": RecentStats: unable to find data in memory cache]" Jun 09 15:27:42.175737 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:27:42.175692 2611 generic.go:356] "Generic (PLEG): container finished" podID="8cd5244e-ab13-4e10-887a-b3b251c3eded" containerID="189c0b8a9e0e74db97bb0af2795e32f821615c7b7ab0315bcd61b99913bf15d7" exitCode=0 Jun 09 15:27:42.176242 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:27:42.175832 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-kw4qq" event={"ID":"8cd5244e-ab13-4e10-887a-b3b251c3eded","Type":"ContainerDied","Data":"189c0b8a9e0e74db97bb0af2795e32f821615c7b7ab0315bcd61b99913bf15d7"} Jun 09 15:27:42.176242 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:27:42.175870 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-kw4qq" event={"ID":"8cd5244e-ab13-4e10-887a-b3b251c3eded","Type":"ContainerDied","Data":"57ea904e6f8c05f779590fde7eaa9a12116d5dd926be68e5171eca3d52a5d9e1"} Jun 09 15:27:42.176242 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:27:42.175899 2611 scope.go:117] "RemoveContainer" containerID="189c0b8a9e0e74db97bb0af2795e32f821615c7b7ab0315bcd61b99913bf15d7" Jun 09 15:27:42.176242 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:27:42.176067 2611 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-kw4qq" Jun 09 15:27:42.179554 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:27:42.179519 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-55569bc78f-xxjf9" event={"ID":"93ac6e22-89d8-40cf-afb0-99049202b60d","Type":"ContainerStarted","Data":"985dfab03ce52493d59cdaa926187bb181592572579467b341f3ac5788b016ad"} Jun 09 15:27:42.179673 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:27:42.179571 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6bdf96b64f-5cpd7" Jun 09 15:27:42.186961 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:27:42.186941 2611 scope.go:117] "RemoveContainer" containerID="189c0b8a9e0e74db97bb0af2795e32f821615c7b7ab0315bcd61b99913bf15d7" Jun 09 15:27:42.187243 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:27:42.187220 2611 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"189c0b8a9e0e74db97bb0af2795e32f821615c7b7ab0315bcd61b99913bf15d7\": container with ID starting with 189c0b8a9e0e74db97bb0af2795e32f821615c7b7ab0315bcd61b99913bf15d7 not found: ID does not exist" containerID="189c0b8a9e0e74db97bb0af2795e32f821615c7b7ab0315bcd61b99913bf15d7" Jun 09 15:27:42.187332 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:27:42.187248 2611 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"189c0b8a9e0e74db97bb0af2795e32f821615c7b7ab0315bcd61b99913bf15d7"} err="failed to get container status \"189c0b8a9e0e74db97bb0af2795e32f821615c7b7ab0315bcd61b99913bf15d7\": rpc error: code = NotFound desc = could not find container \"189c0b8a9e0e74db97bb0af2795e32f821615c7b7ab0315bcd61b99913bf15d7\": container with ID starting with 189c0b8a9e0e74db97bb0af2795e32f821615c7b7ab0315bcd61b99913bf15d7 not found: ID does not exist" Jun 09 15:27:42.200929 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:27:42.200886 2611 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-55569bc78f-xxjf9" podStartSLOduration=1.9106625419999999 podStartE2EDuration="2.200872001s" totalImagesPullingTime="290.209459ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:27:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:27:42.200468687 +0000 UTC m=+783.006160905" watchObservedRunningTime="2026-06-09 15:27:42.200872001 +0000 UTC m=+783.006564219" Jun 09 15:27:42.216792 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:27:42.216761 2611 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-kw4qq"] Jun 09 15:27:42.220582 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:27:42.220552 2611 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-kw4qq"] Jun 09 15:27:42.228683 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:27:42.228650 2611 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-m5ght"] Jun 09 15:27:42.228920 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:27:42.228896 2611 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-m5ght" podUID="a7beac41-1224-4180-8a77-0eb54efdb7d7" containerName="authorino" containerID="cri-o://7115c4b8eea84cf61f6dec36ae8e82def7732ef4a409ae8048ec8e550d425f20" gracePeriod=30 Jun 09 15:27:42.249859 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:27:42.249828 2611 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6bdf96b64f-5cpd7"] Jun 09 15:27:42.252295 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:27:42.252270 2611 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6bdf96b64f-5cpd7"] Jun 09 15:27:42.479141 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:27:42.479113 2611 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-m5ght" Jun 09 15:27:42.576836 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:27:42.576793 2611 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-84scv\" (UniqueName: \"kubernetes.io/projected/a7beac41-1224-4180-8a77-0eb54efdb7d7-kube-api-access-84scv\") pod \"a7beac41-1224-4180-8a77-0eb54efdb7d7\" (UID: \"a7beac41-1224-4180-8a77-0eb54efdb7d7\") " Jun 09 15:27:42.578859 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:27:42.578829 2611 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7beac41-1224-4180-8a77-0eb54efdb7d7-kube-api-access-84scv" (OuterVolumeSpecName: "kube-api-access-84scv") pod "a7beac41-1224-4180-8a77-0eb54efdb7d7" (UID: "a7beac41-1224-4180-8a77-0eb54efdb7d7"). InnerVolumeSpecName "kube-api-access-84scv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 15:27:42.678458 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:27:42.678426 2611 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-84scv\" (UniqueName: \"kubernetes.io/projected/a7beac41-1224-4180-8a77-0eb54efdb7d7-kube-api-access-84scv\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 09 15:27:43.186959 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:27:43.186921 2611 generic.go:356] "Generic (PLEG): container finished" podID="a7beac41-1224-4180-8a77-0eb54efdb7d7" containerID="7115c4b8eea84cf61f6dec36ae8e82def7732ef4a409ae8048ec8e550d425f20" exitCode=0 Jun 09 15:27:43.187459 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:27:43.186968 2611 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-m5ght" Jun 09 15:27:43.187459 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:27:43.187011 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-m5ght" event={"ID":"a7beac41-1224-4180-8a77-0eb54efdb7d7","Type":"ContainerDied","Data":"7115c4b8eea84cf61f6dec36ae8e82def7732ef4a409ae8048ec8e550d425f20"} Jun 09 15:27:43.187459 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:27:43.187062 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-m5ght" event={"ID":"a7beac41-1224-4180-8a77-0eb54efdb7d7","Type":"ContainerDied","Data":"cc874e67b4a460476019454381300bb36ab6929de7664518e454d5b93e633dc4"} Jun 09 15:27:43.187459 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:27:43.187086 2611 scope.go:117] "RemoveContainer" containerID="7115c4b8eea84cf61f6dec36ae8e82def7732ef4a409ae8048ec8e550d425f20" Jun 09 15:27:43.196121 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:27:43.196102 2611 scope.go:117] "RemoveContainer" containerID="7115c4b8eea84cf61f6dec36ae8e82def7732ef4a409ae8048ec8e550d425f20" Jun 09 15:27:43.196408 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:27:43.196390 2611 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7115c4b8eea84cf61f6dec36ae8e82def7732ef4a409ae8048ec8e550d425f20\": container with ID starting with 7115c4b8eea84cf61f6dec36ae8e82def7732ef4a409ae8048ec8e550d425f20 not found: ID does not exist" containerID="7115c4b8eea84cf61f6dec36ae8e82def7732ef4a409ae8048ec8e550d425f20" Jun 09 15:27:43.196466 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:27:43.196416 2611 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7115c4b8eea84cf61f6dec36ae8e82def7732ef4a409ae8048ec8e550d425f20"} err="failed to get container status \"7115c4b8eea84cf61f6dec36ae8e82def7732ef4a409ae8048ec8e550d425f20\": rpc error: code = NotFound desc = could not find container \"7115c4b8eea84cf61f6dec36ae8e82def7732ef4a409ae8048ec8e550d425f20\": container with ID starting with 7115c4b8eea84cf61f6dec36ae8e82def7732ef4a409ae8048ec8e550d425f20 not found: ID does not exist" Jun 09 15:27:43.217233 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:27:43.217202 2611 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-m5ght"] Jun 09 15:27:43.223279 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:27:43.223253 2611 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-m5ght"] Jun 09 15:27:43.632205 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:27:43.632115 2611 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8cd5244e-ab13-4e10-887a-b3b251c3eded" path="/var/lib/kubelet/pods/8cd5244e-ab13-4e10-887a-b3b251c3eded/volumes" Jun 09 15:27:43.632495 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:27:43.632480 2611 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7beac41-1224-4180-8a77-0eb54efdb7d7" path="/var/lib/kubelet/pods/a7beac41-1224-4180-8a77-0eb54efdb7d7/volumes" Jun 09 15:27:43.632763 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:27:43.632752 2611 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb2a7778-a493-48d3-aa1d-39d58b876f14" path="/var/lib/kubelet/pods/bb2a7778-a493-48d3-aa1d-39d58b876f14/volumes" Jun 09 15:29:10.469818 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:29:10.469782 2611 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5b4956897c-5sdm2"] Jun 09 15:29:10.470330 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:29:10.470135 2611 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7beac41-1224-4180-8a77-0eb54efdb7d7" containerName="authorino" Jun 09 15:29:10.470330 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:29:10.470149 2611 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7beac41-1224-4180-8a77-0eb54efdb7d7" containerName="authorino" Jun 09 15:29:10.470330 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:29:10.470183 2611 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8cd5244e-ab13-4e10-887a-b3b251c3eded" containerName="authorino" Jun 09 15:29:10.470330 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:29:10.470189 2611 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cd5244e-ab13-4e10-887a-b3b251c3eded" containerName="authorino" Jun 09 15:29:10.470330 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:29:10.470257 2611 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7beac41-1224-4180-8a77-0eb54efdb7d7" containerName="authorino" Jun 09 15:29:10.470330 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:29:10.470265 2611 memory_manager.go:368] "RemoveStaleState removing state" podUID="8cd5244e-ab13-4e10-887a-b3b251c3eded" containerName="authorino" Jun 09 15:29:10.473223 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:29:10.473206 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5b4956897c-5sdm2" Jun 09 15:29:10.475723 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:29:10.475706 2611 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 09 15:29:10.482942 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:29:10.482913 2611 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5b4956897c-5sdm2"] Jun 09 15:29:10.537283 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:29:10.537235 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxtr4\" (UniqueName: \"kubernetes.io/projected/603dac77-3005-43b3-849c-1454dd5ae583-kube-api-access-rxtr4\") pod \"authorino-5b4956897c-5sdm2\" (UID: \"603dac77-3005-43b3-849c-1454dd5ae583\") " pod="kuadrant-system/authorino-5b4956897c-5sdm2" Jun 09 15:29:10.537462 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:29:10.537295 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/603dac77-3005-43b3-849c-1454dd5ae583-oidc-ca\") pod \"authorino-5b4956897c-5sdm2\" (UID: \"603dac77-3005-43b3-849c-1454dd5ae583\") " pod="kuadrant-system/authorino-5b4956897c-5sdm2" Jun 09 15:29:10.537462 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:29:10.537325 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/603dac77-3005-43b3-849c-1454dd5ae583-tls-cert\") pod \"authorino-5b4956897c-5sdm2\" (UID: \"603dac77-3005-43b3-849c-1454dd5ae583\") " pod="kuadrant-system/authorino-5b4956897c-5sdm2" Jun 09 15:29:10.638189 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:29:10.638124 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxtr4\" (UniqueName: \"kubernetes.io/projected/603dac77-3005-43b3-849c-1454dd5ae583-kube-api-access-rxtr4\") pod \"authorino-5b4956897c-5sdm2\" (UID: \"603dac77-3005-43b3-849c-1454dd5ae583\") " pod="kuadrant-system/authorino-5b4956897c-5sdm2" Jun 09 15:29:10.638393 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:29:10.638229 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/603dac77-3005-43b3-849c-1454dd5ae583-oidc-ca\") pod \"authorino-5b4956897c-5sdm2\" (UID: \"603dac77-3005-43b3-849c-1454dd5ae583\") " pod="kuadrant-system/authorino-5b4956897c-5sdm2" Jun 09 15:29:10.638393 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:29:10.638250 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/603dac77-3005-43b3-849c-1454dd5ae583-tls-cert\") pod \"authorino-5b4956897c-5sdm2\" (UID: \"603dac77-3005-43b3-849c-1454dd5ae583\") " pod="kuadrant-system/authorino-5b4956897c-5sdm2" Jun 09 15:29:10.638967 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:29:10.638944 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/603dac77-3005-43b3-849c-1454dd5ae583-oidc-ca\") pod \"authorino-5b4956897c-5sdm2\" (UID: \"603dac77-3005-43b3-849c-1454dd5ae583\") " pod="kuadrant-system/authorino-5b4956897c-5sdm2" Jun 09 15:29:10.640735 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:29:10.640713 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/603dac77-3005-43b3-849c-1454dd5ae583-tls-cert\") pod \"authorino-5b4956897c-5sdm2\" (UID: \"603dac77-3005-43b3-849c-1454dd5ae583\") " pod="kuadrant-system/authorino-5b4956897c-5sdm2" Jun 09 15:29:10.646543 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:29:10.646518 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxtr4\" (UniqueName: \"kubernetes.io/projected/603dac77-3005-43b3-849c-1454dd5ae583-kube-api-access-rxtr4\") pod \"authorino-5b4956897c-5sdm2\" (UID: \"603dac77-3005-43b3-849c-1454dd5ae583\") " pod="kuadrant-system/authorino-5b4956897c-5sdm2" Jun 09 15:29:10.783107 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:29:10.783021 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5b4956897c-5sdm2" Jun 09 15:29:10.916618 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:29:10.916586 2611 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5b4956897c-5sdm2"] Jun 09 15:29:10.918209 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:29:10.918181 2611 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod603dac77_3005_43b3_849c_1454dd5ae583.slice/crio-28bbfc163eddbeb2bcb9e6ea572929f1a63021890fc77a70f0cd9ea094713e17 WatchSource:0}: Error finding container 28bbfc163eddbeb2bcb9e6ea572929f1a63021890fc77a70f0cd9ea094713e17: Status 404 returned error can't find the container with id 28bbfc163eddbeb2bcb9e6ea572929f1a63021890fc77a70f0cd9ea094713e17 Jun 09 15:29:11.672857 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:29:11.672764 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5b4956897c-5sdm2" event={"ID":"603dac77-3005-43b3-849c-1454dd5ae583","Type":"ContainerStarted","Data":"52b828e3ea2bba8c352574dd3ade7041953afc9ee05c6932b173024202fb5826"} Jun 09 15:29:11.672857 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:29:11.672813 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5b4956897c-5sdm2" event={"ID":"603dac77-3005-43b3-849c-1454dd5ae583","Type":"ContainerStarted","Data":"28bbfc163eddbeb2bcb9e6ea572929f1a63021890fc77a70f0cd9ea094713e17"} Jun 09 15:29:11.695266 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:29:11.695213 2611 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5b4956897c-5sdm2" podStartSLOduration=1.241911746 podStartE2EDuration="1.695193668s" totalImagesPullingTime="453.281922ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:29:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:29:11.692214572 +0000 UTC m=+872.497906795" watchObservedRunningTime="2026-06-09 15:29:11.695193668 +0000 UTC m=+872.500885886" Jun 09 15:29:11.722185 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:29:11.722134 2611 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-55569bc78f-xxjf9"] Jun 09 15:29:11.722362 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:29:11.722338 2611 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-55569bc78f-xxjf9" podUID="93ac6e22-89d8-40cf-afb0-99049202b60d" containerName="authorino" containerID="cri-o://985dfab03ce52493d59cdaa926187bb181592572579467b341f3ac5788b016ad" gracePeriod=30 Jun 09 15:29:11.984719 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:29:11.984688 2611 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-55569bc78f-xxjf9" Jun 09 15:29:12.048512 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:29:12.048472 2611 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/93ac6e22-89d8-40cf-afb0-99049202b60d-tls-cert\") pod \"93ac6e22-89d8-40cf-afb0-99049202b60d\" (UID: \"93ac6e22-89d8-40cf-afb0-99049202b60d\") " Jun 09 15:29:12.048512 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:29:12.048525 2611 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5xv8t\" (UniqueName: \"kubernetes.io/projected/93ac6e22-89d8-40cf-afb0-99049202b60d-kube-api-access-5xv8t\") pod \"93ac6e22-89d8-40cf-afb0-99049202b60d\" (UID: \"93ac6e22-89d8-40cf-afb0-99049202b60d\") " Jun 09 15:29:12.050619 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:29:12.050584 2611 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93ac6e22-89d8-40cf-afb0-99049202b60d-kube-api-access-5xv8t" (OuterVolumeSpecName: "kube-api-access-5xv8t") pod "93ac6e22-89d8-40cf-afb0-99049202b60d" (UID: "93ac6e22-89d8-40cf-afb0-99049202b60d"). InnerVolumeSpecName "kube-api-access-5xv8t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 15:29:12.058983 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:29:12.058955 2611 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93ac6e22-89d8-40cf-afb0-99049202b60d-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "93ac6e22-89d8-40cf-afb0-99049202b60d" (UID: "93ac6e22-89d8-40cf-afb0-99049202b60d"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 15:29:12.149814 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:29:12.149770 2611 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/93ac6e22-89d8-40cf-afb0-99049202b60d-tls-cert\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 09 15:29:12.149814 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:29:12.149806 2611 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5xv8t\" (UniqueName: \"kubernetes.io/projected/93ac6e22-89d8-40cf-afb0-99049202b60d-kube-api-access-5xv8t\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 09 15:29:12.679140 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:29:12.679102 2611 generic.go:356] "Generic (PLEG): container finished" podID="93ac6e22-89d8-40cf-afb0-99049202b60d" containerID="985dfab03ce52493d59cdaa926187bb181592572579467b341f3ac5788b016ad" exitCode=0 Jun 09 15:29:12.679632 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:29:12.679186 2611 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-55569bc78f-xxjf9" Jun 09 15:29:12.679632 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:29:12.679207 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-55569bc78f-xxjf9" event={"ID":"93ac6e22-89d8-40cf-afb0-99049202b60d","Type":"ContainerDied","Data":"985dfab03ce52493d59cdaa926187bb181592572579467b341f3ac5788b016ad"} Jun 09 15:29:12.679632 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:29:12.679263 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-55569bc78f-xxjf9" event={"ID":"93ac6e22-89d8-40cf-afb0-99049202b60d","Type":"ContainerDied","Data":"44886a380b2985a15a774455a309aee9c0394c579926911cbbb96677da44611f"} Jun 09 15:29:12.679632 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:29:12.679290 2611 scope.go:117] "RemoveContainer" containerID="985dfab03ce52493d59cdaa926187bb181592572579467b341f3ac5788b016ad" Jun 09 15:29:12.688708 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:29:12.688688 2611 scope.go:117] "RemoveContainer" containerID="985dfab03ce52493d59cdaa926187bb181592572579467b341f3ac5788b016ad" Jun 09 15:29:12.688979 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:29:12.688958 2611 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"985dfab03ce52493d59cdaa926187bb181592572579467b341f3ac5788b016ad\": container with ID starting with 985dfab03ce52493d59cdaa926187bb181592572579467b341f3ac5788b016ad not found: ID does not exist" containerID="985dfab03ce52493d59cdaa926187bb181592572579467b341f3ac5788b016ad" Jun 09 15:29:12.689050 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:29:12.688986 2611 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"985dfab03ce52493d59cdaa926187bb181592572579467b341f3ac5788b016ad"} err="failed to get container status \"985dfab03ce52493d59cdaa926187bb181592572579467b341f3ac5788b016ad\": rpc error: code = NotFound desc = could not find container \"985dfab03ce52493d59cdaa926187bb181592572579467b341f3ac5788b016ad\": container with ID starting with 985dfab03ce52493d59cdaa926187bb181592572579467b341f3ac5788b016ad not found: ID does not exist" Jun 09 15:29:12.713993 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:29:12.713961 2611 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-55569bc78f-xxjf9"] Jun 09 15:29:12.724818 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:29:12.724786 2611 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-55569bc78f-xxjf9"] Jun 09 15:29:13.633490 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:29:13.633454 2611 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93ac6e22-89d8-40cf-afb0-99049202b60d" path="/var/lib/kubelet/pods/93ac6e22-89d8-40cf-afb0-99049202b60d/volumes" Jun 09 15:29:39.641748 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:29:39.641720 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-9b4t9_7a9cdcf8-af9d-474c-9f46-4099925e11fc/console-operator/1.log" Jun 09 15:29:39.642269 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:29:39.641725 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-9b4t9_7a9cdcf8-af9d-474c-9f46-4099925e11fc/console-operator/1.log" Jun 09 15:29:39.650108 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:29:39.650087 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4vsgw_aa94098e-7a90-4a75-9b97-74e10b75695b/ovn-acl-logging/0.log" Jun 09 15:29:39.650271 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:29:39.650135 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4vsgw_aa94098e-7a90-4a75-9b97-74e10b75695b/ovn-acl-logging/0.log" Jun 09 15:30:00.141287 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:30:00.141252 2611 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29683650-68ssl"] Jun 09 15:30:00.142027 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:30:00.141632 2611 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93ac6e22-89d8-40cf-afb0-99049202b60d" containerName="authorino" Jun 09 15:30:00.142027 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:30:00.141650 2611 state_mem.go:107] "Deleted CPUSet assignment" podUID="93ac6e22-89d8-40cf-afb0-99049202b60d" containerName="authorino" Jun 09 15:30:00.142027 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:30:00.141722 2611 memory_manager.go:368] "RemoveStaleState removing state" podUID="93ac6e22-89d8-40cf-afb0-99049202b60d" containerName="authorino" Jun 09 15:30:00.146266 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:30:00.146245 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29683650-68ssl" Jun 09 15:30:00.148871 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:30:00.148843 2611 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-szbrf\"" Jun 09 15:30:00.152735 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:30:00.152708 2611 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29683650-68ssl"] Jun 09 15:30:00.176218 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:30:00.176178 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76pjc\" (UniqueName: \"kubernetes.io/projected/0d8208eb-8090-41fc-a7fb-89189146c248-kube-api-access-76pjc\") pod \"maas-api-key-cleanup-29683650-68ssl\" (UID: \"0d8208eb-8090-41fc-a7fb-89189146c248\") " pod="opendatahub/maas-api-key-cleanup-29683650-68ssl" Jun 09 15:30:00.277195 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:30:00.277133 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76pjc\" (UniqueName: \"kubernetes.io/projected/0d8208eb-8090-41fc-a7fb-89189146c248-kube-api-access-76pjc\") pod \"maas-api-key-cleanup-29683650-68ssl\" (UID: \"0d8208eb-8090-41fc-a7fb-89189146c248\") " pod="opendatahub/maas-api-key-cleanup-29683650-68ssl" Jun 09 15:30:00.291020 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:30:00.290979 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-76pjc\" (UniqueName: \"kubernetes.io/projected/0d8208eb-8090-41fc-a7fb-89189146c248-kube-api-access-76pjc\") pod \"maas-api-key-cleanup-29683650-68ssl\" (UID: \"0d8208eb-8090-41fc-a7fb-89189146c248\") " pod="opendatahub/maas-api-key-cleanup-29683650-68ssl" Jun 09 15:30:00.458798 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:30:00.458763 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29683650-68ssl" Jun 09 15:30:00.597281 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:30:00.597251 2611 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29683650-68ssl"] Jun 09 15:30:00.598543 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:30:00.598518 2611 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d8208eb_8090_41fc_a7fb_89189146c248.slice/crio-7d32281d98562262f89c4005d19d082b4a0d75f05dd733ca0b3fc099b4db577a WatchSource:0}: Error finding container 7d32281d98562262f89c4005d19d082b4a0d75f05dd733ca0b3fc099b4db577a: Status 404 returned error can't find the container with id 7d32281d98562262f89c4005d19d082b4a0d75f05dd733ca0b3fc099b4db577a Jun 09 15:30:00.942194 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:30:00.942134 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29683650-68ssl" event={"ID":"0d8208eb-8090-41fc-a7fb-89189146c248","Type":"ContainerStarted","Data":"7d32281d98562262f89c4005d19d082b4a0d75f05dd733ca0b3fc099b4db577a"} Jun 09 15:30:03.960781 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:30:03.960739 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29683650-68ssl" event={"ID":"0d8208eb-8090-41fc-a7fb-89189146c248","Type":"ContainerStarted","Data":"b1faab1094d3e429d8254d3f6b80140bfd79aa4b4da51f2fa53913059c8a5ac7"} Jun 09 15:30:03.977315 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:30:03.977257 2611 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29683650-68ssl" podStartSLOduration=0.952717586 podStartE2EDuration="3.977219532s" totalImagesPullingTime="3.024501946s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:30:03.97582619 +0000 UTC m=+924.781518411" watchObservedRunningTime="2026-06-09 15:30:03.977219532 +0000 UTC m=+924.782911753" Jun 09 15:30:04.967212 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:30:04.967146 2611 generic.go:356] "Generic (PLEG): container finished" podID="0d8208eb-8090-41fc-a7fb-89189146c248" containerID="b1faab1094d3e429d8254d3f6b80140bfd79aa4b4da51f2fa53913059c8a5ac7" exitCode=0 Jun 09 15:30:04.967212 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:30:04.967199 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29683650-68ssl" event={"ID":"0d8208eb-8090-41fc-a7fb-89189146c248","Type":"ContainerDied","Data":"b1faab1094d3e429d8254d3f6b80140bfd79aa4b4da51f2fa53913059c8a5ac7"} Jun 09 15:30:06.108959 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:30:06.108930 2611 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29683650-68ssl" Jun 09 15:30:06.121419 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:30:06.121389 2611 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-76pjc\" (UniqueName: \"kubernetes.io/projected/0d8208eb-8090-41fc-a7fb-89189146c248-kube-api-access-76pjc\") pod \"0d8208eb-8090-41fc-a7fb-89189146c248\" (UID: \"0d8208eb-8090-41fc-a7fb-89189146c248\") " Jun 09 15:30:06.123684 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:30:06.123659 2611 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d8208eb-8090-41fc-a7fb-89189146c248-kube-api-access-76pjc" (OuterVolumeSpecName: "kube-api-access-76pjc") pod "0d8208eb-8090-41fc-a7fb-89189146c248" (UID: "0d8208eb-8090-41fc-a7fb-89189146c248"). InnerVolumeSpecName "kube-api-access-76pjc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 15:30:06.222757 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:30:06.222667 2611 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-76pjc\" (UniqueName: \"kubernetes.io/projected/0d8208eb-8090-41fc-a7fb-89189146c248-kube-api-access-76pjc\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 09 15:30:06.980105 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:30:06.980078 2611 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29683650-68ssl" Jun 09 15:30:06.980307 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:30:06.980074 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29683650-68ssl" event={"ID":"0d8208eb-8090-41fc-a7fb-89189146c248","Type":"ContainerDied","Data":"7d32281d98562262f89c4005d19d082b4a0d75f05dd733ca0b3fc099b4db577a"} Jun 09 15:30:06.980307 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:30:06.980212 2611 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7d32281d98562262f89c4005d19d082b4a0d75f05dd733ca0b3fc099b4db577a" Jun 09 15:32:47.666967 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:32:47.666922 2611 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7f8f4b87b-krbf8"] Jun 09 15:32:47.667545 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:32:47.667445 2611 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d8208eb-8090-41fc-a7fb-89189146c248" containerName="cleanup" Jun 09 15:32:47.667545 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:32:47.667497 2611 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d8208eb-8090-41fc-a7fb-89189146c248" containerName="cleanup" Jun 09 15:32:47.667670 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:32:47.667601 2611 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d8208eb-8090-41fc-a7fb-89189146c248" containerName="cleanup" Jun 09 15:32:47.669624 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:32:47.669602 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f8f4b87b-krbf8" Jun 09 15:32:47.680279 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:32:47.680252 2611 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7f8f4b87b-krbf8"] Jun 09 15:32:47.754261 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:32:47.754223 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/708bdb9b-9d76-4915-a297-ca53d1d54144-tls-cert\") pod \"authorino-7f8f4b87b-krbf8\" (UID: \"708bdb9b-9d76-4915-a297-ca53d1d54144\") " pod="kuadrant-system/authorino-7f8f4b87b-krbf8" Jun 09 15:32:47.754459 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:32:47.754285 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hr86x\" (UniqueName: \"kubernetes.io/projected/708bdb9b-9d76-4915-a297-ca53d1d54144-kube-api-access-hr86x\") pod \"authorino-7f8f4b87b-krbf8\" (UID: \"708bdb9b-9d76-4915-a297-ca53d1d54144\") " pod="kuadrant-system/authorino-7f8f4b87b-krbf8" Jun 09 15:32:47.754459 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:32:47.754337 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/708bdb9b-9d76-4915-a297-ca53d1d54144-oidc-ca\") pod \"authorino-7f8f4b87b-krbf8\" (UID: \"708bdb9b-9d76-4915-a297-ca53d1d54144\") " pod="kuadrant-system/authorino-7f8f4b87b-krbf8" Jun 09 15:32:47.855695 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:32:47.855664 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/708bdb9b-9d76-4915-a297-ca53d1d54144-oidc-ca\") pod \"authorino-7f8f4b87b-krbf8\" (UID: \"708bdb9b-9d76-4915-a297-ca53d1d54144\") " pod="kuadrant-system/authorino-7f8f4b87b-krbf8" Jun 09 15:32:47.855873 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:32:47.855720 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/708bdb9b-9d76-4915-a297-ca53d1d54144-tls-cert\") pod \"authorino-7f8f4b87b-krbf8\" (UID: \"708bdb9b-9d76-4915-a297-ca53d1d54144\") " pod="kuadrant-system/authorino-7f8f4b87b-krbf8" Jun 09 15:32:47.855873 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:32:47.855760 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hr86x\" (UniqueName: \"kubernetes.io/projected/708bdb9b-9d76-4915-a297-ca53d1d54144-kube-api-access-hr86x\") pod \"authorino-7f8f4b87b-krbf8\" (UID: \"708bdb9b-9d76-4915-a297-ca53d1d54144\") " pod="kuadrant-system/authorino-7f8f4b87b-krbf8" Jun 09 15:32:47.856338 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:32:47.856319 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/708bdb9b-9d76-4915-a297-ca53d1d54144-oidc-ca\") pod \"authorino-7f8f4b87b-krbf8\" (UID: \"708bdb9b-9d76-4915-a297-ca53d1d54144\") " pod="kuadrant-system/authorino-7f8f4b87b-krbf8" Jun 09 15:32:47.858251 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:32:47.858223 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/708bdb9b-9d76-4915-a297-ca53d1d54144-tls-cert\") pod \"authorino-7f8f4b87b-krbf8\" (UID: \"708bdb9b-9d76-4915-a297-ca53d1d54144\") " pod="kuadrant-system/authorino-7f8f4b87b-krbf8" Jun 09 15:32:47.864321 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:32:47.864289 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hr86x\" (UniqueName: \"kubernetes.io/projected/708bdb9b-9d76-4915-a297-ca53d1d54144-kube-api-access-hr86x\") pod \"authorino-7f8f4b87b-krbf8\" (UID: \"708bdb9b-9d76-4915-a297-ca53d1d54144\") " pod="kuadrant-system/authorino-7f8f4b87b-krbf8" Jun 09 15:32:47.979558 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:32:47.979512 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f8f4b87b-krbf8" Jun 09 15:32:48.116620 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:32:48.116554 2611 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7f8f4b87b-krbf8"] Jun 09 15:32:48.118273 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:32:48.118245 2611 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod708bdb9b_9d76_4915_a297_ca53d1d54144.slice/crio-ed07ea798427e18fa473dc5ee364c5ee05cde8f9e4eb936ee70dfedffa66ad24 WatchSource:0}: Error finding container ed07ea798427e18fa473dc5ee364c5ee05cde8f9e4eb936ee70dfedffa66ad24: Status 404 returned error can't find the container with id ed07ea798427e18fa473dc5ee364c5ee05cde8f9e4eb936ee70dfedffa66ad24 Jun 09 15:32:48.119589 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:32:48.119568 2611 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 15:32:48.873466 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:32:48.873374 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7f8f4b87b-krbf8" event={"ID":"708bdb9b-9d76-4915-a297-ca53d1d54144","Type":"ContainerStarted","Data":"aba764ac7729a580a571207430cea52c56d25cc0de366255c30431e87f101c5b"} Jun 09 15:32:48.873466 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:32:48.873425 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7f8f4b87b-krbf8" event={"ID":"708bdb9b-9d76-4915-a297-ca53d1d54144","Type":"ContainerStarted","Data":"ed07ea798427e18fa473dc5ee364c5ee05cde8f9e4eb936ee70dfedffa66ad24"} Jun 09 15:32:48.913068 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:32:48.913008 2611 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7f8f4b87b-krbf8" podStartSLOduration=1.560849116 podStartE2EDuration="1.912989624s" totalImagesPullingTime="352.140508ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:32:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:32:48.910449494 +0000 UTC m=+1089.716141715" watchObservedRunningTime="2026-06-09 15:32:48.912989624 +0000 UTC m=+1089.718681843" Jun 09 15:32:48.964917 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:32:48.964878 2611 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5b4956897c-5sdm2"] Jun 09 15:32:48.965128 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:32:48.965099 2611 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5b4956897c-5sdm2" podUID="603dac77-3005-43b3-849c-1454dd5ae583" containerName="authorino" containerID="cri-o://52b828e3ea2bba8c352574dd3ade7041953afc9ee05c6932b173024202fb5826" gracePeriod=30 Jun 09 15:32:49.230592 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:32:49.230566 2611 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5b4956897c-5sdm2" Jun 09 15:32:49.267114 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:32:49.266437 2611 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/603dac77-3005-43b3-849c-1454dd5ae583-tls-cert\") pod \"603dac77-3005-43b3-849c-1454dd5ae583\" (UID: \"603dac77-3005-43b3-849c-1454dd5ae583\") " Jun 09 15:32:49.267114 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:32:49.266532 2611 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rxtr4\" (UniqueName: \"kubernetes.io/projected/603dac77-3005-43b3-849c-1454dd5ae583-kube-api-access-rxtr4\") pod \"603dac77-3005-43b3-849c-1454dd5ae583\" (UID: \"603dac77-3005-43b3-849c-1454dd5ae583\") " Jun 09 15:32:49.267114 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:32:49.266563 2611 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/603dac77-3005-43b3-849c-1454dd5ae583-oidc-ca\") pod \"603dac77-3005-43b3-849c-1454dd5ae583\" (UID: \"603dac77-3005-43b3-849c-1454dd5ae583\") " Jun 09 15:32:49.271952 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:32:49.271854 2611 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/603dac77-3005-43b3-849c-1454dd5ae583-kube-api-access-rxtr4" (OuterVolumeSpecName: "kube-api-access-rxtr4") pod "603dac77-3005-43b3-849c-1454dd5ae583" (UID: "603dac77-3005-43b3-849c-1454dd5ae583"). InnerVolumeSpecName "kube-api-access-rxtr4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 15:32:49.275842 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:32:49.275698 2611 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/603dac77-3005-43b3-849c-1454dd5ae583-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "603dac77-3005-43b3-849c-1454dd5ae583" (UID: "603dac77-3005-43b3-849c-1454dd5ae583"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 15:32:49.284300 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:32:49.284270 2611 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/603dac77-3005-43b3-849c-1454dd5ae583-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "603dac77-3005-43b3-849c-1454dd5ae583" (UID: "603dac77-3005-43b3-849c-1454dd5ae583"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 15:32:49.367818 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:32:49.367781 2611 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/603dac77-3005-43b3-849c-1454dd5ae583-tls-cert\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 09 15:32:49.367818 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:32:49.367815 2611 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rxtr4\" (UniqueName: \"kubernetes.io/projected/603dac77-3005-43b3-849c-1454dd5ae583-kube-api-access-rxtr4\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 09 15:32:49.368071 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:32:49.367831 2611 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/603dac77-3005-43b3-849c-1454dd5ae583-oidc-ca\") on node \"ip-10-0-129-139.ec2.internal\" DevicePath \"\"" Jun 09 15:32:49.879598 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:32:49.879561 2611 generic.go:356] "Generic (PLEG): container finished" podID="603dac77-3005-43b3-849c-1454dd5ae583" containerID="52b828e3ea2bba8c352574dd3ade7041953afc9ee05c6932b173024202fb5826" exitCode=0 Jun 09 15:32:49.880001 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:32:49.879611 2611 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5b4956897c-5sdm2" Jun 09 15:32:49.880001 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:32:49.879596 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5b4956897c-5sdm2" event={"ID":"603dac77-3005-43b3-849c-1454dd5ae583","Type":"ContainerDied","Data":"52b828e3ea2bba8c352574dd3ade7041953afc9ee05c6932b173024202fb5826"} Jun 09 15:32:49.880001 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:32:49.879717 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5b4956897c-5sdm2" event={"ID":"603dac77-3005-43b3-849c-1454dd5ae583","Type":"ContainerDied","Data":"28bbfc163eddbeb2bcb9e6ea572929f1a63021890fc77a70f0cd9ea094713e17"} Jun 09 15:32:49.880001 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:32:49.879735 2611 scope.go:117] "RemoveContainer" containerID="52b828e3ea2bba8c352574dd3ade7041953afc9ee05c6932b173024202fb5826" Jun 09 15:32:49.888780 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:32:49.888758 2611 scope.go:117] "RemoveContainer" containerID="52b828e3ea2bba8c352574dd3ade7041953afc9ee05c6932b173024202fb5826" Jun 09 15:32:49.889069 ip-10-0-129-139 kubenswrapper[2611]: E0609 15:32:49.889048 2611 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52b828e3ea2bba8c352574dd3ade7041953afc9ee05c6932b173024202fb5826\": container with ID starting with 52b828e3ea2bba8c352574dd3ade7041953afc9ee05c6932b173024202fb5826 not found: ID does not exist" containerID="52b828e3ea2bba8c352574dd3ade7041953afc9ee05c6932b173024202fb5826" Jun 09 15:32:49.889127 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:32:49.889080 2611 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52b828e3ea2bba8c352574dd3ade7041953afc9ee05c6932b173024202fb5826"} err="failed to get container status \"52b828e3ea2bba8c352574dd3ade7041953afc9ee05c6932b173024202fb5826\": rpc error: code = NotFound desc = could not find container \"52b828e3ea2bba8c352574dd3ade7041953afc9ee05c6932b173024202fb5826\": container with ID starting with 52b828e3ea2bba8c352574dd3ade7041953afc9ee05c6932b173024202fb5826 not found: ID does not exist" Jun 09 15:32:49.898170 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:32:49.898091 2611 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5b4956897c-5sdm2"] Jun 09 15:32:49.902819 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:32:49.902788 2611 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5b4956897c-5sdm2"] Jun 09 15:32:51.633366 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:32:51.633333 2611 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="603dac77-3005-43b3-849c-1454dd5ae583" path="/var/lib/kubelet/pods/603dac77-3005-43b3-849c-1454dd5ae583/volumes" Jun 09 15:34:39.680920 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:34:39.680887 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-9b4t9_7a9cdcf8-af9d-474c-9f46-4099925e11fc/console-operator/1.log" Jun 09 15:34:39.683432 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:34:39.683407 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-9b4t9_7a9cdcf8-af9d-474c-9f46-4099925e11fc/console-operator/1.log" Jun 09 15:34:39.689035 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:34:39.689005 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4vsgw_aa94098e-7a90-4a75-9b97-74e10b75695b/ovn-acl-logging/0.log" Jun 09 15:34:39.691167 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:34:39.691134 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4vsgw_aa94098e-7a90-4a75-9b97-74e10b75695b/ovn-acl-logging/0.log" Jun 09 15:37:11.667869 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:11.667827 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7f8f4b87b-krbf8_708bdb9b-9d76-4915-a297-ca53d1d54144/authorino/0.log" Jun 09 15:37:16.606292 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:16.606244 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29683650-68ssl_0d8208eb-8090-41fc-a7fb-89189146c248/cleanup/0.log" Jun 09 15:37:16.832994 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:16.832957 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-ssqnd_96e42b6a-8596-4bae-b7d9-4a50674e1946/server/0.log" Jun 09 15:37:16.970913 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:16.970880 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-zfdwp_c003e891-cb17-468f-a272-cdeddf520495/manager/0.log" Jun 09 15:37:17.326575 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:17.326490 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f5f495f5c-x2f56_3f79969f-a29c-4b5e-8d75-91aac69cf584/copy-manifests/0.log" Jun 09 15:37:17.334377 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:17.334349 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f5f495f5c-x2f56_3f79969f-a29c-4b5e-8d75-91aac69cf584/manager/0.log" Jun 09 15:37:18.190503 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:18.190474 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bp68k_1cb643e1-ac5e-46a2-a2bc-3a04c35a23ed/util/0.log" Jun 09 15:37:18.197938 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:18.197906 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bp68k_1cb643e1-ac5e-46a2-a2bc-3a04c35a23ed/pull/0.log" Jun 09 15:37:18.205174 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:18.205135 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bp68k_1cb643e1-ac5e-46a2-a2bc-3a04c35a23ed/extract/0.log" Jun 09 15:37:18.315991 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:18.315960 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e059s7f_85cf8db7-d51b-4b68-aff6-bd79366b2bdb/util/0.log" Jun 09 15:37:18.322442 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:18.322415 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e059s7f_85cf8db7-d51b-4b68-aff6-bd79366b2bdb/pull/0.log" Jun 09 15:37:18.328101 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:18.328077 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e059s7f_85cf8db7-d51b-4b68-aff6-bd79366b2bdb/extract/0.log" Jun 09 15:37:18.430337 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:18.430309 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rh4w8_a0baa3c5-e6d1-4ea2-bc5b-8ab30287f2e2/util/0.log" Jun 09 15:37:18.436041 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:18.436012 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rh4w8_a0baa3c5-e6d1-4ea2-bc5b-8ab30287f2e2/pull/0.log" Jun 09 15:37:18.443347 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:18.443253 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rh4w8_a0baa3c5-e6d1-4ea2-bc5b-8ab30287f2e2/extract/0.log" Jun 09 15:37:18.550460 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:18.550436 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z8jxs_8a8b7cf0-2e3d-448b-aad6-0fc22e3bb88c/util/0.log" Jun 09 15:37:18.556652 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:18.556626 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z8jxs_8a8b7cf0-2e3d-448b-aad6-0fc22e3bb88c/pull/0.log" Jun 09 15:37:18.563001 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:18.562980 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z8jxs_8a8b7cf0-2e3d-448b-aad6-0fc22e3bb88c/extract/0.log" Jun 09 15:37:18.687095 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:18.682971 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7f8f4b87b-krbf8_708bdb9b-9d76-4915-a297-ca53d1d54144/authorino/0.log" Jun 09 15:37:18.913062 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:18.912946 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-rklx8_1d31b525-faa3-4dcc-9da4-8d0de8f3bc4b/manager/0.log" Jun 09 15:37:19.027262 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:19.027233 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-8zghr_5c9e72ec-61ce-478f-9487-97b26734ace3/kuadrant-console-plugin/0.log" Jun 09 15:37:20.183594 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:20.183554 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5dcd85bb64-nvhjb_edd3056b-a539-4665-a517-9ac78f5d9d9f/kube-auth-proxy/0.log" Jun 09 15:37:20.637284 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:20.637191 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-85c449f8d5-nz5ns_2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5/router/0.log" Jun 09 15:37:25.357780 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:25.357742 2611 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4nbsh/must-gather-rsf25"] Jun 09 15:37:25.358308 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:25.358146 2611 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="603dac77-3005-43b3-849c-1454dd5ae583" containerName="authorino" Jun 09 15:37:25.358308 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:25.358175 2611 state_mem.go:107] "Deleted CPUSet assignment" podUID="603dac77-3005-43b3-849c-1454dd5ae583" containerName="authorino" Jun 09 15:37:25.358308 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:25.358244 2611 memory_manager.go:368] "RemoveStaleState removing state" podUID="603dac77-3005-43b3-849c-1454dd5ae583" containerName="authorino" Jun 09 15:37:25.360481 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:25.360458 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4nbsh/must-gather-rsf25" Jun 09 15:37:25.363131 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:25.363099 2611 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4nbsh\"/\"openshift-service-ca.crt\"" Jun 09 15:37:25.364013 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:25.363994 2611 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-4nbsh\"/\"default-dockercfg-5v85w\"" Jun 09 15:37:25.364146 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:25.364017 2611 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4nbsh\"/\"kube-root-ca.crt\"" Jun 09 15:37:25.369429 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:25.369399 2611 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4nbsh/must-gather-rsf25"] Jun 09 15:37:25.436958 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:25.436913 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/80b662bc-c954-4a9a-8700-f7b73a0cd213-must-gather-output\") pod \"must-gather-rsf25\" (UID: \"80b662bc-c954-4a9a-8700-f7b73a0cd213\") " pod="openshift-must-gather-4nbsh/must-gather-rsf25" Jun 09 15:37:25.436958 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:25.436961 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5md8c\" (UniqueName: \"kubernetes.io/projected/80b662bc-c954-4a9a-8700-f7b73a0cd213-kube-api-access-5md8c\") pod \"must-gather-rsf25\" (UID: \"80b662bc-c954-4a9a-8700-f7b73a0cd213\") " pod="openshift-must-gather-4nbsh/must-gather-rsf25" Jun 09 15:37:25.538413 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:25.538368 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/80b662bc-c954-4a9a-8700-f7b73a0cd213-must-gather-output\") pod \"must-gather-rsf25\" (UID: \"80b662bc-c954-4a9a-8700-f7b73a0cd213\") " pod="openshift-must-gather-4nbsh/must-gather-rsf25" Jun 09 15:37:25.538413 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:25.538418 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5md8c\" (UniqueName: \"kubernetes.io/projected/80b662bc-c954-4a9a-8700-f7b73a0cd213-kube-api-access-5md8c\") pod \"must-gather-rsf25\" (UID: \"80b662bc-c954-4a9a-8700-f7b73a0cd213\") " pod="openshift-must-gather-4nbsh/must-gather-rsf25" Jun 09 15:37:25.538752 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:25.538725 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/80b662bc-c954-4a9a-8700-f7b73a0cd213-must-gather-output\") pod \"must-gather-rsf25\" (UID: \"80b662bc-c954-4a9a-8700-f7b73a0cd213\") " pod="openshift-must-gather-4nbsh/must-gather-rsf25" Jun 09 15:37:25.547415 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:25.547380 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5md8c\" (UniqueName: \"kubernetes.io/projected/80b662bc-c954-4a9a-8700-f7b73a0cd213-kube-api-access-5md8c\") pod \"must-gather-rsf25\" (UID: \"80b662bc-c954-4a9a-8700-f7b73a0cd213\") " pod="openshift-must-gather-4nbsh/must-gather-rsf25" Jun 09 15:37:25.671789 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:25.671687 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4nbsh/must-gather-rsf25" Jun 09 15:37:25.808866 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:25.808821 2611 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4nbsh/must-gather-rsf25"] Jun 09 15:37:25.810314 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:37:25.810286 2611 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod80b662bc_c954_4a9a_8700_f7b73a0cd213.slice/crio-29adfbb8de91a94885a0d67daea49f6b0ea8a2b4d76d675676119752e89da3f8 WatchSource:0}: Error finding container 29adfbb8de91a94885a0d67daea49f6b0ea8a2b4d76d675676119752e89da3f8: Status 404 returned error can't find the container with id 29adfbb8de91a94885a0d67daea49f6b0ea8a2b4d76d675676119752e89da3f8 Jun 09 15:37:26.383240 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:26.383194 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4nbsh/must-gather-rsf25" event={"ID":"80b662bc-c954-4a9a-8700-f7b73a0cd213","Type":"ContainerStarted","Data":"29adfbb8de91a94885a0d67daea49f6b0ea8a2b4d76d675676119752e89da3f8"} Jun 09 15:37:27.392731 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:27.392692 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4nbsh/must-gather-rsf25" event={"ID":"80b662bc-c954-4a9a-8700-f7b73a0cd213","Type":"ContainerStarted","Data":"3fed082b0fff4d0383434ea08fd313c257d93307d1c97ff14129f9b43063c76f"} Jun 09 15:37:27.393115 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:27.392740 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4nbsh/must-gather-rsf25" event={"ID":"80b662bc-c954-4a9a-8700-f7b73a0cd213","Type":"ContainerStarted","Data":"33b777f7e6044ff3ecf3ff2c14ddaa4d08612d2cd6f73497432d6439fd49b3fd"} Jun 09 15:37:27.414180 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:27.414102 2611 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-4nbsh/must-gather-rsf25" podStartSLOduration=1.659731051 podStartE2EDuration="2.414083413s" totalImagesPullingTime="754.352362ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 15:37:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:37:27.413661059 +0000 UTC m=+1368.219353279" watchObservedRunningTime="2026-06-09 15:37:27.414083413 +0000 UTC m=+1368.219775631" Jun 09 15:37:28.161073 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:28.161043 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-29gkx_5d4f5486-7d40-4141-b905-204512cddc9e/global-pull-secret-syncer/0.log" Jun 09 15:37:28.351720 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:28.351689 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-nqshb_5d1837fb-ae3e-4519-b6f9-a444b41583cc/konnectivity-agent/0.log" Jun 09 15:37:28.375429 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:28.375396 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-139.ec2.internal_33e4799e2cf9d90f29ee83bae71e9e5d/haproxy/0.log" Jun 09 15:37:32.981920 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:32.981881 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bp68k_1cb643e1-ac5e-46a2-a2bc-3a04c35a23ed/extract/0.log" Jun 09 15:37:33.000127 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:33.000091 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bp68k_1cb643e1-ac5e-46a2-a2bc-3a04c35a23ed/util/0.log" Jun 09 15:37:33.029300 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:33.029270 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bp68k_1cb643e1-ac5e-46a2-a2bc-3a04c35a23ed/pull/0.log" Jun 09 15:37:33.055175 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:33.055128 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e059s7f_85cf8db7-d51b-4b68-aff6-bd79366b2bdb/extract/0.log" Jun 09 15:37:33.077415 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:33.077389 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e059s7f_85cf8db7-d51b-4b68-aff6-bd79366b2bdb/util/0.log" Jun 09 15:37:33.102346 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:33.102310 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e059s7f_85cf8db7-d51b-4b68-aff6-bd79366b2bdb/pull/0.log" Jun 09 15:37:33.131767 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:33.131733 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rh4w8_a0baa3c5-e6d1-4ea2-bc5b-8ab30287f2e2/extract/0.log" Jun 09 15:37:33.157951 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:33.157904 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rh4w8_a0baa3c5-e6d1-4ea2-bc5b-8ab30287f2e2/util/0.log" Jun 09 15:37:33.187682 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:33.187596 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rh4w8_a0baa3c5-e6d1-4ea2-bc5b-8ab30287f2e2/pull/0.log" Jun 09 15:37:33.213680 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:33.213648 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z8jxs_8a8b7cf0-2e3d-448b-aad6-0fc22e3bb88c/extract/0.log" Jun 09 15:37:33.236775 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:33.236663 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z8jxs_8a8b7cf0-2e3d-448b-aad6-0fc22e3bb88c/util/0.log" Jun 09 15:37:33.260412 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:33.260379 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1z8jxs_8a8b7cf0-2e3d-448b-aad6-0fc22e3bb88c/pull/0.log" Jun 09 15:37:33.348146 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:33.348112 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7f8f4b87b-krbf8_708bdb9b-9d76-4915-a297-ca53d1d54144/authorino/0.log" Jun 09 15:37:33.421503 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:33.421474 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-rklx8_1d31b525-faa3-4dcc-9da4-8d0de8f3bc4b/manager/0.log" Jun 09 15:37:33.462177 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:33.461898 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-8zghr_5c9e72ec-61ce-478f-9487-97b26734ace3/kuadrant-console-plugin/0.log" Jun 09 15:37:35.458455 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:35.458417 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-bzcwf_34359b10-878f-4c43-9182-99889baf81b7/cluster-monitoring-operator/0.log" Jun 09 15:37:35.494138 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:35.494110 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-wvthr_22c64d94-7b96-4095-9224-bc6c0365167e/kube-state-metrics/0.log" Jun 09 15:37:35.514878 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:35.514843 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-wvthr_22c64d94-7b96-4095-9224-bc6c0365167e/kube-rbac-proxy-main/0.log" Jun 09 15:37:35.540129 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:35.540102 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-wvthr_22c64d94-7b96-4095-9224-bc6c0365167e/kube-rbac-proxy-self/0.log" Jun 09 15:37:35.695063 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:35.695028 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-q4xv9_e2af3552-72ed-4ef4-9424-a5f200d2a794/node-exporter/0.log" Jun 09 15:37:35.718268 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:35.718183 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-q4xv9_e2af3552-72ed-4ef4-9424-a5f200d2a794/kube-rbac-proxy/0.log" Jun 09 15:37:35.743965 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:35.743934 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-q4xv9_e2af3552-72ed-4ef4-9424-a5f200d2a794/init-textfile/0.log" Jun 09 15:37:36.116409 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:36.116374 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-pwkx8_12e7cf41-621a-48a9-8e6e-10b476669bf7/prometheus-operator/0.log" Jun 09 15:37:36.137831 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:36.137797 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-pwkx8_12e7cf41-621a-48a9-8e6e-10b476669bf7/kube-rbac-proxy/0.log" Jun 09 15:37:38.674654 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:38.674613 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-9b4t9_7a9cdcf8-af9d-474c-9f46-4099925e11fc/console-operator/1.log" Jun 09 15:37:38.683124 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:38.683091 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-9b4t9_7a9cdcf8-af9d-474c-9f46-4099925e11fc/console-operator/2.log" Jun 09 15:37:39.289551 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:39.289515 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-tsgfx_59784453-eef7-4fe9-9e6a-426d89aa1361/download-server/0.log" Jun 09 15:37:39.759133 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:39.758775 2611 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4nbsh/perf-node-gather-daemonset-b6nsc"] Jun 09 15:37:39.765448 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:39.765411 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4nbsh/perf-node-gather-daemonset-b6nsc" Jun 09 15:37:39.773264 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:39.773233 2611 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4nbsh/perf-node-gather-daemonset-b6nsc"] Jun 09 15:37:39.880338 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:39.880296 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5f0fc8a1-d7a0-4897-bb5f-31855184aa0d-proc\") pod \"perf-node-gather-daemonset-b6nsc\" (UID: \"5f0fc8a1-d7a0-4897-bb5f-31855184aa0d\") " pod="openshift-must-gather-4nbsh/perf-node-gather-daemonset-b6nsc" Jun 09 15:37:39.880618 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:39.880598 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5f0fc8a1-d7a0-4897-bb5f-31855184aa0d-lib-modules\") pod \"perf-node-gather-daemonset-b6nsc\" (UID: \"5f0fc8a1-d7a0-4897-bb5f-31855184aa0d\") " pod="openshift-must-gather-4nbsh/perf-node-gather-daemonset-b6nsc" Jun 09 15:37:39.880750 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:39.880735 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lscl2\" (UniqueName: \"kubernetes.io/projected/5f0fc8a1-d7a0-4897-bb5f-31855184aa0d-kube-api-access-lscl2\") pod \"perf-node-gather-daemonset-b6nsc\" (UID: \"5f0fc8a1-d7a0-4897-bb5f-31855184aa0d\") " pod="openshift-must-gather-4nbsh/perf-node-gather-daemonset-b6nsc" Jun 09 15:37:39.880880 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:39.880864 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5f0fc8a1-d7a0-4897-bb5f-31855184aa0d-sys\") pod \"perf-node-gather-daemonset-b6nsc\" (UID: \"5f0fc8a1-d7a0-4897-bb5f-31855184aa0d\") " pod="openshift-must-gather-4nbsh/perf-node-gather-daemonset-b6nsc" Jun 09 15:37:39.881035 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:39.881020 2611 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5f0fc8a1-d7a0-4897-bb5f-31855184aa0d-podres\") pod \"perf-node-gather-daemonset-b6nsc\" (UID: \"5f0fc8a1-d7a0-4897-bb5f-31855184aa0d\") " pod="openshift-must-gather-4nbsh/perf-node-gather-daemonset-b6nsc" Jun 09 15:37:39.982109 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:39.982064 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5f0fc8a1-d7a0-4897-bb5f-31855184aa0d-proc\") pod \"perf-node-gather-daemonset-b6nsc\" (UID: \"5f0fc8a1-d7a0-4897-bb5f-31855184aa0d\") " pod="openshift-must-gather-4nbsh/perf-node-gather-daemonset-b6nsc" Jun 09 15:37:39.982327 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:39.982137 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5f0fc8a1-d7a0-4897-bb5f-31855184aa0d-lib-modules\") pod \"perf-node-gather-daemonset-b6nsc\" (UID: \"5f0fc8a1-d7a0-4897-bb5f-31855184aa0d\") " pod="openshift-must-gather-4nbsh/perf-node-gather-daemonset-b6nsc" Jun 09 15:37:39.982327 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:39.982182 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lscl2\" (UniqueName: \"kubernetes.io/projected/5f0fc8a1-d7a0-4897-bb5f-31855184aa0d-kube-api-access-lscl2\") pod \"perf-node-gather-daemonset-b6nsc\" (UID: \"5f0fc8a1-d7a0-4897-bb5f-31855184aa0d\") " pod="openshift-must-gather-4nbsh/perf-node-gather-daemonset-b6nsc" Jun 09 15:37:39.982327 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:39.982220 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5f0fc8a1-d7a0-4897-bb5f-31855184aa0d-sys\") pod \"perf-node-gather-daemonset-b6nsc\" (UID: \"5f0fc8a1-d7a0-4897-bb5f-31855184aa0d\") " pod="openshift-must-gather-4nbsh/perf-node-gather-daemonset-b6nsc" Jun 09 15:37:39.982327 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:39.982285 2611 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5f0fc8a1-d7a0-4897-bb5f-31855184aa0d-podres\") pod \"perf-node-gather-daemonset-b6nsc\" (UID: \"5f0fc8a1-d7a0-4897-bb5f-31855184aa0d\") " pod="openshift-must-gather-4nbsh/perf-node-gather-daemonset-b6nsc" Jun 09 15:37:39.982575 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:39.982494 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5f0fc8a1-d7a0-4897-bb5f-31855184aa0d-podres\") pod \"perf-node-gather-daemonset-b6nsc\" (UID: \"5f0fc8a1-d7a0-4897-bb5f-31855184aa0d\") " pod="openshift-must-gather-4nbsh/perf-node-gather-daemonset-b6nsc" Jun 09 15:37:39.982575 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:39.982552 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5f0fc8a1-d7a0-4897-bb5f-31855184aa0d-proc\") pod \"perf-node-gather-daemonset-b6nsc\" (UID: \"5f0fc8a1-d7a0-4897-bb5f-31855184aa0d\") " pod="openshift-must-gather-4nbsh/perf-node-gather-daemonset-b6nsc" Jun 09 15:37:39.982687 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:39.982638 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5f0fc8a1-d7a0-4897-bb5f-31855184aa0d-lib-modules\") pod \"perf-node-gather-daemonset-b6nsc\" (UID: \"5f0fc8a1-d7a0-4897-bb5f-31855184aa0d\") " pod="openshift-must-gather-4nbsh/perf-node-gather-daemonset-b6nsc" Jun 09 15:37:39.983050 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:39.983010 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5f0fc8a1-d7a0-4897-bb5f-31855184aa0d-sys\") pod \"perf-node-gather-daemonset-b6nsc\" (UID: \"5f0fc8a1-d7a0-4897-bb5f-31855184aa0d\") " pod="openshift-must-gather-4nbsh/perf-node-gather-daemonset-b6nsc" Jun 09 15:37:39.991806 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:39.991766 2611 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lscl2\" (UniqueName: \"kubernetes.io/projected/5f0fc8a1-d7a0-4897-bb5f-31855184aa0d-kube-api-access-lscl2\") pod \"perf-node-gather-daemonset-b6nsc\" (UID: \"5f0fc8a1-d7a0-4897-bb5f-31855184aa0d\") " pod="openshift-must-gather-4nbsh/perf-node-gather-daemonset-b6nsc" Jun 09 15:37:40.079837 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:40.079742 2611 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4nbsh/perf-node-gather-daemonset-b6nsc" Jun 09 15:37:40.299762 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:40.299700 2611 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4nbsh/perf-node-gather-daemonset-b6nsc"] Jun 09 15:37:40.304534 ip-10-0-129-139 kubenswrapper[2611]: W0609 15:37:40.304497 2611 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod5f0fc8a1_d7a0_4897_bb5f_31855184aa0d.slice/crio-68d2b328d34879b1c4a11c862d3ccc263c03e6c671d172bd99c3364364ca1a00 WatchSource:0}: Error finding container 68d2b328d34879b1c4a11c862d3ccc263c03e6c671d172bd99c3364364ca1a00: Status 404 returned error can't find the container with id 68d2b328d34879b1c4a11c862d3ccc263c03e6c671d172bd99c3364364ca1a00 Jun 09 15:37:40.493448 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:40.493397 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4nbsh/perf-node-gather-daemonset-b6nsc" event={"ID":"5f0fc8a1-d7a0-4897-bb5f-31855184aa0d","Type":"ContainerStarted","Data":"0a04cf50030dcdc8f5e19a21f699dfd2a39373d3d06299ff3e508e2086a82963"} Jun 09 15:37:40.493631 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:40.493475 2611 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4nbsh/perf-node-gather-daemonset-b6nsc" event={"ID":"5f0fc8a1-d7a0-4897-bb5f-31855184aa0d","Type":"ContainerStarted","Data":"68d2b328d34879b1c4a11c862d3ccc263c03e6c671d172bd99c3364364ca1a00"} Jun 09 15:37:40.494371 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:40.494317 2611 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-4nbsh/perf-node-gather-daemonset-b6nsc" Jun 09 15:37:40.511290 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:40.511224 2611 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-4nbsh/perf-node-gather-daemonset-b6nsc" podStartSLOduration=1.511202787 podStartE2EDuration="1.511202787s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 15:37:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 15:37:40.510350934 +0000 UTC m=+1381.316043154" watchObservedRunningTime="2026-06-09 15:37:40.511202787 +0000 UTC m=+1381.316895007" Jun 09 15:37:41.190451 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:41.190400 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-88h8k_a97cd107-7aa2-4279-8024-d6584468fd66/dns/0.log" Jun 09 15:37:41.210536 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:41.210502 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-88h8k_a97cd107-7aa2-4279-8024-d6584468fd66/kube-rbac-proxy/0.log" Jun 09 15:37:41.322693 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:41.322659 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-q9x7l_c9ad8e96-7211-48f9-be18-365a42d1a24f/dns-node-resolver/0.log" Jun 09 15:37:42.038050 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:42.038015 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zv9fh_42130943-9472-4e99-901d-84460ecdc92e/node-ca/0.log" Jun 09 15:37:43.147244 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:43.147205 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5dcd85bb64-nvhjb_edd3056b-a539-4665-a517-9ac78f5d9d9f/kube-auth-proxy/0.log" Jun 09 15:37:43.262560 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:43.262532 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-85c449f8d5-nz5ns_2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5/router/0.log" Jun 09 15:37:43.889482 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:43.889447 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5wxnd_e3fbb074-05b5-48f8-b2cc-e1aaa57723c4/serve-healthcheck-canary/0.log" Jun 09 15:37:44.602927 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:44.602877 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-r8ftb_cdf77a37-2bb2-40bb-8006-02e540cc2692/kube-rbac-proxy/0.log" Jun 09 15:37:44.622854 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:44.622823 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-r8ftb_cdf77a37-2bb2-40bb-8006-02e540cc2692/exporter/0.log" Jun 09 15:37:44.643670 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:44.643634 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-r8ftb_cdf77a37-2bb2-40bb-8006-02e540cc2692/extractor/0.log" Jun 09 15:37:47.016644 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:47.016616 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29683650-68ssl_0d8208eb-8090-41fc-a7fb-89189146c248/cleanup/0.log" Jun 09 15:37:47.069148 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:47.069108 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-ssqnd_96e42b6a-8596-4bae-b7d9-4a50674e1946/server/0.log" Jun 09 15:37:47.150417 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:47.150359 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-zfdwp_c003e891-cb17-468f-a272-cdeddf520495/manager/0.log" Jun 09 15:37:47.335047 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:47.334960 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f5f495f5c-x2f56_3f79969f-a29c-4b5e-8d75-91aac69cf584/manager/0.log" Jun 09 15:37:47.362901 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:47.362870 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f5f495f5c-x2f56_3f79969f-a29c-4b5e-8d75-91aac69cf584/copy-manifests/0.log" Jun 09 15:37:47.519852 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:47.519823 2611 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-4nbsh/perf-node-gather-daemonset-b6nsc" Jun 09 15:37:49.070701 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:49.070623 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-565556b8fb-fm7gh_db76c3ec-725e-4b8e-b18f-a2b8f8665547/manager/0.log" Jun 09 15:37:49.103178 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:49.100907 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-6b7g5_64429271-3695-4cb9-82f3-ec0f94ff3fbf/openshift-lws-operator/0.log" Jun 09 15:37:54.074929 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:54.074881 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5dcd85bb64-nvhjb_edd3056b-a539-4665-a517-9ac78f5d9d9f/kube-auth-proxy/0.log" Jun 09 15:37:54.157570 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:54.157532 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-85c449f8d5-nz5ns_2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5/router/0.log" Jun 09 15:37:55.025690 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:55.025652 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-kzxcz_c5f897b6-d89e-42d5-8839-c44fe76224d5/kube-storage-version-migrator-operator/1.log" Jun 09 15:37:55.027479 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:55.027445 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-kzxcz_c5f897b6-d89e-42d5-8839-c44fe76224d5/kube-storage-version-migrator-operator/0.log" Jun 09 15:37:55.357534 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:55.357440 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5dcd85bb64-nvhjb_edd3056b-a539-4665-a517-9ac78f5d9d9f/kube-auth-proxy/0.log" Jun 09 15:37:55.440004 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:55.439965 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-85c449f8d5-nz5ns_2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5/router/0.log" Jun 09 15:37:56.480794 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:56.480761 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tgv5l_c26ef062-04a7-4c4f-a597-c5d097f59914/kube-multus-additional-cni-plugins/0.log" Jun 09 15:37:56.501378 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:56.501258 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tgv5l_c26ef062-04a7-4c4f-a597-c5d097f59914/egress-router-binary-copy/0.log" Jun 09 15:37:56.522731 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:56.522698 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tgv5l_c26ef062-04a7-4c4f-a597-c5d097f59914/cni-plugins/0.log" Jun 09 15:37:56.544873 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:56.544837 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tgv5l_c26ef062-04a7-4c4f-a597-c5d097f59914/bond-cni-plugin/0.log" Jun 09 15:37:56.565299 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:56.565267 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tgv5l_c26ef062-04a7-4c4f-a597-c5d097f59914/routeoverride-cni/0.log" Jun 09 15:37:56.585984 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:56.585957 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tgv5l_c26ef062-04a7-4c4f-a597-c5d097f59914/whereabouts-cni-bincopy/0.log" Jun 09 15:37:56.605814 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:56.605790 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tgv5l_c26ef062-04a7-4c4f-a597-c5d097f59914/whereabouts-cni/0.log" Jun 09 15:37:56.709601 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:56.709563 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-w7zzp_1f78ec9a-bb04-4826-98ea-3f1abeb1f823/kube-multus/0.log" Jun 09 15:37:56.777875 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:56.777802 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-mfj2k_9f450cf6-c990-47e4-a16a-5d0a4ff36581/network-metrics-daemon/0.log" Jun 09 15:37:56.795017 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:56.794987 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-mfj2k_9f450cf6-c990-47e4-a16a-5d0a4ff36581/kube-rbac-proxy/0.log" Jun 09 15:37:57.118729 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:57.118639 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5dcd85bb64-nvhjb_edd3056b-a539-4665-a517-9ac78f5d9d9f/kube-auth-proxy/0.log" Jun 09 15:37:57.215737 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:57.215693 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-85c449f8d5-nz5ns_2f0c6125-dc36-4ca0-ae84-3b0c9b133fb5/router/0.log" Jun 09 15:37:57.918260 ip-10-0-129-139 kubenswrapper[2611]: I0609 15:37:57.918216 2611 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4vsgw_aa94098e-7a90-4a75-9b97-74e10b75695b/ovn-controller/0.log"