Jun 03 19:20:53.033628 ip-10-0-138-80 systemd[1]: Starting Kubernetes Kubelet... Jun 03 19:20:53.435145 ip-10-0-138-80 kubenswrapper[2579]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 19:20:53.435145 ip-10-0-138-80 kubenswrapper[2579]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 03 19:20:53.435145 ip-10-0-138-80 kubenswrapper[2579]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 19:20:53.435145 ip-10-0-138-80 kubenswrapper[2579]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 03 19:20:53.435145 ip-10-0-138-80 kubenswrapper[2579]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 19:20:53.436440 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.435915 2579 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 03 19:20:53.442837 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.442813 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 19:20:53.442837 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.442834 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 19:20:53.442837 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.442838 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 19:20:53.442936 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.442843 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 19:20:53.442936 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.442846 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 19:20:53.442936 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.442849 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 19:20:53.442936 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.442852 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 19:20:53.442936 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.442855 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 19:20:53.442936 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.442859 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 19:20:53.442936 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.442862 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 19:20:53.442936 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.442864 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 19:20:53.442936 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.442868 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 19:20:53.442936 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.442870 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 19:20:53.442936 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.442873 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 19:20:53.442936 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.442883 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 19:20:53.442936 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.442886 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 19:20:53.442936 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.442889 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 19:20:53.442936 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.442892 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 19:20:53.442936 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.442894 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 19:20:53.442936 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.442897 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 19:20:53.442936 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.442899 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 19:20:53.442936 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.442902 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 19:20:53.443409 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.442907 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 19:20:53.443409 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.442909 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 19:20:53.443409 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.442912 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 19:20:53.443409 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.442915 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 19:20:53.443409 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.442917 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 19:20:53.443409 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.442920 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 19:20:53.443409 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.442923 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 19:20:53.443409 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.442925 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 19:20:53.443409 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.442928 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 19:20:53.443409 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.442930 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 19:20:53.443409 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.442932 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 19:20:53.443409 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.442935 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 19:20:53.443409 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.442938 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 19:20:53.443409 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.442941 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 19:20:53.443409 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.442944 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 19:20:53.443409 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.442947 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 19:20:53.443409 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.442950 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 19:20:53.443409 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.442953 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 19:20:53.443409 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.442956 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 19:20:53.443409 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.442958 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 19:20:53.443929 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.442962 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 19:20:53.443929 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.442964 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 19:20:53.443929 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.442967 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 19:20:53.443929 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.442969 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 19:20:53.443929 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.442972 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 19:20:53.443929 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.442974 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 19:20:53.443929 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.442976 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 19:20:53.443929 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.442979 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 19:20:53.443929 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.442981 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 19:20:53.443929 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.442984 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 19:20:53.443929 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.442986 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 19:20:53.443929 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.442988 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 19:20:53.443929 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.442991 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 19:20:53.443929 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.442994 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 19:20:53.443929 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.442996 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 19:20:53.443929 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.442999 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 19:20:53.443929 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.443002 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 19:20:53.443929 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.443006 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 19:20:53.443929 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.443010 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 19:20:53.443929 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.443013 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 19:20:53.444438 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.443015 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 19:20:53.444438 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.443017 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 19:20:53.444438 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.443020 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 19:20:53.444438 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.443022 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 19:20:53.444438 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.443026 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 19:20:53.444438 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.443029 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 19:20:53.444438 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.443032 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 19:20:53.444438 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.443035 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 19:20:53.444438 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.443037 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 19:20:53.444438 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.443040 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 19:20:53.444438 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.443045 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 19:20:53.444438 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.443049 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 19:20:53.444438 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.443052 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 19:20:53.444438 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.443055 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 19:20:53.444438 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.443058 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 19:20:53.444438 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.443060 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 19:20:53.444438 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.443063 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 19:20:53.444438 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.443066 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 19:20:53.444438 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.443068 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 19:20:53.444896 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.443071 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 19:20:53.444896 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.443073 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 19:20:53.444896 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.443076 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 19:20:53.444896 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.443079 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 19:20:53.444896 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.443082 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 19:20:53.444896 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.443085 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 19:20:53.444896 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.443088 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 19:20:53.444896 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.443090 2579 feature_gate.go:328] unrecognized feature gate: Example Jun 03 19:20:53.444896 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.443093 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 19:20:53.444896 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.443095 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 19:20:53.444896 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.443099 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 19:20:53.444896 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.443103 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 19:20:53.444896 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.443106 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 19:20:53.444896 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.443108 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 19:20:53.444896 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.443111 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 19:20:53.444896 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.443113 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 19:20:53.444896 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.443116 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 19:20:53.444896 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.443859 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 19:20:53.444896 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.443866 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 19:20:53.445385 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.443869 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 19:20:53.445385 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.443872 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 19:20:53.445385 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.443875 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 19:20:53.445385 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.443877 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 19:20:53.445385 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.443881 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 19:20:53.445385 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.443891 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 19:20:53.445385 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.443894 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 19:20:53.445385 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.443897 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 19:20:53.445385 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.443899 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 19:20:53.445385 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.443902 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 19:20:53.445385 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.443905 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 19:20:53.445385 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.443907 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 19:20:53.445385 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.443910 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 19:20:53.445385 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.443912 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 19:20:53.445385 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.443915 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 19:20:53.445385 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.443918 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 19:20:53.445385 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.443920 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 19:20:53.445385 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.443923 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 19:20:53.445385 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.443926 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 19:20:53.445385 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.443929 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 19:20:53.445891 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.443932 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 19:20:53.445891 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.443936 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 19:20:53.445891 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.443938 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 19:20:53.445891 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.443943 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 19:20:53.445891 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.443947 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 19:20:53.445891 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.443950 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 19:20:53.445891 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.443953 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 19:20:53.445891 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.443956 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 19:20:53.445891 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.443959 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 19:20:53.445891 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.443962 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 19:20:53.445891 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.443965 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 19:20:53.445891 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.443968 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 19:20:53.445891 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.443971 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 19:20:53.445891 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.443974 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 19:20:53.445891 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.443976 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 19:20:53.445891 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.443979 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 19:20:53.445891 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.443981 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 19:20:53.445891 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.443992 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 19:20:53.445891 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.443995 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 19:20:53.446422 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.443998 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 19:20:53.446422 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444001 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 19:20:53.446422 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444003 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 19:20:53.446422 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444006 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 19:20:53.446422 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444009 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 19:20:53.446422 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444012 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 19:20:53.446422 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444016 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 19:20:53.446422 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444018 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 19:20:53.446422 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444021 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 19:20:53.446422 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444023 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 19:20:53.446422 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444026 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 19:20:53.446422 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444028 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 19:20:53.446422 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444031 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 19:20:53.446422 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444033 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 19:20:53.446422 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444036 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 19:20:53.446422 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444038 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 19:20:53.446422 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444041 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 19:20:53.446422 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444044 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 19:20:53.446422 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444046 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 19:20:53.446889 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444049 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 19:20:53.446889 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444051 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 19:20:53.446889 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444054 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 19:20:53.446889 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444056 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 19:20:53.446889 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444059 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 19:20:53.446889 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444062 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 19:20:53.446889 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444065 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 19:20:53.446889 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444069 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 19:20:53.446889 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444073 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 19:20:53.446889 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444076 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 19:20:53.446889 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444079 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 19:20:53.446889 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444081 2579 feature_gate.go:328] unrecognized feature gate: Example Jun 03 19:20:53.446889 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444090 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 19:20:53.446889 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444092 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 19:20:53.446889 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444095 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 19:20:53.446889 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444097 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 19:20:53.446889 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444100 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 19:20:53.446889 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444103 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 19:20:53.446889 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444105 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 19:20:53.447378 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444108 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 19:20:53.447378 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444110 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 19:20:53.447378 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444114 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 19:20:53.447378 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444118 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 19:20:53.447378 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444120 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 19:20:53.447378 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444123 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 19:20:53.447378 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444127 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 19:20:53.447378 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444130 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 19:20:53.447378 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444133 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 19:20:53.447378 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444136 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 19:20:53.447378 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444139 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 19:20:53.447378 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444141 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 19:20:53.447378 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444144 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 19:20:53.447378 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444147 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 19:20:53.447378 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444150 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 19:20:53.447378 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444153 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 19:20:53.447378 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444156 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 19:20:53.447378 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444160 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 19:20:53.447378 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444163 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 19:20:53.447378 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444603 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 19:20:53.447869 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444608 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 19:20:53.447869 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444611 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 19:20:53.447869 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444614 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 19:20:53.447869 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444617 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 19:20:53.447869 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444619 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 19:20:53.447869 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444623 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 19:20:53.447869 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444626 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 19:20:53.447869 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444629 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 19:20:53.447869 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444631 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 19:20:53.447869 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444634 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 19:20:53.447869 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444637 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 19:20:53.447869 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444640 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 19:20:53.447869 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444643 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 19:20:53.447869 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444645 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 19:20:53.447869 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444648 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 19:20:53.447869 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444651 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 19:20:53.447869 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444653 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 19:20:53.447869 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444656 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 19:20:53.447869 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444658 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 19:20:53.447869 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444661 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 19:20:53.448364 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444665 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 19:20:53.448364 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444668 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 19:20:53.448364 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444670 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 19:20:53.448364 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444673 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 19:20:53.448364 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444675 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 19:20:53.448364 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444678 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 19:20:53.448364 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444680 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 19:20:53.448364 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444682 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 19:20:53.448364 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444685 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 19:20:53.448364 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444690 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 19:20:53.448364 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444693 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 19:20:53.448364 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444695 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 19:20:53.448364 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444699 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 19:20:53.448364 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444701 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 19:20:53.448364 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444704 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 19:20:53.448364 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444707 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 19:20:53.448364 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444709 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 19:20:53.448364 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444711 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 19:20:53.448364 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444714 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 19:20:53.448948 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444717 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 19:20:53.448948 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444721 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 19:20:53.448948 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444723 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 19:20:53.448948 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444726 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 19:20:53.448948 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444728 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 19:20:53.448948 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444731 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 19:20:53.448948 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444733 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 19:20:53.448948 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444736 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 19:20:53.448948 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444738 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 19:20:53.448948 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444741 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 19:20:53.448948 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444743 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 19:20:53.448948 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444746 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 19:20:53.448948 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444748 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 19:20:53.448948 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444751 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 19:20:53.448948 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444753 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 19:20:53.448948 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444756 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 19:20:53.448948 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444758 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 19:20:53.448948 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444761 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 19:20:53.448948 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444764 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 19:20:53.448948 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444766 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 19:20:53.448948 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444769 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 19:20:53.449499 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444771 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 19:20:53.449499 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444776 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 19:20:53.449499 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444779 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 19:20:53.449499 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444782 2579 feature_gate.go:328] unrecognized feature gate: Example Jun 03 19:20:53.449499 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444784 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 19:20:53.449499 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444787 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 19:20:53.449499 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444789 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 19:20:53.449499 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444792 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 19:20:53.449499 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444794 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 19:20:53.449499 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444797 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 19:20:53.449499 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444802 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 19:20:53.449499 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444805 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 19:20:53.449499 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444810 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 19:20:53.449499 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444813 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 19:20:53.449499 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444816 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 19:20:53.449499 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444819 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 19:20:53.449499 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444821 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 19:20:53.449499 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444824 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 19:20:53.449499 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444826 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 19:20:53.450031 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444829 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 19:20:53.450031 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444831 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 19:20:53.450031 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444834 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 19:20:53.450031 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444836 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 19:20:53.450031 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444839 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 19:20:53.450031 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444841 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 19:20:53.450031 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444843 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 19:20:53.450031 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444846 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 19:20:53.450031 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444848 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 19:20:53.450031 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444851 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 19:20:53.450031 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444853 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 19:20:53.450031 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444856 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 19:20:53.450031 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444858 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 19:20:53.450031 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444860 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 19:20:53.450031 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444864 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 19:20:53.450031 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444867 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 19:20:53.450031 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444869 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 19:20:53.450031 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.444872 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 19:20:53.450031 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.444975 2579 flags.go:64] FLAG: --address="0.0.0.0" Jun 03 19:20:53.450031 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.444983 2579 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 03 19:20:53.450541 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.444991 2579 flags.go:64] FLAG: --anonymous-auth="true" Jun 03 19:20:53.450541 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.444996 2579 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 03 19:20:53.450541 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445000 2579 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 03 19:20:53.450541 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445003 2579 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 03 19:20:53.450541 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445007 2579 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 03 19:20:53.450541 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445013 2579 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 03 19:20:53.450541 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445016 2579 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 03 19:20:53.450541 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445019 2579 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 03 19:20:53.450541 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445023 2579 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 03 19:20:53.450541 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445026 2579 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 03 19:20:53.450541 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445029 2579 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 03 19:20:53.450541 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445032 2579 flags.go:64] FLAG: --cgroup-root="" Jun 03 19:20:53.450541 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445035 2579 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 03 19:20:53.450541 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445038 2579 flags.go:64] FLAG: --client-ca-file="" Jun 03 19:20:53.450541 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445041 2579 flags.go:64] FLAG: --cloud-provider="external" Jun 03 19:20:53.450541 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445044 2579 flags.go:64] FLAG: --cluster-dns="[]" Jun 03 19:20:53.450541 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445048 2579 flags.go:64] FLAG: --cluster-domain="" Jun 03 19:20:53.450541 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445051 2579 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 03 19:20:53.450541 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445054 2579 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 03 19:20:53.450541 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445057 2579 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 03 19:20:53.450541 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445060 2579 flags.go:64] FLAG: --container-log-max-files="5" Jun 03 19:20:53.450541 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445063 2579 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 03 19:20:53.450541 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445066 2579 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 03 19:20:53.451113 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445070 2579 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 03 19:20:53.451113 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445073 2579 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 03 19:20:53.451113 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445076 2579 flags.go:64] FLAG: --contention-profiling="false" Jun 03 19:20:53.451113 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445080 2579 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 03 19:20:53.451113 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445083 2579 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 03 19:20:53.451113 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445087 2579 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 03 19:20:53.451113 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445090 2579 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 03 19:20:53.451113 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445094 2579 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 03 19:20:53.451113 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445097 2579 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 03 19:20:53.451113 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445100 2579 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 03 19:20:53.451113 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445103 2579 flags.go:64] FLAG: --enable-load-reader="false" Jun 03 19:20:53.451113 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445106 2579 flags.go:64] FLAG: --enable-server="true" Jun 03 19:20:53.451113 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445109 2579 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 03 19:20:53.451113 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445115 2579 flags.go:64] FLAG: --event-burst="100" Jun 03 19:20:53.451113 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445118 2579 flags.go:64] FLAG: --event-qps="50" Jun 03 19:20:53.451113 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445121 2579 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 03 19:20:53.451113 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445125 2579 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 03 19:20:53.451113 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445128 2579 flags.go:64] FLAG: --eviction-hard="" Jun 03 19:20:53.451113 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445132 2579 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 03 19:20:53.451113 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445135 2579 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 03 19:20:53.451113 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445137 2579 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 03 19:20:53.451113 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445140 2579 flags.go:64] FLAG: --eviction-soft="" Jun 03 19:20:53.451113 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445143 2579 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 03 19:20:53.451113 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445146 2579 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 03 19:20:53.451113 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445149 2579 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 03 19:20:53.451753 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445152 2579 flags.go:64] FLAG: --experimental-mounter-path="" Jun 03 19:20:53.451753 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445155 2579 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 03 19:20:53.451753 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445158 2579 flags.go:64] FLAG: --fail-swap-on="true" Jun 03 19:20:53.451753 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445161 2579 flags.go:64] FLAG: --feature-gates="" Jun 03 19:20:53.451753 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445165 2579 flags.go:64] FLAG: --file-check-frequency="20s" Jun 03 19:20:53.451753 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445168 2579 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 03 19:20:53.451753 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445171 2579 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 03 19:20:53.451753 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445174 2579 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 03 19:20:53.451753 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445177 2579 flags.go:64] FLAG: --healthz-port="10248" Jun 03 19:20:53.451753 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445180 2579 flags.go:64] FLAG: --help="false" Jun 03 19:20:53.451753 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445184 2579 flags.go:64] FLAG: --hostname-override="ip-10-0-138-80.ec2.internal" Jun 03 19:20:53.451753 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445187 2579 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 03 19:20:53.451753 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445191 2579 flags.go:64] FLAG: --http-check-frequency="20s" Jun 03 19:20:53.451753 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445194 2579 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 03 19:20:53.451753 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445197 2579 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 03 19:20:53.451753 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445200 2579 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 03 19:20:53.451753 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445203 2579 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 03 19:20:53.451753 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445206 2579 flags.go:64] FLAG: --image-service-endpoint="" Jun 03 19:20:53.451753 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445209 2579 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 03 19:20:53.451753 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445212 2579 flags.go:64] FLAG: --kube-api-burst="100" Jun 03 19:20:53.451753 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445215 2579 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 03 19:20:53.451753 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445218 2579 flags.go:64] FLAG: --kube-api-qps="50" Jun 03 19:20:53.451753 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445221 2579 flags.go:64] FLAG: --kube-reserved="" Jun 03 19:20:53.451753 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445225 2579 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 03 19:20:53.452371 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445228 2579 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 03 19:20:53.452371 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445231 2579 flags.go:64] FLAG: --kubelet-cgroups="" Jun 03 19:20:53.452371 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445234 2579 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 03 19:20:53.452371 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445236 2579 flags.go:64] FLAG: --lock-file="" Jun 03 19:20:53.452371 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445239 2579 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 03 19:20:53.452371 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445242 2579 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 03 19:20:53.452371 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445245 2579 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 03 19:20:53.452371 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445251 2579 flags.go:64] FLAG: --log-json-split-stream="false" Jun 03 19:20:53.452371 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445254 2579 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 03 19:20:53.452371 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445257 2579 flags.go:64] FLAG: --log-text-split-stream="false" Jun 03 19:20:53.452371 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445260 2579 flags.go:64] FLAG: --logging-format="text" Jun 03 19:20:53.452371 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445263 2579 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 03 19:20:53.452371 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445266 2579 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 03 19:20:53.452371 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445269 2579 flags.go:64] FLAG: --manifest-url="" Jun 03 19:20:53.452371 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445271 2579 flags.go:64] FLAG: --manifest-url-header="" Jun 03 19:20:53.452371 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445276 2579 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 03 19:20:53.452371 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445279 2579 flags.go:64] FLAG: --max-open-files="1000000" Jun 03 19:20:53.452371 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445298 2579 flags.go:64] FLAG: --max-pods="110" Jun 03 19:20:53.452371 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445303 2579 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 03 19:20:53.452371 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445306 2579 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 03 19:20:53.452371 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445309 2579 flags.go:64] FLAG: --memory-manager-policy="None" Jun 03 19:20:53.452371 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445312 2579 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 03 19:20:53.452371 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445315 2579 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 03 19:20:53.452371 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445318 2579 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 03 19:20:53.452371 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445321 2579 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 03 19:20:53.452998 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445328 2579 flags.go:64] FLAG: --node-status-max-images="50" Jun 03 19:20:53.452998 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445331 2579 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 03 19:20:53.452998 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445334 2579 flags.go:64] FLAG: --oom-score-adj="-999" Jun 03 19:20:53.452998 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445338 2579 flags.go:64] FLAG: --pod-cidr="" Jun 03 19:20:53.452998 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445341 2579 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 03 19:20:53.452998 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445346 2579 flags.go:64] FLAG: --pod-manifest-path="" Jun 03 19:20:53.452998 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445349 2579 flags.go:64] FLAG: --pod-max-pids="-1" Jun 03 19:20:53.452998 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445353 2579 flags.go:64] FLAG: --pods-per-core="0" Jun 03 19:20:53.452998 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445356 2579 flags.go:64] FLAG: --port="10250" Jun 03 19:20:53.452998 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445358 2579 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 03 19:20:53.452998 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445361 2579 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0c6ca3affc3df5635" Jun 03 19:20:53.452998 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445365 2579 flags.go:64] FLAG: --qos-reserved="" Jun 03 19:20:53.452998 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445367 2579 flags.go:64] FLAG: --read-only-port="10255" Jun 03 19:20:53.452998 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445370 2579 flags.go:64] FLAG: --register-node="true" Jun 03 19:20:53.452998 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445373 2579 flags.go:64] FLAG: --register-with-taints="" Jun 03 19:20:53.452998 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445377 2579 flags.go:64] FLAG: --registry-burst="10" Jun 03 19:20:53.452998 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445380 2579 flags.go:64] FLAG: --registry-qps="5" Jun 03 19:20:53.452998 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445382 2579 flags.go:64] FLAG: --reserved-cpus="" Jun 03 19:20:53.452998 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445385 2579 flags.go:64] FLAG: --reserved-memory="" Jun 03 19:20:53.452998 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445389 2579 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 03 19:20:53.452998 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445393 2579 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 03 19:20:53.452998 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445396 2579 flags.go:64] FLAG: --rotate-certificates="false" Jun 03 19:20:53.452998 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445399 2579 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 03 19:20:53.452998 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445402 2579 flags.go:64] FLAG: --runonce="false" Jun 03 19:20:53.452998 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445405 2579 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 03 19:20:53.453733 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445408 2579 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 03 19:20:53.453733 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445412 2579 flags.go:64] FLAG: --seccomp-default="false" Jun 03 19:20:53.453733 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445415 2579 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 03 19:20:53.453733 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445418 2579 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 03 19:20:53.453733 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445421 2579 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 03 19:20:53.453733 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445424 2579 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 03 19:20:53.453733 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445427 2579 flags.go:64] FLAG: --storage-driver-password="root" Jun 03 19:20:53.453733 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445430 2579 flags.go:64] FLAG: --storage-driver-secure="false" Jun 03 19:20:53.453733 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445433 2579 flags.go:64] FLAG: --storage-driver-table="stats" Jun 03 19:20:53.453733 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445435 2579 flags.go:64] FLAG: --storage-driver-user="root" Jun 03 19:20:53.453733 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445440 2579 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 03 19:20:53.453733 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445443 2579 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 03 19:20:53.453733 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445446 2579 flags.go:64] FLAG: --system-cgroups="" Jun 03 19:20:53.453733 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445448 2579 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 03 19:20:53.453733 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445454 2579 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 03 19:20:53.453733 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445457 2579 flags.go:64] FLAG: --tls-cert-file="" Jun 03 19:20:53.453733 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445460 2579 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 03 19:20:53.453733 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445464 2579 flags.go:64] FLAG: --tls-min-version="" Jun 03 19:20:53.453733 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445467 2579 flags.go:64] FLAG: --tls-private-key-file="" Jun 03 19:20:53.453733 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445469 2579 flags.go:64] FLAG: --topology-manager-policy="none" Jun 03 19:20:53.453733 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445472 2579 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 03 19:20:53.453733 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445475 2579 flags.go:64] FLAG: --topology-manager-scope="container" Jun 03 19:20:53.453733 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445478 2579 flags.go:64] FLAG: --v="2" Jun 03 19:20:53.453733 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445482 2579 flags.go:64] FLAG: --version="false" Jun 03 19:20:53.453733 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445486 2579 flags.go:64] FLAG: --vmodule="" Jun 03 19:20:53.454360 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445490 2579 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 03 19:20:53.454360 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.445493 2579 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 03 19:20:53.454360 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445659 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 19:20:53.454360 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445663 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 19:20:53.454360 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445666 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 19:20:53.454360 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445669 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 19:20:53.454360 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445672 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 19:20:53.454360 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445676 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 19:20:53.454360 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445680 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 19:20:53.454360 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445683 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 19:20:53.454360 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445686 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 19:20:53.454360 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445689 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 19:20:53.454360 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445691 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 19:20:53.454360 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445694 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 19:20:53.454360 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445696 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 19:20:53.454360 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445699 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 19:20:53.454360 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445701 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 19:20:53.454360 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445706 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 19:20:53.454360 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445709 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 19:20:53.454360 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445711 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 19:20:53.454852 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445714 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 19:20:53.454852 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445717 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 19:20:53.454852 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445720 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 19:20:53.454852 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445724 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 19:20:53.454852 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445728 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 19:20:53.454852 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445731 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 19:20:53.454852 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445733 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 19:20:53.454852 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445736 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 19:20:53.454852 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445738 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 19:20:53.454852 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445741 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 19:20:53.454852 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445743 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 19:20:53.454852 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445746 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 19:20:53.454852 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445748 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 19:20:53.454852 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445751 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 19:20:53.454852 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445753 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 19:20:53.454852 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445756 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 19:20:53.454852 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445758 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 19:20:53.454852 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445761 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 19:20:53.454852 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445763 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 19:20:53.455348 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445767 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 19:20:53.455348 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445772 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 19:20:53.455348 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445775 2579 feature_gate.go:328] unrecognized feature gate: Example Jun 03 19:20:53.455348 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445778 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 19:20:53.455348 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445781 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 19:20:53.455348 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445784 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 19:20:53.455348 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445787 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 19:20:53.455348 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445789 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 19:20:53.455348 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445792 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 19:20:53.455348 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445795 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 19:20:53.455348 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445802 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 19:20:53.455348 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445805 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 19:20:53.455348 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445808 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 19:20:53.455348 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445810 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 19:20:53.455348 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445812 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 19:20:53.455348 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445815 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 19:20:53.455348 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445818 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 19:20:53.455348 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445821 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 19:20:53.455348 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445824 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 19:20:53.455348 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445826 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 19:20:53.455824 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445829 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 19:20:53.455824 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445831 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 19:20:53.455824 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445834 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 19:20:53.455824 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445836 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 19:20:53.455824 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445839 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 19:20:53.455824 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445841 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 19:20:53.455824 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445844 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 19:20:53.455824 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445846 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 19:20:53.455824 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445849 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 19:20:53.455824 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445851 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 19:20:53.455824 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445854 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 19:20:53.455824 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445857 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 19:20:53.455824 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445859 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 19:20:53.455824 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445863 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 19:20:53.455824 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445866 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 19:20:53.455824 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445869 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 19:20:53.455824 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445871 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 19:20:53.455824 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445874 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 19:20:53.455824 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445877 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 19:20:53.455824 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445879 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 19:20:53.456332 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445882 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 19:20:53.456332 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445884 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 19:20:53.456332 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445888 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 19:20:53.456332 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445891 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 19:20:53.456332 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445893 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 19:20:53.456332 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445896 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 19:20:53.456332 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445899 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 19:20:53.456332 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445902 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 19:20:53.456332 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445905 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 19:20:53.456332 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445908 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 19:20:53.456332 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445910 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 19:20:53.456332 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445914 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 19:20:53.456332 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445918 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 19:20:53.456332 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445920 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 19:20:53.456332 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445923 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 19:20:53.456332 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445926 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 19:20:53.456332 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445928 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 19:20:53.456332 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445931 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 19:20:53.456332 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445933 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 19:20:53.456800 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445936 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 19:20:53.456800 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.445938 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 19:20:53.456800 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.447431 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 03 19:20:53.456800 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.454942 2579 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 03 19:20:53.456800 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.454965 2579 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 03 19:20:53.456800 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.454984 2579 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 03 19:20:53.456800 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.454990 2579 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 03 19:20:53.456800 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455053 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 19:20:53.456800 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455059 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 19:20:53.456800 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455062 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 19:20:53.456800 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455068 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 19:20:53.456800 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455072 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 19:20:53.456800 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455075 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 19:20:53.456800 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455079 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 19:20:53.457162 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455082 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 19:20:53.457162 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455085 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 19:20:53.457162 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455088 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 19:20:53.457162 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455091 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 19:20:53.457162 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455094 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 19:20:53.457162 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455096 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 19:20:53.457162 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455099 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 19:20:53.457162 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455101 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 19:20:53.457162 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455104 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 19:20:53.457162 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455106 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 19:20:53.457162 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455109 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 19:20:53.457162 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455112 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 19:20:53.457162 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455114 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 19:20:53.457162 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455117 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 19:20:53.457162 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455120 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 19:20:53.457162 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455122 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 19:20:53.457162 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455125 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 19:20:53.457162 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455128 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 19:20:53.457162 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455131 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 19:20:53.457162 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455134 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 19:20:53.457777 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455137 2579 feature_gate.go:328] unrecognized feature gate: Example Jun 03 19:20:53.457777 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455140 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 19:20:53.457777 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455144 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 19:20:53.457777 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455147 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 19:20:53.457777 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455150 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 19:20:53.457777 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455152 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 19:20:53.457777 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455155 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 19:20:53.457777 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455157 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 19:20:53.457777 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455160 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 19:20:53.457777 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455162 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 19:20:53.457777 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455165 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 19:20:53.457777 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455168 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 19:20:53.457777 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455170 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 19:20:53.457777 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455173 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 19:20:53.457777 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455177 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 19:20:53.457777 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455181 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 19:20:53.457777 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455184 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 19:20:53.457777 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455187 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 19:20:53.457777 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455190 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 19:20:53.457777 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455192 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 19:20:53.458297 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455195 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 19:20:53.458297 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455198 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 19:20:53.458297 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455201 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 19:20:53.458297 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455203 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 19:20:53.458297 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455206 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 19:20:53.458297 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455209 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 19:20:53.458297 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455211 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 19:20:53.458297 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455214 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 19:20:53.458297 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455217 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 19:20:53.458297 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455220 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 19:20:53.458297 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455222 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 19:20:53.458297 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455225 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 19:20:53.458297 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455227 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 19:20:53.458297 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455231 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 19:20:53.458297 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455234 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 19:20:53.458297 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455237 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 19:20:53.458297 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455240 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 19:20:53.458297 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455242 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 19:20:53.458297 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455245 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 19:20:53.458297 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455248 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 19:20:53.458833 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455251 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 19:20:53.458833 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455253 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 19:20:53.458833 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455256 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 19:20:53.458833 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455258 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 19:20:53.458833 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455261 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 19:20:53.458833 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455264 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 19:20:53.458833 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455266 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 19:20:53.458833 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455269 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 19:20:53.458833 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455271 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 19:20:53.458833 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455273 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 19:20:53.458833 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455276 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 19:20:53.458833 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455278 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 19:20:53.458833 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455281 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 19:20:53.458833 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455301 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 19:20:53.458833 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455306 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 19:20:53.458833 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455309 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 19:20:53.458833 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455314 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 19:20:53.458833 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455317 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 19:20:53.458833 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455320 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 19:20:53.459353 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455323 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 19:20:53.459353 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455326 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 19:20:53.459353 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455328 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 19:20:53.459353 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455331 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 19:20:53.459353 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455334 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 19:20:53.459353 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455336 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 19:20:53.459353 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455339 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 19:20:53.459353 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455342 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 19:20:53.459353 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455345 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 19:20:53.459353 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455349 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 19:20:53.459353 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455351 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 19:20:53.459353 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455354 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 19:20:53.459353 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.455360 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 03 19:20:53.459353 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455506 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 19:20:53.459353 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455512 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 19:20:53.459769 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455515 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 19:20:53.459769 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455518 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 19:20:53.459769 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455521 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 19:20:53.459769 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455523 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 19:20:53.459769 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455526 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 19:20:53.459769 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455529 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 19:20:53.459769 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455532 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 19:20:53.459769 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455535 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 19:20:53.459769 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455538 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 19:20:53.459769 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455541 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 19:20:53.459769 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455543 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 19:20:53.459769 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455546 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 19:20:53.459769 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455548 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 19:20:53.459769 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455551 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 19:20:53.459769 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455554 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 19:20:53.459769 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455556 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 19:20:53.459769 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455559 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 19:20:53.459769 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455562 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 19:20:53.459769 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455564 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 19:20:53.459769 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455567 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 19:20:53.460255 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455569 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 19:20:53.460255 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455572 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 19:20:53.460255 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455574 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 19:20:53.460255 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455577 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 19:20:53.460255 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455580 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 19:20:53.460255 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455583 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 19:20:53.460255 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455585 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 19:20:53.460255 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455589 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 19:20:53.460255 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455591 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 19:20:53.460255 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455595 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 19:20:53.460255 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455599 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 19:20:53.460255 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455602 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 19:20:53.460255 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455605 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 19:20:53.460255 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455607 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 19:20:53.460255 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455610 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 19:20:53.460255 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455612 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 19:20:53.460255 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455615 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 19:20:53.460255 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455617 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 19:20:53.460255 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455620 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 19:20:53.460749 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455623 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 19:20:53.460749 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455626 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 19:20:53.460749 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455628 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 19:20:53.460749 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455630 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 19:20:53.460749 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455633 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 19:20:53.460749 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455636 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 19:20:53.460749 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455638 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 19:20:53.460749 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455641 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 19:20:53.460749 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455644 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 19:20:53.460749 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455646 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 19:20:53.460749 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455649 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 19:20:53.460749 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455651 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 19:20:53.460749 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455653 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 19:20:53.460749 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455656 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 19:20:53.460749 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455658 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 19:20:53.460749 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455661 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 19:20:53.460749 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455663 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 19:20:53.460749 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455666 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 19:20:53.460749 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455668 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 19:20:53.460749 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455671 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 19:20:53.461254 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455673 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 19:20:53.461254 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455677 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 19:20:53.461254 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455680 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 19:20:53.461254 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455682 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 19:20:53.461254 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455684 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 19:20:53.461254 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455687 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 19:20:53.461254 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455689 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 19:20:53.461254 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455692 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 19:20:53.461254 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455694 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 19:20:53.461254 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455697 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 19:20:53.461254 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455700 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 19:20:53.461254 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455702 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 19:20:53.461254 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455705 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 19:20:53.461254 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455707 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 19:20:53.461254 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455710 2579 feature_gate.go:328] unrecognized feature gate: Example Jun 03 19:20:53.461254 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455712 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 19:20:53.461254 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455715 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 19:20:53.461254 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455719 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 19:20:53.461254 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455722 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 19:20:53.461751 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455725 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 19:20:53.461751 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455728 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 19:20:53.461751 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455732 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 19:20:53.461751 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455735 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 19:20:53.461751 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455738 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 19:20:53.461751 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455741 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 19:20:53.461751 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455744 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 19:20:53.461751 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455747 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 19:20:53.461751 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455749 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 19:20:53.461751 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455752 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 19:20:53.461751 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455755 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 19:20:53.461751 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455757 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 19:20:53.461751 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455760 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 19:20:53.461751 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455762 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 19:20:53.461751 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455764 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 19:20:53.461751 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455767 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 19:20:53.461751 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455770 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 19:20:53.461751 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:53.455773 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 19:20:53.462380 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.455777 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 03 19:20:53.462380 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.455922 2579 server.go:962] "Client rotation is on, will bootstrap in background" Jun 03 19:20:53.462380 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.458234 2579 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 03 19:20:53.462380 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.459541 2579 server.go:1019] "Starting client certificate rotation" Jun 03 19:20:53.462380 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.459650 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 19:20:53.462380 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.459692 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 19:20:53.463671 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.463621 2579 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 19:20:53.468993 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.468972 2579 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 19:20:53.482097 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.482063 2579 log.go:25] "Validated CRI v1 runtime API" Jun 03 19:20:53.485752 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.485733 2579 log.go:25] "Validated CRI v1 image API" Jun 03 19:20:53.487857 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.487835 2579 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 03 19:20:53.490645 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.490613 2579 fs.go:135] Filesystem UUIDs: map[0ef42ad6-66c9-4081-bf5f-ae5f04db1ede:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 9154dbdf-9de7-4b4d-b17c-27911807b38d:/dev/nvme0n1p4] Jun 03 19:20:53.490748 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.490643 2579 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 03 19:20:53.491046 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.491025 2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 19:20:53.496469 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.496338 2579 manager.go:216] Machine: {Timestamp:2026-06-03 19:20:53.49486961 +0000 UTC m=+0.340529027 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3097636 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ece04aecb057049fe0bea056afba3 SystemUUID:ec2ece04-aecb-0570-49fe-0bea056afba3 BootID:368350cb-e84d-4f40-8715-f06667db1358 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f0:cc:2f:31:e5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f0:cc:2f:31:e5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:fe:1a:d2:6e:19:73 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 03 19:20:53.496469 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.496462 2579 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 03 19:20:53.496631 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.496619 2579 manager.go:232] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 03 19:20:53.499844 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.499802 2579 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 03 19:20:53.500010 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.499846 2579 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-80.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 03 19:20:53.501043 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.501027 2579 topology_manager.go:138] "Creating topology manager with none policy" Jun 03 19:20:53.501088 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.501044 2579 container_manager_linux.go:309] "Creating device plugin manager" Jun 03 19:20:53.501088 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.501059 2579 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 19:20:53.501744 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.501731 2579 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 19:20:53.502611 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.502598 2579 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 03 19:20:53.505430 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.505414 2579 state_mem.go:36] "Initialized new in-memory state store" Jun 03 19:20:53.505576 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.505565 2579 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 03 19:20:53.505611 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.505604 2579 kubelet.go:486] "Attempting to sync node with API server" Jun 03 19:20:53.505638 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.505619 2579 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 03 19:20:53.505638 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.505631 2579 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 03 19:20:53.505691 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.505642 2579 kubelet.go:398] "Adding apiserver pod source" Jun 03 19:20:53.505691 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.505652 2579 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 03 19:20:53.506091 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.506078 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 19:20:53.506144 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.506099 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 19:20:53.510550 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.510525 2579 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 03 19:20:53.512328 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.512311 2579 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 03 19:20:53.512398 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.512343 2579 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 03 19:20:53.513306 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.513276 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 03 19:20:53.513378 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.513310 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 03 19:20:53.513378 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.513317 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 03 19:20:53.513378 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.513323 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 03 19:20:53.513378 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.513332 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 03 19:20:53.513378 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.513337 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 03 19:20:53.513378 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.513346 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 03 19:20:53.513378 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.513351 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 03 19:20:53.513378 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.513358 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 03 19:20:53.513378 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.513364 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 03 19:20:53.513378 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.513372 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 03 19:20:53.513378 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.513377 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 03 19:20:53.514098 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.514082 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 03 19:20:53.514098 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.514096 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 03 19:20:53.516731 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.516710 2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-80.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 03 19:20:53.516731 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:20:53.516690 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 03 19:20:53.516839 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:20:53.516691 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-80.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 03 19:20:53.517676 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.517665 2579 server.go:1268] "Started kubelet" Jun 03 19:20:53.517754 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.517721 2579 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 03 19:20:53.517800 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.517742 2579 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 03 19:20:53.517842 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.517819 2579 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 03 19:20:53.518723 ip-10-0-138-80 systemd[1]: Started Kubernetes Kubelet. Jun 03 19:20:53.519527 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.519495 2579 server.go:310] "Adding debug handlers to kubelet server" Jun 03 19:20:53.519896 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.519880 2579 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 03 19:20:53.524178 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:20:53.524157 2579 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 03 19:20:53.524904 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.524882 2579 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 03 19:20:53.525007 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.524920 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 03 19:20:53.525007 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:20:53.524999 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-80.ec2.internal\" not found" Jun 03 19:20:53.525561 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.525540 2579 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 03 19:20:53.525656 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.525568 2579 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 03 19:20:53.525656 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.525584 2579 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 03 19:20:53.525761 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.525710 2579 reconstruct.go:97] "Volume reconstruction finished" Jun 03 19:20:53.525761 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.525718 2579 reconciler.go:29] "Reconciler: start to sync state" Jun 03 19:20:53.525961 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.525940 2579 factory.go:55] Registering systemd factory Jun 03 19:20:53.525961 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.525966 2579 factory.go:223] Registration of the systemd container factory successfully Jun 03 19:20:53.526406 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.526386 2579 factory.go:153] Registering CRI-O factory Jun 03 19:20:53.526494 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.526409 2579 factory.go:223] Registration of the crio container factory successfully Jun 03 19:20:53.526494 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.526461 2579 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 03 19:20:53.526494 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.526486 2579 factory.go:103] Registering Raw factory Jun 03 19:20:53.526628 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.526502 2579 manager.go:1196] Started watching for new ooms in manager Jun 03 19:20:53.526842 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:20:53.525742 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-80.ec2.internal.18b5a8763f5e0e0b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-80.ec2.internal,UID:ip-10-0-138-80.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-80.ec2.internal,},FirstTimestamp:2026-06-03 19:20:53.517635083 +0000 UTC m=+0.363294551,LastTimestamp:2026-06-03 19:20:53.517635083 +0000 UTC m=+0.363294551,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-80.ec2.internal,}" Jun 03 19:20:53.527062 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.527051 2579 manager.go:349] Starting recovery of all containers Jun 03 19:20:53.531165 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:20:53.531131 2579 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-80.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 03 19:20:53.531339 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:20:53.531309 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 03 19:20:53.533576 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.533550 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-phxvj" Jun 03 19:20:53.537481 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.537462 2579 manager.go:354] Recovery completed Jun 03 19:20:53.541841 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.541822 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 19:20:53.542867 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.542846 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-phxvj" Jun 03 19:20:53.544816 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.544795 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-80.ec2.internal" event="NodeHasSufficientMemory" Jun 03 19:20:53.544918 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.544832 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-80.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 19:20:53.544918 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.544843 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-80.ec2.internal" event="NodeHasSufficientPID" Jun 03 19:20:53.545681 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.545573 2579 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 03 19:20:53.545681 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.545597 2579 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 03 19:20:53.545681 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.545618 2579 state_mem.go:36] "Initialized new in-memory state store" Jun 03 19:20:53.545681 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.545622 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 19:20:53.546453 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.546436 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-80.ec2.internal" event="NodeHasSufficientMemory" Jun 03 19:20:53.546526 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.546467 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-80.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 19:20:53.546526 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.546477 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-80.ec2.internal" event="NodeHasSufficientPID" Jun 03 19:20:53.546599 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.546574 2579 policy_none.go:49] "None policy: Start" Jun 03 19:20:53.546599 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.546590 2579 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 03 19:20:53.546661 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.546604 2579 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 03 19:20:53.546795 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:20:53.546701 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-80.ec2.internal.18b5a87640fcd348 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-80.ec2.internal,UID:ip-10-0-138-80.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-80.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-80.ec2.internal,},FirstTimestamp:2026-06-03 19:20:53.54481748 +0000 UTC m=+0.390476886,LastTimestamp:2026-06-03 19:20:53.54481748 +0000 UTC m=+0.390476886,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-80.ec2.internal,}" Jun 03 19:20:53.547508 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.547496 2579 policy_none.go:47] "Start" Jun 03 19:20:53.582428 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.582199 2579 manager.go:337] "Starting Device Plugin manager" Jun 03 19:20:53.582593 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:20:53.582461 2579 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 03 19:20:53.582593 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.582478 2579 server.go:87] "Starting device plugin registration server" Jun 03 19:20:53.582742 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.582730 2579 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 03 19:20:53.582785 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.582747 2579 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 03 19:20:53.582845 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.582830 2579 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 03 19:20:53.582920 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.582909 2579 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 03 19:20:53.582961 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.582921 2579 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 03 19:20:53.586868 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:20:53.586844 2579 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 03 19:20:53.604684 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:20:53.586907 2579 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-80.ec2.internal\" not found" Jun 03 19:20:53.604684 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.601124 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 03 19:20:53.604684 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.602896 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 03 19:20:53.604684 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.602937 2579 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 03 19:20:53.604684 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.602960 2579 kubelet.go:2448] "Starting kubelet main sync loop" Jun 03 19:20:53.604684 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:20:53.603048 2579 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 03 19:20:53.606090 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.606070 2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 19:20:53.682858 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.682830 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 19:20:53.683933 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.683912 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-80.ec2.internal" event="NodeHasSufficientMemory" Jun 03 19:20:53.684024 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.683951 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-80.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 19:20:53.684024 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.683967 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-80.ec2.internal" event="NodeHasSufficientPID" Jun 03 19:20:53.684024 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.683991 2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-80.ec2.internal" Jun 03 19:20:53.696320 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.696238 2579 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-80.ec2.internal" Jun 03 19:20:53.696320 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:20:53.696267 2579 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-80.ec2.internal\": node \"ip-10-0-138-80.ec2.internal\" not found" Jun 03 19:20:53.703562 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.703540 2579 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-80.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-80.ec2.internal"] Jun 03 19:20:53.703652 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.703605 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 19:20:53.704567 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.704550 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-80.ec2.internal" event="NodeHasSufficientMemory" Jun 03 19:20:53.704659 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.704585 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-80.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 19:20:53.704659 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.704601 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-80.ec2.internal" event="NodeHasSufficientPID" Jun 03 19:20:53.705796 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.705783 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 19:20:53.705928 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.705911 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-80.ec2.internal" Jun 03 19:20:53.705978 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.705944 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 19:20:53.706548 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.706522 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-80.ec2.internal" event="NodeHasSufficientMemory" Jun 03 19:20:53.706548 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.706548 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-80.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 19:20:53.706678 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.706558 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-80.ec2.internal" event="NodeHasSufficientPID" Jun 03 19:20:53.706678 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.706577 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-80.ec2.internal" event="NodeHasSufficientMemory" Jun 03 19:20:53.706678 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.706648 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-80.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 19:20:53.706678 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.706663 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-80.ec2.internal" event="NodeHasSufficientPID" Jun 03 19:20:53.707786 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.707770 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-80.ec2.internal" Jun 03 19:20:53.707889 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.707803 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 19:20:53.709830 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.709811 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-80.ec2.internal" event="NodeHasSufficientMemory" Jun 03 19:20:53.709927 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.709841 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-80.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 19:20:53.709927 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.709856 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-80.ec2.internal" event="NodeHasSufficientPID" Jun 03 19:20:53.713411 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:20:53.713396 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-80.ec2.internal\" not found" Jun 03 19:20:53.727689 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.727653 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/060a8578864dac33397ef52063e9f724-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-80.ec2.internal\" (UID: \"060a8578864dac33397ef52063e9f724\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-80.ec2.internal" Jun 03 19:20:53.727814 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.727693 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/060a8578864dac33397ef52063e9f724-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-80.ec2.internal\" (UID: \"060a8578864dac33397ef52063e9f724\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-80.ec2.internal" Jun 03 19:20:53.727814 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.727726 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/79413a4092866a6445601379cc7dcecf-config\") pod \"kube-apiserver-proxy-ip-10-0-138-80.ec2.internal\" (UID: \"79413a4092866a6445601379cc7dcecf\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-80.ec2.internal" Jun 03 19:20:53.735244 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:20:53.735215 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-80.ec2.internal\" not found" node="ip-10-0-138-80.ec2.internal" Jun 03 19:20:53.739826 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:20:53.739807 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-80.ec2.internal\" not found" node="ip-10-0-138-80.ec2.internal" Jun 03 19:20:53.813960 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:20:53.813922 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-80.ec2.internal\" not found" Jun 03 19:20:53.828042 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.828011 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/060a8578864dac33397ef52063e9f724-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-80.ec2.internal\" (UID: \"060a8578864dac33397ef52063e9f724\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-80.ec2.internal" Jun 03 19:20:53.828142 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.828047 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/060a8578864dac33397ef52063e9f724-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-80.ec2.internal\" (UID: \"060a8578864dac33397ef52063e9f724\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-80.ec2.internal" Jun 03 19:20:53.828142 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.828064 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/79413a4092866a6445601379cc7dcecf-config\") pod \"kube-apiserver-proxy-ip-10-0-138-80.ec2.internal\" (UID: \"79413a4092866a6445601379cc7dcecf\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-80.ec2.internal" Jun 03 19:20:53.828142 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.828099 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/79413a4092866a6445601379cc7dcecf-config\") pod \"kube-apiserver-proxy-ip-10-0-138-80.ec2.internal\" (UID: \"79413a4092866a6445601379cc7dcecf\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-80.ec2.internal" Jun 03 19:20:53.828142 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.828102 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/060a8578864dac33397ef52063e9f724-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-80.ec2.internal\" (UID: \"060a8578864dac33397ef52063e9f724\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-80.ec2.internal" Jun 03 19:20:53.828142 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:53.828119 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/060a8578864dac33397ef52063e9f724-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-80.ec2.internal\" (UID: \"060a8578864dac33397ef52063e9f724\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-80.ec2.internal" Jun 03 19:20:53.914186 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:20:53.914138 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-80.ec2.internal\" not found" Jun 03 19:20:54.015106 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:20:54.015006 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-80.ec2.internal\" not found" Jun 03 19:20:54.038599 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:54.038566 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-80.ec2.internal" Jun 03 19:20:54.044023 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:54.043995 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-80.ec2.internal" Jun 03 19:20:54.115766 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:20:54.115709 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-80.ec2.internal\" not found" Jun 03 19:20:54.216305 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:20:54.216243 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-80.ec2.internal\" not found" Jun 03 19:20:54.316943 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:20:54.316845 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-80.ec2.internal\" not found" Jun 03 19:20:54.417530 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:20:54.417487 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-80.ec2.internal\" not found" Jun 03 19:20:54.458952 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:54.458922 2579 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 03 19:20:54.459494 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:54.459094 2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 19:20:54.518420 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:20:54.518389 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-80.ec2.internal\" not found" Jun 03 19:20:54.522863 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:54.522828 2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 19:20:54.546534 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:54.546469 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-02 19:15:53 +0000 UTC" deadline="2028-01-04 03:55:38.846843793 +0000 UTC" Jun 03 19:20:54.546534 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:54.546530 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13904h34m44.300318138s" Jun 03 19:20:54.578115 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:54.578077 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod060a8578864dac33397ef52063e9f724.slice/crio-7f4851d064715b1555257127130f50b83e1d67306b34f669eebf7e387d1bf1c5 WatchSource:0}: Error finding container 7f4851d064715b1555257127130f50b83e1d67306b34f669eebf7e387d1bf1c5: Status 404 returned error can't find the container with id 7f4851d064715b1555257127130f50b83e1d67306b34f669eebf7e387d1bf1c5 Jun 03 19:20:54.579104 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:54.578622 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79413a4092866a6445601379cc7dcecf.slice/crio-b54c4fef566195b8fd5b16257dbe40ec698d9d2b61967f7038ad1ca53cc287b0 WatchSource:0}: Error finding container b54c4fef566195b8fd5b16257dbe40ec698d9d2b61967f7038ad1ca53cc287b0: Status 404 returned error can't find the container with id b54c4fef566195b8fd5b16257dbe40ec698d9d2b61967f7038ad1ca53cc287b0 Jun 03 19:20:54.584628 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:54.584612 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 19:20:54.607355 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:54.607305 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-80.ec2.internal" event={"ID":"060a8578864dac33397ef52063e9f724","Type":"ContainerStarted","Data":"7f4851d064715b1555257127130f50b83e1d67306b34f669eebf7e387d1bf1c5"} Jun 03 19:20:54.608373 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:54.608351 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-80.ec2.internal" event={"ID":"79413a4092866a6445601379cc7dcecf","Type":"ContainerStarted","Data":"b54c4fef566195b8fd5b16257dbe40ec698d9d2b61967f7038ad1ca53cc287b0"} Jun 03 19:20:54.618484 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:20:54.618463 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-80.ec2.internal\" not found" Jun 03 19:20:54.719034 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:20:54.718991 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-80.ec2.internal\" not found" Jun 03 19:20:54.819609 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:20:54.819523 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-80.ec2.internal\" not found" Jun 03 19:20:54.920104 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:20:54.920064 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-80.ec2.internal\" not found" Jun 03 19:20:55.020763 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:20:55.020725 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-80.ec2.internal\" not found" Jun 03 19:20:55.026088 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.026057 2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 19:20:55.083708 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.083624 2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 19:20:55.125571 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.125531 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-80.ec2.internal" Jun 03 19:20:55.139599 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.139567 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 19:20:55.140872 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.140846 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-80.ec2.internal" Jun 03 19:20:55.150767 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.150736 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 19:20:55.506627 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.506539 2579 apiserver.go:52] "Watching apiserver" Jun 03 19:20:55.512653 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.512623 2579 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 03 19:20:55.513077 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.513049 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-5czvc","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-80.ec2.internal","openshift-multus/network-metrics-daemon-xpvdz","openshift-ovn-kubernetes/ovnkube-node-hxzmz","kube-system/global-pull-secret-syncer-cjz9d","kube-system/kube-apiserver-proxy-ip-10-0-138-80.ec2.internal","openshift-cluster-node-tuning-operator/tuned-x7fzw","openshift-multus/multus-additional-cni-plugins-kjcwb","openshift-multus/multus-tlvhh","openshift-network-diagnostics/network-check-target-4zhtx","openshift-network-operator/iptables-alerter-692f4","kube-system/konnectivity-agent-pgqqd","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xp7nm","openshift-dns/node-resolver-wq5fc"] Jun 03 19:20:55.514772 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.514748 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-x7fzw" Jun 03 19:20:55.516058 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.516013 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xp7nm" Jun 03 19:20:55.516878 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.516862 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xpvdz" Jun 03 19:20:55.516976 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:20:55.516921 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xpvdz" podUID="e0ed8e87-e724-4880-a4e8-fe68533db02a" Jun 03 19:20:55.517251 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.517230 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 03 19:20:55.517420 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.517276 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-425bm\"" Jun 03 19:20:55.517584 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.517563 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 03 19:20:55.518415 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.518395 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 03 19:20:55.518502 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.518484 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hxzmz" Jun 03 19:20:55.518690 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.518675 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 03 19:20:55.519240 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.519226 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-mgswd\"" Jun 03 19:20:55.519333 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.519313 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 03 19:20:55.519766 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.519748 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cjz9d" Jun 03 19:20:55.519908 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:20:55.519835 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cjz9d" podUID="5f4ae72c-cf67-426b-af3e-9b2a27c9488c" Jun 03 19:20:55.520886 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.520867 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wq5fc" Jun 03 19:20:55.521403 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.521378 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 03 19:20:55.521403 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.521394 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 03 19:20:55.521543 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.521414 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-xqt6d\"" Jun 03 19:20:55.521543 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.521394 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 03 19:20:55.521543 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.521530 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 03 19:20:55.521835 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.521817 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 03 19:20:55.521942 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.521926 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 03 19:20:55.522231 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.522208 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tlvhh" Jun 03 19:20:55.523625 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.523228 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 03 19:20:55.523625 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.523371 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5czvc" Jun 03 19:20:55.523625 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.523407 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 03 19:20:55.523829 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.523814 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-9wbtv\"" Jun 03 19:20:55.524708 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.524688 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kjcwb" Jun 03 19:20:55.527214 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.527193 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 03 19:20:55.527364 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.527346 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-nb6jm\"" Jun 03 19:20:55.527451 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.527437 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 03 19:20:55.527754 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.527736 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-8jrb2\"" Jun 03 19:20:55.527884 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.527868 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 03 19:20:55.528388 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.528371 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 03 19:20:55.528729 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.528714 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 03 19:20:55.528880 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.528867 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 03 19:20:55.529024 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.529006 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 03 19:20:55.530198 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.530181 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 03 19:20:55.530691 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.530666 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4zhtx" Jun 03 19:20:55.530895 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:20:55.530871 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4zhtx" podUID="54761057-2346-4f57-9c39-5020ac09c153" Jun 03 19:20:55.531780 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.531757 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-4bzd2\"" Jun 03 19:20:55.531902 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.531855 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 03 19:20:55.532825 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.532805 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 03 19:20:55.533382 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.533367 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-692f4" Jun 03 19:20:55.534796 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.534777 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pgqqd" Jun 03 19:20:55.535696 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.535674 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 03 19:20:55.535834 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.535789 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 03 19:20:55.535937 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.535920 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 03 19:20:55.535999 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.535927 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-77cdc\"" Jun 03 19:20:55.537329 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.537281 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bbe34b9a-ec50-44cc-8203-e763426c06f0-etc-kubernetes\") pod \"tuned-x7fzw\" (UID: \"bbe34b9a-ec50-44cc-8203-e763426c06f0\") " pod="openshift-cluster-node-tuning-operator/tuned-x7fzw" Jun 03 19:20:55.537422 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.537346 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bbe34b9a-ec50-44cc-8203-e763426c06f0-tmp\") pod \"tuned-x7fzw\" (UID: \"bbe34b9a-ec50-44cc-8203-e763426c06f0\") " pod="openshift-cluster-node-tuning-operator/tuned-x7fzw" Jun 03 19:20:55.537422 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.537373 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f9120d61-aab1-47ff-8db1-29e1d2349729-var-lib-openvswitch\") pod \"ovnkube-node-hxzmz\" (UID: \"f9120d61-aab1-47ff-8db1-29e1d2349729\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxzmz" Jun 03 19:20:55.537422 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.537397 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f9120d61-aab1-47ff-8db1-29e1d2349729-run-ovn\") pod \"ovnkube-node-hxzmz\" (UID: \"f9120d61-aab1-47ff-8db1-29e1d2349729\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxzmz" Jun 03 19:20:55.537571 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.537424 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7rgc\" (UniqueName: \"kubernetes.io/projected/54761057-2346-4f57-9c39-5020ac09c153-kube-api-access-m7rgc\") pod \"network-check-target-4zhtx\" (UID: \"54761057-2346-4f57-9c39-5020ac09c153\") " pod="openshift-network-diagnostics/network-check-target-4zhtx" Jun 03 19:20:55.537571 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.537474 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e0ed8e87-e724-4880-a4e8-fe68533db02a-metrics-certs\") pod \"network-metrics-daemon-xpvdz\" (UID: \"e0ed8e87-e724-4880-a4e8-fe68533db02a\") " pod="openshift-multus/network-metrics-daemon-xpvdz" Jun 03 19:20:55.537571 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.537497 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 03 19:20:55.537571 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.537499 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 03 19:20:55.537571 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.537499 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56rz2\" (UniqueName: \"kubernetes.io/projected/e0ed8e87-e724-4880-a4e8-fe68533db02a-kube-api-access-56rz2\") pod \"network-metrics-daemon-xpvdz\" (UID: \"e0ed8e87-e724-4880-a4e8-fe68533db02a\") " pod="openshift-multus/network-metrics-daemon-xpvdz" Jun 03 19:20:55.537571 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.537562 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f9120d61-aab1-47ff-8db1-29e1d2349729-log-socket\") pod \"ovnkube-node-hxzmz\" (UID: \"f9120d61-aab1-47ff-8db1-29e1d2349729\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxzmz" Jun 03 19:20:55.537869 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.537588 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f7cfbe65-8cb3-49e2-9d1a-2e4acee99955-device-dir\") pod \"aws-ebs-csi-driver-node-xp7nm\" (UID: \"f7cfbe65-8cb3-49e2-9d1a-2e4acee99955\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xp7nm" Jun 03 19:20:55.537869 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.537611 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f9120d61-aab1-47ff-8db1-29e1d2349729-systemd-units\") pod \"ovnkube-node-hxzmz\" (UID: \"f9120d61-aab1-47ff-8db1-29e1d2349729\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxzmz" Jun 03 19:20:55.537869 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.537635 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f9120d61-aab1-47ff-8db1-29e1d2349729-run-openvswitch\") pod \"ovnkube-node-hxzmz\" (UID: \"f9120d61-aab1-47ff-8db1-29e1d2349729\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxzmz" Jun 03 19:20:55.537869 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.537662 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fd082ce0-248b-4e84-997c-cde24967cf01-multus-conf-dir\") pod \"multus-tlvhh\" (UID: \"fd082ce0-248b-4e84-997c-cde24967cf01\") " pod="openshift-multus/multus-tlvhh" Jun 03 19:20:55.537869 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.537686 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b79abc02-ece3-4eaf-b4d8-e131f6e71f60-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kjcwb\" (UID: \"b79abc02-ece3-4eaf-b4d8-e131f6e71f60\") " pod="openshift-multus/multus-additional-cni-plugins-kjcwb" Jun 03 19:20:55.537869 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.537727 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zz72v\" (UniqueName: \"kubernetes.io/projected/b79abc02-ece3-4eaf-b4d8-e131f6e71f60-kube-api-access-zz72v\") pod \"multus-additional-cni-plugins-kjcwb\" (UID: \"b79abc02-ece3-4eaf-b4d8-e131f6e71f60\") " pod="openshift-multus/multus-additional-cni-plugins-kjcwb" Jun 03 19:20:55.537869 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.537757 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bbe34b9a-ec50-44cc-8203-e763426c06f0-var-lib-kubelet\") pod \"tuned-x7fzw\" (UID: \"bbe34b9a-ec50-44cc-8203-e763426c06f0\") " pod="openshift-cluster-node-tuning-operator/tuned-x7fzw" Jun 03 19:20:55.537869 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.537779 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5xw4\" (UniqueName: \"kubernetes.io/projected/f9120d61-aab1-47ff-8db1-29e1d2349729-kube-api-access-g5xw4\") pod \"ovnkube-node-hxzmz\" (UID: \"f9120d61-aab1-47ff-8db1-29e1d2349729\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxzmz" Jun 03 19:20:55.537869 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.537811 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5f4ae72c-cf67-426b-af3e-9b2a27c9488c-original-pull-secret\") pod \"global-pull-secret-syncer-cjz9d\" (UID: \"5f4ae72c-cf67-426b-af3e-9b2a27c9488c\") " pod="kube-system/global-pull-secret-syncer-cjz9d" Jun 03 19:20:55.537869 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.537844 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fd082ce0-248b-4e84-997c-cde24967cf01-system-cni-dir\") pod \"multus-tlvhh\" (UID: \"fd082ce0-248b-4e84-997c-cde24967cf01\") " pod="openshift-multus/multus-tlvhh" Jun 03 19:20:55.537869 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.537874 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fd082ce0-248b-4e84-997c-cde24967cf01-etc-kubernetes\") pod \"multus-tlvhh\" (UID: \"fd082ce0-248b-4e84-997c-cde24967cf01\") " pod="openshift-multus/multus-tlvhh" Jun 03 19:20:55.538394 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.537909 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f7cfbe65-8cb3-49e2-9d1a-2e4acee99955-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xp7nm\" (UID: \"f7cfbe65-8cb3-49e2-9d1a-2e4acee99955\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xp7nm" Jun 03 19:20:55.538394 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.537961 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-7bqjp\"" Jun 03 19:20:55.538394 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.537969 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f9120d61-aab1-47ff-8db1-29e1d2349729-host-slash\") pod \"ovnkube-node-hxzmz\" (UID: \"f9120d61-aab1-47ff-8db1-29e1d2349729\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxzmz" Jun 03 19:20:55.538394 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.538035 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f9120d61-aab1-47ff-8db1-29e1d2349729-host-cni-netd\") pod \"ovnkube-node-hxzmz\" (UID: \"f9120d61-aab1-47ff-8db1-29e1d2349729\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxzmz" Jun 03 19:20:55.538394 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.538058 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f9120d61-aab1-47ff-8db1-29e1d2349729-env-overrides\") pod \"ovnkube-node-hxzmz\" (UID: \"f9120d61-aab1-47ff-8db1-29e1d2349729\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxzmz" Jun 03 19:20:55.538394 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.538092 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/19ae3107-ba44-4cb7-9dad-e125e64323fa-hosts-file\") pod \"node-resolver-wq5fc\" (UID: \"19ae3107-ba44-4cb7-9dad-e125e64323fa\") " pod="openshift-dns/node-resolver-wq5fc" Jun 03 19:20:55.538394 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.538124 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bbe34b9a-ec50-44cc-8203-e763426c06f0-etc-sysctl-conf\") pod \"tuned-x7fzw\" (UID: \"bbe34b9a-ec50-44cc-8203-e763426c06f0\") " pod="openshift-cluster-node-tuning-operator/tuned-x7fzw" Jun 03 19:20:55.538394 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.538154 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bbe34b9a-ec50-44cc-8203-e763426c06f0-sys\") pod \"tuned-x7fzw\" (UID: \"bbe34b9a-ec50-44cc-8203-e763426c06f0\") " pod="openshift-cluster-node-tuning-operator/tuned-x7fzw" Jun 03 19:20:55.538394 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.538178 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnfdj\" (UniqueName: \"kubernetes.io/projected/bbe34b9a-ec50-44cc-8203-e763426c06f0-kube-api-access-lnfdj\") pod \"tuned-x7fzw\" (UID: \"bbe34b9a-ec50-44cc-8203-e763426c06f0\") " pod="openshift-cluster-node-tuning-operator/tuned-x7fzw" Jun 03 19:20:55.538394 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.538255 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f7cfbe65-8cb3-49e2-9d1a-2e4acee99955-sys-fs\") pod \"aws-ebs-csi-driver-node-xp7nm\" (UID: \"f7cfbe65-8cb3-49e2-9d1a-2e4acee99955\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xp7nm" Jun 03 19:20:55.538394 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.538303 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fd082ce0-248b-4e84-997c-cde24967cf01-multus-socket-dir-parent\") pod \"multus-tlvhh\" (UID: \"fd082ce0-248b-4e84-997c-cde24967cf01\") " pod="openshift-multus/multus-tlvhh" Jun 03 19:20:55.538394 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.538326 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fd082ce0-248b-4e84-997c-cde24967cf01-host-run-multus-certs\") pod \"multus-tlvhh\" (UID: \"fd082ce0-248b-4e84-997c-cde24967cf01\") " pod="openshift-multus/multus-tlvhh" Jun 03 19:20:55.538394 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.538341 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fd082ce0-248b-4e84-997c-cde24967cf01-host-var-lib-cni-bin\") pod \"multus-tlvhh\" (UID: \"fd082ce0-248b-4e84-997c-cde24967cf01\") " pod="openshift-multus/multus-tlvhh" Jun 03 19:20:55.538394 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.538356 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fd082ce0-248b-4e84-997c-cde24967cf01-hostroot\") pod \"multus-tlvhh\" (UID: \"fd082ce0-248b-4e84-997c-cde24967cf01\") " pod="openshift-multus/multus-tlvhh" Jun 03 19:20:55.538394 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.538372 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f7cfbe65-8cb3-49e2-9d1a-2e4acee99955-socket-dir\") pod \"aws-ebs-csi-driver-node-xp7nm\" (UID: \"f7cfbe65-8cb3-49e2-9d1a-2e4acee99955\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xp7nm" Jun 03 19:20:55.538923 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.538406 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f9120d61-aab1-47ff-8db1-29e1d2349729-host-cni-bin\") pod \"ovnkube-node-hxzmz\" (UID: \"f9120d61-aab1-47ff-8db1-29e1d2349729\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxzmz" Jun 03 19:20:55.538923 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.538453 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmsjb\" (UniqueName: \"kubernetes.io/projected/ce05c923-acba-430c-bcc1-576e5f7d1f33-kube-api-access-jmsjb\") pod \"node-ca-5czvc\" (UID: \"ce05c923-acba-430c-bcc1-576e5f7d1f33\") " pod="openshift-image-registry/node-ca-5czvc" Jun 03 19:20:55.538923 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.538494 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xhzx\" (UniqueName: \"kubernetes.io/projected/f7cfbe65-8cb3-49e2-9d1a-2e4acee99955-kube-api-access-9xhzx\") pod \"aws-ebs-csi-driver-node-xp7nm\" (UID: \"f7cfbe65-8cb3-49e2-9d1a-2e4acee99955\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xp7nm" Jun 03 19:20:55.538923 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.538535 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f9120d61-aab1-47ff-8db1-29e1d2349729-etc-openvswitch\") pod \"ovnkube-node-hxzmz\" (UID: \"f9120d61-aab1-47ff-8db1-29e1d2349729\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxzmz" Jun 03 19:20:55.538923 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.538559 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fd082ce0-248b-4e84-997c-cde24967cf01-os-release\") pod \"multus-tlvhh\" (UID: \"fd082ce0-248b-4e84-997c-cde24967cf01\") " pod="openshift-multus/multus-tlvhh" Jun 03 19:20:55.538923 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.538595 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bbe34b9a-ec50-44cc-8203-e763426c06f0-run\") pod \"tuned-x7fzw\" (UID: \"bbe34b9a-ec50-44cc-8203-e763426c06f0\") " pod="openshift-cluster-node-tuning-operator/tuned-x7fzw" Jun 03 19:20:55.538923 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.538619 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bbe34b9a-ec50-44cc-8203-e763426c06f0-etc-tuned\") pod \"tuned-x7fzw\" (UID: \"bbe34b9a-ec50-44cc-8203-e763426c06f0\") " pod="openshift-cluster-node-tuning-operator/tuned-x7fzw" Jun 03 19:20:55.538923 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.538644 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f7cfbe65-8cb3-49e2-9d1a-2e4acee99955-etc-selinux\") pod \"aws-ebs-csi-driver-node-xp7nm\" (UID: \"f7cfbe65-8cb3-49e2-9d1a-2e4acee99955\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xp7nm" Jun 03 19:20:55.538923 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.538677 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f9120d61-aab1-47ff-8db1-29e1d2349729-node-log\") pod \"ovnkube-node-hxzmz\" (UID: \"f9120d61-aab1-47ff-8db1-29e1d2349729\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxzmz" Jun 03 19:20:55.538923 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.538713 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ce05c923-acba-430c-bcc1-576e5f7d1f33-serviceca\") pod \"node-ca-5czvc\" (UID: \"ce05c923-acba-430c-bcc1-576e5f7d1f33\") " pod="openshift-image-registry/node-ca-5czvc" Jun 03 19:20:55.538923 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.538765 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bbe34b9a-ec50-44cc-8203-e763426c06f0-lib-modules\") pod \"tuned-x7fzw\" (UID: \"bbe34b9a-ec50-44cc-8203-e763426c06f0\") " pod="openshift-cluster-node-tuning-operator/tuned-x7fzw" Jun 03 19:20:55.538923 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.538789 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bbe34b9a-ec50-44cc-8203-e763426c06f0-host\") pod \"tuned-x7fzw\" (UID: \"bbe34b9a-ec50-44cc-8203-e763426c06f0\") " pod="openshift-cluster-node-tuning-operator/tuned-x7fzw" Jun 03 19:20:55.538923 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.538823 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f9120d61-aab1-47ff-8db1-29e1d2349729-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hxzmz\" (UID: \"f9120d61-aab1-47ff-8db1-29e1d2349729\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxzmz" Jun 03 19:20:55.538923 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.538850 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7vls\" (UniqueName: \"kubernetes.io/projected/19ae3107-ba44-4cb7-9dad-e125e64323fa-kube-api-access-d7vls\") pod \"node-resolver-wq5fc\" (UID: \"19ae3107-ba44-4cb7-9dad-e125e64323fa\") " pod="openshift-dns/node-resolver-wq5fc" Jun 03 19:20:55.538923 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.538883 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fd082ce0-248b-4e84-997c-cde24967cf01-host-run-netns\") pod \"multus-tlvhh\" (UID: \"fd082ce0-248b-4e84-997c-cde24967cf01\") " pod="openshift-multus/multus-tlvhh" Jun 03 19:20:55.538923 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.538916 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f7cfbe65-8cb3-49e2-9d1a-2e4acee99955-registration-dir\") pod \"aws-ebs-csi-driver-node-xp7nm\" (UID: \"f7cfbe65-8cb3-49e2-9d1a-2e4acee99955\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xp7nm" Jun 03 19:20:55.539583 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.538948 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f9120d61-aab1-47ff-8db1-29e1d2349729-host-run-netns\") pod \"ovnkube-node-hxzmz\" (UID: \"f9120d61-aab1-47ff-8db1-29e1d2349729\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxzmz" Jun 03 19:20:55.539583 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.539007 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/19ae3107-ba44-4cb7-9dad-e125e64323fa-tmp-dir\") pod \"node-resolver-wq5fc\" (UID: \"19ae3107-ba44-4cb7-9dad-e125e64323fa\") " pod="openshift-dns/node-resolver-wq5fc" Jun 03 19:20:55.539583 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.539050 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fd082ce0-248b-4e84-997c-cde24967cf01-cni-binary-copy\") pod \"multus-tlvhh\" (UID: \"fd082ce0-248b-4e84-997c-cde24967cf01\") " pod="openshift-multus/multus-tlvhh" Jun 03 19:20:55.539583 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.539092 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fd082ce0-248b-4e84-997c-cde24967cf01-host-var-lib-kubelet\") pod \"multus-tlvhh\" (UID: \"fd082ce0-248b-4e84-997c-cde24967cf01\") " pod="openshift-multus/multus-tlvhh" Jun 03 19:20:55.539583 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.539116 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b79abc02-ece3-4eaf-b4d8-e131f6e71f60-system-cni-dir\") pod \"multus-additional-cni-plugins-kjcwb\" (UID: \"b79abc02-ece3-4eaf-b4d8-e131f6e71f60\") " pod="openshift-multus/multus-additional-cni-plugins-kjcwb" Jun 03 19:20:55.539583 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.539144 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b79abc02-ece3-4eaf-b4d8-e131f6e71f60-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kjcwb\" (UID: \"b79abc02-ece3-4eaf-b4d8-e131f6e71f60\") " pod="openshift-multus/multus-additional-cni-plugins-kjcwb" Jun 03 19:20:55.539583 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.539185 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bbe34b9a-ec50-44cc-8203-e763426c06f0-etc-systemd\") pod \"tuned-x7fzw\" (UID: \"bbe34b9a-ec50-44cc-8203-e763426c06f0\") " pod="openshift-cluster-node-tuning-operator/tuned-x7fzw" Jun 03 19:20:55.539583 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.539218 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f9120d61-aab1-47ff-8db1-29e1d2349729-ovnkube-config\") pod \"ovnkube-node-hxzmz\" (UID: \"f9120d61-aab1-47ff-8db1-29e1d2349729\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxzmz" Jun 03 19:20:55.539583 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.539271 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f9120d61-aab1-47ff-8db1-29e1d2349729-ovn-node-metrics-cert\") pod \"ovnkube-node-hxzmz\" (UID: \"f9120d61-aab1-47ff-8db1-29e1d2349729\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxzmz" Jun 03 19:20:55.539583 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.539315 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b79abc02-ece3-4eaf-b4d8-e131f6e71f60-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kjcwb\" (UID: \"b79abc02-ece3-4eaf-b4d8-e131f6e71f60\") " pod="openshift-multus/multus-additional-cni-plugins-kjcwb" Jun 03 19:20:55.539583 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.539341 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bbe34b9a-ec50-44cc-8203-e763426c06f0-etc-modprobe-d\") pod \"tuned-x7fzw\" (UID: \"bbe34b9a-ec50-44cc-8203-e763426c06f0\") " pod="openshift-cluster-node-tuning-operator/tuned-x7fzw" Jun 03 19:20:55.539583 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.539385 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f9120d61-aab1-47ff-8db1-29e1d2349729-host-kubelet\") pod \"ovnkube-node-hxzmz\" (UID: \"f9120d61-aab1-47ff-8db1-29e1d2349729\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxzmz" Jun 03 19:20:55.539583 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.539410 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f9120d61-aab1-47ff-8db1-29e1d2349729-ovnkube-script-lib\") pod \"ovnkube-node-hxzmz\" (UID: \"f9120d61-aab1-47ff-8db1-29e1d2349729\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxzmz" Jun 03 19:20:55.539583 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.539449 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hp8m\" (UniqueName: \"kubernetes.io/projected/fd082ce0-248b-4e84-997c-cde24967cf01-kube-api-access-5hp8m\") pod \"multus-tlvhh\" (UID: \"fd082ce0-248b-4e84-997c-cde24967cf01\") " pod="openshift-multus/multus-tlvhh" Jun 03 19:20:55.539583 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.539474 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5f4ae72c-cf67-426b-af3e-9b2a27c9488c-kubelet-config\") pod \"global-pull-secret-syncer-cjz9d\" (UID: \"5f4ae72c-cf67-426b-af3e-9b2a27c9488c\") " pod="kube-system/global-pull-secret-syncer-cjz9d" Jun 03 19:20:55.539583 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.539495 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5f4ae72c-cf67-426b-af3e-9b2a27c9488c-dbus\") pod \"global-pull-secret-syncer-cjz9d\" (UID: \"5f4ae72c-cf67-426b-af3e-9b2a27c9488c\") " pod="kube-system/global-pull-secret-syncer-cjz9d" Jun 03 19:20:55.540261 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.539523 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fd082ce0-248b-4e84-997c-cde24967cf01-host-run-k8s-cni-cncf-io\") pod \"multus-tlvhh\" (UID: \"fd082ce0-248b-4e84-997c-cde24967cf01\") " pod="openshift-multus/multus-tlvhh" Jun 03 19:20:55.540261 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.539548 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fd082ce0-248b-4e84-997c-cde24967cf01-multus-daemon-config\") pod \"multus-tlvhh\" (UID: \"fd082ce0-248b-4e84-997c-cde24967cf01\") " pod="openshift-multus/multus-tlvhh" Jun 03 19:20:55.540261 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.539575 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b79abc02-ece3-4eaf-b4d8-e131f6e71f60-os-release\") pod \"multus-additional-cni-plugins-kjcwb\" (UID: \"b79abc02-ece3-4eaf-b4d8-e131f6e71f60\") " pod="openshift-multus/multus-additional-cni-plugins-kjcwb" Jun 03 19:20:55.540261 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.539595 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bbe34b9a-ec50-44cc-8203-e763426c06f0-etc-sysctl-d\") pod \"tuned-x7fzw\" (UID: \"bbe34b9a-ec50-44cc-8203-e763426c06f0\") " pod="openshift-cluster-node-tuning-operator/tuned-x7fzw" Jun 03 19:20:55.540261 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.539620 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f9120d61-aab1-47ff-8db1-29e1d2349729-host-run-ovn-kubernetes\") pod \"ovnkube-node-hxzmz\" (UID: \"f9120d61-aab1-47ff-8db1-29e1d2349729\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxzmz" Jun 03 19:20:55.540261 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.539656 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ce05c923-acba-430c-bcc1-576e5f7d1f33-host\") pod \"node-ca-5czvc\" (UID: \"ce05c923-acba-430c-bcc1-576e5f7d1f33\") " pod="openshift-image-registry/node-ca-5czvc" Jun 03 19:20:55.540261 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.539678 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b79abc02-ece3-4eaf-b4d8-e131f6e71f60-cnibin\") pod \"multus-additional-cni-plugins-kjcwb\" (UID: \"b79abc02-ece3-4eaf-b4d8-e131f6e71f60\") " pod="openshift-multus/multus-additional-cni-plugins-kjcwb" Jun 03 19:20:55.540261 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.539702 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b79abc02-ece3-4eaf-b4d8-e131f6e71f60-cni-binary-copy\") pod \"multus-additional-cni-plugins-kjcwb\" (UID: \"b79abc02-ece3-4eaf-b4d8-e131f6e71f60\") " pod="openshift-multus/multus-additional-cni-plugins-kjcwb" Jun 03 19:20:55.540261 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.539724 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f9120d61-aab1-47ff-8db1-29e1d2349729-run-systemd\") pod \"ovnkube-node-hxzmz\" (UID: \"f9120d61-aab1-47ff-8db1-29e1d2349729\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxzmz" Jun 03 19:20:55.540261 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.539749 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fd082ce0-248b-4e84-997c-cde24967cf01-cnibin\") pod \"multus-tlvhh\" (UID: \"fd082ce0-248b-4e84-997c-cde24967cf01\") " pod="openshift-multus/multus-tlvhh" Jun 03 19:20:55.540261 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.539778 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fd082ce0-248b-4e84-997c-cde24967cf01-multus-cni-dir\") pod \"multus-tlvhh\" (UID: \"fd082ce0-248b-4e84-997c-cde24967cf01\") " pod="openshift-multus/multus-tlvhh" Jun 03 19:20:55.540261 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.539800 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fd082ce0-248b-4e84-997c-cde24967cf01-host-var-lib-cni-multus\") pod \"multus-tlvhh\" (UID: \"fd082ce0-248b-4e84-997c-cde24967cf01\") " pod="openshift-multus/multus-tlvhh" Jun 03 19:20:55.540261 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.539827 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bbe34b9a-ec50-44cc-8203-e763426c06f0-etc-sysconfig\") pod \"tuned-x7fzw\" (UID: \"bbe34b9a-ec50-44cc-8203-e763426c06f0\") " pod="openshift-cluster-node-tuning-operator/tuned-x7fzw" Jun 03 19:20:55.546636 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.546604 2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 19:20:55.573895 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.573870 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-dk6v7" Jun 03 19:20:55.581908 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.581868 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-dk6v7" Jun 03 19:20:55.626490 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.626454 2579 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 03 19:20:55.640055 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.640014 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f9120d61-aab1-47ff-8db1-29e1d2349729-run-openvswitch\") pod \"ovnkube-node-hxzmz\" (UID: \"f9120d61-aab1-47ff-8db1-29e1d2349729\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxzmz" Jun 03 19:20:55.640055 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.640056 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fd082ce0-248b-4e84-997c-cde24967cf01-multus-conf-dir\") pod \"multus-tlvhh\" (UID: \"fd082ce0-248b-4e84-997c-cde24967cf01\") " pod="openshift-multus/multus-tlvhh" Jun 03 19:20:55.640335 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.640087 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b79abc02-ece3-4eaf-b4d8-e131f6e71f60-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kjcwb\" (UID: \"b79abc02-ece3-4eaf-b4d8-e131f6e71f60\") " pod="openshift-multus/multus-additional-cni-plugins-kjcwb" Jun 03 19:20:55.640335 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.640144 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zz72v\" (UniqueName: \"kubernetes.io/projected/b79abc02-ece3-4eaf-b4d8-e131f6e71f60-kube-api-access-zz72v\") pod \"multus-additional-cni-plugins-kjcwb\" (UID: \"b79abc02-ece3-4eaf-b4d8-e131f6e71f60\") " pod="openshift-multus/multus-additional-cni-plugins-kjcwb" Jun 03 19:20:55.640335 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.640137 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f9120d61-aab1-47ff-8db1-29e1d2349729-run-openvswitch\") pod \"ovnkube-node-hxzmz\" (UID: \"f9120d61-aab1-47ff-8db1-29e1d2349729\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxzmz" Jun 03 19:20:55.640335 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.640175 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bbe34b9a-ec50-44cc-8203-e763426c06f0-var-lib-kubelet\") pod \"tuned-x7fzw\" (UID: \"bbe34b9a-ec50-44cc-8203-e763426c06f0\") " pod="openshift-cluster-node-tuning-operator/tuned-x7fzw" Jun 03 19:20:55.640335 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.640200 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fd082ce0-248b-4e84-997c-cde24967cf01-multus-conf-dir\") pod \"multus-tlvhh\" (UID: \"fd082ce0-248b-4e84-997c-cde24967cf01\") " pod="openshift-multus/multus-tlvhh" Jun 03 19:20:55.640335 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.640206 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5xw4\" (UniqueName: \"kubernetes.io/projected/f9120d61-aab1-47ff-8db1-29e1d2349729-kube-api-access-g5xw4\") pod \"ovnkube-node-hxzmz\" (UID: \"f9120d61-aab1-47ff-8db1-29e1d2349729\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxzmz" Jun 03 19:20:55.640697 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.640353 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/851b1783-45c5-41bc-904e-b5d3085344d1-iptables-alerter-script\") pod \"iptables-alerter-692f4\" (UID: \"851b1783-45c5-41bc-904e-b5d3085344d1\") " pod="openshift-network-operator/iptables-alerter-692f4" Jun 03 19:20:55.640697 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.640419 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5f4ae72c-cf67-426b-af3e-9b2a27c9488c-original-pull-secret\") pod \"global-pull-secret-syncer-cjz9d\" (UID: \"5f4ae72c-cf67-426b-af3e-9b2a27c9488c\") " pod="kube-system/global-pull-secret-syncer-cjz9d" Jun 03 19:20:55.640697 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.640452 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fd082ce0-248b-4e84-997c-cde24967cf01-system-cni-dir\") pod \"multus-tlvhh\" (UID: \"fd082ce0-248b-4e84-997c-cde24967cf01\") " pod="openshift-multus/multus-tlvhh" Jun 03 19:20:55.640697 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.640483 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fd082ce0-248b-4e84-997c-cde24967cf01-etc-kubernetes\") pod \"multus-tlvhh\" (UID: \"fd082ce0-248b-4e84-997c-cde24967cf01\") " pod="openshift-multus/multus-tlvhh" Jun 03 19:20:55.640697 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.640574 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f7cfbe65-8cb3-49e2-9d1a-2e4acee99955-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xp7nm\" (UID: \"f7cfbe65-8cb3-49e2-9d1a-2e4acee99955\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xp7nm" Jun 03 19:20:55.640697 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.640604 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f9120d61-aab1-47ff-8db1-29e1d2349729-host-slash\") pod \"ovnkube-node-hxzmz\" (UID: \"f9120d61-aab1-47ff-8db1-29e1d2349729\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxzmz" Jun 03 19:20:55.640697 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.640629 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f9120d61-aab1-47ff-8db1-29e1d2349729-host-cni-netd\") pod \"ovnkube-node-hxzmz\" (UID: \"f9120d61-aab1-47ff-8db1-29e1d2349729\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxzmz" Jun 03 19:20:55.640697 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.640659 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f9120d61-aab1-47ff-8db1-29e1d2349729-env-overrides\") pod \"ovnkube-node-hxzmz\" (UID: \"f9120d61-aab1-47ff-8db1-29e1d2349729\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxzmz" Jun 03 19:20:55.640697 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.640691 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/19ae3107-ba44-4cb7-9dad-e125e64323fa-hosts-file\") pod \"node-resolver-wq5fc\" (UID: \"19ae3107-ba44-4cb7-9dad-e125e64323fa\") " pod="openshift-dns/node-resolver-wq5fc" Jun 03 19:20:55.641144 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.640714 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bbe34b9a-ec50-44cc-8203-e763426c06f0-etc-sysctl-conf\") pod \"tuned-x7fzw\" (UID: \"bbe34b9a-ec50-44cc-8203-e763426c06f0\") " pod="openshift-cluster-node-tuning-operator/tuned-x7fzw" Jun 03 19:20:55.641144 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.640761 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bbe34b9a-ec50-44cc-8203-e763426c06f0-sys\") pod \"tuned-x7fzw\" (UID: \"bbe34b9a-ec50-44cc-8203-e763426c06f0\") " pod="openshift-cluster-node-tuning-operator/tuned-x7fzw" Jun 03 19:20:55.641144 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.640785 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnfdj\" (UniqueName: \"kubernetes.io/projected/bbe34b9a-ec50-44cc-8203-e763426c06f0-kube-api-access-lnfdj\") pod \"tuned-x7fzw\" (UID: \"bbe34b9a-ec50-44cc-8203-e763426c06f0\") " pod="openshift-cluster-node-tuning-operator/tuned-x7fzw" Jun 03 19:20:55.641144 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.640791 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bbe34b9a-ec50-44cc-8203-e763426c06f0-var-lib-kubelet\") pod \"tuned-x7fzw\" (UID: \"bbe34b9a-ec50-44cc-8203-e763426c06f0\") " pod="openshift-cluster-node-tuning-operator/tuned-x7fzw" Jun 03 19:20:55.641144 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.640829 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f7cfbe65-8cb3-49e2-9d1a-2e4acee99955-sys-fs\") pod \"aws-ebs-csi-driver-node-xp7nm\" (UID: \"f7cfbe65-8cb3-49e2-9d1a-2e4acee99955\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xp7nm" Jun 03 19:20:55.641144 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.640850 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f9120d61-aab1-47ff-8db1-29e1d2349729-host-slash\") pod \"ovnkube-node-hxzmz\" (UID: \"f9120d61-aab1-47ff-8db1-29e1d2349729\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxzmz" Jun 03 19:20:55.641144 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.640875 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/19ae3107-ba44-4cb7-9dad-e125e64323fa-hosts-file\") pod \"node-resolver-wq5fc\" (UID: \"19ae3107-ba44-4cb7-9dad-e125e64323fa\") " pod="openshift-dns/node-resolver-wq5fc" Jun 03 19:20:55.641144 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.640862 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fd082ce0-248b-4e84-997c-cde24967cf01-multus-socket-dir-parent\") pod \"multus-tlvhh\" (UID: \"fd082ce0-248b-4e84-997c-cde24967cf01\") " pod="openshift-multus/multus-tlvhh" Jun 03 19:20:55.641144 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.640922 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fd082ce0-248b-4e84-997c-cde24967cf01-host-run-multus-certs\") pod \"multus-tlvhh\" (UID: \"fd082ce0-248b-4e84-997c-cde24967cf01\") " pod="openshift-multus/multus-tlvhh" Jun 03 19:20:55.641144 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.640944 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fd082ce0-248b-4e84-997c-cde24967cf01-host-var-lib-cni-bin\") pod \"multus-tlvhh\" (UID: \"fd082ce0-248b-4e84-997c-cde24967cf01\") " pod="openshift-multus/multus-tlvhh" Jun 03 19:20:55.641144 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.640986 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fd082ce0-248b-4e84-997c-cde24967cf01-hostroot\") pod \"multus-tlvhh\" (UID: \"fd082ce0-248b-4e84-997c-cde24967cf01\") " pod="openshift-multus/multus-tlvhh" Jun 03 19:20:55.641144 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.641022 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f7cfbe65-8cb3-49e2-9d1a-2e4acee99955-socket-dir\") pod \"aws-ebs-csi-driver-node-xp7nm\" (UID: \"f7cfbe65-8cb3-49e2-9d1a-2e4acee99955\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xp7nm" Jun 03 19:20:55.641144 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.641042 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bbe34b9a-ec50-44cc-8203-e763426c06f0-etc-sysctl-conf\") pod \"tuned-x7fzw\" (UID: \"bbe34b9a-ec50-44cc-8203-e763426c06f0\") " pod="openshift-cluster-node-tuning-operator/tuned-x7fzw" Jun 03 19:20:55.641144 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.641050 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f9120d61-aab1-47ff-8db1-29e1d2349729-host-cni-bin\") pod \"ovnkube-node-hxzmz\" (UID: \"f9120d61-aab1-47ff-8db1-29e1d2349729\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxzmz" Jun 03 19:20:55.641144 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.641076 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmsjb\" (UniqueName: \"kubernetes.io/projected/ce05c923-acba-430c-bcc1-576e5f7d1f33-kube-api-access-jmsjb\") pod \"node-ca-5czvc\" (UID: \"ce05c923-acba-430c-bcc1-576e5f7d1f33\") " pod="openshift-image-registry/node-ca-5czvc" Jun 03 19:20:55.641144 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.641102 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xhzx\" (UniqueName: \"kubernetes.io/projected/f7cfbe65-8cb3-49e2-9d1a-2e4acee99955-kube-api-access-9xhzx\") pod \"aws-ebs-csi-driver-node-xp7nm\" (UID: \"f7cfbe65-8cb3-49e2-9d1a-2e4acee99955\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xp7nm" Jun 03 19:20:55.641144 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.641152 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f9120d61-aab1-47ff-8db1-29e1d2349729-etc-openvswitch\") pod \"ovnkube-node-hxzmz\" (UID: \"f9120d61-aab1-47ff-8db1-29e1d2349729\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxzmz" Jun 03 19:20:55.641926 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.641157 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fd082ce0-248b-4e84-997c-cde24967cf01-hostroot\") pod \"multus-tlvhh\" (UID: \"fd082ce0-248b-4e84-997c-cde24967cf01\") " pod="openshift-multus/multus-tlvhh" Jun 03 19:20:55.641926 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.641177 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fd082ce0-248b-4e84-997c-cde24967cf01-os-release\") pod \"multus-tlvhh\" (UID: \"fd082ce0-248b-4e84-997c-cde24967cf01\") " pod="openshift-multus/multus-tlvhh" Jun 03 19:20:55.641926 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.641163 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fd082ce0-248b-4e84-997c-cde24967cf01-multus-socket-dir-parent\") pod \"multus-tlvhh\" (UID: \"fd082ce0-248b-4e84-997c-cde24967cf01\") " pod="openshift-multus/multus-tlvhh" Jun 03 19:20:55.641926 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.641201 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bbe34b9a-ec50-44cc-8203-e763426c06f0-sys\") pod \"tuned-x7fzw\" (UID: \"bbe34b9a-ec50-44cc-8203-e763426c06f0\") " pod="openshift-cluster-node-tuning-operator/tuned-x7fzw" Jun 03 19:20:55.641926 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.641209 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fd082ce0-248b-4e84-997c-cde24967cf01-etc-kubernetes\") pod \"multus-tlvhh\" (UID: \"fd082ce0-248b-4e84-997c-cde24967cf01\") " pod="openshift-multus/multus-tlvhh" Jun 03 19:20:55.641926 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.641222 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fd082ce0-248b-4e84-997c-cde24967cf01-host-run-multus-certs\") pod \"multus-tlvhh\" (UID: \"fd082ce0-248b-4e84-997c-cde24967cf01\") " pod="openshift-multus/multus-tlvhh" Jun 03 19:20:55.641926 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:20:55.641122 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 19:20:55.641926 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.641234 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f7cfbe65-8cb3-49e2-9d1a-2e4acee99955-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xp7nm\" (UID: \"f7cfbe65-8cb3-49e2-9d1a-2e4acee99955\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xp7nm" Jun 03 19:20:55.641926 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.641256 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fd082ce0-248b-4e84-997c-cde24967cf01-host-var-lib-cni-bin\") pod \"multus-tlvhh\" (UID: \"fd082ce0-248b-4e84-997c-cde24967cf01\") " pod="openshift-multus/multus-tlvhh" Jun 03 19:20:55.641926 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.641280 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f9120d61-aab1-47ff-8db1-29e1d2349729-etc-openvswitch\") pod \"ovnkube-node-hxzmz\" (UID: \"f9120d61-aab1-47ff-8db1-29e1d2349729\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxzmz" Jun 03 19:20:55.641926 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.641277 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f9120d61-aab1-47ff-8db1-29e1d2349729-host-cni-bin\") pod \"ovnkube-node-hxzmz\" (UID: \"f9120d61-aab1-47ff-8db1-29e1d2349729\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxzmz" Jun 03 19:20:55.641926 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.641220 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bbe34b9a-ec50-44cc-8203-e763426c06f0-run\") pod \"tuned-x7fzw\" (UID: \"bbe34b9a-ec50-44cc-8203-e763426c06f0\") " pod="openshift-cluster-node-tuning-operator/tuned-x7fzw" Jun 03 19:20:55.641926 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.641348 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bbe34b9a-ec50-44cc-8203-e763426c06f0-etc-tuned\") pod \"tuned-x7fzw\" (UID: \"bbe34b9a-ec50-44cc-8203-e763426c06f0\") " pod="openshift-cluster-node-tuning-operator/tuned-x7fzw" Jun 03 19:20:55.641926 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.641378 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f7cfbe65-8cb3-49e2-9d1a-2e4acee99955-etc-selinux\") pod \"aws-ebs-csi-driver-node-xp7nm\" (UID: \"f7cfbe65-8cb3-49e2-9d1a-2e4acee99955\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xp7nm" Jun 03 19:20:55.641926 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.641391 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f7cfbe65-8cb3-49e2-9d1a-2e4acee99955-sys-fs\") pod \"aws-ebs-csi-driver-node-xp7nm\" (UID: \"f7cfbe65-8cb3-49e2-9d1a-2e4acee99955\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xp7nm" Jun 03 19:20:55.641926 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.641399 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fd082ce0-248b-4e84-997c-cde24967cf01-system-cni-dir\") pod \"multus-tlvhh\" (UID: \"fd082ce0-248b-4e84-997c-cde24967cf01\") " pod="openshift-multus/multus-tlvhh" Jun 03 19:20:55.641926 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.641437 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f9120d61-aab1-47ff-8db1-29e1d2349729-host-cni-netd\") pod \"ovnkube-node-hxzmz\" (UID: \"f9120d61-aab1-47ff-8db1-29e1d2349729\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxzmz" Jun 03 19:20:55.641926 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.641408 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f9120d61-aab1-47ff-8db1-29e1d2349729-node-log\") pod \"ovnkube-node-hxzmz\" (UID: \"f9120d61-aab1-47ff-8db1-29e1d2349729\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxzmz" Jun 03 19:20:55.641926 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.641453 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fd082ce0-248b-4e84-997c-cde24967cf01-os-release\") pod \"multus-tlvhh\" (UID: \"fd082ce0-248b-4e84-997c-cde24967cf01\") " pod="openshift-multus/multus-tlvhh" Jun 03 19:20:55.642585 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.641440 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b79abc02-ece3-4eaf-b4d8-e131f6e71f60-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kjcwb\" (UID: \"b79abc02-ece3-4eaf-b4d8-e131f6e71f60\") " pod="openshift-multus/multus-additional-cni-plugins-kjcwb" Jun 03 19:20:55.642585 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.641484 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ce05c923-acba-430c-bcc1-576e5f7d1f33-serviceca\") pod \"node-ca-5czvc\" (UID: \"ce05c923-acba-430c-bcc1-576e5f7d1f33\") " pod="openshift-image-registry/node-ca-5czvc" Jun 03 19:20:55.642585 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.641507 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bbe34b9a-ec50-44cc-8203-e763426c06f0-run\") pod \"tuned-x7fzw\" (UID: \"bbe34b9a-ec50-44cc-8203-e763426c06f0\") " pod="openshift-cluster-node-tuning-operator/tuned-x7fzw" Jun 03 19:20:55.642585 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.641526 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f7cfbe65-8cb3-49e2-9d1a-2e4acee99955-socket-dir\") pod \"aws-ebs-csi-driver-node-xp7nm\" (UID: \"f7cfbe65-8cb3-49e2-9d1a-2e4acee99955\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xp7nm" Jun 03 19:20:55.642585 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.641537 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bbe34b9a-ec50-44cc-8203-e763426c06f0-lib-modules\") pod \"tuned-x7fzw\" (UID: \"bbe34b9a-ec50-44cc-8203-e763426c06f0\") " pod="openshift-cluster-node-tuning-operator/tuned-x7fzw" Jun 03 19:20:55.642585 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.641577 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f9120d61-aab1-47ff-8db1-29e1d2349729-node-log\") pod \"ovnkube-node-hxzmz\" (UID: \"f9120d61-aab1-47ff-8db1-29e1d2349729\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxzmz" Jun 03 19:20:55.642585 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.641591 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f7cfbe65-8cb3-49e2-9d1a-2e4acee99955-etc-selinux\") pod \"aws-ebs-csi-driver-node-xp7nm\" (UID: \"f7cfbe65-8cb3-49e2-9d1a-2e4acee99955\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xp7nm" Jun 03 19:20:55.642585 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.641656 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bbe34b9a-ec50-44cc-8203-e763426c06f0-host\") pod \"tuned-x7fzw\" (UID: \"bbe34b9a-ec50-44cc-8203-e763426c06f0\") " pod="openshift-cluster-node-tuning-operator/tuned-x7fzw" Jun 03 19:20:55.642585 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:20:55.641696 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f4ae72c-cf67-426b-af3e-9b2a27c9488c-original-pull-secret podName:5f4ae72c-cf67-426b-af3e-9b2a27c9488c nodeName:}" failed. No retries permitted until 2026-06-03 19:20:56.14167206 +0000 UTC m=+2.987331454 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5f4ae72c-cf67-426b-af3e-9b2a27c9488c-original-pull-secret") pod "global-pull-secret-syncer-cjz9d" (UID: "5f4ae72c-cf67-426b-af3e-9b2a27c9488c") : object "kube-system"/"original-pull-secret" not registered Jun 03 19:20:55.642585 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.641714 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bbe34b9a-ec50-44cc-8203-e763426c06f0-host\") pod \"tuned-x7fzw\" (UID: \"bbe34b9a-ec50-44cc-8203-e763426c06f0\") " pod="openshift-cluster-node-tuning-operator/tuned-x7fzw" Jun 03 19:20:55.642585 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.641726 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f9120d61-aab1-47ff-8db1-29e1d2349729-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hxzmz\" (UID: \"f9120d61-aab1-47ff-8db1-29e1d2349729\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxzmz" Jun 03 19:20:55.642585 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.641758 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7vls\" (UniqueName: \"kubernetes.io/projected/19ae3107-ba44-4cb7-9dad-e125e64323fa-kube-api-access-d7vls\") pod \"node-resolver-wq5fc\" (UID: \"19ae3107-ba44-4cb7-9dad-e125e64323fa\") " pod="openshift-dns/node-resolver-wq5fc" Jun 03 19:20:55.642585 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.641772 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bbe34b9a-ec50-44cc-8203-e763426c06f0-lib-modules\") pod \"tuned-x7fzw\" (UID: \"bbe34b9a-ec50-44cc-8203-e763426c06f0\") " pod="openshift-cluster-node-tuning-operator/tuned-x7fzw" Jun 03 19:20:55.642585 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.641782 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fd082ce0-248b-4e84-997c-cde24967cf01-host-run-netns\") pod \"multus-tlvhh\" (UID: \"fd082ce0-248b-4e84-997c-cde24967cf01\") " pod="openshift-multus/multus-tlvhh" Jun 03 19:20:55.642585 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.641821 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f9120d61-aab1-47ff-8db1-29e1d2349729-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hxzmz\" (UID: \"f9120d61-aab1-47ff-8db1-29e1d2349729\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxzmz" Jun 03 19:20:55.642585 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.641874 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fd082ce0-248b-4e84-997c-cde24967cf01-host-run-netns\") pod \"multus-tlvhh\" (UID: \"fd082ce0-248b-4e84-997c-cde24967cf01\") " pod="openshift-multus/multus-tlvhh" Jun 03 19:20:55.642585 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.641772 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f9120d61-aab1-47ff-8db1-29e1d2349729-env-overrides\") pod \"ovnkube-node-hxzmz\" (UID: \"f9120d61-aab1-47ff-8db1-29e1d2349729\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxzmz" Jun 03 19:20:55.643327 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.641945 2579 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 03 19:20:55.643327 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.642008 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ce05c923-acba-430c-bcc1-576e5f7d1f33-serviceca\") pod \"node-ca-5czvc\" (UID: \"ce05c923-acba-430c-bcc1-576e5f7d1f33\") " pod="openshift-image-registry/node-ca-5czvc" Jun 03 19:20:55.643327 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.642014 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f7cfbe65-8cb3-49e2-9d1a-2e4acee99955-registration-dir\") pod \"aws-ebs-csi-driver-node-xp7nm\" (UID: \"f7cfbe65-8cb3-49e2-9d1a-2e4acee99955\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xp7nm" Jun 03 19:20:55.643327 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.641851 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f7cfbe65-8cb3-49e2-9d1a-2e4acee99955-registration-dir\") pod \"aws-ebs-csi-driver-node-xp7nm\" (UID: \"f7cfbe65-8cb3-49e2-9d1a-2e4acee99955\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xp7nm" Jun 03 19:20:55.643327 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.642813 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f9120d61-aab1-47ff-8db1-29e1d2349729-host-run-netns\") pod \"ovnkube-node-hxzmz\" (UID: \"f9120d61-aab1-47ff-8db1-29e1d2349729\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxzmz" Jun 03 19:20:55.643327 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.642856 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/19ae3107-ba44-4cb7-9dad-e125e64323fa-tmp-dir\") pod \"node-resolver-wq5fc\" (UID: \"19ae3107-ba44-4cb7-9dad-e125e64323fa\") " pod="openshift-dns/node-resolver-wq5fc" Jun 03 19:20:55.643327 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.642902 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fd082ce0-248b-4e84-997c-cde24967cf01-cni-binary-copy\") pod \"multus-tlvhh\" (UID: \"fd082ce0-248b-4e84-997c-cde24967cf01\") " pod="openshift-multus/multus-tlvhh" Jun 03 19:20:55.643327 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.642933 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fd082ce0-248b-4e84-997c-cde24967cf01-host-var-lib-kubelet\") pod \"multus-tlvhh\" (UID: \"fd082ce0-248b-4e84-997c-cde24967cf01\") " pod="openshift-multus/multus-tlvhh" Jun 03 19:20:55.643327 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.642959 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b79abc02-ece3-4eaf-b4d8-e131f6e71f60-system-cni-dir\") pod \"multus-additional-cni-plugins-kjcwb\" (UID: \"b79abc02-ece3-4eaf-b4d8-e131f6e71f60\") " pod="openshift-multus/multus-additional-cni-plugins-kjcwb" Jun 03 19:20:55.643327 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.642989 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b79abc02-ece3-4eaf-b4d8-e131f6e71f60-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kjcwb\" (UID: \"b79abc02-ece3-4eaf-b4d8-e131f6e71f60\") " pod="openshift-multus/multus-additional-cni-plugins-kjcwb" Jun 03 19:20:55.643327 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.642998 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f9120d61-aab1-47ff-8db1-29e1d2349729-host-run-netns\") pod \"ovnkube-node-hxzmz\" (UID: \"f9120d61-aab1-47ff-8db1-29e1d2349729\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxzmz" Jun 03 19:20:55.643327 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.643017 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bbe34b9a-ec50-44cc-8203-e763426c06f0-etc-systemd\") pod \"tuned-x7fzw\" (UID: \"bbe34b9a-ec50-44cc-8203-e763426c06f0\") " pod="openshift-cluster-node-tuning-operator/tuned-x7fzw" Jun 03 19:20:55.643327 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.643045 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f9120d61-aab1-47ff-8db1-29e1d2349729-ovnkube-config\") pod \"ovnkube-node-hxzmz\" (UID: \"f9120d61-aab1-47ff-8db1-29e1d2349729\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxzmz" Jun 03 19:20:55.643327 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.643070 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f9120d61-aab1-47ff-8db1-29e1d2349729-ovn-node-metrics-cert\") pod \"ovnkube-node-hxzmz\" (UID: \"f9120d61-aab1-47ff-8db1-29e1d2349729\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxzmz" Jun 03 19:20:55.643327 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.643093 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b79abc02-ece3-4eaf-b4d8-e131f6e71f60-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kjcwb\" (UID: \"b79abc02-ece3-4eaf-b4d8-e131f6e71f60\") " pod="openshift-multus/multus-additional-cni-plugins-kjcwb" Jun 03 19:20:55.643327 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.643118 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bbe34b9a-ec50-44cc-8203-e763426c06f0-etc-modprobe-d\") pod \"tuned-x7fzw\" (UID: \"bbe34b9a-ec50-44cc-8203-e763426c06f0\") " pod="openshift-cluster-node-tuning-operator/tuned-x7fzw" Jun 03 19:20:55.643327 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.643142 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f9120d61-aab1-47ff-8db1-29e1d2349729-host-kubelet\") pod \"ovnkube-node-hxzmz\" (UID: \"f9120d61-aab1-47ff-8db1-29e1d2349729\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxzmz" Jun 03 19:20:55.644121 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.643166 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f9120d61-aab1-47ff-8db1-29e1d2349729-ovnkube-script-lib\") pod \"ovnkube-node-hxzmz\" (UID: \"f9120d61-aab1-47ff-8db1-29e1d2349729\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxzmz" Jun 03 19:20:55.644121 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.643196 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7e0a45de-2b41-482b-a027-803833e40d55-konnectivity-ca\") pod \"konnectivity-agent-pgqqd\" (UID: \"7e0a45de-2b41-482b-a027-803833e40d55\") " pod="kube-system/konnectivity-agent-pgqqd" Jun 03 19:20:55.644121 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.643219 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hp8m\" (UniqueName: \"kubernetes.io/projected/fd082ce0-248b-4e84-997c-cde24967cf01-kube-api-access-5hp8m\") pod \"multus-tlvhh\" (UID: \"fd082ce0-248b-4e84-997c-cde24967cf01\") " pod="openshift-multus/multus-tlvhh" Jun 03 19:20:55.644121 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.643246 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5f4ae72c-cf67-426b-af3e-9b2a27c9488c-kubelet-config\") pod \"global-pull-secret-syncer-cjz9d\" (UID: \"5f4ae72c-cf67-426b-af3e-9b2a27c9488c\") " pod="kube-system/global-pull-secret-syncer-cjz9d" Jun 03 19:20:55.644121 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.643272 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5f4ae72c-cf67-426b-af3e-9b2a27c9488c-dbus\") pod \"global-pull-secret-syncer-cjz9d\" (UID: \"5f4ae72c-cf67-426b-af3e-9b2a27c9488c\") " pod="kube-system/global-pull-secret-syncer-cjz9d" Jun 03 19:20:55.644121 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.643272 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/19ae3107-ba44-4cb7-9dad-e125e64323fa-tmp-dir\") pod \"node-resolver-wq5fc\" (UID: \"19ae3107-ba44-4cb7-9dad-e125e64323fa\") " pod="openshift-dns/node-resolver-wq5fc" Jun 03 19:20:55.644121 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.643380 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bbe34b9a-ec50-44cc-8203-e763426c06f0-etc-systemd\") pod \"tuned-x7fzw\" (UID: \"bbe34b9a-ec50-44cc-8203-e763426c06f0\") " pod="openshift-cluster-node-tuning-operator/tuned-x7fzw" Jun 03 19:20:55.644121 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.643407 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fd082ce0-248b-4e84-997c-cde24967cf01-host-run-k8s-cni-cncf-io\") pod \"multus-tlvhh\" (UID: \"fd082ce0-248b-4e84-997c-cde24967cf01\") " pod="openshift-multus/multus-tlvhh" Jun 03 19:20:55.644121 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.643658 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b79abc02-ece3-4eaf-b4d8-e131f6e71f60-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kjcwb\" (UID: \"b79abc02-ece3-4eaf-b4d8-e131f6e71f60\") " pod="openshift-multus/multus-additional-cni-plugins-kjcwb" Jun 03 19:20:55.644121 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.643658 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fd082ce0-248b-4e84-997c-cde24967cf01-cni-binary-copy\") pod \"multus-tlvhh\" (UID: \"fd082ce0-248b-4e84-997c-cde24967cf01\") " pod="openshift-multus/multus-tlvhh" Jun 03 19:20:55.644121 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.643741 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b79abc02-ece3-4eaf-b4d8-e131f6e71f60-system-cni-dir\") pod \"multus-additional-cni-plugins-kjcwb\" (UID: \"b79abc02-ece3-4eaf-b4d8-e131f6e71f60\") " pod="openshift-multus/multus-additional-cni-plugins-kjcwb" Jun 03 19:20:55.644121 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.643752 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fd082ce0-248b-4e84-997c-cde24967cf01-host-var-lib-kubelet\") pod \"multus-tlvhh\" (UID: \"fd082ce0-248b-4e84-997c-cde24967cf01\") " pod="openshift-multus/multus-tlvhh" Jun 03 19:20:55.644121 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.643893 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bbe34b9a-ec50-44cc-8203-e763426c06f0-etc-modprobe-d\") pod \"tuned-x7fzw\" (UID: \"bbe34b9a-ec50-44cc-8203-e763426c06f0\") " pod="openshift-cluster-node-tuning-operator/tuned-x7fzw" Jun 03 19:20:55.644121 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.643963 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f9120d61-aab1-47ff-8db1-29e1d2349729-ovnkube-config\") pod \"ovnkube-node-hxzmz\" (UID: \"f9120d61-aab1-47ff-8db1-29e1d2349729\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxzmz" Jun 03 19:20:55.644121 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.644033 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f9120d61-aab1-47ff-8db1-29e1d2349729-host-kubelet\") pod \"ovnkube-node-hxzmz\" (UID: \"f9120d61-aab1-47ff-8db1-29e1d2349729\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxzmz" Jun 03 19:20:55.644121 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.644094 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b79abc02-ece3-4eaf-b4d8-e131f6e71f60-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kjcwb\" (UID: \"b79abc02-ece3-4eaf-b4d8-e131f6e71f60\") " pod="openshift-multus/multus-additional-cni-plugins-kjcwb" Jun 03 19:20:55.644913 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.644223 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5f4ae72c-cf67-426b-af3e-9b2a27c9488c-kubelet-config\") pod \"global-pull-secret-syncer-cjz9d\" (UID: \"5f4ae72c-cf67-426b-af3e-9b2a27c9488c\") " pod="kube-system/global-pull-secret-syncer-cjz9d" Jun 03 19:20:55.644913 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.644272 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f9120d61-aab1-47ff-8db1-29e1d2349729-ovnkube-script-lib\") pod \"ovnkube-node-hxzmz\" (UID: \"f9120d61-aab1-47ff-8db1-29e1d2349729\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxzmz" Jun 03 19:20:55.644913 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.644331 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5f4ae72c-cf67-426b-af3e-9b2a27c9488c-dbus\") pod \"global-pull-secret-syncer-cjz9d\" (UID: \"5f4ae72c-cf67-426b-af3e-9b2a27c9488c\") " pod="kube-system/global-pull-secret-syncer-cjz9d" Jun 03 19:20:55.644913 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.644386 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fd082ce0-248b-4e84-997c-cde24967cf01-host-run-k8s-cni-cncf-io\") pod \"multus-tlvhh\" (UID: \"fd082ce0-248b-4e84-997c-cde24967cf01\") " pod="openshift-multus/multus-tlvhh" Jun 03 19:20:55.644913 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.644455 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fd082ce0-248b-4e84-997c-cde24967cf01-multus-daemon-config\") pod \"multus-tlvhh\" (UID: \"fd082ce0-248b-4e84-997c-cde24967cf01\") " pod="openshift-multus/multus-tlvhh" Jun 03 19:20:55.644913 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.644601 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b79abc02-ece3-4eaf-b4d8-e131f6e71f60-os-release\") pod \"multus-additional-cni-plugins-kjcwb\" (UID: \"b79abc02-ece3-4eaf-b4d8-e131f6e71f60\") " pod="openshift-multus/multus-additional-cni-plugins-kjcwb" Jun 03 19:20:55.645274 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.645098 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fd082ce0-248b-4e84-997c-cde24967cf01-multus-daemon-config\") pod \"multus-tlvhh\" (UID: \"fd082ce0-248b-4e84-997c-cde24967cf01\") " pod="openshift-multus/multus-tlvhh" Jun 03 19:20:55.645274 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.645262 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b79abc02-ece3-4eaf-b4d8-e131f6e71f60-os-release\") pod \"multus-additional-cni-plugins-kjcwb\" (UID: \"b79abc02-ece3-4eaf-b4d8-e131f6e71f60\") " pod="openshift-multus/multus-additional-cni-plugins-kjcwb" Jun 03 19:20:55.647832 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.645484 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bbe34b9a-ec50-44cc-8203-e763426c06f0-etc-sysctl-d\") pod \"tuned-x7fzw\" (UID: \"bbe34b9a-ec50-44cc-8203-e763426c06f0\") " pod="openshift-cluster-node-tuning-operator/tuned-x7fzw" Jun 03 19:20:55.647832 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.646304 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bbe34b9a-ec50-44cc-8203-e763426c06f0-etc-sysctl-d\") pod \"tuned-x7fzw\" (UID: \"bbe34b9a-ec50-44cc-8203-e763426c06f0\") " pod="openshift-cluster-node-tuning-operator/tuned-x7fzw" Jun 03 19:20:55.647832 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.646384 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f9120d61-aab1-47ff-8db1-29e1d2349729-host-run-ovn-kubernetes\") pod \"ovnkube-node-hxzmz\" (UID: \"f9120d61-aab1-47ff-8db1-29e1d2349729\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxzmz" Jun 03 19:20:55.647832 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.646414 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ce05c923-acba-430c-bcc1-576e5f7d1f33-host\") pod \"node-ca-5czvc\" (UID: \"ce05c923-acba-430c-bcc1-576e5f7d1f33\") " pod="openshift-image-registry/node-ca-5czvc" Jun 03 19:20:55.647832 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.646484 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b79abc02-ece3-4eaf-b4d8-e131f6e71f60-cnibin\") pod \"multus-additional-cni-plugins-kjcwb\" (UID: \"b79abc02-ece3-4eaf-b4d8-e131f6e71f60\") " pod="openshift-multus/multus-additional-cni-plugins-kjcwb" Jun 03 19:20:55.647832 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.646556 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b79abc02-ece3-4eaf-b4d8-e131f6e71f60-cni-binary-copy\") pod \"multus-additional-cni-plugins-kjcwb\" (UID: \"b79abc02-ece3-4eaf-b4d8-e131f6e71f60\") " pod="openshift-multus/multus-additional-cni-plugins-kjcwb" Jun 03 19:20:55.647832 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.646588 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f9120d61-aab1-47ff-8db1-29e1d2349729-run-systemd\") pod \"ovnkube-node-hxzmz\" (UID: \"f9120d61-aab1-47ff-8db1-29e1d2349729\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxzmz" Jun 03 19:20:55.647832 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.646636 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fd082ce0-248b-4e84-997c-cde24967cf01-cnibin\") pod \"multus-tlvhh\" (UID: \"fd082ce0-248b-4e84-997c-cde24967cf01\") " pod="openshift-multus/multus-tlvhh" Jun 03 19:20:55.647832 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.646728 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fd082ce0-248b-4e84-997c-cde24967cf01-multus-cni-dir\") pod \"multus-tlvhh\" (UID: \"fd082ce0-248b-4e84-997c-cde24967cf01\") " pod="openshift-multus/multus-tlvhh" Jun 03 19:20:55.647832 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.646809 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fd082ce0-248b-4e84-997c-cde24967cf01-host-var-lib-cni-multus\") pod \"multus-tlvhh\" (UID: \"fd082ce0-248b-4e84-997c-cde24967cf01\") " pod="openshift-multus/multus-tlvhh" Jun 03 19:20:55.647832 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.646861 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bbe34b9a-ec50-44cc-8203-e763426c06f0-etc-sysconfig\") pod \"tuned-x7fzw\" (UID: \"bbe34b9a-ec50-44cc-8203-e763426c06f0\") " pod="openshift-cluster-node-tuning-operator/tuned-x7fzw" Jun 03 19:20:55.647832 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.646892 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bbe34b9a-ec50-44cc-8203-e763426c06f0-etc-kubernetes\") pod \"tuned-x7fzw\" (UID: \"bbe34b9a-ec50-44cc-8203-e763426c06f0\") " pod="openshift-cluster-node-tuning-operator/tuned-x7fzw" Jun 03 19:20:55.647832 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.646983 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bbe34b9a-ec50-44cc-8203-e763426c06f0-tmp\") pod \"tuned-x7fzw\" (UID: \"bbe34b9a-ec50-44cc-8203-e763426c06f0\") " pod="openshift-cluster-node-tuning-operator/tuned-x7fzw" Jun 03 19:20:55.647832 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.647127 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f9120d61-aab1-47ff-8db1-29e1d2349729-var-lib-openvswitch\") pod \"ovnkube-node-hxzmz\" (UID: \"f9120d61-aab1-47ff-8db1-29e1d2349729\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxzmz" Jun 03 19:20:55.647832 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.647180 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f9120d61-aab1-47ff-8db1-29e1d2349729-run-ovn\") pod \"ovnkube-node-hxzmz\" (UID: \"f9120d61-aab1-47ff-8db1-29e1d2349729\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxzmz" Jun 03 19:20:55.647832 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.647330 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7rgc\" (UniqueName: \"kubernetes.io/projected/54761057-2346-4f57-9c39-5020ac09c153-kube-api-access-m7rgc\") pod \"network-check-target-4zhtx\" (UID: \"54761057-2346-4f57-9c39-5020ac09c153\") " pod="openshift-network-diagnostics/network-check-target-4zhtx" Jun 03 19:20:55.647832 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.647455 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e0ed8e87-e724-4880-a4e8-fe68533db02a-metrics-certs\") pod \"network-metrics-daemon-xpvdz\" (UID: \"e0ed8e87-e724-4880-a4e8-fe68533db02a\") " pod="openshift-multus/network-metrics-daemon-xpvdz" Jun 03 19:20:55.648711 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.647532 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56rz2\" (UniqueName: \"kubernetes.io/projected/e0ed8e87-e724-4880-a4e8-fe68533db02a-kube-api-access-56rz2\") pod \"network-metrics-daemon-xpvdz\" (UID: \"e0ed8e87-e724-4880-a4e8-fe68533db02a\") " pod="openshift-multus/network-metrics-daemon-xpvdz" Jun 03 19:20:55.648711 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.647577 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f9120d61-aab1-47ff-8db1-29e1d2349729-log-socket\") pod \"ovnkube-node-hxzmz\" (UID: \"f9120d61-aab1-47ff-8db1-29e1d2349729\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxzmz" Jun 03 19:20:55.648711 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.647613 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f9120d61-aab1-47ff-8db1-29e1d2349729-host-run-ovn-kubernetes\") pod \"ovnkube-node-hxzmz\" (UID: \"f9120d61-aab1-47ff-8db1-29e1d2349729\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxzmz" Jun 03 19:20:55.648711 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.647615 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/851b1783-45c5-41bc-904e-b5d3085344d1-host-slash\") pod \"iptables-alerter-692f4\" (UID: \"851b1783-45c5-41bc-904e-b5d3085344d1\") " pod="openshift-network-operator/iptables-alerter-692f4" Jun 03 19:20:55.648711 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.647681 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqk48\" (UniqueName: \"kubernetes.io/projected/851b1783-45c5-41bc-904e-b5d3085344d1-kube-api-access-vqk48\") pod \"iptables-alerter-692f4\" (UID: \"851b1783-45c5-41bc-904e-b5d3085344d1\") " pod="openshift-network-operator/iptables-alerter-692f4" Jun 03 19:20:55.648711 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.647709 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7e0a45de-2b41-482b-a027-803833e40d55-agent-certs\") pod \"konnectivity-agent-pgqqd\" (UID: \"7e0a45de-2b41-482b-a027-803833e40d55\") " pod="kube-system/konnectivity-agent-pgqqd" Jun 03 19:20:55.648711 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:20:55.647741 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:20:55.648711 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.647795 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f7cfbe65-8cb3-49e2-9d1a-2e4acee99955-device-dir\") pod \"aws-ebs-csi-driver-node-xp7nm\" (UID: \"f7cfbe65-8cb3-49e2-9d1a-2e4acee99955\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xp7nm" Jun 03 19:20:55.648711 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:20:55.647823 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0ed8e87-e724-4880-a4e8-fe68533db02a-metrics-certs podName:e0ed8e87-e724-4880-a4e8-fe68533db02a nodeName:}" failed. No retries permitted until 2026-06-03 19:20:56.147780794 +0000 UTC m=+2.993440202 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e0ed8e87-e724-4880-a4e8-fe68533db02a-metrics-certs") pod "network-metrics-daemon-xpvdz" (UID: "e0ed8e87-e724-4880-a4e8-fe68533db02a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:20:55.648711 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.647849 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ce05c923-acba-430c-bcc1-576e5f7d1f33-host\") pod \"node-ca-5czvc\" (UID: \"ce05c923-acba-430c-bcc1-576e5f7d1f33\") " pod="openshift-image-registry/node-ca-5czvc" Jun 03 19:20:55.648711 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.647914 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fd082ce0-248b-4e84-997c-cde24967cf01-cnibin\") pod \"multus-tlvhh\" (UID: \"fd082ce0-248b-4e84-997c-cde24967cf01\") " pod="openshift-multus/multus-tlvhh" Jun 03 19:20:55.648711 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.648149 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bbe34b9a-ec50-44cc-8203-e763426c06f0-etc-kubernetes\") pod \"tuned-x7fzw\" (UID: \"bbe34b9a-ec50-44cc-8203-e763426c06f0\") " pod="openshift-cluster-node-tuning-operator/tuned-x7fzw" Jun 03 19:20:55.648711 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.648154 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fd082ce0-248b-4e84-997c-cde24967cf01-multus-cni-dir\") pod \"multus-tlvhh\" (UID: \"fd082ce0-248b-4e84-997c-cde24967cf01\") " pod="openshift-multus/multus-tlvhh" Jun 03 19:20:55.648711 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.648253 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f9120d61-aab1-47ff-8db1-29e1d2349729-run-systemd\") pod \"ovnkube-node-hxzmz\" (UID: \"f9120d61-aab1-47ff-8db1-29e1d2349729\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxzmz" Jun 03 19:20:55.648711 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.648334 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bbe34b9a-ec50-44cc-8203-e763426c06f0-etc-sysconfig\") pod \"tuned-x7fzw\" (UID: \"bbe34b9a-ec50-44cc-8203-e763426c06f0\") " pod="openshift-cluster-node-tuning-operator/tuned-x7fzw" Jun 03 19:20:55.648711 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.648393 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f9120d61-aab1-47ff-8db1-29e1d2349729-var-lib-openvswitch\") pod \"ovnkube-node-hxzmz\" (UID: \"f9120d61-aab1-47ff-8db1-29e1d2349729\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxzmz" Jun 03 19:20:55.648711 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.648487 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f9120d61-aab1-47ff-8db1-29e1d2349729-log-socket\") pod \"ovnkube-node-hxzmz\" (UID: \"f9120d61-aab1-47ff-8db1-29e1d2349729\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxzmz" Jun 03 19:20:55.649946 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.647742 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f7cfbe65-8cb3-49e2-9d1a-2e4acee99955-device-dir\") pod \"aws-ebs-csi-driver-node-xp7nm\" (UID: \"f7cfbe65-8cb3-49e2-9d1a-2e4acee99955\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xp7nm" Jun 03 19:20:55.649946 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.648744 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f9120d61-aab1-47ff-8db1-29e1d2349729-systemd-units\") pod \"ovnkube-node-hxzmz\" (UID: \"f9120d61-aab1-47ff-8db1-29e1d2349729\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxzmz" Jun 03 19:20:55.649946 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.648716 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fd082ce0-248b-4e84-997c-cde24967cf01-host-var-lib-cni-multus\") pod \"multus-tlvhh\" (UID: \"fd082ce0-248b-4e84-997c-cde24967cf01\") " pod="openshift-multus/multus-tlvhh" Jun 03 19:20:55.649946 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.648664 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b79abc02-ece3-4eaf-b4d8-e131f6e71f60-cnibin\") pod \"multus-additional-cni-plugins-kjcwb\" (UID: \"b79abc02-ece3-4eaf-b4d8-e131f6e71f60\") " pod="openshift-multus/multus-additional-cni-plugins-kjcwb" Jun 03 19:20:55.649946 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.648611 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f9120d61-aab1-47ff-8db1-29e1d2349729-run-ovn\") pod \"ovnkube-node-hxzmz\" (UID: \"f9120d61-aab1-47ff-8db1-29e1d2349729\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxzmz" Jun 03 19:20:55.649946 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.648862 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f9120d61-aab1-47ff-8db1-29e1d2349729-systemd-units\") pod \"ovnkube-node-hxzmz\" (UID: \"f9120d61-aab1-47ff-8db1-29e1d2349729\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxzmz" Jun 03 19:20:55.649946 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.649141 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b79abc02-ece3-4eaf-b4d8-e131f6e71f60-cni-binary-copy\") pod \"multus-additional-cni-plugins-kjcwb\" (UID: \"b79abc02-ece3-4eaf-b4d8-e131f6e71f60\") " pod="openshift-multus/multus-additional-cni-plugins-kjcwb" Jun 03 19:20:55.650814 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.650306 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f9120d61-aab1-47ff-8db1-29e1d2349729-ovn-node-metrics-cert\") pod \"ovnkube-node-hxzmz\" (UID: \"f9120d61-aab1-47ff-8db1-29e1d2349729\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxzmz" Jun 03 19:20:55.653895 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.653869 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmsjb\" (UniqueName: \"kubernetes.io/projected/ce05c923-acba-430c-bcc1-576e5f7d1f33-kube-api-access-jmsjb\") pod \"node-ca-5czvc\" (UID: \"ce05c923-acba-430c-bcc1-576e5f7d1f33\") " pod="openshift-image-registry/node-ca-5czvc" Jun 03 19:20:55.655221 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.655197 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7vls\" (UniqueName: \"kubernetes.io/projected/19ae3107-ba44-4cb7-9dad-e125e64323fa-kube-api-access-d7vls\") pod \"node-resolver-wq5fc\" (UID: \"19ae3107-ba44-4cb7-9dad-e125e64323fa\") " pod="openshift-dns/node-resolver-wq5fc" Jun 03 19:20:55.655701 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.655679 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5xw4\" (UniqueName: \"kubernetes.io/projected/f9120d61-aab1-47ff-8db1-29e1d2349729-kube-api-access-g5xw4\") pod \"ovnkube-node-hxzmz\" (UID: \"f9120d61-aab1-47ff-8db1-29e1d2349729\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxzmz" Jun 03 19:20:55.655861 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.655833 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zz72v\" (UniqueName: \"kubernetes.io/projected/b79abc02-ece3-4eaf-b4d8-e131f6e71f60-kube-api-access-zz72v\") pod \"multus-additional-cni-plugins-kjcwb\" (UID: \"b79abc02-ece3-4eaf-b4d8-e131f6e71f60\") " pod="openshift-multus/multus-additional-cni-plugins-kjcwb" Jun 03 19:20:55.656398 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:20:55.656377 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 19:20:55.656497 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:20:55.656402 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 19:20:55.656497 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:20:55.656416 2579 projected.go:196] Error preparing data for projected volume kube-api-access-m7rgc for pod openshift-network-diagnostics/network-check-target-4zhtx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:20:55.656497 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:20:55.656480 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/54761057-2346-4f57-9c39-5020ac09c153-kube-api-access-m7rgc podName:54761057-2346-4f57-9c39-5020ac09c153 nodeName:}" failed. No retries permitted until 2026-06-03 19:20:56.156460502 +0000 UTC m=+3.002119909 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-m7rgc" (UniqueName: "kubernetes.io/projected/54761057-2346-4f57-9c39-5020ac09c153-kube-api-access-m7rgc") pod "network-check-target-4zhtx" (UID: "54761057-2346-4f57-9c39-5020ac09c153") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:20:55.656670 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.656618 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xhzx\" (UniqueName: \"kubernetes.io/projected/f7cfbe65-8cb3-49e2-9d1a-2e4acee99955-kube-api-access-9xhzx\") pod \"aws-ebs-csi-driver-node-xp7nm\" (UID: \"f7cfbe65-8cb3-49e2-9d1a-2e4acee99955\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xp7nm" Jun 03 19:20:55.656742 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.656724 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-56rz2\" (UniqueName: \"kubernetes.io/projected/e0ed8e87-e724-4880-a4e8-fe68533db02a-kube-api-access-56rz2\") pod \"network-metrics-daemon-xpvdz\" (UID: \"e0ed8e87-e724-4880-a4e8-fe68533db02a\") " pod="openshift-multus/network-metrics-daemon-xpvdz" Jun 03 19:20:55.656799 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.656744 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hp8m\" (UniqueName: \"kubernetes.io/projected/fd082ce0-248b-4e84-997c-cde24967cf01-kube-api-access-5hp8m\") pod \"multus-tlvhh\" (UID: \"fd082ce0-248b-4e84-997c-cde24967cf01\") " pod="openshift-multus/multus-tlvhh" Jun 03 19:20:55.656912 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.656887 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bbe34b9a-ec50-44cc-8203-e763426c06f0-tmp\") pod \"tuned-x7fzw\" (UID: \"bbe34b9a-ec50-44cc-8203-e763426c06f0\") " pod="openshift-cluster-node-tuning-operator/tuned-x7fzw" Jun 03 19:20:55.657047 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.657025 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnfdj\" (UniqueName: \"kubernetes.io/projected/bbe34b9a-ec50-44cc-8203-e763426c06f0-kube-api-access-lnfdj\") pod \"tuned-x7fzw\" (UID: \"bbe34b9a-ec50-44cc-8203-e763426c06f0\") " pod="openshift-cluster-node-tuning-operator/tuned-x7fzw" Jun 03 19:20:55.657760 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.657737 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bbe34b9a-ec50-44cc-8203-e763426c06f0-etc-tuned\") pod \"tuned-x7fzw\" (UID: \"bbe34b9a-ec50-44cc-8203-e763426c06f0\") " pod="openshift-cluster-node-tuning-operator/tuned-x7fzw" Jun 03 19:20:55.750063 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.750026 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7e0a45de-2b41-482b-a027-803833e40d55-konnectivity-ca\") pod \"konnectivity-agent-pgqqd\" (UID: \"7e0a45de-2b41-482b-a027-803833e40d55\") " pod="kube-system/konnectivity-agent-pgqqd" Jun 03 19:20:55.750260 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.750098 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/851b1783-45c5-41bc-904e-b5d3085344d1-host-slash\") pod \"iptables-alerter-692f4\" (UID: \"851b1783-45c5-41bc-904e-b5d3085344d1\") " pod="openshift-network-operator/iptables-alerter-692f4" Jun 03 19:20:55.750260 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.750140 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqk48\" (UniqueName: \"kubernetes.io/projected/851b1783-45c5-41bc-904e-b5d3085344d1-kube-api-access-vqk48\") pod \"iptables-alerter-692f4\" (UID: \"851b1783-45c5-41bc-904e-b5d3085344d1\") " pod="openshift-network-operator/iptables-alerter-692f4" Jun 03 19:20:55.750260 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.750169 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7e0a45de-2b41-482b-a027-803833e40d55-agent-certs\") pod \"konnectivity-agent-pgqqd\" (UID: \"7e0a45de-2b41-482b-a027-803833e40d55\") " pod="kube-system/konnectivity-agent-pgqqd" Jun 03 19:20:55.750260 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.750206 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/851b1783-45c5-41bc-904e-b5d3085344d1-iptables-alerter-script\") pod \"iptables-alerter-692f4\" (UID: \"851b1783-45c5-41bc-904e-b5d3085344d1\") " pod="openshift-network-operator/iptables-alerter-692f4" Jun 03 19:20:55.750260 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.750231 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/851b1783-45c5-41bc-904e-b5d3085344d1-host-slash\") pod \"iptables-alerter-692f4\" (UID: \"851b1783-45c5-41bc-904e-b5d3085344d1\") " pod="openshift-network-operator/iptables-alerter-692f4" Jun 03 19:20:55.750702 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.750679 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7e0a45de-2b41-482b-a027-803833e40d55-konnectivity-ca\") pod \"konnectivity-agent-pgqqd\" (UID: \"7e0a45de-2b41-482b-a027-803833e40d55\") " pod="kube-system/konnectivity-agent-pgqqd" Jun 03 19:20:55.751405 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.751386 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/851b1783-45c5-41bc-904e-b5d3085344d1-iptables-alerter-script\") pod \"iptables-alerter-692f4\" (UID: \"851b1783-45c5-41bc-904e-b5d3085344d1\") " pod="openshift-network-operator/iptables-alerter-692f4" Jun 03 19:20:55.753594 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.753577 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7e0a45de-2b41-482b-a027-803833e40d55-agent-certs\") pod \"konnectivity-agent-pgqqd\" (UID: \"7e0a45de-2b41-482b-a027-803833e40d55\") " pod="kube-system/konnectivity-agent-pgqqd" Jun 03 19:20:55.761965 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.761894 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqk48\" (UniqueName: \"kubernetes.io/projected/851b1783-45c5-41bc-904e-b5d3085344d1-kube-api-access-vqk48\") pod \"iptables-alerter-692f4\" (UID: \"851b1783-45c5-41bc-904e-b5d3085344d1\") " pod="openshift-network-operator/iptables-alerter-692f4" Jun 03 19:20:55.827227 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.827184 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-x7fzw" Jun 03 19:20:55.836354 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.836322 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xp7nm" Jun 03 19:20:55.847606 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.847568 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hxzmz" Jun 03 19:20:55.852675 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.852646 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wq5fc" Jun 03 19:20:55.859425 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.859399 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tlvhh" Jun 03 19:20:55.865117 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.865085 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5czvc" Jun 03 19:20:55.871948 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.871917 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kjcwb" Jun 03 19:20:55.881891 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.881857 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-692f4" Jun 03 19:20:55.886669 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:55.886645 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pgqqd" Jun 03 19:20:56.060485 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:56.060401 2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 19:20:56.152480 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:56.152439 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e0ed8e87-e724-4880-a4e8-fe68533db02a-metrics-certs\") pod \"network-metrics-daemon-xpvdz\" (UID: \"e0ed8e87-e724-4880-a4e8-fe68533db02a\") " pod="openshift-multus/network-metrics-daemon-xpvdz" Jun 03 19:20:56.152672 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:56.152504 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5f4ae72c-cf67-426b-af3e-9b2a27c9488c-original-pull-secret\") pod \"global-pull-secret-syncer-cjz9d\" (UID: \"5f4ae72c-cf67-426b-af3e-9b2a27c9488c\") " pod="kube-system/global-pull-secret-syncer-cjz9d" Jun 03 19:20:56.152672 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:20:56.152581 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:20:56.152672 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:20:56.152613 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 19:20:56.152672 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:20:56.152659 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0ed8e87-e724-4880-a4e8-fe68533db02a-metrics-certs podName:e0ed8e87-e724-4880-a4e8-fe68533db02a nodeName:}" failed. No retries permitted until 2026-06-03 19:20:57.152638697 +0000 UTC m=+3.998298090 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e0ed8e87-e724-4880-a4e8-fe68533db02a-metrics-certs") pod "network-metrics-daemon-xpvdz" (UID: "e0ed8e87-e724-4880-a4e8-fe68533db02a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:20:56.152672 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:20:56.152673 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f4ae72c-cf67-426b-af3e-9b2a27c9488c-original-pull-secret podName:5f4ae72c-cf67-426b-af3e-9b2a27c9488c nodeName:}" failed. No retries permitted until 2026-06-03 19:20:57.15266744 +0000 UTC m=+3.998326834 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5f4ae72c-cf67-426b-af3e-9b2a27c9488c-original-pull-secret") pod "global-pull-secret-syncer-cjz9d" (UID: "5f4ae72c-cf67-426b-af3e-9b2a27c9488c") : object "kube-system"/"original-pull-secret" not registered Jun 03 19:20:56.253117 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:56.253081 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7rgc\" (UniqueName: \"kubernetes.io/projected/54761057-2346-4f57-9c39-5020ac09c153-kube-api-access-m7rgc\") pod \"network-check-target-4zhtx\" (UID: \"54761057-2346-4f57-9c39-5020ac09c153\") " pod="openshift-network-diagnostics/network-check-target-4zhtx" Jun 03 19:20:56.253343 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:20:56.253270 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 19:20:56.253343 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:20:56.253319 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 19:20:56.253343 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:20:56.253333 2579 projected.go:196] Error preparing data for projected volume kube-api-access-m7rgc for pod openshift-network-diagnostics/network-check-target-4zhtx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:20:56.253516 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:20:56.253399 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/54761057-2346-4f57-9c39-5020ac09c153-kube-api-access-m7rgc podName:54761057-2346-4f57-9c39-5020ac09c153 nodeName:}" failed. No retries permitted until 2026-06-03 19:20:57.253378667 +0000 UTC m=+4.099038074 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-m7rgc" (UniqueName: "kubernetes.io/projected/54761057-2346-4f57-9c39-5020ac09c153-kube-api-access-m7rgc") pod "network-check-target-4zhtx" (UID: "54761057-2346-4f57-9c39-5020ac09c153") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:20:56.541729 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:56.541696 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce05c923_acba_430c_bcc1_576e5f7d1f33.slice/crio-c15a7d5fbc0fb1a063f90e8a7a64a9cff4e23bdc355b4ede98dd313e301cc54b WatchSource:0}: Error finding container c15a7d5fbc0fb1a063f90e8a7a64a9cff4e23bdc355b4ede98dd313e301cc54b: Status 404 returned error can't find the container with id c15a7d5fbc0fb1a063f90e8a7a64a9cff4e23bdc355b4ede98dd313e301cc54b Jun 03 19:20:56.546354 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:56.546307 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e0a45de_2b41_482b_a027_803833e40d55.slice/crio-970bd840bd2030f785b59d179a51966e1d563ebd475ca344b143190e55adc311 WatchSource:0}: Error finding container 970bd840bd2030f785b59d179a51966e1d563ebd475ca344b143190e55adc311: Status 404 returned error can't find the container with id 970bd840bd2030f785b59d179a51966e1d563ebd475ca344b143190e55adc311 Jun 03 19:20:56.548444 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:56.548411 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9120d61_aab1_47ff_8db1_29e1d2349729.slice/crio-d8b9e3744bff1b441fb27e2e9a6fa1f55f17398ad022d6036271c2b4e0b23e1a WatchSource:0}: Error finding container d8b9e3744bff1b441fb27e2e9a6fa1f55f17398ad022d6036271c2b4e0b23e1a: Status 404 returned error can't find the container with id d8b9e3744bff1b441fb27e2e9a6fa1f55f17398ad022d6036271c2b4e0b23e1a Jun 03 19:20:56.549247 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:56.549177 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod851b1783_45c5_41bc_904e_b5d3085344d1.slice/crio-74a3955758e9d2af3517b18390620e9424bf9f3615fa1371e63a9e947121b005 WatchSource:0}: Error finding container 74a3955758e9d2af3517b18390620e9424bf9f3615fa1371e63a9e947121b005: Status 404 returned error can't find the container with id 74a3955758e9d2af3517b18390620e9424bf9f3615fa1371e63a9e947121b005 Jun 03 19:20:56.550673 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:56.550386 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb79abc02_ece3_4eaf_b4d8_e131f6e71f60.slice/crio-1cf921c977ad14eb4175f4bec3c6389b023d4acc1d2abbdb1449b93dd8c7a6d1 WatchSource:0}: Error finding container 1cf921c977ad14eb4175f4bec3c6389b023d4acc1d2abbdb1449b93dd8c7a6d1: Status 404 returned error can't find the container with id 1cf921c977ad14eb4175f4bec3c6389b023d4acc1d2abbdb1449b93dd8c7a6d1 Jun 03 19:20:56.551105 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:56.551083 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7cfbe65_8cb3_49e2_9d1a_2e4acee99955.slice/crio-5820bd19cba85468b04ce20e9e8c5a8e76e9766f5612769f839d9ef365eb2e5e WatchSource:0}: Error finding container 5820bd19cba85468b04ce20e9e8c5a8e76e9766f5612769f839d9ef365eb2e5e: Status 404 returned error can't find the container with id 5820bd19cba85468b04ce20e9e8c5a8e76e9766f5612769f839d9ef365eb2e5e Jun 03 19:20:56.552155 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:56.552132 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd082ce0_248b_4e84_997c_cde24967cf01.slice/crio-3d655097970f1f4f28dc9f7c228e9f2a9584e657885c8c5fb4ec1141a3666310 WatchSource:0}: Error finding container 3d655097970f1f4f28dc9f7c228e9f2a9584e657885c8c5fb4ec1141a3666310: Status 404 returned error can't find the container with id 3d655097970f1f4f28dc9f7c228e9f2a9584e657885c8c5fb4ec1141a3666310 Jun 03 19:20:56.553863 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:56.553775 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19ae3107_ba44_4cb7_9dad_e125e64323fa.slice/crio-4d546961ad65f9b2a4a6f7bba78050b12bc742de6555965ac991026c5154c435 WatchSource:0}: Error finding container 4d546961ad65f9b2a4a6f7bba78050b12bc742de6555965ac991026c5154c435: Status 404 returned error can't find the container with id 4d546961ad65f9b2a4a6f7bba78050b12bc742de6555965ac991026c5154c435 Jun 03 19:20:56.556140 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:20:56.556118 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbe34b9a_ec50_44cc_8203_e763426c06f0.slice/crio-a262d3e0103564d52b95e32abcbbc9d105948bb97a184906e7755bd60b12c95a WatchSource:0}: Error finding container a262d3e0103564d52b95e32abcbbc9d105948bb97a184906e7755bd60b12c95a: Status 404 returned error can't find the container with id a262d3e0103564d52b95e32abcbbc9d105948bb97a184906e7755bd60b12c95a Jun 03 19:20:56.584919 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:56.584719 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 19:15:55 +0000 UTC" deadline="2027-12-23 14:51:04.064724396 +0000 UTC" Jun 03 19:20:56.585032 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:56.584922 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13627h30m7.479808672s" Jun 03 19:20:56.612346 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:56.612315 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tlvhh" event={"ID":"fd082ce0-248b-4e84-997c-cde24967cf01","Type":"ContainerStarted","Data":"3d655097970f1f4f28dc9f7c228e9f2a9584e657885c8c5fb4ec1141a3666310"} Jun 03 19:20:56.613383 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:56.613351 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xp7nm" event={"ID":"f7cfbe65-8cb3-49e2-9d1a-2e4acee99955","Type":"ContainerStarted","Data":"5820bd19cba85468b04ce20e9e8c5a8e76e9766f5612769f839d9ef365eb2e5e"} Jun 03 19:20:56.614259 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:56.614236 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pgqqd" event={"ID":"7e0a45de-2b41-482b-a027-803833e40d55","Type":"ContainerStarted","Data":"970bd840bd2030f785b59d179a51966e1d563ebd475ca344b143190e55adc311"} Jun 03 19:20:56.615388 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:56.615359 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hxzmz" event={"ID":"f9120d61-aab1-47ff-8db1-29e1d2349729","Type":"ContainerStarted","Data":"d8b9e3744bff1b441fb27e2e9a6fa1f55f17398ad022d6036271c2b4e0b23e1a"} Jun 03 19:20:56.616804 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:56.616758 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5czvc" event={"ID":"ce05c923-acba-430c-bcc1-576e5f7d1f33","Type":"ContainerStarted","Data":"c15a7d5fbc0fb1a063f90e8a7a64a9cff4e23bdc355b4ede98dd313e301cc54b"} Jun 03 19:20:56.617814 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:56.617787 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kjcwb" event={"ID":"b79abc02-ece3-4eaf-b4d8-e131f6e71f60","Type":"ContainerStarted","Data":"1cf921c977ad14eb4175f4bec3c6389b023d4acc1d2abbdb1449b93dd8c7a6d1"} Jun 03 19:20:56.619334 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:56.619308 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-692f4" event={"ID":"851b1783-45c5-41bc-904e-b5d3085344d1","Type":"ContainerStarted","Data":"74a3955758e9d2af3517b18390620e9424bf9f3615fa1371e63a9e947121b005"} Jun 03 19:20:56.622855 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:56.622830 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-x7fzw" event={"ID":"bbe34b9a-ec50-44cc-8203-e763426c06f0","Type":"ContainerStarted","Data":"a262d3e0103564d52b95e32abcbbc9d105948bb97a184906e7755bd60b12c95a"} Jun 03 19:20:56.623864 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:56.623845 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wq5fc" event={"ID":"19ae3107-ba44-4cb7-9dad-e125e64323fa","Type":"ContainerStarted","Data":"4d546961ad65f9b2a4a6f7bba78050b12bc742de6555965ac991026c5154c435"} Jun 03 19:20:57.160928 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:57.160835 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5f4ae72c-cf67-426b-af3e-9b2a27c9488c-original-pull-secret\") pod \"global-pull-secret-syncer-cjz9d\" (UID: \"5f4ae72c-cf67-426b-af3e-9b2a27c9488c\") " pod="kube-system/global-pull-secret-syncer-cjz9d" Jun 03 19:20:57.161100 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:57.160947 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e0ed8e87-e724-4880-a4e8-fe68533db02a-metrics-certs\") pod \"network-metrics-daemon-xpvdz\" (UID: \"e0ed8e87-e724-4880-a4e8-fe68533db02a\") " pod="openshift-multus/network-metrics-daemon-xpvdz" Jun 03 19:20:57.161100 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:20:57.161073 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:20:57.161213 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:20:57.161136 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0ed8e87-e724-4880-a4e8-fe68533db02a-metrics-certs podName:e0ed8e87-e724-4880-a4e8-fe68533db02a nodeName:}" failed. No retries permitted until 2026-06-03 19:20:59.161118028 +0000 UTC m=+6.006777425 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e0ed8e87-e724-4880-a4e8-fe68533db02a-metrics-certs") pod "network-metrics-daemon-xpvdz" (UID: "e0ed8e87-e724-4880-a4e8-fe68533db02a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:20:57.161569 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:20:57.161548 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 19:20:57.161679 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:20:57.161609 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f4ae72c-cf67-426b-af3e-9b2a27c9488c-original-pull-secret podName:5f4ae72c-cf67-426b-af3e-9b2a27c9488c nodeName:}" failed. No retries permitted until 2026-06-03 19:20:59.161593025 +0000 UTC m=+6.007252418 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5f4ae72c-cf67-426b-af3e-9b2a27c9488c-original-pull-secret") pod "global-pull-secret-syncer-cjz9d" (UID: "5f4ae72c-cf67-426b-af3e-9b2a27c9488c") : object "kube-system"/"original-pull-secret" not registered Jun 03 19:20:57.261595 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:57.261553 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7rgc\" (UniqueName: \"kubernetes.io/projected/54761057-2346-4f57-9c39-5020ac09c153-kube-api-access-m7rgc\") pod \"network-check-target-4zhtx\" (UID: \"54761057-2346-4f57-9c39-5020ac09c153\") " pod="openshift-network-diagnostics/network-check-target-4zhtx" Jun 03 19:20:57.261816 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:20:57.261796 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 19:20:57.261901 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:20:57.261823 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 19:20:57.261901 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:20:57.261836 2579 projected.go:196] Error preparing data for projected volume kube-api-access-m7rgc for pod openshift-network-diagnostics/network-check-target-4zhtx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:20:57.261901 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:20:57.261899 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/54761057-2346-4f57-9c39-5020ac09c153-kube-api-access-m7rgc podName:54761057-2346-4f57-9c39-5020ac09c153 nodeName:}" failed. No retries permitted until 2026-06-03 19:20:59.261878353 +0000 UTC m=+6.107537763 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-m7rgc" (UniqueName: "kubernetes.io/projected/54761057-2346-4f57-9c39-5020ac09c153-kube-api-access-m7rgc") pod "network-check-target-4zhtx" (UID: "54761057-2346-4f57-9c39-5020ac09c153") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:20:57.585499 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:57.585374 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 19:15:55 +0000 UTC" deadline="2027-12-04 14:59:46.332198893 +0000 UTC" Jun 03 19:20:57.585499 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:57.585437 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13171h38m48.746766226s" Jun 03 19:20:57.606895 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:57.606060 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xpvdz" Jun 03 19:20:57.606895 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:20:57.606208 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xpvdz" podUID="e0ed8e87-e724-4880-a4e8-fe68533db02a" Jun 03 19:20:57.606895 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:57.606621 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4zhtx" Jun 03 19:20:57.606895 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:20:57.606717 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4zhtx" podUID="54761057-2346-4f57-9c39-5020ac09c153" Jun 03 19:20:57.606895 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:57.606772 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cjz9d" Jun 03 19:20:57.606895 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:20:57.606842 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cjz9d" podUID="5f4ae72c-cf67-426b-af3e-9b2a27c9488c" Jun 03 19:20:57.656336 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:57.655166 2579 generic.go:356] "Generic (PLEG): container finished" podID="060a8578864dac33397ef52063e9f724" containerID="1f3c15a538fdde47d28a6d3573ae4a52524d2eec0bd8df4929caaf6405afdf79" exitCode=0 Jun 03 19:20:57.656336 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:57.656197 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-80.ec2.internal" event={"ID":"060a8578864dac33397ef52063e9f724","Type":"ContainerDied","Data":"1f3c15a538fdde47d28a6d3573ae4a52524d2eec0bd8df4929caaf6405afdf79"} Jun 03 19:20:57.686677 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:57.686638 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-80.ec2.internal" event={"ID":"79413a4092866a6445601379cc7dcecf","Type":"ContainerStarted","Data":"ab298bab11254b3f9108ac41521b57fcc341c4a0fc6d0e2e5fef76622d458bfb"} Jun 03 19:20:57.702337 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:57.702259 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-80.ec2.internal" podStartSLOduration=2.702235168 podStartE2EDuration="2.702235168s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:20:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:20:57.701948707 +0000 UTC m=+4.547608122" watchObservedRunningTime="2026-06-03 19:20:57.702235168 +0000 UTC m=+4.547894585" Jun 03 19:20:58.722374 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:58.722337 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-80.ec2.internal" event={"ID":"060a8578864dac33397ef52063e9f724","Type":"ContainerStarted","Data":"bc05aa0b1fce5cfafc6a5c8bd82d1b92e79a8c22c23c5b9753813095a08f36d1"} Jun 03 19:20:58.741172 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:58.741107 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-80.ec2.internal" podStartSLOduration=3.74108184 podStartE2EDuration="3.74108184s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:20:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:20:58.740085869 +0000 UTC m=+5.585745286" watchObservedRunningTime="2026-06-03 19:20:58.74108184 +0000 UTC m=+5.586741258" Jun 03 19:20:59.183539 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:59.183221 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5f4ae72c-cf67-426b-af3e-9b2a27c9488c-original-pull-secret\") pod \"global-pull-secret-syncer-cjz9d\" (UID: \"5f4ae72c-cf67-426b-af3e-9b2a27c9488c\") " pod="kube-system/global-pull-secret-syncer-cjz9d" Jun 03 19:20:59.183539 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:59.183318 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e0ed8e87-e724-4880-a4e8-fe68533db02a-metrics-certs\") pod \"network-metrics-daemon-xpvdz\" (UID: \"e0ed8e87-e724-4880-a4e8-fe68533db02a\") " pod="openshift-multus/network-metrics-daemon-xpvdz" Jun 03 19:20:59.183539 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:20:59.183394 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 19:20:59.183539 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:20:59.183428 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:20:59.183539 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:20:59.183458 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f4ae72c-cf67-426b-af3e-9b2a27c9488c-original-pull-secret podName:5f4ae72c-cf67-426b-af3e-9b2a27c9488c nodeName:}" failed. No retries permitted until 2026-06-03 19:21:03.183440388 +0000 UTC m=+10.029099802 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5f4ae72c-cf67-426b-af3e-9b2a27c9488c-original-pull-secret") pod "global-pull-secret-syncer-cjz9d" (UID: "5f4ae72c-cf67-426b-af3e-9b2a27c9488c") : object "kube-system"/"original-pull-secret" not registered Jun 03 19:20:59.183539 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:20:59.183478 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0ed8e87-e724-4880-a4e8-fe68533db02a-metrics-certs podName:e0ed8e87-e724-4880-a4e8-fe68533db02a nodeName:}" failed. No retries permitted until 2026-06-03 19:21:03.183468892 +0000 UTC m=+10.029128285 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e0ed8e87-e724-4880-a4e8-fe68533db02a-metrics-certs") pod "network-metrics-daemon-xpvdz" (UID: "e0ed8e87-e724-4880-a4e8-fe68533db02a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:20:59.284620 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:59.284584 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7rgc\" (UniqueName: \"kubernetes.io/projected/54761057-2346-4f57-9c39-5020ac09c153-kube-api-access-m7rgc\") pod \"network-check-target-4zhtx\" (UID: \"54761057-2346-4f57-9c39-5020ac09c153\") " pod="openshift-network-diagnostics/network-check-target-4zhtx" Jun 03 19:20:59.284816 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:20:59.284761 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 19:20:59.284816 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:20:59.284787 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 19:20:59.284816 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:20:59.284801 2579 projected.go:196] Error preparing data for projected volume kube-api-access-m7rgc for pod openshift-network-diagnostics/network-check-target-4zhtx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:20:59.284972 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:20:59.284862 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/54761057-2346-4f57-9c39-5020ac09c153-kube-api-access-m7rgc podName:54761057-2346-4f57-9c39-5020ac09c153 nodeName:}" failed. No retries permitted until 2026-06-03 19:21:03.284840783 +0000 UTC m=+10.130500196 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-m7rgc" (UniqueName: "kubernetes.io/projected/54761057-2346-4f57-9c39-5020ac09c153-kube-api-access-m7rgc") pod "network-check-target-4zhtx" (UID: "54761057-2346-4f57-9c39-5020ac09c153") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:20:59.606414 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:59.606328 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4zhtx" Jun 03 19:20:59.606622 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:20:59.606563 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4zhtx" podUID="54761057-2346-4f57-9c39-5020ac09c153" Jun 03 19:20:59.606690 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:59.606672 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cjz9d" Jun 03 19:20:59.606778 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:20:59.606751 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cjz9d" podUID="5f4ae72c-cf67-426b-af3e-9b2a27c9488c" Jun 03 19:20:59.606849 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:20:59.606819 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xpvdz" Jun 03 19:20:59.606927 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:20:59.606907 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xpvdz" podUID="e0ed8e87-e724-4880-a4e8-fe68533db02a" Jun 03 19:21:01.603988 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:01.603949 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4zhtx" Jun 03 19:21:01.603988 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:01.603975 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cjz9d" Jun 03 19:21:01.604670 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:21:01.604092 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4zhtx" podUID="54761057-2346-4f57-9c39-5020ac09c153" Jun 03 19:21:01.604670 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:01.604157 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xpvdz" Jun 03 19:21:01.604670 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:21:01.604400 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xpvdz" podUID="e0ed8e87-e724-4880-a4e8-fe68533db02a" Jun 03 19:21:01.604670 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:21:01.604497 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cjz9d" podUID="5f4ae72c-cf67-426b-af3e-9b2a27c9488c" Jun 03 19:21:03.220258 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:03.220213 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e0ed8e87-e724-4880-a4e8-fe68533db02a-metrics-certs\") pod \"network-metrics-daemon-xpvdz\" (UID: \"e0ed8e87-e724-4880-a4e8-fe68533db02a\") " pod="openshift-multus/network-metrics-daemon-xpvdz" Jun 03 19:21:03.220811 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:03.220281 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5f4ae72c-cf67-426b-af3e-9b2a27c9488c-original-pull-secret\") pod \"global-pull-secret-syncer-cjz9d\" (UID: \"5f4ae72c-cf67-426b-af3e-9b2a27c9488c\") " pod="kube-system/global-pull-secret-syncer-cjz9d" Jun 03 19:21:03.220811 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:21:03.220457 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 19:21:03.220811 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:21:03.220526 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f4ae72c-cf67-426b-af3e-9b2a27c9488c-original-pull-secret podName:5f4ae72c-cf67-426b-af3e-9b2a27c9488c nodeName:}" failed. No retries permitted until 2026-06-03 19:21:11.220506484 +0000 UTC m=+18.066165894 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5f4ae72c-cf67-426b-af3e-9b2a27c9488c-original-pull-secret") pod "global-pull-secret-syncer-cjz9d" (UID: "5f4ae72c-cf67-426b-af3e-9b2a27c9488c") : object "kube-system"/"original-pull-secret" not registered Jun 03 19:21:03.220989 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:21:03.220951 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:21:03.221071 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:21:03.221008 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0ed8e87-e724-4880-a4e8-fe68533db02a-metrics-certs podName:e0ed8e87-e724-4880-a4e8-fe68533db02a nodeName:}" failed. No retries permitted until 2026-06-03 19:21:11.220991398 +0000 UTC m=+18.066650810 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e0ed8e87-e724-4880-a4e8-fe68533db02a-metrics-certs") pod "network-metrics-daemon-xpvdz" (UID: "e0ed8e87-e724-4880-a4e8-fe68533db02a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:21:03.322122 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:03.321632 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7rgc\" (UniqueName: \"kubernetes.io/projected/54761057-2346-4f57-9c39-5020ac09c153-kube-api-access-m7rgc\") pod \"network-check-target-4zhtx\" (UID: \"54761057-2346-4f57-9c39-5020ac09c153\") " pod="openshift-network-diagnostics/network-check-target-4zhtx" Jun 03 19:21:03.322122 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:21:03.321794 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 19:21:03.322122 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:21:03.321808 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 19:21:03.322122 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:21:03.321817 2579 projected.go:196] Error preparing data for projected volume kube-api-access-m7rgc for pod openshift-network-diagnostics/network-check-target-4zhtx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:21:03.322122 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:21:03.321863 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/54761057-2346-4f57-9c39-5020ac09c153-kube-api-access-m7rgc podName:54761057-2346-4f57-9c39-5020ac09c153 nodeName:}" failed. No retries permitted until 2026-06-03 19:21:11.321850188 +0000 UTC m=+18.167509580 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-m7rgc" (UniqueName: "kubernetes.io/projected/54761057-2346-4f57-9c39-5020ac09c153-kube-api-access-m7rgc") pod "network-check-target-4zhtx" (UID: "54761057-2346-4f57-9c39-5020ac09c153") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:21:03.604726 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:03.604636 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4zhtx" Jun 03 19:21:03.604726 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:21:03.604723 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4zhtx" podUID="54761057-2346-4f57-9c39-5020ac09c153" Jun 03 19:21:03.605268 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:03.604987 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cjz9d" Jun 03 19:21:03.605268 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:03.605096 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xpvdz" Jun 03 19:21:03.605268 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:21:03.605190 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xpvdz" podUID="e0ed8e87-e724-4880-a4e8-fe68533db02a" Jun 03 19:21:03.605268 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:21:03.605233 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cjz9d" podUID="5f4ae72c-cf67-426b-af3e-9b2a27c9488c" Jun 03 19:21:05.604213 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:05.604165 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cjz9d" Jun 03 19:21:05.604767 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:21:05.604321 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cjz9d" podUID="5f4ae72c-cf67-426b-af3e-9b2a27c9488c" Jun 03 19:21:05.604767 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:05.604725 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xpvdz" Jun 03 19:21:05.604850 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:21:05.604829 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xpvdz" podUID="e0ed8e87-e724-4880-a4e8-fe68533db02a" Jun 03 19:21:05.604900 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:05.604889 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4zhtx" Jun 03 19:21:05.604970 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:21:05.604955 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4zhtx" podUID="54761057-2346-4f57-9c39-5020ac09c153" Jun 03 19:21:07.603669 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:07.603564 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4zhtx" Jun 03 19:21:07.603669 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:07.603602 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xpvdz" Jun 03 19:21:07.604199 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:07.603564 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cjz9d" Jun 03 19:21:07.604199 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:21:07.603718 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4zhtx" podUID="54761057-2346-4f57-9c39-5020ac09c153" Jun 03 19:21:07.604199 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:21:07.603831 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cjz9d" podUID="5f4ae72c-cf67-426b-af3e-9b2a27c9488c" Jun 03 19:21:07.604199 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:21:07.603977 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xpvdz" podUID="e0ed8e87-e724-4880-a4e8-fe68533db02a" Jun 03 19:21:09.603737 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:09.603697 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cjz9d" Jun 03 19:21:09.604158 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:21:09.603833 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cjz9d" podUID="5f4ae72c-cf67-426b-af3e-9b2a27c9488c" Jun 03 19:21:09.604249 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:09.604232 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xpvdz" Jun 03 19:21:09.604355 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:21:09.604339 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xpvdz" podUID="e0ed8e87-e724-4880-a4e8-fe68533db02a" Jun 03 19:21:09.604485 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:09.604456 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4zhtx" Jun 03 19:21:09.604586 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:21:09.604568 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4zhtx" podUID="54761057-2346-4f57-9c39-5020ac09c153" Jun 03 19:21:11.285116 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:11.284998 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e0ed8e87-e724-4880-a4e8-fe68533db02a-metrics-certs\") pod \"network-metrics-daemon-xpvdz\" (UID: \"e0ed8e87-e724-4880-a4e8-fe68533db02a\") " pod="openshift-multus/network-metrics-daemon-xpvdz" Jun 03 19:21:11.285116 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:11.285073 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5f4ae72c-cf67-426b-af3e-9b2a27c9488c-original-pull-secret\") pod \"global-pull-secret-syncer-cjz9d\" (UID: \"5f4ae72c-cf67-426b-af3e-9b2a27c9488c\") " pod="kube-system/global-pull-secret-syncer-cjz9d" Jun 03 19:21:11.285907 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:21:11.285229 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 19:21:11.285907 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:21:11.285323 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f4ae72c-cf67-426b-af3e-9b2a27c9488c-original-pull-secret podName:5f4ae72c-cf67-426b-af3e-9b2a27c9488c nodeName:}" failed. No retries permitted until 2026-06-03 19:21:27.285280991 +0000 UTC m=+34.130940405 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5f4ae72c-cf67-426b-af3e-9b2a27c9488c-original-pull-secret") pod "global-pull-secret-syncer-cjz9d" (UID: "5f4ae72c-cf67-426b-af3e-9b2a27c9488c") : object "kube-system"/"original-pull-secret" not registered Jun 03 19:21:11.285907 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:21:11.285421 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:21:11.285907 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:21:11.285499 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0ed8e87-e724-4880-a4e8-fe68533db02a-metrics-certs podName:e0ed8e87-e724-4880-a4e8-fe68533db02a nodeName:}" failed. No retries permitted until 2026-06-03 19:21:27.2854788 +0000 UTC m=+34.131138214 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e0ed8e87-e724-4880-a4e8-fe68533db02a-metrics-certs") pod "network-metrics-daemon-xpvdz" (UID: "e0ed8e87-e724-4880-a4e8-fe68533db02a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:21:11.385624 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:11.385559 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7rgc\" (UniqueName: \"kubernetes.io/projected/54761057-2346-4f57-9c39-5020ac09c153-kube-api-access-m7rgc\") pod \"network-check-target-4zhtx\" (UID: \"54761057-2346-4f57-9c39-5020ac09c153\") " pod="openshift-network-diagnostics/network-check-target-4zhtx" Jun 03 19:21:11.385812 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:21:11.385765 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 19:21:11.385812 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:21:11.385792 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 19:21:11.385812 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:21:11.385806 2579 projected.go:196] Error preparing data for projected volume kube-api-access-m7rgc for pod openshift-network-diagnostics/network-check-target-4zhtx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:21:11.385977 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:21:11.385884 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/54761057-2346-4f57-9c39-5020ac09c153-kube-api-access-m7rgc podName:54761057-2346-4f57-9c39-5020ac09c153 nodeName:}" failed. No retries permitted until 2026-06-03 19:21:27.385864302 +0000 UTC m=+34.231523710 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-m7rgc" (UniqueName: "kubernetes.io/projected/54761057-2346-4f57-9c39-5020ac09c153-kube-api-access-m7rgc") pod "network-check-target-4zhtx" (UID: "54761057-2346-4f57-9c39-5020ac09c153") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:21:11.603609 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:11.603521 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xpvdz" Jun 03 19:21:11.603609 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:11.603552 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cjz9d" Jun 03 19:21:11.603826 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:11.603518 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4zhtx" Jun 03 19:21:11.603826 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:21:11.603666 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xpvdz" podUID="e0ed8e87-e724-4880-a4e8-fe68533db02a" Jun 03 19:21:11.603826 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:21:11.603738 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4zhtx" podUID="54761057-2346-4f57-9c39-5020ac09c153" Jun 03 19:21:11.603960 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:21:11.603837 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cjz9d" podUID="5f4ae72c-cf67-426b-af3e-9b2a27c9488c" Jun 03 19:21:13.604245 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:13.604039 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xpvdz" Jun 03 19:21:13.604678 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:13.604092 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4zhtx" Jun 03 19:21:13.604678 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:21:13.604348 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xpvdz" podUID="e0ed8e87-e724-4880-a4e8-fe68533db02a" Jun 03 19:21:13.604678 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:13.604129 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cjz9d" Jun 03 19:21:13.604678 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:21:13.604391 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4zhtx" podUID="54761057-2346-4f57-9c39-5020ac09c153" Jun 03 19:21:13.604678 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:21:13.604520 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cjz9d" podUID="5f4ae72c-cf67-426b-af3e-9b2a27c9488c" Jun 03 19:21:15.603384 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:15.603329 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xpvdz" Jun 03 19:21:15.604029 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:21:15.603462 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xpvdz" podUID="e0ed8e87-e724-4880-a4e8-fe68533db02a" Jun 03 19:21:15.604029 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:15.603341 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cjz9d" Jun 03 19:21:15.604029 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:21:15.603539 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cjz9d" podUID="5f4ae72c-cf67-426b-af3e-9b2a27c9488c" Jun 03 19:21:15.604029 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:15.603329 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4zhtx" Jun 03 19:21:15.604029 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:21:15.603602 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4zhtx" podUID="54761057-2346-4f57-9c39-5020ac09c153" Jun 03 19:21:15.758960 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:15.758924 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wq5fc" event={"ID":"19ae3107-ba44-4cb7-9dad-e125e64323fa","Type":"ContainerStarted","Data":"479e1a538ac62e4ef12f1028252c2ed6f9d89f1265611d8f2ba6bcdfea3e2d4c"} Jun 03 19:21:15.760601 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:15.760569 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tlvhh" event={"ID":"fd082ce0-248b-4e84-997c-cde24967cf01","Type":"ContainerStarted","Data":"dcd62511ab9bc8a2b6f29b89754e24a4f75ff393a8575b1368642611d133213a"} Jun 03 19:21:15.762340 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:15.762312 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xp7nm" event={"ID":"f7cfbe65-8cb3-49e2-9d1a-2e4acee99955","Type":"ContainerStarted","Data":"9b51634198afeb675a31b0026de5aad94ff2cfd74b520d529437841405e8c763"} Jun 03 19:21:15.763832 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:15.763808 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pgqqd" event={"ID":"7e0a45de-2b41-482b-a027-803833e40d55","Type":"ContainerStarted","Data":"2a84d7e02fffccc1c526b3e8d9fa69dc033cb680c9d1b0635a4dcc8441c23dc2"} Jun 03 19:21:15.766185 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:15.766159 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hxzmz" event={"ID":"f9120d61-aab1-47ff-8db1-29e1d2349729","Type":"ContainerStarted","Data":"d3d1011f2722eb37b60f6ed01484bc81856bc44c625d56fcd7b9245a524e24b9"} Jun 03 19:21:15.766321 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:15.766226 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hxzmz" event={"ID":"f9120d61-aab1-47ff-8db1-29e1d2349729","Type":"ContainerStarted","Data":"a5517c3c25d5b7b2adea29795f016e63254b365415e28b2d1525ce8f6fe63f65"} Jun 03 19:21:15.766321 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:15.766269 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hxzmz" event={"ID":"f9120d61-aab1-47ff-8db1-29e1d2349729","Type":"ContainerStarted","Data":"8161f4344d8a5a46adba71e7025069a3f858e76106fee707f0d5b15af6b2fd9f"} Jun 03 19:21:15.766407 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:15.766342 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hxzmz" event={"ID":"f9120d61-aab1-47ff-8db1-29e1d2349729","Type":"ContainerStarted","Data":"f924867654af6d586f942908c34a8be2d2fb0599d19b61af7518f645eea9f2fc"} Jun 03 19:21:15.767534 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:15.767511 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5czvc" event={"ID":"ce05c923-acba-430c-bcc1-576e5f7d1f33","Type":"ContainerStarted","Data":"9150c4553143260dbd8b747d63c9c46cfa3d26f267478afc253e7cac7128245b"} Jun 03 19:21:15.769021 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:15.769000 2579 generic.go:356] "Generic (PLEG): container finished" podID="b79abc02-ece3-4eaf-b4d8-e131f6e71f60" containerID="24e14fe51c97b131b751ef1113af445376b26ce798c2e79c2d6e9b0073e105ac" exitCode=0 Jun 03 19:21:15.769116 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:15.769070 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kjcwb" event={"ID":"b79abc02-ece3-4eaf-b4d8-e131f6e71f60","Type":"ContainerDied","Data":"24e14fe51c97b131b751ef1113af445376b26ce798c2e79c2d6e9b0073e105ac"} Jun 03 19:21:15.770441 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:15.770421 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-x7fzw" event={"ID":"bbe34b9a-ec50-44cc-8203-e763426c06f0","Type":"ContainerStarted","Data":"8cbc6dd3bad9f67488aa767f0c170ff2f6c97b141006c5b44a65f10e6a11c868"} Jun 03 19:21:15.776763 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:15.776723 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-wq5fc" podStartSLOduration=4.082979181 podStartE2EDuration="22.776708176s" totalImagesPullingTime="18.693728995s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:20:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:21:15.77599906 +0000 UTC m=+22.621658477" watchObservedRunningTime="2026-06-03 19:21:15.776708176 +0000 UTC m=+22.622367591" Jun 03 19:21:15.793645 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:15.793600 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-tlvhh" podStartSLOduration=4.033474021 podStartE2EDuration="22.793581616s" totalImagesPullingTime="18.760107595s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:20:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:21:15.792986932 +0000 UTC m=+22.638646339" watchObservedRunningTime="2026-06-03 19:21:15.793581616 +0000 UTC m=+22.639241034" Jun 03 19:21:15.809742 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:15.808764 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-pgqqd" podStartSLOduration=4.107823516 podStartE2EDuration="22.80874408s" totalImagesPullingTime="18.700920564s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:20:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:21:15.808548958 +0000 UTC m=+22.654208376" watchObservedRunningTime="2026-06-03 19:21:15.80874408 +0000 UTC m=+22.654403496" Jun 03 19:21:15.826977 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:15.826925 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-x7fzw" podStartSLOduration=4.136274768 podStartE2EDuration="22.82690908s" totalImagesPullingTime="18.690634312s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:20:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:21:15.826561981 +0000 UTC m=+22.672221396" watchObservedRunningTime="2026-06-03 19:21:15.82690908 +0000 UTC m=+22.672568494" Jun 03 19:21:15.867787 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:15.867742 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-5czvc" podStartSLOduration=4.156836452 podStartE2EDuration="22.867724276s" totalImagesPullingTime="18.710887824s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:20:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:21:15.842243452 +0000 UTC m=+22.687902867" watchObservedRunningTime="2026-06-03 19:21:15.867724276 +0000 UTC m=+22.713383690" Jun 03 19:21:16.776350 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:16.776309 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hxzmz" event={"ID":"f9120d61-aab1-47ff-8db1-29e1d2349729","Type":"ContainerStarted","Data":"419e81420b346ca9922d9b7d233985d68756e5dc34b02baefa4bba2ee33ab861"} Jun 03 19:21:16.776898 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:16.776469 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hxzmz" event={"ID":"f9120d61-aab1-47ff-8db1-29e1d2349729","Type":"ContainerStarted","Data":"58c983c64ebc8d53bfd1b1fff4a30db7bfe6625d0531db7c643673b3c65383d5"} Jun 03 19:21:16.816206 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:16.816167 2579 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 03 19:21:17.597336 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:17.596949 2579 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-03T19:21:16.816198943Z","UUID":"1eae7fa4-c020-4362-bfff-3127456df662","Handler":null,"Name":"","Endpoint":""} Jun 03 19:21:17.598898 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:17.598871 2579 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 03 19:21:17.599045 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:17.598912 2579 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 03 19:21:17.604213 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:17.603702 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4zhtx" Jun 03 19:21:17.604213 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:21:17.603801 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4zhtx" podUID="54761057-2346-4f57-9c39-5020ac09c153" Jun 03 19:21:17.604213 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:17.604107 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cjz9d" Jun 03 19:21:17.604213 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:21:17.604180 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cjz9d" podUID="5f4ae72c-cf67-426b-af3e-9b2a27c9488c" Jun 03 19:21:17.604522 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:17.604329 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xpvdz" Jun 03 19:21:17.604522 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:21:17.604423 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xpvdz" podUID="e0ed8e87-e724-4880-a4e8-fe68533db02a" Jun 03 19:21:17.784370 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:17.784322 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xp7nm" event={"ID":"f7cfbe65-8cb3-49e2-9d1a-2e4acee99955","Type":"ContainerStarted","Data":"71859870fc52462175c00c7ee70324720050091e77a9650ab17246a1115c0834"} Jun 03 19:21:17.786009 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:17.785974 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-692f4" event={"ID":"851b1783-45c5-41bc-904e-b5d3085344d1","Type":"ContainerStarted","Data":"3f20bf803e64dcda3fd63692374035267971a89881cd865913b4ebdd7dc36944"} Jun 03 19:21:17.806943 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:17.806885 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-692f4" podStartSLOduration=6.096934697 podStartE2EDuration="24.806869367s" totalImagesPullingTime="18.70993467s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:20:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:21:17.806845651 +0000 UTC m=+24.652505065" watchObservedRunningTime="2026-06-03 19:21:17.806869367 +0000 UTC m=+24.652528781" Jun 03 19:21:18.794939 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:18.794900 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hxzmz" event={"ID":"f9120d61-aab1-47ff-8db1-29e1d2349729","Type":"ContainerStarted","Data":"a8a7a16904ae9aecfafccf3a48e416c1eb3fbe075e9c5a1448cc7bc1d4dcdf4b"} Jun 03 19:21:18.797094 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:18.797061 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xp7nm" event={"ID":"f7cfbe65-8cb3-49e2-9d1a-2e4acee99955","Type":"ContainerStarted","Data":"9b4e2626c19a490ceb13f354959a65f748bf45ab06cc46eaade3b5e417f490c8"} Jun 03 19:21:18.816885 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:18.816828 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xp7nm" podStartSLOduration=4.829032115 podStartE2EDuration="25.816805782s" totalImagesPullingTime="20.987773667s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:20:53 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:21:18.81656606 +0000 UTC m=+25.662225467" watchObservedRunningTime="2026-06-03 19:21:18.816805782 +0000 UTC m=+25.662465198" Jun 03 19:21:19.603585 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:19.603542 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4zhtx" Jun 03 19:21:19.603919 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:19.603543 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cjz9d" Jun 03 19:21:19.603919 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:21:19.603677 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4zhtx" podUID="54761057-2346-4f57-9c39-5020ac09c153" Jun 03 19:21:19.603919 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:21:19.603774 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cjz9d" podUID="5f4ae72c-cf67-426b-af3e-9b2a27c9488c" Jun 03 19:21:19.603919 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:19.603543 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xpvdz" Jun 03 19:21:19.603919 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:21:19.603884 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xpvdz" podUID="e0ed8e87-e724-4880-a4e8-fe68533db02a" Jun 03 19:21:20.183009 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:20.182972 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-pgqqd" Jun 03 19:21:20.183541 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:20.183523 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-pgqqd" Jun 03 19:21:20.803209 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:20.803024 2579 generic.go:356] "Generic (PLEG): container finished" podID="b79abc02-ece3-4eaf-b4d8-e131f6e71f60" containerID="2c50a2ed21487a8d0f0ae1e0502ed970385769587e2005131a3256b2c26d44f7" exitCode=0 Jun 03 19:21:20.806536 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:20.803110 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kjcwb" event={"ID":"b79abc02-ece3-4eaf-b4d8-e131f6e71f60","Type":"ContainerDied","Data":"2c50a2ed21487a8d0f0ae1e0502ed970385769587e2005131a3256b2c26d44f7"} Jun 03 19:21:20.811377 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:20.811351 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hxzmz" event={"ID":"f9120d61-aab1-47ff-8db1-29e1d2349729","Type":"ContainerStarted","Data":"167b22379541c8cb362c07d0d700357e2e6957fb1947041d4a7b6dcbad3e0a95"} Jun 03 19:21:20.811641 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:20.811620 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-pgqqd" Jun 03 19:21:20.812108 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:20.812091 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-pgqqd" Jun 03 19:21:20.861397 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:20.861340 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-hxzmz" podStartSLOduration=9.08953851 podStartE2EDuration="27.861320279s" totalImagesPullingTime="18.771781769s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:20:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:21:20.860193681 +0000 UTC m=+27.705853096" watchObservedRunningTime="2026-06-03 19:21:20.861320279 +0000 UTC m=+27.706979699" Jun 03 19:21:21.605499 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:21.605462 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xpvdz" Jun 03 19:21:21.606080 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:21:21.605602 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xpvdz" podUID="e0ed8e87-e724-4880-a4e8-fe68533db02a" Jun 03 19:21:21.606080 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:21.605997 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4zhtx" Jun 03 19:21:21.606212 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:21:21.606083 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4zhtx" podUID="54761057-2346-4f57-9c39-5020ac09c153" Jun 03 19:21:21.606212 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:21.606140 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cjz9d" Jun 03 19:21:21.606342 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:21:21.606209 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cjz9d" podUID="5f4ae72c-cf67-426b-af3e-9b2a27c9488c" Jun 03 19:21:21.816451 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:21.816420 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kjcwb" event={"ID":"b79abc02-ece3-4eaf-b4d8-e131f6e71f60","Type":"ContainerStarted","Data":"165d159f6ad603661d00d3e0fd7957b6c90130bf0bcf05da180b67b45145983f"} Jun 03 19:21:21.817573 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:21.817548 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hxzmz" Jun 03 19:21:21.817700 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:21.817659 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hxzmz" Jun 03 19:21:21.817770 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:21.817714 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hxzmz" Jun 03 19:21:21.834873 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:21.834845 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hxzmz" Jun 03 19:21:21.836374 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:21.836354 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hxzmz" Jun 03 19:21:22.313935 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:22.313904 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4zhtx"] Jun 03 19:21:22.314137 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:22.314065 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4zhtx" Jun 03 19:21:22.314191 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:21:22.314172 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4zhtx" podUID="54761057-2346-4f57-9c39-5020ac09c153" Jun 03 19:21:22.318265 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:22.318239 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cjz9d"] Jun 03 19:21:22.318443 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:22.318428 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cjz9d" Jun 03 19:21:22.318553 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:21:22.318532 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cjz9d" podUID="5f4ae72c-cf67-426b-af3e-9b2a27c9488c" Jun 03 19:21:22.319023 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:22.319004 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xpvdz"] Jun 03 19:21:22.319106 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:22.319097 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xpvdz" Jun 03 19:21:22.319190 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:21:22.319171 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xpvdz" podUID="e0ed8e87-e724-4880-a4e8-fe68533db02a" Jun 03 19:21:22.820529 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:22.820496 2579 generic.go:356] "Generic (PLEG): container finished" podID="b79abc02-ece3-4eaf-b4d8-e131f6e71f60" containerID="165d159f6ad603661d00d3e0fd7957b6c90130bf0bcf05da180b67b45145983f" exitCode=0 Jun 03 19:21:22.821254 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:22.820561 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kjcwb" event={"ID":"b79abc02-ece3-4eaf-b4d8-e131f6e71f60","Type":"ContainerDied","Data":"165d159f6ad603661d00d3e0fd7957b6c90130bf0bcf05da180b67b45145983f"} Jun 03 19:21:23.605084 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:23.604889 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cjz9d" Jun 03 19:21:23.605248 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:23.604964 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xpvdz" Jun 03 19:21:23.605248 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:21:23.605145 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cjz9d" podUID="5f4ae72c-cf67-426b-af3e-9b2a27c9488c" Jun 03 19:21:23.605248 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:21:23.605229 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xpvdz" podUID="e0ed8e87-e724-4880-a4e8-fe68533db02a" Jun 03 19:21:24.603537 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:24.603441 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4zhtx" Jun 03 19:21:24.603924 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:21:24.603568 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4zhtx" podUID="54761057-2346-4f57-9c39-5020ac09c153" Jun 03 19:21:24.828185 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:24.828135 2579 generic.go:356] "Generic (PLEG): container finished" podID="b79abc02-ece3-4eaf-b4d8-e131f6e71f60" containerID="fb5d8c97e063eda95f90be3bada1755e5443371785ae0823e4c08ccdfee2b30b" exitCode=0 Jun 03 19:21:24.828185 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:24.828183 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kjcwb" event={"ID":"b79abc02-ece3-4eaf-b4d8-e131f6e71f60","Type":"ContainerDied","Data":"fb5d8c97e063eda95f90be3bada1755e5443371785ae0823e4c08ccdfee2b30b"} Jun 03 19:21:25.603323 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:25.603271 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cjz9d" Jun 03 19:21:25.603519 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:25.603279 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xpvdz" Jun 03 19:21:25.603519 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:21:25.603431 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cjz9d" podUID="5f4ae72c-cf67-426b-af3e-9b2a27c9488c" Jun 03 19:21:25.603932 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:21:25.603608 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xpvdz" podUID="e0ed8e87-e724-4880-a4e8-fe68533db02a" Jun 03 19:21:26.603834 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:26.603796 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4zhtx" Jun 03 19:21:26.604254 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:21:26.603917 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4zhtx" podUID="54761057-2346-4f57-9c39-5020ac09c153" Jun 03 19:21:27.303268 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:27.303227 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e0ed8e87-e724-4880-a4e8-fe68533db02a-metrics-certs\") pod \"network-metrics-daemon-xpvdz\" (UID: \"e0ed8e87-e724-4880-a4e8-fe68533db02a\") " pod="openshift-multus/network-metrics-daemon-xpvdz" Jun 03 19:21:27.303476 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:27.303279 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5f4ae72c-cf67-426b-af3e-9b2a27c9488c-original-pull-secret\") pod \"global-pull-secret-syncer-cjz9d\" (UID: \"5f4ae72c-cf67-426b-af3e-9b2a27c9488c\") " pod="kube-system/global-pull-secret-syncer-cjz9d" Jun 03 19:21:27.303476 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:21:27.303390 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:21:27.303476 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:21:27.303398 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 19:21:27.303476 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:21:27.303453 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0ed8e87-e724-4880-a4e8-fe68533db02a-metrics-certs podName:e0ed8e87-e724-4880-a4e8-fe68533db02a nodeName:}" failed. No retries permitted until 2026-06-03 19:21:59.303437272 +0000 UTC m=+66.149096687 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e0ed8e87-e724-4880-a4e8-fe68533db02a-metrics-certs") pod "network-metrics-daemon-xpvdz" (UID: "e0ed8e87-e724-4880-a4e8-fe68533db02a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 19:21:27.303476 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:21:27.303467 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f4ae72c-cf67-426b-af3e-9b2a27c9488c-original-pull-secret podName:5f4ae72c-cf67-426b-af3e-9b2a27c9488c nodeName:}" failed. No retries permitted until 2026-06-03 19:21:59.303461293 +0000 UTC m=+66.149120685 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5f4ae72c-cf67-426b-af3e-9b2a27c9488c-original-pull-secret") pod "global-pull-secret-syncer-cjz9d" (UID: "5f4ae72c-cf67-426b-af3e-9b2a27c9488c") : object "kube-system"/"original-pull-secret" not registered Jun 03 19:21:27.404184 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:27.404135 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7rgc\" (UniqueName: \"kubernetes.io/projected/54761057-2346-4f57-9c39-5020ac09c153-kube-api-access-m7rgc\") pod \"network-check-target-4zhtx\" (UID: \"54761057-2346-4f57-9c39-5020ac09c153\") " pod="openshift-network-diagnostics/network-check-target-4zhtx" Jun 03 19:21:27.404405 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:21:27.404344 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 19:21:27.404405 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:21:27.404369 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 19:21:27.404405 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:21:27.404380 2579 projected.go:196] Error preparing data for projected volume kube-api-access-m7rgc for pod openshift-network-diagnostics/network-check-target-4zhtx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:21:27.404725 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:21:27.404447 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/54761057-2346-4f57-9c39-5020ac09c153-kube-api-access-m7rgc podName:54761057-2346-4f57-9c39-5020ac09c153 nodeName:}" failed. No retries permitted until 2026-06-03 19:21:59.404427018 +0000 UTC m=+66.250086433 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-m7rgc" (UniqueName: "kubernetes.io/projected/54761057-2346-4f57-9c39-5020ac09c153-kube-api-access-m7rgc") pod "network-check-target-4zhtx" (UID: "54761057-2346-4f57-9c39-5020ac09c153") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 19:21:27.604265 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:27.604189 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xpvdz" Jun 03 19:21:27.604698 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:27.604189 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cjz9d" Jun 03 19:21:27.604698 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:21:27.604361 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xpvdz" podUID="e0ed8e87-e724-4880-a4e8-fe68533db02a" Jun 03 19:21:27.604698 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:21:27.604415 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cjz9d" podUID="5f4ae72c-cf67-426b-af3e-9b2a27c9488c" Jun 03 19:21:28.603998 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:28.603964 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4zhtx" Jun 03 19:21:28.604176 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:21:28.604082 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4zhtx" podUID="54761057-2346-4f57-9c39-5020ac09c153" Jun 03 19:21:28.842310 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:28.842246 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kjcwb" event={"ID":"b79abc02-ece3-4eaf-b4d8-e131f6e71f60","Type":"ContainerStarted","Data":"bf196850dc4239a3efcda3b453841df57b5dccecf1906b532ff043f21669b66c"} Jun 03 19:21:29.014737 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:29.014707 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-80.ec2.internal" event="NodeReady" Jun 03 19:21:29.014927 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:29.014851 2579 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 03 19:21:29.058471 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:29.058434 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-9cjkr"] Jun 03 19:21:29.061389 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:29.061362 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9cjkr" Jun 03 19:21:29.062320 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:29.062299 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-rr2p9"] Jun 03 19:21:29.063881 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:29.063860 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 03 19:21:29.063993 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:29.063967 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-tfxzd\"" Jun 03 19:21:29.064242 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:29.064226 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 03 19:21:29.065306 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:29.065274 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rr2p9" Jun 03 19:21:29.067937 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:29.067905 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 03 19:21:29.068054 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:29.067969 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 03 19:21:29.068054 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:29.068010 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 03 19:21:29.068365 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:29.068351 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-gzqw4\"" Jun 03 19:21:29.076101 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:29.076049 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9cjkr"] Jun 03 19:21:29.076773 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:29.076755 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rr2p9"] Jun 03 19:21:29.218280 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:29.218184 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzcmk\" (UniqueName: \"kubernetes.io/projected/7d9d6412-0723-4a6d-be56-80ced04b7f8b-kube-api-access-bzcmk\") pod \"dns-default-9cjkr\" (UID: \"7d9d6412-0723-4a6d-be56-80ced04b7f8b\") " pod="openshift-dns/dns-default-9cjkr" Jun 03 19:21:29.218280 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:29.218223 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7d9d6412-0723-4a6d-be56-80ced04b7f8b-config-volume\") pod \"dns-default-9cjkr\" (UID: \"7d9d6412-0723-4a6d-be56-80ced04b7f8b\") " pod="openshift-dns/dns-default-9cjkr" Jun 03 19:21:29.218280 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:29.218254 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cdc85565-9aff-4423-85d6-9ec91df3e28b-cert\") pod \"ingress-canary-rr2p9\" (UID: \"cdc85565-9aff-4423-85d6-9ec91df3e28b\") " pod="openshift-ingress-canary/ingress-canary-rr2p9" Jun 03 19:21:29.218511 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:29.218325 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7d9d6412-0723-4a6d-be56-80ced04b7f8b-metrics-tls\") pod \"dns-default-9cjkr\" (UID: \"7d9d6412-0723-4a6d-be56-80ced04b7f8b\") " pod="openshift-dns/dns-default-9cjkr" Jun 03 19:21:29.218511 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:29.218353 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7d9d6412-0723-4a6d-be56-80ced04b7f8b-tmp-dir\") pod \"dns-default-9cjkr\" (UID: \"7d9d6412-0723-4a6d-be56-80ced04b7f8b\") " pod="openshift-dns/dns-default-9cjkr" Jun 03 19:21:29.218511 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:29.218376 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j25d5\" (UniqueName: \"kubernetes.io/projected/cdc85565-9aff-4423-85d6-9ec91df3e28b-kube-api-access-j25d5\") pod \"ingress-canary-rr2p9\" (UID: \"cdc85565-9aff-4423-85d6-9ec91df3e28b\") " pod="openshift-ingress-canary/ingress-canary-rr2p9" Jun 03 19:21:29.319145 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:29.319113 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzcmk\" (UniqueName: \"kubernetes.io/projected/7d9d6412-0723-4a6d-be56-80ced04b7f8b-kube-api-access-bzcmk\") pod \"dns-default-9cjkr\" (UID: \"7d9d6412-0723-4a6d-be56-80ced04b7f8b\") " pod="openshift-dns/dns-default-9cjkr" Jun 03 19:21:29.319145 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:29.319149 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7d9d6412-0723-4a6d-be56-80ced04b7f8b-config-volume\") pod \"dns-default-9cjkr\" (UID: \"7d9d6412-0723-4a6d-be56-80ced04b7f8b\") " pod="openshift-dns/dns-default-9cjkr" Jun 03 19:21:29.319401 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:29.319168 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cdc85565-9aff-4423-85d6-9ec91df3e28b-cert\") pod \"ingress-canary-rr2p9\" (UID: \"cdc85565-9aff-4423-85d6-9ec91df3e28b\") " pod="openshift-ingress-canary/ingress-canary-rr2p9" Jun 03 19:21:29.319401 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:29.319187 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7d9d6412-0723-4a6d-be56-80ced04b7f8b-metrics-tls\") pod \"dns-default-9cjkr\" (UID: \"7d9d6412-0723-4a6d-be56-80ced04b7f8b\") " pod="openshift-dns/dns-default-9cjkr" Jun 03 19:21:29.319401 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:29.319209 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7d9d6412-0723-4a6d-be56-80ced04b7f8b-tmp-dir\") pod \"dns-default-9cjkr\" (UID: \"7d9d6412-0723-4a6d-be56-80ced04b7f8b\") " pod="openshift-dns/dns-default-9cjkr" Jun 03 19:21:29.319401 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:29.319239 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j25d5\" (UniqueName: \"kubernetes.io/projected/cdc85565-9aff-4423-85d6-9ec91df3e28b-kube-api-access-j25d5\") pod \"ingress-canary-rr2p9\" (UID: \"cdc85565-9aff-4423-85d6-9ec91df3e28b\") " pod="openshift-ingress-canary/ingress-canary-rr2p9" Jun 03 19:21:29.319401 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:21:29.319361 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 19:21:29.319621 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:21:29.319430 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d9d6412-0723-4a6d-be56-80ced04b7f8b-metrics-tls podName:7d9d6412-0723-4a6d-be56-80ced04b7f8b nodeName:}" failed. No retries permitted until 2026-06-03 19:21:29.819413017 +0000 UTC m=+36.665072431 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7d9d6412-0723-4a6d-be56-80ced04b7f8b-metrics-tls") pod "dns-default-9cjkr" (UID: "7d9d6412-0723-4a6d-be56-80ced04b7f8b") : secret "dns-default-metrics-tls" not found Jun 03 19:21:29.319704 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:29.319681 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7d9d6412-0723-4a6d-be56-80ced04b7f8b-tmp-dir\") pod \"dns-default-9cjkr\" (UID: \"7d9d6412-0723-4a6d-be56-80ced04b7f8b\") " pod="openshift-dns/dns-default-9cjkr" Jun 03 19:21:29.319788 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:29.319769 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7d9d6412-0723-4a6d-be56-80ced04b7f8b-config-volume\") pod \"dns-default-9cjkr\" (UID: \"7d9d6412-0723-4a6d-be56-80ced04b7f8b\") " pod="openshift-dns/dns-default-9cjkr" Jun 03 19:21:29.324121 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:29.324095 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cdc85565-9aff-4423-85d6-9ec91df3e28b-cert\") pod \"ingress-canary-rr2p9\" (UID: \"cdc85565-9aff-4423-85d6-9ec91df3e28b\") " pod="openshift-ingress-canary/ingress-canary-rr2p9" Jun 03 19:21:29.328693 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:29.328674 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzcmk\" (UniqueName: \"kubernetes.io/projected/7d9d6412-0723-4a6d-be56-80ced04b7f8b-kube-api-access-bzcmk\") pod \"dns-default-9cjkr\" (UID: \"7d9d6412-0723-4a6d-be56-80ced04b7f8b\") " pod="openshift-dns/dns-default-9cjkr" Jun 03 19:21:29.329252 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:29.329237 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j25d5\" (UniqueName: \"kubernetes.io/projected/cdc85565-9aff-4423-85d6-9ec91df3e28b-kube-api-access-j25d5\") pod \"ingress-canary-rr2p9\" (UID: \"cdc85565-9aff-4423-85d6-9ec91df3e28b\") " pod="openshift-ingress-canary/ingress-canary-rr2p9" Jun 03 19:21:29.377970 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:29.377912 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rr2p9" Jun 03 19:21:29.522961 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:29.522924 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rr2p9"] Jun 03 19:21:29.527359 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:21:29.527326 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdc85565_9aff_4423_85d6_9ec91df3e28b.slice/crio-25e792108b634089c73bf0b24eb37663f82be0f28857febc70b7752e27d760f3 WatchSource:0}: Error finding container 25e792108b634089c73bf0b24eb37663f82be0f28857febc70b7752e27d760f3: Status 404 returned error can't find the container with id 25e792108b634089c73bf0b24eb37663f82be0f28857febc70b7752e27d760f3 Jun 03 19:21:29.604147 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:29.604107 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cjz9d" Jun 03 19:21:29.604359 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:29.604250 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xpvdz" Jun 03 19:21:29.610326 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:29.607625 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 03 19:21:29.610326 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:29.607685 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 19:21:29.610326 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:29.607629 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-grwp9\"" Jun 03 19:21:29.824318 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:29.824195 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7d9d6412-0723-4a6d-be56-80ced04b7f8b-metrics-tls\") pod \"dns-default-9cjkr\" (UID: \"7d9d6412-0723-4a6d-be56-80ced04b7f8b\") " pod="openshift-dns/dns-default-9cjkr" Jun 03 19:21:29.824486 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:21:29.824372 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 19:21:29.824486 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:21:29.824439 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d9d6412-0723-4a6d-be56-80ced04b7f8b-metrics-tls podName:7d9d6412-0723-4a6d-be56-80ced04b7f8b nodeName:}" failed. No retries permitted until 2026-06-03 19:21:30.824422557 +0000 UTC m=+37.670081969 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7d9d6412-0723-4a6d-be56-80ced04b7f8b-metrics-tls") pod "dns-default-9cjkr" (UID: "7d9d6412-0723-4a6d-be56-80ced04b7f8b") : secret "dns-default-metrics-tls" not found Jun 03 19:21:29.847614 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:29.847582 2579 generic.go:356] "Generic (PLEG): container finished" podID="b79abc02-ece3-4eaf-b4d8-e131f6e71f60" containerID="bf196850dc4239a3efcda3b453841df57b5dccecf1906b532ff043f21669b66c" exitCode=0 Jun 03 19:21:29.848120 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:29.847662 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kjcwb" event={"ID":"b79abc02-ece3-4eaf-b4d8-e131f6e71f60","Type":"ContainerDied","Data":"bf196850dc4239a3efcda3b453841df57b5dccecf1906b532ff043f21669b66c"} Jun 03 19:21:29.848923 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:29.848901 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rr2p9" event={"ID":"cdc85565-9aff-4423-85d6-9ec91df3e28b","Type":"ContainerStarted","Data":"25e792108b634089c73bf0b24eb37663f82be0f28857febc70b7752e27d760f3"} Jun 03 19:21:30.604050 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:30.604021 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4zhtx" Jun 03 19:21:30.606859 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:30.606824 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 19:21:30.607028 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:30.606824 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 19:21:30.607723 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:30.607705 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2pf7v\"" Jun 03 19:21:30.832736 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:30.832693 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7d9d6412-0723-4a6d-be56-80ced04b7f8b-metrics-tls\") pod \"dns-default-9cjkr\" (UID: \"7d9d6412-0723-4a6d-be56-80ced04b7f8b\") " pod="openshift-dns/dns-default-9cjkr" Jun 03 19:21:30.832901 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:21:30.832851 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 19:21:30.832968 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:21:30.832946 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d9d6412-0723-4a6d-be56-80ced04b7f8b-metrics-tls podName:7d9d6412-0723-4a6d-be56-80ced04b7f8b nodeName:}" failed. No retries permitted until 2026-06-03 19:21:32.832922339 +0000 UTC m=+39.678581741 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7d9d6412-0723-4a6d-be56-80ced04b7f8b-metrics-tls") pod "dns-default-9cjkr" (UID: "7d9d6412-0723-4a6d-be56-80ced04b7f8b") : secret "dns-default-metrics-tls" not found Jun 03 19:21:30.855744 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:30.855657 2579 generic.go:356] "Generic (PLEG): container finished" podID="b79abc02-ece3-4eaf-b4d8-e131f6e71f60" containerID="8e12b710d8ee7f07f78ed075f8aa863f5542a8b4fe5655804848e10f8a4bd9e2" exitCode=0 Jun 03 19:21:30.855744 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:30.855726 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kjcwb" event={"ID":"b79abc02-ece3-4eaf-b4d8-e131f6e71f60","Type":"ContainerDied","Data":"8e12b710d8ee7f07f78ed075f8aa863f5542a8b4fe5655804848e10f8a4bd9e2"} Jun 03 19:21:31.863790 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:31.863581 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kjcwb" event={"ID":"b79abc02-ece3-4eaf-b4d8-e131f6e71f60","Type":"ContainerStarted","Data":"ab36daf65c558b1ee8b09761a8e75ac477c66916d143b1cc139ac4c52bee166e"} Jun 03 19:21:31.865075 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:31.865049 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rr2p9" event={"ID":"cdc85565-9aff-4423-85d6-9ec91df3e28b","Type":"ContainerStarted","Data":"22f311039756d0792ea4592a1513ea7c7a5a88f6c38f3dce88843b5a035ab129"} Jun 03 19:21:31.895378 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:31.895320 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-kjcwb" podStartSLOduration=9.897895173 podStartE2EDuration="38.895276325s" totalImagesPullingTime="28.997381152s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:20:53 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:21:31.894943453 +0000 UTC m=+38.740602867" watchObservedRunningTime="2026-06-03 19:21:31.895276325 +0000 UTC m=+38.740935741" Jun 03 19:21:31.916322 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:31.915142 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-rr2p9" podStartSLOduration=1.096750068 podStartE2EDuration="2.915120022s" totalImagesPullingTime="1.818369954s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:21:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:21:31.915012327 +0000 UTC m=+38.760671743" watchObservedRunningTime="2026-06-03 19:21:31.915120022 +0000 UTC m=+38.760779438" Jun 03 19:21:32.849264 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:32.849214 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7d9d6412-0723-4a6d-be56-80ced04b7f8b-metrics-tls\") pod \"dns-default-9cjkr\" (UID: \"7d9d6412-0723-4a6d-be56-80ced04b7f8b\") " pod="openshift-dns/dns-default-9cjkr" Jun 03 19:21:32.849444 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:21:32.849400 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 19:21:32.849507 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:21:32.849472 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d9d6412-0723-4a6d-be56-80ced04b7f8b-metrics-tls podName:7d9d6412-0723-4a6d-be56-80ced04b7f8b nodeName:}" failed. No retries permitted until 2026-06-03 19:21:36.849454841 +0000 UTC m=+43.695114234 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7d9d6412-0723-4a6d-be56-80ced04b7f8b-metrics-tls") pod "dns-default-9cjkr" (UID: "7d9d6412-0723-4a6d-be56-80ced04b7f8b") : secret "dns-default-metrics-tls" not found Jun 03 19:21:34.231912 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:34.231870 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c56759479-z6v9c"] Jun 03 19:21:34.253924 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:34.253892 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c56759479-z6v9c"] Jun 03 19:21:34.254093 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:34.254004 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c56759479-z6v9c" Jun 03 19:21:34.258307 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:34.258270 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 03 19:21:34.258547 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:34.258529 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 03 19:21:34.258612 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:34.258545 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 03 19:21:34.258658 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:34.258615 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 03 19:21:34.258812 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:34.258797 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 03 19:21:34.258883 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:34.258837 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 03 19:21:34.259254 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:34.259237 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 03 19:21:34.360687 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:34.360653 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/03f8c278-46a4-441d-b4b9-decabf746b1b-ca\") pod \"cluster-proxy-proxy-agent-5c56759479-z6v9c\" (UID: \"03f8c278-46a4-441d-b4b9-decabf746b1b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c56759479-z6v9c" Jun 03 19:21:34.360687 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:34.360690 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/03f8c278-46a4-441d-b4b9-decabf746b1b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5c56759479-z6v9c\" (UID: \"03f8c278-46a4-441d-b4b9-decabf746b1b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c56759479-z6v9c" Jun 03 19:21:34.360905 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:34.360764 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/03f8c278-46a4-441d-b4b9-decabf746b1b-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5c56759479-z6v9c\" (UID: \"03f8c278-46a4-441d-b4b9-decabf746b1b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c56759479-z6v9c" Jun 03 19:21:34.360905 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:34.360804 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lmb5\" (UniqueName: \"kubernetes.io/projected/03f8c278-46a4-441d-b4b9-decabf746b1b-kube-api-access-5lmb5\") pod \"cluster-proxy-proxy-agent-5c56759479-z6v9c\" (UID: \"03f8c278-46a4-441d-b4b9-decabf746b1b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c56759479-z6v9c" Jun 03 19:21:34.360905 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:34.360831 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/03f8c278-46a4-441d-b4b9-decabf746b1b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5c56759479-z6v9c\" (UID: \"03f8c278-46a4-441d-b4b9-decabf746b1b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c56759479-z6v9c" Jun 03 19:21:34.360905 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:34.360860 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/03f8c278-46a4-441d-b4b9-decabf746b1b-hub\") pod \"cluster-proxy-proxy-agent-5c56759479-z6v9c\" (UID: \"03f8c278-46a4-441d-b4b9-decabf746b1b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c56759479-z6v9c" Jun 03 19:21:34.461237 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:34.461198 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/03f8c278-46a4-441d-b4b9-decabf746b1b-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5c56759479-z6v9c\" (UID: \"03f8c278-46a4-441d-b4b9-decabf746b1b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c56759479-z6v9c" Jun 03 19:21:34.461431 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:34.461248 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lmb5\" (UniqueName: \"kubernetes.io/projected/03f8c278-46a4-441d-b4b9-decabf746b1b-kube-api-access-5lmb5\") pod \"cluster-proxy-proxy-agent-5c56759479-z6v9c\" (UID: \"03f8c278-46a4-441d-b4b9-decabf746b1b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c56759479-z6v9c" Jun 03 19:21:34.461431 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:34.461283 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/03f8c278-46a4-441d-b4b9-decabf746b1b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5c56759479-z6v9c\" (UID: \"03f8c278-46a4-441d-b4b9-decabf746b1b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c56759479-z6v9c" Jun 03 19:21:34.461431 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:34.461333 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/03f8c278-46a4-441d-b4b9-decabf746b1b-hub\") pod \"cluster-proxy-proxy-agent-5c56759479-z6v9c\" (UID: \"03f8c278-46a4-441d-b4b9-decabf746b1b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c56759479-z6v9c" Jun 03 19:21:34.461431 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:34.461426 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/03f8c278-46a4-441d-b4b9-decabf746b1b-ca\") pod \"cluster-proxy-proxy-agent-5c56759479-z6v9c\" (UID: \"03f8c278-46a4-441d-b4b9-decabf746b1b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c56759479-z6v9c" Jun 03 19:21:34.461638 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:34.461451 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/03f8c278-46a4-441d-b4b9-decabf746b1b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5c56759479-z6v9c\" (UID: \"03f8c278-46a4-441d-b4b9-decabf746b1b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c56759479-z6v9c" Jun 03 19:21:34.461970 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:34.461948 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/03f8c278-46a4-441d-b4b9-decabf746b1b-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5c56759479-z6v9c\" (UID: \"03f8c278-46a4-441d-b4b9-decabf746b1b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c56759479-z6v9c" Jun 03 19:21:34.465207 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:34.465181 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/03f8c278-46a4-441d-b4b9-decabf746b1b-ca\") pod \"cluster-proxy-proxy-agent-5c56759479-z6v9c\" (UID: \"03f8c278-46a4-441d-b4b9-decabf746b1b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c56759479-z6v9c" Jun 03 19:21:34.465325 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:34.465272 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/03f8c278-46a4-441d-b4b9-decabf746b1b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5c56759479-z6v9c\" (UID: \"03f8c278-46a4-441d-b4b9-decabf746b1b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c56759479-z6v9c" Jun 03 19:21:34.465371 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:34.465357 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/03f8c278-46a4-441d-b4b9-decabf746b1b-hub\") pod \"cluster-proxy-proxy-agent-5c56759479-z6v9c\" (UID: \"03f8c278-46a4-441d-b4b9-decabf746b1b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c56759479-z6v9c" Jun 03 19:21:34.465475 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:34.465454 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/03f8c278-46a4-441d-b4b9-decabf746b1b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5c56759479-z6v9c\" (UID: \"03f8c278-46a4-441d-b4b9-decabf746b1b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c56759479-z6v9c" Jun 03 19:21:34.470047 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:34.470013 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lmb5\" (UniqueName: \"kubernetes.io/projected/03f8c278-46a4-441d-b4b9-decabf746b1b-kube-api-access-5lmb5\") pod \"cluster-proxy-proxy-agent-5c56759479-z6v9c\" (UID: \"03f8c278-46a4-441d-b4b9-decabf746b1b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c56759479-z6v9c" Jun 03 19:21:34.574564 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:34.574471 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c56759479-z6v9c" Jun 03 19:21:34.727928 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:34.727896 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c56759479-z6v9c"] Jun 03 19:21:34.731162 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:21:34.731131 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod03f8c278_46a4_441d_b4b9_decabf746b1b.slice/crio-16e0c613d38e7858c8646154214d710e03859b2bc01ac7c1efd896df17137d79 WatchSource:0}: Error finding container 16e0c613d38e7858c8646154214d710e03859b2bc01ac7c1efd896df17137d79: Status 404 returned error can't find the container with id 16e0c613d38e7858c8646154214d710e03859b2bc01ac7c1efd896df17137d79 Jun 03 19:21:34.872954 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:34.872869 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c56759479-z6v9c" event={"ID":"03f8c278-46a4-441d-b4b9-decabf746b1b","Type":"ContainerStarted","Data":"16e0c613d38e7858c8646154214d710e03859b2bc01ac7c1efd896df17137d79"} Jun 03 19:21:36.880396 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:36.880340 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7d9d6412-0723-4a6d-be56-80ced04b7f8b-metrics-tls\") pod \"dns-default-9cjkr\" (UID: \"7d9d6412-0723-4a6d-be56-80ced04b7f8b\") " pod="openshift-dns/dns-default-9cjkr" Jun 03 19:21:36.880892 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:21:36.880525 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 19:21:36.880892 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:21:36.880602 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d9d6412-0723-4a6d-be56-80ced04b7f8b-metrics-tls podName:7d9d6412-0723-4a6d-be56-80ced04b7f8b nodeName:}" failed. No retries permitted until 2026-06-03 19:21:44.880586233 +0000 UTC m=+51.726245626 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7d9d6412-0723-4a6d-be56-80ced04b7f8b-metrics-tls") pod "dns-default-9cjkr" (UID: "7d9d6412-0723-4a6d-be56-80ced04b7f8b") : secret "dns-default-metrics-tls" not found Jun 03 19:21:39.888615 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:39.888562 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c56759479-z6v9c" event={"ID":"03f8c278-46a4-441d-b4b9-decabf746b1b","Type":"ContainerStarted","Data":"32016a74fdc6190f6acb4d90fb4d21b69900172d4c8f890636e86c65204e5427"} Jun 03 19:21:39.888615 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:39.888605 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c56759479-z6v9c" event={"ID":"03f8c278-46a4-441d-b4b9-decabf746b1b","Type":"ContainerStarted","Data":"ec8a3e27517aeab149dcab3e341fcd468a8dc3b0e6daa08199d1f3fe0ccf6947"} Jun 03 19:21:39.888615 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:39.888618 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c56759479-z6v9c" event={"ID":"03f8c278-46a4-441d-b4b9-decabf746b1b","Type":"ContainerStarted","Data":"1823000f72abedb65e760e2eefe41a337425a0a8dc93855063db4a0fc1e58534"} Jun 03 19:21:39.908465 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:39.908411 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c56759479-z6v9c" podStartSLOduration=1.3085155720000001 podStartE2EDuration="5.908396231s" totalImagesPullingTime="4.599880659s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:21:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:21:39.907927978 +0000 UTC m=+46.753587392" watchObservedRunningTime="2026-06-03 19:21:39.908396231 +0000 UTC m=+46.754055645" Jun 03 19:21:44.940697 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:44.940652 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7d9d6412-0723-4a6d-be56-80ced04b7f8b-metrics-tls\") pod \"dns-default-9cjkr\" (UID: \"7d9d6412-0723-4a6d-be56-80ced04b7f8b\") " pod="openshift-dns/dns-default-9cjkr" Jun 03 19:21:44.941100 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:21:44.940811 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 19:21:44.941100 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:21:44.940877 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d9d6412-0723-4a6d-be56-80ced04b7f8b-metrics-tls podName:7d9d6412-0723-4a6d-be56-80ced04b7f8b nodeName:}" failed. No retries permitted until 2026-06-03 19:22:00.940861114 +0000 UTC m=+67.786520512 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7d9d6412-0723-4a6d-be56-80ced04b7f8b-metrics-tls") pod "dns-default-9cjkr" (UID: "7d9d6412-0723-4a6d-be56-80ced04b7f8b") : secret "dns-default-metrics-tls" not found Jun 03 19:21:53.836047 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:53.836015 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hxzmz" Jun 03 19:21:59.351356 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:59.351316 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5f4ae72c-cf67-426b-af3e-9b2a27c9488c-original-pull-secret\") pod \"global-pull-secret-syncer-cjz9d\" (UID: \"5f4ae72c-cf67-426b-af3e-9b2a27c9488c\") " pod="kube-system/global-pull-secret-syncer-cjz9d" Jun 03 19:21:59.351829 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:59.351405 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e0ed8e87-e724-4880-a4e8-fe68533db02a-metrics-certs\") pod \"network-metrics-daemon-xpvdz\" (UID: \"e0ed8e87-e724-4880-a4e8-fe68533db02a\") " pod="openshift-multus/network-metrics-daemon-xpvdz" Jun 03 19:21:59.354405 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:59.354385 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 03 19:21:59.354477 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:59.354413 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 19:21:59.361699 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:21:59.361669 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 03 19:21:59.361782 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:21:59.361772 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0ed8e87-e724-4880-a4e8-fe68533db02a-metrics-certs podName:e0ed8e87-e724-4880-a4e8-fe68533db02a nodeName:}" failed. No retries permitted until 2026-06-03 19:23:03.361753988 +0000 UTC m=+130.207413383 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e0ed8e87-e724-4880-a4e8-fe68533db02a-metrics-certs") pod "network-metrics-daemon-xpvdz" (UID: "e0ed8e87-e724-4880-a4e8-fe68533db02a") : secret "metrics-daemon-secret" not found Jun 03 19:21:59.364016 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:59.363993 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5f4ae72c-cf67-426b-af3e-9b2a27c9488c-original-pull-secret\") pod \"global-pull-secret-syncer-cjz9d\" (UID: \"5f4ae72c-cf67-426b-af3e-9b2a27c9488c\") " pod="kube-system/global-pull-secret-syncer-cjz9d" Jun 03 19:21:59.452668 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:59.452607 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7rgc\" (UniqueName: \"kubernetes.io/projected/54761057-2346-4f57-9c39-5020ac09c153-kube-api-access-m7rgc\") pod \"network-check-target-4zhtx\" (UID: \"54761057-2346-4f57-9c39-5020ac09c153\") " pod="openshift-network-diagnostics/network-check-target-4zhtx" Jun 03 19:21:59.455664 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:59.455640 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 19:21:59.466019 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:59.465990 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 19:21:59.476789 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:59.476758 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7rgc\" (UniqueName: \"kubernetes.io/projected/54761057-2346-4f57-9c39-5020ac09c153-kube-api-access-m7rgc\") pod \"network-check-target-4zhtx\" (UID: \"54761057-2346-4f57-9c39-5020ac09c153\") " pod="openshift-network-diagnostics/network-check-target-4zhtx" Jun 03 19:21:59.617448 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:59.617360 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cjz9d" Jun 03 19:21:59.718479 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:59.718449 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2pf7v\"" Jun 03 19:21:59.725937 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:59.725900 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4zhtx" Jun 03 19:21:59.745228 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:59.745198 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cjz9d"] Jun 03 19:21:59.748395 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:21:59.748352 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f4ae72c_cf67_426b_af3e_9b2a27c9488c.slice/crio-fe085167c0f25c189b13c629a80397fe19bc6570f76a200a0299169ee3f79a38 WatchSource:0}: Error finding container fe085167c0f25c189b13c629a80397fe19bc6570f76a200a0299169ee3f79a38: Status 404 returned error can't find the container with id fe085167c0f25c189b13c629a80397fe19bc6570f76a200a0299169ee3f79a38 Jun 03 19:21:59.856153 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:59.856117 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4zhtx"] Jun 03 19:21:59.859321 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:21:59.859271 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54761057_2346_4f57_9c39_5020ac09c153.slice/crio-e5ede474eda28a256a8ead924699c977fa009885a8376d63a854f67a33187267 WatchSource:0}: Error finding container e5ede474eda28a256a8ead924699c977fa009885a8376d63a854f67a33187267: Status 404 returned error can't find the container with id e5ede474eda28a256a8ead924699c977fa009885a8376d63a854f67a33187267 Jun 03 19:21:59.939105 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:59.939068 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4zhtx" event={"ID":"54761057-2346-4f57-9c39-5020ac09c153","Type":"ContainerStarted","Data":"e5ede474eda28a256a8ead924699c977fa009885a8376d63a854f67a33187267"} Jun 03 19:21:59.940227 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:21:59.940201 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cjz9d" event={"ID":"5f4ae72c-cf67-426b-af3e-9b2a27c9488c","Type":"ContainerStarted","Data":"fe085167c0f25c189b13c629a80397fe19bc6570f76a200a0299169ee3f79a38"} Jun 03 19:22:00.964653 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:22:00.964606 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7d9d6412-0723-4a6d-be56-80ced04b7f8b-metrics-tls\") pod \"dns-default-9cjkr\" (UID: \"7d9d6412-0723-4a6d-be56-80ced04b7f8b\") " pod="openshift-dns/dns-default-9cjkr" Jun 03 19:22:00.965162 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:22:00.964774 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 19:22:00.965162 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:22:00.964849 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d9d6412-0723-4a6d-be56-80ced04b7f8b-metrics-tls podName:7d9d6412-0723-4a6d-be56-80ced04b7f8b nodeName:}" failed. No retries permitted until 2026-06-03 19:22:32.964832415 +0000 UTC m=+99.810491809 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7d9d6412-0723-4a6d-be56-80ced04b7f8b-metrics-tls") pod "dns-default-9cjkr" (UID: "7d9d6412-0723-4a6d-be56-80ced04b7f8b") : secret "dns-default-metrics-tls" not found Jun 03 19:22:04.958223 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:22:04.958179 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cjz9d" event={"ID":"5f4ae72c-cf67-426b-af3e-9b2a27c9488c","Type":"ContainerStarted","Data":"b099731e7e6ff8cda2498ff4bb24a782574e2fffcebbe9a7eb952f7a67c76cae"} Jun 03 19:22:04.959722 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:22:04.959694 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4zhtx" event={"ID":"54761057-2346-4f57-9c39-5020ac09c153","Type":"ContainerStarted","Data":"cd2087fdcd05a04b09011f32a155a238af5962d00822e2cb850eacc9d135b592"} Jun 03 19:22:04.959859 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:22:04.959842 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-4zhtx" Jun 03 19:22:04.974698 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:22:04.974641 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-cjz9d" podStartSLOduration=67.369902345 podStartE2EDuration="1m11.974622827s" totalImagesPullingTime="4.604720482s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:20:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:22:04.97438787 +0000 UTC m=+71.820047286" watchObservedRunningTime="2026-06-03 19:22:04.974622827 +0000 UTC m=+71.820282238" Jun 03 19:22:04.990462 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:22:04.990408 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-4zhtx" podStartSLOduration=67.49951544 podStartE2EDuration="1m11.990390894s" totalImagesPullingTime="4.490875454s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:20:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:22:04.989924689 +0000 UTC m=+71.835584107" watchObservedRunningTime="2026-06-03 19:22:04.990390894 +0000 UTC m=+71.836050308" Jun 03 19:22:32.982470 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:22:32.982406 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7d9d6412-0723-4a6d-be56-80ced04b7f8b-metrics-tls\") pod \"dns-default-9cjkr\" (UID: \"7d9d6412-0723-4a6d-be56-80ced04b7f8b\") " pod="openshift-dns/dns-default-9cjkr" Jun 03 19:22:32.982933 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:22:32.982569 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 19:22:32.982933 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:22:32.982649 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d9d6412-0723-4a6d-be56-80ced04b7f8b-metrics-tls podName:7d9d6412-0723-4a6d-be56-80ced04b7f8b nodeName:}" failed. No retries permitted until 2026-06-03 19:23:36.982632246 +0000 UTC m=+163.828291656 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7d9d6412-0723-4a6d-be56-80ced04b7f8b-metrics-tls") pod "dns-default-9cjkr" (UID: "7d9d6412-0723-4a6d-be56-80ced04b7f8b") : secret "dns-default-metrics-tls" not found Jun 03 19:22:35.965061 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:22:35.965028 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-4zhtx" Jun 03 19:23:03.399303 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:23:03.399240 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e0ed8e87-e724-4880-a4e8-fe68533db02a-metrics-certs\") pod \"network-metrics-daemon-xpvdz\" (UID: \"e0ed8e87-e724-4880-a4e8-fe68533db02a\") " pod="openshift-multus/network-metrics-daemon-xpvdz" Jun 03 19:23:03.399806 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:23:03.399394 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 03 19:23:03.399806 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:23:03.399472 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0ed8e87-e724-4880-a4e8-fe68533db02a-metrics-certs podName:e0ed8e87-e724-4880-a4e8-fe68533db02a nodeName:}" failed. No retries permitted until 2026-06-03 19:25:05.399454361 +0000 UTC m=+252.245113771 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e0ed8e87-e724-4880-a4e8-fe68533db02a-metrics-certs") pod "network-metrics-daemon-xpvdz" (UID: "e0ed8e87-e724-4880-a4e8-fe68533db02a") : secret "metrics-daemon-secret" not found Jun 03 19:23:32.072216 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:23:32.072170 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-9cjkr" podUID="7d9d6412-0723-4a6d-be56-80ced04b7f8b" Jun 03 19:23:32.209937 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:23:32.209907 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9cjkr" Jun 03 19:23:32.622111 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:23:32.622005 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-xpvdz" podUID="e0ed8e87-e724-4880-a4e8-fe68533db02a" Jun 03 19:23:37.045051 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:23:37.045015 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7d9d6412-0723-4a6d-be56-80ced04b7f8b-metrics-tls\") pod \"dns-default-9cjkr\" (UID: \"7d9d6412-0723-4a6d-be56-80ced04b7f8b\") " pod="openshift-dns/dns-default-9cjkr" Jun 03 19:23:37.045525 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:23:37.045172 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 19:23:37.045525 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:23:37.045230 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d9d6412-0723-4a6d-be56-80ced04b7f8b-metrics-tls podName:7d9d6412-0723-4a6d-be56-80ced04b7f8b nodeName:}" failed. No retries permitted until 2026-06-03 19:25:39.045214379 +0000 UTC m=+285.890873771 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7d9d6412-0723-4a6d-be56-80ced04b7f8b-metrics-tls") pod "dns-default-9cjkr" (UID: "7d9d6412-0723-4a6d-be56-80ced04b7f8b") : secret "dns-default-metrics-tls" not found Jun 03 19:23:45.603344 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:23:45.603230 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xpvdz" Jun 03 19:25:05.495758 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:05.495701 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e0ed8e87-e724-4880-a4e8-fe68533db02a-metrics-certs\") pod \"network-metrics-daemon-xpvdz\" (UID: \"e0ed8e87-e724-4880-a4e8-fe68533db02a\") " pod="openshift-multus/network-metrics-daemon-xpvdz" Jun 03 19:25:05.496209 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:25:05.495854 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 03 19:25:05.496209 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:25:05.495936 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0ed8e87-e724-4880-a4e8-fe68533db02a-metrics-certs podName:e0ed8e87-e724-4880-a4e8-fe68533db02a nodeName:}" failed. No retries permitted until 2026-06-03 19:27:07.495918516 +0000 UTC m=+374.341577908 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e0ed8e87-e724-4880-a4e8-fe68533db02a-metrics-certs") pod "network-metrics-daemon-xpvdz" (UID: "e0ed8e87-e724-4880-a4e8-fe68533db02a") : secret "metrics-daemon-secret" not found Jun 03 19:25:12.546622 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:12.546580 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-85bd8fd97d-jrw5d"] Jun 03 19:25:12.548855 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:12.548821 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85bd8fd97d-jrw5d" Jun 03 19:25:12.553194 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:12.553170 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 03 19:25:12.553194 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:12.553188 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 03 19:25:12.553523 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:12.553509 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 03 19:25:12.554068 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:12.554046 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 03 19:25:12.556403 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:12.556376 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-h4rlx\"" Jun 03 19:25:12.561374 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:12.561349 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 03 19:25:12.571001 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:12.570973 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85bd8fd97d-jrw5d"] Jun 03 19:25:12.642035 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:12.641999 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b76503e3-1d27-4456-b636-148e6e9d14b2-config\") pod \"console-operator-85bd8fd97d-jrw5d\" (UID: \"b76503e3-1d27-4456-b636-148e6e9d14b2\") " pod="openshift-console-operator/console-operator-85bd8fd97d-jrw5d" Jun 03 19:25:12.642245 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:12.642040 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b76503e3-1d27-4456-b636-148e6e9d14b2-trusted-ca\") pod \"console-operator-85bd8fd97d-jrw5d\" (UID: \"b76503e3-1d27-4456-b636-148e6e9d14b2\") " pod="openshift-console-operator/console-operator-85bd8fd97d-jrw5d" Jun 03 19:25:12.642245 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:12.642116 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b76503e3-1d27-4456-b636-148e6e9d14b2-serving-cert\") pod \"console-operator-85bd8fd97d-jrw5d\" (UID: \"b76503e3-1d27-4456-b636-148e6e9d14b2\") " pod="openshift-console-operator/console-operator-85bd8fd97d-jrw5d" Jun 03 19:25:12.642245 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:12.642145 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vrhz\" (UniqueName: \"kubernetes.io/projected/b76503e3-1d27-4456-b636-148e6e9d14b2-kube-api-access-7vrhz\") pod \"console-operator-85bd8fd97d-jrw5d\" (UID: \"b76503e3-1d27-4456-b636-148e6e9d14b2\") " pod="openshift-console-operator/console-operator-85bd8fd97d-jrw5d" Jun 03 19:25:12.743333 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:12.743273 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vrhz\" (UniqueName: \"kubernetes.io/projected/b76503e3-1d27-4456-b636-148e6e9d14b2-kube-api-access-7vrhz\") pod \"console-operator-85bd8fd97d-jrw5d\" (UID: \"b76503e3-1d27-4456-b636-148e6e9d14b2\") " pod="openshift-console-operator/console-operator-85bd8fd97d-jrw5d" Jun 03 19:25:12.743519 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:12.743353 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b76503e3-1d27-4456-b636-148e6e9d14b2-config\") pod \"console-operator-85bd8fd97d-jrw5d\" (UID: \"b76503e3-1d27-4456-b636-148e6e9d14b2\") " pod="openshift-console-operator/console-operator-85bd8fd97d-jrw5d" Jun 03 19:25:12.743519 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:12.743374 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b76503e3-1d27-4456-b636-148e6e9d14b2-trusted-ca\") pod \"console-operator-85bd8fd97d-jrw5d\" (UID: \"b76503e3-1d27-4456-b636-148e6e9d14b2\") " pod="openshift-console-operator/console-operator-85bd8fd97d-jrw5d" Jun 03 19:25:12.743519 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:12.743406 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b76503e3-1d27-4456-b636-148e6e9d14b2-serving-cert\") pod \"console-operator-85bd8fd97d-jrw5d\" (UID: \"b76503e3-1d27-4456-b636-148e6e9d14b2\") " pod="openshift-console-operator/console-operator-85bd8fd97d-jrw5d" Jun 03 19:25:12.744020 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:12.743991 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b76503e3-1d27-4456-b636-148e6e9d14b2-config\") pod \"console-operator-85bd8fd97d-jrw5d\" (UID: \"b76503e3-1d27-4456-b636-148e6e9d14b2\") " pod="openshift-console-operator/console-operator-85bd8fd97d-jrw5d" Jun 03 19:25:12.744173 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:12.744155 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b76503e3-1d27-4456-b636-148e6e9d14b2-trusted-ca\") pod \"console-operator-85bd8fd97d-jrw5d\" (UID: \"b76503e3-1d27-4456-b636-148e6e9d14b2\") " pod="openshift-console-operator/console-operator-85bd8fd97d-jrw5d" Jun 03 19:25:12.745920 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:12.745896 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b76503e3-1d27-4456-b636-148e6e9d14b2-serving-cert\") pod \"console-operator-85bd8fd97d-jrw5d\" (UID: \"b76503e3-1d27-4456-b636-148e6e9d14b2\") " pod="openshift-console-operator/console-operator-85bd8fd97d-jrw5d" Jun 03 19:25:12.754384 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:12.754354 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vrhz\" (UniqueName: \"kubernetes.io/projected/b76503e3-1d27-4456-b636-148e6e9d14b2-kube-api-access-7vrhz\") pod \"console-operator-85bd8fd97d-jrw5d\" (UID: \"b76503e3-1d27-4456-b636-148e6e9d14b2\") " pod="openshift-console-operator/console-operator-85bd8fd97d-jrw5d" Jun 03 19:25:12.858589 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:12.858489 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85bd8fd97d-jrw5d" Jun 03 19:25:12.991947 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:12.991860 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85bd8fd97d-jrw5d"] Jun 03 19:25:12.996015 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:25:12.995971 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb76503e3_1d27_4456_b636_148e6e9d14b2.slice/crio-c471db5e9f151f54d86874f9ab0bb6b9cdd4d4fb8f602f1f6f6ded7f26055fbf WatchSource:0}: Error finding container c471db5e9f151f54d86874f9ab0bb6b9cdd4d4fb8f602f1f6f6ded7f26055fbf: Status 404 returned error can't find the container with id c471db5e9f151f54d86874f9ab0bb6b9cdd4d4fb8f602f1f6f6ded7f26055fbf Jun 03 19:25:13.484429 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:13.484393 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85bd8fd97d-jrw5d" event={"ID":"b76503e3-1d27-4456-b636-148e6e9d14b2","Type":"ContainerStarted","Data":"c471db5e9f151f54d86874f9ab0bb6b9cdd4d4fb8f602f1f6f6ded7f26055fbf"} Jun 03 19:25:16.495672 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:16.495641 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-jrw5d_b76503e3-1d27-4456-b636-148e6e9d14b2/console-operator/0.log" Jun 03 19:25:16.496063 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:16.495685 2579 generic.go:356] "Generic (PLEG): container finished" podID="b76503e3-1d27-4456-b636-148e6e9d14b2" containerID="05fda9b0aa1fae5eb376ee25766a67bd64cdf6d9eac657145dc264f517f2737d" exitCode=255 Jun 03 19:25:16.496063 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:16.495719 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85bd8fd97d-jrw5d" event={"ID":"b76503e3-1d27-4456-b636-148e6e9d14b2","Type":"ContainerDied","Data":"05fda9b0aa1fae5eb376ee25766a67bd64cdf6d9eac657145dc264f517f2737d"} Jun 03 19:25:16.496063 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:16.495966 2579 scope.go:117] "RemoveContainer" containerID="05fda9b0aa1fae5eb376ee25766a67bd64cdf6d9eac657145dc264f517f2737d" Jun 03 19:25:17.499781 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:17.499753 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-jrw5d_b76503e3-1d27-4456-b636-148e6e9d14b2/console-operator/1.log" Jun 03 19:25:17.500217 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:17.500143 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-jrw5d_b76503e3-1d27-4456-b636-148e6e9d14b2/console-operator/0.log" Jun 03 19:25:17.500217 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:17.500176 2579 generic.go:356] "Generic (PLEG): container finished" podID="b76503e3-1d27-4456-b636-148e6e9d14b2" containerID="630ddb3cb8daf49d51c4063e9c3982a2e6ce55e252703ffa690fcb593730e1c6" exitCode=255 Jun 03 19:25:17.500352 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:17.500216 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85bd8fd97d-jrw5d" event={"ID":"b76503e3-1d27-4456-b636-148e6e9d14b2","Type":"ContainerDied","Data":"630ddb3cb8daf49d51c4063e9c3982a2e6ce55e252703ffa690fcb593730e1c6"} Jun 03 19:25:17.500352 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:17.500264 2579 scope.go:117] "RemoveContainer" containerID="05fda9b0aa1fae5eb376ee25766a67bd64cdf6d9eac657145dc264f517f2737d" Jun 03 19:25:17.500567 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:17.500544 2579 scope.go:117] "RemoveContainer" containerID="630ddb3cb8daf49d51c4063e9c3982a2e6ce55e252703ffa690fcb593730e1c6" Jun 03 19:25:17.500730 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:25:17.500713 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85bd8fd97d-jrw5d_openshift-console-operator(b76503e3-1d27-4456-b636-148e6e9d14b2)\"" pod="openshift-console-operator/console-operator-85bd8fd97d-jrw5d" podUID="b76503e3-1d27-4456-b636-148e6e9d14b2" Jun 03 19:25:18.504553 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:18.504524 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-jrw5d_b76503e3-1d27-4456-b636-148e6e9d14b2/console-operator/1.log" Jun 03 19:25:18.505051 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:18.504940 2579 scope.go:117] "RemoveContainer" containerID="630ddb3cb8daf49d51c4063e9c3982a2e6ce55e252703ffa690fcb593730e1c6" Jun 03 19:25:18.505147 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:25:18.505122 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85bd8fd97d-jrw5d_openshift-console-operator(b76503e3-1d27-4456-b636-148e6e9d14b2)\"" pod="openshift-console-operator/console-operator-85bd8fd97d-jrw5d" podUID="b76503e3-1d27-4456-b636-148e6e9d14b2" Jun 03 19:25:19.380647 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:19.380620 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wq5fc_19ae3107-ba44-4cb7-9dad-e125e64323fa/dns-node-resolver/0.log" Jun 03 19:25:19.981498 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:19.981463 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5czvc_ce05c923-acba-430c-bcc1-576e5f7d1f33/node-ca/0.log" Jun 03 19:25:21.181572 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:21.181542 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rr2p9_cdc85565-9aff-4423-85d6-9ec91df3e28b/serve-healthcheck-canary/0.log" Jun 03 19:25:22.859307 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:22.859230 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85bd8fd97d-jrw5d" Jun 03 19:25:22.859756 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:22.859330 2579 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-85bd8fd97d-jrw5d" Jun 03 19:25:22.859756 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:22.859654 2579 scope.go:117] "RemoveContainer" containerID="630ddb3cb8daf49d51c4063e9c3982a2e6ce55e252703ffa690fcb593730e1c6" Jun 03 19:25:22.859827 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:25:22.859792 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85bd8fd97d-jrw5d_openshift-console-operator(b76503e3-1d27-4456-b636-148e6e9d14b2)\"" pod="openshift-console-operator/console-operator-85bd8fd97d-jrw5d" podUID="b76503e3-1d27-4456-b636-148e6e9d14b2" Jun 03 19:25:35.211370 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:25:35.211316 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-9cjkr" podUID="7d9d6412-0723-4a6d-be56-80ced04b7f8b" Jun 03 19:25:35.552575 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:35.552489 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9cjkr" Jun 03 19:25:36.603537 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:36.603501 2579 scope.go:117] "RemoveContainer" containerID="630ddb3cb8daf49d51c4063e9c3982a2e6ce55e252703ffa690fcb593730e1c6" Jun 03 19:25:37.560128 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:37.560047 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-jrw5d_b76503e3-1d27-4456-b636-148e6e9d14b2/console-operator/2.log" Jun 03 19:25:37.560509 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:37.560495 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-jrw5d_b76503e3-1d27-4456-b636-148e6e9d14b2/console-operator/1.log" Jun 03 19:25:37.560570 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:37.560528 2579 generic.go:356] "Generic (PLEG): container finished" podID="b76503e3-1d27-4456-b636-148e6e9d14b2" containerID="262cec2a932c13ebee51b6d9ec592273444dff685efe5dc508a7b853e7451c25" exitCode=255 Jun 03 19:25:37.560606 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:37.560579 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85bd8fd97d-jrw5d" event={"ID":"b76503e3-1d27-4456-b636-148e6e9d14b2","Type":"ContainerDied","Data":"262cec2a932c13ebee51b6d9ec592273444dff685efe5dc508a7b853e7451c25"} Jun 03 19:25:37.560678 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:37.560665 2579 scope.go:117] "RemoveContainer" containerID="630ddb3cb8daf49d51c4063e9c3982a2e6ce55e252703ffa690fcb593730e1c6" Jun 03 19:25:37.561035 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:37.561012 2579 scope.go:117] "RemoveContainer" containerID="262cec2a932c13ebee51b6d9ec592273444dff685efe5dc508a7b853e7451c25" Jun 03 19:25:37.561203 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:25:37.561182 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-85bd8fd97d-jrw5d_openshift-console-operator(b76503e3-1d27-4456-b636-148e6e9d14b2)\"" pod="openshift-console-operator/console-operator-85bd8fd97d-jrw5d" podUID="b76503e3-1d27-4456-b636-148e6e9d14b2" Jun 03 19:25:38.565149 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:38.565117 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-jrw5d_b76503e3-1d27-4456-b636-148e6e9d14b2/console-operator/2.log" Jun 03 19:25:39.144870 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:39.144828 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7d9d6412-0723-4a6d-be56-80ced04b7f8b-metrics-tls\") pod \"dns-default-9cjkr\" (UID: \"7d9d6412-0723-4a6d-be56-80ced04b7f8b\") " pod="openshift-dns/dns-default-9cjkr" Jun 03 19:25:39.147446 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:39.147421 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7d9d6412-0723-4a6d-be56-80ced04b7f8b-metrics-tls\") pod \"dns-default-9cjkr\" (UID: \"7d9d6412-0723-4a6d-be56-80ced04b7f8b\") " pod="openshift-dns/dns-default-9cjkr" Jun 03 19:25:39.156407 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:39.156373 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-tfxzd\"" Jun 03 19:25:39.164038 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:39.164001 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9cjkr" Jun 03 19:25:39.306467 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:39.306430 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9cjkr"] Jun 03 19:25:39.310259 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:25:39.310228 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d9d6412_0723_4a6d_be56_80ced04b7f8b.slice/crio-52a30fd2b3e8819be4f208ef479e3db766986a1bec9139b25c1a5e3ea78ae756 WatchSource:0}: Error finding container 52a30fd2b3e8819be4f208ef479e3db766986a1bec9139b25c1a5e3ea78ae756: Status 404 returned error can't find the container with id 52a30fd2b3e8819be4f208ef479e3db766986a1bec9139b25c1a5e3ea78ae756 Jun 03 19:25:39.569671 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:39.569576 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9cjkr" event={"ID":"7d9d6412-0723-4a6d-be56-80ced04b7f8b","Type":"ContainerStarted","Data":"52a30fd2b3e8819be4f208ef479e3db766986a1bec9139b25c1a5e3ea78ae756"} Jun 03 19:25:41.127996 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:41.127923 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-wf2cp"] Jun 03 19:25:41.130933 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:41.130916 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wf2cp" Jun 03 19:25:41.138213 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:41.138185 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 03 19:25:41.138350 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:41.138224 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 03 19:25:41.140158 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:41.140142 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-pgttb\"" Jun 03 19:25:41.140427 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:41.140415 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 03 19:25:41.140829 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:41.140810 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 03 19:25:41.151911 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:41.151876 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wf2cp"] Jun 03 19:25:41.261089 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:41.261037 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2c95cea0-9fb2-40ad-aeb3-004a9c0927eb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wf2cp\" (UID: \"2c95cea0-9fb2-40ad-aeb3-004a9c0927eb\") " pod="openshift-insights/insights-runtime-extractor-wf2cp" Jun 03 19:25:41.261315 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:41.261105 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2c95cea0-9fb2-40ad-aeb3-004a9c0927eb-data-volume\") pod \"insights-runtime-extractor-wf2cp\" (UID: \"2c95cea0-9fb2-40ad-aeb3-004a9c0927eb\") " pod="openshift-insights/insights-runtime-extractor-wf2cp" Jun 03 19:25:41.261315 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:41.261126 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzppv\" (UniqueName: \"kubernetes.io/projected/2c95cea0-9fb2-40ad-aeb3-004a9c0927eb-kube-api-access-dzppv\") pod \"insights-runtime-extractor-wf2cp\" (UID: \"2c95cea0-9fb2-40ad-aeb3-004a9c0927eb\") " pod="openshift-insights/insights-runtime-extractor-wf2cp" Jun 03 19:25:41.261315 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:41.261143 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2c95cea0-9fb2-40ad-aeb3-004a9c0927eb-crio-socket\") pod \"insights-runtime-extractor-wf2cp\" (UID: \"2c95cea0-9fb2-40ad-aeb3-004a9c0927eb\") " pod="openshift-insights/insights-runtime-extractor-wf2cp" Jun 03 19:25:41.261315 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:41.261164 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2c95cea0-9fb2-40ad-aeb3-004a9c0927eb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wf2cp\" (UID: \"2c95cea0-9fb2-40ad-aeb3-004a9c0927eb\") " pod="openshift-insights/insights-runtime-extractor-wf2cp" Jun 03 19:25:41.279595 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:41.279566 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5894578676-qzb6c"] Jun 03 19:25:41.282468 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:41.282448 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5894578676-qzb6c" Jun 03 19:25:41.285011 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:41.284985 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 03 19:25:41.285140 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:41.284991 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-wcxmw\"" Jun 03 19:25:41.285140 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:41.285049 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 03 19:25:41.285140 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:41.285137 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 03 19:25:41.290927 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:41.290906 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 03 19:25:41.303802 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:41.303768 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5894578676-qzb6c"] Jun 03 19:25:41.362610 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:41.362577 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2c95cea0-9fb2-40ad-aeb3-004a9c0927eb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wf2cp\" (UID: \"2c95cea0-9fb2-40ad-aeb3-004a9c0927eb\") " pod="openshift-insights/insights-runtime-extractor-wf2cp" Jun 03 19:25:41.362610 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:41.362614 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2c95cea0-9fb2-40ad-aeb3-004a9c0927eb-data-volume\") pod \"insights-runtime-extractor-wf2cp\" (UID: \"2c95cea0-9fb2-40ad-aeb3-004a9c0927eb\") " pod="openshift-insights/insights-runtime-extractor-wf2cp" Jun 03 19:25:41.362827 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:41.362631 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzppv\" (UniqueName: \"kubernetes.io/projected/2c95cea0-9fb2-40ad-aeb3-004a9c0927eb-kube-api-access-dzppv\") pod \"insights-runtime-extractor-wf2cp\" (UID: \"2c95cea0-9fb2-40ad-aeb3-004a9c0927eb\") " pod="openshift-insights/insights-runtime-extractor-wf2cp" Jun 03 19:25:41.362827 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:41.362658 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2c95cea0-9fb2-40ad-aeb3-004a9c0927eb-crio-socket\") pod \"insights-runtime-extractor-wf2cp\" (UID: \"2c95cea0-9fb2-40ad-aeb3-004a9c0927eb\") " pod="openshift-insights/insights-runtime-extractor-wf2cp" Jun 03 19:25:41.362827 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:41.362686 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2c95cea0-9fb2-40ad-aeb3-004a9c0927eb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wf2cp\" (UID: \"2c95cea0-9fb2-40ad-aeb3-004a9c0927eb\") " pod="openshift-insights/insights-runtime-extractor-wf2cp" Jun 03 19:25:41.363247 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:41.363202 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2c95cea0-9fb2-40ad-aeb3-004a9c0927eb-data-volume\") pod \"insights-runtime-extractor-wf2cp\" (UID: \"2c95cea0-9fb2-40ad-aeb3-004a9c0927eb\") " pod="openshift-insights/insights-runtime-extractor-wf2cp" Jun 03 19:25:41.363247 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:41.363210 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2c95cea0-9fb2-40ad-aeb3-004a9c0927eb-crio-socket\") pod \"insights-runtime-extractor-wf2cp\" (UID: \"2c95cea0-9fb2-40ad-aeb3-004a9c0927eb\") " pod="openshift-insights/insights-runtime-extractor-wf2cp" Jun 03 19:25:41.366710 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:41.363625 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2c95cea0-9fb2-40ad-aeb3-004a9c0927eb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wf2cp\" (UID: \"2c95cea0-9fb2-40ad-aeb3-004a9c0927eb\") " pod="openshift-insights/insights-runtime-extractor-wf2cp" Jun 03 19:25:41.368725 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:41.368702 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2c95cea0-9fb2-40ad-aeb3-004a9c0927eb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wf2cp\" (UID: \"2c95cea0-9fb2-40ad-aeb3-004a9c0927eb\") " pod="openshift-insights/insights-runtime-extractor-wf2cp" Jun 03 19:25:41.373558 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:41.373531 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzppv\" (UniqueName: \"kubernetes.io/projected/2c95cea0-9fb2-40ad-aeb3-004a9c0927eb-kube-api-access-dzppv\") pod \"insights-runtime-extractor-wf2cp\" (UID: \"2c95cea0-9fb2-40ad-aeb3-004a9c0927eb\") " pod="openshift-insights/insights-runtime-extractor-wf2cp" Jun 03 19:25:41.440482 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:41.440440 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wf2cp" Jun 03 19:25:41.463878 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:41.463841 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/40e0a014-fe06-4a46-a304-d4a13e716958-installation-pull-secrets\") pod \"image-registry-5894578676-qzb6c\" (UID: \"40e0a014-fe06-4a46-a304-d4a13e716958\") " pod="openshift-image-registry/image-registry-5894578676-qzb6c" Jun 03 19:25:41.464025 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:41.463882 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/40e0a014-fe06-4a46-a304-d4a13e716958-image-registry-private-configuration\") pod \"image-registry-5894578676-qzb6c\" (UID: \"40e0a014-fe06-4a46-a304-d4a13e716958\") " pod="openshift-image-registry/image-registry-5894578676-qzb6c" Jun 03 19:25:41.464025 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:41.463909 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/40e0a014-fe06-4a46-a304-d4a13e716958-registry-tls\") pod \"image-registry-5894578676-qzb6c\" (UID: \"40e0a014-fe06-4a46-a304-d4a13e716958\") " pod="openshift-image-registry/image-registry-5894578676-qzb6c" Jun 03 19:25:41.464025 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:41.463986 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/40e0a014-fe06-4a46-a304-d4a13e716958-ca-trust-extracted\") pod \"image-registry-5894578676-qzb6c\" (UID: \"40e0a014-fe06-4a46-a304-d4a13e716958\") " pod="openshift-image-registry/image-registry-5894578676-qzb6c" Jun 03 19:25:41.464155 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:41.464008 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/40e0a014-fe06-4a46-a304-d4a13e716958-registry-certificates\") pod \"image-registry-5894578676-qzb6c\" (UID: \"40e0a014-fe06-4a46-a304-d4a13e716958\") " pod="openshift-image-registry/image-registry-5894578676-qzb6c" Jun 03 19:25:41.464155 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:41.464073 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/40e0a014-fe06-4a46-a304-d4a13e716958-bound-sa-token\") pod \"image-registry-5894578676-qzb6c\" (UID: \"40e0a014-fe06-4a46-a304-d4a13e716958\") " pod="openshift-image-registry/image-registry-5894578676-qzb6c" Jun 03 19:25:41.464155 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:41.464109 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/40e0a014-fe06-4a46-a304-d4a13e716958-trusted-ca\") pod \"image-registry-5894578676-qzb6c\" (UID: \"40e0a014-fe06-4a46-a304-d4a13e716958\") " pod="openshift-image-registry/image-registry-5894578676-qzb6c" Jun 03 19:25:41.464155 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:41.464144 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdbsd\" (UniqueName: \"kubernetes.io/projected/40e0a014-fe06-4a46-a304-d4a13e716958-kube-api-access-cdbsd\") pod \"image-registry-5894578676-qzb6c\" (UID: \"40e0a014-fe06-4a46-a304-d4a13e716958\") " pod="openshift-image-registry/image-registry-5894578676-qzb6c" Jun 03 19:25:41.564775 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:41.564738 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdbsd\" (UniqueName: \"kubernetes.io/projected/40e0a014-fe06-4a46-a304-d4a13e716958-kube-api-access-cdbsd\") pod \"image-registry-5894578676-qzb6c\" (UID: \"40e0a014-fe06-4a46-a304-d4a13e716958\") " pod="openshift-image-registry/image-registry-5894578676-qzb6c" Jun 03 19:25:41.564775 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:41.564782 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/40e0a014-fe06-4a46-a304-d4a13e716958-installation-pull-secrets\") pod \"image-registry-5894578676-qzb6c\" (UID: \"40e0a014-fe06-4a46-a304-d4a13e716958\") " pod="openshift-image-registry/image-registry-5894578676-qzb6c" Jun 03 19:25:41.565035 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:41.564802 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/40e0a014-fe06-4a46-a304-d4a13e716958-image-registry-private-configuration\") pod \"image-registry-5894578676-qzb6c\" (UID: \"40e0a014-fe06-4a46-a304-d4a13e716958\") " pod="openshift-image-registry/image-registry-5894578676-qzb6c" Jun 03 19:25:41.565035 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:41.564819 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/40e0a014-fe06-4a46-a304-d4a13e716958-registry-tls\") pod \"image-registry-5894578676-qzb6c\" (UID: \"40e0a014-fe06-4a46-a304-d4a13e716958\") " pod="openshift-image-registry/image-registry-5894578676-qzb6c" Jun 03 19:25:41.565035 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:41.564845 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/40e0a014-fe06-4a46-a304-d4a13e716958-ca-trust-extracted\") pod \"image-registry-5894578676-qzb6c\" (UID: \"40e0a014-fe06-4a46-a304-d4a13e716958\") " pod="openshift-image-registry/image-registry-5894578676-qzb6c" Jun 03 19:25:41.565035 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:41.564860 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/40e0a014-fe06-4a46-a304-d4a13e716958-registry-certificates\") pod \"image-registry-5894578676-qzb6c\" (UID: \"40e0a014-fe06-4a46-a304-d4a13e716958\") " pod="openshift-image-registry/image-registry-5894578676-qzb6c" Jun 03 19:25:41.565035 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:41.564899 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/40e0a014-fe06-4a46-a304-d4a13e716958-bound-sa-token\") pod \"image-registry-5894578676-qzb6c\" (UID: \"40e0a014-fe06-4a46-a304-d4a13e716958\") " pod="openshift-image-registry/image-registry-5894578676-qzb6c" Jun 03 19:25:41.565035 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:41.564918 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/40e0a014-fe06-4a46-a304-d4a13e716958-trusted-ca\") pod \"image-registry-5894578676-qzb6c\" (UID: \"40e0a014-fe06-4a46-a304-d4a13e716958\") " pod="openshift-image-registry/image-registry-5894578676-qzb6c" Jun 03 19:25:41.565478 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:41.565448 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/40e0a014-fe06-4a46-a304-d4a13e716958-ca-trust-extracted\") pod \"image-registry-5894578676-qzb6c\" (UID: \"40e0a014-fe06-4a46-a304-d4a13e716958\") " pod="openshift-image-registry/image-registry-5894578676-qzb6c" Jun 03 19:25:41.565915 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:41.565890 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/40e0a014-fe06-4a46-a304-d4a13e716958-registry-certificates\") pod \"image-registry-5894578676-qzb6c\" (UID: \"40e0a014-fe06-4a46-a304-d4a13e716958\") " pod="openshift-image-registry/image-registry-5894578676-qzb6c" Jun 03 19:25:41.566250 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:41.566230 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/40e0a014-fe06-4a46-a304-d4a13e716958-trusted-ca\") pod \"image-registry-5894578676-qzb6c\" (UID: \"40e0a014-fe06-4a46-a304-d4a13e716958\") " pod="openshift-image-registry/image-registry-5894578676-qzb6c" Jun 03 19:25:41.567463 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:41.567441 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/40e0a014-fe06-4a46-a304-d4a13e716958-image-registry-private-configuration\") pod \"image-registry-5894578676-qzb6c\" (UID: \"40e0a014-fe06-4a46-a304-d4a13e716958\") " pod="openshift-image-registry/image-registry-5894578676-qzb6c" Jun 03 19:25:41.567570 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:41.567543 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/40e0a014-fe06-4a46-a304-d4a13e716958-registry-tls\") pod \"image-registry-5894578676-qzb6c\" (UID: \"40e0a014-fe06-4a46-a304-d4a13e716958\") " pod="openshift-image-registry/image-registry-5894578676-qzb6c" Jun 03 19:25:41.567616 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:41.567565 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/40e0a014-fe06-4a46-a304-d4a13e716958-installation-pull-secrets\") pod \"image-registry-5894578676-qzb6c\" (UID: \"40e0a014-fe06-4a46-a304-d4a13e716958\") " pod="openshift-image-registry/image-registry-5894578676-qzb6c" Jun 03 19:25:41.577715 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:41.577676 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9cjkr" event={"ID":"7d9d6412-0723-4a6d-be56-80ced04b7f8b","Type":"ContainerStarted","Data":"c1551953e83315499c5df32db37365835459ce76eaeb8b2fb5c6e99f46165e02"} Jun 03 19:25:41.577856 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:41.577753 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9cjkr" event={"ID":"7d9d6412-0723-4a6d-be56-80ced04b7f8b","Type":"ContainerStarted","Data":"e2e8d601ad2e53091d97c9e6345918a5f96d6f2098afc9aebf1d45da57b57d52"} Jun 03 19:25:41.577856 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:41.577775 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-9cjkr" Jun 03 19:25:41.580865 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:41.580808 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/40e0a014-fe06-4a46-a304-d4a13e716958-bound-sa-token\") pod \"image-registry-5894578676-qzb6c\" (UID: \"40e0a014-fe06-4a46-a304-d4a13e716958\") " pod="openshift-image-registry/image-registry-5894578676-qzb6c" Jun 03 19:25:41.581107 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:41.581090 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wf2cp"] Jun 03 19:25:41.584244 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:41.584219 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdbsd\" (UniqueName: \"kubernetes.io/projected/40e0a014-fe06-4a46-a304-d4a13e716958-kube-api-access-cdbsd\") pod \"image-registry-5894578676-qzb6c\" (UID: \"40e0a014-fe06-4a46-a304-d4a13e716958\") " pod="openshift-image-registry/image-registry-5894578676-qzb6c" Jun 03 19:25:41.584503 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:25:41.584450 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c95cea0_9fb2_40ad_aeb3_004a9c0927eb.slice/crio-f00661d88330923afa39e1d4f393a329e364c73fe409c30f4ff039b75bbb1547 WatchSource:0}: Error finding container f00661d88330923afa39e1d4f393a329e364c73fe409c30f4ff039b75bbb1547: Status 404 returned error can't find the container with id f00661d88330923afa39e1d4f393a329e364c73fe409c30f4ff039b75bbb1547 Jun 03 19:25:41.592018 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:41.591998 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5894578676-qzb6c" Jun 03 19:25:41.604698 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:41.604643 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-9cjkr" podStartSLOduration=251.125209673 podStartE2EDuration="4m12.604612674s" totalImagesPullingTime="1.479403001s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:21:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:25:41.603987669 +0000 UTC m=+288.449647084" watchObservedRunningTime="2026-06-03 19:25:41.604612674 +0000 UTC m=+288.450272090" Jun 03 19:25:41.732356 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:41.732250 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5894578676-qzb6c"] Jun 03 19:25:41.735846 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:25:41.735808 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40e0a014_fe06_4a46_a304_d4a13e716958.slice/crio-eb3cf0c963f3260dcf09ceb1d23fbee346e3d886d3e020af49883d836c0ad987 WatchSource:0}: Error finding container eb3cf0c963f3260dcf09ceb1d23fbee346e3d886d3e020af49883d836c0ad987: Status 404 returned error can't find the container with id eb3cf0c963f3260dcf09ceb1d23fbee346e3d886d3e020af49883d836c0ad987 Jun 03 19:25:42.582425 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:42.582386 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5894578676-qzb6c" event={"ID":"40e0a014-fe06-4a46-a304-d4a13e716958","Type":"ContainerStarted","Data":"853e28fe642ed538cda7a294049ec8ec37cf974fa30e0b1e054afc0c4a02d9c3"} Jun 03 19:25:42.582425 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:42.582434 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5894578676-qzb6c" event={"ID":"40e0a014-fe06-4a46-a304-d4a13e716958","Type":"ContainerStarted","Data":"eb3cf0c963f3260dcf09ceb1d23fbee346e3d886d3e020af49883d836c0ad987"} Jun 03 19:25:42.582929 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:42.582504 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5894578676-qzb6c" Jun 03 19:25:42.584257 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:42.584231 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wf2cp" event={"ID":"2c95cea0-9fb2-40ad-aeb3-004a9c0927eb","Type":"ContainerStarted","Data":"c532a83fd754c62ef6bb46cb546892b534abb768ff993067b496fe50b383d954"} Jun 03 19:25:42.584381 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:42.584305 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wf2cp" event={"ID":"2c95cea0-9fb2-40ad-aeb3-004a9c0927eb","Type":"ContainerStarted","Data":"936815c0b1808bc4941a516e3ac883c7c7e61669ed0502f9280b837860b309b7"} Jun 03 19:25:42.584381 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:42.584336 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wf2cp" event={"ID":"2c95cea0-9fb2-40ad-aeb3-004a9c0927eb","Type":"ContainerStarted","Data":"f00661d88330923afa39e1d4f393a329e364c73fe409c30f4ff039b75bbb1547"} Jun 03 19:25:42.605698 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:42.605633 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5894578676-qzb6c" podStartSLOduration=1.605616022 podStartE2EDuration="1.605616022s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:25:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:25:42.605162436 +0000 UTC m=+289.450821851" watchObservedRunningTime="2026-06-03 19:25:42.605616022 +0000 UTC m=+289.451275436" Jun 03 19:25:42.859373 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:42.859259 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85bd8fd97d-jrw5d" Jun 03 19:25:42.859373 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:42.859346 2579 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-85bd8fd97d-jrw5d" Jun 03 19:25:42.859690 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:42.859675 2579 scope.go:117] "RemoveContainer" containerID="262cec2a932c13ebee51b6d9ec592273444dff685efe5dc508a7b853e7451c25" Jun 03 19:25:42.859855 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:25:42.859835 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-85bd8fd97d-jrw5d_openshift-console-operator(b76503e3-1d27-4456-b636-148e6e9d14b2)\"" pod="openshift-console-operator/console-operator-85bd8fd97d-jrw5d" podUID="b76503e3-1d27-4456-b636-148e6e9d14b2" Jun 03 19:25:44.598159 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:44.598110 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wf2cp" event={"ID":"2c95cea0-9fb2-40ad-aeb3-004a9c0927eb","Type":"ContainerStarted","Data":"1e848c783318463a6bd052c681dd1e4ccf38a5edef074d4d164ffc45ea51926b"} Jun 03 19:25:44.619677 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:44.619621 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-wf2cp" podStartSLOduration=1.210718088 podStartE2EDuration="3.619602985s" totalImagesPullingTime="2.408884897s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:25:41 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:25:44.619149906 +0000 UTC m=+291.464809321" watchObservedRunningTime="2026-06-03 19:25:44.619602985 +0000 UTC m=+291.465262400" Jun 03 19:25:48.604177 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:25:48.604132 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-xpvdz" podUID="e0ed8e87-e724-4880-a4e8-fe68533db02a" Jun 03 19:25:51.586859 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:51.586824 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-9cjkr" Jun 03 19:25:53.534129 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:53.534092 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-jrw5d_b76503e3-1d27-4456-b636-148e6e9d14b2/console-operator/2.log" Jun 03 19:25:53.534869 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:53.534843 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-jrw5d_b76503e3-1d27-4456-b636-148e6e9d14b2/console-operator/2.log" Jun 03 19:25:53.545261 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:53.545232 2579 kubelet.go:1648] "Image garbage collection succeeded" Jun 03 19:25:53.605318 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:53.605152 2579 scope.go:117] "RemoveContainer" containerID="262cec2a932c13ebee51b6d9ec592273444dff685efe5dc508a7b853e7451c25" Jun 03 19:25:53.615017 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:25:53.605321 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-85bd8fd97d-jrw5d_openshift-console-operator(b76503e3-1d27-4456-b636-148e6e9d14b2)\"" pod="openshift-console-operator/console-operator-85bd8fd97d-jrw5d" podUID="b76503e3-1d27-4456-b636-148e6e9d14b2" Jun 03 19:25:54.809649 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:54.809611 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-2859r"] Jun 03 19:25:54.812712 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:54.812687 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2859r" Jun 03 19:25:54.815466 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:54.815443 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 03 19:25:54.815591 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:54.815520 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-fmdrk\"" Jun 03 19:25:54.815931 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:54.815911 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 03 19:25:54.816478 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:54.816461 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 03 19:25:54.816534 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:54.816470 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 03 19:25:54.816584 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:54.816565 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 03 19:25:54.816781 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:54.816767 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 03 19:25:54.865024 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:54.864984 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ae51ab15-b7d0-43ba-818e-2c19f3c5f00f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2859r\" (UID: \"ae51ab15-b7d0-43ba-818e-2c19f3c5f00f\") " pod="openshift-monitoring/node-exporter-2859r" Jun 03 19:25:54.865024 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:54.865026 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ae51ab15-b7d0-43ba-818e-2c19f3c5f00f-node-exporter-tls\") pod \"node-exporter-2859r\" (UID: \"ae51ab15-b7d0-43ba-818e-2c19f3c5f00f\") " pod="openshift-monitoring/node-exporter-2859r" Jun 03 19:25:54.865280 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:54.865043 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqvf4\" (UniqueName: \"kubernetes.io/projected/ae51ab15-b7d0-43ba-818e-2c19f3c5f00f-kube-api-access-cqvf4\") pod \"node-exporter-2859r\" (UID: \"ae51ab15-b7d0-43ba-818e-2c19f3c5f00f\") " pod="openshift-monitoring/node-exporter-2859r" Jun 03 19:25:54.865280 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:54.865064 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ae51ab15-b7d0-43ba-818e-2c19f3c5f00f-root\") pod \"node-exporter-2859r\" (UID: \"ae51ab15-b7d0-43ba-818e-2c19f3c5f00f\") " pod="openshift-monitoring/node-exporter-2859r" Jun 03 19:25:54.865280 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:54.865173 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ae51ab15-b7d0-43ba-818e-2c19f3c5f00f-sys\") pod \"node-exporter-2859r\" (UID: \"ae51ab15-b7d0-43ba-818e-2c19f3c5f00f\") " pod="openshift-monitoring/node-exporter-2859r" Jun 03 19:25:54.865280 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:54.865212 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ae51ab15-b7d0-43ba-818e-2c19f3c5f00f-node-exporter-wtmp\") pod \"node-exporter-2859r\" (UID: \"ae51ab15-b7d0-43ba-818e-2c19f3c5f00f\") " pod="openshift-monitoring/node-exporter-2859r" Jun 03 19:25:54.865280 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:54.865273 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ae51ab15-b7d0-43ba-818e-2c19f3c5f00f-node-exporter-accelerators-collector-config\") pod \"node-exporter-2859r\" (UID: \"ae51ab15-b7d0-43ba-818e-2c19f3c5f00f\") " pod="openshift-monitoring/node-exporter-2859r" Jun 03 19:25:54.865500 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:54.865338 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae51ab15-b7d0-43ba-818e-2c19f3c5f00f-metrics-client-ca\") pod \"node-exporter-2859r\" (UID: \"ae51ab15-b7d0-43ba-818e-2c19f3c5f00f\") " pod="openshift-monitoring/node-exporter-2859r" Jun 03 19:25:54.865500 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:54.865359 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ae51ab15-b7d0-43ba-818e-2c19f3c5f00f-node-exporter-textfile\") pod \"node-exporter-2859r\" (UID: \"ae51ab15-b7d0-43ba-818e-2c19f3c5f00f\") " pod="openshift-monitoring/node-exporter-2859r" Jun 03 19:25:54.966669 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:54.966628 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ae51ab15-b7d0-43ba-818e-2c19f3c5f00f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2859r\" (UID: \"ae51ab15-b7d0-43ba-818e-2c19f3c5f00f\") " pod="openshift-monitoring/node-exporter-2859r" Jun 03 19:25:54.966669 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:54.966672 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ae51ab15-b7d0-43ba-818e-2c19f3c5f00f-node-exporter-tls\") pod \"node-exporter-2859r\" (UID: \"ae51ab15-b7d0-43ba-818e-2c19f3c5f00f\") " pod="openshift-monitoring/node-exporter-2859r" Jun 03 19:25:54.966871 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:54.966699 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqvf4\" (UniqueName: \"kubernetes.io/projected/ae51ab15-b7d0-43ba-818e-2c19f3c5f00f-kube-api-access-cqvf4\") pod \"node-exporter-2859r\" (UID: \"ae51ab15-b7d0-43ba-818e-2c19f3c5f00f\") " pod="openshift-monitoring/node-exporter-2859r" Jun 03 19:25:54.966871 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:25:54.966799 2579 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 03 19:25:54.966940 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:54.966866 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ae51ab15-b7d0-43ba-818e-2c19f3c5f00f-root\") pod \"node-exporter-2859r\" (UID: \"ae51ab15-b7d0-43ba-818e-2c19f3c5f00f\") " pod="openshift-monitoring/node-exporter-2859r" Jun 03 19:25:54.966940 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:54.966930 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ae51ab15-b7d0-43ba-818e-2c19f3c5f00f-sys\") pod \"node-exporter-2859r\" (UID: \"ae51ab15-b7d0-43ba-818e-2c19f3c5f00f\") " pod="openshift-monitoring/node-exporter-2859r" Jun 03 19:25:54.967037 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:54.966947 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ae51ab15-b7d0-43ba-818e-2c19f3c5f00f-node-exporter-wtmp\") pod \"node-exporter-2859r\" (UID: \"ae51ab15-b7d0-43ba-818e-2c19f3c5f00f\") " pod="openshift-monitoring/node-exporter-2859r" Jun 03 19:25:54.967037 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:54.966973 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ae51ab15-b7d0-43ba-818e-2c19f3c5f00f-root\") pod \"node-exporter-2859r\" (UID: \"ae51ab15-b7d0-43ba-818e-2c19f3c5f00f\") " pod="openshift-monitoring/node-exporter-2859r" Jun 03 19:25:54.967037 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:25:54.966984 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae51ab15-b7d0-43ba-818e-2c19f3c5f00f-node-exporter-tls podName:ae51ab15-b7d0-43ba-818e-2c19f3c5f00f nodeName:}" failed. No retries permitted until 2026-06-03 19:25:55.466951131 +0000 UTC m=+302.312610534 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/ae51ab15-b7d0-43ba-818e-2c19f3c5f00f-node-exporter-tls") pod "node-exporter-2859r" (UID: "ae51ab15-b7d0-43ba-818e-2c19f3c5f00f") : secret "node-exporter-tls" not found Jun 03 19:25:54.967037 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:54.966984 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ae51ab15-b7d0-43ba-818e-2c19f3c5f00f-sys\") pod \"node-exporter-2859r\" (UID: \"ae51ab15-b7d0-43ba-818e-2c19f3c5f00f\") " pod="openshift-monitoring/node-exporter-2859r" Jun 03 19:25:54.967221 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:54.967042 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ae51ab15-b7d0-43ba-818e-2c19f3c5f00f-node-exporter-accelerators-collector-config\") pod \"node-exporter-2859r\" (UID: \"ae51ab15-b7d0-43ba-818e-2c19f3c5f00f\") " pod="openshift-monitoring/node-exporter-2859r" Jun 03 19:25:54.967221 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:54.967051 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ae51ab15-b7d0-43ba-818e-2c19f3c5f00f-node-exporter-wtmp\") pod \"node-exporter-2859r\" (UID: \"ae51ab15-b7d0-43ba-818e-2c19f3c5f00f\") " pod="openshift-monitoring/node-exporter-2859r" Jun 03 19:25:54.967221 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:54.967077 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae51ab15-b7d0-43ba-818e-2c19f3c5f00f-metrics-client-ca\") pod \"node-exporter-2859r\" (UID: \"ae51ab15-b7d0-43ba-818e-2c19f3c5f00f\") " pod="openshift-monitoring/node-exporter-2859r" Jun 03 19:25:54.967221 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:54.967212 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ae51ab15-b7d0-43ba-818e-2c19f3c5f00f-node-exporter-textfile\") pod \"node-exporter-2859r\" (UID: \"ae51ab15-b7d0-43ba-818e-2c19f3c5f00f\") " pod="openshift-monitoring/node-exporter-2859r" Jun 03 19:25:54.967517 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:54.967496 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ae51ab15-b7d0-43ba-818e-2c19f3c5f00f-node-exporter-textfile\") pod \"node-exporter-2859r\" (UID: \"ae51ab15-b7d0-43ba-818e-2c19f3c5f00f\") " pod="openshift-monitoring/node-exporter-2859r" Jun 03 19:25:54.967650 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:54.967634 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae51ab15-b7d0-43ba-818e-2c19f3c5f00f-metrics-client-ca\") pod \"node-exporter-2859r\" (UID: \"ae51ab15-b7d0-43ba-818e-2c19f3c5f00f\") " pod="openshift-monitoring/node-exporter-2859r" Jun 03 19:25:54.967772 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:54.967749 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ae51ab15-b7d0-43ba-818e-2c19f3c5f00f-node-exporter-accelerators-collector-config\") pod \"node-exporter-2859r\" (UID: \"ae51ab15-b7d0-43ba-818e-2c19f3c5f00f\") " pod="openshift-monitoring/node-exporter-2859r" Jun 03 19:25:54.969220 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:54.969199 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ae51ab15-b7d0-43ba-818e-2c19f3c5f00f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2859r\" (UID: \"ae51ab15-b7d0-43ba-818e-2c19f3c5f00f\") " pod="openshift-monitoring/node-exporter-2859r" Jun 03 19:25:54.978836 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:54.978808 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqvf4\" (UniqueName: \"kubernetes.io/projected/ae51ab15-b7d0-43ba-818e-2c19f3c5f00f-kube-api-access-cqvf4\") pod \"node-exporter-2859r\" (UID: \"ae51ab15-b7d0-43ba-818e-2c19f3c5f00f\") " pod="openshift-monitoring/node-exporter-2859r" Jun 03 19:25:55.471237 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:55.471204 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ae51ab15-b7d0-43ba-818e-2c19f3c5f00f-node-exporter-tls\") pod \"node-exporter-2859r\" (UID: \"ae51ab15-b7d0-43ba-818e-2c19f3c5f00f\") " pod="openshift-monitoring/node-exporter-2859r" Jun 03 19:25:55.473615 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:55.473590 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ae51ab15-b7d0-43ba-818e-2c19f3c5f00f-node-exporter-tls\") pod \"node-exporter-2859r\" (UID: \"ae51ab15-b7d0-43ba-818e-2c19f3c5f00f\") " pod="openshift-monitoring/node-exporter-2859r" Jun 03 19:25:55.722996 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:55.722906 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2859r" Jun 03 19:25:55.735962 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:25:55.735917 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae51ab15_b7d0_43ba_818e_2c19f3c5f00f.slice/crio-230c96cfe52e48e3004b2f4765b3322497d36cad361064d47d61728819f14ea6 WatchSource:0}: Error finding container 230c96cfe52e48e3004b2f4765b3322497d36cad361064d47d61728819f14ea6: Status 404 returned error can't find the container with id 230c96cfe52e48e3004b2f4765b3322497d36cad361064d47d61728819f14ea6 Jun 03 19:25:55.737913 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:55.737893 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 19:25:56.639323 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:56.639274 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2859r" event={"ID":"ae51ab15-b7d0-43ba-818e-2c19f3c5f00f","Type":"ContainerStarted","Data":"dbb329a50979c41e8bab994e859550cddb681d6e4e44f0641c0d12e93bfaa9f1"} Jun 03 19:25:56.639692 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:56.639351 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2859r" event={"ID":"ae51ab15-b7d0-43ba-818e-2c19f3c5f00f","Type":"ContainerStarted","Data":"230c96cfe52e48e3004b2f4765b3322497d36cad361064d47d61728819f14ea6"} Jun 03 19:25:56.801942 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:56.801835 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-db8b7bf4b-vm4k6"] Jun 03 19:25:56.805137 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:56.805111 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-db8b7bf4b-vm4k6" Jun 03 19:25:56.808493 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:56.808467 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-fv3m7meqpdv6p\"" Jun 03 19:25:56.808654 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:56.808472 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 03 19:25:56.808783 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:56.808767 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 03 19:25:56.808911 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:56.808897 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 03 19:25:56.809004 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:56.808970 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-vxb7n\"" Jun 03 19:25:56.809082 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:56.808989 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 03 19:25:56.811089 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:56.811072 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 03 19:25:56.837283 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:56.837246 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-db8b7bf4b-vm4k6"] Jun 03 19:25:56.884768 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:56.884723 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ebea4b18-499b-4be4-b2b3-ae82442dcc77-metrics-client-ca\") pod \"thanos-querier-db8b7bf4b-vm4k6\" (UID: \"ebea4b18-499b-4be4-b2b3-ae82442dcc77\") " pod="openshift-monitoring/thanos-querier-db8b7bf4b-vm4k6" Jun 03 19:25:56.884959 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:56.884796 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ebea4b18-499b-4be4-b2b3-ae82442dcc77-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-db8b7bf4b-vm4k6\" (UID: \"ebea4b18-499b-4be4-b2b3-ae82442dcc77\") " pod="openshift-monitoring/thanos-querier-db8b7bf4b-vm4k6" Jun 03 19:25:56.884959 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:56.884843 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kj5dh\" (UniqueName: \"kubernetes.io/projected/ebea4b18-499b-4be4-b2b3-ae82442dcc77-kube-api-access-kj5dh\") pod \"thanos-querier-db8b7bf4b-vm4k6\" (UID: \"ebea4b18-499b-4be4-b2b3-ae82442dcc77\") " pod="openshift-monitoring/thanos-querier-db8b7bf4b-vm4k6" Jun 03 19:25:56.884959 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:56.884878 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ebea4b18-499b-4be4-b2b3-ae82442dcc77-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-db8b7bf4b-vm4k6\" (UID: \"ebea4b18-499b-4be4-b2b3-ae82442dcc77\") " pod="openshift-monitoring/thanos-querier-db8b7bf4b-vm4k6" Jun 03 19:25:56.884959 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:56.884911 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ebea4b18-499b-4be4-b2b3-ae82442dcc77-secret-grpc-tls\") pod \"thanos-querier-db8b7bf4b-vm4k6\" (UID: \"ebea4b18-499b-4be4-b2b3-ae82442dcc77\") " pod="openshift-monitoring/thanos-querier-db8b7bf4b-vm4k6" Jun 03 19:25:56.884959 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:56.884951 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ebea4b18-499b-4be4-b2b3-ae82442dcc77-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-db8b7bf4b-vm4k6\" (UID: \"ebea4b18-499b-4be4-b2b3-ae82442dcc77\") " pod="openshift-monitoring/thanos-querier-db8b7bf4b-vm4k6" Jun 03 19:25:56.885123 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:56.884974 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ebea4b18-499b-4be4-b2b3-ae82442dcc77-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-db8b7bf4b-vm4k6\" (UID: \"ebea4b18-499b-4be4-b2b3-ae82442dcc77\") " pod="openshift-monitoring/thanos-querier-db8b7bf4b-vm4k6" Jun 03 19:25:56.885123 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:56.885010 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ebea4b18-499b-4be4-b2b3-ae82442dcc77-secret-thanos-querier-tls\") pod \"thanos-querier-db8b7bf4b-vm4k6\" (UID: \"ebea4b18-499b-4be4-b2b3-ae82442dcc77\") " pod="openshift-monitoring/thanos-querier-db8b7bf4b-vm4k6" Jun 03 19:25:56.985837 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:56.985796 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ebea4b18-499b-4be4-b2b3-ae82442dcc77-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-db8b7bf4b-vm4k6\" (UID: \"ebea4b18-499b-4be4-b2b3-ae82442dcc77\") " pod="openshift-monitoring/thanos-querier-db8b7bf4b-vm4k6" Jun 03 19:25:56.985837 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:56.985842 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ebea4b18-499b-4be4-b2b3-ae82442dcc77-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-db8b7bf4b-vm4k6\" (UID: \"ebea4b18-499b-4be4-b2b3-ae82442dcc77\") " pod="openshift-monitoring/thanos-querier-db8b7bf4b-vm4k6" Jun 03 19:25:56.986044 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:56.985873 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ebea4b18-499b-4be4-b2b3-ae82442dcc77-secret-thanos-querier-tls\") pod \"thanos-querier-db8b7bf4b-vm4k6\" (UID: \"ebea4b18-499b-4be4-b2b3-ae82442dcc77\") " pod="openshift-monitoring/thanos-querier-db8b7bf4b-vm4k6" Jun 03 19:25:56.986044 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:56.985915 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ebea4b18-499b-4be4-b2b3-ae82442dcc77-metrics-client-ca\") pod \"thanos-querier-db8b7bf4b-vm4k6\" (UID: \"ebea4b18-499b-4be4-b2b3-ae82442dcc77\") " pod="openshift-monitoring/thanos-querier-db8b7bf4b-vm4k6" Jun 03 19:25:56.986044 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:56.985937 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ebea4b18-499b-4be4-b2b3-ae82442dcc77-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-db8b7bf4b-vm4k6\" (UID: \"ebea4b18-499b-4be4-b2b3-ae82442dcc77\") " pod="openshift-monitoring/thanos-querier-db8b7bf4b-vm4k6" Jun 03 19:25:56.986044 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:56.985953 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kj5dh\" (UniqueName: \"kubernetes.io/projected/ebea4b18-499b-4be4-b2b3-ae82442dcc77-kube-api-access-kj5dh\") pod \"thanos-querier-db8b7bf4b-vm4k6\" (UID: \"ebea4b18-499b-4be4-b2b3-ae82442dcc77\") " pod="openshift-monitoring/thanos-querier-db8b7bf4b-vm4k6" Jun 03 19:25:56.986231 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:56.986098 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ebea4b18-499b-4be4-b2b3-ae82442dcc77-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-db8b7bf4b-vm4k6\" (UID: \"ebea4b18-499b-4be4-b2b3-ae82442dcc77\") " pod="openshift-monitoring/thanos-querier-db8b7bf4b-vm4k6" Jun 03 19:25:56.986231 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:56.986143 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ebea4b18-499b-4be4-b2b3-ae82442dcc77-secret-grpc-tls\") pod \"thanos-querier-db8b7bf4b-vm4k6\" (UID: \"ebea4b18-499b-4be4-b2b3-ae82442dcc77\") " pod="openshift-monitoring/thanos-querier-db8b7bf4b-vm4k6" Jun 03 19:25:56.987053 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:56.987003 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ebea4b18-499b-4be4-b2b3-ae82442dcc77-metrics-client-ca\") pod \"thanos-querier-db8b7bf4b-vm4k6\" (UID: \"ebea4b18-499b-4be4-b2b3-ae82442dcc77\") " pod="openshift-monitoring/thanos-querier-db8b7bf4b-vm4k6" Jun 03 19:25:56.988878 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:56.988821 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ebea4b18-499b-4be4-b2b3-ae82442dcc77-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-db8b7bf4b-vm4k6\" (UID: \"ebea4b18-499b-4be4-b2b3-ae82442dcc77\") " pod="openshift-monitoring/thanos-querier-db8b7bf4b-vm4k6" Jun 03 19:25:56.988991 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:56.988910 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ebea4b18-499b-4be4-b2b3-ae82442dcc77-secret-grpc-tls\") pod \"thanos-querier-db8b7bf4b-vm4k6\" (UID: \"ebea4b18-499b-4be4-b2b3-ae82442dcc77\") " pod="openshift-monitoring/thanos-querier-db8b7bf4b-vm4k6" Jun 03 19:25:56.989154 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:56.989130 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ebea4b18-499b-4be4-b2b3-ae82442dcc77-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-db8b7bf4b-vm4k6\" (UID: \"ebea4b18-499b-4be4-b2b3-ae82442dcc77\") " pod="openshift-monitoring/thanos-querier-db8b7bf4b-vm4k6" Jun 03 19:25:56.989252 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:56.989238 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ebea4b18-499b-4be4-b2b3-ae82442dcc77-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-db8b7bf4b-vm4k6\" (UID: \"ebea4b18-499b-4be4-b2b3-ae82442dcc77\") " pod="openshift-monitoring/thanos-querier-db8b7bf4b-vm4k6" Jun 03 19:25:56.989328 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:56.989315 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ebea4b18-499b-4be4-b2b3-ae82442dcc77-secret-thanos-querier-tls\") pod \"thanos-querier-db8b7bf4b-vm4k6\" (UID: \"ebea4b18-499b-4be4-b2b3-ae82442dcc77\") " pod="openshift-monitoring/thanos-querier-db8b7bf4b-vm4k6" Jun 03 19:25:56.989387 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:56.989325 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ebea4b18-499b-4be4-b2b3-ae82442dcc77-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-db8b7bf4b-vm4k6\" (UID: \"ebea4b18-499b-4be4-b2b3-ae82442dcc77\") " pod="openshift-monitoring/thanos-querier-db8b7bf4b-vm4k6" Jun 03 19:25:56.994466 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:56.994442 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kj5dh\" (UniqueName: \"kubernetes.io/projected/ebea4b18-499b-4be4-b2b3-ae82442dcc77-kube-api-access-kj5dh\") pod \"thanos-querier-db8b7bf4b-vm4k6\" (UID: \"ebea4b18-499b-4be4-b2b3-ae82442dcc77\") " pod="openshift-monitoring/thanos-querier-db8b7bf4b-vm4k6" Jun 03 19:25:57.115843 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:57.115729 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-db8b7bf4b-vm4k6" Jun 03 19:25:57.253811 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:57.253739 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-db8b7bf4b-vm4k6"] Jun 03 19:25:57.257654 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:25:57.257625 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebea4b18_499b_4be4_b2b3_ae82442dcc77.slice/crio-521fc1e4ffc2b0cebf049a1401aae728ece4e96192818b2da32e42c79afd9aa4 WatchSource:0}: Error finding container 521fc1e4ffc2b0cebf049a1401aae728ece4e96192818b2da32e42c79afd9aa4: Status 404 returned error can't find the container with id 521fc1e4ffc2b0cebf049a1401aae728ece4e96192818b2da32e42c79afd9aa4 Jun 03 19:25:57.643778 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:57.643745 2579 generic.go:356] "Generic (PLEG): container finished" podID="ae51ab15-b7d0-43ba-818e-2c19f3c5f00f" containerID="dbb329a50979c41e8bab994e859550cddb681d6e4e44f0641c0d12e93bfaa9f1" exitCode=0 Jun 03 19:25:57.644231 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:57.643823 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2859r" event={"ID":"ae51ab15-b7d0-43ba-818e-2c19f3c5f00f","Type":"ContainerDied","Data":"dbb329a50979c41e8bab994e859550cddb681d6e4e44f0641c0d12e93bfaa9f1"} Jun 03 19:25:57.645028 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:57.645008 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-db8b7bf4b-vm4k6" event={"ID":"ebea4b18-499b-4be4-b2b3-ae82442dcc77","Type":"ContainerStarted","Data":"521fc1e4ffc2b0cebf049a1401aae728ece4e96192818b2da32e42c79afd9aa4"} Jun 03 19:25:58.650152 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:58.650116 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2859r" event={"ID":"ae51ab15-b7d0-43ba-818e-2c19f3c5f00f","Type":"ContainerStarted","Data":"7122a2ca4a44127a04fec383161a67e9382a932ed0c0632206522dba414f86f8"} Jun 03 19:25:58.650585 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:58.650172 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2859r" event={"ID":"ae51ab15-b7d0-43ba-818e-2c19f3c5f00f","Type":"ContainerStarted","Data":"e88373478b359a290e92432ede9f2939578f1f1efba76983f6472036a852f98a"} Jun 03 19:25:58.672246 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:58.672196 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-2859r" podStartSLOduration=3.825378941 podStartE2EDuration="4.672177567s" totalImagesPullingTime="770.327873ms" totalInitContainerRuntime="76.470753ms" isStatefulPod=true podCreationTimestamp="2026-06-03 19:25:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:25:58.671183369 +0000 UTC m=+305.516842804" watchObservedRunningTime="2026-06-03 19:25:58.672177567 +0000 UTC m=+305.517836982" Jun 03 19:25:59.257477 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:59.257433 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6c5bb68b96-6sbqt"] Jun 03 19:25:59.260799 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:59.260773 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6c5bb68b96-6sbqt" Jun 03 19:25:59.263411 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:59.263384 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 03 19:25:59.263558 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:59.263418 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 03 19:25:59.263558 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:59.263384 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 03 19:25:59.263558 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:59.263458 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 03 19:25:59.264174 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:59.264154 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-bk8nr\"" Jun 03 19:25:59.264306 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:59.264251 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-58ms8l2gkqih9\"" Jun 03 19:25:59.272386 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:59.272359 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6c5bb68b96-6sbqt"] Jun 03 19:25:59.305938 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:59.305902 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e9b03cd4-cbfc-4f2b-a718-5480fcffa7b8-secret-metrics-server-client-certs\") pod \"metrics-server-6c5bb68b96-6sbqt\" (UID: \"e9b03cd4-cbfc-4f2b-a718-5480fcffa7b8\") " pod="openshift-monitoring/metrics-server-6c5bb68b96-6sbqt" Jun 03 19:25:59.306143 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:59.305964 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtpx9\" (UniqueName: \"kubernetes.io/projected/e9b03cd4-cbfc-4f2b-a718-5480fcffa7b8-kube-api-access-dtpx9\") pod \"metrics-server-6c5bb68b96-6sbqt\" (UID: \"e9b03cd4-cbfc-4f2b-a718-5480fcffa7b8\") " pod="openshift-monitoring/metrics-server-6c5bb68b96-6sbqt" Jun 03 19:25:59.306143 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:59.305994 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e9b03cd4-cbfc-4f2b-a718-5480fcffa7b8-secret-metrics-server-tls\") pod \"metrics-server-6c5bb68b96-6sbqt\" (UID: \"e9b03cd4-cbfc-4f2b-a718-5480fcffa7b8\") " pod="openshift-monitoring/metrics-server-6c5bb68b96-6sbqt" Jun 03 19:25:59.306143 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:59.306023 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9b03cd4-cbfc-4f2b-a718-5480fcffa7b8-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6c5bb68b96-6sbqt\" (UID: \"e9b03cd4-cbfc-4f2b-a718-5480fcffa7b8\") " pod="openshift-monitoring/metrics-server-6c5bb68b96-6sbqt" Jun 03 19:25:59.306143 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:59.306050 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e9b03cd4-cbfc-4f2b-a718-5480fcffa7b8-metrics-server-audit-profiles\") pod \"metrics-server-6c5bb68b96-6sbqt\" (UID: \"e9b03cd4-cbfc-4f2b-a718-5480fcffa7b8\") " pod="openshift-monitoring/metrics-server-6c5bb68b96-6sbqt" Jun 03 19:25:59.306143 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:59.306078 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e9b03cd4-cbfc-4f2b-a718-5480fcffa7b8-client-ca-bundle\") pod \"metrics-server-6c5bb68b96-6sbqt\" (UID: \"e9b03cd4-cbfc-4f2b-a718-5480fcffa7b8\") " pod="openshift-monitoring/metrics-server-6c5bb68b96-6sbqt" Jun 03 19:25:59.306401 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:59.306202 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e9b03cd4-cbfc-4f2b-a718-5480fcffa7b8-audit-log\") pod \"metrics-server-6c5bb68b96-6sbqt\" (UID: \"e9b03cd4-cbfc-4f2b-a718-5480fcffa7b8\") " pod="openshift-monitoring/metrics-server-6c5bb68b96-6sbqt" Jun 03 19:25:59.407335 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:59.407274 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e9b03cd4-cbfc-4f2b-a718-5480fcffa7b8-secret-metrics-server-client-certs\") pod \"metrics-server-6c5bb68b96-6sbqt\" (UID: \"e9b03cd4-cbfc-4f2b-a718-5480fcffa7b8\") " pod="openshift-monitoring/metrics-server-6c5bb68b96-6sbqt" Jun 03 19:25:59.407536 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:59.407374 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtpx9\" (UniqueName: \"kubernetes.io/projected/e9b03cd4-cbfc-4f2b-a718-5480fcffa7b8-kube-api-access-dtpx9\") pod \"metrics-server-6c5bb68b96-6sbqt\" (UID: \"e9b03cd4-cbfc-4f2b-a718-5480fcffa7b8\") " pod="openshift-monitoring/metrics-server-6c5bb68b96-6sbqt" Jun 03 19:25:59.407536 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:59.407411 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e9b03cd4-cbfc-4f2b-a718-5480fcffa7b8-secret-metrics-server-tls\") pod \"metrics-server-6c5bb68b96-6sbqt\" (UID: \"e9b03cd4-cbfc-4f2b-a718-5480fcffa7b8\") " pod="openshift-monitoring/metrics-server-6c5bb68b96-6sbqt" Jun 03 19:25:59.407536 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:59.407441 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9b03cd4-cbfc-4f2b-a718-5480fcffa7b8-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6c5bb68b96-6sbqt\" (UID: \"e9b03cd4-cbfc-4f2b-a718-5480fcffa7b8\") " pod="openshift-monitoring/metrics-server-6c5bb68b96-6sbqt" Jun 03 19:25:59.407536 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:59.407466 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e9b03cd4-cbfc-4f2b-a718-5480fcffa7b8-metrics-server-audit-profiles\") pod \"metrics-server-6c5bb68b96-6sbqt\" (UID: \"e9b03cd4-cbfc-4f2b-a718-5480fcffa7b8\") " pod="openshift-monitoring/metrics-server-6c5bb68b96-6sbqt" Jun 03 19:25:59.407536 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:59.407511 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e9b03cd4-cbfc-4f2b-a718-5480fcffa7b8-client-ca-bundle\") pod \"metrics-server-6c5bb68b96-6sbqt\" (UID: \"e9b03cd4-cbfc-4f2b-a718-5480fcffa7b8\") " pod="openshift-monitoring/metrics-server-6c5bb68b96-6sbqt" Jun 03 19:25:59.407794 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:59.407581 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e9b03cd4-cbfc-4f2b-a718-5480fcffa7b8-audit-log\") pod \"metrics-server-6c5bb68b96-6sbqt\" (UID: \"e9b03cd4-cbfc-4f2b-a718-5480fcffa7b8\") " pod="openshift-monitoring/metrics-server-6c5bb68b96-6sbqt" Jun 03 19:25:59.408022 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:59.407997 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e9b03cd4-cbfc-4f2b-a718-5480fcffa7b8-audit-log\") pod \"metrics-server-6c5bb68b96-6sbqt\" (UID: \"e9b03cd4-cbfc-4f2b-a718-5480fcffa7b8\") " pod="openshift-monitoring/metrics-server-6c5bb68b96-6sbqt" Jun 03 19:25:59.408483 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:59.408458 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9b03cd4-cbfc-4f2b-a718-5480fcffa7b8-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6c5bb68b96-6sbqt\" (UID: \"e9b03cd4-cbfc-4f2b-a718-5480fcffa7b8\") " pod="openshift-monitoring/metrics-server-6c5bb68b96-6sbqt" Jun 03 19:25:59.408575 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:59.408529 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e9b03cd4-cbfc-4f2b-a718-5480fcffa7b8-metrics-server-audit-profiles\") pod \"metrics-server-6c5bb68b96-6sbqt\" (UID: \"e9b03cd4-cbfc-4f2b-a718-5480fcffa7b8\") " pod="openshift-monitoring/metrics-server-6c5bb68b96-6sbqt" Jun 03 19:25:59.410403 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:59.410371 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e9b03cd4-cbfc-4f2b-a718-5480fcffa7b8-secret-metrics-server-client-certs\") pod \"metrics-server-6c5bb68b96-6sbqt\" (UID: \"e9b03cd4-cbfc-4f2b-a718-5480fcffa7b8\") " pod="openshift-monitoring/metrics-server-6c5bb68b96-6sbqt" Jun 03 19:25:59.410593 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:59.410566 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e9b03cd4-cbfc-4f2b-a718-5480fcffa7b8-secret-metrics-server-tls\") pod \"metrics-server-6c5bb68b96-6sbqt\" (UID: \"e9b03cd4-cbfc-4f2b-a718-5480fcffa7b8\") " pod="openshift-monitoring/metrics-server-6c5bb68b96-6sbqt" Jun 03 19:25:59.410759 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:59.410728 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e9b03cd4-cbfc-4f2b-a718-5480fcffa7b8-client-ca-bundle\") pod \"metrics-server-6c5bb68b96-6sbqt\" (UID: \"e9b03cd4-cbfc-4f2b-a718-5480fcffa7b8\") " pod="openshift-monitoring/metrics-server-6c5bb68b96-6sbqt" Jun 03 19:25:59.417061 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:59.417037 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtpx9\" (UniqueName: \"kubernetes.io/projected/e9b03cd4-cbfc-4f2b-a718-5480fcffa7b8-kube-api-access-dtpx9\") pod \"metrics-server-6c5bb68b96-6sbqt\" (UID: \"e9b03cd4-cbfc-4f2b-a718-5480fcffa7b8\") " pod="openshift-monitoring/metrics-server-6c5bb68b96-6sbqt" Jun 03 19:25:59.555165 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:59.555084 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-9b9fc658-9kmnp"] Jun 03 19:25:59.558814 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:59.558790 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-9b9fc658-9kmnp" Jun 03 19:25:59.561445 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:59.561419 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-wbnlg\"" Jun 03 19:25:59.561445 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:59.561424 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 03 19:25:59.565839 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:59.565811 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-9b9fc658-9kmnp"] Jun 03 19:25:59.572443 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:59.572410 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6c5bb68b96-6sbqt" Jun 03 19:25:59.610117 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:59.610079 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgv94\" (UniqueName: \"kubernetes.io/projected/1d2984f3-bc07-4dc5-a5e2-04f1852d5956-kube-api-access-fgv94\") pod \"monitoring-plugin-9b9fc658-9kmnp\" (UID: \"1d2984f3-bc07-4dc5-a5e2-04f1852d5956\") " pod="openshift-monitoring/monitoring-plugin-9b9fc658-9kmnp" Jun 03 19:25:59.610117 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:59.610123 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1d2984f3-bc07-4dc5-a5e2-04f1852d5956-monitoring-plugin-cert\") pod \"monitoring-plugin-9b9fc658-9kmnp\" (UID: \"1d2984f3-bc07-4dc5-a5e2-04f1852d5956\") " pod="openshift-monitoring/monitoring-plugin-9b9fc658-9kmnp" Jun 03 19:25:59.659613 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:59.659582 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-db8b7bf4b-vm4k6" event={"ID":"ebea4b18-499b-4be4-b2b3-ae82442dcc77","Type":"ContainerStarted","Data":"f3e3f80496c2b33cc45447e7db0128a8b00de940f3cd3ba62d608eb4c03fe2de"} Jun 03 19:25:59.711423 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:59.711392 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgv94\" (UniqueName: \"kubernetes.io/projected/1d2984f3-bc07-4dc5-a5e2-04f1852d5956-kube-api-access-fgv94\") pod \"monitoring-plugin-9b9fc658-9kmnp\" (UID: \"1d2984f3-bc07-4dc5-a5e2-04f1852d5956\") " pod="openshift-monitoring/monitoring-plugin-9b9fc658-9kmnp" Jun 03 19:25:59.711572 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:59.711439 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1d2984f3-bc07-4dc5-a5e2-04f1852d5956-monitoring-plugin-cert\") pod \"monitoring-plugin-9b9fc658-9kmnp\" (UID: \"1d2984f3-bc07-4dc5-a5e2-04f1852d5956\") " pod="openshift-monitoring/monitoring-plugin-9b9fc658-9kmnp" Jun 03 19:25:59.714044 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:59.714019 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1d2984f3-bc07-4dc5-a5e2-04f1852d5956-monitoring-plugin-cert\") pod \"monitoring-plugin-9b9fc658-9kmnp\" (UID: \"1d2984f3-bc07-4dc5-a5e2-04f1852d5956\") " pod="openshift-monitoring/monitoring-plugin-9b9fc658-9kmnp" Jun 03 19:25:59.725530 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:59.725492 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgv94\" (UniqueName: \"kubernetes.io/projected/1d2984f3-bc07-4dc5-a5e2-04f1852d5956-kube-api-access-fgv94\") pod \"monitoring-plugin-9b9fc658-9kmnp\" (UID: \"1d2984f3-bc07-4dc5-a5e2-04f1852d5956\") " pod="openshift-monitoring/monitoring-plugin-9b9fc658-9kmnp" Jun 03 19:25:59.729509 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:59.729476 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6c5bb68b96-6sbqt"] Jun 03 19:25:59.735214 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:25:59.735187 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9b03cd4_cbfc_4f2b_a718_5480fcffa7b8.slice/crio-c2532dd0a3110326cae6eebe4fadbe1e51f479914d2b4bb1cda43c3ee4cf20c8 WatchSource:0}: Error finding container c2532dd0a3110326cae6eebe4fadbe1e51f479914d2b4bb1cda43c3ee4cf20c8: Status 404 returned error can't find the container with id c2532dd0a3110326cae6eebe4fadbe1e51f479914d2b4bb1cda43c3ee4cf20c8 Jun 03 19:25:59.869281 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:25:59.869191 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-9b9fc658-9kmnp" Jun 03 19:26:00.008364 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:00.008339 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-9b9fc658-9kmnp"] Jun 03 19:26:00.010580 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:26:00.010558 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d2984f3_bc07_4dc5_a5e2_04f1852d5956.slice/crio-eaac8cbdb0f196c87a8a3b2cf0d956c3c222c8501325bfe1691d7635ef2fb2b4 WatchSource:0}: Error finding container eaac8cbdb0f196c87a8a3b2cf0d956c3c222c8501325bfe1691d7635ef2fb2b4: Status 404 returned error can't find the container with id eaac8cbdb0f196c87a8a3b2cf0d956c3c222c8501325bfe1691d7635ef2fb2b4 Jun 03 19:26:00.666893 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:00.666816 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-9b9fc658-9kmnp" event={"ID":"1d2984f3-bc07-4dc5-a5e2-04f1852d5956","Type":"ContainerStarted","Data":"eaac8cbdb0f196c87a8a3b2cf0d956c3c222c8501325bfe1691d7635ef2fb2b4"} Jun 03 19:26:00.670268 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:00.670227 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-db8b7bf4b-vm4k6" event={"ID":"ebea4b18-499b-4be4-b2b3-ae82442dcc77","Type":"ContainerStarted","Data":"c01211f9b8d8bfc70400b9becd5bf30f67b568bb00637d5c5519e98e57fce760"} Jun 03 19:26:00.670426 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:00.670329 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-db8b7bf4b-vm4k6" event={"ID":"ebea4b18-499b-4be4-b2b3-ae82442dcc77","Type":"ContainerStarted","Data":"804231d5bf4b5eef458478ba943275a2a2846bfe1489c0fd103d862a2740107a"} Jun 03 19:26:00.670426 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:00.670366 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-db8b7bf4b-vm4k6" event={"ID":"ebea4b18-499b-4be4-b2b3-ae82442dcc77","Type":"ContainerStarted","Data":"85fb5f5091ed49b9c97873adaf8e97bf15d5fcbdd60733992b8916079c3052de"} Jun 03 19:26:00.671491 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:00.671460 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6c5bb68b96-6sbqt" event={"ID":"e9b03cd4-cbfc-4f2b-a718-5480fcffa7b8","Type":"ContainerStarted","Data":"c2532dd0a3110326cae6eebe4fadbe1e51f479914d2b4bb1cda43c3ee4cf20c8"} Jun 03 19:26:01.680070 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:01.680035 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-db8b7bf4b-vm4k6" event={"ID":"ebea4b18-499b-4be4-b2b3-ae82442dcc77","Type":"ContainerStarted","Data":"3aac7a955d60ab8112fe552a0dd7b05cf12e4eb4417fa1b8b9366c09ff3a24f9"} Jun 03 19:26:01.680403 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:01.680166 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-db8b7bf4b-vm4k6" event={"ID":"ebea4b18-499b-4be4-b2b3-ae82442dcc77","Type":"ContainerStarted","Data":"42fa4a4b740e69e846c153d1ddf596eedf70aaa6092a27bb81e19c2425b10297"} Jun 03 19:26:01.680403 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:01.680228 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-db8b7bf4b-vm4k6" Jun 03 19:26:01.746372 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:01.746274 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-db8b7bf4b-vm4k6" podStartSLOduration=2.678490508 podStartE2EDuration="5.746251614s" totalImagesPullingTime="3.067761106s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:25:56 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:26:01.74451007 +0000 UTC m=+308.590169485" watchObservedRunningTime="2026-06-03 19:26:01.746251614 +0000 UTC m=+308.591911030" Jun 03 19:26:02.686245 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:02.686203 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6c5bb68b96-6sbqt" event={"ID":"e9b03cd4-cbfc-4f2b-a718-5480fcffa7b8","Type":"ContainerStarted","Data":"442d25d5533b40f1be3c041fb4ccbe30509ff1b72299cf96051c8b9007add5ae"} Jun 03 19:26:02.687817 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:02.687795 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-9b9fc658-9kmnp" event={"ID":"1d2984f3-bc07-4dc5-a5e2-04f1852d5956","Type":"ContainerStarted","Data":"d5556d6d2a87fddae3c9e287d74577a9d11ffb0b530f4cc0c0d5e13c03af8ae1"} Jun 03 19:26:02.688065 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:02.688050 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-9b9fc658-9kmnp" Jun 03 19:26:02.693349 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:02.693326 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-9b9fc658-9kmnp" Jun 03 19:26:02.707148 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:02.707099 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6c5bb68b96-6sbqt" podStartSLOduration=1.793457016 podStartE2EDuration="3.707081363s" totalImagesPullingTime="1.913624347s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:25:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:26:02.706096743 +0000 UTC m=+309.551756158" watchObservedRunningTime="2026-06-03 19:26:02.707081363 +0000 UTC m=+309.552740777" Jun 03 19:26:02.725353 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:02.725280 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-9b9fc658-9kmnp" podStartSLOduration=2.082803024 podStartE2EDuration="3.725263382s" totalImagesPullingTime="1.642460358s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:25:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:26:02.722200936 +0000 UTC m=+309.567860351" watchObservedRunningTime="2026-06-03 19:26:02.725263382 +0000 UTC m=+309.570922797" Jun 03 19:26:03.594965 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:03.594936 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5894578676-qzb6c" Jun 03 19:26:03.603267 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:03.603244 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xpvdz" Jun 03 19:26:04.603821 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:04.603786 2579 scope.go:117] "RemoveContainer" containerID="262cec2a932c13ebee51b6d9ec592273444dff685efe5dc508a7b853e7451c25" Jun 03 19:26:04.698240 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:04.698206 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-jrw5d_b76503e3-1d27-4456-b636-148e6e9d14b2/console-operator/2.log" Jun 03 19:26:04.698432 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:04.698349 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85bd8fd97d-jrw5d" event={"ID":"b76503e3-1d27-4456-b636-148e6e9d14b2","Type":"ContainerStarted","Data":"e75354a39cdc153d4dc44d18bd1f979ca805b778dbb2d3c7a62c3b806dbd912b"} Jun 03 19:26:04.698813 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:04.698788 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85bd8fd97d-jrw5d" Jun 03 19:26:04.700125 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:04.700100 2579 patch_prober.go:28] interesting pod/console-operator-85bd8fd97d-jrw5d container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.133.0.9:8443/readyz\": dial tcp 10.133.0.9:8443: connect: connection refused" start-of-body= Jun 03 19:26:04.700255 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:04.700144 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-85bd8fd97d-jrw5d" podUID="b76503e3-1d27-4456-b636-148e6e9d14b2" containerName="console-operator" probeResult="failure" output="Get \"https://10.133.0.9:8443/readyz\": dial tcp 10.133.0.9:8443: connect: connection refused" Jun 03 19:26:04.717400 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:04.717337 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-85bd8fd97d-jrw5d" podStartSLOduration=49.973814874 podStartE2EDuration="52.717321471s" totalImagesPullingTime="2.743506597s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:25:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:26:04.717018672 +0000 UTC m=+311.562678087" watchObservedRunningTime="2026-06-03 19:26:04.717321471 +0000 UTC m=+311.562980865" Jun 03 19:26:05.706860 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:05.706827 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-85bd8fd97d-jrw5d" Jun 03 19:26:07.693734 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:07.693706 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-db8b7bf4b-vm4k6" Jun 03 19:26:15.263822 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:15.263777 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-649cb55559-v8hhw"] Jun 03 19:26:15.305401 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:15.305359 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-649cb55559-v8hhw"] Jun 03 19:26:15.305589 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:15.305484 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-649cb55559-v8hhw" Jun 03 19:26:15.308515 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:15.308483 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 03 19:26:15.308668 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:15.308554 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 03 19:26:15.308668 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:15.308603 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 03 19:26:15.309544 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:15.309526 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 03 19:26:15.309714 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:15.309702 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 03 19:26:15.309825 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:15.309807 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 03 19:26:15.309870 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:15.309821 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-kv62v\"" Jun 03 19:26:15.309870 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:15.309858 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 03 19:26:15.451905 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:15.451867 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e310587d-9cb6-45d5-8886-bc6e03cb4338-console-config\") pod \"console-649cb55559-v8hhw\" (UID: \"e310587d-9cb6-45d5-8886-bc6e03cb4338\") " pod="openshift-console/console-649cb55559-v8hhw" Jun 03 19:26:15.451905 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:15.451907 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e310587d-9cb6-45d5-8886-bc6e03cb4338-service-ca\") pod \"console-649cb55559-v8hhw\" (UID: \"e310587d-9cb6-45d5-8886-bc6e03cb4338\") " pod="openshift-console/console-649cb55559-v8hhw" Jun 03 19:26:15.452123 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:15.451924 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e310587d-9cb6-45d5-8886-bc6e03cb4338-oauth-serving-cert\") pod \"console-649cb55559-v8hhw\" (UID: \"e310587d-9cb6-45d5-8886-bc6e03cb4338\") " pod="openshift-console/console-649cb55559-v8hhw" Jun 03 19:26:15.452123 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:15.451941 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e310587d-9cb6-45d5-8886-bc6e03cb4338-console-oauth-config\") pod \"console-649cb55559-v8hhw\" (UID: \"e310587d-9cb6-45d5-8886-bc6e03cb4338\") " pod="openshift-console/console-649cb55559-v8hhw" Jun 03 19:26:15.452123 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:15.452066 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e310587d-9cb6-45d5-8886-bc6e03cb4338-console-serving-cert\") pod \"console-649cb55559-v8hhw\" (UID: \"e310587d-9cb6-45d5-8886-bc6e03cb4338\") " pod="openshift-console/console-649cb55559-v8hhw" Jun 03 19:26:15.452123 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:15.452108 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zk84\" (UniqueName: \"kubernetes.io/projected/e310587d-9cb6-45d5-8886-bc6e03cb4338-kube-api-access-7zk84\") pod \"console-649cb55559-v8hhw\" (UID: \"e310587d-9cb6-45d5-8886-bc6e03cb4338\") " pod="openshift-console/console-649cb55559-v8hhw" Jun 03 19:26:15.552609 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:15.552512 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e310587d-9cb6-45d5-8886-bc6e03cb4338-console-config\") pod \"console-649cb55559-v8hhw\" (UID: \"e310587d-9cb6-45d5-8886-bc6e03cb4338\") " pod="openshift-console/console-649cb55559-v8hhw" Jun 03 19:26:15.552609 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:15.552553 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e310587d-9cb6-45d5-8886-bc6e03cb4338-service-ca\") pod \"console-649cb55559-v8hhw\" (UID: \"e310587d-9cb6-45d5-8886-bc6e03cb4338\") " pod="openshift-console/console-649cb55559-v8hhw" Jun 03 19:26:15.552609 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:15.552569 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e310587d-9cb6-45d5-8886-bc6e03cb4338-oauth-serving-cert\") pod \"console-649cb55559-v8hhw\" (UID: \"e310587d-9cb6-45d5-8886-bc6e03cb4338\") " pod="openshift-console/console-649cb55559-v8hhw" Jun 03 19:26:15.552839 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:15.552712 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e310587d-9cb6-45d5-8886-bc6e03cb4338-console-oauth-config\") pod \"console-649cb55559-v8hhw\" (UID: \"e310587d-9cb6-45d5-8886-bc6e03cb4338\") " pod="openshift-console/console-649cb55559-v8hhw" Jun 03 19:26:15.552876 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:15.552838 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e310587d-9cb6-45d5-8886-bc6e03cb4338-console-serving-cert\") pod \"console-649cb55559-v8hhw\" (UID: \"e310587d-9cb6-45d5-8886-bc6e03cb4338\") " pod="openshift-console/console-649cb55559-v8hhw" Jun 03 19:26:15.552922 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:15.552884 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zk84\" (UniqueName: \"kubernetes.io/projected/e310587d-9cb6-45d5-8886-bc6e03cb4338-kube-api-access-7zk84\") pod \"console-649cb55559-v8hhw\" (UID: \"e310587d-9cb6-45d5-8886-bc6e03cb4338\") " pod="openshift-console/console-649cb55559-v8hhw" Jun 03 19:26:15.553408 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:15.553387 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e310587d-9cb6-45d5-8886-bc6e03cb4338-service-ca\") pod \"console-649cb55559-v8hhw\" (UID: \"e310587d-9cb6-45d5-8886-bc6e03cb4338\") " pod="openshift-console/console-649cb55559-v8hhw" Jun 03 19:26:15.553408 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:15.553399 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e310587d-9cb6-45d5-8886-bc6e03cb4338-console-config\") pod \"console-649cb55559-v8hhw\" (UID: \"e310587d-9cb6-45d5-8886-bc6e03cb4338\") " pod="openshift-console/console-649cb55559-v8hhw" Jun 03 19:26:15.553408 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:15.553408 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e310587d-9cb6-45d5-8886-bc6e03cb4338-oauth-serving-cert\") pod \"console-649cb55559-v8hhw\" (UID: \"e310587d-9cb6-45d5-8886-bc6e03cb4338\") " pod="openshift-console/console-649cb55559-v8hhw" Jun 03 19:26:15.555345 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:15.555324 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e310587d-9cb6-45d5-8886-bc6e03cb4338-console-serving-cert\") pod \"console-649cb55559-v8hhw\" (UID: \"e310587d-9cb6-45d5-8886-bc6e03cb4338\") " pod="openshift-console/console-649cb55559-v8hhw" Jun 03 19:26:15.555449 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:15.555356 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e310587d-9cb6-45d5-8886-bc6e03cb4338-console-oauth-config\") pod \"console-649cb55559-v8hhw\" (UID: \"e310587d-9cb6-45d5-8886-bc6e03cb4338\") " pod="openshift-console/console-649cb55559-v8hhw" Jun 03 19:26:15.563712 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:15.563686 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zk84\" (UniqueName: \"kubernetes.io/projected/e310587d-9cb6-45d5-8886-bc6e03cb4338-kube-api-access-7zk84\") pod \"console-649cb55559-v8hhw\" (UID: \"e310587d-9cb6-45d5-8886-bc6e03cb4338\") " pod="openshift-console/console-649cb55559-v8hhw" Jun 03 19:26:15.614774 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:15.614738 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-649cb55559-v8hhw" Jun 03 19:26:15.778798 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:15.778764 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-649cb55559-v8hhw"] Jun 03 19:26:15.781812 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:26:15.781783 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode310587d_9cb6_45d5_8886_bc6e03cb4338.slice/crio-7e2b0c9e03a89aaabee3d506fddb9d48a85b971731ab459c7c57e36ffa9ad807 WatchSource:0}: Error finding container 7e2b0c9e03a89aaabee3d506fddb9d48a85b971731ab459c7c57e36ffa9ad807: Status 404 returned error can't find the container with id 7e2b0c9e03a89aaabee3d506fddb9d48a85b971731ab459c7c57e36ffa9ad807 Jun 03 19:26:16.595728 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:26:16.595680 2579 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: Download config.json digest sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 does not match expected sha256:4dc2854fdd15ffc6e3bf686c9dfe033471e552e83817afd539bb054b7c1ef91c; artifact err: provided artifact is a container image" image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7ac997e89e957f364dd6de4214af90a8e10714b0729262981154cb014dc1c2fc" Jun 03 19:26:16.596127 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:26:16.595817 2579 kuberuntime_manager.go:1459] "Unhandled Error" err="container console start failed in pod console-649cb55559-v8hhw_openshift-console(e310587d-9cb6-45d5-8886-bc6e03cb4338): ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: Download config.json digest sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 does not match expected sha256:4dc2854fdd15ffc6e3bf686c9dfe033471e552e83817afd539bb054b7c1ef91c; artifact err: provided artifact is a container image" logger="UnhandledError" Jun 03 19:26:16.596127 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:26:16.595866 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: Download config.json digest sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 does not match expected sha256:4dc2854fdd15ffc6e3bf686c9dfe033471e552e83817afd539bb054b7c1ef91c; artifact err: provided artifact is a container image\"" pod="openshift-console/console-649cb55559-v8hhw" podUID="e310587d-9cb6-45d5-8886-bc6e03cb4338" Jun 03 19:26:16.742474 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:16.742377 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-649cb55559-v8hhw" event={"ID":"e310587d-9cb6-45d5-8886-bc6e03cb4338","Type":"ContainerStarted","Data":"7e2b0c9e03a89aaabee3d506fddb9d48a85b971731ab459c7c57e36ffa9ad807"} Jun 03 19:26:16.743679 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:26:16.743647 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7ac997e89e957f364dd6de4214af90a8e10714b0729262981154cb014dc1c2fc\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: Download config.json digest sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 does not match expected sha256:4dc2854fdd15ffc6e3bf686c9dfe033471e552e83817afd539bb054b7c1ef91c; artifact err: provided artifact is a container image\"" pod="openshift-console/console-649cb55559-v8hhw" podUID="e310587d-9cb6-45d5-8886-bc6e03cb4338" Jun 03 19:26:17.747395 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:26:17.747366 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7ac997e89e957f364dd6de4214af90a8e10714b0729262981154cb014dc1c2fc\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: Download config.json digest sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 does not match expected sha256:4dc2854fdd15ffc6e3bf686c9dfe033471e552e83817afd539bb054b7c1ef91c; artifact err: provided artifact is a container image\"" pod="openshift-console/console-649cb55559-v8hhw" podUID="e310587d-9cb6-45d5-8886-bc6e03cb4338" Jun 03 19:26:19.572885 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:19.572831 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6c5bb68b96-6sbqt" Jun 03 19:26:19.573321 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:19.572912 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6c5bb68b96-6sbqt" Jun 03 19:26:24.643726 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:24.643693 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5cd84c5d6c-8t6hg"] Jun 03 19:26:24.646422 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:24.646392 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cd84c5d6c-8t6hg" Jun 03 19:26:24.656606 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:24.656570 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 03 19:26:24.659830 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:24.659799 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cd84c5d6c-8t6hg"] Jun 03 19:26:24.736269 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:24.736229 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/adf2ce3b-214b-4986-8373-dea927c89b08-service-ca\") pod \"console-5cd84c5d6c-8t6hg\" (UID: \"adf2ce3b-214b-4986-8373-dea927c89b08\") " pod="openshift-console/console-5cd84c5d6c-8t6hg" Jun 03 19:26:24.736269 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:24.736269 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/adf2ce3b-214b-4986-8373-dea927c89b08-oauth-serving-cert\") pod \"console-5cd84c5d6c-8t6hg\" (UID: \"adf2ce3b-214b-4986-8373-dea927c89b08\") " pod="openshift-console/console-5cd84c5d6c-8t6hg" Jun 03 19:26:24.736509 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:24.736317 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/adf2ce3b-214b-4986-8373-dea927c89b08-console-serving-cert\") pod \"console-5cd84c5d6c-8t6hg\" (UID: \"adf2ce3b-214b-4986-8373-dea927c89b08\") " pod="openshift-console/console-5cd84c5d6c-8t6hg" Jun 03 19:26:24.736509 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:24.736344 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/adf2ce3b-214b-4986-8373-dea927c89b08-console-config\") pod \"console-5cd84c5d6c-8t6hg\" (UID: \"adf2ce3b-214b-4986-8373-dea927c89b08\") " pod="openshift-console/console-5cd84c5d6c-8t6hg" Jun 03 19:26:24.736509 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:24.736389 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbs2h\" (UniqueName: \"kubernetes.io/projected/adf2ce3b-214b-4986-8373-dea927c89b08-kube-api-access-dbs2h\") pod \"console-5cd84c5d6c-8t6hg\" (UID: \"adf2ce3b-214b-4986-8373-dea927c89b08\") " pod="openshift-console/console-5cd84c5d6c-8t6hg" Jun 03 19:26:24.736509 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:24.736408 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/adf2ce3b-214b-4986-8373-dea927c89b08-trusted-ca-bundle\") pod \"console-5cd84c5d6c-8t6hg\" (UID: \"adf2ce3b-214b-4986-8373-dea927c89b08\") " pod="openshift-console/console-5cd84c5d6c-8t6hg" Jun 03 19:26:24.736509 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:24.736477 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/adf2ce3b-214b-4986-8373-dea927c89b08-console-oauth-config\") pod \"console-5cd84c5d6c-8t6hg\" (UID: \"adf2ce3b-214b-4986-8373-dea927c89b08\") " pod="openshift-console/console-5cd84c5d6c-8t6hg" Jun 03 19:26:24.837377 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:24.837315 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/adf2ce3b-214b-4986-8373-dea927c89b08-console-oauth-config\") pod \"console-5cd84c5d6c-8t6hg\" (UID: \"adf2ce3b-214b-4986-8373-dea927c89b08\") " pod="openshift-console/console-5cd84c5d6c-8t6hg" Jun 03 19:26:24.837579 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:24.837452 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/adf2ce3b-214b-4986-8373-dea927c89b08-service-ca\") pod \"console-5cd84c5d6c-8t6hg\" (UID: \"adf2ce3b-214b-4986-8373-dea927c89b08\") " pod="openshift-console/console-5cd84c5d6c-8t6hg" Jun 03 19:26:24.837579 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:24.837481 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/adf2ce3b-214b-4986-8373-dea927c89b08-oauth-serving-cert\") pod \"console-5cd84c5d6c-8t6hg\" (UID: \"adf2ce3b-214b-4986-8373-dea927c89b08\") " pod="openshift-console/console-5cd84c5d6c-8t6hg" Jun 03 19:26:24.837579 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:24.837509 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/adf2ce3b-214b-4986-8373-dea927c89b08-console-serving-cert\") pod \"console-5cd84c5d6c-8t6hg\" (UID: \"adf2ce3b-214b-4986-8373-dea927c89b08\") " pod="openshift-console/console-5cd84c5d6c-8t6hg" Jun 03 19:26:24.837579 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:24.837533 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/adf2ce3b-214b-4986-8373-dea927c89b08-console-config\") pod \"console-5cd84c5d6c-8t6hg\" (UID: \"adf2ce3b-214b-4986-8373-dea927c89b08\") " pod="openshift-console/console-5cd84c5d6c-8t6hg" Jun 03 19:26:24.837579 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:24.837575 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbs2h\" (UniqueName: \"kubernetes.io/projected/adf2ce3b-214b-4986-8373-dea927c89b08-kube-api-access-dbs2h\") pod \"console-5cd84c5d6c-8t6hg\" (UID: \"adf2ce3b-214b-4986-8373-dea927c89b08\") " pod="openshift-console/console-5cd84c5d6c-8t6hg" Jun 03 19:26:24.837841 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:24.837604 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/adf2ce3b-214b-4986-8373-dea927c89b08-trusted-ca-bundle\") pod \"console-5cd84c5d6c-8t6hg\" (UID: \"adf2ce3b-214b-4986-8373-dea927c89b08\") " pod="openshift-console/console-5cd84c5d6c-8t6hg" Jun 03 19:26:24.838323 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:24.838269 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/adf2ce3b-214b-4986-8373-dea927c89b08-service-ca\") pod \"console-5cd84c5d6c-8t6hg\" (UID: \"adf2ce3b-214b-4986-8373-dea927c89b08\") " pod="openshift-console/console-5cd84c5d6c-8t6hg" Jun 03 19:26:24.838323 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:24.838308 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/adf2ce3b-214b-4986-8373-dea927c89b08-oauth-serving-cert\") pod \"console-5cd84c5d6c-8t6hg\" (UID: \"adf2ce3b-214b-4986-8373-dea927c89b08\") " pod="openshift-console/console-5cd84c5d6c-8t6hg" Jun 03 19:26:24.838457 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:24.838420 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/adf2ce3b-214b-4986-8373-dea927c89b08-console-config\") pod \"console-5cd84c5d6c-8t6hg\" (UID: \"adf2ce3b-214b-4986-8373-dea927c89b08\") " pod="openshift-console/console-5cd84c5d6c-8t6hg" Jun 03 19:26:24.838733 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:24.838711 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/adf2ce3b-214b-4986-8373-dea927c89b08-trusted-ca-bundle\") pod \"console-5cd84c5d6c-8t6hg\" (UID: \"adf2ce3b-214b-4986-8373-dea927c89b08\") " pod="openshift-console/console-5cd84c5d6c-8t6hg" Jun 03 19:26:24.840074 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:24.840042 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/adf2ce3b-214b-4986-8373-dea927c89b08-console-oauth-config\") pod \"console-5cd84c5d6c-8t6hg\" (UID: \"adf2ce3b-214b-4986-8373-dea927c89b08\") " pod="openshift-console/console-5cd84c5d6c-8t6hg" Jun 03 19:26:24.840231 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:24.840209 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/adf2ce3b-214b-4986-8373-dea927c89b08-console-serving-cert\") pod \"console-5cd84c5d6c-8t6hg\" (UID: \"adf2ce3b-214b-4986-8373-dea927c89b08\") " pod="openshift-console/console-5cd84c5d6c-8t6hg" Jun 03 19:26:24.847850 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:24.847824 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbs2h\" (UniqueName: \"kubernetes.io/projected/adf2ce3b-214b-4986-8373-dea927c89b08-kube-api-access-dbs2h\") pod \"console-5cd84c5d6c-8t6hg\" (UID: \"adf2ce3b-214b-4986-8373-dea927c89b08\") " pod="openshift-console/console-5cd84c5d6c-8t6hg" Jun 03 19:26:24.957976 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:24.957877 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cd84c5d6c-8t6hg" Jun 03 19:26:25.096524 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:25.096481 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cd84c5d6c-8t6hg"] Jun 03 19:26:25.098773 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:26:25.098744 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadf2ce3b_214b_4986_8373_dea927c89b08.slice/crio-058b2ade4906aa43581980d69a1ad9daa870f6eb87f860cbed548e16c57afb53 WatchSource:0}: Error finding container 058b2ade4906aa43581980d69a1ad9daa870f6eb87f860cbed548e16c57afb53: Status 404 returned error can't find the container with id 058b2ade4906aa43581980d69a1ad9daa870f6eb87f860cbed548e16c57afb53 Jun 03 19:26:25.775700 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:25.775662 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cd84c5d6c-8t6hg" event={"ID":"adf2ce3b-214b-4986-8373-dea927c89b08","Type":"ContainerStarted","Data":"058b2ade4906aa43581980d69a1ad9daa870f6eb87f860cbed548e16c57afb53"} Jun 03 19:26:28.788260 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:28.788220 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-649cb55559-v8hhw" event={"ID":"e310587d-9cb6-45d5-8886-bc6e03cb4338","Type":"ContainerStarted","Data":"241febca232f9b3f50a71c19bdaddc48caba80bae20727190cd7d15897bd6232"} Jun 03 19:26:28.789704 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:28.789679 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cd84c5d6c-8t6hg" event={"ID":"adf2ce3b-214b-4986-8373-dea927c89b08","Type":"ContainerStarted","Data":"4437727fb4d885234dc67910d5eb48557c6c56d79239c15bb6ac5b584d5afba3"} Jun 03 19:26:28.808468 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:28.808419 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-649cb55559-v8hhw" podStartSLOduration=13.808403054 podStartE2EDuration="13.808403054s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:26:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=1 observedRunningTime="2026-06-03 19:26:28.807918778 +0000 UTC m=+335.653578194" watchObservedRunningTime="2026-06-03 19:26:28.808403054 +0000 UTC m=+335.654062468" Jun 03 19:26:34.958921 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:34.958876 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5cd84c5d6c-8t6hg" Jun 03 19:26:34.959407 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:34.958955 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5cd84c5d6c-8t6hg" Jun 03 19:26:34.963955 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:34.963916 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5cd84c5d6c-8t6hg" Jun 03 19:26:34.983902 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:34.983839 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5cd84c5d6c-8t6hg" podStartSLOduration=7.838683741 podStartE2EDuration="10.983816698s" totalImagesPullingTime="3.145132957s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:26:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:26:28.826529916 +0000 UTC m=+335.672189331" watchObservedRunningTime="2026-06-03 19:26:34.983816698 +0000 UTC m=+341.829476118" Jun 03 19:26:35.615657 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:35.615622 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-649cb55559-v8hhw" Jun 03 19:26:35.616414 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:35.616385 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-649cb55559-v8hhw" Jun 03 19:26:35.620897 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:35.620868 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-649cb55559-v8hhw" Jun 03 19:26:35.823227 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:35.823187 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5cd84c5d6c-8t6hg" Jun 03 19:26:35.823632 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:35.823612 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-649cb55559-v8hhw" Jun 03 19:26:35.891951 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:35.891920 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-649cb55559-v8hhw"] Jun 03 19:26:39.577971 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:39.577940 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6c5bb68b96-6sbqt" Jun 03 19:26:39.582143 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:39.582114 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6c5bb68b96-6sbqt" Jun 03 19:26:44.575721 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:44.575629 2579 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c56759479-z6v9c" podUID="03f8c278-46a4-441d-b4b9-decabf746b1b" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 03 19:26:54.575855 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:26:54.575813 2579 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c56759479-z6v9c" podUID="03f8c278-46a4-441d-b4b9-decabf746b1b" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 03 19:27:02.845975 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:02.845929 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-649cb55559-v8hhw" podUID="e310587d-9cb6-45d5-8886-bc6e03cb4338" containerName="console" containerID="cri-o://241febca232f9b3f50a71c19bdaddc48caba80bae20727190cd7d15897bd6232" gracePeriod=15 Jun 03 19:27:03.099614 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:03.099549 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-649cb55559-v8hhw" Jun 03 19:27:03.186766 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:03.186729 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e310587d-9cb6-45d5-8886-bc6e03cb4338-console-serving-cert\") pod \"e310587d-9cb6-45d5-8886-bc6e03cb4338\" (UID: \"e310587d-9cb6-45d5-8886-bc6e03cb4338\") " Jun 03 19:27:03.186951 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:03.186779 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e310587d-9cb6-45d5-8886-bc6e03cb4338-console-config\") pod \"e310587d-9cb6-45d5-8886-bc6e03cb4338\" (UID: \"e310587d-9cb6-45d5-8886-bc6e03cb4338\") " Jun 03 19:27:03.186951 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:03.186803 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e310587d-9cb6-45d5-8886-bc6e03cb4338-oauth-serving-cert\") pod \"e310587d-9cb6-45d5-8886-bc6e03cb4338\" (UID: \"e310587d-9cb6-45d5-8886-bc6e03cb4338\") " Jun 03 19:27:03.186951 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:03.186841 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e310587d-9cb6-45d5-8886-bc6e03cb4338-console-oauth-config\") pod \"e310587d-9cb6-45d5-8886-bc6e03cb4338\" (UID: \"e310587d-9cb6-45d5-8886-bc6e03cb4338\") " Jun 03 19:27:03.186951 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:03.186876 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7zk84\" (UniqueName: \"kubernetes.io/projected/e310587d-9cb6-45d5-8886-bc6e03cb4338-kube-api-access-7zk84\") pod \"e310587d-9cb6-45d5-8886-bc6e03cb4338\" (UID: \"e310587d-9cb6-45d5-8886-bc6e03cb4338\") " Jun 03 19:27:03.186951 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:03.186896 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e310587d-9cb6-45d5-8886-bc6e03cb4338-service-ca\") pod \"e310587d-9cb6-45d5-8886-bc6e03cb4338\" (UID: \"e310587d-9cb6-45d5-8886-bc6e03cb4338\") " Jun 03 19:27:03.187334 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:03.187305 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e310587d-9cb6-45d5-8886-bc6e03cb4338-console-config" (OuterVolumeSpecName: "console-config") pod "e310587d-9cb6-45d5-8886-bc6e03cb4338" (UID: "e310587d-9cb6-45d5-8886-bc6e03cb4338"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 19:27:03.187450 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:03.187420 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e310587d-9cb6-45d5-8886-bc6e03cb4338-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e310587d-9cb6-45d5-8886-bc6e03cb4338" (UID: "e310587d-9cb6-45d5-8886-bc6e03cb4338"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 19:27:03.187753 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:03.187448 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e310587d-9cb6-45d5-8886-bc6e03cb4338-service-ca" (OuterVolumeSpecName: "service-ca") pod "e310587d-9cb6-45d5-8886-bc6e03cb4338" (UID: "e310587d-9cb6-45d5-8886-bc6e03cb4338"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 19:27:03.189385 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:03.189359 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e310587d-9cb6-45d5-8886-bc6e03cb4338-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e310587d-9cb6-45d5-8886-bc6e03cb4338" (UID: "e310587d-9cb6-45d5-8886-bc6e03cb4338"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 19:27:03.189484 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:03.189404 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e310587d-9cb6-45d5-8886-bc6e03cb4338-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e310587d-9cb6-45d5-8886-bc6e03cb4338" (UID: "e310587d-9cb6-45d5-8886-bc6e03cb4338"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 19:27:03.189484 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:03.189411 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e310587d-9cb6-45d5-8886-bc6e03cb4338-kube-api-access-7zk84" (OuterVolumeSpecName: "kube-api-access-7zk84") pod "e310587d-9cb6-45d5-8886-bc6e03cb4338" (UID: "e310587d-9cb6-45d5-8886-bc6e03cb4338"). InnerVolumeSpecName "kube-api-access-7zk84". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:27:03.288304 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:03.288261 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e310587d-9cb6-45d5-8886-bc6e03cb4338-console-oauth-config\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\"" Jun 03 19:27:03.288469 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:03.288328 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7zk84\" (UniqueName: \"kubernetes.io/projected/e310587d-9cb6-45d5-8886-bc6e03cb4338-kube-api-access-7zk84\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\"" Jun 03 19:27:03.288469 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:03.288341 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e310587d-9cb6-45d5-8886-bc6e03cb4338-service-ca\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\"" Jun 03 19:27:03.288469 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:03.288349 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e310587d-9cb6-45d5-8886-bc6e03cb4338-console-serving-cert\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\"" Jun 03 19:27:03.288469 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:03.288357 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e310587d-9cb6-45d5-8886-bc6e03cb4338-console-config\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\"" Jun 03 19:27:03.288469 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:03.288365 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e310587d-9cb6-45d5-8886-bc6e03cb4338-oauth-serving-cert\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\"" Jun 03 19:27:03.919681 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:03.919638 2579 generic.go:356] "Generic (PLEG): container finished" podID="e310587d-9cb6-45d5-8886-bc6e03cb4338" containerID="241febca232f9b3f50a71c19bdaddc48caba80bae20727190cd7d15897bd6232" exitCode=0 Jun 03 19:27:03.919681 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:03.919681 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-649cb55559-v8hhw" Jun 03 19:27:03.920138 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:03.919726 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-649cb55559-v8hhw" event={"ID":"e310587d-9cb6-45d5-8886-bc6e03cb4338","Type":"ContainerDied","Data":"241febca232f9b3f50a71c19bdaddc48caba80bae20727190cd7d15897bd6232"} Jun 03 19:27:03.920138 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:03.919778 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-649cb55559-v8hhw" event={"ID":"e310587d-9cb6-45d5-8886-bc6e03cb4338","Type":"ContainerDied","Data":"7e2b0c9e03a89aaabee3d506fddb9d48a85b971731ab459c7c57e36ffa9ad807"} Jun 03 19:27:03.920138 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:03.919802 2579 scope.go:117] "RemoveContainer" containerID="241febca232f9b3f50a71c19bdaddc48caba80bae20727190cd7d15897bd6232" Jun 03 19:27:03.927957 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:03.927939 2579 scope.go:117] "RemoveContainer" containerID="241febca232f9b3f50a71c19bdaddc48caba80bae20727190cd7d15897bd6232" Jun 03 19:27:03.928216 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:27:03.928188 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"241febca232f9b3f50a71c19bdaddc48caba80bae20727190cd7d15897bd6232\": container with ID starting with 241febca232f9b3f50a71c19bdaddc48caba80bae20727190cd7d15897bd6232 not found: ID does not exist" containerID="241febca232f9b3f50a71c19bdaddc48caba80bae20727190cd7d15897bd6232" Jun 03 19:27:03.928265 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:03.928223 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"241febca232f9b3f50a71c19bdaddc48caba80bae20727190cd7d15897bd6232"} err="failed to get container status \"241febca232f9b3f50a71c19bdaddc48caba80bae20727190cd7d15897bd6232\": rpc error: code = NotFound desc = could not find container \"241febca232f9b3f50a71c19bdaddc48caba80bae20727190cd7d15897bd6232\": container with ID starting with 241febca232f9b3f50a71c19bdaddc48caba80bae20727190cd7d15897bd6232 not found: ID does not exist" Jun 03 19:27:03.936463 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:03.936435 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-649cb55559-v8hhw"] Jun 03 19:27:03.939956 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:03.939930 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-649cb55559-v8hhw"] Jun 03 19:27:04.576249 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:04.576208 2579 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c56759479-z6v9c" podUID="03f8c278-46a4-441d-b4b9-decabf746b1b" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 03 19:27:04.576427 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:04.576308 2579 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c56759479-z6v9c" Jun 03 19:27:04.576812 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:04.576794 2579 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"32016a74fdc6190f6acb4d90fb4d21b69900172d4c8f890636e86c65204e5427"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c56759479-z6v9c" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 03 19:27:04.576851 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:04.576833 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c56759479-z6v9c" podUID="03f8c278-46a4-441d-b4b9-decabf746b1b" containerName="service-proxy" containerID="cri-o://32016a74fdc6190f6acb4d90fb4d21b69900172d4c8f890636e86c65204e5427" gracePeriod=30 Jun 03 19:27:04.926753 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:04.926718 2579 generic.go:356] "Generic (PLEG): container finished" podID="03f8c278-46a4-441d-b4b9-decabf746b1b" containerID="32016a74fdc6190f6acb4d90fb4d21b69900172d4c8f890636e86c65204e5427" exitCode=2 Jun 03 19:27:04.927132 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:04.926775 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c56759479-z6v9c" event={"ID":"03f8c278-46a4-441d-b4b9-decabf746b1b","Type":"ContainerDied","Data":"32016a74fdc6190f6acb4d90fb4d21b69900172d4c8f890636e86c65204e5427"} Jun 03 19:27:04.927132 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:04.926819 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c56759479-z6v9c" event={"ID":"03f8c278-46a4-441d-b4b9-decabf746b1b","Type":"ContainerStarted","Data":"c984ede4066056b209dba0269dbf2570ff5228aae71c6fb6c39edc0c300d6432"} Jun 03 19:27:05.608808 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:05.608770 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e310587d-9cb6-45d5-8886-bc6e03cb4338" path="/var/lib/kubelet/pods/e310587d-9cb6-45d5-8886-bc6e03cb4338/volumes" Jun 03 19:27:07.527316 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:07.527246 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e0ed8e87-e724-4880-a4e8-fe68533db02a-metrics-certs\") pod \"network-metrics-daemon-xpvdz\" (UID: \"e0ed8e87-e724-4880-a4e8-fe68533db02a\") " pod="openshift-multus/network-metrics-daemon-xpvdz" Jun 03 19:27:07.529882 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:07.529859 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e0ed8e87-e724-4880-a4e8-fe68533db02a-metrics-certs\") pod \"network-metrics-daemon-xpvdz\" (UID: \"e0ed8e87-e724-4880-a4e8-fe68533db02a\") " pod="openshift-multus/network-metrics-daemon-xpvdz" Jun 03 19:27:07.806903 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:07.806819 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-grwp9\"" Jun 03 19:27:07.814887 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:07.814856 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xpvdz" Jun 03 19:27:07.946823 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:07.946677 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xpvdz"] Jun 03 19:27:07.949348 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:27:07.949319 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0ed8e87_e724_4880_a4e8_fe68533db02a.slice/crio-6291da5e40ffed37b18c740ff80ac63fb2b3601a545ce18c842e84fd6a3f94d0 WatchSource:0}: Error finding container 6291da5e40ffed37b18c740ff80ac63fb2b3601a545ce18c842e84fd6a3f94d0: Status 404 returned error can't find the container with id 6291da5e40ffed37b18c740ff80ac63fb2b3601a545ce18c842e84fd6a3f94d0 Jun 03 19:27:08.943040 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:08.942997 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xpvdz" event={"ID":"e0ed8e87-e724-4880-a4e8-fe68533db02a","Type":"ContainerStarted","Data":"d0402d92d06d2386b656b8424e9a52dd0a1ad003c8b7698c5d5a3a528fe07d43"} Jun 03 19:27:08.943498 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:08.943070 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xpvdz" event={"ID":"e0ed8e87-e724-4880-a4e8-fe68533db02a","Type":"ContainerStarted","Data":"6291da5e40ffed37b18c740ff80ac63fb2b3601a545ce18c842e84fd6a3f94d0"} Jun 03 19:27:09.948010 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:09.947966 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xpvdz" event={"ID":"e0ed8e87-e724-4880-a4e8-fe68533db02a","Type":"ContainerStarted","Data":"7a7e4f422e472471a7211db49affbfc9c97de23127bfd556a6ed5b5e818b6b4a"} Jun 03 19:27:09.965232 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:09.965182 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-xpvdz" podStartSLOduration=376.104836848 podStartE2EDuration="6m16.96516659s" totalImagesPullingTime="860.329742ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:20:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:27:09.964450776 +0000 UTC m=+376.810110212" watchObservedRunningTime="2026-06-03 19:27:09.96516659 +0000 UTC m=+376.810826005" Jun 03 19:27:23.358774 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:23.358738 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-c697fb878-kw8rq"] Jun 03 19:27:23.359182 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:23.358999 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e310587d-9cb6-45d5-8886-bc6e03cb4338" containerName="console" Jun 03 19:27:23.359182 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:23.359010 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e310587d-9cb6-45d5-8886-bc6e03cb4338" containerName="console" Jun 03 19:27:23.359182 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:23.359068 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="e310587d-9cb6-45d5-8886-bc6e03cb4338" containerName="console" Jun 03 19:27:23.362060 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:23.362040 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c697fb878-kw8rq" Jun 03 19:27:23.381797 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:23.381759 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c697fb878-kw8rq"] Jun 03 19:27:23.458138 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:23.458103 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88jkg\" (UniqueName: \"kubernetes.io/projected/ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd-kube-api-access-88jkg\") pod \"console-c697fb878-kw8rq\" (UID: \"ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd\") " pod="openshift-console/console-c697fb878-kw8rq" Jun 03 19:27:23.458138 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:23.458147 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd-trusted-ca-bundle\") pod \"console-c697fb878-kw8rq\" (UID: \"ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd\") " pod="openshift-console/console-c697fb878-kw8rq" Jun 03 19:27:23.458395 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:23.458214 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd-console-serving-cert\") pod \"console-c697fb878-kw8rq\" (UID: \"ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd\") " pod="openshift-console/console-c697fb878-kw8rq" Jun 03 19:27:23.458395 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:23.458252 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd-console-config\") pod \"console-c697fb878-kw8rq\" (UID: \"ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd\") " pod="openshift-console/console-c697fb878-kw8rq" Jun 03 19:27:23.458395 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:23.458345 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd-service-ca\") pod \"console-c697fb878-kw8rq\" (UID: \"ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd\") " pod="openshift-console/console-c697fb878-kw8rq" Jun 03 19:27:23.458395 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:23.458368 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd-oauth-serving-cert\") pod \"console-c697fb878-kw8rq\" (UID: \"ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd\") " pod="openshift-console/console-c697fb878-kw8rq" Jun 03 19:27:23.458395 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:23.458393 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd-console-oauth-config\") pod \"console-c697fb878-kw8rq\" (UID: \"ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd\") " pod="openshift-console/console-c697fb878-kw8rq" Jun 03 19:27:23.558996 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:23.558951 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd-service-ca\") pod \"console-c697fb878-kw8rq\" (UID: \"ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd\") " pod="openshift-console/console-c697fb878-kw8rq" Jun 03 19:27:23.558996 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:23.558994 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd-oauth-serving-cert\") pod \"console-c697fb878-kw8rq\" (UID: \"ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd\") " pod="openshift-console/console-c697fb878-kw8rq" Jun 03 19:27:23.559272 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:23.559019 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd-console-oauth-config\") pod \"console-c697fb878-kw8rq\" (UID: \"ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd\") " pod="openshift-console/console-c697fb878-kw8rq" Jun 03 19:27:23.559272 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:23.559148 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88jkg\" (UniqueName: \"kubernetes.io/projected/ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd-kube-api-access-88jkg\") pod \"console-c697fb878-kw8rq\" (UID: \"ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd\") " pod="openshift-console/console-c697fb878-kw8rq" Jun 03 19:27:23.559272 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:23.559203 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd-trusted-ca-bundle\") pod \"console-c697fb878-kw8rq\" (UID: \"ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd\") " pod="openshift-console/console-c697fb878-kw8rq" Jun 03 19:27:23.559272 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:23.559268 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd-console-serving-cert\") pod \"console-c697fb878-kw8rq\" (UID: \"ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd\") " pod="openshift-console/console-c697fb878-kw8rq" Jun 03 19:27:23.559503 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:23.559323 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd-console-config\") pod \"console-c697fb878-kw8rq\" (UID: \"ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd\") " pod="openshift-console/console-c697fb878-kw8rq" Jun 03 19:27:23.559880 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:23.559853 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd-service-ca\") pod \"console-c697fb878-kw8rq\" (UID: \"ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd\") " pod="openshift-console/console-c697fb878-kw8rq" Jun 03 19:27:23.560003 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:23.559856 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd-oauth-serving-cert\") pod \"console-c697fb878-kw8rq\" (UID: \"ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd\") " pod="openshift-console/console-c697fb878-kw8rq" Jun 03 19:27:23.560141 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:23.560123 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd-trusted-ca-bundle\") pod \"console-c697fb878-kw8rq\" (UID: \"ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd\") " pod="openshift-console/console-c697fb878-kw8rq" Jun 03 19:27:23.560236 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:23.560216 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd-console-config\") pod \"console-c697fb878-kw8rq\" (UID: \"ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd\") " pod="openshift-console/console-c697fb878-kw8rq" Jun 03 19:27:23.561645 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:23.561616 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd-console-oauth-config\") pod \"console-c697fb878-kw8rq\" (UID: \"ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd\") " pod="openshift-console/console-c697fb878-kw8rq" Jun 03 19:27:23.561871 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:23.561850 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd-console-serving-cert\") pod \"console-c697fb878-kw8rq\" (UID: \"ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd\") " pod="openshift-console/console-c697fb878-kw8rq" Jun 03 19:27:23.569245 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:23.569223 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-88jkg\" (UniqueName: \"kubernetes.io/projected/ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd-kube-api-access-88jkg\") pod \"console-c697fb878-kw8rq\" (UID: \"ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd\") " pod="openshift-console/console-c697fb878-kw8rq" Jun 03 19:27:23.671736 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:23.671707 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c697fb878-kw8rq" Jun 03 19:27:23.816763 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:23.816727 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c697fb878-kw8rq"] Jun 03 19:27:23.819454 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:27:23.819423 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad30ee95_8f27_48a4_ae3d_d3ca74c6afcd.slice/crio-38491a4164082c26b4815bfb750ce46190420bfddf33db80d519556d437baf7d WatchSource:0}: Error finding container 38491a4164082c26b4815bfb750ce46190420bfddf33db80d519556d437baf7d: Status 404 returned error can't find the container with id 38491a4164082c26b4815bfb750ce46190420bfddf33db80d519556d437baf7d Jun 03 19:27:24.000150 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:24.000048 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c697fb878-kw8rq" event={"ID":"ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd","Type":"ContainerStarted","Data":"317de92764b5fc299648c6de36f2bbd3c7ca6685987c299531ca133e23aa2946"} Jun 03 19:27:24.000150 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:24.000113 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c697fb878-kw8rq" event={"ID":"ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd","Type":"ContainerStarted","Data":"38491a4164082c26b4815bfb750ce46190420bfddf33db80d519556d437baf7d"} Jun 03 19:27:24.021060 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:24.020998 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-c697fb878-kw8rq" podStartSLOduration=1.020979956 podStartE2EDuration="1.020979956s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:27:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:27:24.019792218 +0000 UTC m=+390.865451633" watchObservedRunningTime="2026-06-03 19:27:24.020979956 +0000 UTC m=+390.866639370" Jun 03 19:27:33.675620 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:33.675571 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-c697fb878-kw8rq" Jun 03 19:27:33.676380 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:33.675716 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-c697fb878-kw8rq" Jun 03 19:27:33.681351 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:33.681327 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-c697fb878-kw8rq" Jun 03 19:27:34.043071 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:34.042991 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-c697fb878-kw8rq" Jun 03 19:27:34.092676 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:34.092632 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5cd84c5d6c-8t6hg"] Jun 03 19:27:59.114927 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:59.114858 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5cd84c5d6c-8t6hg" podUID="adf2ce3b-214b-4986-8373-dea927c89b08" containerName="console" containerID="cri-o://4437727fb4d885234dc67910d5eb48557c6c56d79239c15bb6ac5b584d5afba3" gracePeriod=15 Jun 03 19:27:59.367679 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:59.367615 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cd84c5d6c-8t6hg" Jun 03 19:27:59.467950 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:59.467919 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/adf2ce3b-214b-4986-8373-dea927c89b08-oauth-serving-cert\") pod \"adf2ce3b-214b-4986-8373-dea927c89b08\" (UID: \"adf2ce3b-214b-4986-8373-dea927c89b08\") " Jun 03 19:27:59.467950 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:59.467954 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dbs2h\" (UniqueName: \"kubernetes.io/projected/adf2ce3b-214b-4986-8373-dea927c89b08-kube-api-access-dbs2h\") pod \"adf2ce3b-214b-4986-8373-dea927c89b08\" (UID: \"adf2ce3b-214b-4986-8373-dea927c89b08\") " Jun 03 19:27:59.468210 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:59.467980 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/adf2ce3b-214b-4986-8373-dea927c89b08-trusted-ca-bundle\") pod \"adf2ce3b-214b-4986-8373-dea927c89b08\" (UID: \"adf2ce3b-214b-4986-8373-dea927c89b08\") " Jun 03 19:27:59.468210 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:59.467999 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/adf2ce3b-214b-4986-8373-dea927c89b08-console-oauth-config\") pod \"adf2ce3b-214b-4986-8373-dea927c89b08\" (UID: \"adf2ce3b-214b-4986-8373-dea927c89b08\") " Jun 03 19:27:59.468210 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:59.468019 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/adf2ce3b-214b-4986-8373-dea927c89b08-console-config\") pod \"adf2ce3b-214b-4986-8373-dea927c89b08\" (UID: \"adf2ce3b-214b-4986-8373-dea927c89b08\") " Jun 03 19:27:59.468210 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:59.468064 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/adf2ce3b-214b-4986-8373-dea927c89b08-service-ca\") pod \"adf2ce3b-214b-4986-8373-dea927c89b08\" (UID: \"adf2ce3b-214b-4986-8373-dea927c89b08\") " Jun 03 19:27:59.468210 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:59.468115 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/adf2ce3b-214b-4986-8373-dea927c89b08-console-serving-cert\") pod \"adf2ce3b-214b-4986-8373-dea927c89b08\" (UID: \"adf2ce3b-214b-4986-8373-dea927c89b08\") " Jun 03 19:27:59.468533 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:59.468503 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/adf2ce3b-214b-4986-8373-dea927c89b08-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "adf2ce3b-214b-4986-8373-dea927c89b08" (UID: "adf2ce3b-214b-4986-8373-dea927c89b08"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 19:27:59.468533 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:59.468518 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/adf2ce3b-214b-4986-8373-dea927c89b08-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "adf2ce3b-214b-4986-8373-dea927c89b08" (UID: "adf2ce3b-214b-4986-8373-dea927c89b08"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 19:27:59.468639 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:59.468579 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/adf2ce3b-214b-4986-8373-dea927c89b08-service-ca" (OuterVolumeSpecName: "service-ca") pod "adf2ce3b-214b-4986-8373-dea927c89b08" (UID: "adf2ce3b-214b-4986-8373-dea927c89b08"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 19:27:59.468639 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:59.468622 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/adf2ce3b-214b-4986-8373-dea927c89b08-console-config" (OuterVolumeSpecName: "console-config") pod "adf2ce3b-214b-4986-8373-dea927c89b08" (UID: "adf2ce3b-214b-4986-8373-dea927c89b08"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 19:27:59.470503 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:59.470470 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/adf2ce3b-214b-4986-8373-dea927c89b08-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "adf2ce3b-214b-4986-8373-dea927c89b08" (UID: "adf2ce3b-214b-4986-8373-dea927c89b08"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 19:27:59.470620 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:59.470546 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/adf2ce3b-214b-4986-8373-dea927c89b08-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "adf2ce3b-214b-4986-8373-dea927c89b08" (UID: "adf2ce3b-214b-4986-8373-dea927c89b08"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 19:27:59.470620 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:59.470576 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/adf2ce3b-214b-4986-8373-dea927c89b08-kube-api-access-dbs2h" (OuterVolumeSpecName: "kube-api-access-dbs2h") pod "adf2ce3b-214b-4986-8373-dea927c89b08" (UID: "adf2ce3b-214b-4986-8373-dea927c89b08"). InnerVolumeSpecName "kube-api-access-dbs2h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:27:59.569340 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:59.569278 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/adf2ce3b-214b-4986-8373-dea927c89b08-service-ca\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\"" Jun 03 19:27:59.569507 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:59.569355 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/adf2ce3b-214b-4986-8373-dea927c89b08-console-serving-cert\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\"" Jun 03 19:27:59.569507 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:59.569366 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/adf2ce3b-214b-4986-8373-dea927c89b08-oauth-serving-cert\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\"" Jun 03 19:27:59.569507 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:59.569375 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dbs2h\" (UniqueName: \"kubernetes.io/projected/adf2ce3b-214b-4986-8373-dea927c89b08-kube-api-access-dbs2h\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\"" Jun 03 19:27:59.569507 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:59.569386 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/adf2ce3b-214b-4986-8373-dea927c89b08-trusted-ca-bundle\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\"" Jun 03 19:27:59.569507 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:59.569394 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/adf2ce3b-214b-4986-8373-dea927c89b08-console-oauth-config\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\"" Jun 03 19:27:59.569507 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:27:59.569405 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/adf2ce3b-214b-4986-8373-dea927c89b08-console-config\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\"" Jun 03 19:28:00.135493 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:28:00.135458 2579 generic.go:356] "Generic (PLEG): container finished" podID="adf2ce3b-214b-4986-8373-dea927c89b08" containerID="4437727fb4d885234dc67910d5eb48557c6c56d79239c15bb6ac5b584d5afba3" exitCode=0 Jun 03 19:28:00.135908 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:28:00.135496 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cd84c5d6c-8t6hg" event={"ID":"adf2ce3b-214b-4986-8373-dea927c89b08","Type":"ContainerDied","Data":"4437727fb4d885234dc67910d5eb48557c6c56d79239c15bb6ac5b584d5afba3"} Jun 03 19:28:00.135908 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:28:00.135558 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cd84c5d6c-8t6hg" event={"ID":"adf2ce3b-214b-4986-8373-dea927c89b08","Type":"ContainerDied","Data":"058b2ade4906aa43581980d69a1ad9daa870f6eb87f860cbed548e16c57afb53"} Jun 03 19:28:00.135908 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:28:00.135578 2579 scope.go:117] "RemoveContainer" containerID="4437727fb4d885234dc67910d5eb48557c6c56d79239c15bb6ac5b584d5afba3" Jun 03 19:28:00.135908 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:28:00.135514 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cd84c5d6c-8t6hg" Jun 03 19:28:00.144142 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:28:00.144120 2579 scope.go:117] "RemoveContainer" containerID="4437727fb4d885234dc67910d5eb48557c6c56d79239c15bb6ac5b584d5afba3" Jun 03 19:28:00.144511 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:28:00.144491 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4437727fb4d885234dc67910d5eb48557c6c56d79239c15bb6ac5b584d5afba3\": container with ID starting with 4437727fb4d885234dc67910d5eb48557c6c56d79239c15bb6ac5b584d5afba3 not found: ID does not exist" containerID="4437727fb4d885234dc67910d5eb48557c6c56d79239c15bb6ac5b584d5afba3" Jun 03 19:28:00.144581 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:28:00.144519 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4437727fb4d885234dc67910d5eb48557c6c56d79239c15bb6ac5b584d5afba3"} err="failed to get container status \"4437727fb4d885234dc67910d5eb48557c6c56d79239c15bb6ac5b584d5afba3\": rpc error: code = NotFound desc = could not find container \"4437727fb4d885234dc67910d5eb48557c6c56d79239c15bb6ac5b584d5afba3\": container with ID starting with 4437727fb4d885234dc67910d5eb48557c6c56d79239c15bb6ac5b584d5afba3 not found: ID does not exist" Jun 03 19:28:00.152675 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:28:00.152641 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5cd84c5d6c-8t6hg"] Jun 03 19:28:00.157245 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:28:00.157221 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5cd84c5d6c-8t6hg"] Jun 03 19:28:01.608125 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:28:01.608085 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="adf2ce3b-214b-4986-8373-dea927c89b08" path="/var/lib/kubelet/pods/adf2ce3b-214b-4986-8373-dea927c89b08/volumes" Jun 03 19:28:40.946708 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:28:40.946673 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-58c5b5c6c9-ctf9m"] Jun 03 19:28:40.947125 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:28:40.946942 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="adf2ce3b-214b-4986-8373-dea927c89b08" containerName="console" Jun 03 19:28:40.947125 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:28:40.946953 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="adf2ce3b-214b-4986-8373-dea927c89b08" containerName="console" Jun 03 19:28:40.947125 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:28:40.947007 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="adf2ce3b-214b-4986-8373-dea927c89b08" containerName="console" Jun 03 19:28:40.949801 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:28:40.949781 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58c5b5c6c9-ctf9m" Jun 03 19:28:40.977206 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:28:40.977171 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58c5b5c6c9-ctf9m"] Jun 03 19:28:41.106555 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:28:41.106510 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/71ba41c9-019b-4488-ab88-a213a4616d44-console-config\") pod \"console-58c5b5c6c9-ctf9m\" (UID: \"71ba41c9-019b-4488-ab88-a213a4616d44\") " pod="openshift-console/console-58c5b5c6c9-ctf9m" Jun 03 19:28:41.106555 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:28:41.106559 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/71ba41c9-019b-4488-ab88-a213a4616d44-oauth-serving-cert\") pod \"console-58c5b5c6c9-ctf9m\" (UID: \"71ba41c9-019b-4488-ab88-a213a4616d44\") " pod="openshift-console/console-58c5b5c6c9-ctf9m" Jun 03 19:28:41.106770 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:28:41.106600 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/71ba41c9-019b-4488-ab88-a213a4616d44-console-serving-cert\") pod \"console-58c5b5c6c9-ctf9m\" (UID: \"71ba41c9-019b-4488-ab88-a213a4616d44\") " pod="openshift-console/console-58c5b5c6c9-ctf9m" Jun 03 19:28:41.106770 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:28:41.106622 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71ba41c9-019b-4488-ab88-a213a4616d44-trusted-ca-bundle\") pod \"console-58c5b5c6c9-ctf9m\" (UID: \"71ba41c9-019b-4488-ab88-a213a4616d44\") " pod="openshift-console/console-58c5b5c6c9-ctf9m" Jun 03 19:28:41.106770 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:28:41.106707 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/71ba41c9-019b-4488-ab88-a213a4616d44-service-ca\") pod \"console-58c5b5c6c9-ctf9m\" (UID: \"71ba41c9-019b-4488-ab88-a213a4616d44\") " pod="openshift-console/console-58c5b5c6c9-ctf9m" Jun 03 19:28:41.106770 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:28:41.106745 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/71ba41c9-019b-4488-ab88-a213a4616d44-console-oauth-config\") pod \"console-58c5b5c6c9-ctf9m\" (UID: \"71ba41c9-019b-4488-ab88-a213a4616d44\") " pod="openshift-console/console-58c5b5c6c9-ctf9m" Jun 03 19:28:41.106770 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:28:41.106762 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhp9b\" (UniqueName: \"kubernetes.io/projected/71ba41c9-019b-4488-ab88-a213a4616d44-kube-api-access-vhp9b\") pod \"console-58c5b5c6c9-ctf9m\" (UID: \"71ba41c9-019b-4488-ab88-a213a4616d44\") " pod="openshift-console/console-58c5b5c6c9-ctf9m" Jun 03 19:28:41.208099 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:28:41.207997 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/71ba41c9-019b-4488-ab88-a213a4616d44-oauth-serving-cert\") pod \"console-58c5b5c6c9-ctf9m\" (UID: \"71ba41c9-019b-4488-ab88-a213a4616d44\") " pod="openshift-console/console-58c5b5c6c9-ctf9m" Jun 03 19:28:41.208099 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:28:41.208057 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/71ba41c9-019b-4488-ab88-a213a4616d44-console-serving-cert\") pod \"console-58c5b5c6c9-ctf9m\" (UID: \"71ba41c9-019b-4488-ab88-a213a4616d44\") " pod="openshift-console/console-58c5b5c6c9-ctf9m" Jun 03 19:28:41.208099 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:28:41.208076 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71ba41c9-019b-4488-ab88-a213a4616d44-trusted-ca-bundle\") pod \"console-58c5b5c6c9-ctf9m\" (UID: \"71ba41c9-019b-4488-ab88-a213a4616d44\") " pod="openshift-console/console-58c5b5c6c9-ctf9m" Jun 03 19:28:41.208439 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:28:41.208126 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/71ba41c9-019b-4488-ab88-a213a4616d44-service-ca\") pod \"console-58c5b5c6c9-ctf9m\" (UID: \"71ba41c9-019b-4488-ab88-a213a4616d44\") " pod="openshift-console/console-58c5b5c6c9-ctf9m" Jun 03 19:28:41.208439 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:28:41.208156 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/71ba41c9-019b-4488-ab88-a213a4616d44-console-oauth-config\") pod \"console-58c5b5c6c9-ctf9m\" (UID: \"71ba41c9-019b-4488-ab88-a213a4616d44\") " pod="openshift-console/console-58c5b5c6c9-ctf9m" Jun 03 19:28:41.208439 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:28:41.208281 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhp9b\" (UniqueName: \"kubernetes.io/projected/71ba41c9-019b-4488-ab88-a213a4616d44-kube-api-access-vhp9b\") pod \"console-58c5b5c6c9-ctf9m\" (UID: \"71ba41c9-019b-4488-ab88-a213a4616d44\") " pod="openshift-console/console-58c5b5c6c9-ctf9m" Jun 03 19:28:41.208439 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:28:41.208376 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/71ba41c9-019b-4488-ab88-a213a4616d44-console-config\") pod \"console-58c5b5c6c9-ctf9m\" (UID: \"71ba41c9-019b-4488-ab88-a213a4616d44\") " pod="openshift-console/console-58c5b5c6c9-ctf9m" Jun 03 19:28:41.208920 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:28:41.208889 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/71ba41c9-019b-4488-ab88-a213a4616d44-service-ca\") pod \"console-58c5b5c6c9-ctf9m\" (UID: \"71ba41c9-019b-4488-ab88-a213a4616d44\") " pod="openshift-console/console-58c5b5c6c9-ctf9m" Jun 03 19:28:41.209021 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:28:41.208896 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/71ba41c9-019b-4488-ab88-a213a4616d44-oauth-serving-cert\") pod \"console-58c5b5c6c9-ctf9m\" (UID: \"71ba41c9-019b-4488-ab88-a213a4616d44\") " pod="openshift-console/console-58c5b5c6c9-ctf9m" Jun 03 19:28:41.209235 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:28:41.209213 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71ba41c9-019b-4488-ab88-a213a4616d44-trusted-ca-bundle\") pod \"console-58c5b5c6c9-ctf9m\" (UID: \"71ba41c9-019b-4488-ab88-a213a4616d44\") " pod="openshift-console/console-58c5b5c6c9-ctf9m" Jun 03 19:28:41.209330 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:28:41.209240 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/71ba41c9-019b-4488-ab88-a213a4616d44-console-config\") pod \"console-58c5b5c6c9-ctf9m\" (UID: \"71ba41c9-019b-4488-ab88-a213a4616d44\") " pod="openshift-console/console-58c5b5c6c9-ctf9m" Jun 03 19:28:41.210792 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:28:41.210766 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/71ba41c9-019b-4488-ab88-a213a4616d44-console-serving-cert\") pod \"console-58c5b5c6c9-ctf9m\" (UID: \"71ba41c9-019b-4488-ab88-a213a4616d44\") " pod="openshift-console/console-58c5b5c6c9-ctf9m" Jun 03 19:28:41.210951 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:28:41.210928 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/71ba41c9-019b-4488-ab88-a213a4616d44-console-oauth-config\") pod \"console-58c5b5c6c9-ctf9m\" (UID: \"71ba41c9-019b-4488-ab88-a213a4616d44\") " pod="openshift-console/console-58c5b5c6c9-ctf9m" Jun 03 19:28:41.218349 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:28:41.218323 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhp9b\" (UniqueName: \"kubernetes.io/projected/71ba41c9-019b-4488-ab88-a213a4616d44-kube-api-access-vhp9b\") pod \"console-58c5b5c6c9-ctf9m\" (UID: \"71ba41c9-019b-4488-ab88-a213a4616d44\") " pod="openshift-console/console-58c5b5c6c9-ctf9m" Jun 03 19:28:41.260390 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:28:41.260342 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58c5b5c6c9-ctf9m" Jun 03 19:28:41.402164 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:28:41.402109 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58c5b5c6c9-ctf9m"] Jun 03 19:28:41.406025 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:28:41.405998 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71ba41c9_019b_4488_ab88_a213a4616d44.slice/crio-1c1cd0ce9ec82872868821aa4b32db1fe6d8c8e6ebd529313b61ee1954e5e266 WatchSource:0}: Error finding container 1c1cd0ce9ec82872868821aa4b32db1fe6d8c8e6ebd529313b61ee1954e5e266: Status 404 returned error can't find the container with id 1c1cd0ce9ec82872868821aa4b32db1fe6d8c8e6ebd529313b61ee1954e5e266 Jun 03 19:28:42.291999 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:28:42.291963 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58c5b5c6c9-ctf9m" event={"ID":"71ba41c9-019b-4488-ab88-a213a4616d44","Type":"ContainerStarted","Data":"c32a2d3ad87cacc453c104843be68422031f297e7211c2f38f36da4037adbf9b"} Jun 03 19:28:42.292451 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:28:42.292016 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58c5b5c6c9-ctf9m" event={"ID":"71ba41c9-019b-4488-ab88-a213a4616d44","Type":"ContainerStarted","Data":"1c1cd0ce9ec82872868821aa4b32db1fe6d8c8e6ebd529313b61ee1954e5e266"} Jun 03 19:28:51.260647 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:28:51.260602 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-58c5b5c6c9-ctf9m" Jun 03 19:28:51.261066 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:28:51.260671 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-58c5b5c6c9-ctf9m" Jun 03 19:28:51.265505 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:28:51.265481 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-58c5b5c6c9-ctf9m" Jun 03 19:28:51.288350 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:28:51.288275 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-58c5b5c6c9-ctf9m" podStartSLOduration=11.288258916 podStartE2EDuration="11.288258916s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:28:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:28:42.310330517 +0000 UTC m=+469.155989934" watchObservedRunningTime="2026-06-03 19:28:51.288258916 +0000 UTC m=+478.133918330" Jun 03 19:28:51.328091 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:28:51.328057 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-58c5b5c6c9-ctf9m" Jun 03 19:28:51.376270 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:28:51.376232 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c697fb878-kw8rq"] Jun 03 19:29:16.401166 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:29:16.401099 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-c697fb878-kw8rq" podUID="ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd" containerName="console" containerID="cri-o://317de92764b5fc299648c6de36f2bbd3c7ca6685987c299531ca133e23aa2946" gracePeriod=15 Jun 03 19:29:16.644762 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:29:16.644735 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c697fb878-kw8rq" Jun 03 19:29:16.681131 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:29:16.681040 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd-console-config\") pod \"ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd\" (UID: \"ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd\") " Jun 03 19:29:16.681131 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:29:16.681077 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd-service-ca\") pod \"ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd\" (UID: \"ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd\") " Jun 03 19:29:16.681131 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:29:16.681112 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd-trusted-ca-bundle\") pod \"ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd\" (UID: \"ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd\") " Jun 03 19:29:16.681452 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:29:16.681135 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd-console-oauth-config\") pod \"ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd\" (UID: \"ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd\") " Jun 03 19:29:16.681452 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:29:16.681185 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd-oauth-serving-cert\") pod \"ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd\" (UID: \"ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd\") " Jun 03 19:29:16.681452 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:29:16.681330 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd-console-serving-cert\") pod \"ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd\" (UID: \"ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd\") " Jun 03 19:29:16.681452 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:29:16.681414 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-88jkg\" (UniqueName: \"kubernetes.io/projected/ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd-kube-api-access-88jkg\") pod \"ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd\" (UID: \"ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd\") " Jun 03 19:29:16.681677 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:29:16.681563 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd-console-config" (OuterVolumeSpecName: "console-config") pod "ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd" (UID: "ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 19:29:16.681755 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:29:16.681733 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd" (UID: "ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 19:29:16.681828 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:29:16.681813 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd-console-config\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\"" Jun 03 19:29:16.681886 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:29:16.681835 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd-trusted-ca-bundle\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\"" Jun 03 19:29:16.681886 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:29:16.681499 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd-service-ca" (OuterVolumeSpecName: "service-ca") pod "ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd" (UID: "ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 19:29:16.682092 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:29:16.682068 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd" (UID: "ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 19:29:16.683775 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:29:16.683749 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd-kube-api-access-88jkg" (OuterVolumeSpecName: "kube-api-access-88jkg") pod "ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd" (UID: "ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd"). InnerVolumeSpecName "kube-api-access-88jkg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:29:16.684086 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:29:16.684063 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd" (UID: "ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 19:29:16.684132 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:29:16.684077 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd" (UID: "ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 19:29:16.782709 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:29:16.782663 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-88jkg\" (UniqueName: \"kubernetes.io/projected/ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd-kube-api-access-88jkg\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\"" Jun 03 19:29:16.782709 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:29:16.782703 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd-service-ca\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\"" Jun 03 19:29:16.782709 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:29:16.782717 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd-console-oauth-config\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\"" Jun 03 19:29:16.782947 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:29:16.782729 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd-oauth-serving-cert\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\"" Jun 03 19:29:16.782947 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:29:16.782741 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd-console-serving-cert\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\"" Jun 03 19:29:17.415713 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:29:17.415678 2579 generic.go:356] "Generic (PLEG): container finished" podID="ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd" containerID="317de92764b5fc299648c6de36f2bbd3c7ca6685987c299531ca133e23aa2946" exitCode=0 Jun 03 19:29:17.416135 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:29:17.415723 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c697fb878-kw8rq" Jun 03 19:29:17.416135 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:29:17.415750 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c697fb878-kw8rq" event={"ID":"ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd","Type":"ContainerDied","Data":"317de92764b5fc299648c6de36f2bbd3c7ca6685987c299531ca133e23aa2946"} Jun 03 19:29:17.416135 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:29:17.415791 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c697fb878-kw8rq" event={"ID":"ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd","Type":"ContainerDied","Data":"38491a4164082c26b4815bfb750ce46190420bfddf33db80d519556d437baf7d"} Jun 03 19:29:17.416135 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:29:17.415811 2579 scope.go:117] "RemoveContainer" containerID="317de92764b5fc299648c6de36f2bbd3c7ca6685987c299531ca133e23aa2946" Jun 03 19:29:17.424559 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:29:17.424536 2579 scope.go:117] "RemoveContainer" containerID="317de92764b5fc299648c6de36f2bbd3c7ca6685987c299531ca133e23aa2946" Jun 03 19:29:17.424851 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:29:17.424832 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"317de92764b5fc299648c6de36f2bbd3c7ca6685987c299531ca133e23aa2946\": container with ID starting with 317de92764b5fc299648c6de36f2bbd3c7ca6685987c299531ca133e23aa2946 not found: ID does not exist" containerID="317de92764b5fc299648c6de36f2bbd3c7ca6685987c299531ca133e23aa2946" Jun 03 19:29:17.424892 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:29:17.424861 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"317de92764b5fc299648c6de36f2bbd3c7ca6685987c299531ca133e23aa2946"} err="failed to get container status \"317de92764b5fc299648c6de36f2bbd3c7ca6685987c299531ca133e23aa2946\": rpc error: code = NotFound desc = could not find container \"317de92764b5fc299648c6de36f2bbd3c7ca6685987c299531ca133e23aa2946\": container with ID starting with 317de92764b5fc299648c6de36f2bbd3c7ca6685987c299531ca133e23aa2946 not found: ID does not exist" Jun 03 19:29:17.436917 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:29:17.436885 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c697fb878-kw8rq"] Jun 03 19:29:17.440447 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:29:17.440417 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-c697fb878-kw8rq"] Jun 03 19:29:17.608940 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:29:17.608905 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd" path="/var/lib/kubelet/pods/ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd/volumes" Jun 03 19:29:46.386863 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:29:46.386767 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-n89jn"] Jun 03 19:29:46.387260 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:29:46.387074 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd" containerName="console" Jun 03 19:29:46.387260 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:29:46.387086 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd" containerName="console" Jun 03 19:29:46.387260 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:29:46.387138 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad30ee95-8f27-48a4-ae3d-d3ca74c6afcd" containerName="console" Jun 03 19:29:46.389944 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:29:46.389925 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-n89jn" Jun 03 19:29:46.392701 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:29:46.392667 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 03 19:29:46.392841 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:29:46.392735 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-prcxc\"" Jun 03 19:29:46.393509 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:29:46.393493 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 03 19:29:46.403156 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:29:46.403126 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-n89jn"] Jun 03 19:29:46.519681 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:29:46.519646 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/00073a56-8bf5-4ccd-b692-2079c1bf750e-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-n89jn\" (UID: \"00073a56-8bf5-4ccd-b692-2079c1bf750e\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-n89jn" Jun 03 19:29:46.519681 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:29:46.519686 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5smjb\" (UniqueName: \"kubernetes.io/projected/00073a56-8bf5-4ccd-b692-2079c1bf750e-kube-api-access-5smjb\") pod \"cert-manager-webhook-7dc76cbb94-n89jn\" (UID: \"00073a56-8bf5-4ccd-b692-2079c1bf750e\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-n89jn" Jun 03 19:29:46.620838 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:29:46.620797 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5smjb\" (UniqueName: \"kubernetes.io/projected/00073a56-8bf5-4ccd-b692-2079c1bf750e-kube-api-access-5smjb\") pod \"cert-manager-webhook-7dc76cbb94-n89jn\" (UID: \"00073a56-8bf5-4ccd-b692-2079c1bf750e\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-n89jn" Jun 03 19:29:46.621023 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:29:46.620888 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/00073a56-8bf5-4ccd-b692-2079c1bf750e-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-n89jn\" (UID: \"00073a56-8bf5-4ccd-b692-2079c1bf750e\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-n89jn" Jun 03 19:29:46.631868 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:29:46.631834 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/00073a56-8bf5-4ccd-b692-2079c1bf750e-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-n89jn\" (UID: \"00073a56-8bf5-4ccd-b692-2079c1bf750e\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-n89jn" Jun 03 19:29:46.632002 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:29:46.631896 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5smjb\" (UniqueName: \"kubernetes.io/projected/00073a56-8bf5-4ccd-b692-2079c1bf750e-kube-api-access-5smjb\") pod \"cert-manager-webhook-7dc76cbb94-n89jn\" (UID: \"00073a56-8bf5-4ccd-b692-2079c1bf750e\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-n89jn" Jun 03 19:29:46.699383 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:29:46.699325 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-n89jn" Jun 03 19:29:46.840781 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:29:46.840748 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-n89jn"] Jun 03 19:29:46.845681 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:29:46.845640 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod00073a56_8bf5_4ccd_b692_2079c1bf750e.slice/crio-a014487430586d0268bc991131132644d23f92bd3c3c451b7e86351f29125dfa WatchSource:0}: Error finding container a014487430586d0268bc991131132644d23f92bd3c3c451b7e86351f29125dfa: Status 404 returned error can't find the container with id a014487430586d0268bc991131132644d23f92bd3c3c451b7e86351f29125dfa Jun 03 19:29:47.524336 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:29:47.524298 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-n89jn" event={"ID":"00073a56-8bf5-4ccd-b692-2079c1bf750e","Type":"ContainerStarted","Data":"a014487430586d0268bc991131132644d23f92bd3c3c451b7e86351f29125dfa"} Jun 03 19:29:50.538138 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:29:50.538045 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-n89jn" event={"ID":"00073a56-8bf5-4ccd-b692-2079c1bf750e","Type":"ContainerStarted","Data":"f75edae3882f1dae8ec043a067c72e3723fa6d3811b41c7f8950e119ad2f8e3e"} Jun 03 19:29:50.538138 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:29:50.538110 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-n89jn" Jun 03 19:29:50.564612 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:29:50.564551 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-n89jn" podStartSLOduration=1.226248101 podStartE2EDuration="4.564534112s" totalImagesPullingTime="3.338286011s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:29:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:29:50.563545208 +0000 UTC m=+537.409204647" watchObservedRunningTime="2026-06-03 19:29:50.564534112 +0000 UTC m=+537.410193527" Jun 03 19:29:56.544874 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:29:56.544840 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-n89jn" Jun 03 19:30:17.929929 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:17.929894 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d56d45df5-rsjk6"] Jun 03 19:30:17.933157 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:17.933138 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7d56d45df5-rsjk6" Jun 03 19:30:17.937109 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:17.937084 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 03 19:30:17.937424 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:17.937405 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 03 19:30:17.937528 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:17.937516 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-srlj4\"" Jun 03 19:30:17.937787 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:17.937767 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 03 19:30:17.941200 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:17.941184 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 03 19:30:17.963928 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:17.963890 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d56d45df5-rsjk6"] Jun 03 19:30:17.982088 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:17.982048 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/34166712-240f-4e83-a73d-2aad2e475ce6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d56d45df5-rsjk6\" (UID: \"34166712-240f-4e83-a73d-2aad2e475ce6\") " pod="opendatahub/opendatahub-operator-controller-manager-7d56d45df5-rsjk6" Jun 03 19:30:17.982273 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:17.982120 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/34166712-240f-4e83-a73d-2aad2e475ce6-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d56d45df5-rsjk6\" (UID: \"34166712-240f-4e83-a73d-2aad2e475ce6\") " pod="opendatahub/opendatahub-operator-controller-manager-7d56d45df5-rsjk6" Jun 03 19:30:17.982273 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:17.982148 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/34166712-240f-4e83-a73d-2aad2e475ce6-manifests\") pod \"opendatahub-operator-controller-manager-7d56d45df5-rsjk6\" (UID: \"34166712-240f-4e83-a73d-2aad2e475ce6\") " pod="opendatahub/opendatahub-operator-controller-manager-7d56d45df5-rsjk6" Jun 03 19:30:17.982273 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:17.982183 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/34166712-240f-4e83-a73d-2aad2e475ce6-tmp\") pod \"opendatahub-operator-controller-manager-7d56d45df5-rsjk6\" (UID: \"34166712-240f-4e83-a73d-2aad2e475ce6\") " pod="opendatahub/opendatahub-operator-controller-manager-7d56d45df5-rsjk6" Jun 03 19:30:17.982273 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:17.982201 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnzmc\" (UniqueName: \"kubernetes.io/projected/34166712-240f-4e83-a73d-2aad2e475ce6-kube-api-access-qnzmc\") pod \"opendatahub-operator-controller-manager-7d56d45df5-rsjk6\" (UID: \"34166712-240f-4e83-a73d-2aad2e475ce6\") " pod="opendatahub/opendatahub-operator-controller-manager-7d56d45df5-rsjk6" Jun 03 19:30:18.083499 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:18.083463 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/34166712-240f-4e83-a73d-2aad2e475ce6-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d56d45df5-rsjk6\" (UID: \"34166712-240f-4e83-a73d-2aad2e475ce6\") " pod="opendatahub/opendatahub-operator-controller-manager-7d56d45df5-rsjk6" Jun 03 19:30:18.083499 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:18.083504 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/34166712-240f-4e83-a73d-2aad2e475ce6-manifests\") pod \"opendatahub-operator-controller-manager-7d56d45df5-rsjk6\" (UID: \"34166712-240f-4e83-a73d-2aad2e475ce6\") " pod="opendatahub/opendatahub-operator-controller-manager-7d56d45df5-rsjk6" Jun 03 19:30:18.083770 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:18.083538 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/34166712-240f-4e83-a73d-2aad2e475ce6-tmp\") pod \"opendatahub-operator-controller-manager-7d56d45df5-rsjk6\" (UID: \"34166712-240f-4e83-a73d-2aad2e475ce6\") " pod="opendatahub/opendatahub-operator-controller-manager-7d56d45df5-rsjk6" Jun 03 19:30:18.083770 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:18.083556 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnzmc\" (UniqueName: \"kubernetes.io/projected/34166712-240f-4e83-a73d-2aad2e475ce6-kube-api-access-qnzmc\") pod \"opendatahub-operator-controller-manager-7d56d45df5-rsjk6\" (UID: \"34166712-240f-4e83-a73d-2aad2e475ce6\") " pod="opendatahub/opendatahub-operator-controller-manager-7d56d45df5-rsjk6" Jun 03 19:30:18.083770 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:18.083596 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/34166712-240f-4e83-a73d-2aad2e475ce6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d56d45df5-rsjk6\" (UID: \"34166712-240f-4e83-a73d-2aad2e475ce6\") " pod="opendatahub/opendatahub-operator-controller-manager-7d56d45df5-rsjk6" Jun 03 19:30:18.084078 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:18.084045 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/34166712-240f-4e83-a73d-2aad2e475ce6-manifests\") pod \"opendatahub-operator-controller-manager-7d56d45df5-rsjk6\" (UID: \"34166712-240f-4e83-a73d-2aad2e475ce6\") " pod="opendatahub/opendatahub-operator-controller-manager-7d56d45df5-rsjk6" Jun 03 19:30:18.086070 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:18.086046 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/34166712-240f-4e83-a73d-2aad2e475ce6-tmp\") pod \"opendatahub-operator-controller-manager-7d56d45df5-rsjk6\" (UID: \"34166712-240f-4e83-a73d-2aad2e475ce6\") " pod="opendatahub/opendatahub-operator-controller-manager-7d56d45df5-rsjk6" Jun 03 19:30:18.086435 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:18.086411 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/34166712-240f-4e83-a73d-2aad2e475ce6-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d56d45df5-rsjk6\" (UID: \"34166712-240f-4e83-a73d-2aad2e475ce6\") " pod="opendatahub/opendatahub-operator-controller-manager-7d56d45df5-rsjk6" Jun 03 19:30:18.086482 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:18.086443 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/34166712-240f-4e83-a73d-2aad2e475ce6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d56d45df5-rsjk6\" (UID: \"34166712-240f-4e83-a73d-2aad2e475ce6\") " pod="opendatahub/opendatahub-operator-controller-manager-7d56d45df5-rsjk6" Jun 03 19:30:18.096591 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:18.096559 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnzmc\" (UniqueName: \"kubernetes.io/projected/34166712-240f-4e83-a73d-2aad2e475ce6-kube-api-access-qnzmc\") pod \"opendatahub-operator-controller-manager-7d56d45df5-rsjk6\" (UID: \"34166712-240f-4e83-a73d-2aad2e475ce6\") " pod="opendatahub/opendatahub-operator-controller-manager-7d56d45df5-rsjk6" Jun 03 19:30:18.244754 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:18.244650 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7d56d45df5-rsjk6" Jun 03 19:30:18.398928 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:18.398901 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d56d45df5-rsjk6"] Jun 03 19:30:18.401488 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:30:18.401459 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34166712_240f_4e83_a73d_2aad2e475ce6.slice/crio-06707b478ad69a38307b39c50462bb244c494cf2639706b4c8ee1f5823cf4627 WatchSource:0}: Error finding container 06707b478ad69a38307b39c50462bb244c494cf2639706b4c8ee1f5823cf4627: Status 404 returned error can't find the container with id 06707b478ad69a38307b39c50462bb244c494cf2639706b4c8ee1f5823cf4627 Jun 03 19:30:18.639902 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:18.639869 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d56d45df5-rsjk6" event={"ID":"34166712-240f-4e83-a73d-2aad2e475ce6","Type":"ContainerStarted","Data":"06707b478ad69a38307b39c50462bb244c494cf2639706b4c8ee1f5823cf4627"} Jun 03 19:30:21.653349 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:21.653310 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d56d45df5-rsjk6" event={"ID":"34166712-240f-4e83-a73d-2aad2e475ce6","Type":"ContainerStarted","Data":"4cc0bb223da8ee25ae27edca7e5a943a7057ed97c73d1ee9e2f65e7434e98df5"} Jun 03 19:30:22.659268 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:22.659226 2579 generic.go:356] "Generic (PLEG): container finished" podID="34166712-240f-4e83-a73d-2aad2e475ce6" containerID="4cc0bb223da8ee25ae27edca7e5a943a7057ed97c73d1ee9e2f65e7434e98df5" exitCode=0 Jun 03 19:30:22.659696 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:22.659316 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d56d45df5-rsjk6" event={"ID":"34166712-240f-4e83-a73d-2aad2e475ce6","Type":"ContainerDied","Data":"4cc0bb223da8ee25ae27edca7e5a943a7057ed97c73d1ee9e2f65e7434e98df5"} Jun 03 19:30:23.665367 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:23.665331 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d56d45df5-rsjk6" event={"ID":"34166712-240f-4e83-a73d-2aad2e475ce6","Type":"ContainerStarted","Data":"9ce19ff5f568ac1d9f20dbb7e318556c5b118b5dcdb75ca88790b97e20a555a8"} Jun 03 19:30:23.665814 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:23.665463 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7d56d45df5-rsjk6" Jun 03 19:30:23.692356 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:23.692269 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7d56d45df5-rsjk6" podStartSLOduration=2.459029584 podStartE2EDuration="6.692245037s" totalImagesPullingTime="3.272836048s" totalInitContainerRuntime="960.379405ms" isStatefulPod=false podCreationTimestamp="2026-06-03 19:30:17 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:30:23.691706076 +0000 UTC m=+570.537365492" watchObservedRunningTime="2026-06-03 19:30:23.692245037 +0000 UTC m=+570.537904453" Jun 03 19:30:34.671652 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:34.671619 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7d56d45df5-rsjk6" Jun 03 19:30:37.743472 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:37.743431 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-256dp"] Jun 03 19:30:37.753020 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:37.752985 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-256dp" Jun 03 19:30:37.755682 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:37.755652 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 03 19:30:37.755832 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:37.755655 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-964mf\"" Jun 03 19:30:37.759429 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:37.759087 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-256dp"] Jun 03 19:30:37.859234 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:37.859195 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lx5mv\" (UniqueName: \"kubernetes.io/projected/9b7ae0eb-5ac9-4a2d-bc25-c5985ab31dd9-kube-api-access-lx5mv\") pod \"odh-model-controller-6dc94f689f-256dp\" (UID: \"9b7ae0eb-5ac9-4a2d-bc25-c5985ab31dd9\") " pod="opendatahub/odh-model-controller-6dc94f689f-256dp" Jun 03 19:30:37.859421 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:37.859279 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9b7ae0eb-5ac9-4a2d-bc25-c5985ab31dd9-cert\") pod \"odh-model-controller-6dc94f689f-256dp\" (UID: \"9b7ae0eb-5ac9-4a2d-bc25-c5985ab31dd9\") " pod="opendatahub/odh-model-controller-6dc94f689f-256dp" Jun 03 19:30:37.960695 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:37.960643 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lx5mv\" (UniqueName: \"kubernetes.io/projected/9b7ae0eb-5ac9-4a2d-bc25-c5985ab31dd9-kube-api-access-lx5mv\") pod \"odh-model-controller-6dc94f689f-256dp\" (UID: \"9b7ae0eb-5ac9-4a2d-bc25-c5985ab31dd9\") " pod="opendatahub/odh-model-controller-6dc94f689f-256dp" Jun 03 19:30:37.960695 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:37.960706 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9b7ae0eb-5ac9-4a2d-bc25-c5985ab31dd9-cert\") pod \"odh-model-controller-6dc94f689f-256dp\" (UID: \"9b7ae0eb-5ac9-4a2d-bc25-c5985ab31dd9\") " pod="opendatahub/odh-model-controller-6dc94f689f-256dp" Jun 03 19:30:37.960928 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:30:37.960833 2579 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 03 19:30:37.960928 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:30:37.960888 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b7ae0eb-5ac9-4a2d-bc25-c5985ab31dd9-cert podName:9b7ae0eb-5ac9-4a2d-bc25-c5985ab31dd9 nodeName:}" failed. No retries permitted until 2026-06-03 19:30:38.460870401 +0000 UTC m=+585.306529793 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/9b7ae0eb-5ac9-4a2d-bc25-c5985ab31dd9-cert") pod "odh-model-controller-6dc94f689f-256dp" (UID: "9b7ae0eb-5ac9-4a2d-bc25-c5985ab31dd9") : secret "odh-model-controller-webhook-cert" not found Jun 03 19:30:37.972843 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:37.972806 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lx5mv\" (UniqueName: \"kubernetes.io/projected/9b7ae0eb-5ac9-4a2d-bc25-c5985ab31dd9-kube-api-access-lx5mv\") pod \"odh-model-controller-6dc94f689f-256dp\" (UID: \"9b7ae0eb-5ac9-4a2d-bc25-c5985ab31dd9\") " pod="opendatahub/odh-model-controller-6dc94f689f-256dp" Jun 03 19:30:38.246520 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:38.246481 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-46zv5"] Jun 03 19:30:38.250024 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:38.250005 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-46zv5" Jun 03 19:30:38.252317 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:38.252279 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 03 19:30:38.262214 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:38.262190 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-46zv5"] Jun 03 19:30:38.364742 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:38.364699 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrcz8\" (UniqueName: \"kubernetes.io/projected/f8e27063-851d-4ba7-ae7c-bee10b560730-kube-api-access-mrcz8\") pod \"model-serving-api-5dd488fc48-46zv5\" (UID: \"f8e27063-851d-4ba7-ae7c-bee10b560730\") " pod="opendatahub/model-serving-api-5dd488fc48-46zv5" Jun 03 19:30:38.364931 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:38.364787 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f8e27063-851d-4ba7-ae7c-bee10b560730-tls-certs\") pod \"model-serving-api-5dd488fc48-46zv5\" (UID: \"f8e27063-851d-4ba7-ae7c-bee10b560730\") " pod="opendatahub/model-serving-api-5dd488fc48-46zv5" Jun 03 19:30:38.466099 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:38.466065 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrcz8\" (UniqueName: \"kubernetes.io/projected/f8e27063-851d-4ba7-ae7c-bee10b560730-kube-api-access-mrcz8\") pod \"model-serving-api-5dd488fc48-46zv5\" (UID: \"f8e27063-851d-4ba7-ae7c-bee10b560730\") " pod="opendatahub/model-serving-api-5dd488fc48-46zv5" Jun 03 19:30:38.466325 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:38.466113 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9b7ae0eb-5ac9-4a2d-bc25-c5985ab31dd9-cert\") pod \"odh-model-controller-6dc94f689f-256dp\" (UID: \"9b7ae0eb-5ac9-4a2d-bc25-c5985ab31dd9\") " pod="opendatahub/odh-model-controller-6dc94f689f-256dp" Jun 03 19:30:38.466325 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:38.466260 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f8e27063-851d-4ba7-ae7c-bee10b560730-tls-certs\") pod \"model-serving-api-5dd488fc48-46zv5\" (UID: \"f8e27063-851d-4ba7-ae7c-bee10b560730\") " pod="opendatahub/model-serving-api-5dd488fc48-46zv5" Jun 03 19:30:38.468830 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:38.468801 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9b7ae0eb-5ac9-4a2d-bc25-c5985ab31dd9-cert\") pod \"odh-model-controller-6dc94f689f-256dp\" (UID: \"9b7ae0eb-5ac9-4a2d-bc25-c5985ab31dd9\") " pod="opendatahub/odh-model-controller-6dc94f689f-256dp" Jun 03 19:30:38.468950 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:38.468877 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f8e27063-851d-4ba7-ae7c-bee10b560730-tls-certs\") pod \"model-serving-api-5dd488fc48-46zv5\" (UID: \"f8e27063-851d-4ba7-ae7c-bee10b560730\") " pod="opendatahub/model-serving-api-5dd488fc48-46zv5" Jun 03 19:30:38.474986 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:38.474953 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrcz8\" (UniqueName: \"kubernetes.io/projected/f8e27063-851d-4ba7-ae7c-bee10b560730-kube-api-access-mrcz8\") pod \"model-serving-api-5dd488fc48-46zv5\" (UID: \"f8e27063-851d-4ba7-ae7c-bee10b560730\") " pod="opendatahub/model-serving-api-5dd488fc48-46zv5" Jun 03 19:30:38.559873 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:38.559781 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-46zv5" Jun 03 19:30:38.664669 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:38.664621 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-256dp" Jun 03 19:30:38.718945 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:38.718862 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-46zv5"] Jun 03 19:30:38.722865 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:30:38.722833 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8e27063_851d_4ba7_ae7c_bee10b560730.slice/crio-1cd4adcf03bfa59b02a3dbb21cc3b05bc7c8ccb60489bbc8050b7045770a3c0e WatchSource:0}: Error finding container 1cd4adcf03bfa59b02a3dbb21cc3b05bc7c8ccb60489bbc8050b7045770a3c0e: Status 404 returned error can't find the container with id 1cd4adcf03bfa59b02a3dbb21cc3b05bc7c8ccb60489bbc8050b7045770a3c0e Jun 03 19:30:38.813776 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:38.813674 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-256dp"] Jun 03 19:30:38.817690 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:30:38.817662 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b7ae0eb_5ac9_4a2d_bc25_c5985ab31dd9.slice/crio-2c2426d60a8f7e3e47b6e7ef0c911594a788a6cff93342744401e8540f25e2b3 WatchSource:0}: Error finding container 2c2426d60a8f7e3e47b6e7ef0c911594a788a6cff93342744401e8540f25e2b3: Status 404 returned error can't find the container with id 2c2426d60a8f7e3e47b6e7ef0c911594a788a6cff93342744401e8540f25e2b3 Jun 03 19:30:39.728617 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:39.728546 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-46zv5" event={"ID":"f8e27063-851d-4ba7-ae7c-bee10b560730","Type":"ContainerStarted","Data":"1cd4adcf03bfa59b02a3dbb21cc3b05bc7c8ccb60489bbc8050b7045770a3c0e"} Jun 03 19:30:39.731095 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:39.731008 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-256dp" event={"ID":"9b7ae0eb-5ac9-4a2d-bc25-c5985ab31dd9","Type":"ContainerStarted","Data":"2c2426d60a8f7e3e47b6e7ef0c911594a788a6cff93342744401e8540f25e2b3"} Jun 03 19:30:43.388595 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:43.388555 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-d68c4fc59-tprs2"] Jun 03 19:30:43.391817 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:43.391796 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-d68c4fc59-tprs2" Jun 03 19:30:43.395221 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:43.395189 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 03 19:30:43.396208 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:43.396170 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 03 19:30:43.396208 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:43.396195 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 03 19:30:43.396445 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:43.396215 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 03 19:30:43.396445 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:43.396174 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-cwh4w\"" Jun 03 19:30:43.406485 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:43.406452 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-d68c4fc59-tprs2"] Jun 03 19:30:43.517912 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:43.517872 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/65d4d626-909d-4e1d-8ea2-6d1e31bbb547-tls-certs\") pod \"kube-auth-proxy-d68c4fc59-tprs2\" (UID: \"65d4d626-909d-4e1d-8ea2-6d1e31bbb547\") " pod="openshift-ingress/kube-auth-proxy-d68c4fc59-tprs2" Jun 03 19:30:43.518109 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:43.517931 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/65d4d626-909d-4e1d-8ea2-6d1e31bbb547-tmp\") pod \"kube-auth-proxy-d68c4fc59-tprs2\" (UID: \"65d4d626-909d-4e1d-8ea2-6d1e31bbb547\") " pod="openshift-ingress/kube-auth-proxy-d68c4fc59-tprs2" Jun 03 19:30:43.518109 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:43.517957 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwdqc\" (UniqueName: \"kubernetes.io/projected/65d4d626-909d-4e1d-8ea2-6d1e31bbb547-kube-api-access-vwdqc\") pod \"kube-auth-proxy-d68c4fc59-tprs2\" (UID: \"65d4d626-909d-4e1d-8ea2-6d1e31bbb547\") " pod="openshift-ingress/kube-auth-proxy-d68c4fc59-tprs2" Jun 03 19:30:43.619094 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:43.619055 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwdqc\" (UniqueName: \"kubernetes.io/projected/65d4d626-909d-4e1d-8ea2-6d1e31bbb547-kube-api-access-vwdqc\") pod \"kube-auth-proxy-d68c4fc59-tprs2\" (UID: \"65d4d626-909d-4e1d-8ea2-6d1e31bbb547\") " pod="openshift-ingress/kube-auth-proxy-d68c4fc59-tprs2" Jun 03 19:30:43.619269 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:43.619122 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/65d4d626-909d-4e1d-8ea2-6d1e31bbb547-tls-certs\") pod \"kube-auth-proxy-d68c4fc59-tprs2\" (UID: \"65d4d626-909d-4e1d-8ea2-6d1e31bbb547\") " pod="openshift-ingress/kube-auth-proxy-d68c4fc59-tprs2" Jun 03 19:30:43.619269 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:43.619162 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/65d4d626-909d-4e1d-8ea2-6d1e31bbb547-tmp\") pod \"kube-auth-proxy-d68c4fc59-tprs2\" (UID: \"65d4d626-909d-4e1d-8ea2-6d1e31bbb547\") " pod="openshift-ingress/kube-auth-proxy-d68c4fc59-tprs2" Jun 03 19:30:43.621588 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:43.621555 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/65d4d626-909d-4e1d-8ea2-6d1e31bbb547-tmp\") pod \"kube-auth-proxy-d68c4fc59-tprs2\" (UID: \"65d4d626-909d-4e1d-8ea2-6d1e31bbb547\") " pod="openshift-ingress/kube-auth-proxy-d68c4fc59-tprs2" Jun 03 19:30:43.621784 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:43.621763 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/65d4d626-909d-4e1d-8ea2-6d1e31bbb547-tls-certs\") pod \"kube-auth-proxy-d68c4fc59-tprs2\" (UID: \"65d4d626-909d-4e1d-8ea2-6d1e31bbb547\") " pod="openshift-ingress/kube-auth-proxy-d68c4fc59-tprs2" Jun 03 19:30:43.629413 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:43.629381 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwdqc\" (UniqueName: \"kubernetes.io/projected/65d4d626-909d-4e1d-8ea2-6d1e31bbb547-kube-api-access-vwdqc\") pod \"kube-auth-proxy-d68c4fc59-tprs2\" (UID: \"65d4d626-909d-4e1d-8ea2-6d1e31bbb547\") " pod="openshift-ingress/kube-auth-proxy-d68c4fc59-tprs2" Jun 03 19:30:43.702981 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:43.702890 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-d68c4fc59-tprs2" Jun 03 19:30:43.754219 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:43.754180 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-46zv5" event={"ID":"f8e27063-851d-4ba7-ae7c-bee10b560730","Type":"ContainerStarted","Data":"75149038902d632ca908b8f3592f9d39caa9b6e52b7d5f76301c9433a311e6d2"} Jun 03 19:30:43.754441 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:43.754280 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-46zv5" Jun 03 19:30:43.756333 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:43.756280 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-256dp" event={"ID":"9b7ae0eb-5ac9-4a2d-bc25-c5985ab31dd9","Type":"ContainerStarted","Data":"47d213a24852b03ab8b898961ec3820a050a9f2e3e4a7c46427d9a60d21f98fe"} Jun 03 19:30:43.756501 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:43.756433 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-256dp" Jun 03 19:30:43.777643 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:43.777578 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-46zv5" podStartSLOduration=1.644676912 podStartE2EDuration="5.777555565s" totalImagesPullingTime="4.132878653s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:30:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:30:43.776050618 +0000 UTC m=+590.621710035" watchObservedRunningTime="2026-06-03 19:30:43.777555565 +0000 UTC m=+590.623214984" Jun 03 19:30:43.792754 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:43.792622 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-256dp" podStartSLOduration=2.712010616 podStartE2EDuration="6.792597084s" totalImagesPullingTime="4.080586468s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:30:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:30:43.7920041 +0000 UTC m=+590.637663515" watchObservedRunningTime="2026-06-03 19:30:43.792597084 +0000 UTC m=+590.638256500" Jun 03 19:30:43.857317 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:43.857269 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-d68c4fc59-tprs2"] Jun 03 19:30:43.858676 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:30:43.858648 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65d4d626_909d_4e1d_8ea2_6d1e31bbb547.slice/crio-d24ddef6a25c7316a491925b2bf7bfe1ccd7817a48b6e82a29cd124cf0eca1df WatchSource:0}: Error finding container d24ddef6a25c7316a491925b2bf7bfe1ccd7817a48b6e82a29cd124cf0eca1df: Status 404 returned error can't find the container with id d24ddef6a25c7316a491925b2bf7bfe1ccd7817a48b6e82a29cd124cf0eca1df Jun 03 19:30:44.763829 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:44.763781 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-d68c4fc59-tprs2" event={"ID":"65d4d626-909d-4e1d-8ea2-6d1e31bbb547","Type":"ContainerStarted","Data":"d24ddef6a25c7316a491925b2bf7bfe1ccd7817a48b6e82a29cd124cf0eca1df"} Jun 03 19:30:47.777460 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:47.777423 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-d68c4fc59-tprs2" event={"ID":"65d4d626-909d-4e1d-8ea2-6d1e31bbb547","Type":"ContainerStarted","Data":"a5b0ac8e79f615ecabe53a29cdcd5d800b3c09564e8278f6f71f04e43ed432ba"} Jun 03 19:30:47.796801 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:47.796745 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-d68c4fc59-tprs2" podStartSLOduration=1.7831252119999998 podStartE2EDuration="4.796726081s" totalImagesPullingTime="3.013600869s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:30:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:30:47.795772033 +0000 UTC m=+594.641431448" watchObservedRunningTime="2026-06-03 19:30:47.796726081 +0000 UTC m=+594.642385522" Jun 03 19:30:49.173708 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:49.173667 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-4j2r9"] Jun 03 19:30:49.177038 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:49.177015 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-4j2r9" Jun 03 19:30:49.180790 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:49.180756 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 03 19:30:49.180920 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:49.180861 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-dt6pf\"" Jun 03 19:30:49.190112 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:49.190084 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-pn9sz"] Jun 03 19:30:49.193532 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:49.193505 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-4j2r9"] Jun 03 19:30:49.193644 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:49.193622 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-pn9sz" Jun 03 19:30:49.197476 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:49.197456 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 03 19:30:49.197701 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:49.197687 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-cvcwn\"" Jun 03 19:30:49.213362 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:49.213328 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-pn9sz"] Jun 03 19:30:49.270673 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:49.270630 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/28167aeb-e4ac-4c15-829f-10e5914d5c6a-cert\") pod \"kserve-controller-manager-69fc866d76-4j2r9\" (UID: \"28167aeb-e4ac-4c15-829f-10e5914d5c6a\") " pod="opendatahub/kserve-controller-manager-69fc866d76-4j2r9" Jun 03 19:30:49.270673 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:49.270673 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzrxq\" (UniqueName: \"kubernetes.io/projected/28167aeb-e4ac-4c15-829f-10e5914d5c6a-kube-api-access-mzrxq\") pod \"kserve-controller-manager-69fc866d76-4j2r9\" (UID: \"28167aeb-e4ac-4c15-829f-10e5914d5c6a\") " pod="opendatahub/kserve-controller-manager-69fc866d76-4j2r9" Jun 03 19:30:49.371510 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:49.371472 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thhfd\" (UniqueName: \"kubernetes.io/projected/752b47cd-19d4-4c7a-b3a3-fe503df57b14-kube-api-access-thhfd\") pod \"llmisvc-controller-manager-864bfd7bc9-pn9sz\" (UID: \"752b47cd-19d4-4c7a-b3a3-fe503df57b14\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-pn9sz" Jun 03 19:30:49.371688 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:49.371535 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/28167aeb-e4ac-4c15-829f-10e5914d5c6a-cert\") pod \"kserve-controller-manager-69fc866d76-4j2r9\" (UID: \"28167aeb-e4ac-4c15-829f-10e5914d5c6a\") " pod="opendatahub/kserve-controller-manager-69fc866d76-4j2r9" Jun 03 19:30:49.371688 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:49.371555 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzrxq\" (UniqueName: \"kubernetes.io/projected/28167aeb-e4ac-4c15-829f-10e5914d5c6a-kube-api-access-mzrxq\") pod \"kserve-controller-manager-69fc866d76-4j2r9\" (UID: \"28167aeb-e4ac-4c15-829f-10e5914d5c6a\") " pod="opendatahub/kserve-controller-manager-69fc866d76-4j2r9" Jun 03 19:30:49.371688 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:49.371588 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/752b47cd-19d4-4c7a-b3a3-fe503df57b14-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-pn9sz\" (UID: \"752b47cd-19d4-4c7a-b3a3-fe503df57b14\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-pn9sz" Jun 03 19:30:49.374398 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:49.374368 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/28167aeb-e4ac-4c15-829f-10e5914d5c6a-cert\") pod \"kserve-controller-manager-69fc866d76-4j2r9\" (UID: \"28167aeb-e4ac-4c15-829f-10e5914d5c6a\") " pod="opendatahub/kserve-controller-manager-69fc866d76-4j2r9" Jun 03 19:30:49.400866 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:49.400835 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzrxq\" (UniqueName: \"kubernetes.io/projected/28167aeb-e4ac-4c15-829f-10e5914d5c6a-kube-api-access-mzrxq\") pod \"kserve-controller-manager-69fc866d76-4j2r9\" (UID: \"28167aeb-e4ac-4c15-829f-10e5914d5c6a\") " pod="opendatahub/kserve-controller-manager-69fc866d76-4j2r9" Jun 03 19:30:49.472088 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:49.471972 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/752b47cd-19d4-4c7a-b3a3-fe503df57b14-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-pn9sz\" (UID: \"752b47cd-19d4-4c7a-b3a3-fe503df57b14\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-pn9sz" Jun 03 19:30:49.472088 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:49.472067 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thhfd\" (UniqueName: \"kubernetes.io/projected/752b47cd-19d4-4c7a-b3a3-fe503df57b14-kube-api-access-thhfd\") pod \"llmisvc-controller-manager-864bfd7bc9-pn9sz\" (UID: \"752b47cd-19d4-4c7a-b3a3-fe503df57b14\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-pn9sz" Jun 03 19:30:49.474659 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:49.474635 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/752b47cd-19d4-4c7a-b3a3-fe503df57b14-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-pn9sz\" (UID: \"752b47cd-19d4-4c7a-b3a3-fe503df57b14\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-pn9sz" Jun 03 19:30:49.483900 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:49.483876 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-thhfd\" (UniqueName: \"kubernetes.io/projected/752b47cd-19d4-4c7a-b3a3-fe503df57b14-kube-api-access-thhfd\") pod \"llmisvc-controller-manager-864bfd7bc9-pn9sz\" (UID: \"752b47cd-19d4-4c7a-b3a3-fe503df57b14\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-pn9sz" Jun 03 19:30:49.487640 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:49.487621 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-4j2r9" Jun 03 19:30:49.504229 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:49.504188 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-pn9sz" Jun 03 19:30:49.644735 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:49.644695 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-4j2r9"] Jun 03 19:30:49.646044 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:30:49.646015 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28167aeb_e4ac_4c15_829f_10e5914d5c6a.slice/crio-49aebae356ae297e90468014bbe36fb612aef451c87743842e37adfc3c50d0d9 WatchSource:0}: Error finding container 49aebae356ae297e90468014bbe36fb612aef451c87743842e37adfc3c50d0d9: Status 404 returned error can't find the container with id 49aebae356ae297e90468014bbe36fb612aef451c87743842e37adfc3c50d0d9 Jun 03 19:30:49.659783 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:49.659747 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-pn9sz"] Jun 03 19:30:49.662667 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:30:49.662639 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod752b47cd_19d4_4c7a_b3a3_fe503df57b14.slice/crio-c2cb0de9643ba187cf4214710c8145c9f8753089af154a301eee331b2ae72500 WatchSource:0}: Error finding container c2cb0de9643ba187cf4214710c8145c9f8753089af154a301eee331b2ae72500: Status 404 returned error can't find the container with id c2cb0de9643ba187cf4214710c8145c9f8753089af154a301eee331b2ae72500 Jun 03 19:30:49.791071 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:49.790960 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-pn9sz" event={"ID":"752b47cd-19d4-4c7a-b3a3-fe503df57b14","Type":"ContainerStarted","Data":"c2cb0de9643ba187cf4214710c8145c9f8753089af154a301eee331b2ae72500"} Jun 03 19:30:49.792034 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:49.792009 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-4j2r9" event={"ID":"28167aeb-e4ac-4c15-829f-10e5914d5c6a","Type":"ContainerStarted","Data":"49aebae356ae297e90468014bbe36fb612aef451c87743842e37adfc3c50d0d9"} Jun 03 19:30:53.565433 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:53.565401 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-jrw5d_b76503e3-1d27-4456-b636-148e6e9d14b2/console-operator/2.log" Jun 03 19:30:53.565885 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:53.565753 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-jrw5d_b76503e3-1d27-4456-b636-148e6e9d14b2/console-operator/2.log" Jun 03 19:30:53.812961 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:53.812922 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-4j2r9" event={"ID":"28167aeb-e4ac-4c15-829f-10e5914d5c6a","Type":"ContainerStarted","Data":"7dce29e8c884a801a19de32ec785364e50e382a5d8e4d58e8d62f39dd4c8d1b9"} Jun 03 19:30:53.815195 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:53.813017 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-4j2r9" Jun 03 19:30:53.815195 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:53.814428 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-pn9sz" event={"ID":"752b47cd-19d4-4c7a-b3a3-fe503df57b14","Type":"ContainerStarted","Data":"ebe32c071a0623fe547de4ad7d88f9d054e508d78149c0f7a1e498f03111e3bf"} Jun 03 19:30:53.815195 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:53.814544 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-pn9sz" Jun 03 19:30:53.833353 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:53.833224 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-4j2r9" podStartSLOduration=1.709580596 podStartE2EDuration="4.833204872s" totalImagesPullingTime="3.123624276s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:30:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:30:53.8310474 +0000 UTC m=+600.676706818" watchObservedRunningTime="2026-06-03 19:30:53.833204872 +0000 UTC m=+600.678864288" Jun 03 19:30:53.851907 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:53.851836 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-pn9sz" podStartSLOduration=1.7413016940000001 podStartE2EDuration="4.851811977s" totalImagesPullingTime="3.110510283s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:30:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:30:53.85170718 +0000 UTC m=+600.697366597" watchObservedRunningTime="2026-06-03 19:30:53.851811977 +0000 UTC m=+600.697471393" Jun 03 19:30:54.766467 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:54.766428 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-256dp" Jun 03 19:30:54.769628 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:30:54.769603 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-46zv5" Jun 03 19:31:00.021404 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:31:00.021318 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-8b9ffc7d9-sfb4s"] Jun 03 19:31:00.028863 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:31:00.028829 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-8b9ffc7d9-sfb4s" Jun 03 19:31:00.033362 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:31:00.033331 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-wlplj\"" Jun 03 19:31:00.033780 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:31:00.033762 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 03 19:31:00.051302 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:31:00.051262 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-8b9ffc7d9-sfb4s"] Jun 03 19:31:00.069114 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:31:00.069075 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wtd5\" (UniqueName: \"kubernetes.io/projected/000ee25d-2c22-4291-99b2-2f4399305d38-kube-api-access-5wtd5\") pod \"dashboard-redirect-8b9ffc7d9-sfb4s\" (UID: \"000ee25d-2c22-4291-99b2-2f4399305d38\") " pod="opendatahub/dashboard-redirect-8b9ffc7d9-sfb4s" Jun 03 19:31:00.069339 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:31:00.069200 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/000ee25d-2c22-4291-99b2-2f4399305d38-redirect-config\") pod \"dashboard-redirect-8b9ffc7d9-sfb4s\" (UID: \"000ee25d-2c22-4291-99b2-2f4399305d38\") " pod="opendatahub/dashboard-redirect-8b9ffc7d9-sfb4s" Jun 03 19:31:00.169707 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:31:00.169672 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wtd5\" (UniqueName: \"kubernetes.io/projected/000ee25d-2c22-4291-99b2-2f4399305d38-kube-api-access-5wtd5\") pod \"dashboard-redirect-8b9ffc7d9-sfb4s\" (UID: \"000ee25d-2c22-4291-99b2-2f4399305d38\") " pod="opendatahub/dashboard-redirect-8b9ffc7d9-sfb4s" Jun 03 19:31:00.169888 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:31:00.169741 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/000ee25d-2c22-4291-99b2-2f4399305d38-redirect-config\") pod \"dashboard-redirect-8b9ffc7d9-sfb4s\" (UID: \"000ee25d-2c22-4291-99b2-2f4399305d38\") " pod="opendatahub/dashboard-redirect-8b9ffc7d9-sfb4s" Jun 03 19:31:00.170455 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:31:00.170438 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/000ee25d-2c22-4291-99b2-2f4399305d38-redirect-config\") pod \"dashboard-redirect-8b9ffc7d9-sfb4s\" (UID: \"000ee25d-2c22-4291-99b2-2f4399305d38\") " pod="opendatahub/dashboard-redirect-8b9ffc7d9-sfb4s" Jun 03 19:31:00.181056 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:31:00.181024 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wtd5\" (UniqueName: \"kubernetes.io/projected/000ee25d-2c22-4291-99b2-2f4399305d38-kube-api-access-5wtd5\") pod \"dashboard-redirect-8b9ffc7d9-sfb4s\" (UID: \"000ee25d-2c22-4291-99b2-2f4399305d38\") " pod="opendatahub/dashboard-redirect-8b9ffc7d9-sfb4s" Jun 03 19:31:00.339250 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:31:00.339158 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-8b9ffc7d9-sfb4s" Jun 03 19:31:00.485889 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:31:00.485864 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-8b9ffc7d9-sfb4s"] Jun 03 19:31:00.487690 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:31:00.487660 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod000ee25d_2c22_4291_99b2_2f4399305d38.slice/crio-38031364ebbcd829c71bd76577a35f8cee7fe28845f856526ac52c95d0f8e095 WatchSource:0}: Error finding container 38031364ebbcd829c71bd76577a35f8cee7fe28845f856526ac52c95d0f8e095: Status 404 returned error can't find the container with id 38031364ebbcd829c71bd76577a35f8cee7fe28845f856526ac52c95d0f8e095 Jun 03 19:31:00.489055 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:31:00.489036 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 19:31:00.850190 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:31:00.850150 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-8b9ffc7d9-sfb4s" event={"ID":"000ee25d-2c22-4291-99b2-2f4399305d38","Type":"ContainerStarted","Data":"38031364ebbcd829c71bd76577a35f8cee7fe28845f856526ac52c95d0f8e095"} Jun 03 19:31:02.053570 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:31:02.053526 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-gm6kr"] Jun 03 19:31:02.056448 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:31:02.056431 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-gm6kr" Jun 03 19:31:02.059973 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:31:02.059942 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 03 19:31:02.060352 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:31:02.060332 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 03 19:31:02.060452 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:31:02.060358 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-x5tgr\"" Jun 03 19:31:02.072483 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:31:02.072456 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-gm6kr"] Jun 03 19:31:02.086981 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:31:02.086946 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmwjx\" (UniqueName: \"kubernetes.io/projected/803e2c6b-385f-41dd-827a-ad8fdab62fa2-kube-api-access-tmwjx\") pod \"servicemesh-operator3-57f65f65fb-gm6kr\" (UID: \"803e2c6b-385f-41dd-827a-ad8fdab62fa2\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-gm6kr" Jun 03 19:31:02.087152 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:31:02.086994 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/803e2c6b-385f-41dd-827a-ad8fdab62fa2-operator-config\") pod \"servicemesh-operator3-57f65f65fb-gm6kr\" (UID: \"803e2c6b-385f-41dd-827a-ad8fdab62fa2\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-gm6kr" Jun 03 19:31:02.188317 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:31:02.188255 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmwjx\" (UniqueName: \"kubernetes.io/projected/803e2c6b-385f-41dd-827a-ad8fdab62fa2-kube-api-access-tmwjx\") pod \"servicemesh-operator3-57f65f65fb-gm6kr\" (UID: \"803e2c6b-385f-41dd-827a-ad8fdab62fa2\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-gm6kr" Jun 03 19:31:02.188516 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:31:02.188347 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/803e2c6b-385f-41dd-827a-ad8fdab62fa2-operator-config\") pod \"servicemesh-operator3-57f65f65fb-gm6kr\" (UID: \"803e2c6b-385f-41dd-827a-ad8fdab62fa2\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-gm6kr" Jun 03 19:31:02.191184 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:31:02.191156 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/803e2c6b-385f-41dd-827a-ad8fdab62fa2-operator-config\") pod \"servicemesh-operator3-57f65f65fb-gm6kr\" (UID: \"803e2c6b-385f-41dd-827a-ad8fdab62fa2\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-gm6kr" Jun 03 19:31:02.198158 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:31:02.198129 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmwjx\" (UniqueName: \"kubernetes.io/projected/803e2c6b-385f-41dd-827a-ad8fdab62fa2-kube-api-access-tmwjx\") pod \"servicemesh-operator3-57f65f65fb-gm6kr\" (UID: \"803e2c6b-385f-41dd-827a-ad8fdab62fa2\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-gm6kr" Jun 03 19:31:02.367195 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:31:02.367095 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-gm6kr" Jun 03 19:31:02.537712 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:31:02.537680 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-gm6kr"] Jun 03 19:31:02.541614 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:31:02.541587 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod803e2c6b_385f_41dd_827a_ad8fdab62fa2.slice/crio-00c68fe3f136213a5b5a6338aacda2427078f9ba58b99d1acd4ec92a3283a721 WatchSource:0}: Error finding container 00c68fe3f136213a5b5a6338aacda2427078f9ba58b99d1acd4ec92a3283a721: Status 404 returned error can't find the container with id 00c68fe3f136213a5b5a6338aacda2427078f9ba58b99d1acd4ec92a3283a721 Jun 03 19:31:02.860675 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:31:02.860635 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-gm6kr" event={"ID":"803e2c6b-385f-41dd-827a-ad8fdab62fa2","Type":"ContainerStarted","Data":"00c68fe3f136213a5b5a6338aacda2427078f9ba58b99d1acd4ec92a3283a721"} Jun 03 19:31:08.902717 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:31:08.902670 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-8b9ffc7d9-sfb4s" event={"ID":"000ee25d-2c22-4291-99b2-2f4399305d38","Type":"ContainerStarted","Data":"638585bb62d7b053535739e1d6f868e3b1ab1c041cbf91eadbb0acdbcc31392d"} Jun 03 19:31:08.904728 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:31:08.904699 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-gm6kr" event={"ID":"803e2c6b-385f-41dd-827a-ad8fdab62fa2","Type":"ContainerStarted","Data":"b73ebaf8658fa93c961429d55ff18239880b599d69ecf84e646effbe706d79b0"} Jun 03 19:31:08.904884 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:31:08.904843 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-gm6kr" Jun 03 19:31:08.939526 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:31:08.939468 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-8b9ffc7d9-sfb4s" podStartSLOduration=2.130839892 podStartE2EDuration="9.939433125s" totalImagesPullingTime="7.808593233s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:30:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:31:08.93935557 +0000 UTC m=+615.785014987" watchObservedRunningTime="2026-06-03 19:31:08.939433125 +0000 UTC m=+615.785092537" Jun 03 19:31:08.982185 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:31:08.982121 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-gm6kr" podStartSLOduration=1.27291168 podStartE2EDuration="6.982096821s" totalImagesPullingTime="5.709185141s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:31:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:31:08.980986241 +0000 UTC m=+615.826645655" watchObservedRunningTime="2026-06-03 19:31:08.982096821 +0000 UTC m=+615.827756237" Jun 03 19:31:14.467054 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:31:14.466965 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-mnw87"] Jun 03 19:31:14.470112 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:31:14.470091 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mnw87" Jun 03 19:31:14.472518 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:31:14.472490 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 03 19:31:14.472785 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:31:14.472757 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 03 19:31:14.472785 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:31:14.472767 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 03 19:31:14.472958 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:31:14.472784 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 03 19:31:14.472958 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:31:14.472824 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-cvgpx\"" Jun 03 19:31:14.483147 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:31:14.483119 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-mnw87"] Jun 03 19:31:14.507101 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:31:14.507064 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0430d7f8-5504-46dd-9d47-c5727b00bf37-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-mnw87\" (UID: \"0430d7f8-5504-46dd-9d47-c5727b00bf37\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mnw87" Jun 03 19:31:14.507480 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:31:14.507185 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0430d7f8-5504-46dd-9d47-c5727b00bf37-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-mnw87\" (UID: \"0430d7f8-5504-46dd-9d47-c5727b00bf37\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mnw87" Jun 03 19:31:14.507480 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:31:14.507346 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0430d7f8-5504-46dd-9d47-c5727b00bf37-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-mnw87\" (UID: \"0430d7f8-5504-46dd-9d47-c5727b00bf37\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mnw87" Jun 03 19:31:14.507611 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:31:14.507490 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0430d7f8-5504-46dd-9d47-c5727b00bf37-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-mnw87\" (UID: \"0430d7f8-5504-46dd-9d47-c5727b00bf37\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mnw87" Jun 03 19:31:14.507611 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:31:14.507532 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0430d7f8-5504-46dd-9d47-c5727b00bf37-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-mnw87\" (UID: \"0430d7f8-5504-46dd-9d47-c5727b00bf37\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mnw87" Jun 03 19:31:14.507611 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:31:14.507555 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sktkc\" (UniqueName: \"kubernetes.io/projected/0430d7f8-5504-46dd-9d47-c5727b00bf37-kube-api-access-sktkc\") pod \"istiod-openshift-gateway-75c67f8887-mnw87\" (UID: \"0430d7f8-5504-46dd-9d47-c5727b00bf37\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mnw87" Jun 03 19:31:14.507611 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:31:14.507581 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0430d7f8-5504-46dd-9d47-c5727b00bf37-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-mnw87\" (UID: \"0430d7f8-5504-46dd-9d47-c5727b00bf37\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mnw87" Jun 03 19:31:14.608742 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:31:14.608678 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0430d7f8-5504-46dd-9d47-c5727b00bf37-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-mnw87\" (UID: \"0430d7f8-5504-46dd-9d47-c5727b00bf37\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mnw87" Jun 03 19:31:14.608742 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:31:14.608740 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0430d7f8-5504-46dd-9d47-c5727b00bf37-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-mnw87\" (UID: \"0430d7f8-5504-46dd-9d47-c5727b00bf37\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mnw87" Jun 03 19:31:14.608742 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:31:14.608762 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sktkc\" (UniqueName: \"kubernetes.io/projected/0430d7f8-5504-46dd-9d47-c5727b00bf37-kube-api-access-sktkc\") pod \"istiod-openshift-gateway-75c67f8887-mnw87\" (UID: \"0430d7f8-5504-46dd-9d47-c5727b00bf37\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mnw87" Jun 03 19:31:14.609076 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:31:14.608781 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0430d7f8-5504-46dd-9d47-c5727b00bf37-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-mnw87\" (UID: \"0430d7f8-5504-46dd-9d47-c5727b00bf37\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mnw87" Jun 03 19:31:14.609076 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:31:14.608804 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0430d7f8-5504-46dd-9d47-c5727b00bf37-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-mnw87\" (UID: \"0430d7f8-5504-46dd-9d47-c5727b00bf37\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mnw87" Jun 03 19:31:14.609076 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:31:14.608830 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0430d7f8-5504-46dd-9d47-c5727b00bf37-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-mnw87\" (UID: \"0430d7f8-5504-46dd-9d47-c5727b00bf37\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mnw87" Jun 03 19:31:14.609076 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:31:14.608873 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0430d7f8-5504-46dd-9d47-c5727b00bf37-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-mnw87\" (UID: \"0430d7f8-5504-46dd-9d47-c5727b00bf37\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mnw87" Jun 03 19:31:14.609737 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:31:14.609642 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0430d7f8-5504-46dd-9d47-c5727b00bf37-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-mnw87\" (UID: \"0430d7f8-5504-46dd-9d47-c5727b00bf37\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mnw87" Jun 03 19:31:14.611478 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:31:14.611454 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0430d7f8-5504-46dd-9d47-c5727b00bf37-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-mnw87\" (UID: \"0430d7f8-5504-46dd-9d47-c5727b00bf37\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mnw87" Jun 03 19:31:14.611581 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:31:14.611479 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0430d7f8-5504-46dd-9d47-c5727b00bf37-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-mnw87\" (UID: \"0430d7f8-5504-46dd-9d47-c5727b00bf37\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mnw87" Jun 03 19:31:14.611581 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:31:14.611496 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0430d7f8-5504-46dd-9d47-c5727b00bf37-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-mnw87\" (UID: \"0430d7f8-5504-46dd-9d47-c5727b00bf37\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mnw87" Jun 03 19:31:14.611663 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:31:14.611643 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0430d7f8-5504-46dd-9d47-c5727b00bf37-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-mnw87\" (UID: \"0430d7f8-5504-46dd-9d47-c5727b00bf37\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mnw87" Jun 03 19:31:14.618745 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:31:14.618716 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0430d7f8-5504-46dd-9d47-c5727b00bf37-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-mnw87\" (UID: \"0430d7f8-5504-46dd-9d47-c5727b00bf37\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mnw87" Jun 03 19:31:14.618962 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:31:14.618940 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sktkc\" (UniqueName: \"kubernetes.io/projected/0430d7f8-5504-46dd-9d47-c5727b00bf37-kube-api-access-sktkc\") pod \"istiod-openshift-gateway-75c67f8887-mnw87\" (UID: \"0430d7f8-5504-46dd-9d47-c5727b00bf37\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mnw87" Jun 03 19:31:14.780589 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:31:14.780497 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mnw87" Jun 03 19:31:14.926375 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:31:14.926348 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-mnw87"] Jun 03 19:31:14.929023 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:31:14.928990 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0430d7f8_5504_46dd_9d47_c5727b00bf37.slice/crio-e16b0a7e1c4cc7f6b9b4a2e1fff1df82a7d422ba939cf0d4320dead0371ac2e0 WatchSource:0}: Error finding container e16b0a7e1c4cc7f6b9b4a2e1fff1df82a7d422ba939cf0d4320dead0371ac2e0: Status 404 returned error can't find the container with id e16b0a7e1c4cc7f6b9b4a2e1fff1df82a7d422ba939cf0d4320dead0371ac2e0 Jun 03 19:31:15.938478 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:31:15.938436 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mnw87" event={"ID":"0430d7f8-5504-46dd-9d47-c5727b00bf37","Type":"ContainerStarted","Data":"e16b0a7e1c4cc7f6b9b4a2e1fff1df82a7d422ba939cf0d4320dead0371ac2e0"} Jun 03 19:31:18.093843 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:31:18.093797 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jun 03 19:31:18.094146 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:31:18.093869 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jun 03 19:31:18.957407 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:31:18.957367 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mnw87" event={"ID":"0430d7f8-5504-46dd-9d47-c5727b00bf37","Type":"ContainerStarted","Data":"8652b85e373983fac36e748907810c1c83d51b160e50e4ac719a1cb8f6e7d5e8"} Jun 03 19:31:18.957592 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:31:18.957490 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mnw87" Jun 03 19:31:18.980382 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:31:18.980330 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mnw87" podStartSLOduration=1.8177382020000001 podStartE2EDuration="4.980283329s" totalImagesPullingTime="3.162545127s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:31:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:31:18.978675837 +0000 UTC m=+625.824335252" watchObservedRunningTime="2026-06-03 19:31:18.980283329 +0000 UTC m=+625.825942744" Jun 03 19:31:19.912408 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:31:19.912372 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-gm6kr" Jun 03 19:31:19.963524 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:31:19.963491 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-mnw87" Jun 03 19:31:24.823172 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:31:24.823136 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-pn9sz" Jun 03 19:31:24.826171 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:31:24.826146 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-4j2r9" Jun 03 19:32:25.783231 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:32:25.783188 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-796fd6659-kqt9f"] Jun 03 19:32:25.786230 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:32:25.786208 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-796fd6659-kqt9f" Jun 03 19:32:25.803048 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:32:25.803015 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-796fd6659-kqt9f"] Jun 03 19:32:25.957191 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:32:25.957130 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6d927a0d-a339-4edc-9980-637cefcfddd7-service-ca\") pod \"console-796fd6659-kqt9f\" (UID: \"6d927a0d-a339-4edc-9980-637cefcfddd7\") " pod="openshift-console/console-796fd6659-kqt9f" Jun 03 19:32:25.957419 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:32:25.957241 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6d927a0d-a339-4edc-9980-637cefcfddd7-oauth-serving-cert\") pod \"console-796fd6659-kqt9f\" (UID: \"6d927a0d-a339-4edc-9980-637cefcfddd7\") " pod="openshift-console/console-796fd6659-kqt9f" Jun 03 19:32:25.957419 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:32:25.957269 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctttj\" (UniqueName: \"kubernetes.io/projected/6d927a0d-a339-4edc-9980-637cefcfddd7-kube-api-access-ctttj\") pod \"console-796fd6659-kqt9f\" (UID: \"6d927a0d-a339-4edc-9980-637cefcfddd7\") " pod="openshift-console/console-796fd6659-kqt9f" Jun 03 19:32:25.957419 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:32:25.957322 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6d927a0d-a339-4edc-9980-637cefcfddd7-console-oauth-config\") pod \"console-796fd6659-kqt9f\" (UID: \"6d927a0d-a339-4edc-9980-637cefcfddd7\") " pod="openshift-console/console-796fd6659-kqt9f" Jun 03 19:32:25.957419 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:32:25.957407 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d927a0d-a339-4edc-9980-637cefcfddd7-trusted-ca-bundle\") pod \"console-796fd6659-kqt9f\" (UID: \"6d927a0d-a339-4edc-9980-637cefcfddd7\") " pod="openshift-console/console-796fd6659-kqt9f" Jun 03 19:32:25.957558 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:32:25.957431 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6d927a0d-a339-4edc-9980-637cefcfddd7-console-config\") pod \"console-796fd6659-kqt9f\" (UID: \"6d927a0d-a339-4edc-9980-637cefcfddd7\") " pod="openshift-console/console-796fd6659-kqt9f" Jun 03 19:32:25.957558 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:32:25.957450 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6d927a0d-a339-4edc-9980-637cefcfddd7-console-serving-cert\") pod \"console-796fd6659-kqt9f\" (UID: \"6d927a0d-a339-4edc-9980-637cefcfddd7\") " pod="openshift-console/console-796fd6659-kqt9f" Jun 03 19:32:26.058213 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:32:26.058118 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d927a0d-a339-4edc-9980-637cefcfddd7-trusted-ca-bundle\") pod \"console-796fd6659-kqt9f\" (UID: \"6d927a0d-a339-4edc-9980-637cefcfddd7\") " pod="openshift-console/console-796fd6659-kqt9f" Jun 03 19:32:26.058213 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:32:26.058158 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6d927a0d-a339-4edc-9980-637cefcfddd7-console-config\") pod \"console-796fd6659-kqt9f\" (UID: \"6d927a0d-a339-4edc-9980-637cefcfddd7\") " pod="openshift-console/console-796fd6659-kqt9f" Jun 03 19:32:26.058213 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:32:26.058177 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6d927a0d-a339-4edc-9980-637cefcfddd7-console-serving-cert\") pod \"console-796fd6659-kqt9f\" (UID: \"6d927a0d-a339-4edc-9980-637cefcfddd7\") " pod="openshift-console/console-796fd6659-kqt9f" Jun 03 19:32:26.058507 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:32:26.058216 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6d927a0d-a339-4edc-9980-637cefcfddd7-service-ca\") pod \"console-796fd6659-kqt9f\" (UID: \"6d927a0d-a339-4edc-9980-637cefcfddd7\") " pod="openshift-console/console-796fd6659-kqt9f" Jun 03 19:32:26.058507 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:32:26.058246 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6d927a0d-a339-4edc-9980-637cefcfddd7-oauth-serving-cert\") pod \"console-796fd6659-kqt9f\" (UID: \"6d927a0d-a339-4edc-9980-637cefcfddd7\") " pod="openshift-console/console-796fd6659-kqt9f" Jun 03 19:32:26.058507 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:32:26.058269 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctttj\" (UniqueName: \"kubernetes.io/projected/6d927a0d-a339-4edc-9980-637cefcfddd7-kube-api-access-ctttj\") pod \"console-796fd6659-kqt9f\" (UID: \"6d927a0d-a339-4edc-9980-637cefcfddd7\") " pod="openshift-console/console-796fd6659-kqt9f" Jun 03 19:32:26.058507 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:32:26.058309 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6d927a0d-a339-4edc-9980-637cefcfddd7-console-oauth-config\") pod \"console-796fd6659-kqt9f\" (UID: \"6d927a0d-a339-4edc-9980-637cefcfddd7\") " pod="openshift-console/console-796fd6659-kqt9f" Jun 03 19:32:26.058997 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:32:26.058963 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6d927a0d-a339-4edc-9980-637cefcfddd7-console-config\") pod \"console-796fd6659-kqt9f\" (UID: \"6d927a0d-a339-4edc-9980-637cefcfddd7\") " pod="openshift-console/console-796fd6659-kqt9f" Jun 03 19:32:26.059274 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:32:26.059007 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6d927a0d-a339-4edc-9980-637cefcfddd7-service-ca\") pod \"console-796fd6659-kqt9f\" (UID: \"6d927a0d-a339-4edc-9980-637cefcfddd7\") " pod="openshift-console/console-796fd6659-kqt9f" Jun 03 19:32:26.059274 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:32:26.059093 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6d927a0d-a339-4edc-9980-637cefcfddd7-oauth-serving-cert\") pod \"console-796fd6659-kqt9f\" (UID: \"6d927a0d-a339-4edc-9980-637cefcfddd7\") " pod="openshift-console/console-796fd6659-kqt9f" Jun 03 19:32:26.059274 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:32:26.059149 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d927a0d-a339-4edc-9980-637cefcfddd7-trusted-ca-bundle\") pod \"console-796fd6659-kqt9f\" (UID: \"6d927a0d-a339-4edc-9980-637cefcfddd7\") " pod="openshift-console/console-796fd6659-kqt9f" Jun 03 19:32:26.060988 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:32:26.060962 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6d927a0d-a339-4edc-9980-637cefcfddd7-console-serving-cert\") pod \"console-796fd6659-kqt9f\" (UID: \"6d927a0d-a339-4edc-9980-637cefcfddd7\") " pod="openshift-console/console-796fd6659-kqt9f" Jun 03 19:32:26.061085 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:32:26.061051 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6d927a0d-a339-4edc-9980-637cefcfddd7-console-oauth-config\") pod \"console-796fd6659-kqt9f\" (UID: \"6d927a0d-a339-4edc-9980-637cefcfddd7\") " pod="openshift-console/console-796fd6659-kqt9f" Jun 03 19:32:26.066809 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:32:26.066782 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctttj\" (UniqueName: \"kubernetes.io/projected/6d927a0d-a339-4edc-9980-637cefcfddd7-kube-api-access-ctttj\") pod \"console-796fd6659-kqt9f\" (UID: \"6d927a0d-a339-4edc-9980-637cefcfddd7\") " pod="openshift-console/console-796fd6659-kqt9f" Jun 03 19:32:26.098768 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:32:26.098726 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-796fd6659-kqt9f" Jun 03 19:32:26.243441 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:32:26.243412 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-796fd6659-kqt9f"] Jun 03 19:32:26.246007 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:32:26.245975 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d927a0d_a339_4edc_9980_637cefcfddd7.slice/crio-c40e77c2fc0f20cc4124bd687c5dd75d198adb978b96e8af7415feb78b2bead8 WatchSource:0}: Error finding container c40e77c2fc0f20cc4124bd687c5dd75d198adb978b96e8af7415feb78b2bead8: Status 404 returned error can't find the container with id c40e77c2fc0f20cc4124bd687c5dd75d198adb978b96e8af7415feb78b2bead8 Jun 03 19:32:26.270595 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:32:26.270563 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-796fd6659-kqt9f" event={"ID":"6d927a0d-a339-4edc-9980-637cefcfddd7","Type":"ContainerStarted","Data":"c40e77c2fc0f20cc4124bd687c5dd75d198adb978b96e8af7415feb78b2bead8"} Jun 03 19:32:27.276875 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:32:27.276834 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-796fd6659-kqt9f" event={"ID":"6d927a0d-a339-4edc-9980-637cefcfddd7","Type":"ContainerStarted","Data":"5659b7382b1d1bd8cb20ddb3990f8e697122f45234cfe82f5ea57855a3b6d818"} Jun 03 19:32:27.298747 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:32:27.298678 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-796fd6659-kqt9f" podStartSLOduration=2.298654278 podStartE2EDuration="2.298654278s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:32:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:32:27.295568993 +0000 UTC m=+694.141228411" watchObservedRunningTime="2026-06-03 19:32:27.298654278 +0000 UTC m=+694.144313694" Jun 03 19:32:36.099340 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:32:36.099280 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-796fd6659-kqt9f" Jun 03 19:32:36.099771 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:32:36.099369 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-796fd6659-kqt9f" Jun 03 19:32:36.104407 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:32:36.104377 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-796fd6659-kqt9f" Jun 03 19:32:36.319680 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:32:36.319648 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-796fd6659-kqt9f" Jun 03 19:32:36.384550 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:32:36.384457 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-58c5b5c6c9-ctf9m"] Jun 03 19:33:00.458422 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:00.458389 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bxhbd"] Jun 03 19:33:00.461863 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:00.461842 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bxhbd" Jun 03 19:33:00.464981 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:00.464951 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-gxl6s\"" Jun 03 19:33:00.480175 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:00.480074 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bxhbd"] Jun 03 19:33:00.580945 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:00.580910 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa857b5b-adc4-44d0-9adf-20c16b9bff56-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-bxhbd\" (UID: \"aa857b5b-adc4-44d0-9adf-20c16b9bff56\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bxhbd" Jun 03 19:33:00.581144 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:00.580962 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gb2nq\" (UniqueName: \"kubernetes.io/projected/aa857b5b-adc4-44d0-9adf-20c16b9bff56-kube-api-access-gb2nq\") pod \"maas-default-gateway-openshift-default-687ff6996-bxhbd\" (UID: \"aa857b5b-adc4-44d0-9adf-20c16b9bff56\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bxhbd" Jun 03 19:33:00.581144 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:00.580995 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa857b5b-adc4-44d0-9adf-20c16b9bff56-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-bxhbd\" (UID: \"aa857b5b-adc4-44d0-9adf-20c16b9bff56\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bxhbd" Jun 03 19:33:00.581144 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:00.581025 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa857b5b-adc4-44d0-9adf-20c16b9bff56-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-bxhbd\" (UID: \"aa857b5b-adc4-44d0-9adf-20c16b9bff56\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bxhbd" Jun 03 19:33:00.581144 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:00.581064 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa857b5b-adc4-44d0-9adf-20c16b9bff56-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-bxhbd\" (UID: \"aa857b5b-adc4-44d0-9adf-20c16b9bff56\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bxhbd" Jun 03 19:33:00.581379 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:00.581139 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa857b5b-adc4-44d0-9adf-20c16b9bff56-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-bxhbd\" (UID: \"aa857b5b-adc4-44d0-9adf-20c16b9bff56\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bxhbd" Jun 03 19:33:00.581379 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:00.581192 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa857b5b-adc4-44d0-9adf-20c16b9bff56-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-bxhbd\" (UID: \"aa857b5b-adc4-44d0-9adf-20c16b9bff56\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bxhbd" Jun 03 19:33:00.581379 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:00.581222 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa857b5b-adc4-44d0-9adf-20c16b9bff56-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-bxhbd\" (UID: \"aa857b5b-adc4-44d0-9adf-20c16b9bff56\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bxhbd" Jun 03 19:33:00.581379 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:00.581261 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa857b5b-adc4-44d0-9adf-20c16b9bff56-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-bxhbd\" (UID: \"aa857b5b-adc4-44d0-9adf-20c16b9bff56\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bxhbd" Jun 03 19:33:00.681864 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:00.681812 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa857b5b-adc4-44d0-9adf-20c16b9bff56-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-bxhbd\" (UID: \"aa857b5b-adc4-44d0-9adf-20c16b9bff56\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bxhbd" Jun 03 19:33:00.682053 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:00.681892 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gb2nq\" (UniqueName: \"kubernetes.io/projected/aa857b5b-adc4-44d0-9adf-20c16b9bff56-kube-api-access-gb2nq\") pod \"maas-default-gateway-openshift-default-687ff6996-bxhbd\" (UID: \"aa857b5b-adc4-44d0-9adf-20c16b9bff56\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bxhbd" Jun 03 19:33:00.682053 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:00.681934 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa857b5b-adc4-44d0-9adf-20c16b9bff56-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-bxhbd\" (UID: \"aa857b5b-adc4-44d0-9adf-20c16b9bff56\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bxhbd" Jun 03 19:33:00.682053 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:00.681962 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa857b5b-adc4-44d0-9adf-20c16b9bff56-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-bxhbd\" (UID: \"aa857b5b-adc4-44d0-9adf-20c16b9bff56\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bxhbd" Jun 03 19:33:00.682053 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:00.682006 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa857b5b-adc4-44d0-9adf-20c16b9bff56-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-bxhbd\" (UID: \"aa857b5b-adc4-44d0-9adf-20c16b9bff56\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bxhbd" Jun 03 19:33:00.682465 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:00.682053 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa857b5b-adc4-44d0-9adf-20c16b9bff56-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-bxhbd\" (UID: \"aa857b5b-adc4-44d0-9adf-20c16b9bff56\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bxhbd" Jun 03 19:33:00.682599 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:00.682258 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa857b5b-adc4-44d0-9adf-20c16b9bff56-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-bxhbd\" (UID: \"aa857b5b-adc4-44d0-9adf-20c16b9bff56\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bxhbd" Jun 03 19:33:00.682599 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:00.682430 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa857b5b-adc4-44d0-9adf-20c16b9bff56-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-bxhbd\" (UID: \"aa857b5b-adc4-44d0-9adf-20c16b9bff56\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bxhbd" Jun 03 19:33:00.682719 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:00.682590 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa857b5b-adc4-44d0-9adf-20c16b9bff56-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-bxhbd\" (UID: \"aa857b5b-adc4-44d0-9adf-20c16b9bff56\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bxhbd" Jun 03 19:33:00.682719 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:00.682649 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa857b5b-adc4-44d0-9adf-20c16b9bff56-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-bxhbd\" (UID: \"aa857b5b-adc4-44d0-9adf-20c16b9bff56\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bxhbd" Jun 03 19:33:00.682719 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:00.682707 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa857b5b-adc4-44d0-9adf-20c16b9bff56-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-bxhbd\" (UID: \"aa857b5b-adc4-44d0-9adf-20c16b9bff56\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bxhbd" Jun 03 19:33:00.682921 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:00.682899 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa857b5b-adc4-44d0-9adf-20c16b9bff56-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-bxhbd\" (UID: \"aa857b5b-adc4-44d0-9adf-20c16b9bff56\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bxhbd" Jun 03 19:33:00.682989 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:00.682900 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa857b5b-adc4-44d0-9adf-20c16b9bff56-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-bxhbd\" (UID: \"aa857b5b-adc4-44d0-9adf-20c16b9bff56\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bxhbd" Jun 03 19:33:00.683132 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:00.683110 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa857b5b-adc4-44d0-9adf-20c16b9bff56-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-bxhbd\" (UID: \"aa857b5b-adc4-44d0-9adf-20c16b9bff56\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bxhbd" Jun 03 19:33:00.685844 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:00.685803 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa857b5b-adc4-44d0-9adf-20c16b9bff56-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-bxhbd\" (UID: \"aa857b5b-adc4-44d0-9adf-20c16b9bff56\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bxhbd" Jun 03 19:33:00.685977 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:00.685901 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa857b5b-adc4-44d0-9adf-20c16b9bff56-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-bxhbd\" (UID: \"aa857b5b-adc4-44d0-9adf-20c16b9bff56\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bxhbd" Jun 03 19:33:00.690925 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:00.690890 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa857b5b-adc4-44d0-9adf-20c16b9bff56-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-bxhbd\" (UID: \"aa857b5b-adc4-44d0-9adf-20c16b9bff56\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bxhbd" Jun 03 19:33:00.691211 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:00.691188 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gb2nq\" (UniqueName: \"kubernetes.io/projected/aa857b5b-adc4-44d0-9adf-20c16b9bff56-kube-api-access-gb2nq\") pod \"maas-default-gateway-openshift-default-687ff6996-bxhbd\" (UID: \"aa857b5b-adc4-44d0-9adf-20c16b9bff56\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bxhbd" Jun 03 19:33:00.775537 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:00.775429 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bxhbd" Jun 03 19:33:00.940108 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:00.940077 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bxhbd"] Jun 03 19:33:00.942519 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:33:00.942487 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa857b5b_adc4_44d0_9adf_20c16b9bff56.slice/crio-34aed145b60505b11890bdb4bfd5f724ae6c65c5d4819b9ab27f5b6631c8ee68 WatchSource:0}: Error finding container 34aed145b60505b11890bdb4bfd5f724ae6c65c5d4819b9ab27f5b6631c8ee68: Status 404 returned error can't find the container with id 34aed145b60505b11890bdb4bfd5f724ae6c65c5d4819b9ab27f5b6631c8ee68 Jun 03 19:33:01.414544 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:01.414478 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-58c5b5c6c9-ctf9m" podUID="71ba41c9-019b-4488-ab88-a213a4616d44" containerName="console" containerID="cri-o://c32a2d3ad87cacc453c104843be68422031f297e7211c2f38f36da4037adbf9b" gracePeriod=15 Jun 03 19:33:01.436472 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:01.436431 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bxhbd" event={"ID":"aa857b5b-adc4-44d0-9adf-20c16b9bff56","Type":"ContainerStarted","Data":"34aed145b60505b11890bdb4bfd5f724ae6c65c5d4819b9ab27f5b6631c8ee68"} Jun 03 19:33:01.659668 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:01.659634 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58c5b5c6c9-ctf9m" Jun 03 19:33:01.792771 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:01.792729 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71ba41c9-019b-4488-ab88-a213a4616d44-trusted-ca-bundle\") pod \"71ba41c9-019b-4488-ab88-a213a4616d44\" (UID: \"71ba41c9-019b-4488-ab88-a213a4616d44\") " Jun 03 19:33:01.793038 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:01.792802 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/71ba41c9-019b-4488-ab88-a213a4616d44-console-oauth-config\") pod \"71ba41c9-019b-4488-ab88-a213a4616d44\" (UID: \"71ba41c9-019b-4488-ab88-a213a4616d44\") " Jun 03 19:33:01.793038 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:01.792863 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vhp9b\" (UniqueName: \"kubernetes.io/projected/71ba41c9-019b-4488-ab88-a213a4616d44-kube-api-access-vhp9b\") pod \"71ba41c9-019b-4488-ab88-a213a4616d44\" (UID: \"71ba41c9-019b-4488-ab88-a213a4616d44\") " Jun 03 19:33:01.793038 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:01.792973 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/71ba41c9-019b-4488-ab88-a213a4616d44-console-config\") pod \"71ba41c9-019b-4488-ab88-a213a4616d44\" (UID: \"71ba41c9-019b-4488-ab88-a213a4616d44\") " Jun 03 19:33:01.793038 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:01.793010 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/71ba41c9-019b-4488-ab88-a213a4616d44-service-ca\") pod \"71ba41c9-019b-4488-ab88-a213a4616d44\" (UID: \"71ba41c9-019b-4488-ab88-a213a4616d44\") " Jun 03 19:33:01.794279 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:01.793073 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/71ba41c9-019b-4488-ab88-a213a4616d44-oauth-serving-cert\") pod \"71ba41c9-019b-4488-ab88-a213a4616d44\" (UID: \"71ba41c9-019b-4488-ab88-a213a4616d44\") " Jun 03 19:33:01.794279 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:01.793128 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/71ba41c9-019b-4488-ab88-a213a4616d44-console-serving-cert\") pod \"71ba41c9-019b-4488-ab88-a213a4616d44\" (UID: \"71ba41c9-019b-4488-ab88-a213a4616d44\") " Jun 03 19:33:01.794279 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:01.793394 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71ba41c9-019b-4488-ab88-a213a4616d44-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "71ba41c9-019b-4488-ab88-a213a4616d44" (UID: "71ba41c9-019b-4488-ab88-a213a4616d44"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 19:33:01.794279 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:01.793530 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71ba41c9-019b-4488-ab88-a213a4616d44-trusted-ca-bundle\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\"" Jun 03 19:33:01.794279 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:01.793539 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71ba41c9-019b-4488-ab88-a213a4616d44-console-config" (OuterVolumeSpecName: "console-config") pod "71ba41c9-019b-4488-ab88-a213a4616d44" (UID: "71ba41c9-019b-4488-ab88-a213a4616d44"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 19:33:01.794279 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:01.793595 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71ba41c9-019b-4488-ab88-a213a4616d44-service-ca" (OuterVolumeSpecName: "service-ca") pod "71ba41c9-019b-4488-ab88-a213a4616d44" (UID: "71ba41c9-019b-4488-ab88-a213a4616d44"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 19:33:01.794279 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:01.793672 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71ba41c9-019b-4488-ab88-a213a4616d44-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "71ba41c9-019b-4488-ab88-a213a4616d44" (UID: "71ba41c9-019b-4488-ab88-a213a4616d44"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 19:33:01.795446 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:01.795419 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71ba41c9-019b-4488-ab88-a213a4616d44-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "71ba41c9-019b-4488-ab88-a213a4616d44" (UID: "71ba41c9-019b-4488-ab88-a213a4616d44"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 19:33:01.795531 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:01.795461 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71ba41c9-019b-4488-ab88-a213a4616d44-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "71ba41c9-019b-4488-ab88-a213a4616d44" (UID: "71ba41c9-019b-4488-ab88-a213a4616d44"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 19:33:01.795531 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:01.795522 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71ba41c9-019b-4488-ab88-a213a4616d44-kube-api-access-vhp9b" (OuterVolumeSpecName: "kube-api-access-vhp9b") pod "71ba41c9-019b-4488-ab88-a213a4616d44" (UID: "71ba41c9-019b-4488-ab88-a213a4616d44"). InnerVolumeSpecName "kube-api-access-vhp9b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:33:01.894064 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:01.894023 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/71ba41c9-019b-4488-ab88-a213a4616d44-console-oauth-config\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\"" Jun 03 19:33:01.894064 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:01.894057 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vhp9b\" (UniqueName: \"kubernetes.io/projected/71ba41c9-019b-4488-ab88-a213a4616d44-kube-api-access-vhp9b\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\"" Jun 03 19:33:01.894064 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:01.894070 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/71ba41c9-019b-4488-ab88-a213a4616d44-console-config\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\"" Jun 03 19:33:01.894348 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:01.894081 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/71ba41c9-019b-4488-ab88-a213a4616d44-service-ca\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\"" Jun 03 19:33:01.894348 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:01.894088 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/71ba41c9-019b-4488-ab88-a213a4616d44-oauth-serving-cert\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\"" Jun 03 19:33:01.894348 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:01.894097 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/71ba41c9-019b-4488-ab88-a213a4616d44-console-serving-cert\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\"" Jun 03 19:33:02.442539 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:02.442502 2579 generic.go:356] "Generic (PLEG): container finished" podID="71ba41c9-019b-4488-ab88-a213a4616d44" containerID="c32a2d3ad87cacc453c104843be68422031f297e7211c2f38f36da4037adbf9b" exitCode=0 Jun 03 19:33:02.442726 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:02.442566 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58c5b5c6c9-ctf9m" Jun 03 19:33:02.442726 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:02.442593 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58c5b5c6c9-ctf9m" event={"ID":"71ba41c9-019b-4488-ab88-a213a4616d44","Type":"ContainerDied","Data":"c32a2d3ad87cacc453c104843be68422031f297e7211c2f38f36da4037adbf9b"} Jun 03 19:33:02.442726 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:02.442673 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58c5b5c6c9-ctf9m" event={"ID":"71ba41c9-019b-4488-ab88-a213a4616d44","Type":"ContainerDied","Data":"1c1cd0ce9ec82872868821aa4b32db1fe6d8c8e6ebd529313b61ee1954e5e266"} Jun 03 19:33:02.442726 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:02.442695 2579 scope.go:117] "RemoveContainer" containerID="c32a2d3ad87cacc453c104843be68422031f297e7211c2f38f36da4037adbf9b" Jun 03 19:33:02.452503 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:02.452477 2579 scope.go:117] "RemoveContainer" containerID="c32a2d3ad87cacc453c104843be68422031f297e7211c2f38f36da4037adbf9b" Jun 03 19:33:02.452793 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:33:02.452775 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c32a2d3ad87cacc453c104843be68422031f297e7211c2f38f36da4037adbf9b\": container with ID starting with c32a2d3ad87cacc453c104843be68422031f297e7211c2f38f36da4037adbf9b not found: ID does not exist" containerID="c32a2d3ad87cacc453c104843be68422031f297e7211c2f38f36da4037adbf9b" Jun 03 19:33:02.452840 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:02.452801 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c32a2d3ad87cacc453c104843be68422031f297e7211c2f38f36da4037adbf9b"} err="failed to get container status \"c32a2d3ad87cacc453c104843be68422031f297e7211c2f38f36da4037adbf9b\": rpc error: code = NotFound desc = could not find container \"c32a2d3ad87cacc453c104843be68422031f297e7211c2f38f36da4037adbf9b\": container with ID starting with c32a2d3ad87cacc453c104843be68422031f297e7211c2f38f36da4037adbf9b not found: ID does not exist" Jun 03 19:33:02.465789 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:02.465752 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-58c5b5c6c9-ctf9m"] Jun 03 19:33:02.469560 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:02.469529 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-58c5b5c6c9-ctf9m"] Jun 03 19:33:03.609753 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:03.609720 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71ba41c9-019b-4488-ab88-a213a4616d44" path="/var/lib/kubelet/pods/71ba41c9-019b-4488-ab88-a213a4616d44/volumes" Jun 03 19:33:06.196122 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:06.196083 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jun 03 19:33:06.196440 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:06.196156 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jun 03 19:33:06.196440 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:06.196186 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jun 03 19:33:06.466214 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:06.466118 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bxhbd" event={"ID":"aa857b5b-adc4-44d0-9adf-20c16b9bff56","Type":"ContainerStarted","Data":"0ff07e35a4fa6296d722e8dea5c071b0163864001756cd8324a399d9458e07ee"} Jun 03 19:33:06.488270 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:06.488202 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bxhbd" podStartSLOduration=1.237025414 podStartE2EDuration="6.488178493s" totalImagesPullingTime="5.251153079s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:33:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:33:06.487031401 +0000 UTC m=+733.332691008" watchObservedRunningTime="2026-06-03 19:33:06.488178493 +0000 UTC m=+733.333837911" Jun 03 19:33:06.776498 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:06.776408 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bxhbd" Jun 03 19:33:06.938476 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:06.938435 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xvq4j"] Jun 03 19:33:06.938882 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:06.938864 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71ba41c9-019b-4488-ab88-a213a4616d44" containerName="console" Jun 03 19:33:06.938972 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:06.938884 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="71ba41c9-019b-4488-ab88-a213a4616d44" containerName="console" Jun 03 19:33:06.939027 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:06.938970 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="71ba41c9-019b-4488-ab88-a213a4616d44" containerName="console" Jun 03 19:33:06.942341 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:06.942316 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-xvq4j" Jun 03 19:33:06.945328 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:06.945280 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 03 19:33:06.945473 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:06.945339 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 03 19:33:06.946185 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:06.946160 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-dmfm7\"" Jun 03 19:33:06.946324 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:06.946157 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 03 19:33:06.951574 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:06.951553 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xvq4j"] Jun 03 19:33:07.037593 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:07.037498 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xvq4j"] Jun 03 19:33:07.047498 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:07.047448 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5rzr\" (UniqueName: \"kubernetes.io/projected/5f320f49-eee1-4bbb-922c-8e6d5dba9f95-kube-api-access-s5rzr\") pod \"limitador-limitador-64c94fd64f-xvq4j\" (UID: \"5f320f49-eee1-4bbb-922c-8e6d5dba9f95\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-xvq4j" Jun 03 19:33:07.047667 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:07.047504 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5f320f49-eee1-4bbb-922c-8e6d5dba9f95-config-file\") pod \"limitador-limitador-64c94fd64f-xvq4j\" (UID: \"5f320f49-eee1-4bbb-922c-8e6d5dba9f95\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-xvq4j" Jun 03 19:33:07.148076 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:07.148037 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5rzr\" (UniqueName: \"kubernetes.io/projected/5f320f49-eee1-4bbb-922c-8e6d5dba9f95-kube-api-access-s5rzr\") pod \"limitador-limitador-64c94fd64f-xvq4j\" (UID: \"5f320f49-eee1-4bbb-922c-8e6d5dba9f95\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-xvq4j" Jun 03 19:33:07.148076 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:07.148079 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5f320f49-eee1-4bbb-922c-8e6d5dba9f95-config-file\") pod \"limitador-limitador-64c94fd64f-xvq4j\" (UID: \"5f320f49-eee1-4bbb-922c-8e6d5dba9f95\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-xvq4j" Jun 03 19:33:07.148760 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:07.148738 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5f320f49-eee1-4bbb-922c-8e6d5dba9f95-config-file\") pod \"limitador-limitador-64c94fd64f-xvq4j\" (UID: \"5f320f49-eee1-4bbb-922c-8e6d5dba9f95\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-xvq4j" Jun 03 19:33:07.156766 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:07.156736 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5rzr\" (UniqueName: \"kubernetes.io/projected/5f320f49-eee1-4bbb-922c-8e6d5dba9f95-kube-api-access-s5rzr\") pod \"limitador-limitador-64c94fd64f-xvq4j\" (UID: \"5f320f49-eee1-4bbb-922c-8e6d5dba9f95\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-xvq4j" Jun 03 19:33:07.254282 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:07.254246 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-xvq4j" Jun 03 19:33:07.397390 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:07.397359 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xvq4j"] Jun 03 19:33:07.399023 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:33:07.398982 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f320f49_eee1_4bbb_922c_8e6d5dba9f95.slice/crio-991316b8e1208291e3fd64fa8f56198901368b2d6eff5e0f3e6a8789b3a1e525 WatchSource:0}: Error finding container 991316b8e1208291e3fd64fa8f56198901368b2d6eff5e0f3e6a8789b3a1e525: Status 404 returned error can't find the container with id 991316b8e1208291e3fd64fa8f56198901368b2d6eff5e0f3e6a8789b3a1e525 Jun 03 19:33:07.473196 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:07.473154 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-xvq4j" event={"ID":"5f320f49-eee1-4bbb-922c-8e6d5dba9f95","Type":"ContainerStarted","Data":"991316b8e1208291e3fd64fa8f56198901368b2d6eff5e0f3e6a8789b3a1e525"} Jun 03 19:33:07.782189 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:07.782154 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bxhbd" Jun 03 19:33:08.481270 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:08.481229 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bxhbd" Jun 03 19:33:08.482382 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:08.482356 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bxhbd" Jun 03 19:33:10.494879 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:10.494777 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-xvq4j" event={"ID":"5f320f49-eee1-4bbb-922c-8e6d5dba9f95","Type":"ContainerStarted","Data":"3de732b9180377482b12f605209d26c864cbf8759c513ed028e2dafd465fbf1b"} Jun 03 19:33:10.495307 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:10.495068 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-xvq4j" Jun 03 19:33:10.512624 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:10.512550 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-xvq4j" podStartSLOduration=1.745578471 podStartE2EDuration="4.512526163s" totalImagesPullingTime="2.766947692s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:33:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:33:10.51219783 +0000 UTC m=+737.357857246" watchObservedRunningTime="2026-06-03 19:33:10.512526163 +0000 UTC m=+737.358185581" Jun 03 19:33:21.500725 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:21.500681 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-xvq4j" Jun 03 19:33:23.412814 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:23.412776 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xvq4j"] Jun 03 19:33:23.413345 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:23.412966 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-xvq4j" podUID="5f320f49-eee1-4bbb-922c-8e6d5dba9f95" containerName="limitador" containerID="cri-o://3de732b9180377482b12f605209d26c864cbf8759c513ed028e2dafd465fbf1b" gracePeriod=30 Jun 03 19:33:23.977935 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:23.977860 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-xvq4j" Jun 03 19:33:24.116229 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:24.116186 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s5rzr\" (UniqueName: \"kubernetes.io/projected/5f320f49-eee1-4bbb-922c-8e6d5dba9f95-kube-api-access-s5rzr\") pod \"5f320f49-eee1-4bbb-922c-8e6d5dba9f95\" (UID: \"5f320f49-eee1-4bbb-922c-8e6d5dba9f95\") " Jun 03 19:33:24.116462 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:24.116280 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5f320f49-eee1-4bbb-922c-8e6d5dba9f95-config-file\") pod \"5f320f49-eee1-4bbb-922c-8e6d5dba9f95\" (UID: \"5f320f49-eee1-4bbb-922c-8e6d5dba9f95\") " Jun 03 19:33:24.116706 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:24.116681 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f320f49-eee1-4bbb-922c-8e6d5dba9f95-config-file" (OuterVolumeSpecName: "config-file") pod "5f320f49-eee1-4bbb-922c-8e6d5dba9f95" (UID: "5f320f49-eee1-4bbb-922c-8e6d5dba9f95"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 19:33:24.118725 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:24.118702 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f320f49-eee1-4bbb-922c-8e6d5dba9f95-kube-api-access-s5rzr" (OuterVolumeSpecName: "kube-api-access-s5rzr") pod "5f320f49-eee1-4bbb-922c-8e6d5dba9f95" (UID: "5f320f49-eee1-4bbb-922c-8e6d5dba9f95"). InnerVolumeSpecName "kube-api-access-s5rzr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:33:24.217185 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:24.217151 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s5rzr\" (UniqueName: \"kubernetes.io/projected/5f320f49-eee1-4bbb-922c-8e6d5dba9f95-kube-api-access-s5rzr\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\"" Jun 03 19:33:24.217185 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:24.217182 2579 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5f320f49-eee1-4bbb-922c-8e6d5dba9f95-config-file\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\"" Jun 03 19:33:24.566206 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:24.566170 2579 generic.go:356] "Generic (PLEG): container finished" podID="5f320f49-eee1-4bbb-922c-8e6d5dba9f95" containerID="3de732b9180377482b12f605209d26c864cbf8759c513ed028e2dafd465fbf1b" exitCode=0 Jun 03 19:33:24.566688 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:24.566214 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-xvq4j" Jun 03 19:33:24.566688 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:24.566249 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-xvq4j" event={"ID":"5f320f49-eee1-4bbb-922c-8e6d5dba9f95","Type":"ContainerDied","Data":"3de732b9180377482b12f605209d26c864cbf8759c513ed028e2dafd465fbf1b"} Jun 03 19:33:24.566688 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:24.566330 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-xvq4j" event={"ID":"5f320f49-eee1-4bbb-922c-8e6d5dba9f95","Type":"ContainerDied","Data":"991316b8e1208291e3fd64fa8f56198901368b2d6eff5e0f3e6a8789b3a1e525"} Jun 03 19:33:24.566688 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:24.566356 2579 scope.go:117] "RemoveContainer" containerID="3de732b9180377482b12f605209d26c864cbf8759c513ed028e2dafd465fbf1b" Jun 03 19:33:24.575254 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:24.575224 2579 scope.go:117] "RemoveContainer" containerID="3de732b9180377482b12f605209d26c864cbf8759c513ed028e2dafd465fbf1b" Jun 03 19:33:24.575624 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:33:24.575604 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3de732b9180377482b12f605209d26c864cbf8759c513ed028e2dafd465fbf1b\": container with ID starting with 3de732b9180377482b12f605209d26c864cbf8759c513ed028e2dafd465fbf1b not found: ID does not exist" containerID="3de732b9180377482b12f605209d26c864cbf8759c513ed028e2dafd465fbf1b" Jun 03 19:33:24.575707 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:24.575632 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3de732b9180377482b12f605209d26c864cbf8759c513ed028e2dafd465fbf1b"} err="failed to get container status \"3de732b9180377482b12f605209d26c864cbf8759c513ed028e2dafd465fbf1b\": rpc error: code = NotFound desc = could not find container \"3de732b9180377482b12f605209d26c864cbf8759c513ed028e2dafd465fbf1b\": container with ID starting with 3de732b9180377482b12f605209d26c864cbf8759c513ed028e2dafd465fbf1b not found: ID does not exist" Jun 03 19:33:24.589224 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:24.588819 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xvq4j"] Jun 03 19:33:24.594767 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:24.594735 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xvq4j"] Jun 03 19:33:25.609699 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:25.609663 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f320f49-eee1-4bbb-922c-8e6d5dba9f95" path="/var/lib/kubelet/pods/5f320f49-eee1-4bbb-922c-8e6d5dba9f95/volumes" Jun 03 19:33:28.154090 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:28.154050 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-hh7mj"] Jun 03 19:33:28.154603 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:28.154424 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f320f49-eee1-4bbb-922c-8e6d5dba9f95" containerName="limitador" Jun 03 19:33:28.154603 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:28.154439 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f320f49-eee1-4bbb-922c-8e6d5dba9f95" containerName="limitador" Jun 03 19:33:28.154603 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:28.154536 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f320f49-eee1-4bbb-922c-8e6d5dba9f95" containerName="limitador" Jun 03 19:33:28.159275 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:28.159249 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-hh7mj" Jun 03 19:33:28.161859 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:28.161836 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 03 19:33:28.165557 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:28.165526 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-hh7mj"] Jun 03 19:33:28.257165 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:28.257126 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/7488f9c0-6108-4a14-a4bf-5046ce749148-data\") pod \"postgres-69fb4594cf-hh7mj\" (UID: \"7488f9c0-6108-4a14-a4bf-5046ce749148\") " pod="opendatahub/postgres-69fb4594cf-hh7mj" Jun 03 19:33:28.257381 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:28.257176 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkdv9\" (UniqueName: \"kubernetes.io/projected/7488f9c0-6108-4a14-a4bf-5046ce749148-kube-api-access-lkdv9\") pod \"postgres-69fb4594cf-hh7mj\" (UID: \"7488f9c0-6108-4a14-a4bf-5046ce749148\") " pod="opendatahub/postgres-69fb4594cf-hh7mj" Jun 03 19:33:28.358602 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:28.358551 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/7488f9c0-6108-4a14-a4bf-5046ce749148-data\") pod \"postgres-69fb4594cf-hh7mj\" (UID: \"7488f9c0-6108-4a14-a4bf-5046ce749148\") " pod="opendatahub/postgres-69fb4594cf-hh7mj" Jun 03 19:33:28.358796 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:28.358627 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkdv9\" (UniqueName: \"kubernetes.io/projected/7488f9c0-6108-4a14-a4bf-5046ce749148-kube-api-access-lkdv9\") pod \"postgres-69fb4594cf-hh7mj\" (UID: \"7488f9c0-6108-4a14-a4bf-5046ce749148\") " pod="opendatahub/postgres-69fb4594cf-hh7mj" Jun 03 19:33:28.358963 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:28.358941 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/7488f9c0-6108-4a14-a4bf-5046ce749148-data\") pod \"postgres-69fb4594cf-hh7mj\" (UID: \"7488f9c0-6108-4a14-a4bf-5046ce749148\") " pod="opendatahub/postgres-69fb4594cf-hh7mj" Jun 03 19:33:28.368081 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:28.368048 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkdv9\" (UniqueName: \"kubernetes.io/projected/7488f9c0-6108-4a14-a4bf-5046ce749148-kube-api-access-lkdv9\") pod \"postgres-69fb4594cf-hh7mj\" (UID: \"7488f9c0-6108-4a14-a4bf-5046ce749148\") " pod="opendatahub/postgres-69fb4594cf-hh7mj" Jun 03 19:33:28.472407 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:28.472277 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-hh7mj" Jun 03 19:33:28.614869 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:28.614780 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-hh7mj"] Jun 03 19:33:28.617815 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:33:28.617783 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7488f9c0_6108_4a14_a4bf_5046ce749148.slice/crio-3e6b324ec583c0e011f2d5ce235cc6858a2ca2f4bdf4f2afbc7e2774bd453c1a WatchSource:0}: Error finding container 3e6b324ec583c0e011f2d5ce235cc6858a2ca2f4bdf4f2afbc7e2774bd453c1a: Status 404 returned error can't find the container with id 3e6b324ec583c0e011f2d5ce235cc6858a2ca2f4bdf4f2afbc7e2774bd453c1a Jun 03 19:33:29.592599 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:29.592561 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-hh7mj" event={"ID":"7488f9c0-6108-4a14-a4bf-5046ce749148","Type":"ContainerStarted","Data":"3e6b324ec583c0e011f2d5ce235cc6858a2ca2f4bdf4f2afbc7e2774bd453c1a"} Jun 03 19:33:31.612230 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:31.612142 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-hh7mj" Jun 03 19:33:31.612230 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:31.612214 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-hh7mj" event={"ID":"7488f9c0-6108-4a14-a4bf-5046ce749148","Type":"ContainerStarted","Data":"f09292715801126dc89155579dade3065409ad76474a3068d284d79ed9fb4188"} Jun 03 19:33:31.624620 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:31.624563 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-hh7mj" podStartSLOduration=0.991340384 podStartE2EDuration="3.624545434s" totalImagesPullingTime="2.63320505s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:33:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:33:31.623681686 +0000 UTC m=+758.469341103" watchObservedRunningTime="2026-06-03 19:33:31.624545434 +0000 UTC m=+758.470204849" Jun 03 19:33:37.640607 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:33:37.640578 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-hh7mj" Jun 03 19:34:08.437937 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:34:08.437902 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 19:34:08.447489 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:34:08.447463 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 19:34:08.450617 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:34:08.450392 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 03 19:34:08.450617 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:34:08.450441 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-dl8dh\"" Jun 03 19:34:08.450617 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:34:08.450440 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 03 19:34:08.450617 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:34:08.450440 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 03 19:34:08.451602 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:34:08.451575 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 19:34:08.528160 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:34:08.528123 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnsnk\" (UniqueName: \"kubernetes.io/projected/51d62e61-4750-4073-9f11-058b1465cf57-kube-api-access-nnsnk\") pod \"maas-keycloak-0\" (UID: \"51d62e61-4750-4073-9f11-058b1465cf57\") " pod="keycloak-system/maas-keycloak-0" Jun 03 19:34:08.629591 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:34:08.629553 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnsnk\" (UniqueName: \"kubernetes.io/projected/51d62e61-4750-4073-9f11-058b1465cf57-kube-api-access-nnsnk\") pod \"maas-keycloak-0\" (UID: \"51d62e61-4750-4073-9f11-058b1465cf57\") " pod="keycloak-system/maas-keycloak-0" Jun 03 19:34:08.638731 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:34:08.638698 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnsnk\" (UniqueName: \"kubernetes.io/projected/51d62e61-4750-4073-9f11-058b1465cf57-kube-api-access-nnsnk\") pod \"maas-keycloak-0\" (UID: \"51d62e61-4750-4073-9f11-058b1465cf57\") " pod="keycloak-system/maas-keycloak-0" Jun 03 19:34:08.760816 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:34:08.760712 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 19:34:08.904065 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:34:08.903999 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 19:34:08.906964 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:34:08.906934 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51d62e61_4750_4073_9f11_058b1465cf57.slice/crio-3b3e3b41672d093d8da0e913306bbe96c95fabe37f71f9ccee717c6459340a87 WatchSource:0}: Error finding container 3b3e3b41672d093d8da0e913306bbe96c95fabe37f71f9ccee717c6459340a87: Status 404 returned error can't find the container with id 3b3e3b41672d093d8da0e913306bbe96c95fabe37f71f9ccee717c6459340a87 Jun 03 19:34:09.784889 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:34:09.784842 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"51d62e61-4750-4073-9f11-058b1465cf57","Type":"ContainerStarted","Data":"3b3e3b41672d093d8da0e913306bbe96c95fabe37f71f9ccee717c6459340a87"} Jun 03 19:34:13.811322 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:34:13.811242 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"51d62e61-4750-4073-9f11-058b1465cf57","Type":"ContainerStarted","Data":"e13bbd1a4de71bf645aec66bef0a12de60e97c233aa78eae7b966003bea2bafe"} Jun 03 19:34:13.833093 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:34:13.833030 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.1489981679999999 podStartE2EDuration="5.833009721s" totalImagesPullingTime="4.684011553s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:34:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:34:13.831516333 +0000 UTC m=+800.677175785" watchObservedRunningTime="2026-06-03 19:34:13.833009721 +0000 UTC m=+800.678669144" Jun 03 19:34:14.762979 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:34:14.762941 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 03 19:34:14.763421 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:34:14.763382 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="51d62e61-4750-4073-9f11-058b1465cf57" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.33:9000/health/started\": dial tcp 10.133.0.33:9000: connect: connection refused" Jun 03 19:34:15.762071 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:34:15.762021 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="51d62e61-4750-4073-9f11-058b1465cf57" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.33:9000/health/started\": dial tcp 10.133.0.33:9000: connect: connection refused" Jun 03 19:34:16.762199 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:34:16.762134 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="51d62e61-4750-4073-9f11-058b1465cf57" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.33:9000/health/started\": dial tcp 10.133.0.33:9000: connect: connection refused" Jun 03 19:34:17.762085 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:34:17.762026 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="51d62e61-4750-4073-9f11-058b1465cf57" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.33:9000/health/started\": dial tcp 10.133.0.33:9000: connect: connection refused" Jun 03 19:34:18.762126 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:34:18.761393 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 03 19:34:18.762126 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:34:18.761727 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="51d62e61-4750-4073-9f11-058b1465cf57" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.33:9000/health/started\": dial tcp 10.133.0.33:9000: connect: connection refused" Jun 03 19:34:19.761510 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:34:19.761455 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="51d62e61-4750-4073-9f11-058b1465cf57" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.33:9000/health/started\": dial tcp 10.133.0.33:9000: connect: connection refused" Jun 03 19:34:20.761436 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:34:20.761376 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="51d62e61-4750-4073-9f11-058b1465cf57" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.33:9000/health/started\": dial tcp 10.133.0.33:9000: connect: connection refused" Jun 03 19:34:21.762045 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:34:21.761983 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="51d62e61-4750-4073-9f11-058b1465cf57" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.33:9000/health/started\": dial tcp 10.133.0.33:9000: connect: connection refused" Jun 03 19:34:22.762023 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:34:22.761969 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="51d62e61-4750-4073-9f11-058b1465cf57" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.33:9000/health/started\": dial tcp 10.133.0.33:9000: connect: connection refused" Jun 03 19:34:23.762180 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:34:23.762121 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="51d62e61-4750-4073-9f11-058b1465cf57" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.33:9000/health/started\": dial tcp 10.133.0.33:9000: connect: connection refused" Jun 03 19:34:24.762369 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:34:24.762312 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="51d62e61-4750-4073-9f11-058b1465cf57" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.33:9000/health/started\": dial tcp 10.133.0.33:9000: connect: connection refused" Jun 03 19:34:25.761656 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:34:25.761588 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="51d62e61-4750-4073-9f11-058b1465cf57" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.33:9000/health/started\": dial tcp 10.133.0.33:9000: connect: connection refused" Jun 03 19:34:26.761565 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:34:26.761512 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="51d62e61-4750-4073-9f11-058b1465cf57" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.33:9000/health/started\": dial tcp 10.133.0.33:9000: connect: connection refused" Jun 03 19:34:27.899474 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:34:27.899433 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 03 19:34:27.920496 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:34:27.920434 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="51d62e61-4750-4073-9f11-058b1465cf57" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 19:34:37.906040 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:34:37.906003 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 03 19:34:44.350988 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:34:44.350948 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7db85598d-j24x9"] Jun 03 19:34:44.359357 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:34:44.359326 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7db85598d-j24x9" Jun 03 19:34:44.362437 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:34:44.362409 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 03 19:34:44.362632 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:34:44.362411 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-hqcvx\"" Jun 03 19:34:44.363549 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:34:44.363522 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7db85598d-j24x9"] Jun 03 19:34:44.480797 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:34:44.480750 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8474\" (UniqueName: \"kubernetes.io/projected/fa01a0a3-cb6c-40c1-80bf-bf3976b9636c-kube-api-access-l8474\") pod \"maas-controller-7db85598d-j24x9\" (UID: \"fa01a0a3-cb6c-40c1-80bf-bf3976b9636c\") " pod="opendatahub/maas-controller-7db85598d-j24x9" Jun 03 19:34:44.582178 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:34:44.582140 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8474\" (UniqueName: \"kubernetes.io/projected/fa01a0a3-cb6c-40c1-80bf-bf3976b9636c-kube-api-access-l8474\") pod \"maas-controller-7db85598d-j24x9\" (UID: \"fa01a0a3-cb6c-40c1-80bf-bf3976b9636c\") " pod="opendatahub/maas-controller-7db85598d-j24x9" Jun 03 19:34:44.591378 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:34:44.591341 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8474\" (UniqueName: \"kubernetes.io/projected/fa01a0a3-cb6c-40c1-80bf-bf3976b9636c-kube-api-access-l8474\") pod \"maas-controller-7db85598d-j24x9\" (UID: \"fa01a0a3-cb6c-40c1-80bf-bf3976b9636c\") " pod="opendatahub/maas-controller-7db85598d-j24x9" Jun 03 19:34:44.672871 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:34:44.672821 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7db85598d-j24x9" Jun 03 19:34:44.830974 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:34:44.830933 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7db85598d-j24x9"] Jun 03 19:34:44.834185 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:34:44.834146 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa01a0a3_cb6c_40c1_80bf_bf3976b9636c.slice/crio-f73061c4fd5b04c1bfcc89ff205a1e9e4889c6e85a6e8529cbc7a1494046da18 WatchSource:0}: Error finding container f73061c4fd5b04c1bfcc89ff205a1e9e4889c6e85a6e8529cbc7a1494046da18: Status 404 returned error can't find the container with id f73061c4fd5b04c1bfcc89ff205a1e9e4889c6e85a6e8529cbc7a1494046da18 Jun 03 19:34:44.998193 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:34:44.998099 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7db85598d-j24x9" event={"ID":"fa01a0a3-cb6c-40c1-80bf-bf3976b9636c","Type":"ContainerStarted","Data":"f73061c4fd5b04c1bfcc89ff205a1e9e4889c6e85a6e8529cbc7a1494046da18"} Jun 03 19:34:48.017556 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:34:48.017516 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7db85598d-j24x9" event={"ID":"fa01a0a3-cb6c-40c1-80bf-bf3976b9636c","Type":"ContainerStarted","Data":"330fbbc6c7e8ba8a34fba5edb54052244e5225265352db548e5cc034343ac20b"} Jun 03 19:34:48.018037 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:34:48.017666 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7db85598d-j24x9" Jun 03 19:34:48.036704 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:34:48.036644 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7db85598d-j24x9" podStartSLOduration=1.699543979 podStartE2EDuration="4.0366218s" totalImagesPullingTime="2.337077821s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:34:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:34:48.036396137 +0000 UTC m=+834.882055554" watchObservedRunningTime="2026-06-03 19:34:48.0366218 +0000 UTC m=+834.882281218" Jun 03 19:34:59.029171 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:34:59.029135 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7db85598d-j24x9" Jun 03 19:35:19.332965 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:35:19.332927 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-gmx9m"] Jun 03 19:35:19.336468 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:35:19.336446 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7c6c859784-gmx9m" Jun 03 19:35:19.338934 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:35:19.338906 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 03 19:35:19.350879 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:35:19.350845 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-gmx9m"] Jun 03 19:35:19.395283 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:35:19.395245 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nv4jl\" (UniqueName: \"kubernetes.io/projected/b04205af-a027-4800-a8d6-7c8dfef7c76c-kube-api-access-nv4jl\") pod \"payload-processing-7c6c859784-gmx9m\" (UID: \"b04205af-a027-4800-a8d6-7c8dfef7c76c\") " pod="openshift-ingress/payload-processing-7c6c859784-gmx9m" Jun 03 19:35:19.496113 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:35:19.496071 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nv4jl\" (UniqueName: \"kubernetes.io/projected/b04205af-a027-4800-a8d6-7c8dfef7c76c-kube-api-access-nv4jl\") pod \"payload-processing-7c6c859784-gmx9m\" (UID: \"b04205af-a027-4800-a8d6-7c8dfef7c76c\") " pod="openshift-ingress/payload-processing-7c6c859784-gmx9m" Jun 03 19:35:19.505447 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:35:19.505416 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nv4jl\" (UniqueName: \"kubernetes.io/projected/b04205af-a027-4800-a8d6-7c8dfef7c76c-kube-api-access-nv4jl\") pod \"payload-processing-7c6c859784-gmx9m\" (UID: \"b04205af-a027-4800-a8d6-7c8dfef7c76c\") " pod="openshift-ingress/payload-processing-7c6c859784-gmx9m" Jun 03 19:35:19.648537 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:35:19.648495 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7c6c859784-gmx9m" Jun 03 19:35:19.800152 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:35:19.800123 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-gmx9m"] Jun 03 19:35:19.803210 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:35:19.803170 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb04205af_a027_4800_a8d6_7c8dfef7c76c.slice/crio-d321ca69f1c88f1b5759733bbee78a6c3674d21c9a8a8379b370cdf5d69fdafd WatchSource:0}: Error finding container d321ca69f1c88f1b5759733bbee78a6c3674d21c9a8a8379b370cdf5d69fdafd: Status 404 returned error can't find the container with id d321ca69f1c88f1b5759733bbee78a6c3674d21c9a8a8379b370cdf5d69fdafd Jun 03 19:35:20.184313 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:35:20.184243 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-gmx9m" event={"ID":"b04205af-a027-4800-a8d6-7c8dfef7c76c","Type":"ContainerStarted","Data":"d321ca69f1c88f1b5759733bbee78a6c3674d21c9a8a8379b370cdf5d69fdafd"} Jun 03 19:35:23.207247 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:35:23.207204 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-gmx9m" event={"ID":"b04205af-a027-4800-a8d6-7c8dfef7c76c","Type":"ContainerStarted","Data":"8e6e52bc6a6761c79b556e8c04cce9b356110cb43ad0919e37a80bb20d732d34"} Jun 03 19:35:23.207676 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:35:23.207302 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-gmx9m" Jun 03 19:35:23.231979 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:35:23.231921 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-7c6c859784-gmx9m" podStartSLOduration=1.438845356 podStartE2EDuration="4.231904227s" totalImagesPullingTime="2.793058871s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:35:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:35:23.231648638 +0000 UTC m=+870.077308053" watchObservedRunningTime="2026-06-03 19:35:23.231904227 +0000 UTC m=+870.077563641" Jun 03 19:35:28.241536 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:35:28.241498 2579 generic.go:356] "Generic (PLEG): container finished" podID="aa857b5b-adc4-44d0-9adf-20c16b9bff56" containerID="0ff07e35a4fa6296d722e8dea5c071b0163864001756cd8324a399d9458e07ee" exitCode=0 Jun 03 19:35:28.242082 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:35:28.241577 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bxhbd" event={"ID":"aa857b5b-adc4-44d0-9adf-20c16b9bff56","Type":"ContainerDied","Data":"0ff07e35a4fa6296d722e8dea5c071b0163864001756cd8324a399d9458e07ee"} Jun 03 19:35:28.242082 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:35:28.242091 2579 scope.go:117] "RemoveContainer" containerID="0ff07e35a4fa6296d722e8dea5c071b0163864001756cd8324a399d9458e07ee" Jun 03 19:35:28.243205 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:35:28.243172 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jun 03 19:35:28.243331 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:35:28.243244 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jun 03 19:35:28.243331 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:35:28.243275 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jun 03 19:35:29.248228 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:35:29.248185 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bxhbd" event={"ID":"aa857b5b-adc4-44d0-9adf-20c16b9bff56","Type":"ContainerStarted","Data":"75dc854cffb46cd734a2188a1cda87816ac094f43e329ebb1e5cdfe54a375a20"} Jun 03 19:35:29.776715 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:35:29.776595 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bxhbd" Jun 03 19:35:29.776715 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:35:29.776677 2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-bxhbd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body= Jun 03 19:35:29.777116 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:35:29.776734 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bxhbd" podUID="aa857b5b-adc4-44d0-9adf-20c16b9bff56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" Jun 03 19:35:29.919763 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:35:29.919724 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 19:35:29.919959 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:35:29.919929 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="51d62e61-4750-4073-9f11-058b1465cf57" containerName="keycloak" containerID="cri-o://e13bbd1a4de71bf645aec66bef0a12de60e97c233aa78eae7b966003bea2bafe" gracePeriod=30 Jun 03 19:35:30.776733 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:35:30.776174 2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-bxhbd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body= Jun 03 19:35:30.776733 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:35:30.776262 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bxhbd" podUID="aa857b5b-adc4-44d0-9adf-20c16b9bff56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" Jun 03 19:35:31.620390 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:35:31.620312 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 19:35:31.707151 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:35:31.707111 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nnsnk\" (UniqueName: \"kubernetes.io/projected/51d62e61-4750-4073-9f11-058b1465cf57-kube-api-access-nnsnk\") pod \"51d62e61-4750-4073-9f11-058b1465cf57\" (UID: \"51d62e61-4750-4073-9f11-058b1465cf57\") " Jun 03 19:35:31.709621 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:35:31.709584 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51d62e61-4750-4073-9f11-058b1465cf57-kube-api-access-nnsnk" (OuterVolumeSpecName: "kube-api-access-nnsnk") pod "51d62e61-4750-4073-9f11-058b1465cf57" (UID: "51d62e61-4750-4073-9f11-058b1465cf57"). InnerVolumeSpecName "kube-api-access-nnsnk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:35:31.777792 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:35:31.777746 2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-bxhbd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body= Jun 03 19:35:31.778449 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:35:31.778413 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bxhbd" podUID="aa857b5b-adc4-44d0-9adf-20c16b9bff56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" Jun 03 19:35:31.808764 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:35:31.808712 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nnsnk\" (UniqueName: \"kubernetes.io/projected/51d62e61-4750-4073-9f11-058b1465cf57-kube-api-access-nnsnk\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\"" Jun 03 19:35:32.269452 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:35:32.269405 2579 generic.go:356] "Generic (PLEG): container finished" podID="51d62e61-4750-4073-9f11-058b1465cf57" containerID="e13bbd1a4de71bf645aec66bef0a12de60e97c233aa78eae7b966003bea2bafe" exitCode=143 Jun 03 19:35:32.269666 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:35:32.269485 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"51d62e61-4750-4073-9f11-058b1465cf57","Type":"ContainerDied","Data":"e13bbd1a4de71bf645aec66bef0a12de60e97c233aa78eae7b966003bea2bafe"} Jun 03 19:35:32.269666 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:35:32.269568 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"51d62e61-4750-4073-9f11-058b1465cf57","Type":"ContainerDied","Data":"3b3e3b41672d093d8da0e913306bbe96c95fabe37f71f9ccee717c6459340a87"} Jun 03 19:35:32.269666 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:35:32.269595 2579 scope.go:117] "RemoveContainer" containerID="e13bbd1a4de71bf645aec66bef0a12de60e97c233aa78eae7b966003bea2bafe" Jun 03 19:35:32.269829 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:35:32.269775 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 19:35:32.295881 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:35:32.295847 2579 scope.go:117] "RemoveContainer" containerID="e13bbd1a4de71bf645aec66bef0a12de60e97c233aa78eae7b966003bea2bafe" Jun 03 19:35:32.296303 ip-10-0-138-80 kubenswrapper[2579]: E0603 19:35:32.296255 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e13bbd1a4de71bf645aec66bef0a12de60e97c233aa78eae7b966003bea2bafe\": container with ID starting with e13bbd1a4de71bf645aec66bef0a12de60e97c233aa78eae7b966003bea2bafe not found: ID does not exist" containerID="e13bbd1a4de71bf645aec66bef0a12de60e97c233aa78eae7b966003bea2bafe" Jun 03 19:35:32.296404 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:35:32.296310 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e13bbd1a4de71bf645aec66bef0a12de60e97c233aa78eae7b966003bea2bafe"} err="failed to get container status \"e13bbd1a4de71bf645aec66bef0a12de60e97c233aa78eae7b966003bea2bafe\": rpc error: code = NotFound desc = could not find container \"e13bbd1a4de71bf645aec66bef0a12de60e97c233aa78eae7b966003bea2bafe\": container with ID starting with e13bbd1a4de71bf645aec66bef0a12de60e97c233aa78eae7b966003bea2bafe not found: ID does not exist" Jun 03 19:35:32.308144 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:35:32.308106 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 19:35:32.312370 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:35:32.312340 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 19:35:32.337425 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:35:32.337383 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 19:35:32.337800 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:35:32.337786 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51d62e61-4750-4073-9f11-058b1465cf57" containerName="keycloak" Jun 03 19:35:32.337859 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:35:32.337801 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="51d62e61-4750-4073-9f11-058b1465cf57" containerName="keycloak" Jun 03 19:35:32.337896 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:35:32.337861 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="51d62e61-4750-4073-9f11-058b1465cf57" containerName="keycloak" Jun 03 19:35:32.341639 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:35:32.341617 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 19:35:32.344452 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:35:32.344408 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 03 19:35:32.344452 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:35:32.344436 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 03 19:35:32.344672 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:35:32.344410 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 03 19:35:32.344672 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:35:32.344480 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 03 19:35:32.344672 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:35:32.344589 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-dl8dh\"" Jun 03 19:35:32.350611 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:35:32.350584 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 19:35:32.421403 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:35:32.421361 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/9b1af315-fddc-4cc4-b05c-d7531459d2a1-test-realms\") pod \"maas-keycloak-0\" (UID: \"9b1af315-fddc-4cc4-b05c-d7531459d2a1\") " pod="keycloak-system/maas-keycloak-0" Jun 03 19:35:32.421403 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:35:32.421402 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttnnx\" (UniqueName: \"kubernetes.io/projected/9b1af315-fddc-4cc4-b05c-d7531459d2a1-kube-api-access-ttnnx\") pod \"maas-keycloak-0\" (UID: \"9b1af315-fddc-4cc4-b05c-d7531459d2a1\") " pod="keycloak-system/maas-keycloak-0" Jun 03 19:35:32.523141 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:35:32.523035 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/9b1af315-fddc-4cc4-b05c-d7531459d2a1-test-realms\") pod \"maas-keycloak-0\" (UID: \"9b1af315-fddc-4cc4-b05c-d7531459d2a1\") " pod="keycloak-system/maas-keycloak-0" Jun 03 19:35:32.523141 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:35:32.523084 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttnnx\" (UniqueName: \"kubernetes.io/projected/9b1af315-fddc-4cc4-b05c-d7531459d2a1-kube-api-access-ttnnx\") pod \"maas-keycloak-0\" (UID: \"9b1af315-fddc-4cc4-b05c-d7531459d2a1\") " pod="keycloak-system/maas-keycloak-0" Jun 03 19:35:32.523779 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:35:32.523759 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/9b1af315-fddc-4cc4-b05c-d7531459d2a1-test-realms\") pod \"maas-keycloak-0\" (UID: \"9b1af315-fddc-4cc4-b05c-d7531459d2a1\") " pod="keycloak-system/maas-keycloak-0" Jun 03 19:35:32.532683 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:35:32.532638 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttnnx\" (UniqueName: \"kubernetes.io/projected/9b1af315-fddc-4cc4-b05c-d7531459d2a1-kube-api-access-ttnnx\") pod \"maas-keycloak-0\" (UID: \"9b1af315-fddc-4cc4-b05c-d7531459d2a1\") " pod="keycloak-system/maas-keycloak-0" Jun 03 19:35:32.653425 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:35:32.653380 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 19:35:32.790380 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:35:32.775886 2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-bxhbd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body= Jun 03 19:35:32.790380 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:35:32.775948 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bxhbd" podUID="aa857b5b-adc4-44d0-9adf-20c16b9bff56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" Jun 03 19:35:32.845951 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:35:32.845910 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 19:35:32.849513 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:35:32.849477 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b1af315_fddc_4cc4_b05c_d7531459d2a1.slice/crio-2bee28118a079b15199253c510103101c74fb9fda992b81dad7555d00fd1a93f WatchSource:0}: Error finding container 2bee28118a079b15199253c510103101c74fb9fda992b81dad7555d00fd1a93f: Status 404 returned error can't find the container with id 2bee28118a079b15199253c510103101c74fb9fda992b81dad7555d00fd1a93f Jun 03 19:35:33.276100 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:35:33.276059 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"9b1af315-fddc-4cc4-b05c-d7531459d2a1","Type":"ContainerStarted","Data":"54b1f22947516e2dc1af44de27306177b4c121d98e413aade4787640322c2021"} Jun 03 19:35:33.276311 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:35:33.276120 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"9b1af315-fddc-4cc4-b05c-d7531459d2a1","Type":"ContainerStarted","Data":"2bee28118a079b15199253c510103101c74fb9fda992b81dad7555d00fd1a93f"} Jun 03 19:35:33.300474 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:35:33.300413 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=0.972374453 podStartE2EDuration="1.300389725s" totalImagesPullingTime="328.015272ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:35:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:35:33.298347372 +0000 UTC m=+880.144006787" watchObservedRunningTime="2026-06-03 19:35:33.300389725 +0000 UTC m=+880.146049139" Jun 03 19:35:33.610775 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:35:33.610684 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51d62e61-4750-4073-9f11-058b1465cf57" path="/var/lib/kubelet/pods/51d62e61-4750-4073-9f11-058b1465cf57/volumes" Jun 03 19:35:33.654389 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:35:33.654337 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 03 19:35:33.656090 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:35:33.656056 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9b1af315-fddc-4cc4-b05c-d7531459d2a1" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.36:9000/health/started\": dial tcp 10.133.0.36:9000: connect: connection refused" Jun 03 19:35:33.781601 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:35:33.781565 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bxhbd" Jun 03 19:35:33.782157 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:35:33.782129 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bxhbd" Jun 03 19:35:33.783191 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:35:33.783164 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bxhbd" Jun 03 19:35:34.215337 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:35:34.215215 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-gmx9m" Jun 03 19:35:34.654821 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:35:34.654759 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9b1af315-fddc-4cc4-b05c-d7531459d2a1" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.36:9000/health/started\": dial tcp 10.133.0.36:9000: connect: connection refused" Jun 03 19:35:35.654847 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:35:35.654793 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9b1af315-fddc-4cc4-b05c-d7531459d2a1" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.36:9000/health/started\": dial tcp 10.133.0.36:9000: connect: connection refused" Jun 03 19:35:36.654956 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:35:36.654902 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9b1af315-fddc-4cc4-b05c-d7531459d2a1" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.36:9000/health/started\": dial tcp 10.133.0.36:9000: connect: connection refused" Jun 03 19:35:37.654631 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:35:37.654575 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9b1af315-fddc-4cc4-b05c-d7531459d2a1" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.36:9000/health/started\": dial tcp 10.133.0.36:9000: connect: connection refused" Jun 03 19:35:38.653904 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:35:38.653844 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9b1af315-fddc-4cc4-b05c-d7531459d2a1" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.36:9000/health/started\": dial tcp 10.133.0.36:9000: connect: connection refused" Jun 03 19:35:39.654746 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:35:39.654673 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9b1af315-fddc-4cc4-b05c-d7531459d2a1" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.36:9000/health/started\": dial tcp 10.133.0.36:9000: connect: connection refused" Jun 03 19:35:40.653942 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:35:40.653890 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9b1af315-fddc-4cc4-b05c-d7531459d2a1" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.36:9000/health/started\": dial tcp 10.133.0.36:9000: connect: connection refused" Jun 03 19:35:41.654672 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:35:41.654616 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9b1af315-fddc-4cc4-b05c-d7531459d2a1" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.36:9000/health/started\": dial tcp 10.133.0.36:9000: connect: connection refused" Jun 03 19:35:42.653566 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:35:42.653513 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 03 19:35:42.653923 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:35:42.653766 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9b1af315-fddc-4cc4-b05c-d7531459d2a1" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.36:9000/health/started\": dial tcp 10.133.0.36:9000: connect: connection refused" Jun 03 19:35:43.654667 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:35:43.654609 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9b1af315-fddc-4cc4-b05c-d7531459d2a1" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.36:9000/health/started\": dial tcp 10.133.0.36:9000: connect: connection refused" Jun 03 19:35:44.653967 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:35:44.653913 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9b1af315-fddc-4cc4-b05c-d7531459d2a1" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.36:9000/health/started\": dial tcp 10.133.0.36:9000: connect: connection refused" Jun 03 19:35:45.654401 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:35:45.654341 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9b1af315-fddc-4cc4-b05c-d7531459d2a1" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.36:9000/health/started\": dial tcp 10.133.0.36:9000: connect: connection refused" Jun 03 19:35:46.654679 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:35:46.654611 2579 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9b1af315-fddc-4cc4-b05c-d7531459d2a1" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.36:9000/health/started\": dial tcp 10.133.0.36:9000: connect: connection refused" Jun 03 19:35:47.784434 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:35:47.784392 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 03 19:35:47.801489 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:35:47.801432 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="9b1af315-fddc-4cc4-b05c-d7531459d2a1" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 19:35:53.603622 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:35:53.603589 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-jrw5d_b76503e3-1d27-4456-b636-148e6e9d14b2/console-operator/2.log" Jun 03 19:35:53.605330 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:35:53.605274 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-jrw5d_b76503e3-1d27-4456-b636-148e6e9d14b2/console-operator/2.log" Jun 03 19:35:57.790632 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:35:57.790596 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 03 19:36:22.874775 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:22.874735 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-9rtdn"] Jun 03 19:36:22.878437 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:22.878411 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-9rtdn" Jun 03 19:36:22.881605 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:22.881569 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 03 19:36:22.882785 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:22.882759 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 03 19:36:22.883449 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:22.883427 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-rtlr7\"" Jun 03 19:36:22.883585 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:22.883465 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 03 19:36:22.895755 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:22.895715 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-9rtdn"] Jun 03 19:36:23.052050 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:23.052004 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1e6b2116-d8ef-4fcb-9496-efd0be94b820-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-9rtdn\" (UID: \"1e6b2116-d8ef-4fcb-9496-efd0be94b820\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-9rtdn" Jun 03 19:36:23.052050 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:23.052055 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e6b2116-d8ef-4fcb-9496-efd0be94b820-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-9rtdn\" (UID: \"1e6b2116-d8ef-4fcb-9496-efd0be94b820\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-9rtdn" Jun 03 19:36:23.052377 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:23.052078 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1e6b2116-d8ef-4fcb-9496-efd0be94b820-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-9rtdn\" (UID: \"1e6b2116-d8ef-4fcb-9496-efd0be94b820\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-9rtdn" Jun 03 19:36:23.052377 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:23.052190 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2p985\" (UniqueName: \"kubernetes.io/projected/1e6b2116-d8ef-4fcb-9496-efd0be94b820-kube-api-access-2p985\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-9rtdn\" (UID: \"1e6b2116-d8ef-4fcb-9496-efd0be94b820\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-9rtdn" Jun 03 19:36:23.052377 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:23.052254 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1e6b2116-d8ef-4fcb-9496-efd0be94b820-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-9rtdn\" (UID: \"1e6b2116-d8ef-4fcb-9496-efd0be94b820\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-9rtdn" Jun 03 19:36:23.052377 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:23.052361 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1e6b2116-d8ef-4fcb-9496-efd0be94b820-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-9rtdn\" (UID: \"1e6b2116-d8ef-4fcb-9496-efd0be94b820\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-9rtdn" Jun 03 19:36:23.153415 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:23.153376 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1e6b2116-d8ef-4fcb-9496-efd0be94b820-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-9rtdn\" (UID: \"1e6b2116-d8ef-4fcb-9496-efd0be94b820\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-9rtdn" Jun 03 19:36:23.153625 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:23.153448 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1e6b2116-d8ef-4fcb-9496-efd0be94b820-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-9rtdn\" (UID: \"1e6b2116-d8ef-4fcb-9496-efd0be94b820\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-9rtdn" Jun 03 19:36:23.153625 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:23.153480 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e6b2116-d8ef-4fcb-9496-efd0be94b820-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-9rtdn\" (UID: \"1e6b2116-d8ef-4fcb-9496-efd0be94b820\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-9rtdn" Jun 03 19:36:23.153625 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:23.153510 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1e6b2116-d8ef-4fcb-9496-efd0be94b820-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-9rtdn\" (UID: \"1e6b2116-d8ef-4fcb-9496-efd0be94b820\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-9rtdn" Jun 03 19:36:23.153625 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:23.153559 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2p985\" (UniqueName: \"kubernetes.io/projected/1e6b2116-d8ef-4fcb-9496-efd0be94b820-kube-api-access-2p985\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-9rtdn\" (UID: \"1e6b2116-d8ef-4fcb-9496-efd0be94b820\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-9rtdn" Jun 03 19:36:23.153625 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:23.153604 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1e6b2116-d8ef-4fcb-9496-efd0be94b820-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-9rtdn\" (UID: \"1e6b2116-d8ef-4fcb-9496-efd0be94b820\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-9rtdn" Jun 03 19:36:23.153883 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:23.153860 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1e6b2116-d8ef-4fcb-9496-efd0be94b820-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-9rtdn\" (UID: \"1e6b2116-d8ef-4fcb-9496-efd0be94b820\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-9rtdn" Jun 03 19:36:23.153943 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:23.153879 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1e6b2116-d8ef-4fcb-9496-efd0be94b820-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-9rtdn\" (UID: \"1e6b2116-d8ef-4fcb-9496-efd0be94b820\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-9rtdn" Jun 03 19:36:23.153943 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:23.153916 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1e6b2116-d8ef-4fcb-9496-efd0be94b820-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-9rtdn\" (UID: \"1e6b2116-d8ef-4fcb-9496-efd0be94b820\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-9rtdn" Jun 03 19:36:23.155925 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:23.155902 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1e6b2116-d8ef-4fcb-9496-efd0be94b820-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-9rtdn\" (UID: \"1e6b2116-d8ef-4fcb-9496-efd0be94b820\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-9rtdn" Jun 03 19:36:23.156213 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:23.156194 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e6b2116-d8ef-4fcb-9496-efd0be94b820-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-9rtdn\" (UID: \"1e6b2116-d8ef-4fcb-9496-efd0be94b820\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-9rtdn" Jun 03 19:36:23.165714 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:23.165678 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2p985\" (UniqueName: \"kubernetes.io/projected/1e6b2116-d8ef-4fcb-9496-efd0be94b820-kube-api-access-2p985\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-9rtdn\" (UID: \"1e6b2116-d8ef-4fcb-9496-efd0be94b820\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-9rtdn" Jun 03 19:36:23.192037 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:23.192001 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-9rtdn" Jun 03 19:36:23.351463 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:36:23.351428 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e6b2116_d8ef_4fcb_9496_efd0be94b820.slice/crio-751ca71b6c2304fd99b426a9dd87cd957536e5cfa6b743a90142a89cc86e4bf9 WatchSource:0}: Error finding container 751ca71b6c2304fd99b426a9dd87cd957536e5cfa6b743a90142a89cc86e4bf9: Status 404 returned error can't find the container with id 751ca71b6c2304fd99b426a9dd87cd957536e5cfa6b743a90142a89cc86e4bf9 Jun 03 19:36:23.353756 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:23.353727 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 19:36:23.355777 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:23.355753 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-9rtdn"] Jun 03 19:36:23.571058 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:23.570965 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-9rtdn" event={"ID":"1e6b2116-d8ef-4fcb-9496-efd0be94b820","Type":"ContainerStarted","Data":"751ca71b6c2304fd99b426a9dd87cd957536e5cfa6b743a90142a89cc86e4bf9"} Jun 03 19:36:28.599392 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:28.599354 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-9rtdn" event={"ID":"1e6b2116-d8ef-4fcb-9496-efd0be94b820","Type":"ContainerStarted","Data":"4e148e1cc7d550dc8f61d5db6940149549f4728d5f8209e50b5fd145f7d7d86b"} Jun 03 19:36:29.606907 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:29.606807 2579 generic.go:356] "Generic (PLEG): container finished" podID="1e6b2116-d8ef-4fcb-9496-efd0be94b820" containerID="4e148e1cc7d550dc8f61d5db6940149549f4728d5f8209e50b5fd145f7d7d86b" exitCode=0 Jun 03 19:36:29.610401 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:29.610366 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-9rtdn" event={"ID":"1e6b2116-d8ef-4fcb-9496-efd0be94b820","Type":"ContainerDied","Data":"4e148e1cc7d550dc8f61d5db6940149549f4728d5f8209e50b5fd145f7d7d86b"} Jun 03 19:36:31.619792 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:31.619750 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-9rtdn" event={"ID":"1e6b2116-d8ef-4fcb-9496-efd0be94b820","Type":"ContainerStarted","Data":"22b71104f423bd29f65bbf6cfb50ea83604e2a90c6ae3f5d15d6bd7c097eda6f"} Jun 03 19:36:31.642036 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:31.641977 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-9rtdn" podStartSLOduration=2.792462179 podStartE2EDuration="9.641959481s" totalImagesPullingTime="5.483215572s" totalInitContainerRuntime="1.36628173s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:36:22 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:36:31.641380452 +0000 UTC m=+938.487039867" watchObservedRunningTime="2026-06-03 19:36:31.641959481 +0000 UTC m=+938.487618896" Jun 03 19:36:32.138625 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:32.138581 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-fvjtf"] Jun 03 19:36:32.143598 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:32.143568 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fvjtf" Jun 03 19:36:32.146870 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:32.146838 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 03 19:36:32.154332 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:32.154282 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-fvjtf"] Jun 03 19:36:32.236017 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:32.235968 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cfd18048-eb13-4598-88b3-1be22b9e0287-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-fvjtf\" (UID: \"cfd18048-eb13-4598-88b3-1be22b9e0287\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fvjtf" Jun 03 19:36:32.236209 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:32.236027 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cfd18048-eb13-4598-88b3-1be22b9e0287-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-fvjtf\" (UID: \"cfd18048-eb13-4598-88b3-1be22b9e0287\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fvjtf" Jun 03 19:36:32.236209 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:32.236089 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cfd18048-eb13-4598-88b3-1be22b9e0287-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-fvjtf\" (UID: \"cfd18048-eb13-4598-88b3-1be22b9e0287\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fvjtf" Jun 03 19:36:32.236209 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:32.236129 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5wgv\" (UniqueName: \"kubernetes.io/projected/cfd18048-eb13-4598-88b3-1be22b9e0287-kube-api-access-v5wgv\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-fvjtf\" (UID: \"cfd18048-eb13-4598-88b3-1be22b9e0287\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fvjtf" Jun 03 19:36:32.236209 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:32.236178 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cfd18048-eb13-4598-88b3-1be22b9e0287-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-fvjtf\" (UID: \"cfd18048-eb13-4598-88b3-1be22b9e0287\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fvjtf" Jun 03 19:36:32.236394 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:32.236234 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cfd18048-eb13-4598-88b3-1be22b9e0287-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-fvjtf\" (UID: \"cfd18048-eb13-4598-88b3-1be22b9e0287\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fvjtf" Jun 03 19:36:32.337635 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:32.337575 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cfd18048-eb13-4598-88b3-1be22b9e0287-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-fvjtf\" (UID: \"cfd18048-eb13-4598-88b3-1be22b9e0287\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fvjtf" Jun 03 19:36:32.337635 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:32.337636 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cfd18048-eb13-4598-88b3-1be22b9e0287-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-fvjtf\" (UID: \"cfd18048-eb13-4598-88b3-1be22b9e0287\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fvjtf" Jun 03 19:36:32.337920 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:32.337655 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cfd18048-eb13-4598-88b3-1be22b9e0287-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-fvjtf\" (UID: \"cfd18048-eb13-4598-88b3-1be22b9e0287\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fvjtf" Jun 03 19:36:32.337920 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:32.337675 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5wgv\" (UniqueName: \"kubernetes.io/projected/cfd18048-eb13-4598-88b3-1be22b9e0287-kube-api-access-v5wgv\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-fvjtf\" (UID: \"cfd18048-eb13-4598-88b3-1be22b9e0287\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fvjtf" Jun 03 19:36:32.337920 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:32.337715 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cfd18048-eb13-4598-88b3-1be22b9e0287-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-fvjtf\" (UID: \"cfd18048-eb13-4598-88b3-1be22b9e0287\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fvjtf" Jun 03 19:36:32.337920 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:32.337762 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cfd18048-eb13-4598-88b3-1be22b9e0287-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-fvjtf\" (UID: \"cfd18048-eb13-4598-88b3-1be22b9e0287\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fvjtf" Jun 03 19:36:32.338130 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:32.338094 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cfd18048-eb13-4598-88b3-1be22b9e0287-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-fvjtf\" (UID: \"cfd18048-eb13-4598-88b3-1be22b9e0287\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fvjtf" Jun 03 19:36:32.338130 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:32.338122 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cfd18048-eb13-4598-88b3-1be22b9e0287-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-fvjtf\" (UID: \"cfd18048-eb13-4598-88b3-1be22b9e0287\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fvjtf" Jun 03 19:36:32.338242 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:32.338177 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cfd18048-eb13-4598-88b3-1be22b9e0287-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-fvjtf\" (UID: \"cfd18048-eb13-4598-88b3-1be22b9e0287\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fvjtf" Jun 03 19:36:32.340309 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:32.340264 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cfd18048-eb13-4598-88b3-1be22b9e0287-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-fvjtf\" (UID: \"cfd18048-eb13-4598-88b3-1be22b9e0287\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fvjtf" Jun 03 19:36:32.341263 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:32.341231 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cfd18048-eb13-4598-88b3-1be22b9e0287-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-fvjtf\" (UID: \"cfd18048-eb13-4598-88b3-1be22b9e0287\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fvjtf" Jun 03 19:36:32.351916 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:32.351879 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5wgv\" (UniqueName: \"kubernetes.io/projected/cfd18048-eb13-4598-88b3-1be22b9e0287-kube-api-access-v5wgv\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-fvjtf\" (UID: \"cfd18048-eb13-4598-88b3-1be22b9e0287\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fvjtf" Jun 03 19:36:32.458120 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:32.457986 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fvjtf" Jun 03 19:36:32.609038 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:32.608891 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-fvjtf"] Jun 03 19:36:32.612468 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:36:32.612424 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfd18048_eb13_4598_88b3_1be22b9e0287.slice/crio-d54c3232a956b2230f2c9e7d851b02a36a3c5ee9c27e5aaa6a99fdf07ff9f0c7 WatchSource:0}: Error finding container d54c3232a956b2230f2c9e7d851b02a36a3c5ee9c27e5aaa6a99fdf07ff9f0c7: Status 404 returned error can't find the container with id d54c3232a956b2230f2c9e7d851b02a36a3c5ee9c27e5aaa6a99fdf07ff9f0c7 Jun 03 19:36:32.628022 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:32.627979 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fvjtf" event={"ID":"cfd18048-eb13-4598-88b3-1be22b9e0287","Type":"ContainerStarted","Data":"d54c3232a956b2230f2c9e7d851b02a36a3c5ee9c27e5aaa6a99fdf07ff9f0c7"} Jun 03 19:36:33.192216 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:33.192165 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-9rtdn" Jun 03 19:36:33.192216 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:33.192228 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-9rtdn" Jun 03 19:36:33.205073 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:33.205035 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-9rtdn" Jun 03 19:36:33.634785 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:33.634683 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fvjtf" event={"ID":"cfd18048-eb13-4598-88b3-1be22b9e0287","Type":"ContainerStarted","Data":"040001f5140ad8c2ac441e448a8f0bc6ab900f99fd6dfe7c0c351ab016b77eaf"} Jun 03 19:36:33.646920 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:33.646890 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-9rtdn" Jun 03 19:36:34.641559 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:34.641524 2579 generic.go:356] "Generic (PLEG): container finished" podID="cfd18048-eb13-4598-88b3-1be22b9e0287" containerID="040001f5140ad8c2ac441e448a8f0bc6ab900f99fd6dfe7c0c351ab016b77eaf" exitCode=0 Jun 03 19:36:34.641956 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:34.641597 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fvjtf" event={"ID":"cfd18048-eb13-4598-88b3-1be22b9e0287","Type":"ContainerDied","Data":"040001f5140ad8c2ac441e448a8f0bc6ab900f99fd6dfe7c0c351ab016b77eaf"} Jun 03 19:36:35.648083 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:35.648038 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fvjtf" event={"ID":"cfd18048-eb13-4598-88b3-1be22b9e0287","Type":"ContainerStarted","Data":"74e8f5e85f2ac0182540f7c5851a3c27ac61e622c2452a41b14935f4b8c6142e"} Jun 03 19:36:35.669055 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:35.668989 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fvjtf" podStartSLOduration=2.103765164 podStartE2EDuration="3.668968738s" totalImagesPullingTime="237.790618ms" totalInitContainerRuntime="1.327412956s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:36:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:36:35.66747824 +0000 UTC m=+942.513137656" watchObservedRunningTime="2026-06-03 19:36:35.668968738 +0000 UTC m=+942.514628152" Jun 03 19:36:42.459081 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:42.459032 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fvjtf" Jun 03 19:36:42.459581 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:42.459121 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fvjtf" Jun 03 19:36:42.472682 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:42.472636 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fvjtf" Jun 03 19:36:42.695595 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:42.695559 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fvjtf" Jun 03 19:36:50.046879 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:50.046836 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cx9xpf"] Jun 03 19:36:50.050212 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:50.050191 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cx9xpf" Jun 03 19:36:50.053229 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:50.053202 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 03 19:36:50.065457 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:50.065421 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cx9xpf"] Jun 03 19:36:50.115557 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:50.115517 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/15808d4b-17dd-48ea-9932-dfd18290c41f-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cx9xpf\" (UID: \"15808d4b-17dd-48ea-9932-dfd18290c41f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cx9xpf" Jun 03 19:36:50.115753 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:50.115569 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/15808d4b-17dd-48ea-9932-dfd18290c41f-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cx9xpf\" (UID: \"15808d4b-17dd-48ea-9932-dfd18290c41f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cx9xpf" Jun 03 19:36:50.115753 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:50.115628 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/15808d4b-17dd-48ea-9932-dfd18290c41f-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cx9xpf\" (UID: \"15808d4b-17dd-48ea-9932-dfd18290c41f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cx9xpf" Jun 03 19:36:50.115842 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:50.115754 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/15808d4b-17dd-48ea-9932-dfd18290c41f-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cx9xpf\" (UID: \"15808d4b-17dd-48ea-9932-dfd18290c41f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cx9xpf" Jun 03 19:36:50.115842 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:50.115775 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ld8gt\" (UniqueName: \"kubernetes.io/projected/15808d4b-17dd-48ea-9932-dfd18290c41f-kube-api-access-ld8gt\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cx9xpf\" (UID: \"15808d4b-17dd-48ea-9932-dfd18290c41f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cx9xpf" Jun 03 19:36:50.115842 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:50.115796 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/15808d4b-17dd-48ea-9932-dfd18290c41f-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cx9xpf\" (UID: \"15808d4b-17dd-48ea-9932-dfd18290c41f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cx9xpf" Jun 03 19:36:50.216719 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:50.216667 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/15808d4b-17dd-48ea-9932-dfd18290c41f-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cx9xpf\" (UID: \"15808d4b-17dd-48ea-9932-dfd18290c41f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cx9xpf" Jun 03 19:36:50.216719 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:50.216719 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ld8gt\" (UniqueName: \"kubernetes.io/projected/15808d4b-17dd-48ea-9932-dfd18290c41f-kube-api-access-ld8gt\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cx9xpf\" (UID: \"15808d4b-17dd-48ea-9932-dfd18290c41f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cx9xpf" Jun 03 19:36:50.217010 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:50.216750 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/15808d4b-17dd-48ea-9932-dfd18290c41f-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cx9xpf\" (UID: \"15808d4b-17dd-48ea-9932-dfd18290c41f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cx9xpf" Jun 03 19:36:50.217010 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:50.216804 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/15808d4b-17dd-48ea-9932-dfd18290c41f-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cx9xpf\" (UID: \"15808d4b-17dd-48ea-9932-dfd18290c41f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cx9xpf" Jun 03 19:36:50.217010 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:50.216840 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/15808d4b-17dd-48ea-9932-dfd18290c41f-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cx9xpf\" (UID: \"15808d4b-17dd-48ea-9932-dfd18290c41f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cx9xpf" Jun 03 19:36:50.217010 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:50.216867 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/15808d4b-17dd-48ea-9932-dfd18290c41f-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cx9xpf\" (UID: \"15808d4b-17dd-48ea-9932-dfd18290c41f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cx9xpf" Jun 03 19:36:50.217354 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:50.217324 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/15808d4b-17dd-48ea-9932-dfd18290c41f-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cx9xpf\" (UID: \"15808d4b-17dd-48ea-9932-dfd18290c41f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cx9xpf" Jun 03 19:36:50.217489 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:50.217325 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/15808d4b-17dd-48ea-9932-dfd18290c41f-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cx9xpf\" (UID: \"15808d4b-17dd-48ea-9932-dfd18290c41f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cx9xpf" Jun 03 19:36:50.217489 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:50.217374 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/15808d4b-17dd-48ea-9932-dfd18290c41f-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cx9xpf\" (UID: \"15808d4b-17dd-48ea-9932-dfd18290c41f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cx9xpf" Jun 03 19:36:50.219383 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:50.219356 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/15808d4b-17dd-48ea-9932-dfd18290c41f-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cx9xpf\" (UID: \"15808d4b-17dd-48ea-9932-dfd18290c41f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cx9xpf" Jun 03 19:36:50.219511 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:50.219494 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/15808d4b-17dd-48ea-9932-dfd18290c41f-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cx9xpf\" (UID: \"15808d4b-17dd-48ea-9932-dfd18290c41f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cx9xpf" Jun 03 19:36:50.226696 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:50.226666 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ld8gt\" (UniqueName: \"kubernetes.io/projected/15808d4b-17dd-48ea-9932-dfd18290c41f-kube-api-access-ld8gt\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cx9xpf\" (UID: \"15808d4b-17dd-48ea-9932-dfd18290c41f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cx9xpf" Jun 03 19:36:50.361183 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:50.361072 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cx9xpf" Jun 03 19:36:50.516332 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:50.516156 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cx9xpf"] Jun 03 19:36:50.519075 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:36:50.519036 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15808d4b_17dd_48ea_9932_dfd18290c41f.slice/crio-2ee4594fd08ce5f69642da6ff21c3f3877a7bc15f9174176c44b2cd05e09732a WatchSource:0}: Error finding container 2ee4594fd08ce5f69642da6ff21c3f3877a7bc15f9174176c44b2cd05e09732a: Status 404 returned error can't find the container with id 2ee4594fd08ce5f69642da6ff21c3f3877a7bc15f9174176c44b2cd05e09732a Jun 03 19:36:50.726658 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:50.726585 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cx9xpf" event={"ID":"15808d4b-17dd-48ea-9932-dfd18290c41f","Type":"ContainerStarted","Data":"1c0a5776edc56eb14547118d7f7e5843d9f8c9b2643f68ba688e8177ad58874a"} Jun 03 19:36:50.726658 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:50.726643 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cx9xpf" event={"ID":"15808d4b-17dd-48ea-9932-dfd18290c41f","Type":"ContainerStarted","Data":"2ee4594fd08ce5f69642da6ff21c3f3877a7bc15f9174176c44b2cd05e09732a"} Jun 03 19:36:52.741371 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:52.741334 2579 generic.go:356] "Generic (PLEG): container finished" podID="15808d4b-17dd-48ea-9932-dfd18290c41f" containerID="1c0a5776edc56eb14547118d7f7e5843d9f8c9b2643f68ba688e8177ad58874a" exitCode=0 Jun 03 19:36:52.741864 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:52.741402 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cx9xpf" event={"ID":"15808d4b-17dd-48ea-9932-dfd18290c41f","Type":"ContainerDied","Data":"1c0a5776edc56eb14547118d7f7e5843d9f8c9b2643f68ba688e8177ad58874a"} Jun 03 19:36:53.747844 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:53.747811 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cx9xpf" event={"ID":"15808d4b-17dd-48ea-9932-dfd18290c41f","Type":"ContainerStarted","Data":"fd1a729e0399c6b3f17e1725cc312651eb64b60abda23fa99d1cb5380b59557d"} Jun 03 19:36:53.774949 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:36:53.774890 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cx9xpf" podStartSLOduration=1.4937829360000001 podStartE2EDuration="3.774867361s" totalImagesPullingTime="241.111045ms" totalInitContainerRuntime="2.03997338s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:36:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:36:53.772874151 +0000 UTC m=+960.618533565" watchObservedRunningTime="2026-06-03 19:36:53.774867361 +0000 UTC m=+960.620526776" Jun 03 19:37:00.361767 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:37:00.361718 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cx9xpf" Jun 03 19:37:00.362214 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:37:00.361805 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cx9xpf" Jun 03 19:37:00.374767 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:37:00.374736 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cx9xpf" Jun 03 19:37:00.795053 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:37:00.795011 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cx9xpf" Jun 03 19:39:39.344891 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:39:39.344850 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7db85598d-j24x9"] Jun 03 19:39:39.345492 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:39:39.345093 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-7db85598d-j24x9" podUID="fa01a0a3-cb6c-40c1-80bf-bf3976b9636c" containerName="manager" containerID="cri-o://330fbbc6c7e8ba8a34fba5edb54052244e5225265352db548e5cc034343ac20b" gracePeriod=30 Jun 03 19:39:39.590962 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:39:39.590930 2579 generic.go:356] "Generic (PLEG): container finished" podID="fa01a0a3-cb6c-40c1-80bf-bf3976b9636c" containerID="330fbbc6c7e8ba8a34fba5edb54052244e5225265352db548e5cc034343ac20b" exitCode=0 Jun 03 19:39:39.591122 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:39:39.590980 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7db85598d-j24x9" event={"ID":"fa01a0a3-cb6c-40c1-80bf-bf3976b9636c","Type":"ContainerDied","Data":"330fbbc6c7e8ba8a34fba5edb54052244e5225265352db548e5cc034343ac20b"} Jun 03 19:39:39.591122 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:39:39.591020 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7db85598d-j24x9" event={"ID":"fa01a0a3-cb6c-40c1-80bf-bf3976b9636c","Type":"ContainerDied","Data":"f73061c4fd5b04c1bfcc89ff205a1e9e4889c6e85a6e8529cbc7a1494046da18"} Jun 03 19:39:39.591122 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:39:39.591036 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f73061c4fd5b04c1bfcc89ff205a1e9e4889c6e85a6e8529cbc7a1494046da18" Jun 03 19:39:39.607373 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:39:39.607281 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7db85598d-j24x9" Jun 03 19:39:39.679054 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:39:39.679013 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l8474\" (UniqueName: \"kubernetes.io/projected/fa01a0a3-cb6c-40c1-80bf-bf3976b9636c-kube-api-access-l8474\") pod \"fa01a0a3-cb6c-40c1-80bf-bf3976b9636c\" (UID: \"fa01a0a3-cb6c-40c1-80bf-bf3976b9636c\") " Jun 03 19:39:39.681309 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:39:39.681255 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa01a0a3-cb6c-40c1-80bf-bf3976b9636c-kube-api-access-l8474" (OuterVolumeSpecName: "kube-api-access-l8474") pod "fa01a0a3-cb6c-40c1-80bf-bf3976b9636c" (UID: "fa01a0a3-cb6c-40c1-80bf-bf3976b9636c"). InnerVolumeSpecName "kube-api-access-l8474". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:39:39.780006 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:39:39.779955 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l8474\" (UniqueName: \"kubernetes.io/projected/fa01a0a3-cb6c-40c1-80bf-bf3976b9636c-kube-api-access-l8474\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\"" Jun 03 19:39:40.596087 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:39:40.596053 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7db85598d-j24x9" Jun 03 19:39:40.622588 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:39:40.622549 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7db85598d-j24x9"] Jun 03 19:39:40.626551 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:39:40.626516 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7db85598d-j24x9"] Jun 03 19:39:41.609467 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:39:41.609431 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa01a0a3-cb6c-40c1-80bf-bf3976b9636c" path="/var/lib/kubelet/pods/fa01a0a3-cb6c-40c1-80bf-bf3976b9636c/volumes" Jun 03 19:40:53.642554 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:40:53.642523 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-jrw5d_b76503e3-1d27-4456-b636-148e6e9d14b2/console-operator/2.log" Jun 03 19:40:53.644318 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:40:53.644275 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-jrw5d_b76503e3-1d27-4456-b636-148e6e9d14b2/console-operator/2.log" Jun 03 19:40:53.672757 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:40:53.672712 2579 scope.go:117] "RemoveContainer" containerID="330fbbc6c7e8ba8a34fba5edb54052244e5225265352db548e5cc034343ac20b" Jun 03 19:45:00.147966 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:45:00.147861 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29675265-wq84w"] Jun 03 19:45:00.148565 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:45:00.148457 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa01a0a3-cb6c-40c1-80bf-bf3976b9636c" containerName="manager" Jun 03 19:45:00.148565 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:45:00.148478 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa01a0a3-cb6c-40c1-80bf-bf3976b9636c" containerName="manager" Jun 03 19:45:00.148691 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:45:00.148598 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa01a0a3-cb6c-40c1-80bf-bf3976b9636c" containerName="manager" Jun 03 19:45:00.151623 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:45:00.151603 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29675265-wq84w" Jun 03 19:45:00.154094 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:45:00.154074 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-t4cn7\"" Jun 03 19:45:00.167567 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:45:00.167541 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29675265-wq84w"] Jun 03 19:45:00.265211 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:45:00.265169 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7rgl\" (UniqueName: \"kubernetes.io/projected/de540b94-1104-40d5-8765-821e455db9de-kube-api-access-k7rgl\") pod \"maas-api-key-cleanup-29675265-wq84w\" (UID: \"de540b94-1104-40d5-8765-821e455db9de\") " pod="opendatahub/maas-api-key-cleanup-29675265-wq84w" Jun 03 19:45:00.366175 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:45:00.366140 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7rgl\" (UniqueName: \"kubernetes.io/projected/de540b94-1104-40d5-8765-821e455db9de-kube-api-access-k7rgl\") pod \"maas-api-key-cleanup-29675265-wq84w\" (UID: \"de540b94-1104-40d5-8765-821e455db9de\") " pod="opendatahub/maas-api-key-cleanup-29675265-wq84w" Jun 03 19:45:00.375439 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:45:00.375411 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7rgl\" (UniqueName: \"kubernetes.io/projected/de540b94-1104-40d5-8765-821e455db9de-kube-api-access-k7rgl\") pod \"maas-api-key-cleanup-29675265-wq84w\" (UID: \"de540b94-1104-40d5-8765-821e455db9de\") " pod="opendatahub/maas-api-key-cleanup-29675265-wq84w" Jun 03 19:45:00.461605 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:45:00.461513 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29675265-wq84w" Jun 03 19:45:00.596574 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:45:00.596548 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29675265-wq84w"] Jun 03 19:45:00.598704 ip-10-0-138-80 kubenswrapper[2579]: W0603 19:45:00.598675 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde540b94_1104_40d5_8765_821e455db9de.slice/crio-0c04763cc64f904cff314af31f13f55a98a9575479212de2519300e323cc0243 WatchSource:0}: Error finding container 0c04763cc64f904cff314af31f13f55a98a9575479212de2519300e323cc0243: Status 404 returned error can't find the container with id 0c04763cc64f904cff314af31f13f55a98a9575479212de2519300e323cc0243 Jun 03 19:45:00.600697 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:45:00.600682 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 19:45:01.189897 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:45:01.189856 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29675265-wq84w" event={"ID":"de540b94-1104-40d5-8765-821e455db9de","Type":"ContainerStarted","Data":"0c04763cc64f904cff314af31f13f55a98a9575479212de2519300e323cc0243"} Jun 03 19:45:04.206245 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:45:04.206206 2579 generic.go:356] "Generic (PLEG): container finished" podID="de540b94-1104-40d5-8765-821e455db9de" containerID="ba01d0056dd15897f04073ee2d4651d19d2d049710f3a1b11945a3b2c6ad01d2" exitCode=0 Jun 03 19:45:04.206674 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:45:04.206297 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29675265-wq84w" event={"ID":"de540b94-1104-40d5-8765-821e455db9de","Type":"ContainerDied","Data":"ba01d0056dd15897f04073ee2d4651d19d2d049710f3a1b11945a3b2c6ad01d2"} Jun 03 19:45:05.350949 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:45:05.350922 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29675265-wq84w" Jun 03 19:45:05.420755 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:45:05.420705 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k7rgl\" (UniqueName: \"kubernetes.io/projected/de540b94-1104-40d5-8765-821e455db9de-kube-api-access-k7rgl\") pod \"de540b94-1104-40d5-8765-821e455db9de\" (UID: \"de540b94-1104-40d5-8765-821e455db9de\") " Jun 03 19:45:05.422996 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:45:05.422962 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de540b94-1104-40d5-8765-821e455db9de-kube-api-access-k7rgl" (OuterVolumeSpecName: "kube-api-access-k7rgl") pod "de540b94-1104-40d5-8765-821e455db9de" (UID: "de540b94-1104-40d5-8765-821e455db9de"). InnerVolumeSpecName "kube-api-access-k7rgl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 19:45:05.522079 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:45:05.521986 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k7rgl\" (UniqueName: \"kubernetes.io/projected/de540b94-1104-40d5-8765-821e455db9de-kube-api-access-k7rgl\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\"" Jun 03 19:45:06.216970 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:45:06.216929 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29675265-wq84w" event={"ID":"de540b94-1104-40d5-8765-821e455db9de","Type":"ContainerDied","Data":"0c04763cc64f904cff314af31f13f55a98a9575479212de2519300e323cc0243"} Jun 03 19:45:06.216970 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:45:06.216964 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29675265-wq84w" Jun 03 19:45:06.217189 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:45:06.217040 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0c04763cc64f904cff314af31f13f55a98a9575479212de2519300e323cc0243" Jun 03 19:45:53.679806 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:45:53.679773 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-jrw5d_b76503e3-1d27-4456-b636-148e6e9d14b2/console-operator/2.log" Jun 03 19:45:53.682332 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:45:53.681990 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-jrw5d_b76503e3-1d27-4456-b636-148e6e9d14b2/console-operator/2.log" Jun 03 19:50:53.708350 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:50:53.708204 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-jrw5d_b76503e3-1d27-4456-b636-148e6e9d14b2/console-operator/2.log" Jun 03 19:50:53.714328 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:50:53.713408 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-jrw5d_b76503e3-1d27-4456-b636-148e6e9d14b2/console-operator/2.log" Jun 03 19:55:53.737538 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:55:53.737413 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-jrw5d_b76503e3-1d27-4456-b636-148e6e9d14b2/console-operator/2.log" Jun 03 19:55:53.743317 ip-10-0-138-80 kubenswrapper[2579]: I0603 19:55:53.743281 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-jrw5d_b76503e3-1d27-4456-b636-148e6e9d14b2/console-operator/2.log" Jun 03 20:00:00.143723 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:00:00.143636 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29675280-8lzws"] Jun 03 20:00:00.144179 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:00:00.144042 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de540b94-1104-40d5-8765-821e455db9de" containerName="cleanup" Jun 03 20:00:00.144179 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:00:00.144057 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="de540b94-1104-40d5-8765-821e455db9de" containerName="cleanup" Jun 03 20:00:00.144179 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:00:00.144128 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="de540b94-1104-40d5-8765-821e455db9de" containerName="cleanup" Jun 03 20:00:00.147062 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:00:00.147046 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29675280-8lzws" Jun 03 20:00:00.150219 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:00:00.150205 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-t4cn7\"" Jun 03 20:00:00.163474 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:00:00.163442 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29675280-8lzws"] Jun 03 20:00:00.267455 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:00:00.267416 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjdnx\" (UniqueName: \"kubernetes.io/projected/8128adf9-0207-494b-8b8b-629f03458b00-kube-api-access-vjdnx\") pod \"maas-api-key-cleanup-29675280-8lzws\" (UID: \"8128adf9-0207-494b-8b8b-629f03458b00\") " pod="opendatahub/maas-api-key-cleanup-29675280-8lzws" Jun 03 20:00:00.368816 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:00:00.368772 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjdnx\" (UniqueName: \"kubernetes.io/projected/8128adf9-0207-494b-8b8b-629f03458b00-kube-api-access-vjdnx\") pod \"maas-api-key-cleanup-29675280-8lzws\" (UID: \"8128adf9-0207-494b-8b8b-629f03458b00\") " pod="opendatahub/maas-api-key-cleanup-29675280-8lzws" Jun 03 20:00:00.378268 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:00:00.378237 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjdnx\" (UniqueName: \"kubernetes.io/projected/8128adf9-0207-494b-8b8b-629f03458b00-kube-api-access-vjdnx\") pod \"maas-api-key-cleanup-29675280-8lzws\" (UID: \"8128adf9-0207-494b-8b8b-629f03458b00\") " pod="opendatahub/maas-api-key-cleanup-29675280-8lzws" Jun 03 20:00:00.457232 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:00:00.457142 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29675280-8lzws" Jun 03 20:00:00.595660 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:00:00.595634 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29675280-8lzws"] Jun 03 20:00:00.599437 ip-10-0-138-80 kubenswrapper[2579]: W0603 20:00:00.599406 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8128adf9_0207_494b_8b8b_629f03458b00.slice/crio-c702626c537e5826c0382f5577c8d5cb83d0483f85b84c2775dcfff3c3330901 WatchSource:0}: Error finding container c702626c537e5826c0382f5577c8d5cb83d0483f85b84c2775dcfff3c3330901: Status 404 returned error can't find the container with id c702626c537e5826c0382f5577c8d5cb83d0483f85b84c2775dcfff3c3330901 Jun 03 20:00:01.598152 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:00:01.598118 2579 generic.go:356] "Generic (PLEG): container finished" podID="8128adf9-0207-494b-8b8b-629f03458b00" containerID="d6655f52c6e4f8c2deb025cf47cc7d02d7ef97fd275f2aa8fd917c5d6b038f36" exitCode=0 Jun 03 20:00:01.598617 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:00:01.598204 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29675280-8lzws" event={"ID":"8128adf9-0207-494b-8b8b-629f03458b00","Type":"ContainerDied","Data":"d6655f52c6e4f8c2deb025cf47cc7d02d7ef97fd275f2aa8fd917c5d6b038f36"} Jun 03 20:00:01.598617 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:00:01.598255 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29675280-8lzws" event={"ID":"8128adf9-0207-494b-8b8b-629f03458b00","Type":"ContainerStarted","Data":"c702626c537e5826c0382f5577c8d5cb83d0483f85b84c2775dcfff3c3330901"} Jun 03 20:00:02.744603 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:00:02.744572 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29675280-8lzws" Jun 03 20:00:02.891728 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:00:02.891688 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vjdnx\" (UniqueName: \"kubernetes.io/projected/8128adf9-0207-494b-8b8b-629f03458b00-kube-api-access-vjdnx\") pod \"8128adf9-0207-494b-8b8b-629f03458b00\" (UID: \"8128adf9-0207-494b-8b8b-629f03458b00\") " Jun 03 20:00:02.893944 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:00:02.893917 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8128adf9-0207-494b-8b8b-629f03458b00-kube-api-access-vjdnx" (OuterVolumeSpecName: "kube-api-access-vjdnx") pod "8128adf9-0207-494b-8b8b-629f03458b00" (UID: "8128adf9-0207-494b-8b8b-629f03458b00"). InnerVolumeSpecName "kube-api-access-vjdnx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 20:00:02.992660 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:00:02.992591 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vjdnx\" (UniqueName: \"kubernetes.io/projected/8128adf9-0207-494b-8b8b-629f03458b00-kube-api-access-vjdnx\") on node \"ip-10-0-138-80.ec2.internal\" DevicePath \"\"" Jun 03 20:00:03.609431 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:00:03.609391 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29675280-8lzws" event={"ID":"8128adf9-0207-494b-8b8b-629f03458b00","Type":"ContainerDied","Data":"c702626c537e5826c0382f5577c8d5cb83d0483f85b84c2775dcfff3c3330901"} Jun 03 20:00:03.609431 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:00:03.609428 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29675280-8lzws" Jun 03 20:00:03.609695 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:00:03.609444 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c702626c537e5826c0382f5577c8d5cb83d0483f85b84c2775dcfff3c3330901" Jun 03 20:00:53.767723 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:00:53.767604 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-jrw5d_b76503e3-1d27-4456-b636-148e6e9d14b2/console-operator/2.log" Jun 03 20:00:53.774800 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:00:53.774775 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-jrw5d_b76503e3-1d27-4456-b636-148e6e9d14b2/console-operator/2.log" Jun 03 20:01:18.491443 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:18.491362 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-8b9ffc7d9-sfb4s_000ee25d-2c22-4291-99b2-2f4399305d38/nginx/0.log" Jun 03 20:01:18.612805 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:18.612771 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-4j2r9_28167aeb-e4ac-4c15-829f-10e5914d5c6a/manager/0.log" Jun 03 20:01:18.731860 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:18.731824 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-pn9sz_752b47cd-19d4-4c7a-b3a3-fe503df57b14/manager/0.log" Jun 03 20:01:18.956222 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:18.956184 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29675265-wq84w_de540b94-1104-40d5-8765-821e455db9de/cleanup/0.log" Jun 03 20:01:19.064275 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:19.064247 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29675280-8lzws_8128adf9-0207-494b-8b8b-629f03458b00/cleanup/0.log" Jun 03 20:01:19.300904 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:19.300824 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-46zv5_f8e27063-851d-4ba7-ae7c-bee10b560730/server/0.log" Jun 03 20:01:19.419442 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:19.419408 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-256dp_9b7ae0eb-5ac9-4a2d-bc25-c5985ab31dd9/manager/0.log" Jun 03 20:01:19.674479 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:19.674450 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d56d45df5-rsjk6_34166712-240f-4e83-a73d-2aad2e475ce6/copy-manifests/0.log" Jun 03 20:01:19.688624 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:19.688592 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d56d45df5-rsjk6_34166712-240f-4e83-a73d-2aad2e475ce6/manager/0.log" Jun 03 20:01:19.924006 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:19.923977 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-hh7mj_7488f9c0-6108-4a14-a4bf-5046ce749148/postgres/0.log" Jun 03 20:01:22.472361 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:22.472333 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-mnw87_0430d7f8-5504-46dd-9d47-c5727b00bf37/discovery/0.log" Jun 03 20:01:22.585416 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:22.585385 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-d68c4fc59-tprs2_65d4d626-909d-4e1d-8ea2-6d1e31bbb547/kube-auth-proxy/0.log" Jun 03 20:01:22.815025 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:22.814924 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-bxhbd_aa857b5b-adc4-44d0-9adf-20c16b9bff56/istio-proxy/1.log" Jun 03 20:01:22.936669 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:22.936644 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-gmx9m_b04205af-a027-4800-a8d6-7c8dfef7c76c/payload-processing/0.log" Jun 03 20:01:23.419914 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:23.419884 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-9rtdn_1e6b2116-d8ef-4fcb-9496-efd0be94b820/storage-initializer/0.log" Jun 03 20:01:23.426870 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:23.426847 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-9rtdn_1e6b2116-d8ef-4fcb-9496-efd0be94b820/main/0.log" Jun 03 20:01:23.538636 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:23.538608 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-fvjtf_cfd18048-eb13-4598-88b3-1be22b9e0287/storage-initializer/0.log" Jun 03 20:01:23.545829 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:23.545795 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-fvjtf_cfd18048-eb13-4598-88b3-1be22b9e0287/main/0.log" Jun 03 20:01:23.782804 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:23.782708 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cx9xpf_15808d4b-17dd-48ea-9932-dfd18290c41f/storage-initializer/0.log" Jun 03 20:01:23.791019 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:23.790994 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cx9xpf_15808d4b-17dd-48ea-9932-dfd18290c41f/main/0.log" Jun 03 20:01:31.440334 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:31.440303 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-cjz9d_5f4ae72c-cf67-426b-af3e-9b2a27c9488c/global-pull-secret-syncer/0.log" Jun 03 20:01:31.622310 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:31.622259 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-pgqqd_7e0a45de-2b41-482b-a027-803833e40d55/konnectivity-agent/0.log" Jun 03 20:01:31.753541 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:31.753459 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-80.ec2.internal_79413a4092866a6445601379cc7dcecf/haproxy/0.log" Jun 03 20:01:34.974837 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:34.974806 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-gm6kr_803e2c6b-385f-41dd-827a-ad8fdab62fa2/sail-operator/0.log" Jun 03 20:01:38.732939 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:38.732895 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6c5bb68b96-6sbqt_e9b03cd4-cbfc-4f2b-a718-5480fcffa7b8/metrics-server/0.log" Jun 03 20:01:38.776512 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:38.776462 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-9b9fc658-9kmnp_1d2984f3-bc07-4dc5-a5e2-04f1852d5956/monitoring-plugin/0.log" Jun 03 20:01:38.809356 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:38.809324 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2859r_ae51ab15-b7d0-43ba-818e-2c19f3c5f00f/node-exporter/0.log" Jun 03 20:01:38.839060 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:38.839031 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2859r_ae51ab15-b7d0-43ba-818e-2c19f3c5f00f/kube-rbac-proxy/0.log" Jun 03 20:01:38.874579 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:38.874555 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2859r_ae51ab15-b7d0-43ba-818e-2c19f3c5f00f/init-textfile/0.log" Jun 03 20:01:39.628010 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:39.627985 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-db8b7bf4b-vm4k6_ebea4b18-499b-4be4-b2b3-ae82442dcc77/thanos-query/0.log" Jun 03 20:01:39.661409 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:39.661334 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-db8b7bf4b-vm4k6_ebea4b18-499b-4be4-b2b3-ae82442dcc77/kube-rbac-proxy-web/0.log" Jun 03 20:01:39.690993 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:39.690968 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-db8b7bf4b-vm4k6_ebea4b18-499b-4be4-b2b3-ae82442dcc77/kube-rbac-proxy/0.log" Jun 03 20:01:39.716674 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:39.716647 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-db8b7bf4b-vm4k6_ebea4b18-499b-4be4-b2b3-ae82442dcc77/prom-label-proxy/0.log" Jun 03 20:01:39.752717 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:39.752681 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-db8b7bf4b-vm4k6_ebea4b18-499b-4be4-b2b3-ae82442dcc77/kube-rbac-proxy-rules/0.log" Jun 03 20:01:39.783374 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:39.783343 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-db8b7bf4b-vm4k6_ebea4b18-499b-4be4-b2b3-ae82442dcc77/kube-rbac-proxy-metrics/0.log" Jun 03 20:01:41.868613 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:41.868571 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-jrw5d_b76503e3-1d27-4456-b636-148e6e9d14b2/console-operator/2.log" Jun 03 20:01:41.873520 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:41.873484 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-jrw5d_b76503e3-1d27-4456-b636-148e6e9d14b2/console-operator/3.log" Jun 03 20:01:42.478067 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:42.478039 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-796fd6659-kqt9f_6d927a0d-a339-4edc-9980-637cefcfddd7/console/0.log" Jun 03 20:01:43.781711 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:43.781669 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-sfrrm/perf-node-gather-daemonset-nhlv8"] Jun 03 20:01:43.785010 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:43.782910 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8128adf9-0207-494b-8b8b-629f03458b00" containerName="cleanup" Jun 03 20:01:43.785010 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:43.782939 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8128adf9-0207-494b-8b8b-629f03458b00" containerName="cleanup" Jun 03 20:01:43.785010 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:43.783175 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="8128adf9-0207-494b-8b8b-629f03458b00" containerName="cleanup" Jun 03 20:01:43.787241 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:43.787211 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sfrrm/perf-node-gather-daemonset-nhlv8" Jun 03 20:01:43.790564 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:43.790537 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sfrrm\"/\"kube-root-ca.crt\"" Jun 03 20:01:43.790710 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:43.790537 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-sfrrm\"/\"default-dockercfg-h4xnk\"" Jun 03 20:01:43.791687 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:43.791666 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sfrrm\"/\"openshift-service-ca.crt\"" Jun 03 20:01:43.794721 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:43.794699 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sfrrm/perf-node-gather-daemonset-nhlv8"] Jun 03 20:01:43.829069 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:43.829029 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c3805a53-5f0f-4b3a-9fe5-7fd1749d27bf-proc\") pod \"perf-node-gather-daemonset-nhlv8\" (UID: \"c3805a53-5f0f-4b3a-9fe5-7fd1749d27bf\") " pod="openshift-must-gather-sfrrm/perf-node-gather-daemonset-nhlv8" Jun 03 20:01:43.829069 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:43.829066 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c3805a53-5f0f-4b3a-9fe5-7fd1749d27bf-lib-modules\") pod \"perf-node-gather-daemonset-nhlv8\" (UID: \"c3805a53-5f0f-4b3a-9fe5-7fd1749d27bf\") " pod="openshift-must-gather-sfrrm/perf-node-gather-daemonset-nhlv8" Jun 03 20:01:43.829339 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:43.829118 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54fvd\" (UniqueName: \"kubernetes.io/projected/c3805a53-5f0f-4b3a-9fe5-7fd1749d27bf-kube-api-access-54fvd\") pod \"perf-node-gather-daemonset-nhlv8\" (UID: \"c3805a53-5f0f-4b3a-9fe5-7fd1749d27bf\") " pod="openshift-must-gather-sfrrm/perf-node-gather-daemonset-nhlv8" Jun 03 20:01:43.829339 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:43.829142 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c3805a53-5f0f-4b3a-9fe5-7fd1749d27bf-podres\") pod \"perf-node-gather-daemonset-nhlv8\" (UID: \"c3805a53-5f0f-4b3a-9fe5-7fd1749d27bf\") " pod="openshift-must-gather-sfrrm/perf-node-gather-daemonset-nhlv8" Jun 03 20:01:43.829339 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:43.829160 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c3805a53-5f0f-4b3a-9fe5-7fd1749d27bf-sys\") pod \"perf-node-gather-daemonset-nhlv8\" (UID: \"c3805a53-5f0f-4b3a-9fe5-7fd1749d27bf\") " pod="openshift-must-gather-sfrrm/perf-node-gather-daemonset-nhlv8" Jun 03 20:01:43.930477 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:43.930433 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c3805a53-5f0f-4b3a-9fe5-7fd1749d27bf-sys\") pod \"perf-node-gather-daemonset-nhlv8\" (UID: \"c3805a53-5f0f-4b3a-9fe5-7fd1749d27bf\") " pod="openshift-must-gather-sfrrm/perf-node-gather-daemonset-nhlv8" Jun 03 20:01:43.930672 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:43.930554 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c3805a53-5f0f-4b3a-9fe5-7fd1749d27bf-proc\") pod \"perf-node-gather-daemonset-nhlv8\" (UID: \"c3805a53-5f0f-4b3a-9fe5-7fd1749d27bf\") " pod="openshift-must-gather-sfrrm/perf-node-gather-daemonset-nhlv8" Jun 03 20:01:43.930672 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:43.930578 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c3805a53-5f0f-4b3a-9fe5-7fd1749d27bf-sys\") pod \"perf-node-gather-daemonset-nhlv8\" (UID: \"c3805a53-5f0f-4b3a-9fe5-7fd1749d27bf\") " pod="openshift-must-gather-sfrrm/perf-node-gather-daemonset-nhlv8" Jun 03 20:01:43.930672 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:43.930580 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c3805a53-5f0f-4b3a-9fe5-7fd1749d27bf-lib-modules\") pod \"perf-node-gather-daemonset-nhlv8\" (UID: \"c3805a53-5f0f-4b3a-9fe5-7fd1749d27bf\") " pod="openshift-must-gather-sfrrm/perf-node-gather-daemonset-nhlv8" Jun 03 20:01:43.930809 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:43.930669 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c3805a53-5f0f-4b3a-9fe5-7fd1749d27bf-proc\") pod \"perf-node-gather-daemonset-nhlv8\" (UID: \"c3805a53-5f0f-4b3a-9fe5-7fd1749d27bf\") " pod="openshift-must-gather-sfrrm/perf-node-gather-daemonset-nhlv8" Jun 03 20:01:43.930809 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:43.930684 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54fvd\" (UniqueName: \"kubernetes.io/projected/c3805a53-5f0f-4b3a-9fe5-7fd1749d27bf-kube-api-access-54fvd\") pod \"perf-node-gather-daemonset-nhlv8\" (UID: \"c3805a53-5f0f-4b3a-9fe5-7fd1749d27bf\") " pod="openshift-must-gather-sfrrm/perf-node-gather-daemonset-nhlv8" Jun 03 20:01:43.930809 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:43.930706 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c3805a53-5f0f-4b3a-9fe5-7fd1749d27bf-lib-modules\") pod \"perf-node-gather-daemonset-nhlv8\" (UID: \"c3805a53-5f0f-4b3a-9fe5-7fd1749d27bf\") " pod="openshift-must-gather-sfrrm/perf-node-gather-daemonset-nhlv8" Jun 03 20:01:43.930809 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:43.930721 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c3805a53-5f0f-4b3a-9fe5-7fd1749d27bf-podres\") pod \"perf-node-gather-daemonset-nhlv8\" (UID: \"c3805a53-5f0f-4b3a-9fe5-7fd1749d27bf\") " pod="openshift-must-gather-sfrrm/perf-node-gather-daemonset-nhlv8" Jun 03 20:01:43.930930 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:43.930834 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c3805a53-5f0f-4b3a-9fe5-7fd1749d27bf-podres\") pod \"perf-node-gather-daemonset-nhlv8\" (UID: \"c3805a53-5f0f-4b3a-9fe5-7fd1749d27bf\") " pod="openshift-must-gather-sfrrm/perf-node-gather-daemonset-nhlv8" Jun 03 20:01:43.943403 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:43.943375 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-54fvd\" (UniqueName: \"kubernetes.io/projected/c3805a53-5f0f-4b3a-9fe5-7fd1749d27bf-kube-api-access-54fvd\") pod \"perf-node-gather-daemonset-nhlv8\" (UID: \"c3805a53-5f0f-4b3a-9fe5-7fd1749d27bf\") " pod="openshift-must-gather-sfrrm/perf-node-gather-daemonset-nhlv8" Jun 03 20:01:44.101744 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:44.101652 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sfrrm/perf-node-gather-daemonset-nhlv8" Jun 03 20:01:44.249905 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:44.249873 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sfrrm/perf-node-gather-daemonset-nhlv8"] Jun 03 20:01:44.251936 ip-10-0-138-80 kubenswrapper[2579]: W0603 20:01:44.251905 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc3805a53_5f0f_4b3a_9fe5_7fd1749d27bf.slice/crio-0ba5b77a60a419d5b30357e607212e6582ac38354f66d2bb15ffb7b5007bbbb4 WatchSource:0}: Error finding container 0ba5b77a60a419d5b30357e607212e6582ac38354f66d2bb15ffb7b5007bbbb4: Status 404 returned error can't find the container with id 0ba5b77a60a419d5b30357e607212e6582ac38354f66d2bb15ffb7b5007bbbb4 Jun 03 20:01:44.516457 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:44.516427 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9cjkr_7d9d6412-0723-4a6d-be56-80ced04b7f8b/dns/0.log" Jun 03 20:01:44.537761 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:44.537731 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9cjkr_7d9d6412-0723-4a6d-be56-80ced04b7f8b/kube-rbac-proxy/0.log" Jun 03 20:01:44.652209 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:44.652178 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wq5fc_19ae3107-ba44-4cb7-9dad-e125e64323fa/dns-node-resolver/0.log" Jun 03 20:01:45.128350 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:45.128244 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sfrrm/perf-node-gather-daemonset-nhlv8" event={"ID":"c3805a53-5f0f-4b3a-9fe5-7fd1749d27bf","Type":"ContainerStarted","Data":"4592ce4798ba5839a57de0a975172bfa719cc18e474099775ebe82d8591ff7c7"} Jun 03 20:01:45.128350 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:45.128321 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sfrrm/perf-node-gather-daemonset-nhlv8" event={"ID":"c3805a53-5f0f-4b3a-9fe5-7fd1749d27bf","Type":"ContainerStarted","Data":"0ba5b77a60a419d5b30357e607212e6582ac38354f66d2bb15ffb7b5007bbbb4"} Jun 03 20:01:45.128350 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:45.128351 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-sfrrm/perf-node-gather-daemonset-nhlv8" Jun 03 20:01:45.145747 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:45.145698 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-sfrrm/perf-node-gather-daemonset-nhlv8" podStartSLOduration=2.145682372 podStartE2EDuration="2.145682372s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 20:01:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:01:45.14522528 +0000 UTC m=+2451.990884695" watchObservedRunningTime="2026-06-03 20:01:45.145682372 +0000 UTC m=+2451.991341787" Jun 03 20:01:45.207761 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:45.207731 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5894578676-qzb6c_40e0a014-fe06-4a46-a304-d4a13e716958/registry/0.log" Jun 03 20:01:45.233413 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:45.233384 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5czvc_ce05c923-acba-430c-bcc1-576e5f7d1f33/node-ca/0.log" Jun 03 20:01:46.345679 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:46.345650 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-mnw87_0430d7f8-5504-46dd-9d47-c5727b00bf37/discovery/0.log" Jun 03 20:01:46.373694 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:46.373673 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-d68c4fc59-tprs2_65d4d626-909d-4e1d-8ea2-6d1e31bbb547/kube-auth-proxy/0.log" Jun 03 20:01:46.480116 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:46.480089 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-bxhbd_aa857b5b-adc4-44d0-9adf-20c16b9bff56/istio-proxy/0.log" Jun 03 20:01:46.517871 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:46.517822 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-bxhbd_aa857b5b-adc4-44d0-9adf-20c16b9bff56/istio-proxy/1.log" Jun 03 20:01:46.583417 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:46.583384 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-gmx9m_b04205af-a027-4800-a8d6-7c8dfef7c76c/payload-processing/0.log" Jun 03 20:01:47.362054 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:47.362022 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rr2p9_cdc85565-9aff-4423-85d6-9ec91df3e28b/serve-healthcheck-canary/0.log" Jun 03 20:01:48.053949 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:48.053922 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wf2cp_2c95cea0-9fb2-40ad-aeb3-004a9c0927eb/kube-rbac-proxy/0.log" Jun 03 20:01:48.079641 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:48.079615 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wf2cp_2c95cea0-9fb2-40ad-aeb3-004a9c0927eb/exporter/0.log" Jun 03 20:01:48.102455 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:48.102423 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wf2cp_2c95cea0-9fb2-40ad-aeb3-004a9c0927eb/extractor/0.log" Jun 03 20:01:50.463702 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:50.463677 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-8b9ffc7d9-sfb4s_000ee25d-2c22-4291-99b2-2f4399305d38/nginx/0.log" Jun 03 20:01:50.494069 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:50.494046 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-4j2r9_28167aeb-e4ac-4c15-829f-10e5914d5c6a/manager/0.log" Jun 03 20:01:50.565699 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:50.565671 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-pn9sz_752b47cd-19d4-4c7a-b3a3-fe503df57b14/manager/0.log" Jun 03 20:01:50.630925 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:50.630890 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29675265-wq84w_de540b94-1104-40d5-8765-821e455db9de/cleanup/0.log" Jun 03 20:01:50.657587 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:50.657545 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29675280-8lzws_8128adf9-0207-494b-8b8b-629f03458b00/cleanup/0.log" Jun 03 20:01:50.768872 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:50.768788 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-46zv5_f8e27063-851d-4ba7-ae7c-bee10b560730/server/0.log" Jun 03 20:01:50.816922 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:50.816898 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-256dp_9b7ae0eb-5ac9-4a2d-bc25-c5985ab31dd9/manager/0.log" Jun 03 20:01:50.964735 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:50.964699 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d56d45df5-rsjk6_34166712-240f-4e83-a73d-2aad2e475ce6/manager/0.log" Jun 03 20:01:50.982115 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:50.982093 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d56d45df5-rsjk6_34166712-240f-4e83-a73d-2aad2e475ce6/copy-manifests/0.log" Jun 03 20:01:51.053451 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:51.053381 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-hh7mj_7488f9c0-6108-4a14-a4bf-5046ce749148/postgres/0.log" Jun 03 20:01:51.144232 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:51.144206 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-sfrrm/perf-node-gather-daemonset-nhlv8" Jun 03 20:01:56.184835 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:56.184804 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-mnw87_0430d7f8-5504-46dd-9d47-c5727b00bf37/discovery/0.log" Jun 03 20:01:56.200418 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:56.200390 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-d68c4fc59-tprs2_65d4d626-909d-4e1d-8ea2-6d1e31bbb547/kube-auth-proxy/0.log" Jun 03 20:01:56.240726 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:56.240695 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-bxhbd_aa857b5b-adc4-44d0-9adf-20c16b9bff56/istio-proxy/0.log" Jun 03 20:01:56.272154 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:56.272120 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-bxhbd_aa857b5b-adc4-44d0-9adf-20c16b9bff56/istio-proxy/1.log" Jun 03 20:01:56.322606 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:56.322580 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-gmx9m_b04205af-a027-4800-a8d6-7c8dfef7c76c/payload-processing/0.log" Jun 03 20:01:57.624969 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:57.624939 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-mnw87_0430d7f8-5504-46dd-9d47-c5727b00bf37/discovery/0.log" Jun 03 20:01:57.635436 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:57.635405 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-d68c4fc59-tprs2_65d4d626-909d-4e1d-8ea2-6d1e31bbb547/kube-auth-proxy/0.log" Jun 03 20:01:57.678876 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:57.678818 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-bxhbd_aa857b5b-adc4-44d0-9adf-20c16b9bff56/istio-proxy/0.log" Jun 03 20:01:57.711662 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:57.711634 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-bxhbd_aa857b5b-adc4-44d0-9adf-20c16b9bff56/istio-proxy/1.log" Jun 03 20:01:57.765471 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:57.765445 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-gmx9m_b04205af-a027-4800-a8d6-7c8dfef7c76c/payload-processing/0.log" Jun 03 20:01:59.487246 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:59.487196 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-mnw87_0430d7f8-5504-46dd-9d47-c5727b00bf37/discovery/0.log" Jun 03 20:01:59.499358 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:59.499337 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-d68c4fc59-tprs2_65d4d626-909d-4e1d-8ea2-6d1e31bbb547/kube-auth-proxy/0.log" Jun 03 20:01:59.539950 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:59.539934 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-bxhbd_aa857b5b-adc4-44d0-9adf-20c16b9bff56/istio-proxy/0.log" Jun 03 20:01:59.579532 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:59.579498 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-bxhbd_aa857b5b-adc4-44d0-9adf-20c16b9bff56/istio-proxy/1.log" Jun 03 20:01:59.628928 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:01:59.628899 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-gmx9m_b04205af-a027-4800-a8d6-7c8dfef7c76c/payload-processing/0.log" Jun 03 20:02:00.558496 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:02:00.558464 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kjcwb_b79abc02-ece3-4eaf-b4d8-e131f6e71f60/kube-multus-additional-cni-plugins/0.log" Jun 03 20:02:00.583802 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:02:00.583777 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kjcwb_b79abc02-ece3-4eaf-b4d8-e131f6e71f60/egress-router-binary-copy/0.log" Jun 03 20:02:00.606335 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:02:00.606311 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kjcwb_b79abc02-ece3-4eaf-b4d8-e131f6e71f60/cni-plugins/0.log" Jun 03 20:02:00.628376 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:02:00.628357 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kjcwb_b79abc02-ece3-4eaf-b4d8-e131f6e71f60/bond-cni-plugin/0.log" Jun 03 20:02:00.650971 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:02:00.650955 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kjcwb_b79abc02-ece3-4eaf-b4d8-e131f6e71f60/routeoverride-cni/0.log" Jun 03 20:02:00.673626 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:02:00.673601 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kjcwb_b79abc02-ece3-4eaf-b4d8-e131f6e71f60/whereabouts-cni-bincopy/0.log" Jun 03 20:02:00.696263 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:02:00.696244 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kjcwb_b79abc02-ece3-4eaf-b4d8-e131f6e71f60/whereabouts-cni/0.log" Jun 03 20:02:00.790540 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:02:00.790510 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-tlvhh_fd082ce0-248b-4e84-997c-cde24967cf01/kube-multus/0.log" Jun 03 20:02:00.924607 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:02:00.924570 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-xpvdz_e0ed8e87-e724-4880-a4e8-fe68533db02a/network-metrics-daemon/0.log" Jun 03 20:02:00.946834 ip-10-0-138-80 kubenswrapper[2579]: I0603 20:02:00.946808 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-xpvdz_e0ed8e87-e724-4880-a4e8-fe68533db02a/kube-rbac-proxy/0.log"