Jun 09 12:41:10.569111 ip-10-0-133-109 systemd[1]: Starting Kubernetes Kubelet... Jun 09 12:41:10.956661 ip-10-0-133-109 kubenswrapper[2561]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 12:41:10.956661 ip-10-0-133-109 kubenswrapper[2561]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 09 12:41:10.956661 ip-10-0-133-109 kubenswrapper[2561]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 12:41:10.956661 ip-10-0-133-109 kubenswrapper[2561]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 09 12:41:10.956661 ip-10-0-133-109 kubenswrapper[2561]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 12:41:10.958552 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.958467 2561 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 09 12:41:10.966994 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.966973 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 12:41:10.966994 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.966990 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 12:41:10.966994 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.966994 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 12:41:10.966994 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.966997 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 12:41:10.966994 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.967000 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 12:41:10.967184 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.967003 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 12:41:10.967184 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.967006 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 12:41:10.967184 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.967009 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 12:41:10.967184 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.967014 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 12:41:10.967184 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.967019 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 12:41:10.967184 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.967022 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 12:41:10.967184 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.967025 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 12:41:10.967184 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.967028 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 12:41:10.967184 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.967031 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 09 12:41:10.967184 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.967034 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 12:41:10.967184 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.967036 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 12:41:10.967184 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.967039 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 12:41:10.967184 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.967042 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 12:41:10.967184 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.967044 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 12:41:10.967184 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.967047 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 12:41:10.967184 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.967050 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 12:41:10.967184 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.967052 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 12:41:10.967184 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.967055 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 12:41:10.967184 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.967057 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 12:41:10.967627 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.967060 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 12:41:10.967627 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.967063 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 12:41:10.967627 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.967066 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 12:41:10.967627 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.967069 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 12:41:10.967627 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.967072 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 12:41:10.967627 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.967076 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 12:41:10.967627 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.967079 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 12:41:10.967627 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.967082 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 12:41:10.967627 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.967084 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 12:41:10.967627 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.967087 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 12:41:10.967627 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.967091 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 12:41:10.967627 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.967093 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 12:41:10.967627 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.967096 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 12:41:10.967627 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.967099 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 12:41:10.967627 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.967102 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 12:41:10.967627 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.967105 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 12:41:10.967627 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.967108 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 12:41:10.967627 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.967110 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 12:41:10.967627 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.967113 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 12:41:10.968144 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.967115 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 12:41:10.968144 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.967118 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 12:41:10.968144 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.967121 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 12:41:10.968144 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.967124 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 12:41:10.968144 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.967127 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 12:41:10.968144 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.967129 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 12:41:10.968144 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.967132 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 12:41:10.968144 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.967135 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 12:41:10.968144 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.967137 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 12:41:10.968144 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.967140 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 12:41:10.968144 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.967142 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 12:41:10.968144 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.967145 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 12:41:10.968144 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.967148 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 12:41:10.968144 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.967150 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 12:41:10.968144 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.967153 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 12:41:10.968144 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.967155 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 12:41:10.968144 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.967159 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 12:41:10.968144 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.967161 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 12:41:10.968144 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.967164 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 12:41:10.968144 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.967166 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 12:41:10.968631 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.967169 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 12:41:10.968631 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.967171 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 12:41:10.968631 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.967174 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 12:41:10.968631 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.967177 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 12:41:10.968631 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.967180 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 12:41:10.968631 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.967182 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 12:41:10.968631 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.967185 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 12:41:10.968631 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.967188 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 12:41:10.968631 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.967191 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 12:41:10.968631 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.967194 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 12:41:10.968631 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.967196 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 12:41:10.968631 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.967199 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 12:41:10.968631 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.967201 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 12:41:10.968631 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.967205 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 12:41:10.968631 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.967207 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 12:41:10.968631 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.967210 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 12:41:10.968631 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.967212 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 12:41:10.968631 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.967214 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 12:41:10.968631 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.967217 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 12:41:10.968631 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.967220 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 12:41:10.969135 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.967223 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 12:41:10.969135 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.967225 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 12:41:10.969135 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.967228 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 12:41:10.969135 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.967230 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 12:41:10.969135 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.967235 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 12:41:10.969135 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.967239 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 12:41:10.969135 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.967241 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 12:41:10.969135 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.967244 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 12:41:10.969135 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.967247 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 12:41:10.969135 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.967250 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 12:41:10.969135 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.967253 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 12:41:10.969135 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.967255 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 12:41:10.969135 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.967257 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 12:41:10.969135 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.967260 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 12:41:10.969135 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.967263 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 12:41:10.969135 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.967267 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 12:41:10.969135 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968021 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 12:41:10.969135 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968029 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 12:41:10.969135 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968034 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 12:41:10.969594 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968037 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 12:41:10.969594 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968041 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 12:41:10.969594 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968043 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 12:41:10.969594 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968047 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 12:41:10.969594 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968050 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 12:41:10.969594 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968053 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 12:41:10.969594 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968055 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 12:41:10.969594 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968058 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 12:41:10.969594 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968061 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 12:41:10.969594 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968063 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 12:41:10.969594 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968066 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 12:41:10.969594 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968069 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 12:41:10.969594 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968072 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 12:41:10.969594 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968074 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 12:41:10.969594 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968077 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 12:41:10.969594 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968081 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 12:41:10.969594 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968083 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 12:41:10.969594 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968085 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 12:41:10.969594 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968088 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 12:41:10.969594 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968091 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 12:41:10.970107 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968093 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 12:41:10.970107 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968095 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 12:41:10.970107 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968098 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 12:41:10.970107 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968100 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 12:41:10.970107 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968103 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 12:41:10.970107 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968105 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 12:41:10.970107 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968108 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 12:41:10.970107 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968110 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 12:41:10.970107 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968113 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 12:41:10.970107 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968116 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 12:41:10.970107 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968118 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 12:41:10.970107 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968121 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 12:41:10.970107 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968124 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 12:41:10.970107 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968126 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 12:41:10.970107 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968129 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 12:41:10.970107 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968131 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 12:41:10.970107 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968134 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 12:41:10.970107 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968136 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 12:41:10.970107 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968141 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 12:41:10.970107 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968144 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 12:41:10.970610 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968147 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 12:41:10.970610 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968150 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 12:41:10.970610 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968153 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 12:41:10.970610 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968156 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 12:41:10.970610 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968159 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 12:41:10.970610 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968162 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 12:41:10.970610 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968164 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 12:41:10.970610 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968167 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 12:41:10.970610 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968170 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 12:41:10.970610 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968173 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 12:41:10.970610 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968175 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 12:41:10.970610 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968178 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 12:41:10.970610 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968180 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 12:41:10.970610 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968183 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 12:41:10.970610 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968186 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 12:41:10.970610 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968188 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 12:41:10.970610 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968191 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 12:41:10.970610 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968193 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 12:41:10.970610 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968196 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 12:41:10.970610 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968199 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 12:41:10.971145 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968201 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 12:41:10.971145 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968204 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 12:41:10.971145 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968207 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 12:41:10.971145 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968210 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 12:41:10.971145 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968213 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 12:41:10.971145 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968216 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 12:41:10.971145 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968218 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 12:41:10.971145 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968221 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 12:41:10.971145 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968224 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 12:41:10.971145 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968226 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 12:41:10.971145 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968229 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 12:41:10.971145 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968232 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 12:41:10.971145 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968235 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 12:41:10.971145 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968237 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 12:41:10.971145 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968240 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 12:41:10.971145 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968242 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 12:41:10.971145 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968245 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 12:41:10.971145 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968247 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 12:41:10.971145 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968250 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 12:41:10.971617 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968252 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 12:41:10.971617 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968257 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 12:41:10.971617 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968261 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 12:41:10.971617 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968265 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 12:41:10.971617 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968269 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 12:41:10.971617 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968272 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 09 12:41:10.971617 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968275 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 12:41:10.971617 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968278 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 12:41:10.971617 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968281 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 12:41:10.971617 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968283 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 12:41:10.971617 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968286 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 12:41:10.971617 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968289 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 12:41:10.971617 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968291 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 12:41:10.971617 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968294 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 12:41:10.971617 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968297 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 12:41:10.971617 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968300 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 12:41:10.971617 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968303 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 12:41:10.971617 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968732 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 12:41:10.971617 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968738 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 12:41:10.972100 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968741 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 12:41:10.972100 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968744 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 12:41:10.972100 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968747 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 12:41:10.972100 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968749 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 12:41:10.972100 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968752 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 12:41:10.972100 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968755 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 12:41:10.972100 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968757 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 12:41:10.972100 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968760 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 12:41:10.972100 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968762 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 12:41:10.972100 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968765 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 09 12:41:10.972100 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968767 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 12:41:10.972100 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968770 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 12:41:10.972100 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968772 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 12:41:10.972100 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968775 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 12:41:10.972100 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968778 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 12:41:10.972100 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968781 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 12:41:10.972100 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968783 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 12:41:10.972100 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968786 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 12:41:10.972100 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968788 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 12:41:10.972100 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968791 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 12:41:10.972591 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968793 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 12:41:10.972591 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968796 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 12:41:10.972591 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968799 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 12:41:10.972591 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968801 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 12:41:10.972591 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968803 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 12:41:10.972591 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968808 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 12:41:10.972591 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968811 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 12:41:10.972591 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968831 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 12:41:10.972591 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968834 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 12:41:10.972591 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968837 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 12:41:10.972591 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968840 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 12:41:10.972591 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968843 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 12:41:10.972591 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968845 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 12:41:10.972591 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968848 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 12:41:10.972591 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968851 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 12:41:10.972591 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968853 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 12:41:10.972591 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968856 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 12:41:10.972591 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968859 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 12:41:10.972591 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968861 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 12:41:10.972591 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968864 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 12:41:10.973111 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968866 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 12:41:10.973111 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968869 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 12:41:10.973111 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968871 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 12:41:10.973111 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968874 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 12:41:10.973111 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968877 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 12:41:10.973111 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968879 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 12:41:10.973111 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968882 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 12:41:10.973111 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968886 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 12:41:10.973111 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968888 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 12:41:10.973111 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968891 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 12:41:10.973111 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968895 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 12:41:10.973111 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968898 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 12:41:10.973111 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968901 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 12:41:10.973111 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968904 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 12:41:10.973111 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968906 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 12:41:10.973111 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968909 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 12:41:10.973111 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968912 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 12:41:10.973111 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968916 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 12:41:10.973111 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968919 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 12:41:10.973587 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968922 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 12:41:10.973587 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968925 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 12:41:10.973587 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968928 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 12:41:10.973587 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968931 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 12:41:10.973587 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968933 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 12:41:10.973587 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968936 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 12:41:10.973587 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968938 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 12:41:10.973587 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968941 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 12:41:10.973587 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968943 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 12:41:10.973587 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968946 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 12:41:10.973587 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968948 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 12:41:10.973587 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968951 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 12:41:10.973587 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968959 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 12:41:10.973587 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968962 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 12:41:10.973587 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968965 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 12:41:10.973587 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968967 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 12:41:10.973587 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968970 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 12:41:10.973587 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968972 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 12:41:10.973587 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968975 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 12:41:10.973587 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968978 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 12:41:10.974131 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968981 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 12:41:10.974131 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968984 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 12:41:10.974131 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968987 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 12:41:10.974131 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968990 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 12:41:10.974131 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968993 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 12:41:10.974131 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968996 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 12:41:10.974131 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.968998 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 12:41:10.974131 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.969001 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 12:41:10.974131 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.969003 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 12:41:10.974131 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.969008 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 12:41:10.974131 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.969013 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 12:41:10.974131 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.969016 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 12:41:10.974131 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.969019 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 12:41:10.974131 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.969025 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 12:41:10.974131 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.969028 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 12:41:10.974131 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.969030 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 12:41:10.974131 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.969033 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 12:41:10.974131 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.969036 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 12:41:10.974131 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969114 2561 flags.go:64] FLAG: --address="0.0.0.0" Jun 09 12:41:10.974131 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969124 2561 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 09 12:41:10.974622 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969135 2561 flags.go:64] FLAG: --anonymous-auth="true" Jun 09 12:41:10.974622 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969141 2561 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 09 12:41:10.974622 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969147 2561 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 09 12:41:10.974622 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969152 2561 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 09 12:41:10.974622 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969158 2561 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 09 12:41:10.974622 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969162 2561 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 09 12:41:10.974622 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969165 2561 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 09 12:41:10.974622 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969168 2561 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 09 12:41:10.974622 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969171 2561 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 09 12:41:10.974622 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969175 2561 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 09 12:41:10.974622 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969178 2561 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 09 12:41:10.974622 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969181 2561 flags.go:64] FLAG: --cgroup-root="" Jun 09 12:41:10.974622 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969183 2561 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 09 12:41:10.974622 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969186 2561 flags.go:64] FLAG: --client-ca-file="" Jun 09 12:41:10.974622 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969190 2561 flags.go:64] FLAG: --cloud-provider="external" Jun 09 12:41:10.974622 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969193 2561 flags.go:64] FLAG: --cluster-dns="[]" Jun 09 12:41:10.974622 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969197 2561 flags.go:64] FLAG: --cluster-domain="" Jun 09 12:41:10.974622 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969200 2561 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 09 12:41:10.974622 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969203 2561 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 09 12:41:10.974622 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969206 2561 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 09 12:41:10.974622 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969209 2561 flags.go:64] FLAG: --container-log-max-files="5" Jun 09 12:41:10.974622 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969213 2561 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 09 12:41:10.974622 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969218 2561 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 09 12:41:10.975189 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969221 2561 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 09 12:41:10.975189 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969224 2561 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 09 12:41:10.975189 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969228 2561 flags.go:64] FLAG: --contention-profiling="false" Jun 09 12:41:10.975189 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969232 2561 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 09 12:41:10.975189 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969235 2561 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 09 12:41:10.975189 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969238 2561 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 09 12:41:10.975189 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969241 2561 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 09 12:41:10.975189 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969245 2561 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 09 12:41:10.975189 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969248 2561 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 09 12:41:10.975189 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969251 2561 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 09 12:41:10.975189 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969253 2561 flags.go:64] FLAG: --enable-load-reader="false" Jun 09 12:41:10.975189 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969256 2561 flags.go:64] FLAG: --enable-server="true" Jun 09 12:41:10.975189 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969259 2561 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 09 12:41:10.975189 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969264 2561 flags.go:64] FLAG: --event-burst="100" Jun 09 12:41:10.975189 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969267 2561 flags.go:64] FLAG: --event-qps="50" Jun 09 12:41:10.975189 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969270 2561 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 09 12:41:10.975189 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969273 2561 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 09 12:41:10.975189 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969276 2561 flags.go:64] FLAG: --eviction-hard="" Jun 09 12:41:10.975189 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969280 2561 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 09 12:41:10.975189 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969283 2561 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 09 12:41:10.975189 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969286 2561 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 09 12:41:10.975189 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969289 2561 flags.go:64] FLAG: --eviction-soft="" Jun 09 12:41:10.975189 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969291 2561 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 09 12:41:10.975189 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969294 2561 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 09 12:41:10.975189 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969298 2561 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 09 12:41:10.975877 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969300 2561 flags.go:64] FLAG: --experimental-mounter-path="" Jun 09 12:41:10.975877 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969303 2561 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 09 12:41:10.975877 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969306 2561 flags.go:64] FLAG: --fail-swap-on="true" Jun 09 12:41:10.975877 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969309 2561 flags.go:64] FLAG: --feature-gates="" Jun 09 12:41:10.975877 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969312 2561 flags.go:64] FLAG: --file-check-frequency="20s" Jun 09 12:41:10.975877 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969315 2561 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 09 12:41:10.975877 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969320 2561 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 09 12:41:10.975877 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969323 2561 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 09 12:41:10.975877 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969326 2561 flags.go:64] FLAG: --healthz-port="10248" Jun 09 12:41:10.975877 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969330 2561 flags.go:64] FLAG: --help="false" Jun 09 12:41:10.975877 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969333 2561 flags.go:64] FLAG: --hostname-override="ip-10-0-133-109.ec2.internal" Jun 09 12:41:10.975877 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969336 2561 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 09 12:41:10.975877 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969338 2561 flags.go:64] FLAG: --http-check-frequency="20s" Jun 09 12:41:10.975877 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969341 2561 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 09 12:41:10.975877 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969344 2561 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 09 12:41:10.975877 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969357 2561 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 09 12:41:10.975877 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969360 2561 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 09 12:41:10.975877 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969363 2561 flags.go:64] FLAG: --image-service-endpoint="" Jun 09 12:41:10.975877 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969366 2561 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 09 12:41:10.975877 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969369 2561 flags.go:64] FLAG: --kube-api-burst="100" Jun 09 12:41:10.975877 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969372 2561 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 09 12:41:10.975877 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969375 2561 flags.go:64] FLAG: --kube-api-qps="50" Jun 09 12:41:10.975877 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969378 2561 flags.go:64] FLAG: --kube-reserved="" Jun 09 12:41:10.975877 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969381 2561 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 09 12:41:10.976473 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969384 2561 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 09 12:41:10.976473 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969387 2561 flags.go:64] FLAG: --kubelet-cgroups="" Jun 09 12:41:10.976473 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969390 2561 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 09 12:41:10.976473 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969393 2561 flags.go:64] FLAG: --lock-file="" Jun 09 12:41:10.976473 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969396 2561 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 09 12:41:10.976473 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969399 2561 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 09 12:41:10.976473 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969402 2561 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 09 12:41:10.976473 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969407 2561 flags.go:64] FLAG: --log-json-split-stream="false" Jun 09 12:41:10.976473 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969411 2561 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 09 12:41:10.976473 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969413 2561 flags.go:64] FLAG: --log-text-split-stream="false" Jun 09 12:41:10.976473 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969416 2561 flags.go:64] FLAG: --logging-format="text" Jun 09 12:41:10.976473 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969419 2561 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 09 12:41:10.976473 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969422 2561 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 09 12:41:10.976473 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969425 2561 flags.go:64] FLAG: --manifest-url="" Jun 09 12:41:10.976473 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969429 2561 flags.go:64] FLAG: --manifest-url-header="" Jun 09 12:41:10.976473 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969433 2561 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 09 12:41:10.976473 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969437 2561 flags.go:64] FLAG: --max-open-files="1000000" Jun 09 12:41:10.976473 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969442 2561 flags.go:64] FLAG: --max-pods="110" Jun 09 12:41:10.976473 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969445 2561 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 09 12:41:10.976473 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969448 2561 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 09 12:41:10.976473 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969451 2561 flags.go:64] FLAG: --memory-manager-policy="None" Jun 09 12:41:10.976473 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969454 2561 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 09 12:41:10.976473 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969457 2561 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 09 12:41:10.976473 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969460 2561 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 09 12:41:10.976473 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969462 2561 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 09 12:41:10.977119 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969469 2561 flags.go:64] FLAG: --node-status-max-images="50" Jun 09 12:41:10.977119 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969472 2561 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 09 12:41:10.977119 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969475 2561 flags.go:64] FLAG: --oom-score-adj="-999" Jun 09 12:41:10.977119 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969478 2561 flags.go:64] FLAG: --pod-cidr="" Jun 09 12:41:10.977119 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969481 2561 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 09 12:41:10.977119 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969486 2561 flags.go:64] FLAG: --pod-manifest-path="" Jun 09 12:41:10.977119 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969489 2561 flags.go:64] FLAG: --pod-max-pids="-1" Jun 09 12:41:10.977119 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969492 2561 flags.go:64] FLAG: --pods-per-core="0" Jun 09 12:41:10.977119 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969495 2561 flags.go:64] FLAG: --port="10250" Jun 09 12:41:10.977119 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969498 2561 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 09 12:41:10.977119 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969501 2561 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-084e0c7f29a8ef2c3" Jun 09 12:41:10.977119 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969504 2561 flags.go:64] FLAG: --qos-reserved="" Jun 09 12:41:10.977119 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969506 2561 flags.go:64] FLAG: --read-only-port="10255" Jun 09 12:41:10.977119 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969509 2561 flags.go:64] FLAG: --register-node="true" Jun 09 12:41:10.977119 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969513 2561 flags.go:64] FLAG: --register-with-taints="" Jun 09 12:41:10.977119 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969516 2561 flags.go:64] FLAG: --registry-burst="10" Jun 09 12:41:10.977119 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969519 2561 flags.go:64] FLAG: --registry-qps="5" Jun 09 12:41:10.977119 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969522 2561 flags.go:64] FLAG: --reserved-cpus="" Jun 09 12:41:10.977119 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969525 2561 flags.go:64] FLAG: --reserved-memory="" Jun 09 12:41:10.977119 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969529 2561 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 09 12:41:10.977119 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969532 2561 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 09 12:41:10.977119 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969535 2561 flags.go:64] FLAG: --rotate-certificates="false" Jun 09 12:41:10.977119 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969539 2561 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 09 12:41:10.977119 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969542 2561 flags.go:64] FLAG: --runonce="false" Jun 09 12:41:10.977119 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969546 2561 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 09 12:41:10.977761 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969549 2561 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 09 12:41:10.977761 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969552 2561 flags.go:64] FLAG: --seccomp-default="false" Jun 09 12:41:10.977761 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969555 2561 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 09 12:41:10.977761 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969558 2561 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 09 12:41:10.977761 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969561 2561 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 09 12:41:10.977761 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969564 2561 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 09 12:41:10.977761 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969567 2561 flags.go:64] FLAG: --storage-driver-password="root" Jun 09 12:41:10.977761 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969570 2561 flags.go:64] FLAG: --storage-driver-secure="false" Jun 09 12:41:10.977761 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969573 2561 flags.go:64] FLAG: --storage-driver-table="stats" Jun 09 12:41:10.977761 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969576 2561 flags.go:64] FLAG: --storage-driver-user="root" Jun 09 12:41:10.977761 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969579 2561 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 09 12:41:10.977761 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969582 2561 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 09 12:41:10.977761 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969584 2561 flags.go:64] FLAG: --system-cgroups="" Jun 09 12:41:10.977761 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969587 2561 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 09 12:41:10.977761 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969592 2561 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 09 12:41:10.977761 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969595 2561 flags.go:64] FLAG: --tls-cert-file="" Jun 09 12:41:10.977761 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969598 2561 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 09 12:41:10.977761 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969602 2561 flags.go:64] FLAG: --tls-min-version="" Jun 09 12:41:10.977761 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969605 2561 flags.go:64] FLAG: --tls-private-key-file="" Jun 09 12:41:10.977761 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969608 2561 flags.go:64] FLAG: --topology-manager-policy="none" Jun 09 12:41:10.977761 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969611 2561 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 09 12:41:10.977761 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969613 2561 flags.go:64] FLAG: --topology-manager-scope="container" Jun 09 12:41:10.977761 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969616 2561 flags.go:64] FLAG: --v="2" Jun 09 12:41:10.977761 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969620 2561 flags.go:64] FLAG: --version="false" Jun 09 12:41:10.977761 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969625 2561 flags.go:64] FLAG: --vmodule="" Jun 09 12:41:10.978397 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969629 2561 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 09 12:41:10.978397 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.969632 2561 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 09 12:41:10.978397 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.969754 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 12:41:10.978397 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.969758 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 12:41:10.978397 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.969763 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 12:41:10.978397 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.969766 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 12:41:10.978397 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.969771 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 12:41:10.978397 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.969773 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 12:41:10.978397 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.969776 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 12:41:10.978397 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.969779 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 12:41:10.978397 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.969782 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 12:41:10.978397 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.969785 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 12:41:10.978397 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.969788 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 12:41:10.978397 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.969790 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 12:41:10.978397 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.969793 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 12:41:10.978397 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.969795 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 12:41:10.978397 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.969798 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 12:41:10.978397 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.969801 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 12:41:10.978397 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.969804 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 12:41:10.978397 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.969806 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 12:41:10.978999 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.969809 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 12:41:10.978999 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.969823 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 12:41:10.978999 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.969827 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 12:41:10.978999 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.969829 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 12:41:10.978999 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.969832 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 12:41:10.978999 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.969834 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 12:41:10.978999 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.969837 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 12:41:10.978999 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.969840 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 12:41:10.978999 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.969842 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 12:41:10.978999 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.969845 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 12:41:10.978999 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.969848 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 12:41:10.978999 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.969851 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 12:41:10.978999 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.969857 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 12:41:10.978999 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.969859 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 12:41:10.978999 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.969862 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 12:41:10.978999 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.969865 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 12:41:10.978999 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.969869 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 12:41:10.978999 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.969872 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 12:41:10.978999 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.969876 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 12:41:10.978999 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.969879 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 12:41:10.979476 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.969881 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 12:41:10.979476 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.969884 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 12:41:10.979476 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.969887 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 12:41:10.979476 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.969889 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 12:41:10.979476 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.969892 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 12:41:10.979476 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.969895 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 12:41:10.979476 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.969899 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 12:41:10.979476 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.969903 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 12:41:10.979476 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.969906 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 12:41:10.979476 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.969909 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 12:41:10.979476 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.969912 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 12:41:10.979476 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.969915 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 12:41:10.979476 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.969918 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 12:41:10.979476 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.969920 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 12:41:10.979476 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.969923 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 12:41:10.979476 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.969925 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 12:41:10.979476 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.969928 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 12:41:10.979476 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.969930 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 12:41:10.979476 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.969933 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 12:41:10.979983 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.969936 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 12:41:10.979983 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.969938 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 12:41:10.979983 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.969941 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 12:41:10.979983 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.969944 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 12:41:10.979983 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.969946 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 12:41:10.979983 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.969949 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 12:41:10.979983 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.969952 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 12:41:10.979983 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.969955 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 12:41:10.979983 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.969957 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 12:41:10.979983 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.969961 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 12:41:10.979983 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.969964 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 12:41:10.979983 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.969968 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 12:41:10.979983 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.969971 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 12:41:10.979983 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.969974 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 12:41:10.979983 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.969977 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 12:41:10.979983 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.969979 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 12:41:10.979983 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.969982 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 12:41:10.979983 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.969985 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 12:41:10.979983 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.969987 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 12:41:10.980481 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.969990 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 12:41:10.980481 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.969992 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 12:41:10.980481 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.969995 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 12:41:10.980481 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.969998 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 12:41:10.980481 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.970000 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 12:41:10.980481 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.970003 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 09 12:41:10.980481 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.970005 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 12:41:10.980481 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.970009 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 12:41:10.980481 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.970013 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 12:41:10.980481 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.970015 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 12:41:10.980481 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.970018 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 12:41:10.980481 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.970021 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 12:41:10.980481 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.970024 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 12:41:10.980481 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.970027 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 12:41:10.980481 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.970030 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 12:41:10.980481 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.970032 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 12:41:10.980481 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.970035 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 12:41:10.980481 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.970038 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 12:41:10.980481 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.970040 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 12:41:10.980481 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.970043 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 12:41:10.980998 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.970047 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 12:41:10.980998 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.970051 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 12:41:10.980998 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.970055 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 12:41:10.980998 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.970061 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 12:41:10.980998 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.976924 2561 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 09 12:41:10.980998 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.976941 2561 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 09 12:41:10.980998 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.976961 2561 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 09 12:41:10.980998 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.976970 2561 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 09 12:41:10.980998 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977022 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 12:41:10.980998 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977027 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 12:41:10.980998 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977031 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 12:41:10.980998 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977034 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 12:41:10.980998 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977037 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 12:41:10.980998 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977040 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 12:41:10.981389 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977043 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 12:41:10.981389 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977046 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 12:41:10.981389 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977049 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 12:41:10.981389 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977052 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 12:41:10.981389 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977055 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 12:41:10.981389 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977058 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 12:41:10.981389 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977061 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 09 12:41:10.981389 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977064 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 12:41:10.981389 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977066 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 12:41:10.981389 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977069 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 12:41:10.981389 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977072 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 12:41:10.981389 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977075 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 12:41:10.981389 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977077 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 12:41:10.981389 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977080 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 12:41:10.981389 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977082 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 12:41:10.981389 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977085 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 12:41:10.981389 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977088 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 12:41:10.981389 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977090 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 12:41:10.981389 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977093 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 12:41:10.981389 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977096 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 12:41:10.981890 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977098 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 12:41:10.981890 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977101 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 12:41:10.981890 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977104 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 12:41:10.981890 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977108 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 12:41:10.981890 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977111 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 12:41:10.981890 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977116 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 12:41:10.981890 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977120 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 12:41:10.981890 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977124 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 12:41:10.981890 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977128 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 12:41:10.981890 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977131 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 12:41:10.981890 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977135 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 12:41:10.981890 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977138 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 12:41:10.981890 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977140 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 12:41:10.981890 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977143 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 12:41:10.981890 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977146 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 12:41:10.981890 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977149 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 12:41:10.981890 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977151 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 12:41:10.981890 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977154 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 12:41:10.981890 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977157 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 12:41:10.982391 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977159 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 12:41:10.982391 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977162 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 12:41:10.982391 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977165 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 12:41:10.982391 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977168 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 12:41:10.982391 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977170 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 12:41:10.982391 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977174 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 12:41:10.982391 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977177 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 12:41:10.982391 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977180 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 12:41:10.982391 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977183 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 12:41:10.982391 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977186 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 12:41:10.982391 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977189 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 12:41:10.982391 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977191 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 12:41:10.982391 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977194 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 12:41:10.982391 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977197 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 12:41:10.982391 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977199 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 12:41:10.982391 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977202 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 12:41:10.982391 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977205 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 12:41:10.982391 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977208 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 12:41:10.982391 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977211 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 12:41:10.982886 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977214 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 12:41:10.982886 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977217 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 12:41:10.982886 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977219 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 12:41:10.982886 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977222 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 12:41:10.982886 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977225 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 12:41:10.982886 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977227 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 12:41:10.982886 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977230 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 12:41:10.982886 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977232 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 12:41:10.982886 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977235 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 12:41:10.982886 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977237 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 12:41:10.982886 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977240 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 12:41:10.982886 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977242 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 12:41:10.982886 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977245 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 12:41:10.982886 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977248 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 12:41:10.982886 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977251 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 12:41:10.982886 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977253 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 12:41:10.982886 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977256 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 12:41:10.982886 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977258 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 12:41:10.982886 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977261 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 12:41:10.983353 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977263 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 12:41:10.983353 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977266 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 12:41:10.983353 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977269 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 12:41:10.983353 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977272 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 12:41:10.983353 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977275 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 12:41:10.983353 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977278 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 12:41:10.983353 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977281 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 12:41:10.983353 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977283 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 12:41:10.983353 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977286 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 12:41:10.983353 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977288 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 12:41:10.983353 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977291 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 12:41:10.983353 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977294 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 12:41:10.983353 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977297 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 12:41:10.983353 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977299 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 12:41:10.983353 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977302 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 12:41:10.983353 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977304 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 12:41:10.983799 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.977309 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 12:41:10.983799 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977418 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 12:41:10.983799 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977422 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 12:41:10.983799 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977425 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 12:41:10.983799 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977428 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 12:41:10.983799 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977431 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 12:41:10.983799 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977435 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 12:41:10.983799 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977438 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 12:41:10.983799 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977441 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 12:41:10.983799 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977444 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 12:41:10.983799 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977447 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 12:41:10.983799 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977450 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 12:41:10.983799 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977452 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 12:41:10.983799 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977455 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 12:41:10.984284 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977458 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 12:41:10.984284 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977460 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 12:41:10.984284 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977464 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 12:41:10.984284 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977466 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 12:41:10.984284 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977469 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 12:41:10.984284 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977471 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 12:41:10.984284 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977474 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 12:41:10.984284 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977476 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 12:41:10.984284 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977479 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 12:41:10.984284 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977481 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 12:41:10.984284 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977484 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 12:41:10.984284 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977487 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 12:41:10.984284 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977489 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 12:41:10.984284 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977492 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 12:41:10.984284 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977494 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 12:41:10.984284 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977498 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 12:41:10.984284 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977500 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 12:41:10.984284 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977503 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 12:41:10.984284 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977505 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 12:41:10.984284 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977508 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 12:41:10.984762 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977511 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 12:41:10.984762 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977513 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 12:41:10.984762 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977516 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 12:41:10.984762 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977518 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 12:41:10.984762 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977521 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 12:41:10.984762 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977523 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 12:41:10.984762 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977526 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 12:41:10.984762 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977529 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 12:41:10.984762 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977532 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 12:41:10.984762 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977534 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 12:41:10.984762 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977537 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 12:41:10.984762 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977539 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 12:41:10.984762 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977542 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 12:41:10.984762 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977545 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 12:41:10.984762 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977548 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 12:41:10.984762 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977551 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 12:41:10.984762 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977568 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 12:41:10.984762 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977572 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 12:41:10.984762 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977576 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 12:41:10.985237 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977579 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 12:41:10.985237 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977581 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 12:41:10.985237 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977584 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 12:41:10.985237 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977587 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 12:41:10.985237 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977590 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 12:41:10.985237 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977593 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 12:41:10.985237 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977596 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 12:41:10.985237 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977598 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 12:41:10.985237 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977601 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 12:41:10.985237 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977604 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 12:41:10.985237 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977607 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 12:41:10.985237 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977609 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 12:41:10.985237 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977612 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 12:41:10.985237 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977614 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 12:41:10.985237 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977617 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 12:41:10.985237 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977619 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 12:41:10.985237 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977623 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 12:41:10.985237 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977626 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 12:41:10.985237 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977629 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 12:41:10.985237 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977632 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 12:41:10.985763 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977635 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 12:41:10.985763 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977637 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 12:41:10.985763 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977640 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 12:41:10.985763 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977642 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 12:41:10.985763 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977645 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 12:41:10.985763 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977648 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 12:41:10.985763 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977650 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 12:41:10.985763 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977653 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 12:41:10.985763 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977655 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 12:41:10.985763 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977658 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 12:41:10.985763 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977660 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 12:41:10.985763 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977663 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 12:41:10.985763 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977665 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 12:41:10.985763 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977667 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 12:41:10.985763 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977670 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 12:41:10.985763 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977673 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 12:41:10.985763 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977676 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 12:41:10.985763 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977679 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 12:41:10.985763 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977681 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 12:41:10.985763 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977684 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 12:41:10.986957 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977686 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 12:41:10.986957 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977689 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 12:41:10.986957 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977692 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 12:41:10.986957 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977695 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 12:41:10.986957 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977697 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 12:41:10.986957 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977700 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 12:41:10.986957 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:10.977702 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 09 12:41:10.986957 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.977707 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 12:41:10.986957 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.977811 2561 server.go:962] "Client rotation is on, will bootstrap in background" Jun 09 12:41:10.986957 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.979893 2561 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 09 12:41:10.986957 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.981218 2561 server.go:1019] "Starting client certificate rotation" Jun 09 12:41:10.986957 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.981347 2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 12:41:10.986957 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.981379 2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 12:41:10.986957 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.983758 2561 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 12:41:10.987357 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.986740 2561 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 12:41:10.996716 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.996694 2561 log.go:25] "Validated CRI v1 runtime API" Jun 09 12:41:10.999178 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.999163 2561 log.go:25] "Validated CRI v1 image API" Jun 09 12:41:10.999893 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:10.999873 2561 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 09 12:41:11.002220 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.002193 2561 fs.go:135] Filesystem UUIDs: map[1cdd17f0-d5bb-4d52-a4a2-3c14cf11e7f8:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 92e0a797-4dc8-4c3c-ae80-23fed5302878:/dev/nvme0n1p4] Jun 09 12:41:11.002292 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.002218 2561 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 09 12:41:11.007508 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.007284 2561 manager.go:216] Machine: {Timestamp:2026-06-09 12:41:11.006029531 +0000 UTC m=+0.321343512 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100181 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec25dc4e1907ddb36719b25f4728bef2 SystemUUID:ec25dc4e-1907-ddb3-6719-b25f4728bef2 BootID:de198754-4f16-462c-b7d1-1bdb94be0b54 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ab:34:af:12:85 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ab:34:af:12:85 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:7a:73:a2:c2:7f:51 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 09 12:41:11.007508 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.007495 2561 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 09 12:41:11.007663 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.007595 2561 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 09 12:41:11.010987 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.010958 2561 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 09 12:41:11.011118 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.010990 2561 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-109.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 09 12:41:11.011810 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.011801 2561 topology_manager.go:138] "Creating topology manager with none policy" Jun 09 12:41:11.011857 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.011825 2561 container_manager_linux.go:309] "Creating device plugin manager" Jun 09 12:41:11.011857 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.011835 2561 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 12:41:11.012436 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.012427 2561 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 12:41:11.013248 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.013239 2561 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 09 12:41:11.015541 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.015521 2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 12:41:11.015708 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.015696 2561 state_mem.go:36] "Initialized new in-memory state store" Jun 09 12:41:11.015857 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.015846 2561 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 09 12:41:11.015889 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.015876 2561 kubelet.go:486] "Attempting to sync node with API server" Jun 09 12:41:11.015928 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.015892 2561 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 09 12:41:11.015928 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.015906 2561 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 09 12:41:11.015928 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.015916 2561 kubelet.go:398] "Adding apiserver pod source" Jun 09 12:41:11.015928 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.015925 2561 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 09 12:41:11.016328 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.016314 2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 12:41:11.016581 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.016570 2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 12:41:11.018738 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.018722 2561 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 09 12:41:11.020144 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.020131 2561 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 09 12:41:11.020190 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.020161 2561 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 09 12:41:11.020768 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.020758 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 09 12:41:11.020803 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.020773 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 09 12:41:11.020803 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.020779 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 09 12:41:11.020803 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.020784 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 09 12:41:11.020803 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.020791 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 09 12:41:11.020803 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.020797 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 09 12:41:11.020953 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.020902 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 09 12:41:11.020953 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.020908 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 09 12:41:11.020953 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.020914 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 09 12:41:11.020953 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.020920 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 09 12:41:11.020953 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.020934 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 09 12:41:11.020953 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.020942 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 09 12:41:11.022426 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.022412 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 09 12:41:11.022464 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.022429 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 09 12:41:11.026545 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.026525 2561 server.go:1268] "Started kubelet" Jun 09 12:41:11.026677 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.026608 2561 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 09 12:41:11.026744 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.026655 2561 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 09 12:41:11.026881 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.026863 2561 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 09 12:41:11.027579 ip-10-0-133-109 systemd[1]: Started Kubernetes Kubelet. Jun 09 12:41:11.028601 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.028583 2561 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 09 12:41:11.028803 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.028784 2561 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-109.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 09 12:41:11.028901 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:11.028828 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-109.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 09 12:41:11.029407 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.029381 2561 server.go:310] "Adding debug handlers to kubelet server" Jun 09 12:41:11.029565 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:11.029543 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 09 12:41:11.032878 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:11.031910 2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-109.ec2.internal.18b76a21cb5a67ac default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-109.ec2.internal,UID:ip-10-0-133-109.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-109.ec2.internal,},FirstTimestamp:2026-06-09 12:41:11.026485164 +0000 UTC m=+0.341799146,LastTimestamp:2026-06-09 12:41:11.026485164 +0000 UTC m=+0.341799146,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-109.ec2.internal,}" Jun 09 12:41:11.033708 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.033689 2561 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 09 12:41:11.033708 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.033694 2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 09 12:41:11.033853 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:11.033779 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-109.ec2.internal\" not found" Jun 09 12:41:11.034498 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.034481 2561 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 09 12:41:11.034630 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.034621 2561 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 09 12:41:11.034771 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.034756 2561 reconstruct.go:97] "Volume reconstruction finished" Jun 09 12:41:11.034771 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.034771 2561 reconciler.go:29] "Reconciler: start to sync state" Jun 09 12:41:11.034950 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.034934 2561 factory.go:55] Registering systemd factory Jun 09 12:41:11.035000 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.034973 2561 factory.go:223] Registration of the systemd container factory successfully Jun 09 12:41:11.035227 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.035216 2561 factory.go:153] Registering CRI-O factory Jun 09 12:41:11.035282 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.035231 2561 factory.go:223] Registration of the crio container factory successfully Jun 09 12:41:11.035322 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.035286 2561 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 09 12:41:11.035322 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.035311 2561 factory.go:103] Registering Raw factory Jun 09 12:41:11.035400 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.035328 2561 manager.go:1196] Started watching for new ooms in manager Jun 09 12:41:11.035743 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.035725 2561 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 09 12:41:11.036222 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.036203 2561 manager.go:349] Starting recovery of all containers Jun 09 12:41:11.039220 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:11.039189 2561 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 09 12:41:11.039386 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:11.039363 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 09 12:41:11.039590 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:11.039562 2561 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-109.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 09 12:41:11.045967 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.045943 2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-j9dqw" Jun 09 12:41:11.046642 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.046623 2561 manager.go:354] Recovery completed Jun 09 12:41:11.049110 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:11.049088 2561 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jun 09 12:41:11.052046 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.052032 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 12:41:11.053781 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.053766 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-109.ec2.internal" event="NodeHasSufficientMemory" Jun 09 12:41:11.053904 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.053795 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-109.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 12:41:11.053904 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.053805 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-109.ec2.internal" event="NodeHasSufficientPID" Jun 09 12:41:11.054034 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.054017 2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-j9dqw" Jun 09 12:41:11.054369 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.054350 2561 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 09 12:41:11.054369 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.054368 2561 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 09 12:41:11.054462 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.054384 2561 state_mem.go:36] "Initialized new in-memory state store" Jun 09 12:41:11.054462 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.054401 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 12:41:11.055162 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.055143 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-109.ec2.internal" event="NodeHasSufficientMemory" Jun 09 12:41:11.055244 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.055176 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-109.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 12:41:11.055244 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.055188 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-109.ec2.internal" event="NodeHasSufficientPID" Jun 09 12:41:11.055666 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.055654 2561 policy_none.go:49] "None policy: Start" Jun 09 12:41:11.055699 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.055671 2561 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 09 12:41:11.055699 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.055680 2561 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 09 12:41:11.056628 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.056616 2561 policy_none.go:47] "Start" Jun 09 12:41:11.057270 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:11.057200 2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-109.ec2.internal.18b76a21ccfaed31 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-109.ec2.internal,UID:ip-10-0-133-109.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-133-109.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-133-109.ec2.internal,},FirstTimestamp:2026-06-09 12:41:11.053782321 +0000 UTC m=+0.369096303,LastTimestamp:2026-06-09 12:41:11.053782321 +0000 UTC m=+0.369096303,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-109.ec2.internal,}" Jun 09 12:41:11.093513 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.093492 2561 manager.go:337] "Starting Device Plugin manager" Jun 09 12:41:11.105389 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:11.093566 2561 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 09 12:41:11.105389 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.093579 2561 server.go:87] "Starting device plugin registration server" Jun 09 12:41:11.105389 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.093864 2561 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 09 12:41:11.105389 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.093880 2561 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 09 12:41:11.105389 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.093983 2561 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 09 12:41:11.105389 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.094063 2561 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 09 12:41:11.105389 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.094072 2561 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 09 12:41:11.105389 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:11.094649 2561 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 09 12:41:11.105389 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:11.094696 2561 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-109.ec2.internal\" not found" Jun 09 12:41:11.108663 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.108639 2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 09 12:41:11.109783 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.109768 2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 09 12:41:11.109852 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.109802 2561 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 09 12:41:11.109852 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.109838 2561 kubelet.go:2448] "Starting kubelet main sync loop" Jun 09 12:41:11.109938 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:11.109875 2561 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 09 12:41:11.112337 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.112320 2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 12:41:11.194635 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.194603 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 12:41:11.195659 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.195644 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-109.ec2.internal" event="NodeHasSufficientMemory" Jun 09 12:41:11.195732 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.195676 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-109.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 12:41:11.195732 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.195686 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-109.ec2.internal" event="NodeHasSufficientPID" Jun 09 12:41:11.195732 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.195708 2561 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-109.ec2.internal" Jun 09 12:41:11.203740 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.203724 2561 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-109.ec2.internal" Jun 09 12:41:11.203809 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:11.203745 2561 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-109.ec2.internal\": node \"ip-10-0-133-109.ec2.internal\" not found" Jun 09 12:41:11.210180 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.210143 2561 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-109.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-109.ec2.internal"] Jun 09 12:41:11.210226 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.210200 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 12:41:11.211632 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.211611 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-109.ec2.internal" event="NodeHasSufficientMemory" Jun 09 12:41:11.211699 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.211641 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-109.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 12:41:11.211699 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.211654 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-109.ec2.internal" event="NodeHasSufficientPID" Jun 09 12:41:11.212785 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.212773 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 12:41:11.212925 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.212911 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-109.ec2.internal" Jun 09 12:41:11.212984 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.212947 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 12:41:11.213503 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.213479 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-109.ec2.internal" event="NodeHasSufficientMemory" Jun 09 12:41:11.213503 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.213503 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-109.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 12:41:11.213620 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.213516 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-109.ec2.internal" event="NodeHasSufficientPID" Jun 09 12:41:11.213620 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.213537 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-109.ec2.internal" event="NodeHasSufficientMemory" Jun 09 12:41:11.213620 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.213560 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-109.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 12:41:11.213620 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.213573 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-109.ec2.internal" event="NodeHasSufficientPID" Jun 09 12:41:11.214651 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.214635 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-109.ec2.internal" Jun 09 12:41:11.214731 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.214665 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 12:41:11.215335 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.215320 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-109.ec2.internal" event="NodeHasSufficientMemory" Jun 09 12:41:11.215399 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.215344 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-109.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 12:41:11.215399 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.215354 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-109.ec2.internal" event="NodeHasSufficientPID" Jun 09 12:41:11.235294 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:11.235269 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-109.ec2.internal\" not found" Jun 09 12:41:11.238381 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:11.238363 2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-109.ec2.internal\" not found" node="ip-10-0-133-109.ec2.internal" Jun 09 12:41:11.242595 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:11.242579 2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-109.ec2.internal\" not found" node="ip-10-0-133-109.ec2.internal" Jun 09 12:41:11.335388 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:11.335370 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-109.ec2.internal\" not found" Jun 09 12:41:11.335469 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.335457 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3ae446967242a088e635b73955367e69-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-109.ec2.internal\" (UID: \"3ae446967242a088e635b73955367e69\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-109.ec2.internal" Jun 09 12:41:11.335513 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.335478 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ae446967242a088e635b73955367e69-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-109.ec2.internal\" (UID: \"3ae446967242a088e635b73955367e69\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-109.ec2.internal" Jun 09 12:41:11.335513 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.335494 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/627b185f30291ffb2e9813e90451a240-config\") pod \"kube-apiserver-proxy-ip-10-0-133-109.ec2.internal\" (UID: \"627b185f30291ffb2e9813e90451a240\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-109.ec2.internal" Jun 09 12:41:11.435865 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:11.435838 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-109.ec2.internal\" not found" Jun 09 12:41:11.435865 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.435862 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3ae446967242a088e635b73955367e69-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-109.ec2.internal\" (UID: \"3ae446967242a088e635b73955367e69\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-109.ec2.internal" Jun 09 12:41:11.436022 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.435885 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ae446967242a088e635b73955367e69-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-109.ec2.internal\" (UID: \"3ae446967242a088e635b73955367e69\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-109.ec2.internal" Jun 09 12:41:11.436022 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.435904 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/627b185f30291ffb2e9813e90451a240-config\") pod \"kube-apiserver-proxy-ip-10-0-133-109.ec2.internal\" (UID: \"627b185f30291ffb2e9813e90451a240\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-109.ec2.internal" Jun 09 12:41:11.436022 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.435951 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3ae446967242a088e635b73955367e69-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-109.ec2.internal\" (UID: \"3ae446967242a088e635b73955367e69\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-109.ec2.internal" Jun 09 12:41:11.436022 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.435971 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ae446967242a088e635b73955367e69-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-109.ec2.internal\" (UID: \"3ae446967242a088e635b73955367e69\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-109.ec2.internal" Jun 09 12:41:11.436141 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.436022 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/627b185f30291ffb2e9813e90451a240-config\") pod \"kube-apiserver-proxy-ip-10-0-133-109.ec2.internal\" (UID: \"627b185f30291ffb2e9813e90451a240\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-109.ec2.internal" Jun 09 12:41:11.536466 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:11.536437 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-109.ec2.internal\" not found" Jun 09 12:41:11.542592 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.542573 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-109.ec2.internal" Jun 09 12:41:11.546609 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.546592 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-109.ec2.internal" Jun 09 12:41:11.636830 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:11.636785 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-109.ec2.internal\" not found" Jun 09 12:41:11.737183 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:11.737148 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-109.ec2.internal\" not found" Jun 09 12:41:11.837646 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:11.837585 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-109.ec2.internal\" not found" Jun 09 12:41:11.934116 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.934094 2561 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 12:41:11.980855 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.980676 2561 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 09 12:41:11.980855 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.980841 2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 12:41:11.981549 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.980880 2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 12:41:11.990058 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:11.990030 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod627b185f30291ffb2e9813e90451a240.slice/crio-9261ff44c7dcc838a3f8ea01dd13781dd7ff963a1db7d9235e56452eee71ad81 WatchSource:0}: Error finding container 9261ff44c7dcc838a3f8ea01dd13781dd7ff963a1db7d9235e56452eee71ad81: Status 404 returned error can't find the container with id 9261ff44c7dcc838a3f8ea01dd13781dd7ff963a1db7d9235e56452eee71ad81 Jun 09 12:41:11.990622 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:11.990599 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ae446967242a088e635b73955367e69.slice/crio-05d437e242c5fd674e5c171e9657c79bf8508210ffbc334e1da2824f629cc907 WatchSource:0}: Error finding container 05d437e242c5fd674e5c171e9657c79bf8508210ffbc334e1da2824f629cc907: Status 404 returned error can't find the container with id 05d437e242c5fd674e5c171e9657c79bf8508210ffbc334e1da2824f629cc907 Jun 09 12:41:11.994591 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:11.994579 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 12:41:12.017070 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.017053 2561 apiserver.go:52] "Watching apiserver" Jun 09 12:41:12.029170 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.029147 2561 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 09 12:41:12.029456 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.029438 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-xcnw9","openshift-dns/node-resolver-xlxkq","openshift-multus/multus-additional-cni-plugins-vhn5n","openshift-network-operator/iptables-alerter-lpnt2","openshift-ovn-kubernetes/ovnkube-node-tsmnb","kube-system/konnectivity-agent-kj5x2","openshift-image-registry/node-ca-4n62g","openshift-multus/multus-9khwg","openshift-multus/network-metrics-daemon-xcq9r","openshift-network-diagnostics/network-check-target-mq44p","kube-system/global-pull-secret-syncer-br4cc","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nwz6"] Jun 09 12:41:12.031425 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.031410 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xcnw9" Jun 09 12:41:12.032474 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.032453 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xlxkq" Jun 09 12:41:12.033493 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.033478 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vhn5n" Jun 09 12:41:12.033804 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.033784 2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 09 12:41:12.034245 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.034229 2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-109.ec2.internal" Jun 09 12:41:12.034443 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.034422 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lpnt2" Jun 09 12:41:12.035582 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.035565 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 09 12:41:12.035840 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.035827 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tsmnb" Jun 09 12:41:12.037189 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.037171 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kj5x2" Jun 09 12:41:12.038454 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.038434 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4n62g" Jun 09 12:41:12.038670 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.038651 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a1b0f311-294d-4b26-b1ae-84ecd996fc34-system-cni-dir\") pod \"multus-additional-cni-plugins-vhn5n\" (UID: \"a1b0f311-294d-4b26-b1ae-84ecd996fc34\") " pod="openshift-multus/multus-additional-cni-plugins-vhn5n" Jun 09 12:41:12.038762 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.038675 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4b49422f-6fab-47a3-956f-b78c3784dc3c-systemd-units\") pod \"ovnkube-node-tsmnb\" (UID: \"4b49422f-6fab-47a3-956f-b78c3784dc3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsmnb" Jun 09 12:41:12.038762 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.038709 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b49422f-6fab-47a3-956f-b78c3784dc3c-etc-openvswitch\") pod \"ovnkube-node-tsmnb\" (UID: \"4b49422f-6fab-47a3-956f-b78c3784dc3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsmnb" Jun 09 12:41:12.038762 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.038747 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b49422f-6fab-47a3-956f-b78c3784dc3c-run-openvswitch\") pod \"ovnkube-node-tsmnb\" (UID: \"4b49422f-6fab-47a3-956f-b78c3784dc3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsmnb" Jun 09 12:41:12.038946 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.038773 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/98f6370c-d970-420a-afcc-7abb56d7c44e-agent-certs\") pod \"konnectivity-agent-kj5x2\" (UID: \"98f6370c-d970-420a-afcc-7abb56d7c44e\") " pod="kube-system/konnectivity-agent-kj5x2" Jun 09 12:41:12.038946 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.038804 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b6d83a37-95b0-4f9e-ac03-5c0927e92520-etc-modprobe-d\") pod \"tuned-xcnw9\" (UID: \"b6d83a37-95b0-4f9e-ac03-5c0927e92520\") " pod="openshift-cluster-node-tuning-operator/tuned-xcnw9" Jun 09 12:41:12.038946 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.038852 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/00dcaa51-80f6-4fcd-9eb0-8c27466112df-tmp-dir\") pod \"node-resolver-xlxkq\" (UID: \"00dcaa51-80f6-4fcd-9eb0-8c27466112df\") " pod="openshift-dns/node-resolver-xlxkq" Jun 09 12:41:12.038946 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.038877 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a1b0f311-294d-4b26-b1ae-84ecd996fc34-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vhn5n\" (UID: \"a1b0f311-294d-4b26-b1ae-84ecd996fc34\") " pod="openshift-multus/multus-additional-cni-plugins-vhn5n" Jun 09 12:41:12.038946 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.038902 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5s8cs\" (UniqueName: \"kubernetes.io/projected/4b49422f-6fab-47a3-956f-b78c3784dc3c-kube-api-access-5s8cs\") pod \"ovnkube-node-tsmnb\" (UID: \"4b49422f-6fab-47a3-956f-b78c3784dc3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsmnb" Jun 09 12:41:12.038946 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.038925 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b6d83a37-95b0-4f9e-ac03-5c0927e92520-etc-kubernetes\") pod \"tuned-xcnw9\" (UID: \"b6d83a37-95b0-4f9e-ac03-5c0927e92520\") " pod="openshift-cluster-node-tuning-operator/tuned-xcnw9" Jun 09 12:41:12.039202 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.038977 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b6d83a37-95b0-4f9e-ac03-5c0927e92520-etc-sysctl-conf\") pod \"tuned-xcnw9\" (UID: \"b6d83a37-95b0-4f9e-ac03-5c0927e92520\") " pod="openshift-cluster-node-tuning-operator/tuned-xcnw9" Jun 09 12:41:12.039202 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.039001 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b6d83a37-95b0-4f9e-ac03-5c0927e92520-run\") pod \"tuned-xcnw9\" (UID: \"b6d83a37-95b0-4f9e-ac03-5c0927e92520\") " pod="openshift-cluster-node-tuning-operator/tuned-xcnw9" Jun 09 12:41:12.039202 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.039022 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b6d83a37-95b0-4f9e-ac03-5c0927e92520-tmp\") pod \"tuned-xcnw9\" (UID: \"b6d83a37-95b0-4f9e-ac03-5c0927e92520\") " pod="openshift-cluster-node-tuning-operator/tuned-xcnw9" Jun 09 12:41:12.039202 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.039048 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a1b0f311-294d-4b26-b1ae-84ecd996fc34-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vhn5n\" (UID: \"a1b0f311-294d-4b26-b1ae-84ecd996fc34\") " pod="openshift-multus/multus-additional-cni-plugins-vhn5n" Jun 09 12:41:12.039202 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.039076 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkhkl\" (UniqueName: \"kubernetes.io/projected/a1b0f311-294d-4b26-b1ae-84ecd996fc34-kube-api-access-tkhkl\") pod \"multus-additional-cni-plugins-vhn5n\" (UID: \"a1b0f311-294d-4b26-b1ae-84ecd996fc34\") " pod="openshift-multus/multus-additional-cni-plugins-vhn5n" Jun 09 12:41:12.039202 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.039098 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/94fe31fd-8a59-4bff-b38f-43dfb84073f3-host-slash\") pod \"iptables-alerter-lpnt2\" (UID: \"94fe31fd-8a59-4bff-b38f-43dfb84073f3\") " pod="openshift-network-operator/iptables-alerter-lpnt2" Jun 09 12:41:12.039202 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.039129 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t58gh\" (UniqueName: \"kubernetes.io/projected/94fe31fd-8a59-4bff-b38f-43dfb84073f3-kube-api-access-t58gh\") pod \"iptables-alerter-lpnt2\" (UID: \"94fe31fd-8a59-4bff-b38f-43dfb84073f3\") " pod="openshift-network-operator/iptables-alerter-lpnt2" Jun 09 12:41:12.039202 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.039149 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b49422f-6fab-47a3-956f-b78c3784dc3c-var-lib-openvswitch\") pod \"ovnkube-node-tsmnb\" (UID: \"4b49422f-6fab-47a3-956f-b78c3784dc3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsmnb" Jun 09 12:41:12.039202 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.039166 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b6d83a37-95b0-4f9e-ac03-5c0927e92520-etc-systemd\") pod \"tuned-xcnw9\" (UID: \"b6d83a37-95b0-4f9e-ac03-5c0927e92520\") " pod="openshift-cluster-node-tuning-operator/tuned-xcnw9" Jun 09 12:41:12.039202 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.039184 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b6d83a37-95b0-4f9e-ac03-5c0927e92520-sys\") pod \"tuned-xcnw9\" (UID: \"b6d83a37-95b0-4f9e-ac03-5c0927e92520\") " pod="openshift-cluster-node-tuning-operator/tuned-xcnw9" Jun 09 12:41:12.039202 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.039201 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/00dcaa51-80f6-4fcd-9eb0-8c27466112df-hosts-file\") pod \"node-resolver-xlxkq\" (UID: \"00dcaa51-80f6-4fcd-9eb0-8c27466112df\") " pod="openshift-dns/node-resolver-xlxkq" Jun 09 12:41:12.039569 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.039216 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a1b0f311-294d-4b26-b1ae-84ecd996fc34-cnibin\") pod \"multus-additional-cni-plugins-vhn5n\" (UID: \"a1b0f311-294d-4b26-b1ae-84ecd996fc34\") " pod="openshift-multus/multus-additional-cni-plugins-vhn5n" Jun 09 12:41:12.039569 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.039230 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a1b0f311-294d-4b26-b1ae-84ecd996fc34-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vhn5n\" (UID: \"a1b0f311-294d-4b26-b1ae-84ecd996fc34\") " pod="openshift-multus/multus-additional-cni-plugins-vhn5n" Jun 09 12:41:12.039569 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.039245 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4b49422f-6fab-47a3-956f-b78c3784dc3c-host-slash\") pod \"ovnkube-node-tsmnb\" (UID: \"4b49422f-6fab-47a3-956f-b78c3784dc3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsmnb" Jun 09 12:41:12.039569 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.039260 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4b49422f-6fab-47a3-956f-b78c3784dc3c-run-systemd\") pod \"ovnkube-node-tsmnb\" (UID: \"4b49422f-6fab-47a3-956f-b78c3784dc3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsmnb" Jun 09 12:41:12.039569 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.039274 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4b49422f-6fab-47a3-956f-b78c3784dc3c-ovnkube-config\") pod \"ovnkube-node-tsmnb\" (UID: \"4b49422f-6fab-47a3-956f-b78c3784dc3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsmnb" Jun 09 12:41:12.039569 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.039288 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4b49422f-6fab-47a3-956f-b78c3784dc3c-env-overrides\") pod \"ovnkube-node-tsmnb\" (UID: \"4b49422f-6fab-47a3-956f-b78c3784dc3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsmnb" Jun 09 12:41:12.039569 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.039302 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b49422f-6fab-47a3-956f-b78c3784dc3c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tsmnb\" (UID: \"4b49422f-6fab-47a3-956f-b78c3784dc3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsmnb" Jun 09 12:41:12.039569 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.039325 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4b49422f-6fab-47a3-956f-b78c3784dc3c-ovn-node-metrics-cert\") pod \"ovnkube-node-tsmnb\" (UID: \"4b49422f-6fab-47a3-956f-b78c3784dc3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsmnb" Jun 09 12:41:12.039569 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.039340 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4b49422f-6fab-47a3-956f-b78c3784dc3c-ovnkube-script-lib\") pod \"ovnkube-node-tsmnb\" (UID: \"4b49422f-6fab-47a3-956f-b78c3784dc3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsmnb" Jun 09 12:41:12.039569 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.039356 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/98f6370c-d970-420a-afcc-7abb56d7c44e-konnectivity-ca\") pod \"konnectivity-agent-kj5x2\" (UID: \"98f6370c-d970-420a-afcc-7abb56d7c44e\") " pod="kube-system/konnectivity-agent-kj5x2" Jun 09 12:41:12.039569 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.039371 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b6d83a37-95b0-4f9e-ac03-5c0927e92520-etc-sysconfig\") pod \"tuned-xcnw9\" (UID: \"b6d83a37-95b0-4f9e-ac03-5c0927e92520\") " pod="openshift-cluster-node-tuning-operator/tuned-xcnw9" Jun 09 12:41:12.039569 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.039406 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b6d83a37-95b0-4f9e-ac03-5c0927e92520-etc-sysctl-d\") pod \"tuned-xcnw9\" (UID: \"b6d83a37-95b0-4f9e-ac03-5c0927e92520\") " pod="openshift-cluster-node-tuning-operator/tuned-xcnw9" Jun 09 12:41:12.039569 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.039436 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b6d83a37-95b0-4f9e-ac03-5c0927e92520-host\") pod \"tuned-xcnw9\" (UID: \"b6d83a37-95b0-4f9e-ac03-5c0927e92520\") " pod="openshift-cluster-node-tuning-operator/tuned-xcnw9" Jun 09 12:41:12.039569 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.039460 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b6d83a37-95b0-4f9e-ac03-5c0927e92520-etc-tuned\") pod \"tuned-xcnw9\" (UID: \"b6d83a37-95b0-4f9e-ac03-5c0927e92520\") " pod="openshift-cluster-node-tuning-operator/tuned-xcnw9" Jun 09 12:41:12.039569 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.039484 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxggp\" (UniqueName: \"kubernetes.io/projected/00dcaa51-80f6-4fcd-9eb0-8c27466112df-kube-api-access-qxggp\") pod \"node-resolver-xlxkq\" (UID: \"00dcaa51-80f6-4fcd-9eb0-8c27466112df\") " pod="openshift-dns/node-resolver-xlxkq" Jun 09 12:41:12.039569 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.039528 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4b49422f-6fab-47a3-956f-b78c3784dc3c-host-run-netns\") pod \"ovnkube-node-tsmnb\" (UID: \"4b49422f-6fab-47a3-956f-b78c3784dc3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsmnb" Jun 09 12:41:12.040192 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.039550 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4b49422f-6fab-47a3-956f-b78c3784dc3c-run-ovn\") pod \"ovnkube-node-tsmnb\" (UID: \"4b49422f-6fab-47a3-956f-b78c3784dc3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsmnb" Jun 09 12:41:12.040192 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.039571 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4b49422f-6fab-47a3-956f-b78c3784dc3c-host-cni-bin\") pod \"ovnkube-node-tsmnb\" (UID: \"4b49422f-6fab-47a3-956f-b78c3784dc3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsmnb" Jun 09 12:41:12.040192 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.039594 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a1b0f311-294d-4b26-b1ae-84ecd996fc34-os-release\") pod \"multus-additional-cni-plugins-vhn5n\" (UID: \"a1b0f311-294d-4b26-b1ae-84ecd996fc34\") " pod="openshift-multus/multus-additional-cni-plugins-vhn5n" Jun 09 12:41:12.040192 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.039615 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a1b0f311-294d-4b26-b1ae-84ecd996fc34-cni-binary-copy\") pod \"multus-additional-cni-plugins-vhn5n\" (UID: \"a1b0f311-294d-4b26-b1ae-84ecd996fc34\") " pod="openshift-multus/multus-additional-cni-plugins-vhn5n" Jun 09 12:41:12.040192 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.039621 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9khwg" Jun 09 12:41:12.040192 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.039638 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/94fe31fd-8a59-4bff-b38f-43dfb84073f3-iptables-alerter-script\") pod \"iptables-alerter-lpnt2\" (UID: \"94fe31fd-8a59-4bff-b38f-43dfb84073f3\") " pod="openshift-network-operator/iptables-alerter-lpnt2" Jun 09 12:41:12.040192 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.039663 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b49422f-6fab-47a3-956f-b78c3784dc3c-host-kubelet\") pod \"ovnkube-node-tsmnb\" (UID: \"4b49422f-6fab-47a3-956f-b78c3784dc3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsmnb" Jun 09 12:41:12.040192 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.039684 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4b49422f-6fab-47a3-956f-b78c3784dc3c-node-log\") pod \"ovnkube-node-tsmnb\" (UID: \"4b49422f-6fab-47a3-956f-b78c3784dc3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsmnb" Jun 09 12:41:12.040192 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.039708 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4b49422f-6fab-47a3-956f-b78c3784dc3c-log-socket\") pod \"ovnkube-node-tsmnb\" (UID: \"4b49422f-6fab-47a3-956f-b78c3784dc3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsmnb" Jun 09 12:41:12.040192 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.039733 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b49422f-6fab-47a3-956f-b78c3784dc3c-host-run-ovn-kubernetes\") pod \"ovnkube-node-tsmnb\" (UID: \"4b49422f-6fab-47a3-956f-b78c3784dc3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsmnb" Jun 09 12:41:12.040192 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.039782 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4b49422f-6fab-47a3-956f-b78c3784dc3c-host-cni-netd\") pod \"ovnkube-node-tsmnb\" (UID: \"4b49422f-6fab-47a3-956f-b78c3784dc3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsmnb" Jun 09 12:41:12.040192 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.039836 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b6d83a37-95b0-4f9e-ac03-5c0927e92520-lib-modules\") pod \"tuned-xcnw9\" (UID: \"b6d83a37-95b0-4f9e-ac03-5c0927e92520\") " pod="openshift-cluster-node-tuning-operator/tuned-xcnw9" Jun 09 12:41:12.040192 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.039860 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b6d83a37-95b0-4f9e-ac03-5c0927e92520-var-lib-kubelet\") pod \"tuned-xcnw9\" (UID: \"b6d83a37-95b0-4f9e-ac03-5c0927e92520\") " pod="openshift-cluster-node-tuning-operator/tuned-xcnw9" Jun 09 12:41:12.040192 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.039883 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgjkt\" (UniqueName: \"kubernetes.io/projected/b6d83a37-95b0-4f9e-ac03-5c0927e92520-kube-api-access-bgjkt\") pod \"tuned-xcnw9\" (UID: \"b6d83a37-95b0-4f9e-ac03-5c0927e92520\") " pod="openshift-cluster-node-tuning-operator/tuned-xcnw9" Jun 09 12:41:12.040722 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.040705 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xcq9r" Jun 09 12:41:12.040830 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:12.040794 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xcq9r" podUID="c9511ce2-9c98-4362-8953-c323b4bdd636" Jun 09 12:41:12.041826 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.041797 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mq44p" Jun 09 12:41:12.041902 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:12.041876 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mq44p" podUID="12a5bda4-80f2-4135-ad58-d5a14bceef3f" Jun 09 12:41:12.043053 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.043037 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-br4cc" Jun 09 12:41:12.043135 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:12.043093 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-br4cc" podUID="3a86fe59-f4c8-4c09-9f19-6fada48b8194" Jun 09 12:41:12.044324 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.044228 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nwz6" Jun 09 12:41:12.050589 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.050567 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-9jt5g\"" Jun 09 12:41:12.050682 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.050644 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 09 12:41:12.050682 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.050651 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 09 12:41:12.050682 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.050670 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 09 12:41:12.050911 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.050571 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 09 12:41:12.050911 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.050759 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 09 12:41:12.050911 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.050786 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 09 12:41:12.050911 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.050811 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 09 12:41:12.050911 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.050854 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 09 12:41:12.051212 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.050931 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 09 12:41:12.051212 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.050990 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 09 12:41:12.051389 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.051374 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 09 12:41:12.051463 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.051439 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 09 12:41:12.051670 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.051655 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 09 12:41:12.051761 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.051712 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 09 12:41:12.051761 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.051720 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 09 12:41:12.051902 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.051847 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 09 12:41:12.052940 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.052632 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-ltspt\"" Jun 09 12:41:12.056110 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.056086 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 09 12:41:12.056238 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.056202 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-08 12:36:11 +0000 UTC" deadline="2027-12-24 12:50:47.640293994 +0000 UTC" Jun 09 12:41:12.056300 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.056240 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13512h9m35.584057672s" Jun 09 12:41:12.056518 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.056439 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 09 12:41:12.056518 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.056451 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-2zk2v\"" Jun 09 12:41:12.056518 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.056458 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 09 12:41:12.056518 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.056469 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-2q24n\"" Jun 09 12:41:12.056518 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.056484 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 09 12:41:12.056518 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.056503 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 09 12:41:12.056793 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.056557 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 09 12:41:12.056793 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.056678 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-fjkkf\"" Jun 09 12:41:12.056793 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.056762 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-q4c9h\"" Jun 09 12:41:12.056793 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.056782 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 09 12:41:12.056977 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.056765 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 09 12:41:12.056977 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.056847 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 09 12:41:12.057100 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.057088 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-6vgsm\"" Jun 09 12:41:12.057214 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.057199 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-gtc7j\"" Jun 09 12:41:12.057446 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.057432 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 09 12:41:12.057513 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.057500 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-lb9qc\"" Jun 09 12:41:12.058594 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.058578 2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 12:41:12.058676 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.058664 2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-109.ec2.internal" Jun 09 12:41:12.059372 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.059355 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-109.ec2.internal"] Jun 09 12:41:12.083046 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.083028 2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 12:41:12.097219 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.097175 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-133-109.ec2.internal"] Jun 09 12:41:12.098404 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.098392 2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 12:41:12.112731 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.112693 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-109.ec2.internal" event={"ID":"627b185f30291ffb2e9813e90451a240","Type":"ContainerStarted","Data":"9261ff44c7dcc838a3f8ea01dd13781dd7ff963a1db7d9235e56452eee71ad81"} Jun 09 12:41:12.113782 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.113758 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-109.ec2.internal" event={"ID":"3ae446967242a088e635b73955367e69","Type":"ContainerStarted","Data":"05d437e242c5fd674e5c171e9657c79bf8508210ffbc334e1da2824f629cc907"} Jun 09 12:41:12.129676 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.129659 2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-k2fx9" Jun 09 12:41:12.136481 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.136465 2561 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 09 12:41:12.140661 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.140645 2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-k2fx9" Jun 09 12:41:12.140701 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.140659 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c9ff1a02-bda3-4cd7-bc7c-aa86cf372357-host-var-lib-cni-multus\") pod \"multus-9khwg\" (UID: \"c9ff1a02-bda3-4cd7-bc7c-aa86cf372357\") " pod="openshift-multus/multus-9khwg" Jun 09 12:41:12.140701 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.140678 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c9ff1a02-bda3-4cd7-bc7c-aa86cf372357-multus-conf-dir\") pod \"multus-9khwg\" (UID: \"c9ff1a02-bda3-4cd7-bc7c-aa86cf372357\") " pod="openshift-multus/multus-9khwg" Jun 09 12:41:12.140701 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.140693 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c9ff1a02-bda3-4cd7-bc7c-aa86cf372357-host-run-multus-certs\") pod \"multus-9khwg\" (UID: \"c9ff1a02-bda3-4cd7-bc7c-aa86cf372357\") " pod="openshift-multus/multus-9khwg" Jun 09 12:41:12.140844 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.140713 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkhkl\" (UniqueName: \"kubernetes.io/projected/a1b0f311-294d-4b26-b1ae-84ecd996fc34-kube-api-access-tkhkl\") pod \"multus-additional-cni-plugins-vhn5n\" (UID: \"a1b0f311-294d-4b26-b1ae-84ecd996fc34\") " pod="openshift-multus/multus-additional-cni-plugins-vhn5n" Jun 09 12:41:12.140844 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.140728 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t58gh\" (UniqueName: \"kubernetes.io/projected/94fe31fd-8a59-4bff-b38f-43dfb84073f3-kube-api-access-t58gh\") pod \"iptables-alerter-lpnt2\" (UID: \"94fe31fd-8a59-4bff-b38f-43dfb84073f3\") " pod="openshift-network-operator/iptables-alerter-lpnt2" Jun 09 12:41:12.140844 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.140762 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b49422f-6fab-47a3-956f-b78c3784dc3c-var-lib-openvswitch\") pod \"ovnkube-node-tsmnb\" (UID: \"4b49422f-6fab-47a3-956f-b78c3784dc3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsmnb" Jun 09 12:41:12.140844 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.140798 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b6d83a37-95b0-4f9e-ac03-5c0927e92520-etc-systemd\") pod \"tuned-xcnw9\" (UID: \"b6d83a37-95b0-4f9e-ac03-5c0927e92520\") " pod="openshift-cluster-node-tuning-operator/tuned-xcnw9" Jun 09 12:41:12.141017 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.140887 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b6d83a37-95b0-4f9e-ac03-5c0927e92520-etc-systemd\") pod \"tuned-xcnw9\" (UID: \"b6d83a37-95b0-4f9e-ac03-5c0927e92520\") " pod="openshift-cluster-node-tuning-operator/tuned-xcnw9" Jun 09 12:41:12.141017 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.140904 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b49422f-6fab-47a3-956f-b78c3784dc3c-var-lib-openvswitch\") pod \"ovnkube-node-tsmnb\" (UID: \"4b49422f-6fab-47a3-956f-b78c3784dc3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsmnb" Jun 09 12:41:12.141017 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.140918 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c9ff1a02-bda3-4cd7-bc7c-aa86cf372357-host-var-lib-kubelet\") pod \"multus-9khwg\" (UID: \"c9ff1a02-bda3-4cd7-bc7c-aa86cf372357\") " pod="openshift-multus/multus-9khwg" Jun 09 12:41:12.141017 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.140978 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a1b0f311-294d-4b26-b1ae-84ecd996fc34-cnibin\") pod \"multus-additional-cni-plugins-vhn5n\" (UID: \"a1b0f311-294d-4b26-b1ae-84ecd996fc34\") " pod="openshift-multus/multus-additional-cni-plugins-vhn5n" Jun 09 12:41:12.141017 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.141004 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4b49422f-6fab-47a3-956f-b78c3784dc3c-host-slash\") pod \"ovnkube-node-tsmnb\" (UID: \"4b49422f-6fab-47a3-956f-b78c3784dc3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsmnb" Jun 09 12:41:12.141233 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.141017 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a1b0f311-294d-4b26-b1ae-84ecd996fc34-cnibin\") pod \"multus-additional-cni-plugins-vhn5n\" (UID: \"a1b0f311-294d-4b26-b1ae-84ecd996fc34\") " pod="openshift-multus/multus-additional-cni-plugins-vhn5n" Jun 09 12:41:12.141233 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.141035 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4b49422f-6fab-47a3-956f-b78c3784dc3c-run-systemd\") pod \"ovnkube-node-tsmnb\" (UID: \"4b49422f-6fab-47a3-956f-b78c3784dc3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsmnb" Jun 09 12:41:12.141233 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.141058 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4b49422f-6fab-47a3-956f-b78c3784dc3c-host-slash\") pod \"ovnkube-node-tsmnb\" (UID: \"4b49422f-6fab-47a3-956f-b78c3784dc3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsmnb" Jun 09 12:41:12.141233 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.141063 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4b49422f-6fab-47a3-956f-b78c3784dc3c-env-overrides\") pod \"ovnkube-node-tsmnb\" (UID: \"4b49422f-6fab-47a3-956f-b78c3784dc3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsmnb" Jun 09 12:41:12.141233 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.141070 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4b49422f-6fab-47a3-956f-b78c3784dc3c-run-systemd\") pod \"ovnkube-node-tsmnb\" (UID: \"4b49422f-6fab-47a3-956f-b78c3784dc3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsmnb" Jun 09 12:41:12.141233 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.141093 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b6d83a37-95b0-4f9e-ac03-5c0927e92520-etc-sysconfig\") pod \"tuned-xcnw9\" (UID: \"b6d83a37-95b0-4f9e-ac03-5c0927e92520\") " pod="openshift-cluster-node-tuning-operator/tuned-xcnw9" Jun 09 12:41:12.141233 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.141109 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b6d83a37-95b0-4f9e-ac03-5c0927e92520-host\") pod \"tuned-xcnw9\" (UID: \"b6d83a37-95b0-4f9e-ac03-5c0927e92520\") " pod="openshift-cluster-node-tuning-operator/tuned-xcnw9" Jun 09 12:41:12.141233 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.141127 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/688d2f31-5684-43d2-81e4-a8c0b73565f5-etc-selinux\") pod \"aws-ebs-csi-driver-node-7nwz6\" (UID: \"688d2f31-5684-43d2-81e4-a8c0b73565f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nwz6" Jun 09 12:41:12.141233 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.141152 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b49422f-6fab-47a3-956f-b78c3784dc3c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tsmnb\" (UID: \"4b49422f-6fab-47a3-956f-b78c3784dc3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsmnb" Jun 09 12:41:12.141233 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.141154 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b6d83a37-95b0-4f9e-ac03-5c0927e92520-etc-sysconfig\") pod \"tuned-xcnw9\" (UID: \"b6d83a37-95b0-4f9e-ac03-5c0927e92520\") " pod="openshift-cluster-node-tuning-operator/tuned-xcnw9" Jun 09 12:41:12.141233 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.141184 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b6d83a37-95b0-4f9e-ac03-5c0927e92520-host\") pod \"tuned-xcnw9\" (UID: \"b6d83a37-95b0-4f9e-ac03-5c0927e92520\") " pod="openshift-cluster-node-tuning-operator/tuned-xcnw9" Jun 09 12:41:12.141233 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.141215 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b49422f-6fab-47a3-956f-b78c3784dc3c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tsmnb\" (UID: \"4b49422f-6fab-47a3-956f-b78c3784dc3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsmnb" Jun 09 12:41:12.141233 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.141235 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/98f6370c-d970-420a-afcc-7abb56d7c44e-konnectivity-ca\") pod \"konnectivity-agent-kj5x2\" (UID: \"98f6370c-d970-420a-afcc-7abb56d7c44e\") " pod="kube-system/konnectivity-agent-kj5x2" Jun 09 12:41:12.141836 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.141252 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mklp8\" (UniqueName: \"kubernetes.io/projected/a8b7f08f-8ac0-4cc8-b9c3-9dc0451f79c8-kube-api-access-mklp8\") pod \"node-ca-4n62g\" (UID: \"a8b7f08f-8ac0-4cc8-b9c3-9dc0451f79c8\") " pod="openshift-image-registry/node-ca-4n62g" Jun 09 12:41:12.141836 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.141273 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c9ff1a02-bda3-4cd7-bc7c-aa86cf372357-os-release\") pod \"multus-9khwg\" (UID: \"c9ff1a02-bda3-4cd7-bc7c-aa86cf372357\") " pod="openshift-multus/multus-9khwg" Jun 09 12:41:12.141836 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.141290 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4b49422f-6fab-47a3-956f-b78c3784dc3c-host-run-netns\") pod \"ovnkube-node-tsmnb\" (UID: \"4b49422f-6fab-47a3-956f-b78c3784dc3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsmnb" Jun 09 12:41:12.141836 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.141310 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/688d2f31-5684-43d2-81e4-a8c0b73565f5-device-dir\") pod \"aws-ebs-csi-driver-node-7nwz6\" (UID: \"688d2f31-5684-43d2-81e4-a8c0b73565f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nwz6" Jun 09 12:41:12.141836 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.141327 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4b49422f-6fab-47a3-956f-b78c3784dc3c-host-run-netns\") pod \"ovnkube-node-tsmnb\" (UID: \"4b49422f-6fab-47a3-956f-b78c3784dc3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsmnb" Jun 09 12:41:12.141836 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.141350 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a8b7f08f-8ac0-4cc8-b9c3-9dc0451f79c8-host\") pod \"node-ca-4n62g\" (UID: \"a8b7f08f-8ac0-4cc8-b9c3-9dc0451f79c8\") " pod="openshift-image-registry/node-ca-4n62g" Jun 09 12:41:12.141836 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.141366 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c9ff1a02-bda3-4cd7-bc7c-aa86cf372357-multus-socket-dir-parent\") pod \"multus-9khwg\" (UID: \"c9ff1a02-bda3-4cd7-bc7c-aa86cf372357\") " pod="openshift-multus/multus-9khwg" Jun 09 12:41:12.141836 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.141395 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/94fe31fd-8a59-4bff-b38f-43dfb84073f3-iptables-alerter-script\") pod \"iptables-alerter-lpnt2\" (UID: \"94fe31fd-8a59-4bff-b38f-43dfb84073f3\") " pod="openshift-network-operator/iptables-alerter-lpnt2" Jun 09 12:41:12.141836 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.141460 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b49422f-6fab-47a3-956f-b78c3784dc3c-host-kubelet\") pod \"ovnkube-node-tsmnb\" (UID: \"4b49422f-6fab-47a3-956f-b78c3784dc3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsmnb" Jun 09 12:41:12.141836 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.141509 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c9ff1a02-bda3-4cd7-bc7c-aa86cf372357-system-cni-dir\") pod \"multus-9khwg\" (UID: \"c9ff1a02-bda3-4cd7-bc7c-aa86cf372357\") " pod="openshift-multus/multus-9khwg" Jun 09 12:41:12.141836 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.141545 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4b49422f-6fab-47a3-956f-b78c3784dc3c-env-overrides\") pod \"ovnkube-node-tsmnb\" (UID: \"4b49422f-6fab-47a3-956f-b78c3784dc3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsmnb" Jun 09 12:41:12.141836 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.141563 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b49422f-6fab-47a3-956f-b78c3784dc3c-host-run-ovn-kubernetes\") pod \"ovnkube-node-tsmnb\" (UID: \"4b49422f-6fab-47a3-956f-b78c3784dc3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsmnb" Jun 09 12:41:12.141836 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.141550 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b49422f-6fab-47a3-956f-b78c3784dc3c-host-kubelet\") pod \"ovnkube-node-tsmnb\" (UID: \"4b49422f-6fab-47a3-956f-b78c3784dc3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsmnb" Jun 09 12:41:12.141836 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.141581 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b6d83a37-95b0-4f9e-ac03-5c0927e92520-var-lib-kubelet\") pod \"tuned-xcnw9\" (UID: \"b6d83a37-95b0-4f9e-ac03-5c0927e92520\") " pod="openshift-cluster-node-tuning-operator/tuned-xcnw9" Jun 09 12:41:12.141836 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.141615 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b49422f-6fab-47a3-956f-b78c3784dc3c-host-run-ovn-kubernetes\") pod \"ovnkube-node-tsmnb\" (UID: \"4b49422f-6fab-47a3-956f-b78c3784dc3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsmnb" Jun 09 12:41:12.141836 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.141620 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b6d83a37-95b0-4f9e-ac03-5c0927e92520-var-lib-kubelet\") pod \"tuned-xcnw9\" (UID: \"b6d83a37-95b0-4f9e-ac03-5c0927e92520\") " pod="openshift-cluster-node-tuning-operator/tuned-xcnw9" Jun 09 12:41:12.141836 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.141645 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgjkt\" (UniqueName: \"kubernetes.io/projected/b6d83a37-95b0-4f9e-ac03-5c0927e92520-kube-api-access-bgjkt\") pod \"tuned-xcnw9\" (UID: \"b6d83a37-95b0-4f9e-ac03-5c0927e92520\") " pod="openshift-cluster-node-tuning-operator/tuned-xcnw9" Jun 09 12:41:12.142568 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.141668 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnh6l\" (UniqueName: \"kubernetes.io/projected/688d2f31-5684-43d2-81e4-a8c0b73565f5-kube-api-access-nnh6l\") pod \"aws-ebs-csi-driver-node-7nwz6\" (UID: \"688d2f31-5684-43d2-81e4-a8c0b73565f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nwz6" Jun 09 12:41:12.142568 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.141685 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c9ff1a02-bda3-4cd7-bc7c-aa86cf372357-multus-cni-dir\") pod \"multus-9khwg\" (UID: \"c9ff1a02-bda3-4cd7-bc7c-aa86cf372357\") " pod="openshift-multus/multus-9khwg" Jun 09 12:41:12.142568 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.141704 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c9ff1a02-bda3-4cd7-bc7c-aa86cf372357-host-run-netns\") pod \"multus-9khwg\" (UID: \"c9ff1a02-bda3-4cd7-bc7c-aa86cf372357\") " pod="openshift-multus/multus-9khwg" Jun 09 12:41:12.142568 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.141732 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c9ff1a02-bda3-4cd7-bc7c-aa86cf372357-hostroot\") pod \"multus-9khwg\" (UID: \"c9ff1a02-bda3-4cd7-bc7c-aa86cf372357\") " pod="openshift-multus/multus-9khwg" Jun 09 12:41:12.142568 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.141770 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c9ff1a02-bda3-4cd7-bc7c-aa86cf372357-multus-daemon-config\") pod \"multus-9khwg\" (UID: \"c9ff1a02-bda3-4cd7-bc7c-aa86cf372357\") " pod="openshift-multus/multus-9khwg" Jun 09 12:41:12.142568 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.141794 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b49422f-6fab-47a3-956f-b78c3784dc3c-etc-openvswitch\") pod \"ovnkube-node-tsmnb\" (UID: \"4b49422f-6fab-47a3-956f-b78c3784dc3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsmnb" Jun 09 12:41:12.142568 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.141837 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b49422f-6fab-47a3-956f-b78c3784dc3c-run-openvswitch\") pod \"ovnkube-node-tsmnb\" (UID: \"4b49422f-6fab-47a3-956f-b78c3784dc3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsmnb" Jun 09 12:41:12.142568 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.141859 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b6d83a37-95b0-4f9e-ac03-5c0927e92520-etc-modprobe-d\") pod \"tuned-xcnw9\" (UID: \"b6d83a37-95b0-4f9e-ac03-5c0927e92520\") " pod="openshift-cluster-node-tuning-operator/tuned-xcnw9" Jun 09 12:41:12.142568 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.141886 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b6d83a37-95b0-4f9e-ac03-5c0927e92520-run\") pod \"tuned-xcnw9\" (UID: \"b6d83a37-95b0-4f9e-ac03-5c0927e92520\") " pod="openshift-cluster-node-tuning-operator/tuned-xcnw9" Jun 09 12:41:12.142568 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.141905 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b49422f-6fab-47a3-956f-b78c3784dc3c-etc-openvswitch\") pod \"ovnkube-node-tsmnb\" (UID: \"4b49422f-6fab-47a3-956f-b78c3784dc3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsmnb" Jun 09 12:41:12.142568 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.141909 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c9ff1a02-bda3-4cd7-bc7c-aa86cf372357-etc-kubernetes\") pod \"multus-9khwg\" (UID: \"c9ff1a02-bda3-4cd7-bc7c-aa86cf372357\") " pod="openshift-multus/multus-9khwg" Jun 09 12:41:12.142568 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.141929 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b49422f-6fab-47a3-956f-b78c3784dc3c-run-openvswitch\") pod \"ovnkube-node-tsmnb\" (UID: \"4b49422f-6fab-47a3-956f-b78c3784dc3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsmnb" Jun 09 12:41:12.142568 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.141942 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3a86fe59-f4c8-4c09-9f19-6fada48b8194-original-pull-secret\") pod \"global-pull-secret-syncer-br4cc\" (UID: \"3a86fe59-f4c8-4c09-9f19-6fada48b8194\") " pod="kube-system/global-pull-secret-syncer-br4cc" Jun 09 12:41:12.142568 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.141946 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/94fe31fd-8a59-4bff-b38f-43dfb84073f3-iptables-alerter-script\") pod \"iptables-alerter-lpnt2\" (UID: \"94fe31fd-8a59-4bff-b38f-43dfb84073f3\") " pod="openshift-network-operator/iptables-alerter-lpnt2" Jun 09 12:41:12.142568 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.141959 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b6d83a37-95b0-4f9e-ac03-5c0927e92520-run\") pod \"tuned-xcnw9\" (UID: \"b6d83a37-95b0-4f9e-ac03-5c0927e92520\") " pod="openshift-cluster-node-tuning-operator/tuned-xcnw9" Jun 09 12:41:12.142568 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.141987 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/00dcaa51-80f6-4fcd-9eb0-8c27466112df-tmp-dir\") pod \"node-resolver-xlxkq\" (UID: \"00dcaa51-80f6-4fcd-9eb0-8c27466112df\") " pod="openshift-dns/node-resolver-xlxkq" Jun 09 12:41:12.142568 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.142019 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b6d83a37-95b0-4f9e-ac03-5c0927e92520-etc-kubernetes\") pod \"tuned-xcnw9\" (UID: \"b6d83a37-95b0-4f9e-ac03-5c0927e92520\") " pod="openshift-cluster-node-tuning-operator/tuned-xcnw9" Jun 09 12:41:12.143378 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.142048 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b6d83a37-95b0-4f9e-ac03-5c0927e92520-etc-modprobe-d\") pod \"tuned-xcnw9\" (UID: \"b6d83a37-95b0-4f9e-ac03-5c0927e92520\") " pod="openshift-cluster-node-tuning-operator/tuned-xcnw9" Jun 09 12:41:12.143378 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.142074 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a1b0f311-294d-4b26-b1ae-84ecd996fc34-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vhn5n\" (UID: \"a1b0f311-294d-4b26-b1ae-84ecd996fc34\") " pod="openshift-multus/multus-additional-cni-plugins-vhn5n" Jun 09 12:41:12.143378 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.142081 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b6d83a37-95b0-4f9e-ac03-5c0927e92520-etc-kubernetes\") pod \"tuned-xcnw9\" (UID: \"b6d83a37-95b0-4f9e-ac03-5c0927e92520\") " pod="openshift-cluster-node-tuning-operator/tuned-xcnw9" Jun 09 12:41:12.143378 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.142101 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/94fe31fd-8a59-4bff-b38f-43dfb84073f3-host-slash\") pod \"iptables-alerter-lpnt2\" (UID: \"94fe31fd-8a59-4bff-b38f-43dfb84073f3\") " pod="openshift-network-operator/iptables-alerter-lpnt2" Jun 09 12:41:12.143378 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.142142 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b6d83a37-95b0-4f9e-ac03-5c0927e92520-sys\") pod \"tuned-xcnw9\" (UID: \"b6d83a37-95b0-4f9e-ac03-5c0927e92520\") " pod="openshift-cluster-node-tuning-operator/tuned-xcnw9" Jun 09 12:41:12.143378 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.142169 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/94fe31fd-8a59-4bff-b38f-43dfb84073f3-host-slash\") pod \"iptables-alerter-lpnt2\" (UID: \"94fe31fd-8a59-4bff-b38f-43dfb84073f3\") " pod="openshift-network-operator/iptables-alerter-lpnt2" Jun 09 12:41:12.143378 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.142165 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/00dcaa51-80f6-4fcd-9eb0-8c27466112df-hosts-file\") pod \"node-resolver-xlxkq\" (UID: \"00dcaa51-80f6-4fcd-9eb0-8c27466112df\") " pod="openshift-dns/node-resolver-xlxkq" Jun 09 12:41:12.143378 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.142202 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a1b0f311-294d-4b26-b1ae-84ecd996fc34-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vhn5n\" (UID: \"a1b0f311-294d-4b26-b1ae-84ecd996fc34\") " pod="openshift-multus/multus-additional-cni-plugins-vhn5n" Jun 09 12:41:12.143378 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.142218 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4b49422f-6fab-47a3-956f-b78c3784dc3c-ovnkube-config\") pod \"ovnkube-node-tsmnb\" (UID: \"4b49422f-6fab-47a3-956f-b78c3784dc3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsmnb" Jun 09 12:41:12.143378 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.142232 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/00dcaa51-80f6-4fcd-9eb0-8c27466112df-hosts-file\") pod \"node-resolver-xlxkq\" (UID: \"00dcaa51-80f6-4fcd-9eb0-8c27466112df\") " pod="openshift-dns/node-resolver-xlxkq" Jun 09 12:41:12.143378 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.142233 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4b49422f-6fab-47a3-956f-b78c3784dc3c-ovn-node-metrics-cert\") pod \"ovnkube-node-tsmnb\" (UID: \"4b49422f-6fab-47a3-956f-b78c3784dc3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsmnb" Jun 09 12:41:12.143378 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.142202 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b6d83a37-95b0-4f9e-ac03-5c0927e92520-sys\") pod \"tuned-xcnw9\" (UID: \"b6d83a37-95b0-4f9e-ac03-5c0927e92520\") " pod="openshift-cluster-node-tuning-operator/tuned-xcnw9" Jun 09 12:41:12.143378 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.142270 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4b49422f-6fab-47a3-956f-b78c3784dc3c-ovnkube-script-lib\") pod \"ovnkube-node-tsmnb\" (UID: \"4b49422f-6fab-47a3-956f-b78c3784dc3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsmnb" Jun 09 12:41:12.143378 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.142295 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b6d83a37-95b0-4f9e-ac03-5c0927e92520-etc-sysctl-d\") pod \"tuned-xcnw9\" (UID: \"b6d83a37-95b0-4f9e-ac03-5c0927e92520\") " pod="openshift-cluster-node-tuning-operator/tuned-xcnw9" Jun 09 12:41:12.143378 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.142262 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/00dcaa51-80f6-4fcd-9eb0-8c27466112df-tmp-dir\") pod \"node-resolver-xlxkq\" (UID: \"00dcaa51-80f6-4fcd-9eb0-8c27466112df\") " pod="openshift-dns/node-resolver-xlxkq" Jun 09 12:41:12.143378 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.142321 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/688d2f31-5684-43d2-81e4-a8c0b73565f5-socket-dir\") pod \"aws-ebs-csi-driver-node-7nwz6\" (UID: \"688d2f31-5684-43d2-81e4-a8c0b73565f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nwz6" Jun 09 12:41:12.143378 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.142352 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c9ff1a02-bda3-4cd7-bc7c-aa86cf372357-cnibin\") pod \"multus-9khwg\" (UID: \"c9ff1a02-bda3-4cd7-bc7c-aa86cf372357\") " pod="openshift-multus/multus-9khwg" Jun 09 12:41:12.144190 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.142376 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b6d83a37-95b0-4f9e-ac03-5c0927e92520-etc-tuned\") pod \"tuned-xcnw9\" (UID: \"b6d83a37-95b0-4f9e-ac03-5c0927e92520\") " pod="openshift-cluster-node-tuning-operator/tuned-xcnw9" Jun 09 12:41:12.144190 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.142401 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/688d2f31-5684-43d2-81e4-a8c0b73565f5-registration-dir\") pod \"aws-ebs-csi-driver-node-7nwz6\" (UID: \"688d2f31-5684-43d2-81e4-a8c0b73565f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nwz6" Jun 09 12:41:12.144190 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.142428 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c9ff1a02-bda3-4cd7-bc7c-aa86cf372357-host-run-k8s-cni-cncf-io\") pod \"multus-9khwg\" (UID: \"c9ff1a02-bda3-4cd7-bc7c-aa86cf372357\") " pod="openshift-multus/multus-9khwg" Jun 09 12:41:12.144190 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.142459 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b6d83a37-95b0-4f9e-ac03-5c0927e92520-etc-sysctl-d\") pod \"tuned-xcnw9\" (UID: \"b6d83a37-95b0-4f9e-ac03-5c0927e92520\") " pod="openshift-cluster-node-tuning-operator/tuned-xcnw9" Jun 09 12:41:12.144190 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.142472 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmbwj\" (UniqueName: \"kubernetes.io/projected/c9511ce2-9c98-4362-8953-c323b4bdd636-kube-api-access-lmbwj\") pod \"network-metrics-daemon-xcq9r\" (UID: \"c9511ce2-9c98-4362-8953-c323b4bdd636\") " pod="openshift-multus/network-metrics-daemon-xcq9r" Jun 09 12:41:12.144190 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.142547 2561 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 09 12:41:12.144190 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.142620 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a1b0f311-294d-4b26-b1ae-84ecd996fc34-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vhn5n\" (UID: \"a1b0f311-294d-4b26-b1ae-84ecd996fc34\") " pod="openshift-multus/multus-additional-cni-plugins-vhn5n" Jun 09 12:41:12.144190 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.142773 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4b49422f-6fab-47a3-956f-b78c3784dc3c-ovnkube-config\") pod \"ovnkube-node-tsmnb\" (UID: \"4b49422f-6fab-47a3-956f-b78c3784dc3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsmnb" Jun 09 12:41:12.144190 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.142774 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a1b0f311-294d-4b26-b1ae-84ecd996fc34-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vhn5n\" (UID: \"a1b0f311-294d-4b26-b1ae-84ecd996fc34\") " pod="openshift-multus/multus-additional-cni-plugins-vhn5n" Jun 09 12:41:12.144190 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.142773 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxggp\" (UniqueName: \"kubernetes.io/projected/00dcaa51-80f6-4fcd-9eb0-8c27466112df-kube-api-access-qxggp\") pod \"node-resolver-xlxkq\" (UID: \"00dcaa51-80f6-4fcd-9eb0-8c27466112df\") " pod="openshift-dns/node-resolver-xlxkq" Jun 09 12:41:12.144190 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.142857 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4b49422f-6fab-47a3-956f-b78c3784dc3c-run-ovn\") pod \"ovnkube-node-tsmnb\" (UID: \"4b49422f-6fab-47a3-956f-b78c3784dc3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsmnb" Jun 09 12:41:12.144190 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.142885 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4b49422f-6fab-47a3-956f-b78c3784dc3c-host-cni-bin\") pod \"ovnkube-node-tsmnb\" (UID: \"4b49422f-6fab-47a3-956f-b78c3784dc3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsmnb" Jun 09 12:41:12.144190 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.142911 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/688d2f31-5684-43d2-81e4-a8c0b73565f5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7nwz6\" (UID: \"688d2f31-5684-43d2-81e4-a8c0b73565f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nwz6" Jun 09 12:41:12.144190 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.142940 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9511ce2-9c98-4362-8953-c323b4bdd636-metrics-certs\") pod \"network-metrics-daemon-xcq9r\" (UID: \"c9511ce2-9c98-4362-8953-c323b4bdd636\") " pod="openshift-multus/network-metrics-daemon-xcq9r" Jun 09 12:41:12.144190 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.142964 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3a86fe59-f4c8-4c09-9f19-6fada48b8194-kubelet-config\") pod \"global-pull-secret-syncer-br4cc\" (UID: \"3a86fe59-f4c8-4c09-9f19-6fada48b8194\") " pod="kube-system/global-pull-secret-syncer-br4cc" Jun 09 12:41:12.144190 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.142976 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4b49422f-6fab-47a3-956f-b78c3784dc3c-ovnkube-script-lib\") pod \"ovnkube-node-tsmnb\" (UID: \"4b49422f-6fab-47a3-956f-b78c3784dc3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsmnb" Jun 09 12:41:12.144190 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.142997 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a1b0f311-294d-4b26-b1ae-84ecd996fc34-os-release\") pod \"multus-additional-cni-plugins-vhn5n\" (UID: \"a1b0f311-294d-4b26-b1ae-84ecd996fc34\") " pod="openshift-multus/multus-additional-cni-plugins-vhn5n" Jun 09 12:41:12.145030 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.143024 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a1b0f311-294d-4b26-b1ae-84ecd996fc34-cni-binary-copy\") pod \"multus-additional-cni-plugins-vhn5n\" (UID: \"a1b0f311-294d-4b26-b1ae-84ecd996fc34\") " pod="openshift-multus/multus-additional-cni-plugins-vhn5n" Jun 09 12:41:12.145030 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.143053 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4b49422f-6fab-47a3-956f-b78c3784dc3c-run-ovn\") pod \"ovnkube-node-tsmnb\" (UID: \"4b49422f-6fab-47a3-956f-b78c3784dc3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsmnb" Jun 09 12:41:12.145030 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.143067 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4b49422f-6fab-47a3-956f-b78c3784dc3c-node-log\") pod \"ovnkube-node-tsmnb\" (UID: \"4b49422f-6fab-47a3-956f-b78c3784dc3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsmnb" Jun 09 12:41:12.145030 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.143094 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4b49422f-6fab-47a3-956f-b78c3784dc3c-log-socket\") pod \"ovnkube-node-tsmnb\" (UID: \"4b49422f-6fab-47a3-956f-b78c3784dc3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsmnb" Jun 09 12:41:12.145030 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.143096 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4b49422f-6fab-47a3-956f-b78c3784dc3c-host-cni-bin\") pod \"ovnkube-node-tsmnb\" (UID: \"4b49422f-6fab-47a3-956f-b78c3784dc3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsmnb" Jun 09 12:41:12.145030 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.143133 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4b49422f-6fab-47a3-956f-b78c3784dc3c-node-log\") pod \"ovnkube-node-tsmnb\" (UID: \"4b49422f-6fab-47a3-956f-b78c3784dc3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsmnb" Jun 09 12:41:12.145030 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.143150 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a1b0f311-294d-4b26-b1ae-84ecd996fc34-os-release\") pod \"multus-additional-cni-plugins-vhn5n\" (UID: \"a1b0f311-294d-4b26-b1ae-84ecd996fc34\") " pod="openshift-multus/multus-additional-cni-plugins-vhn5n" Jun 09 12:41:12.145030 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.143162 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a8b7f08f-8ac0-4cc8-b9c3-9dc0451f79c8-serviceca\") pod \"node-ca-4n62g\" (UID: \"a8b7f08f-8ac0-4cc8-b9c3-9dc0451f79c8\") " pod="openshift-image-registry/node-ca-4n62g" Jun 09 12:41:12.145030 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.143161 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4b49422f-6fab-47a3-956f-b78c3784dc3c-log-socket\") pod \"ovnkube-node-tsmnb\" (UID: \"4b49422f-6fab-47a3-956f-b78c3784dc3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsmnb" Jun 09 12:41:12.145030 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.143192 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhhww\" (UniqueName: \"kubernetes.io/projected/12a5bda4-80f2-4135-ad58-d5a14bceef3f-kube-api-access-mhhww\") pod \"network-check-target-mq44p\" (UID: \"12a5bda4-80f2-4135-ad58-d5a14bceef3f\") " pod="openshift-network-diagnostics/network-check-target-mq44p" Jun 09 12:41:12.145030 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.143221 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4b49422f-6fab-47a3-956f-b78c3784dc3c-host-cni-netd\") pod \"ovnkube-node-tsmnb\" (UID: \"4b49422f-6fab-47a3-956f-b78c3784dc3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsmnb" Jun 09 12:41:12.145030 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.143246 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b6d83a37-95b0-4f9e-ac03-5c0927e92520-lib-modules\") pod \"tuned-xcnw9\" (UID: \"b6d83a37-95b0-4f9e-ac03-5c0927e92520\") " pod="openshift-cluster-node-tuning-operator/tuned-xcnw9" Jun 09 12:41:12.145030 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.143271 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/688d2f31-5684-43d2-81e4-a8c0b73565f5-sys-fs\") pod \"aws-ebs-csi-driver-node-7nwz6\" (UID: \"688d2f31-5684-43d2-81e4-a8c0b73565f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nwz6" Jun 09 12:41:12.145030 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.143280 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/98f6370c-d970-420a-afcc-7abb56d7c44e-konnectivity-ca\") pod \"konnectivity-agent-kj5x2\" (UID: \"98f6370c-d970-420a-afcc-7abb56d7c44e\") " pod="kube-system/konnectivity-agent-kj5x2" Jun 09 12:41:12.145030 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.143294 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvk2b\" (UniqueName: \"kubernetes.io/projected/c9ff1a02-bda3-4cd7-bc7c-aa86cf372357-kube-api-access-nvk2b\") pod \"multus-9khwg\" (UID: \"c9ff1a02-bda3-4cd7-bc7c-aa86cf372357\") " pod="openshift-multus/multus-9khwg" Jun 09 12:41:12.145030 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.143292 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4b49422f-6fab-47a3-956f-b78c3784dc3c-host-cni-netd\") pod \"ovnkube-node-tsmnb\" (UID: \"4b49422f-6fab-47a3-956f-b78c3784dc3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsmnb" Jun 09 12:41:12.145030 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.143319 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3a86fe59-f4c8-4c09-9f19-6fada48b8194-dbus\") pod \"global-pull-secret-syncer-br4cc\" (UID: \"3a86fe59-f4c8-4c09-9f19-6fada48b8194\") " pod="kube-system/global-pull-secret-syncer-br4cc" Jun 09 12:41:12.145779 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.143350 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a1b0f311-294d-4b26-b1ae-84ecd996fc34-system-cni-dir\") pod \"multus-additional-cni-plugins-vhn5n\" (UID: \"a1b0f311-294d-4b26-b1ae-84ecd996fc34\") " pod="openshift-multus/multus-additional-cni-plugins-vhn5n" Jun 09 12:41:12.145779 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.143371 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4b49422f-6fab-47a3-956f-b78c3784dc3c-systemd-units\") pod \"ovnkube-node-tsmnb\" (UID: \"4b49422f-6fab-47a3-956f-b78c3784dc3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsmnb" Jun 09 12:41:12.145779 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.143394 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/98f6370c-d970-420a-afcc-7abb56d7c44e-agent-certs\") pod \"konnectivity-agent-kj5x2\" (UID: \"98f6370c-d970-420a-afcc-7abb56d7c44e\") " pod="kube-system/konnectivity-agent-kj5x2" Jun 09 12:41:12.145779 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.143406 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a1b0f311-294d-4b26-b1ae-84ecd996fc34-system-cni-dir\") pod \"multus-additional-cni-plugins-vhn5n\" (UID: \"a1b0f311-294d-4b26-b1ae-84ecd996fc34\") " pod="openshift-multus/multus-additional-cni-plugins-vhn5n" Jun 09 12:41:12.145779 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.143412 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4b49422f-6fab-47a3-956f-b78c3784dc3c-systemd-units\") pod \"ovnkube-node-tsmnb\" (UID: \"4b49422f-6fab-47a3-956f-b78c3784dc3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsmnb" Jun 09 12:41:12.145779 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.143416 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b6d83a37-95b0-4f9e-ac03-5c0927e92520-tmp\") pod \"tuned-xcnw9\" (UID: \"b6d83a37-95b0-4f9e-ac03-5c0927e92520\") " pod="openshift-cluster-node-tuning-operator/tuned-xcnw9" Jun 09 12:41:12.145779 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.143370 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b6d83a37-95b0-4f9e-ac03-5c0927e92520-lib-modules\") pod \"tuned-xcnw9\" (UID: \"b6d83a37-95b0-4f9e-ac03-5c0927e92520\") " pod="openshift-cluster-node-tuning-operator/tuned-xcnw9" Jun 09 12:41:12.145779 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.143473 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c9ff1a02-bda3-4cd7-bc7c-aa86cf372357-cni-binary-copy\") pod \"multus-9khwg\" (UID: \"c9ff1a02-bda3-4cd7-bc7c-aa86cf372357\") " pod="openshift-multus/multus-9khwg" Jun 09 12:41:12.145779 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.143503 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c9ff1a02-bda3-4cd7-bc7c-aa86cf372357-host-var-lib-cni-bin\") pod \"multus-9khwg\" (UID: \"c9ff1a02-bda3-4cd7-bc7c-aa86cf372357\") " pod="openshift-multus/multus-9khwg" Jun 09 12:41:12.145779 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.143544 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a1b0f311-294d-4b26-b1ae-84ecd996fc34-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vhn5n\" (UID: \"a1b0f311-294d-4b26-b1ae-84ecd996fc34\") " pod="openshift-multus/multus-additional-cni-plugins-vhn5n" Jun 09 12:41:12.145779 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.143554 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a1b0f311-294d-4b26-b1ae-84ecd996fc34-cni-binary-copy\") pod \"multus-additional-cni-plugins-vhn5n\" (UID: \"a1b0f311-294d-4b26-b1ae-84ecd996fc34\") " pod="openshift-multus/multus-additional-cni-plugins-vhn5n" Jun 09 12:41:12.145779 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.143572 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5s8cs\" (UniqueName: \"kubernetes.io/projected/4b49422f-6fab-47a3-956f-b78c3784dc3c-kube-api-access-5s8cs\") pod \"ovnkube-node-tsmnb\" (UID: \"4b49422f-6fab-47a3-956f-b78c3784dc3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsmnb" Jun 09 12:41:12.145779 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.143599 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b6d83a37-95b0-4f9e-ac03-5c0927e92520-etc-sysctl-conf\") pod \"tuned-xcnw9\" (UID: \"b6d83a37-95b0-4f9e-ac03-5c0927e92520\") " pod="openshift-cluster-node-tuning-operator/tuned-xcnw9" Jun 09 12:41:12.145779 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.143752 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b6d83a37-95b0-4f9e-ac03-5c0927e92520-etc-sysctl-conf\") pod \"tuned-xcnw9\" (UID: \"b6d83a37-95b0-4f9e-ac03-5c0927e92520\") " pod="openshift-cluster-node-tuning-operator/tuned-xcnw9" Jun 09 12:41:12.145779 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.143762 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a1b0f311-294d-4b26-b1ae-84ecd996fc34-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vhn5n\" (UID: \"a1b0f311-294d-4b26-b1ae-84ecd996fc34\") " pod="openshift-multus/multus-additional-cni-plugins-vhn5n" Jun 09 12:41:12.145779 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.145178 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b6d83a37-95b0-4f9e-ac03-5c0927e92520-etc-tuned\") pod \"tuned-xcnw9\" (UID: \"b6d83a37-95b0-4f9e-ac03-5c0927e92520\") " pod="openshift-cluster-node-tuning-operator/tuned-xcnw9" Jun 09 12:41:12.145779 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.145306 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4b49422f-6fab-47a3-956f-b78c3784dc3c-ovn-node-metrics-cert\") pod \"ovnkube-node-tsmnb\" (UID: \"4b49422f-6fab-47a3-956f-b78c3784dc3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsmnb" Jun 09 12:41:12.146297 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.145564 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/98f6370c-d970-420a-afcc-7abb56d7c44e-agent-certs\") pod \"konnectivity-agent-kj5x2\" (UID: \"98f6370c-d970-420a-afcc-7abb56d7c44e\") " pod="kube-system/konnectivity-agent-kj5x2" Jun 09 12:41:12.146297 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.145802 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b6d83a37-95b0-4f9e-ac03-5c0927e92520-tmp\") pod \"tuned-xcnw9\" (UID: \"b6d83a37-95b0-4f9e-ac03-5c0927e92520\") " pod="openshift-cluster-node-tuning-operator/tuned-xcnw9" Jun 09 12:41:12.156221 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.156196 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t58gh\" (UniqueName: \"kubernetes.io/projected/94fe31fd-8a59-4bff-b38f-43dfb84073f3-kube-api-access-t58gh\") pod \"iptables-alerter-lpnt2\" (UID: \"94fe31fd-8a59-4bff-b38f-43dfb84073f3\") " pod="openshift-network-operator/iptables-alerter-lpnt2" Jun 09 12:41:12.156910 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.156890 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxggp\" (UniqueName: \"kubernetes.io/projected/00dcaa51-80f6-4fcd-9eb0-8c27466112df-kube-api-access-qxggp\") pod \"node-resolver-xlxkq\" (UID: \"00dcaa51-80f6-4fcd-9eb0-8c27466112df\") " pod="openshift-dns/node-resolver-xlxkq" Jun 09 12:41:12.157188 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.157166 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgjkt\" (UniqueName: \"kubernetes.io/projected/b6d83a37-95b0-4f9e-ac03-5c0927e92520-kube-api-access-bgjkt\") pod \"tuned-xcnw9\" (UID: \"b6d83a37-95b0-4f9e-ac03-5c0927e92520\") " pod="openshift-cluster-node-tuning-operator/tuned-xcnw9" Jun 09 12:41:12.157961 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.157944 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkhkl\" (UniqueName: \"kubernetes.io/projected/a1b0f311-294d-4b26-b1ae-84ecd996fc34-kube-api-access-tkhkl\") pod \"multus-additional-cni-plugins-vhn5n\" (UID: \"a1b0f311-294d-4b26-b1ae-84ecd996fc34\") " pod="openshift-multus/multus-additional-cni-plugins-vhn5n" Jun 09 12:41:12.158149 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.158133 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5s8cs\" (UniqueName: \"kubernetes.io/projected/4b49422f-6fab-47a3-956f-b78c3784dc3c-kube-api-access-5s8cs\") pod \"ovnkube-node-tsmnb\" (UID: \"4b49422f-6fab-47a3-956f-b78c3784dc3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tsmnb" Jun 09 12:41:12.243985 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.243958 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/688d2f31-5684-43d2-81e4-a8c0b73565f5-etc-selinux\") pod \"aws-ebs-csi-driver-node-7nwz6\" (UID: \"688d2f31-5684-43d2-81e4-a8c0b73565f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nwz6" Jun 09 12:41:12.244110 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.243991 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mklp8\" (UniqueName: \"kubernetes.io/projected/a8b7f08f-8ac0-4cc8-b9c3-9dc0451f79c8-kube-api-access-mklp8\") pod \"node-ca-4n62g\" (UID: \"a8b7f08f-8ac0-4cc8-b9c3-9dc0451f79c8\") " pod="openshift-image-registry/node-ca-4n62g" Jun 09 12:41:12.244110 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.244007 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c9ff1a02-bda3-4cd7-bc7c-aa86cf372357-os-release\") pod \"multus-9khwg\" (UID: \"c9ff1a02-bda3-4cd7-bc7c-aa86cf372357\") " pod="openshift-multus/multus-9khwg" Jun 09 12:41:12.244110 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.244030 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/688d2f31-5684-43d2-81e4-a8c0b73565f5-device-dir\") pod \"aws-ebs-csi-driver-node-7nwz6\" (UID: \"688d2f31-5684-43d2-81e4-a8c0b73565f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nwz6" Jun 09 12:41:12.244110 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.244082 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/688d2f31-5684-43d2-81e4-a8c0b73565f5-etc-selinux\") pod \"aws-ebs-csi-driver-node-7nwz6\" (UID: \"688d2f31-5684-43d2-81e4-a8c0b73565f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nwz6" Jun 09 12:41:12.244110 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.244090 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c9ff1a02-bda3-4cd7-bc7c-aa86cf372357-os-release\") pod \"multus-9khwg\" (UID: \"c9ff1a02-bda3-4cd7-bc7c-aa86cf372357\") " pod="openshift-multus/multus-9khwg" Jun 09 12:41:12.244270 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.244137 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a8b7f08f-8ac0-4cc8-b9c3-9dc0451f79c8-host\") pod \"node-ca-4n62g\" (UID: \"a8b7f08f-8ac0-4cc8-b9c3-9dc0451f79c8\") " pod="openshift-image-registry/node-ca-4n62g" Jun 09 12:41:12.244270 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.244176 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c9ff1a02-bda3-4cd7-bc7c-aa86cf372357-multus-socket-dir-parent\") pod \"multus-9khwg\" (UID: \"c9ff1a02-bda3-4cd7-bc7c-aa86cf372357\") " pod="openshift-multus/multus-9khwg" Jun 09 12:41:12.244270 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.244204 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c9ff1a02-bda3-4cd7-bc7c-aa86cf372357-system-cni-dir\") pod \"multus-9khwg\" (UID: \"c9ff1a02-bda3-4cd7-bc7c-aa86cf372357\") " pod="openshift-multus/multus-9khwg" Jun 09 12:41:12.244270 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.244208 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/688d2f31-5684-43d2-81e4-a8c0b73565f5-device-dir\") pod \"aws-ebs-csi-driver-node-7nwz6\" (UID: \"688d2f31-5684-43d2-81e4-a8c0b73565f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nwz6" Jun 09 12:41:12.244270 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.244213 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a8b7f08f-8ac0-4cc8-b9c3-9dc0451f79c8-host\") pod \"node-ca-4n62g\" (UID: \"a8b7f08f-8ac0-4cc8-b9c3-9dc0451f79c8\") " pod="openshift-image-registry/node-ca-4n62g" Jun 09 12:41:12.244270 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.244231 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnh6l\" (UniqueName: \"kubernetes.io/projected/688d2f31-5684-43d2-81e4-a8c0b73565f5-kube-api-access-nnh6l\") pod \"aws-ebs-csi-driver-node-7nwz6\" (UID: \"688d2f31-5684-43d2-81e4-a8c0b73565f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nwz6" Jun 09 12:41:12.244270 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.244255 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c9ff1a02-bda3-4cd7-bc7c-aa86cf372357-multus-cni-dir\") pod \"multus-9khwg\" (UID: \"c9ff1a02-bda3-4cd7-bc7c-aa86cf372357\") " pod="openshift-multus/multus-9khwg" Jun 09 12:41:12.244270 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.244257 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c9ff1a02-bda3-4cd7-bc7c-aa86cf372357-multus-socket-dir-parent\") pod \"multus-9khwg\" (UID: \"c9ff1a02-bda3-4cd7-bc7c-aa86cf372357\") " pod="openshift-multus/multus-9khwg" Jun 09 12:41:12.244270 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.244262 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c9ff1a02-bda3-4cd7-bc7c-aa86cf372357-system-cni-dir\") pod \"multus-9khwg\" (UID: \"c9ff1a02-bda3-4cd7-bc7c-aa86cf372357\") " pod="openshift-multus/multus-9khwg" Jun 09 12:41:12.244597 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.244319 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c9ff1a02-bda3-4cd7-bc7c-aa86cf372357-multus-cni-dir\") pod \"multus-9khwg\" (UID: \"c9ff1a02-bda3-4cd7-bc7c-aa86cf372357\") " pod="openshift-multus/multus-9khwg" Jun 09 12:41:12.244597 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.244352 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c9ff1a02-bda3-4cd7-bc7c-aa86cf372357-host-run-netns\") pod \"multus-9khwg\" (UID: \"c9ff1a02-bda3-4cd7-bc7c-aa86cf372357\") " pod="openshift-multus/multus-9khwg" Jun 09 12:41:12.244597 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.244376 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c9ff1a02-bda3-4cd7-bc7c-aa86cf372357-hostroot\") pod \"multus-9khwg\" (UID: \"c9ff1a02-bda3-4cd7-bc7c-aa86cf372357\") " pod="openshift-multus/multus-9khwg" Jun 09 12:41:12.244597 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.244402 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c9ff1a02-bda3-4cd7-bc7c-aa86cf372357-multus-daemon-config\") pod \"multus-9khwg\" (UID: \"c9ff1a02-bda3-4cd7-bc7c-aa86cf372357\") " pod="openshift-multus/multus-9khwg" Jun 09 12:41:12.244597 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.244424 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c9ff1a02-bda3-4cd7-bc7c-aa86cf372357-etc-kubernetes\") pod \"multus-9khwg\" (UID: \"c9ff1a02-bda3-4cd7-bc7c-aa86cf372357\") " pod="openshift-multus/multus-9khwg" Jun 09 12:41:12.244597 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.244442 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3a86fe59-f4c8-4c09-9f19-6fada48b8194-original-pull-secret\") pod \"global-pull-secret-syncer-br4cc\" (UID: \"3a86fe59-f4c8-4c09-9f19-6fada48b8194\") " pod="kube-system/global-pull-secret-syncer-br4cc" Jun 09 12:41:12.244597 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.244439 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c9ff1a02-bda3-4cd7-bc7c-aa86cf372357-host-run-netns\") pod \"multus-9khwg\" (UID: \"c9ff1a02-bda3-4cd7-bc7c-aa86cf372357\") " pod="openshift-multus/multus-9khwg" Jun 09 12:41:12.244597 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.244432 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c9ff1a02-bda3-4cd7-bc7c-aa86cf372357-hostroot\") pod \"multus-9khwg\" (UID: \"c9ff1a02-bda3-4cd7-bc7c-aa86cf372357\") " pod="openshift-multus/multus-9khwg" Jun 09 12:41:12.244597 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.244475 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/688d2f31-5684-43d2-81e4-a8c0b73565f5-socket-dir\") pod \"aws-ebs-csi-driver-node-7nwz6\" (UID: \"688d2f31-5684-43d2-81e4-a8c0b73565f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nwz6" Jun 09 12:41:12.244597 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.244482 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c9ff1a02-bda3-4cd7-bc7c-aa86cf372357-etc-kubernetes\") pod \"multus-9khwg\" (UID: \"c9ff1a02-bda3-4cd7-bc7c-aa86cf372357\") " pod="openshift-multus/multus-9khwg" Jun 09 12:41:12.244597 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.244534 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c9ff1a02-bda3-4cd7-bc7c-aa86cf372357-cnibin\") pod \"multus-9khwg\" (UID: \"c9ff1a02-bda3-4cd7-bc7c-aa86cf372357\") " pod="openshift-multus/multus-9khwg" Jun 09 12:41:12.244597 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.244559 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/688d2f31-5684-43d2-81e4-a8c0b73565f5-registration-dir\") pod \"aws-ebs-csi-driver-node-7nwz6\" (UID: \"688d2f31-5684-43d2-81e4-a8c0b73565f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nwz6" Jun 09 12:41:12.244597 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.244583 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c9ff1a02-bda3-4cd7-bc7c-aa86cf372357-host-run-k8s-cni-cncf-io\") pod \"multus-9khwg\" (UID: \"c9ff1a02-bda3-4cd7-bc7c-aa86cf372357\") " pod="openshift-multus/multus-9khwg" Jun 09 12:41:12.244597 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:12.244562 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 12:41:12.244597 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.244591 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c9ff1a02-bda3-4cd7-bc7c-aa86cf372357-cnibin\") pod \"multus-9khwg\" (UID: \"c9ff1a02-bda3-4cd7-bc7c-aa86cf372357\") " pod="openshift-multus/multus-9khwg" Jun 09 12:41:12.245362 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.244608 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmbwj\" (UniqueName: \"kubernetes.io/projected/c9511ce2-9c98-4362-8953-c323b4bdd636-kube-api-access-lmbwj\") pod \"network-metrics-daemon-xcq9r\" (UID: \"c9511ce2-9c98-4362-8953-c323b4bdd636\") " pod="openshift-multus/network-metrics-daemon-xcq9r" Jun 09 12:41:12.245362 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.244633 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/688d2f31-5684-43d2-81e4-a8c0b73565f5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7nwz6\" (UID: \"688d2f31-5684-43d2-81e4-a8c0b73565f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nwz6" Jun 09 12:41:12.245362 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.244637 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/688d2f31-5684-43d2-81e4-a8c0b73565f5-registration-dir\") pod \"aws-ebs-csi-driver-node-7nwz6\" (UID: \"688d2f31-5684-43d2-81e4-a8c0b73565f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nwz6" Jun 09 12:41:12.245362 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.244660 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9511ce2-9c98-4362-8953-c323b4bdd636-metrics-certs\") pod \"network-metrics-daemon-xcq9r\" (UID: \"c9511ce2-9c98-4362-8953-c323b4bdd636\") " pod="openshift-multus/network-metrics-daemon-xcq9r" Jun 09 12:41:12.245362 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.244655 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/688d2f31-5684-43d2-81e4-a8c0b73565f5-socket-dir\") pod \"aws-ebs-csi-driver-node-7nwz6\" (UID: \"688d2f31-5684-43d2-81e4-a8c0b73565f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nwz6" Jun 09 12:41:12.245362 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.244726 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/688d2f31-5684-43d2-81e4-a8c0b73565f5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7nwz6\" (UID: \"688d2f31-5684-43d2-81e4-a8c0b73565f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nwz6" Jun 09 12:41:12.245362 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.244721 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c9ff1a02-bda3-4cd7-bc7c-aa86cf372357-host-run-k8s-cni-cncf-io\") pod \"multus-9khwg\" (UID: \"c9ff1a02-bda3-4cd7-bc7c-aa86cf372357\") " pod="openshift-multus/multus-9khwg" Jun 09 12:41:12.245362 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:12.244760 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a86fe59-f4c8-4c09-9f19-6fada48b8194-original-pull-secret podName:3a86fe59-f4c8-4c09-9f19-6fada48b8194 nodeName:}" failed. No retries permitted until 2026-06-09 12:41:12.744687216 +0000 UTC m=+2.060001200 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3a86fe59-f4c8-4c09-9f19-6fada48b8194-original-pull-secret") pod "global-pull-secret-syncer-br4cc" (UID: "3a86fe59-f4c8-4c09-9f19-6fada48b8194") : object "kube-system"/"original-pull-secret" not registered Jun 09 12:41:12.245362 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.244785 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3a86fe59-f4c8-4c09-9f19-6fada48b8194-kubelet-config\") pod \"global-pull-secret-syncer-br4cc\" (UID: \"3a86fe59-f4c8-4c09-9f19-6fada48b8194\") " pod="kube-system/global-pull-secret-syncer-br4cc" Jun 09 12:41:12.245362 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:12.244811 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 12:41:12.245362 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.244890 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3a86fe59-f4c8-4c09-9f19-6fada48b8194-kubelet-config\") pod \"global-pull-secret-syncer-br4cc\" (UID: \"3a86fe59-f4c8-4c09-9f19-6fada48b8194\") " pod="kube-system/global-pull-secret-syncer-br4cc" Jun 09 12:41:12.245362 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:12.244911 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9511ce2-9c98-4362-8953-c323b4bdd636-metrics-certs podName:c9511ce2-9c98-4362-8953-c323b4bdd636 nodeName:}" failed. No retries permitted until 2026-06-09 12:41:12.744893389 +0000 UTC m=+2.060207360 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c9511ce2-9c98-4362-8953-c323b4bdd636-metrics-certs") pod "network-metrics-daemon-xcq9r" (UID: "c9511ce2-9c98-4362-8953-c323b4bdd636") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 12:41:12.245362 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.244847 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a8b7f08f-8ac0-4cc8-b9c3-9dc0451f79c8-serviceca\") pod \"node-ca-4n62g\" (UID: \"a8b7f08f-8ac0-4cc8-b9c3-9dc0451f79c8\") " pod="openshift-image-registry/node-ca-4n62g" Jun 09 12:41:12.245362 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.244949 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhhww\" (UniqueName: \"kubernetes.io/projected/12a5bda4-80f2-4135-ad58-d5a14bceef3f-kube-api-access-mhhww\") pod \"network-check-target-mq44p\" (UID: \"12a5bda4-80f2-4135-ad58-d5a14bceef3f\") " pod="openshift-network-diagnostics/network-check-target-mq44p" Jun 09 12:41:12.245362 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.244978 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/688d2f31-5684-43d2-81e4-a8c0b73565f5-sys-fs\") pod \"aws-ebs-csi-driver-node-7nwz6\" (UID: \"688d2f31-5684-43d2-81e4-a8c0b73565f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nwz6" Jun 09 12:41:12.245362 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.245003 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvk2b\" (UniqueName: \"kubernetes.io/projected/c9ff1a02-bda3-4cd7-bc7c-aa86cf372357-kube-api-access-nvk2b\") pod \"multus-9khwg\" (UID: \"c9ff1a02-bda3-4cd7-bc7c-aa86cf372357\") " pod="openshift-multus/multus-9khwg" Jun 09 12:41:12.245893 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.245027 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3a86fe59-f4c8-4c09-9f19-6fada48b8194-dbus\") pod \"global-pull-secret-syncer-br4cc\" (UID: \"3a86fe59-f4c8-4c09-9f19-6fada48b8194\") " pod="kube-system/global-pull-secret-syncer-br4cc" Jun 09 12:41:12.245893 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.245057 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c9ff1a02-bda3-4cd7-bc7c-aa86cf372357-cni-binary-copy\") pod \"multus-9khwg\" (UID: \"c9ff1a02-bda3-4cd7-bc7c-aa86cf372357\") " pod="openshift-multus/multus-9khwg" Jun 09 12:41:12.245893 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.245072 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c9ff1a02-bda3-4cd7-bc7c-aa86cf372357-multus-daemon-config\") pod \"multus-9khwg\" (UID: \"c9ff1a02-bda3-4cd7-bc7c-aa86cf372357\") " pod="openshift-multus/multus-9khwg" Jun 09 12:41:12.245893 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.245081 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c9ff1a02-bda3-4cd7-bc7c-aa86cf372357-host-var-lib-cni-bin\") pod \"multus-9khwg\" (UID: \"c9ff1a02-bda3-4cd7-bc7c-aa86cf372357\") " pod="openshift-multus/multus-9khwg" Jun 09 12:41:12.245893 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.245132 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c9ff1a02-bda3-4cd7-bc7c-aa86cf372357-host-var-lib-cni-multus\") pod \"multus-9khwg\" (UID: \"c9ff1a02-bda3-4cd7-bc7c-aa86cf372357\") " pod="openshift-multus/multus-9khwg" Jun 09 12:41:12.245893 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.245151 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c9ff1a02-bda3-4cd7-bc7c-aa86cf372357-host-var-lib-cni-bin\") pod \"multus-9khwg\" (UID: \"c9ff1a02-bda3-4cd7-bc7c-aa86cf372357\") " pod="openshift-multus/multus-9khwg" Jun 09 12:41:12.245893 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.245177 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c9ff1a02-bda3-4cd7-bc7c-aa86cf372357-host-var-lib-cni-multus\") pod \"multus-9khwg\" (UID: \"c9ff1a02-bda3-4cd7-bc7c-aa86cf372357\") " pod="openshift-multus/multus-9khwg" Jun 09 12:41:12.245893 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.245196 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3a86fe59-f4c8-4c09-9f19-6fada48b8194-dbus\") pod \"global-pull-secret-syncer-br4cc\" (UID: \"3a86fe59-f4c8-4c09-9f19-6fada48b8194\") " pod="kube-system/global-pull-secret-syncer-br4cc" Jun 09 12:41:12.245893 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.245202 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/688d2f31-5684-43d2-81e4-a8c0b73565f5-sys-fs\") pod \"aws-ebs-csi-driver-node-7nwz6\" (UID: \"688d2f31-5684-43d2-81e4-a8c0b73565f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nwz6" Jun 09 12:41:12.245893 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.245218 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a8b7f08f-8ac0-4cc8-b9c3-9dc0451f79c8-serviceca\") pod \"node-ca-4n62g\" (UID: \"a8b7f08f-8ac0-4cc8-b9c3-9dc0451f79c8\") " pod="openshift-image-registry/node-ca-4n62g" Jun 09 12:41:12.245893 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.245256 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c9ff1a02-bda3-4cd7-bc7c-aa86cf372357-multus-conf-dir\") pod \"multus-9khwg\" (UID: \"c9ff1a02-bda3-4cd7-bc7c-aa86cf372357\") " pod="openshift-multus/multus-9khwg" Jun 09 12:41:12.245893 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.245300 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c9ff1a02-bda3-4cd7-bc7c-aa86cf372357-host-run-multus-certs\") pod \"multus-9khwg\" (UID: \"c9ff1a02-bda3-4cd7-bc7c-aa86cf372357\") " pod="openshift-multus/multus-9khwg" Jun 09 12:41:12.245893 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.245326 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c9ff1a02-bda3-4cd7-bc7c-aa86cf372357-multus-conf-dir\") pod \"multus-9khwg\" (UID: \"c9ff1a02-bda3-4cd7-bc7c-aa86cf372357\") " pod="openshift-multus/multus-9khwg" Jun 09 12:41:12.245893 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.245328 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c9ff1a02-bda3-4cd7-bc7c-aa86cf372357-host-var-lib-kubelet\") pod \"multus-9khwg\" (UID: \"c9ff1a02-bda3-4cd7-bc7c-aa86cf372357\") " pod="openshift-multus/multus-9khwg" Jun 09 12:41:12.245893 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.245360 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c9ff1a02-bda3-4cd7-bc7c-aa86cf372357-host-var-lib-kubelet\") pod \"multus-9khwg\" (UID: \"c9ff1a02-bda3-4cd7-bc7c-aa86cf372357\") " pod="openshift-multus/multus-9khwg" Jun 09 12:41:12.245893 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.245391 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c9ff1a02-bda3-4cd7-bc7c-aa86cf372357-host-run-multus-certs\") pod \"multus-9khwg\" (UID: \"c9ff1a02-bda3-4cd7-bc7c-aa86cf372357\") " pod="openshift-multus/multus-9khwg" Jun 09 12:41:12.245893 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.245498 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c9ff1a02-bda3-4cd7-bc7c-aa86cf372357-cni-binary-copy\") pod \"multus-9khwg\" (UID: \"c9ff1a02-bda3-4cd7-bc7c-aa86cf372357\") " pod="openshift-multus/multus-9khwg" Jun 09 12:41:12.261348 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:12.261327 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 12:41:12.261348 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:12.261347 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 12:41:12.261493 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:12.261359 2561 projected.go:196] Error preparing data for projected volume kube-api-access-mhhww for pod openshift-network-diagnostics/network-check-target-mq44p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 12:41:12.261493 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:12.261410 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/12a5bda4-80f2-4135-ad58-d5a14bceef3f-kube-api-access-mhhww podName:12a5bda4-80f2-4135-ad58-d5a14bceef3f nodeName:}" failed. No retries permitted until 2026-06-09 12:41:12.761395379 +0000 UTC m=+2.076709361 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-mhhww" (UniqueName: "kubernetes.io/projected/12a5bda4-80f2-4135-ad58-d5a14bceef3f-kube-api-access-mhhww") pod "network-check-target-mq44p" (UID: "12a5bda4-80f2-4135-ad58-d5a14bceef3f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 12:41:12.263445 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.263417 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnh6l\" (UniqueName: \"kubernetes.io/projected/688d2f31-5684-43d2-81e4-a8c0b73565f5-kube-api-access-nnh6l\") pod \"aws-ebs-csi-driver-node-7nwz6\" (UID: \"688d2f31-5684-43d2-81e4-a8c0b73565f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nwz6" Jun 09 12:41:12.263688 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.263667 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmbwj\" (UniqueName: \"kubernetes.io/projected/c9511ce2-9c98-4362-8953-c323b4bdd636-kube-api-access-lmbwj\") pod \"network-metrics-daemon-xcq9r\" (UID: \"c9511ce2-9c98-4362-8953-c323b4bdd636\") " pod="openshift-multus/network-metrics-daemon-xcq9r" Jun 09 12:41:12.263792 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.263776 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvk2b\" (UniqueName: \"kubernetes.io/projected/c9ff1a02-bda3-4cd7-bc7c-aa86cf372357-kube-api-access-nvk2b\") pod \"multus-9khwg\" (UID: \"c9ff1a02-bda3-4cd7-bc7c-aa86cf372357\") " pod="openshift-multus/multus-9khwg" Jun 09 12:41:12.265117 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.265098 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mklp8\" (UniqueName: \"kubernetes.io/projected/a8b7f08f-8ac0-4cc8-b9c3-9dc0451f79c8-kube-api-access-mklp8\") pod \"node-ca-4n62g\" (UID: \"a8b7f08f-8ac0-4cc8-b9c3-9dc0451f79c8\") " pod="openshift-image-registry/node-ca-4n62g" Jun 09 12:41:12.332188 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.332156 2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 12:41:12.340761 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.340738 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xcnw9" Jun 09 12:41:12.347542 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.347494 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xlxkq" Jun 09 12:41:12.349110 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:12.349027 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6d83a37_95b0_4f9e_ac03_5c0927e92520.slice/crio-2b0e5dca15c7c0e315e12512b74bfc6b9250af699e465532bce5dbcd0109338f WatchSource:0}: Error finding container 2b0e5dca15c7c0e315e12512b74bfc6b9250af699e465532bce5dbcd0109338f: Status 404 returned error can't find the container with id 2b0e5dca15c7c0e315e12512b74bfc6b9250af699e465532bce5dbcd0109338f Jun 09 12:41:12.354053 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.354037 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vhn5n" Jun 09 12:41:12.356091 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:12.356071 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00dcaa51_80f6_4fcd_9eb0_8c27466112df.slice/crio-c308d6f879dd2a591871c86074015f942abfc5122ec5351025b4739d0db4677e WatchSource:0}: Error finding container c308d6f879dd2a591871c86074015f942abfc5122ec5351025b4739d0db4677e: Status 404 returned error can't find the container with id c308d6f879dd2a591871c86074015f942abfc5122ec5351025b4739d0db4677e Jun 09 12:41:12.361417 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:12.361397 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1b0f311_294d_4b26_b1ae_84ecd996fc34.slice/crio-6350431f4ee0b14000c094f15580793f0b6f959d93d47acc60723420c1d02bca WatchSource:0}: Error finding container 6350431f4ee0b14000c094f15580793f0b6f959d93d47acc60723420c1d02bca: Status 404 returned error can't find the container with id 6350431f4ee0b14000c094f15580793f0b6f959d93d47acc60723420c1d02bca Jun 09 12:41:12.362273 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.362255 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lpnt2" Jun 09 12:41:12.367534 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.367353 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tsmnb" Jun 09 12:41:12.369369 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:12.369349 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94fe31fd_8a59_4bff_b38f_43dfb84073f3.slice/crio-5438966ffc87d65e583082dc9f1da3599e2b550b7090551c9e0087cbee04b2a8 WatchSource:0}: Error finding container 5438966ffc87d65e583082dc9f1da3599e2b550b7090551c9e0087cbee04b2a8: Status 404 returned error can't find the container with id 5438966ffc87d65e583082dc9f1da3599e2b550b7090551c9e0087cbee04b2a8 Jun 09 12:41:12.372572 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.372556 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kj5x2" Jun 09 12:41:12.374024 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:12.374003 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b49422f_6fab_47a3_956f_b78c3784dc3c.slice/crio-61ce4e6b80bafed56f42df8eb9739f02e92a6418463a71b1f77b3c9245209e1d WatchSource:0}: Error finding container 61ce4e6b80bafed56f42df8eb9739f02e92a6418463a71b1f77b3c9245209e1d: Status 404 returned error can't find the container with id 61ce4e6b80bafed56f42df8eb9739f02e92a6418463a71b1f77b3c9245209e1d Jun 09 12:41:12.378149 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.378131 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4n62g" Jun 09 12:41:12.379633 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:12.379600 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98f6370c_d970_420a_afcc_7abb56d7c44e.slice/crio-25a113f9cc0ab2436c70e8a2890204a3261a8adc8c634396830767ca7de2ea99 WatchSource:0}: Error finding container 25a113f9cc0ab2436c70e8a2890204a3261a8adc8c634396830767ca7de2ea99: Status 404 returned error can't find the container with id 25a113f9cc0ab2436c70e8a2890204a3261a8adc8c634396830767ca7de2ea99 Jun 09 12:41:12.383883 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.383867 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9khwg" Jun 09 12:41:12.385214 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:12.385195 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8b7f08f_8ac0_4cc8_b9c3_9dc0451f79c8.slice/crio-b242bfb641079c15f1e18e3e87ca65d652ab6cdecfd2d52416fc36780869ffd3 WatchSource:0}: Error finding container b242bfb641079c15f1e18e3e87ca65d652ab6cdecfd2d52416fc36780869ffd3: Status 404 returned error can't find the container with id b242bfb641079c15f1e18e3e87ca65d652ab6cdecfd2d52416fc36780869ffd3 Jun 09 12:41:12.388186 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.388168 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nwz6" Jun 09 12:41:12.391314 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:12.391295 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9ff1a02_bda3_4cd7_bc7c_aa86cf372357.slice/crio-dc2c46f390179d09dc6dd3469829b48301ea8bd6bfa0b58beab55453e9e8cae8 WatchSource:0}: Error finding container dc2c46f390179d09dc6dd3469829b48301ea8bd6bfa0b58beab55453e9e8cae8: Status 404 returned error can't find the container with id dc2c46f390179d09dc6dd3469829b48301ea8bd6bfa0b58beab55453e9e8cae8 Jun 09 12:41:12.395786 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:12.395768 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod688d2f31_5684_43d2_81e4_a8c0b73565f5.slice/crio-d83380f4972fccda31f4c7cca407ffb7788aa4668fae868a67f30ebff0c82e5c WatchSource:0}: Error finding container d83380f4972fccda31f4c7cca407ffb7788aa4668fae868a67f30ebff0c82e5c: Status 404 returned error can't find the container with id d83380f4972fccda31f4c7cca407ffb7788aa4668fae868a67f30ebff0c82e5c Jun 09 12:41:12.510487 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.510459 2561 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 12:41:12.750046 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.750009 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3a86fe59-f4c8-4c09-9f19-6fada48b8194-original-pull-secret\") pod \"global-pull-secret-syncer-br4cc\" (UID: \"3a86fe59-f4c8-4c09-9f19-6fada48b8194\") " pod="kube-system/global-pull-secret-syncer-br4cc" Jun 09 12:41:12.750202 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.750074 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9511ce2-9c98-4362-8953-c323b4bdd636-metrics-certs\") pod \"network-metrics-daemon-xcq9r\" (UID: \"c9511ce2-9c98-4362-8953-c323b4bdd636\") " pod="openshift-multus/network-metrics-daemon-xcq9r" Jun 09 12:41:12.750244 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:12.750215 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 12:41:12.750298 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:12.750279 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9511ce2-9c98-4362-8953-c323b4bdd636-metrics-certs podName:c9511ce2-9c98-4362-8953-c323b4bdd636 nodeName:}" failed. No retries permitted until 2026-06-09 12:41:13.750261157 +0000 UTC m=+3.065575131 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c9511ce2-9c98-4362-8953-c323b4bdd636-metrics-certs") pod "network-metrics-daemon-xcq9r" (UID: "c9511ce2-9c98-4362-8953-c323b4bdd636") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 12:41:12.750370 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:12.750359 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 12:41:12.750409 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:12.750392 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a86fe59-f4c8-4c09-9f19-6fada48b8194-original-pull-secret podName:3a86fe59-f4c8-4c09-9f19-6fada48b8194 nodeName:}" failed. No retries permitted until 2026-06-09 12:41:13.750381008 +0000 UTC m=+3.065694981 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3a86fe59-f4c8-4c09-9f19-6fada48b8194-original-pull-secret") pod "global-pull-secret-syncer-br4cc" (UID: "3a86fe59-f4c8-4c09-9f19-6fada48b8194") : object "kube-system"/"original-pull-secret" not registered Jun 09 12:41:12.851486 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:12.851448 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhhww\" (UniqueName: \"kubernetes.io/projected/12a5bda4-80f2-4135-ad58-d5a14bceef3f-kube-api-access-mhhww\") pod \"network-check-target-mq44p\" (UID: \"12a5bda4-80f2-4135-ad58-d5a14bceef3f\") " pod="openshift-network-diagnostics/network-check-target-mq44p" Jun 09 12:41:12.851668 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:12.851652 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 12:41:12.851727 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:12.851676 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 12:41:12.851727 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:12.851689 2561 projected.go:196] Error preparing data for projected volume kube-api-access-mhhww for pod openshift-network-diagnostics/network-check-target-mq44p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 12:41:12.851858 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:12.851749 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/12a5bda4-80f2-4135-ad58-d5a14bceef3f-kube-api-access-mhhww podName:12a5bda4-80f2-4135-ad58-d5a14bceef3f nodeName:}" failed. No retries permitted until 2026-06-09 12:41:13.85172918 +0000 UTC m=+3.167043152 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-mhhww" (UniqueName: "kubernetes.io/projected/12a5bda4-80f2-4135-ad58-d5a14bceef3f-kube-api-access-mhhww") pod "network-check-target-mq44p" (UID: "12a5bda4-80f2-4135-ad58-d5a14bceef3f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 12:41:13.113970 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:13.112880 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-br4cc" Jun 09 12:41:13.113970 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:13.113013 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-br4cc" podUID="3a86fe59-f4c8-4c09-9f19-6fada48b8194" Jun 09 12:41:13.143869 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:13.143798 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 12:36:12 +0000 UTC" deadline="2027-11-08 08:57:41.031179143 +0000 UTC" Jun 09 12:41:13.143869 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:13.143868 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12404h16m27.88731572s" Jun 09 12:41:13.153677 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:13.153589 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lpnt2" event={"ID":"94fe31fd-8a59-4bff-b38f-43dfb84073f3","Type":"ContainerStarted","Data":"5438966ffc87d65e583082dc9f1da3599e2b550b7090551c9e0087cbee04b2a8"} Jun 09 12:41:13.159998 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:13.159964 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vhn5n" event={"ID":"a1b0f311-294d-4b26-b1ae-84ecd996fc34","Type":"ContainerStarted","Data":"6350431f4ee0b14000c094f15580793f0b6f959d93d47acc60723420c1d02bca"} Jun 09 12:41:13.177328 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:13.177298 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xcnw9" event={"ID":"b6d83a37-95b0-4f9e-ac03-5c0927e92520","Type":"ContainerStarted","Data":"2b0e5dca15c7c0e315e12512b74bfc6b9250af699e465532bce5dbcd0109338f"} Jun 09 12:41:13.187025 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:13.186999 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nwz6" event={"ID":"688d2f31-5684-43d2-81e4-a8c0b73565f5","Type":"ContainerStarted","Data":"d83380f4972fccda31f4c7cca407ffb7788aa4668fae868a67f30ebff0c82e5c"} Jun 09 12:41:13.193961 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:13.193931 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9khwg" event={"ID":"c9ff1a02-bda3-4cd7-bc7c-aa86cf372357","Type":"ContainerStarted","Data":"dc2c46f390179d09dc6dd3469829b48301ea8bd6bfa0b58beab55453e9e8cae8"} Jun 09 12:41:13.203771 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:13.203742 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4n62g" event={"ID":"a8b7f08f-8ac0-4cc8-b9c3-9dc0451f79c8","Type":"ContainerStarted","Data":"b242bfb641079c15f1e18e3e87ca65d652ab6cdecfd2d52416fc36780869ffd3"} Jun 09 12:41:13.221400 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:13.221375 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kj5x2" event={"ID":"98f6370c-d970-420a-afcc-7abb56d7c44e","Type":"ContainerStarted","Data":"25a113f9cc0ab2436c70e8a2890204a3261a8adc8c634396830767ca7de2ea99"} Jun 09 12:41:13.227902 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:13.227516 2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 12:41:13.234147 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:13.234123 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tsmnb" event={"ID":"4b49422f-6fab-47a3-956f-b78c3784dc3c","Type":"ContainerStarted","Data":"61ce4e6b80bafed56f42df8eb9739f02e92a6418463a71b1f77b3c9245209e1d"} Jun 09 12:41:13.257103 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:13.257080 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xlxkq" event={"ID":"00dcaa51-80f6-4fcd-9eb0-8c27466112df","Type":"ContainerStarted","Data":"c308d6f879dd2a591871c86074015f942abfc5122ec5351025b4739d0db4677e"} Jun 09 12:41:13.759110 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:13.759069 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3a86fe59-f4c8-4c09-9f19-6fada48b8194-original-pull-secret\") pod \"global-pull-secret-syncer-br4cc\" (UID: \"3a86fe59-f4c8-4c09-9f19-6fada48b8194\") " pod="kube-system/global-pull-secret-syncer-br4cc" Jun 09 12:41:13.759279 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:13.759140 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9511ce2-9c98-4362-8953-c323b4bdd636-metrics-certs\") pod \"network-metrics-daemon-xcq9r\" (UID: \"c9511ce2-9c98-4362-8953-c323b4bdd636\") " pod="openshift-multus/network-metrics-daemon-xcq9r" Jun 09 12:41:13.759348 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:13.759284 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 12:41:13.759348 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:13.759341 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9511ce2-9c98-4362-8953-c323b4bdd636-metrics-certs podName:c9511ce2-9c98-4362-8953-c323b4bdd636 nodeName:}" failed. No retries permitted until 2026-06-09 12:41:15.759322256 +0000 UTC m=+5.074636243 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c9511ce2-9c98-4362-8953-c323b4bdd636-metrics-certs") pod "network-metrics-daemon-xcq9r" (UID: "c9511ce2-9c98-4362-8953-c323b4bdd636") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 12:41:13.759879 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:13.759837 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 12:41:13.760022 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:13.760009 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a86fe59-f4c8-4c09-9f19-6fada48b8194-original-pull-secret podName:3a86fe59-f4c8-4c09-9f19-6fada48b8194 nodeName:}" failed. No retries permitted until 2026-06-09 12:41:15.759979498 +0000 UTC m=+5.075293470 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3a86fe59-f4c8-4c09-9f19-6fada48b8194-original-pull-secret") pod "global-pull-secret-syncer-br4cc" (UID: "3a86fe59-f4c8-4c09-9f19-6fada48b8194") : object "kube-system"/"original-pull-secret" not registered Jun 09 12:41:13.860209 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:13.860095 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhhww\" (UniqueName: \"kubernetes.io/projected/12a5bda4-80f2-4135-ad58-d5a14bceef3f-kube-api-access-mhhww\") pod \"network-check-target-mq44p\" (UID: \"12a5bda4-80f2-4135-ad58-d5a14bceef3f\") " pod="openshift-network-diagnostics/network-check-target-mq44p" Jun 09 12:41:13.860392 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:13.860281 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 12:41:13.860392 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:13.860306 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 12:41:13.860392 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:13.860321 2561 projected.go:196] Error preparing data for projected volume kube-api-access-mhhww for pod openshift-network-diagnostics/network-check-target-mq44p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 12:41:13.860392 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:13.860378 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/12a5bda4-80f2-4135-ad58-d5a14bceef3f-kube-api-access-mhhww podName:12a5bda4-80f2-4135-ad58-d5a14bceef3f nodeName:}" failed. No retries permitted until 2026-06-09 12:41:15.860359693 +0000 UTC m=+5.175673665 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-mhhww" (UniqueName: "kubernetes.io/projected/12a5bda4-80f2-4135-ad58-d5a14bceef3f-kube-api-access-mhhww") pod "network-check-target-mq44p" (UID: "12a5bda4-80f2-4135-ad58-d5a14bceef3f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 12:41:14.110876 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:14.110777 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mq44p" Jun 09 12:41:14.111036 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:14.110921 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mq44p" podUID="12a5bda4-80f2-4135-ad58-d5a14bceef3f" Jun 09 12:41:14.111341 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:14.111321 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xcq9r" Jun 09 12:41:14.111446 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:14.111425 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xcq9r" podUID="c9511ce2-9c98-4362-8953-c323b4bdd636" Jun 09 12:41:14.144350 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:14.144223 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 12:36:12 +0000 UTC" deadline="2027-12-02 23:11:15.458795471 +0000 UTC" Jun 09 12:41:14.144350 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:14.144254 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12994h30m1.314545752s" Jun 09 12:41:15.038044 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:15.038014 2561 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 12:41:15.113106 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:15.113076 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-br4cc" Jun 09 12:41:15.113263 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:15.113209 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-br4cc" podUID="3a86fe59-f4c8-4c09-9f19-6fada48b8194" Jun 09 12:41:15.774939 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:15.774904 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9511ce2-9c98-4362-8953-c323b4bdd636-metrics-certs\") pod \"network-metrics-daemon-xcq9r\" (UID: \"c9511ce2-9c98-4362-8953-c323b4bdd636\") " pod="openshift-multus/network-metrics-daemon-xcq9r" Jun 09 12:41:15.775416 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:15.775002 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3a86fe59-f4c8-4c09-9f19-6fada48b8194-original-pull-secret\") pod \"global-pull-secret-syncer-br4cc\" (UID: \"3a86fe59-f4c8-4c09-9f19-6fada48b8194\") " pod="kube-system/global-pull-secret-syncer-br4cc" Jun 09 12:41:15.775416 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:15.775120 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 12:41:15.775416 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:15.775178 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a86fe59-f4c8-4c09-9f19-6fada48b8194-original-pull-secret podName:3a86fe59-f4c8-4c09-9f19-6fada48b8194 nodeName:}" failed. No retries permitted until 2026-06-09 12:41:19.775160263 +0000 UTC m=+9.090474234 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3a86fe59-f4c8-4c09-9f19-6fada48b8194-original-pull-secret") pod "global-pull-secret-syncer-br4cc" (UID: "3a86fe59-f4c8-4c09-9f19-6fada48b8194") : object "kube-system"/"original-pull-secret" not registered Jun 09 12:41:15.775577 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:15.775556 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 12:41:15.775625 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:15.775603 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9511ce2-9c98-4362-8953-c323b4bdd636-metrics-certs podName:c9511ce2-9c98-4362-8953-c323b4bdd636 nodeName:}" failed. No retries permitted until 2026-06-09 12:41:19.775586406 +0000 UTC m=+9.090900380 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c9511ce2-9c98-4362-8953-c323b4bdd636-metrics-certs") pod "network-metrics-daemon-xcq9r" (UID: "c9511ce2-9c98-4362-8953-c323b4bdd636") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 12:41:15.876260 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:15.876191 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhhww\" (UniqueName: \"kubernetes.io/projected/12a5bda4-80f2-4135-ad58-d5a14bceef3f-kube-api-access-mhhww\") pod \"network-check-target-mq44p\" (UID: \"12a5bda4-80f2-4135-ad58-d5a14bceef3f\") " pod="openshift-network-diagnostics/network-check-target-mq44p" Jun 09 12:41:15.876426 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:15.876356 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 12:41:15.876426 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:15.876377 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 12:41:15.876426 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:15.876390 2561 projected.go:196] Error preparing data for projected volume kube-api-access-mhhww for pod openshift-network-diagnostics/network-check-target-mq44p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 12:41:15.876575 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:15.876456 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/12a5bda4-80f2-4135-ad58-d5a14bceef3f-kube-api-access-mhhww podName:12a5bda4-80f2-4135-ad58-d5a14bceef3f nodeName:}" failed. No retries permitted until 2026-06-09 12:41:19.876436081 +0000 UTC m=+9.191750052 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-mhhww" (UniqueName: "kubernetes.io/projected/12a5bda4-80f2-4135-ad58-d5a14bceef3f-kube-api-access-mhhww") pod "network-check-target-mq44p" (UID: "12a5bda4-80f2-4135-ad58-d5a14bceef3f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 12:41:16.110271 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:16.110192 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mq44p" Jun 09 12:41:16.110467 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:16.110319 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mq44p" podUID="12a5bda4-80f2-4135-ad58-d5a14bceef3f" Jun 09 12:41:16.110715 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:16.110697 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xcq9r" Jun 09 12:41:16.110867 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:16.110846 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xcq9r" podUID="c9511ce2-9c98-4362-8953-c323b4bdd636" Jun 09 12:41:17.111085 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:17.110990 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-br4cc" Jun 09 12:41:17.111542 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:17.111135 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-br4cc" podUID="3a86fe59-f4c8-4c09-9f19-6fada48b8194" Jun 09 12:41:18.111101 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:18.111063 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xcq9r" Jun 09 12:41:18.111725 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:18.111075 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mq44p" Jun 09 12:41:18.111725 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:18.111222 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xcq9r" podUID="c9511ce2-9c98-4362-8953-c323b4bdd636" Jun 09 12:41:18.111725 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:18.111296 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mq44p" podUID="12a5bda4-80f2-4135-ad58-d5a14bceef3f" Jun 09 12:41:19.110758 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:19.110642 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-br4cc" Jun 09 12:41:19.110965 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:19.110772 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-br4cc" podUID="3a86fe59-f4c8-4c09-9f19-6fada48b8194" Jun 09 12:41:19.809089 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:19.809055 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9511ce2-9c98-4362-8953-c323b4bdd636-metrics-certs\") pod \"network-metrics-daemon-xcq9r\" (UID: \"c9511ce2-9c98-4362-8953-c323b4bdd636\") " pod="openshift-multus/network-metrics-daemon-xcq9r" Jun 09 12:41:19.809527 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:19.809149 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3a86fe59-f4c8-4c09-9f19-6fada48b8194-original-pull-secret\") pod \"global-pull-secret-syncer-br4cc\" (UID: \"3a86fe59-f4c8-4c09-9f19-6fada48b8194\") " pod="kube-system/global-pull-secret-syncer-br4cc" Jun 09 12:41:19.809527 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:19.809231 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 12:41:19.809527 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:19.809262 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 12:41:19.809527 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:19.809310 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9511ce2-9c98-4362-8953-c323b4bdd636-metrics-certs podName:c9511ce2-9c98-4362-8953-c323b4bdd636 nodeName:}" failed. No retries permitted until 2026-06-09 12:41:27.809287754 +0000 UTC m=+17.124601750 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c9511ce2-9c98-4362-8953-c323b4bdd636-metrics-certs") pod "network-metrics-daemon-xcq9r" (UID: "c9511ce2-9c98-4362-8953-c323b4bdd636") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 12:41:19.809527 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:19.809330 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a86fe59-f4c8-4c09-9f19-6fada48b8194-original-pull-secret podName:3a86fe59-f4c8-4c09-9f19-6fada48b8194 nodeName:}" failed. No retries permitted until 2026-06-09 12:41:27.809322092 +0000 UTC m=+17.124636060 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3a86fe59-f4c8-4c09-9f19-6fada48b8194-original-pull-secret") pod "global-pull-secret-syncer-br4cc" (UID: "3a86fe59-f4c8-4c09-9f19-6fada48b8194") : object "kube-system"/"original-pull-secret" not registered Jun 09 12:41:19.909481 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:19.909438 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhhww\" (UniqueName: \"kubernetes.io/projected/12a5bda4-80f2-4135-ad58-d5a14bceef3f-kube-api-access-mhhww\") pod \"network-check-target-mq44p\" (UID: \"12a5bda4-80f2-4135-ad58-d5a14bceef3f\") " pod="openshift-network-diagnostics/network-check-target-mq44p" Jun 09 12:41:19.909664 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:19.909587 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 12:41:19.909664 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:19.909610 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 12:41:19.909664 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:19.909623 2561 projected.go:196] Error preparing data for projected volume kube-api-access-mhhww for pod openshift-network-diagnostics/network-check-target-mq44p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 12:41:19.909835 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:19.909681 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/12a5bda4-80f2-4135-ad58-d5a14bceef3f-kube-api-access-mhhww podName:12a5bda4-80f2-4135-ad58-d5a14bceef3f nodeName:}" failed. No retries permitted until 2026-06-09 12:41:27.909662173 +0000 UTC m=+17.224976143 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-mhhww" (UniqueName: "kubernetes.io/projected/12a5bda4-80f2-4135-ad58-d5a14bceef3f-kube-api-access-mhhww") pod "network-check-target-mq44p" (UID: "12a5bda4-80f2-4135-ad58-d5a14bceef3f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 12:41:20.111145 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:20.110925 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mq44p" Jun 09 12:41:20.111145 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:20.111060 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mq44p" podUID="12a5bda4-80f2-4135-ad58-d5a14bceef3f" Jun 09 12:41:20.111370 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:20.111262 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xcq9r" Jun 09 12:41:20.111428 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:20.111389 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xcq9r" podUID="c9511ce2-9c98-4362-8953-c323b4bdd636" Jun 09 12:41:21.111787 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:21.111752 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-br4cc" Jun 09 12:41:21.112239 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:21.111890 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-br4cc" podUID="3a86fe59-f4c8-4c09-9f19-6fada48b8194" Jun 09 12:41:22.111008 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:22.110970 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mq44p" Jun 09 12:41:22.111282 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:22.110975 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xcq9r" Jun 09 12:41:22.111282 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:22.111093 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mq44p" podUID="12a5bda4-80f2-4135-ad58-d5a14bceef3f" Jun 09 12:41:22.111282 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:22.111152 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xcq9r" podUID="c9511ce2-9c98-4362-8953-c323b4bdd636" Jun 09 12:41:23.113878 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:23.113848 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-br4cc" Jun 09 12:41:23.114221 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:23.113981 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-br4cc" podUID="3a86fe59-f4c8-4c09-9f19-6fada48b8194" Jun 09 12:41:24.110723 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:24.110694 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mq44p" Jun 09 12:41:24.110930 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:24.110792 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mq44p" podUID="12a5bda4-80f2-4135-ad58-d5a14bceef3f" Jun 09 12:41:24.110930 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:24.110841 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xcq9r" Jun 09 12:41:24.111024 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:24.110978 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xcq9r" podUID="c9511ce2-9c98-4362-8953-c323b4bdd636" Jun 09 12:41:25.110191 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:25.110157 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-br4cc" Jun 09 12:41:25.110657 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:25.110275 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-br4cc" podUID="3a86fe59-f4c8-4c09-9f19-6fada48b8194" Jun 09 12:41:26.110027 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:26.109987 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mq44p" Jun 09 12:41:26.110027 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:26.110025 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xcq9r" Jun 09 12:41:26.110272 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:26.110108 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mq44p" podUID="12a5bda4-80f2-4135-ad58-d5a14bceef3f" Jun 09 12:41:26.110272 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:26.110222 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xcq9r" podUID="c9511ce2-9c98-4362-8953-c323b4bdd636" Jun 09 12:41:27.110574 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:27.110543 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-br4cc" Jun 09 12:41:27.110937 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:27.110654 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-br4cc" podUID="3a86fe59-f4c8-4c09-9f19-6fada48b8194" Jun 09 12:41:27.866882 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:27.866847 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9511ce2-9c98-4362-8953-c323b4bdd636-metrics-certs\") pod \"network-metrics-daemon-xcq9r\" (UID: \"c9511ce2-9c98-4362-8953-c323b4bdd636\") " pod="openshift-multus/network-metrics-daemon-xcq9r" Jun 09 12:41:27.867090 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:27.866935 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3a86fe59-f4c8-4c09-9f19-6fada48b8194-original-pull-secret\") pod \"global-pull-secret-syncer-br4cc\" (UID: \"3a86fe59-f4c8-4c09-9f19-6fada48b8194\") " pod="kube-system/global-pull-secret-syncer-br4cc" Jun 09 12:41:27.867090 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:27.867008 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 12:41:27.867090 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:27.867062 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9511ce2-9c98-4362-8953-c323b4bdd636-metrics-certs podName:c9511ce2-9c98-4362-8953-c323b4bdd636 nodeName:}" failed. No retries permitted until 2026-06-09 12:41:43.867049108 +0000 UTC m=+33.182363080 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c9511ce2-9c98-4362-8953-c323b4bdd636-metrics-certs") pod "network-metrics-daemon-xcq9r" (UID: "c9511ce2-9c98-4362-8953-c323b4bdd636") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 12:41:27.867090 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:27.867012 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 12:41:27.867286 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:27.867125 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a86fe59-f4c8-4c09-9f19-6fada48b8194-original-pull-secret podName:3a86fe59-f4c8-4c09-9f19-6fada48b8194 nodeName:}" failed. No retries permitted until 2026-06-09 12:41:43.867113336 +0000 UTC m=+33.182427306 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3a86fe59-f4c8-4c09-9f19-6fada48b8194-original-pull-secret") pod "global-pull-secret-syncer-br4cc" (UID: "3a86fe59-f4c8-4c09-9f19-6fada48b8194") : object "kube-system"/"original-pull-secret" not registered Jun 09 12:41:27.967568 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:27.967533 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhhww\" (UniqueName: \"kubernetes.io/projected/12a5bda4-80f2-4135-ad58-d5a14bceef3f-kube-api-access-mhhww\") pod \"network-check-target-mq44p\" (UID: \"12a5bda4-80f2-4135-ad58-d5a14bceef3f\") " pod="openshift-network-diagnostics/network-check-target-mq44p" Jun 09 12:41:27.967755 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:27.967695 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 12:41:27.967755 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:27.967716 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 12:41:27.967755 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:27.967726 2561 projected.go:196] Error preparing data for projected volume kube-api-access-mhhww for pod openshift-network-diagnostics/network-check-target-mq44p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 12:41:27.967943 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:27.967777 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/12a5bda4-80f2-4135-ad58-d5a14bceef3f-kube-api-access-mhhww podName:12a5bda4-80f2-4135-ad58-d5a14bceef3f nodeName:}" failed. No retries permitted until 2026-06-09 12:41:43.967758449 +0000 UTC m=+33.283072421 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-mhhww" (UniqueName: "kubernetes.io/projected/12a5bda4-80f2-4135-ad58-d5a14bceef3f-kube-api-access-mhhww") pod "network-check-target-mq44p" (UID: "12a5bda4-80f2-4135-ad58-d5a14bceef3f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 12:41:28.110390 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:28.110359 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xcq9r" Jun 09 12:41:28.110587 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:28.110359 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mq44p" Jun 09 12:41:28.110587 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:28.110500 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xcq9r" podUID="c9511ce2-9c98-4362-8953-c323b4bdd636" Jun 09 12:41:28.110587 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:28.110568 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mq44p" podUID="12a5bda4-80f2-4135-ad58-d5a14bceef3f" Jun 09 12:41:29.113350 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:29.113315 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-br4cc" Jun 09 12:41:29.113789 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:29.113443 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-br4cc" podUID="3a86fe59-f4c8-4c09-9f19-6fada48b8194" Jun 09 12:41:30.110186 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:30.110153 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mq44p" Jun 09 12:41:30.110367 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:30.110162 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xcq9r" Jun 09 12:41:30.110367 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:30.110263 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mq44p" podUID="12a5bda4-80f2-4135-ad58-d5a14bceef3f" Jun 09 12:41:30.110469 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:30.110363 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xcq9r" podUID="c9511ce2-9c98-4362-8953-c323b4bdd636" Jun 09 12:41:31.110799 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:31.110759 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-br4cc" Jun 09 12:41:31.111267 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:31.110893 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-br4cc" podUID="3a86fe59-f4c8-4c09-9f19-6fada48b8194" Jun 09 12:41:32.111196 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:32.111039 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xcq9r" Jun 09 12:41:32.111549 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:32.111096 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mq44p" Jun 09 12:41:32.111549 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:32.111282 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xcq9r" podUID="c9511ce2-9c98-4362-8953-c323b4bdd636" Jun 09 12:41:32.111549 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:32.111411 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mq44p" podUID="12a5bda4-80f2-4135-ad58-d5a14bceef3f" Jun 09 12:41:32.304370 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:32.304343 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-109.ec2.internal" event={"ID":"627b185f30291ffb2e9813e90451a240","Type":"ContainerStarted","Data":"f413d70c17634753692c8d907a2cbdd435ff687ccd702dd011243732fdd5adda"} Jun 09 12:41:32.305788 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:32.305764 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9khwg" event={"ID":"c9ff1a02-bda3-4cd7-bc7c-aa86cf372357","Type":"ContainerStarted","Data":"a6a3d725b4ef3028e287e85a54e16895fc0cbcbcf6a500b6d3e745ffdd7223ff"} Jun 09 12:41:32.308715 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:32.308690 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tsmnb" event={"ID":"4b49422f-6fab-47a3-956f-b78c3784dc3c","Type":"ContainerStarted","Data":"15dcf05d81d48f8fa4b1e7019c5eac34ad376da11f7dcd8a10d9f14e33d9593a"} Jun 09 12:41:32.308858 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:32.308767 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tsmnb" event={"ID":"4b49422f-6fab-47a3-956f-b78c3784dc3c","Type":"ContainerStarted","Data":"7009450e6b49f6d5685705165fc20e24b9e7e70a199c74b434ec108ff23df84e"} Jun 09 12:41:32.310176 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:32.310150 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xcnw9" event={"ID":"b6d83a37-95b0-4f9e-ac03-5c0927e92520","Type":"ContainerStarted","Data":"fb9d0c3528a05419d9b44606baf790f3dc16acb3a01d0f3544a19dba23adc2ae"} Jun 09 12:41:32.334852 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:32.334761 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-109.ec2.internal" podStartSLOduration=20.334739443 podStartE2EDuration="20.334739443s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 12:41:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:41:32.333486334 +0000 UTC m=+21.648800326" watchObservedRunningTime="2026-06-09 12:41:32.334739443 +0000 UTC m=+21.650053445" Jun 09 12:41:32.376986 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:32.376934 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-xcnw9" podStartSLOduration=1.9228692889999999 podStartE2EDuration="21.376919133s" totalImagesPullingTime="19.454049844s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 12:41:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:41:32.35740616 +0000 UTC m=+21.672720152" watchObservedRunningTime="2026-06-09 12:41:32.376919133 +0000 UTC m=+21.692233124" Jun 09 12:41:32.377401 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:32.377375 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-9khwg" podStartSLOduration=1.930990344 podStartE2EDuration="21.37736726s" totalImagesPullingTime="19.446376916s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 12:41:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:41:32.376676651 +0000 UTC m=+21.691990642" watchObservedRunningTime="2026-06-09 12:41:32.37736726 +0000 UTC m=+21.692681282" Jun 09 12:41:33.110954 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:33.110770 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-br4cc" Jun 09 12:41:33.111127 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:33.111032 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-br4cc" podUID="3a86fe59-f4c8-4c09-9f19-6fada48b8194" Jun 09 12:41:33.313920 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:33.313887 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nwz6" event={"ID":"688d2f31-5684-43d2-81e4-a8c0b73565f5","Type":"ContainerStarted","Data":"1f8c7946b17bcb4dd37cffc8faa79e2af674eaee0cfcf79e6722c42b996be555"} Jun 09 12:41:33.315637 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:33.315597 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4n62g" event={"ID":"a8b7f08f-8ac0-4cc8-b9c3-9dc0451f79c8","Type":"ContainerStarted","Data":"1fb5507e32d16b3d0f8c61c629f009c97fc40eb91fa3f826c6455d33c5610865"} Jun 09 12:41:33.317047 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:33.317021 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kj5x2" event={"ID":"98f6370c-d970-420a-afcc-7abb56d7c44e","Type":"ContainerStarted","Data":"3389317e529b0f0db0e01a6b6864a1f10de096a7f6b0c6d487fe6031303ae636"} Jun 09 12:41:33.320413 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:33.320387 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tsmnb" event={"ID":"4b49422f-6fab-47a3-956f-b78c3784dc3c","Type":"ContainerStarted","Data":"d69abb03bb30bb6a93ddd7c50859008f41eee11244dde9fff3e42570d33ebe29"} Jun 09 12:41:33.320596 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:33.320465 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tsmnb" event={"ID":"4b49422f-6fab-47a3-956f-b78c3784dc3c","Type":"ContainerStarted","Data":"ad015dd1ded6125b60dba7d963c478a3f00893c26cafdd196c73869d4c2e1bf7"} Jun 09 12:41:33.320596 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:33.320517 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tsmnb" event={"ID":"4b49422f-6fab-47a3-956f-b78c3784dc3c","Type":"ContainerStarted","Data":"f6aa998866fbff5dc8689b9f6cff337c6636e3b7327b1425ab47af2ee6c96caa"} Jun 09 12:41:33.320596 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:33.320564 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tsmnb" event={"ID":"4b49422f-6fab-47a3-956f-b78c3784dc3c","Type":"ContainerStarted","Data":"d2e3dceab5b9531132ed1b814dabef494247bc4c0ff3705584401d77149c42a1"} Jun 09 12:41:33.322112 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:33.322091 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xlxkq" event={"ID":"00dcaa51-80f6-4fcd-9eb0-8c27466112df","Type":"ContainerStarted","Data":"d74a0c356a65def87074ad2d5ac458386019d40e10f9dcdc01f8063a30a3ee32"} Jun 09 12:41:33.324126 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:33.324092 2561 generic.go:356] "Generic (PLEG): container finished" podID="3ae446967242a088e635b73955367e69" containerID="2be1b549ba50dc97120ab02fbfaff0472c48e522fc505cf005055fc51a2dfb14" exitCode=0 Jun 09 12:41:33.324217 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:33.324202 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-109.ec2.internal" event={"ID":"3ae446967242a088e635b73955367e69","Type":"ContainerDied","Data":"2be1b549ba50dc97120ab02fbfaff0472c48e522fc505cf005055fc51a2dfb14"} Jun 09 12:41:33.327796 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:33.327771 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lpnt2" event={"ID":"94fe31fd-8a59-4bff-b38f-43dfb84073f3","Type":"ContainerStarted","Data":"52e3417c6e082f3866c1a5686c511b315cdd9f64197f2a599a7c87b3cedea42e"} Jun 09 12:41:33.329367 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:33.329345 2561 generic.go:356] "Generic (PLEG): container finished" podID="a1b0f311-294d-4b26-b1ae-84ecd996fc34" containerID="6e6a506982604cbe237abdcb6533944744b2052230d8907c3e27559c62290b2c" exitCode=0 Jun 09 12:41:33.329456 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:33.329419 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vhn5n" event={"ID":"a1b0f311-294d-4b26-b1ae-84ecd996fc34","Type":"ContainerDied","Data":"6e6a506982604cbe237abdcb6533944744b2052230d8907c3e27559c62290b2c"} Jun 09 12:41:33.360830 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:33.360776 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-4n62g" podStartSLOduration=3.320218234 podStartE2EDuration="22.360761893s" totalImagesPullingTime="19.040543659s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 12:41:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:41:33.338509343 +0000 UTC m=+22.653823337" watchObservedRunningTime="2026-06-09 12:41:33.360761893 +0000 UTC m=+22.676075883" Jun 09 12:41:33.378947 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:33.378873 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-xlxkq" podStartSLOduration=3.309457751 podStartE2EDuration="22.378857185s" totalImagesPullingTime="19.069399434s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 12:41:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:41:33.378766893 +0000 UTC m=+22.694080896" watchObservedRunningTime="2026-06-09 12:41:33.378857185 +0000 UTC m=+22.694171176" Jun 09 12:41:33.423230 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:33.423171 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-lpnt2" podStartSLOduration=3.366965131 podStartE2EDuration="22.42315242s" totalImagesPullingTime="19.056187289s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 12:41:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:41:33.422668734 +0000 UTC m=+22.737982725" watchObservedRunningTime="2026-06-09 12:41:33.42315242 +0000 UTC m=+22.738466413" Jun 09 12:41:33.441450 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:33.441397 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-kj5x2" podStartSLOduration=11.824685427 podStartE2EDuration="22.441377384s" totalImagesPullingTime="10.616691957s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:41:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:41:33.441156684 +0000 UTC m=+22.756470673" watchObservedRunningTime="2026-06-09 12:41:33.441377384 +0000 UTC m=+22.756691376" Jun 09 12:41:34.033623 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:34.033563 2561 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 09 12:41:34.106775 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:34.106684 2561 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-09T12:41:34.033579067Z","UUID":"4c9b0d49-c30c-4e91-9dbd-aef5c515e1b6","Handler":null,"Name":"","Endpoint":""} Jun 09 12:41:34.108302 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:34.108276 2561 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 09 12:41:34.108411 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:34.108321 2561 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 09 12:41:34.111221 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:34.110893 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mq44p" Jun 09 12:41:34.111365 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:34.110899 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xcq9r" Jun 09 12:41:34.114111 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:34.114068 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mq44p" podUID="12a5bda4-80f2-4135-ad58-d5a14bceef3f" Jun 09 12:41:34.114637 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:34.114244 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xcq9r" podUID="c9511ce2-9c98-4362-8953-c323b4bdd636" Jun 09 12:41:34.333982 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:34.333943 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nwz6" event={"ID":"688d2f31-5684-43d2-81e4-a8c0b73565f5","Type":"ContainerStarted","Data":"46cc08f27c6fbc1d57c0092d646f36d6483837cddb5d5f1d621b53d7e99d9771"} Jun 09 12:41:34.335979 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:34.335948 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-109.ec2.internal" event={"ID":"3ae446967242a088e635b73955367e69","Type":"ContainerStarted","Data":"ede5c73f7dc771a1f9917fdde6a19566a1fd2c42431624c564669110320b0609"} Jun 09 12:41:34.356033 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:34.355991 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-109.ec2.internal" podStartSLOduration=22.355977013 podStartE2EDuration="22.355977013s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 12:41:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:41:34.355456816 +0000 UTC m=+23.670770800" watchObservedRunningTime="2026-06-09 12:41:34.355977013 +0000 UTC m=+23.671291002" Jun 09 12:41:34.896243 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:34.896195 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-kj5x2" Jun 09 12:41:34.896828 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:34.896787 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-kj5x2" Jun 09 12:41:35.111179 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:35.110937 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-br4cc" Jun 09 12:41:35.111354 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:35.111229 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-br4cc" podUID="3a86fe59-f4c8-4c09-9f19-6fada48b8194" Jun 09 12:41:35.344785 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:35.344751 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tsmnb" event={"ID":"4b49422f-6fab-47a3-956f-b78c3784dc3c","Type":"ContainerStarted","Data":"dd2b9837bbafe3ded3a94cd2f281f27aebcc185168f92786d30610541216e35b"} Jun 09 12:41:36.008720 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:36.008686 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-kj5x2" Jun 09 12:41:36.009473 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:36.009447 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-kj5x2" Jun 09 12:41:36.110754 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:36.110722 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xcq9r" Jun 09 12:41:36.110754 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:36.110739 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mq44p" Jun 09 12:41:36.110986 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:36.110855 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xcq9r" podUID="c9511ce2-9c98-4362-8953-c323b4bdd636" Jun 09 12:41:36.110986 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:36.110971 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mq44p" podUID="12a5bda4-80f2-4135-ad58-d5a14bceef3f" Jun 09 12:41:36.349766 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:36.349683 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nwz6" event={"ID":"688d2f31-5684-43d2-81e4-a8c0b73565f5","Type":"ContainerStarted","Data":"51faa2eb84dd7d8a0b07c65d4e0a56772ccd5d2dcfda7faaf4c4154addffd9b0"} Jun 09 12:41:36.370614 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:36.370571 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nwz6" podStartSLOduration=3.978476759 podStartE2EDuration="25.370554854s" totalImagesPullingTime="21.392078095s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 12:41:11 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:41:36.370433732 +0000 UTC m=+25.685747724" watchObservedRunningTime="2026-06-09 12:41:36.370554854 +0000 UTC m=+25.685868845" Jun 09 12:41:37.110686 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:37.110657 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-br4cc" Jun 09 12:41:37.110911 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:37.110775 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-br4cc" podUID="3a86fe59-f4c8-4c09-9f19-6fada48b8194" Jun 09 12:41:38.110283 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:38.110087 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mq44p" Jun 09 12:41:38.110899 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:38.110087 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xcq9r" Jun 09 12:41:38.110899 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:38.110329 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mq44p" podUID="12a5bda4-80f2-4135-ad58-d5a14bceef3f" Jun 09 12:41:38.110899 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:38.110413 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xcq9r" podUID="c9511ce2-9c98-4362-8953-c323b4bdd636" Jun 09 12:41:38.357575 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:38.357545 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tsmnb" event={"ID":"4b49422f-6fab-47a3-956f-b78c3784dc3c","Type":"ContainerStarted","Data":"73a2eaf4b8264439ff678b7ee98e6f3a51df14e5dd0f433f0988a4d655ed182c"} Jun 09 12:41:38.357869 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:38.357809 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tsmnb" Jun 09 12:41:38.357998 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:38.357890 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tsmnb" Jun 09 12:41:38.357998 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:38.357936 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tsmnb" Jun 09 12:41:38.359607 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:38.359583 2561 generic.go:356] "Generic (PLEG): container finished" podID="a1b0f311-294d-4b26-b1ae-84ecd996fc34" containerID="58462cdbc8173852ab383e9ba8d662b77f5dd8d3021c2d0fd6d673fe795d1501" exitCode=0 Jun 09 12:41:38.359722 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:38.359627 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vhn5n" event={"ID":"a1b0f311-294d-4b26-b1ae-84ecd996fc34","Type":"ContainerDied","Data":"58462cdbc8173852ab383e9ba8d662b77f5dd8d3021c2d0fd6d673fe795d1501"} Jun 09 12:41:38.374335 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:38.374309 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tsmnb" Jun 09 12:41:38.374665 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:38.374619 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tsmnb" Jun 09 12:41:38.393806 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:38.393766 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-tsmnb" podStartSLOduration=7.673670149 podStartE2EDuration="27.393754298s" totalImagesPullingTime="19.720084149s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 12:41:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:41:38.393299425 +0000 UTC m=+27.708613436" watchObservedRunningTime="2026-06-09 12:41:38.393754298 +0000 UTC m=+27.709068321" Jun 09 12:41:39.110194 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:39.110150 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-br4cc" Jun 09 12:41:39.110440 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:39.110271 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-br4cc" podUID="3a86fe59-f4c8-4c09-9f19-6fada48b8194" Jun 09 12:41:39.562727 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:39.561724 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mq44p"] Jun 09 12:41:39.562727 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:39.562052 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-br4cc"] Jun 09 12:41:39.562727 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:39.562156 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-br4cc" Jun 09 12:41:39.562727 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:39.562284 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-br4cc" podUID="3a86fe59-f4c8-4c09-9f19-6fada48b8194" Jun 09 12:41:39.563296 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:39.563273 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mq44p" Jun 09 12:41:39.563399 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:39.563379 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mq44p" podUID="12a5bda4-80f2-4135-ad58-d5a14bceef3f" Jun 09 12:41:39.564247 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:39.564219 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xcq9r"] Jun 09 12:41:39.564388 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:39.564372 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xcq9r" Jun 09 12:41:39.564479 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:39.564462 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xcq9r" podUID="c9511ce2-9c98-4362-8953-c323b4bdd636" Jun 09 12:41:40.366199 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:40.366164 2561 generic.go:356] "Generic (PLEG): container finished" podID="a1b0f311-294d-4b26-b1ae-84ecd996fc34" containerID="8e1f1ba2f28b5728eac3b52141c061844a805845bc6164affcb2cfff73d37b39" exitCode=0 Jun 09 12:41:40.366665 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:40.366250 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vhn5n" event={"ID":"a1b0f311-294d-4b26-b1ae-84ecd996fc34","Type":"ContainerDied","Data":"8e1f1ba2f28b5728eac3b52141c061844a805845bc6164affcb2cfff73d37b39"} Jun 09 12:41:41.111147 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:41.111115 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xcq9r" Jun 09 12:41:41.111324 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:41.111226 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xcq9r" podUID="c9511ce2-9c98-4362-8953-c323b4bdd636" Jun 09 12:41:41.111324 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:41.111294 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mq44p" Jun 09 12:41:41.111434 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:41.111384 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mq44p" podUID="12a5bda4-80f2-4135-ad58-d5a14bceef3f" Jun 09 12:41:41.111434 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:41.111418 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-br4cc" Jun 09 12:41:41.111519 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:41.111463 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-br4cc" podUID="3a86fe59-f4c8-4c09-9f19-6fada48b8194" Jun 09 12:41:42.372430 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:42.372392 2561 generic.go:356] "Generic (PLEG): container finished" podID="a1b0f311-294d-4b26-b1ae-84ecd996fc34" containerID="59e7d3a8a2d8d2f4732eed41ab48e1420d6d55fab8f0017201ad90c80b5ca680" exitCode=0 Jun 09 12:41:42.373181 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:42.372439 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vhn5n" event={"ID":"a1b0f311-294d-4b26-b1ae-84ecd996fc34","Type":"ContainerDied","Data":"59e7d3a8a2d8d2f4732eed41ab48e1420d6d55fab8f0017201ad90c80b5ca680"} Jun 09 12:41:43.110681 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:43.110646 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xcq9r" Jun 09 12:41:43.110860 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:43.110691 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-br4cc" Jun 09 12:41:43.110860 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:43.110646 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mq44p" Jun 09 12:41:43.110860 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:43.110795 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xcq9r" podUID="c9511ce2-9c98-4362-8953-c323b4bdd636" Jun 09 12:41:43.111032 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:43.110888 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mq44p" podUID="12a5bda4-80f2-4135-ad58-d5a14bceef3f" Jun 09 12:41:43.111032 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:43.110976 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-br4cc" podUID="3a86fe59-f4c8-4c09-9f19-6fada48b8194" Jun 09 12:41:43.894535 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:43.894497 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9511ce2-9c98-4362-8953-c323b4bdd636-metrics-certs\") pod \"network-metrics-daemon-xcq9r\" (UID: \"c9511ce2-9c98-4362-8953-c323b4bdd636\") " pod="openshift-multus/network-metrics-daemon-xcq9r" Jun 09 12:41:43.894999 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:43.894588 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3a86fe59-f4c8-4c09-9f19-6fada48b8194-original-pull-secret\") pod \"global-pull-secret-syncer-br4cc\" (UID: \"3a86fe59-f4c8-4c09-9f19-6fada48b8194\") " pod="kube-system/global-pull-secret-syncer-br4cc" Jun 09 12:41:43.894999 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:43.894611 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 12:41:43.894999 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:43.894678 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9511ce2-9c98-4362-8953-c323b4bdd636-metrics-certs podName:c9511ce2-9c98-4362-8953-c323b4bdd636 nodeName:}" failed. No retries permitted until 2026-06-09 12:42:15.894662266 +0000 UTC m=+65.209976234 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c9511ce2-9c98-4362-8953-c323b4bdd636-metrics-certs") pod "network-metrics-daemon-xcq9r" (UID: "c9511ce2-9c98-4362-8953-c323b4bdd636") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 12:41:43.894999 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:43.894695 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 12:41:43.894999 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:43.894749 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a86fe59-f4c8-4c09-9f19-6fada48b8194-original-pull-secret podName:3a86fe59-f4c8-4c09-9f19-6fada48b8194 nodeName:}" failed. No retries permitted until 2026-06-09 12:42:15.894733442 +0000 UTC m=+65.210047414 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3a86fe59-f4c8-4c09-9f19-6fada48b8194-original-pull-secret") pod "global-pull-secret-syncer-br4cc" (UID: "3a86fe59-f4c8-4c09-9f19-6fada48b8194") : object "kube-system"/"original-pull-secret" not registered Jun 09 12:41:43.995042 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:43.995008 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhhww\" (UniqueName: \"kubernetes.io/projected/12a5bda4-80f2-4135-ad58-d5a14bceef3f-kube-api-access-mhhww\") pod \"network-check-target-mq44p\" (UID: \"12a5bda4-80f2-4135-ad58-d5a14bceef3f\") " pod="openshift-network-diagnostics/network-check-target-mq44p" Jun 09 12:41:43.995215 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:43.995165 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 12:41:43.995215 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:43.995187 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 12:41:43.995215 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:43.995201 2561 projected.go:196] Error preparing data for projected volume kube-api-access-mhhww for pod openshift-network-diagnostics/network-check-target-mq44p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 12:41:43.995328 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:43.995255 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/12a5bda4-80f2-4135-ad58-d5a14bceef3f-kube-api-access-mhhww podName:12a5bda4-80f2-4135-ad58-d5a14bceef3f nodeName:}" failed. No retries permitted until 2026-06-09 12:42:15.995241609 +0000 UTC m=+65.310555579 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-mhhww" (UniqueName: "kubernetes.io/projected/12a5bda4-80f2-4135-ad58-d5a14bceef3f-kube-api-access-mhhww") pod "network-check-target-mq44p" (UID: "12a5bda4-80f2-4135-ad58-d5a14bceef3f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 12:41:45.110283 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:45.110235 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xcq9r" Jun 09 12:41:45.110283 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:45.110271 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-br4cc" Jun 09 12:41:45.110795 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:45.110237 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mq44p" Jun 09 12:41:45.110795 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:45.110378 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xcq9r" podUID="c9511ce2-9c98-4362-8953-c323b4bdd636" Jun 09 12:41:45.110795 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:45.110443 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-br4cc" podUID="3a86fe59-f4c8-4c09-9f19-6fada48b8194" Jun 09 12:41:45.110795 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:45.110506 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mq44p" podUID="12a5bda4-80f2-4135-ad58-d5a14bceef3f" Jun 09 12:41:46.013221 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:46.013033 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-109.ec2.internal" event="NodeReady" Jun 09 12:41:46.013386 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:46.013323 2561 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 09 12:41:46.060261 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:46.060231 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-gd65w"] Jun 09 12:41:46.066483 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:46.066455 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-gckgj"] Jun 09 12:41:46.066599 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:46.066583 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gd65w" Jun 09 12:41:46.069264 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:46.069241 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 09 12:41:46.069264 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:46.069263 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-k7xst\"" Jun 09 12:41:46.069534 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:46.069520 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 09 12:41:46.070091 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:46.070074 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gckgj" Jun 09 12:41:46.072355 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:46.072338 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-mgx5s\"" Jun 09 12:41:46.072587 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:46.072568 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 09 12:41:46.072708 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:46.072691 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 09 12:41:46.072765 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:46.072713 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 09 12:41:46.076771 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:46.076749 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gd65w"] Jun 09 12:41:46.079221 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:46.079194 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gckgj"] Jun 09 12:41:46.212835 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:46.212787 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/31987512-1565-4167-b4e7-1e9414500b94-tmp-dir\") pod \"dns-default-gd65w\" (UID: \"31987512-1565-4167-b4e7-1e9414500b94\") " pod="openshift-dns/dns-default-gd65w" Jun 09 12:41:46.213199 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:46.212860 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/31987512-1565-4167-b4e7-1e9414500b94-config-volume\") pod \"dns-default-gd65w\" (UID: \"31987512-1565-4167-b4e7-1e9414500b94\") " pod="openshift-dns/dns-default-gd65w" Jun 09 12:41:46.213199 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:46.212895 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqqjc\" (UniqueName: \"kubernetes.io/projected/31987512-1565-4167-b4e7-1e9414500b94-kube-api-access-kqqjc\") pod \"dns-default-gd65w\" (UID: \"31987512-1565-4167-b4e7-1e9414500b94\") " pod="openshift-dns/dns-default-gd65w" Jun 09 12:41:46.213199 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:46.212928 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d830b16-2fa4-4b5d-b5e5-0fbc3a4261d3-cert\") pod \"ingress-canary-gckgj\" (UID: \"3d830b16-2fa4-4b5d-b5e5-0fbc3a4261d3\") " pod="openshift-ingress-canary/ingress-canary-gckgj" Jun 09 12:41:46.213199 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:46.212951 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/31987512-1565-4167-b4e7-1e9414500b94-metrics-tls\") pod \"dns-default-gd65w\" (UID: \"31987512-1565-4167-b4e7-1e9414500b94\") " pod="openshift-dns/dns-default-gd65w" Jun 09 12:41:46.213199 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:46.213033 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6r6bd\" (UniqueName: \"kubernetes.io/projected/3d830b16-2fa4-4b5d-b5e5-0fbc3a4261d3-kube-api-access-6r6bd\") pod \"ingress-canary-gckgj\" (UID: \"3d830b16-2fa4-4b5d-b5e5-0fbc3a4261d3\") " pod="openshift-ingress-canary/ingress-canary-gckgj" Jun 09 12:41:46.313464 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:46.313443 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d830b16-2fa4-4b5d-b5e5-0fbc3a4261d3-cert\") pod \"ingress-canary-gckgj\" (UID: \"3d830b16-2fa4-4b5d-b5e5-0fbc3a4261d3\") " pod="openshift-ingress-canary/ingress-canary-gckgj" Jun 09 12:41:46.313584 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:46.313471 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/31987512-1565-4167-b4e7-1e9414500b94-metrics-tls\") pod \"dns-default-gd65w\" (UID: \"31987512-1565-4167-b4e7-1e9414500b94\") " pod="openshift-dns/dns-default-gd65w" Jun 09 12:41:46.313584 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:46.313509 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6r6bd\" (UniqueName: \"kubernetes.io/projected/3d830b16-2fa4-4b5d-b5e5-0fbc3a4261d3-kube-api-access-6r6bd\") pod \"ingress-canary-gckgj\" (UID: \"3d830b16-2fa4-4b5d-b5e5-0fbc3a4261d3\") " pod="openshift-ingress-canary/ingress-canary-gckgj" Jun 09 12:41:46.313584 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:46.313537 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/31987512-1565-4167-b4e7-1e9414500b94-tmp-dir\") pod \"dns-default-gd65w\" (UID: \"31987512-1565-4167-b4e7-1e9414500b94\") " pod="openshift-dns/dns-default-gd65w" Jun 09 12:41:46.313584 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:46.313565 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/31987512-1565-4167-b4e7-1e9414500b94-config-volume\") pod \"dns-default-gd65w\" (UID: \"31987512-1565-4167-b4e7-1e9414500b94\") " pod="openshift-dns/dns-default-gd65w" Jun 09 12:41:46.313584 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:46.313582 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqqjc\" (UniqueName: \"kubernetes.io/projected/31987512-1565-4167-b4e7-1e9414500b94-kube-api-access-kqqjc\") pod \"dns-default-gd65w\" (UID: \"31987512-1565-4167-b4e7-1e9414500b94\") " pod="openshift-dns/dns-default-gd65w" Jun 09 12:41:46.313853 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:46.313589 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 12:41:46.313853 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:46.313647 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31987512-1565-4167-b4e7-1e9414500b94-metrics-tls podName:31987512-1565-4167-b4e7-1e9414500b94 nodeName:}" failed. No retries permitted until 2026-06-09 12:41:46.813628049 +0000 UTC m=+36.128942028 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/31987512-1565-4167-b4e7-1e9414500b94-metrics-tls") pod "dns-default-gd65w" (UID: "31987512-1565-4167-b4e7-1e9414500b94") : secret "dns-default-metrics-tls" not found Jun 09 12:41:46.313957 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:46.313888 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/31987512-1565-4167-b4e7-1e9414500b94-tmp-dir\") pod \"dns-default-gd65w\" (UID: \"31987512-1565-4167-b4e7-1e9414500b94\") " pod="openshift-dns/dns-default-gd65w" Jun 09 12:41:46.314232 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:46.314214 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/31987512-1565-4167-b4e7-1e9414500b94-config-volume\") pod \"dns-default-gd65w\" (UID: \"31987512-1565-4167-b4e7-1e9414500b94\") " pod="openshift-dns/dns-default-gd65w" Jun 09 12:41:46.317658 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:46.317634 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d830b16-2fa4-4b5d-b5e5-0fbc3a4261d3-cert\") pod \"ingress-canary-gckgj\" (UID: \"3d830b16-2fa4-4b5d-b5e5-0fbc3a4261d3\") " pod="openshift-ingress-canary/ingress-canary-gckgj" Jun 09 12:41:46.324759 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:46.324734 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqqjc\" (UniqueName: \"kubernetes.io/projected/31987512-1565-4167-b4e7-1e9414500b94-kube-api-access-kqqjc\") pod \"dns-default-gd65w\" (UID: \"31987512-1565-4167-b4e7-1e9414500b94\") " pod="openshift-dns/dns-default-gd65w" Jun 09 12:41:46.326169 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:46.326145 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6r6bd\" (UniqueName: \"kubernetes.io/projected/3d830b16-2fa4-4b5d-b5e5-0fbc3a4261d3-kube-api-access-6r6bd\") pod \"ingress-canary-gckgj\" (UID: \"3d830b16-2fa4-4b5d-b5e5-0fbc3a4261d3\") " pod="openshift-ingress-canary/ingress-canary-gckgj" Jun 09 12:41:46.384130 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:46.384091 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vhn5n" event={"ID":"a1b0f311-294d-4b26-b1ae-84ecd996fc34","Type":"ContainerStarted","Data":"bccc682a9a367bbcf56c5b30cbd15c4dfb620af3427f9556d83564e08459dd8a"} Jun 09 12:41:46.386588 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:46.386567 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gckgj" Jun 09 12:41:46.523353 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:46.523326 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gckgj"] Jun 09 12:41:46.528257 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:46.528232 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d830b16_2fa4_4b5d_b5e5_0fbc3a4261d3.slice/crio-af14d7b24d71a9ea52fe5e03e8805d421ad5c3379eea1bbfc95778e85daf4834 WatchSource:0}: Error finding container af14d7b24d71a9ea52fe5e03e8805d421ad5c3379eea1bbfc95778e85daf4834: Status 404 returned error can't find the container with id af14d7b24d71a9ea52fe5e03e8805d421ad5c3379eea1bbfc95778e85daf4834 Jun 09 12:41:46.816141 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:46.816059 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/31987512-1565-4167-b4e7-1e9414500b94-metrics-tls\") pod \"dns-default-gd65w\" (UID: \"31987512-1565-4167-b4e7-1e9414500b94\") " pod="openshift-dns/dns-default-gd65w" Jun 09 12:41:46.816286 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:46.816183 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 12:41:46.816286 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:46.816236 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31987512-1565-4167-b4e7-1e9414500b94-metrics-tls podName:31987512-1565-4167-b4e7-1e9414500b94 nodeName:}" failed. No retries permitted until 2026-06-09 12:41:47.816221727 +0000 UTC m=+37.131535696 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/31987512-1565-4167-b4e7-1e9414500b94-metrics-tls") pod "dns-default-gd65w" (UID: "31987512-1565-4167-b4e7-1e9414500b94") : secret "dns-default-metrics-tls" not found Jun 09 12:41:47.110392 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:47.110305 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mq44p" Jun 09 12:41:47.110555 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:47.110317 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xcq9r" Jun 09 12:41:47.110555 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:47.110489 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-br4cc" Jun 09 12:41:47.114792 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:47.114758 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 12:41:47.114942 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:47.114845 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 12:41:47.115010 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:47.114938 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fjw6q\"" Jun 09 12:41:47.116065 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:47.116043 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-sfqkv\"" Jun 09 12:41:47.116562 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:47.116548 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 12:41:47.117217 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:47.117197 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 12:41:47.387571 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:47.387480 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gckgj" event={"ID":"3d830b16-2fa4-4b5d-b5e5-0fbc3a4261d3","Type":"ContainerStarted","Data":"af14d7b24d71a9ea52fe5e03e8805d421ad5c3379eea1bbfc95778e85daf4834"} Jun 09 12:41:47.390704 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:47.390675 2561 generic.go:356] "Generic (PLEG): container finished" podID="a1b0f311-294d-4b26-b1ae-84ecd996fc34" containerID="bccc682a9a367bbcf56c5b30cbd15c4dfb620af3427f9556d83564e08459dd8a" exitCode=0 Jun 09 12:41:47.390852 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:47.390743 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vhn5n" event={"ID":"a1b0f311-294d-4b26-b1ae-84ecd996fc34","Type":"ContainerDied","Data":"bccc682a9a367bbcf56c5b30cbd15c4dfb620af3427f9556d83564e08459dd8a"} Jun 09 12:41:47.825080 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:47.824868 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/31987512-1565-4167-b4e7-1e9414500b94-metrics-tls\") pod \"dns-default-gd65w\" (UID: \"31987512-1565-4167-b4e7-1e9414500b94\") " pod="openshift-dns/dns-default-gd65w" Jun 09 12:41:47.825317 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:47.825019 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 12:41:47.825317 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:47.825154 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31987512-1565-4167-b4e7-1e9414500b94-metrics-tls podName:31987512-1565-4167-b4e7-1e9414500b94 nodeName:}" failed. No retries permitted until 2026-06-09 12:41:49.825135906 +0000 UTC m=+39.140449888 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/31987512-1565-4167-b4e7-1e9414500b94-metrics-tls") pod "dns-default-gd65w" (UID: "31987512-1565-4167-b4e7-1e9414500b94") : secret "dns-default-metrics-tls" not found Jun 09 12:41:48.396629 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:48.396600 2561 generic.go:356] "Generic (PLEG): container finished" podID="a1b0f311-294d-4b26-b1ae-84ecd996fc34" containerID="b9734ad089cccfac7a486413442a62a46eab61811e42654000db1aca77dada6c" exitCode=0 Jun 09 12:41:48.397202 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:48.396679 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vhn5n" event={"ID":"a1b0f311-294d-4b26-b1ae-84ecd996fc34","Type":"ContainerDied","Data":"b9734ad089cccfac7a486413442a62a46eab61811e42654000db1aca77dada6c"} Jun 09 12:41:48.398362 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:48.398339 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gckgj" event={"ID":"3d830b16-2fa4-4b5d-b5e5-0fbc3a4261d3","Type":"ContainerStarted","Data":"5af922618a83fecb615871ef8ca2f8bb1bb65fda6aec9457d3866af75709b56d"} Jun 09 12:41:48.444435 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:48.444378 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-gckgj" podStartSLOduration=0.725968617 podStartE2EDuration="2.444357308s" totalImagesPullingTime="1.718388691s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:41:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:41:48.443568744 +0000 UTC m=+37.758882736" watchObservedRunningTime="2026-06-09 12:41:48.444357308 +0000 UTC m=+37.759671299" Jun 09 12:41:49.403781 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:49.403749 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vhn5n" event={"ID":"a1b0f311-294d-4b26-b1ae-84ecd996fc34","Type":"ContainerStarted","Data":"d057f9f18c10d627cb6b38a234ae01bdfcc49adbdbc1a02ba6cef49d29a38297"} Jun 09 12:41:49.428128 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:49.428077 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-vhn5n" podStartSLOduration=8.575697543 podStartE2EDuration="38.428062622s" totalImagesPullingTime="29.852365079s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 12:41:11 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:41:49.426577514 +0000 UTC m=+38.741891503" watchObservedRunningTime="2026-06-09 12:41:49.428062622 +0000 UTC m=+38.743376613" Jun 09 12:41:49.840845 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:49.840790 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/31987512-1565-4167-b4e7-1e9414500b94-metrics-tls\") pod \"dns-default-gd65w\" (UID: \"31987512-1565-4167-b4e7-1e9414500b94\") " pod="openshift-dns/dns-default-gd65w" Jun 09 12:41:49.840995 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:49.840942 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 12:41:49.841052 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:49.841037 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31987512-1565-4167-b4e7-1e9414500b94-metrics-tls podName:31987512-1565-4167-b4e7-1e9414500b94 nodeName:}" failed. No retries permitted until 2026-06-09 12:41:53.8410069 +0000 UTC m=+43.156320888 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/31987512-1565-4167-b4e7-1e9414500b94-metrics-tls") pod "dns-default-gd65w" (UID: "31987512-1565-4167-b4e7-1e9414500b94") : secret "dns-default-metrics-tls" not found Jun 09 12:41:51.080896 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:51.080873 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xlxkq_00dcaa51-80f6-4fcd-9eb0-8c27466112df/dns-node-resolver/0.log" Jun 09 12:41:51.481006 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:51.480936 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4n62g_a8b7f08f-8ac0-4cc8-b9c3-9dc0451f79c8/node-ca/0.log" Jun 09 12:41:52.684578 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:52.684539 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gckgj_3d830b16-2fa4-4b5d-b5e5-0fbc3a4261d3/serve-healthcheck-canary/0.log" Jun 09 12:41:53.666462 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:53.666427 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-cscvd"] Jun 09 12:41:53.707723 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:53.707690 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-cscvd"] Jun 09 12:41:53.708111 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:53.707789 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-cscvd" Jun 09 12:41:53.710844 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:53.710823 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 09 12:41:53.710936 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:53.710826 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 09 12:41:53.710936 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:53.710853 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-zjncs\"" Jun 09 12:41:53.767571 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:53.767544 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-m8hvz"] Jun 09 12:41:53.791849 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:53.789634 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-d7689"] Jun 09 12:41:53.791849 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:53.790878 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-m8hvz" Jun 09 12:41:53.794023 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:53.793996 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 09 12:41:53.794023 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:53.794025 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-ktn5t\"" Jun 09 12:41:53.794327 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:53.794301 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 09 12:41:53.794396 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:53.794357 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 09 12:41:53.794491 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:53.794464 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 09 12:41:53.803539 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:53.803520 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-4l59j"] Jun 09 12:41:53.803644 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:53.803630 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-d7689" Jun 09 12:41:53.806485 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:53.806453 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 09 12:41:53.806577 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:53.806535 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 09 12:41:53.806628 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:53.806535 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-dg9db\"" Jun 09 12:41:53.806736 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:53.806720 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 09 12:41:53.806771 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:53.806744 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 09 12:41:53.825746 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:53.825726 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-m8hvz"] Jun 09 12:41:53.825849 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:53.825759 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-d7689"] Jun 09 12:41:53.825849 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:53.825774 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-4l59j"] Jun 09 12:41:53.825925 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:53.825860 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-4l59j" Jun 09 12:41:53.828511 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:53.828492 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 09 12:41:53.828605 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:53.828546 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 09 12:41:53.828605 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:53.828600 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-vbgkg\"" Jun 09 12:41:53.828725 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:53.828614 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 09 12:41:53.828891 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:53.828876 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 09 12:41:53.834666 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:53.834639 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 09 12:41:53.874601 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:53.874566 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/31987512-1565-4167-b4e7-1e9414500b94-metrics-tls\") pod \"dns-default-gd65w\" (UID: \"31987512-1565-4167-b4e7-1e9414500b94\") " pod="openshift-dns/dns-default-gd65w" Jun 09 12:41:53.874738 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:53.874641 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6jf8\" (UniqueName: \"kubernetes.io/projected/e9a5c713-1ee4-4293-8b96-29d43eac55f4-kube-api-access-x6jf8\") pod \"volume-data-source-validator-78dd696465-cscvd\" (UID: \"e9a5c713-1ee4-4293-8b96-29d43eac55f4\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-cscvd" Jun 09 12:41:53.874738 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:53.874712 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 12:41:53.874866 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:41:53.874777 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31987512-1565-4167-b4e7-1e9414500b94-metrics-tls podName:31987512-1565-4167-b4e7-1e9414500b94 nodeName:}" failed. No retries permitted until 2026-06-09 12:42:01.874761774 +0000 UTC m=+51.190075743 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/31987512-1565-4167-b4e7-1e9414500b94-metrics-tls") pod "dns-default-gd65w" (UID: "31987512-1565-4167-b4e7-1e9414500b94") : secret "dns-default-metrics-tls" not found Jun 09 12:41:53.975947 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:53.975857 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dd28dc2d-f1bc-4022-ad12-dac9c5f8331a-serving-cert\") pod \"console-operator-668fdbf85c-4l59j\" (UID: \"dd28dc2d-f1bc-4022-ad12-dac9c5f8331a\") " pod="openshift-console-operator/console-operator-668fdbf85c-4l59j" Jun 09 12:41:53.975947 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:53.975898 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kphhk\" (UniqueName: \"kubernetes.io/projected/48765388-02b2-4591-a720-30d6215fa9a3-kube-api-access-kphhk\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-m8hvz\" (UID: \"48765388-02b2-4591-a720-30d6215fa9a3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-m8hvz" Jun 09 12:41:53.976120 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:53.975973 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dd28dc2d-f1bc-4022-ad12-dac9c5f8331a-trusted-ca\") pod \"console-operator-668fdbf85c-4l59j\" (UID: \"dd28dc2d-f1bc-4022-ad12-dac9c5f8331a\") " pod="openshift-console-operator/console-operator-668fdbf85c-4l59j" Jun 09 12:41:53.976120 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:53.976015 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5a923537-e481-434d-a73d-675ce3d058b9-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-d7689\" (UID: \"5a923537-e481-434d-a73d-675ce3d058b9\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-d7689" Jun 09 12:41:53.976120 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:53.976041 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5a923537-e481-434d-a73d-675ce3d058b9-config\") pod \"service-ca-operator-6bc5ff68f5-d7689\" (UID: \"5a923537-e481-434d-a73d-675ce3d058b9\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-d7689" Jun 09 12:41:53.976120 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:53.976079 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/48765388-02b2-4591-a720-30d6215fa9a3-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-m8hvz\" (UID: \"48765388-02b2-4591-a720-30d6215fa9a3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-m8hvz" Jun 09 12:41:53.976120 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:53.976096 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtm5r\" (UniqueName: \"kubernetes.io/projected/5a923537-e481-434d-a73d-675ce3d058b9-kube-api-access-qtm5r\") pod \"service-ca-operator-6bc5ff68f5-d7689\" (UID: \"5a923537-e481-434d-a73d-675ce3d058b9\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-d7689" Jun 09 12:41:53.976293 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:53.976120 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/48765388-02b2-4591-a720-30d6215fa9a3-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-m8hvz\" (UID: \"48765388-02b2-4591-a720-30d6215fa9a3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-m8hvz" Jun 09 12:41:53.976293 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:53.976148 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/dd28dc2d-f1bc-4022-ad12-dac9c5f8331a-config\") pod \"console-operator-668fdbf85c-4l59j\" (UID: \"dd28dc2d-f1bc-4022-ad12-dac9c5f8331a\") " pod="openshift-console-operator/console-operator-668fdbf85c-4l59j" Jun 09 12:41:53.976293 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:53.976192 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6jf8\" (UniqueName: \"kubernetes.io/projected/e9a5c713-1ee4-4293-8b96-29d43eac55f4-kube-api-access-x6jf8\") pod \"volume-data-source-validator-78dd696465-cscvd\" (UID: \"e9a5c713-1ee4-4293-8b96-29d43eac55f4\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-cscvd" Jun 09 12:41:53.976293 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:53.976207 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tf9l\" (UniqueName: \"kubernetes.io/projected/dd28dc2d-f1bc-4022-ad12-dac9c5f8331a-kube-api-access-5tf9l\") pod \"console-operator-668fdbf85c-4l59j\" (UID: \"dd28dc2d-f1bc-4022-ad12-dac9c5f8331a\") " pod="openshift-console-operator/console-operator-668fdbf85c-4l59j" Jun 09 12:41:53.987825 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:53.987784 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6jf8\" (UniqueName: \"kubernetes.io/projected/e9a5c713-1ee4-4293-8b96-29d43eac55f4-kube-api-access-x6jf8\") pod \"volume-data-source-validator-78dd696465-cscvd\" (UID: \"e9a5c713-1ee4-4293-8b96-29d43eac55f4\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-cscvd" Jun 09 12:41:54.016388 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:54.016361 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-cscvd" Jun 09 12:41:54.077453 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:54.077421 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dd28dc2d-f1bc-4022-ad12-dac9c5f8331a-trusted-ca\") pod \"console-operator-668fdbf85c-4l59j\" (UID: \"dd28dc2d-f1bc-4022-ad12-dac9c5f8331a\") " pod="openshift-console-operator/console-operator-668fdbf85c-4l59j" Jun 09 12:41:54.077453 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:54.077455 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5a923537-e481-434d-a73d-675ce3d058b9-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-d7689\" (UID: \"5a923537-e481-434d-a73d-675ce3d058b9\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-d7689" Jun 09 12:41:54.077663 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:54.077474 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5a923537-e481-434d-a73d-675ce3d058b9-config\") pod \"service-ca-operator-6bc5ff68f5-d7689\" (UID: \"5a923537-e481-434d-a73d-675ce3d058b9\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-d7689" Jun 09 12:41:54.077663 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:54.077544 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/48765388-02b2-4591-a720-30d6215fa9a3-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-m8hvz\" (UID: \"48765388-02b2-4591-a720-30d6215fa9a3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-m8hvz" Jun 09 12:41:54.077663 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:54.077574 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtm5r\" (UniqueName: \"kubernetes.io/projected/5a923537-e481-434d-a73d-675ce3d058b9-kube-api-access-qtm5r\") pod \"service-ca-operator-6bc5ff68f5-d7689\" (UID: \"5a923537-e481-434d-a73d-675ce3d058b9\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-d7689" Jun 09 12:41:54.077663 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:54.077609 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/48765388-02b2-4591-a720-30d6215fa9a3-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-m8hvz\" (UID: \"48765388-02b2-4591-a720-30d6215fa9a3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-m8hvz" Jun 09 12:41:54.077663 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:54.077627 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/dd28dc2d-f1bc-4022-ad12-dac9c5f8331a-config\") pod \"console-operator-668fdbf85c-4l59j\" (UID: \"dd28dc2d-f1bc-4022-ad12-dac9c5f8331a\") " pod="openshift-console-operator/console-operator-668fdbf85c-4l59j" Jun 09 12:41:54.077945 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:54.077682 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tf9l\" (UniqueName: \"kubernetes.io/projected/dd28dc2d-f1bc-4022-ad12-dac9c5f8331a-kube-api-access-5tf9l\") pod \"console-operator-668fdbf85c-4l59j\" (UID: \"dd28dc2d-f1bc-4022-ad12-dac9c5f8331a\") " pod="openshift-console-operator/console-operator-668fdbf85c-4l59j" Jun 09 12:41:54.077945 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:54.077724 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dd28dc2d-f1bc-4022-ad12-dac9c5f8331a-serving-cert\") pod \"console-operator-668fdbf85c-4l59j\" (UID: \"dd28dc2d-f1bc-4022-ad12-dac9c5f8331a\") " pod="openshift-console-operator/console-operator-668fdbf85c-4l59j" Jun 09 12:41:54.077945 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:54.077751 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kphhk\" (UniqueName: \"kubernetes.io/projected/48765388-02b2-4591-a720-30d6215fa9a3-kube-api-access-kphhk\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-m8hvz\" (UID: \"48765388-02b2-4591-a720-30d6215fa9a3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-m8hvz" Jun 09 12:41:54.078098 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:54.078085 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5a923537-e481-434d-a73d-675ce3d058b9-config\") pod \"service-ca-operator-6bc5ff68f5-d7689\" (UID: \"5a923537-e481-434d-a73d-675ce3d058b9\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-d7689" Jun 09 12:41:54.078244 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:54.078215 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/48765388-02b2-4591-a720-30d6215fa9a3-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-m8hvz\" (UID: \"48765388-02b2-4591-a720-30d6215fa9a3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-m8hvz" Jun 09 12:41:54.078612 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:54.078594 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/dd28dc2d-f1bc-4022-ad12-dac9c5f8331a-config\") pod \"console-operator-668fdbf85c-4l59j\" (UID: \"dd28dc2d-f1bc-4022-ad12-dac9c5f8331a\") " pod="openshift-console-operator/console-operator-668fdbf85c-4l59j" Jun 09 12:41:54.079071 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:54.079047 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dd28dc2d-f1bc-4022-ad12-dac9c5f8331a-trusted-ca\") pod \"console-operator-668fdbf85c-4l59j\" (UID: \"dd28dc2d-f1bc-4022-ad12-dac9c5f8331a\") " pod="openshift-console-operator/console-operator-668fdbf85c-4l59j" Jun 09 12:41:54.080306 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:54.080252 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5a923537-e481-434d-a73d-675ce3d058b9-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-d7689\" (UID: \"5a923537-e481-434d-a73d-675ce3d058b9\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-d7689" Jun 09 12:41:54.080306 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:54.080275 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/48765388-02b2-4591-a720-30d6215fa9a3-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-m8hvz\" (UID: \"48765388-02b2-4591-a720-30d6215fa9a3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-m8hvz" Jun 09 12:41:54.080575 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:54.080555 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dd28dc2d-f1bc-4022-ad12-dac9c5f8331a-serving-cert\") pod \"console-operator-668fdbf85c-4l59j\" (UID: \"dd28dc2d-f1bc-4022-ad12-dac9c5f8331a\") " pod="openshift-console-operator/console-operator-668fdbf85c-4l59j" Jun 09 12:41:54.088261 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:54.088235 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtm5r\" (UniqueName: \"kubernetes.io/projected/5a923537-e481-434d-a73d-675ce3d058b9-kube-api-access-qtm5r\") pod \"service-ca-operator-6bc5ff68f5-d7689\" (UID: \"5a923537-e481-434d-a73d-675ce3d058b9\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-d7689" Jun 09 12:41:54.088697 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:54.088674 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tf9l\" (UniqueName: \"kubernetes.io/projected/dd28dc2d-f1bc-4022-ad12-dac9c5f8331a-kube-api-access-5tf9l\") pod \"console-operator-668fdbf85c-4l59j\" (UID: \"dd28dc2d-f1bc-4022-ad12-dac9c5f8331a\") " pod="openshift-console-operator/console-operator-668fdbf85c-4l59j" Jun 09 12:41:54.089037 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:54.089015 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kphhk\" (UniqueName: \"kubernetes.io/projected/48765388-02b2-4591-a720-30d6215fa9a3-kube-api-access-kphhk\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-m8hvz\" (UID: \"48765388-02b2-4591-a720-30d6215fa9a3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-m8hvz" Jun 09 12:41:54.102846 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:54.102408 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-m8hvz" Jun 09 12:41:54.111866 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:54.111806 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-d7689" Jun 09 12:41:54.134304 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:54.134277 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-4l59j" Jun 09 12:41:54.159994 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:54.159956 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-cscvd"] Jun 09 12:41:54.162861 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:54.162836 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9a5c713_1ee4_4293_8b96_29d43eac55f4.slice/crio-d832077e3d629f26f3189c9fc2dbd09aebc74be5cb2a2e2cee4f3cb2175f3532 WatchSource:0}: Error finding container d832077e3d629f26f3189c9fc2dbd09aebc74be5cb2a2e2cee4f3cb2175f3532: Status 404 returned error can't find the container with id d832077e3d629f26f3189c9fc2dbd09aebc74be5cb2a2e2cee4f3cb2175f3532 Jun 09 12:41:54.279883 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:54.279628 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-m8hvz"] Jun 09 12:41:54.282851 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:54.282807 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48765388_02b2_4591_a720_30d6215fa9a3.slice/crio-8f26c0833b73633ccf176e5ea88b5c21d7e8dc385c81825ed89c25da56c31dbc WatchSource:0}: Error finding container 8f26c0833b73633ccf176e5ea88b5c21d7e8dc385c81825ed89c25da56c31dbc: Status 404 returned error can't find the container with id 8f26c0833b73633ccf176e5ea88b5c21d7e8dc385c81825ed89c25da56c31dbc Jun 09 12:41:54.307358 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:54.307330 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-d7689"] Jun 09 12:41:54.311019 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:54.310993 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a923537_e481_434d_a73d_675ce3d058b9.slice/crio-30adc0dfb5a5dd45ea65b2db12f7cb55f90f6b47d5d3ee4139c281c0d8fa345f WatchSource:0}: Error finding container 30adc0dfb5a5dd45ea65b2db12f7cb55f90f6b47d5d3ee4139c281c0d8fa345f: Status 404 returned error can't find the container with id 30adc0dfb5a5dd45ea65b2db12f7cb55f90f6b47d5d3ee4139c281c0d8fa345f Jun 09 12:41:54.328576 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:54.328547 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-4l59j"] Jun 09 12:41:54.331504 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:54.331483 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd28dc2d_f1bc_4022_ad12_dac9c5f8331a.slice/crio-93f149a71c4f90281fed5e3f0be9f837d319ddc792a78f4c8da8c615a3c764cb WatchSource:0}: Error finding container 93f149a71c4f90281fed5e3f0be9f837d319ddc792a78f4c8da8c615a3c764cb: Status 404 returned error can't find the container with id 93f149a71c4f90281fed5e3f0be9f837d319ddc792a78f4c8da8c615a3c764cb Jun 09 12:41:54.416765 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:54.416728 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-d7689" event={"ID":"5a923537-e481-434d-a73d-675ce3d058b9","Type":"ContainerStarted","Data":"30adc0dfb5a5dd45ea65b2db12f7cb55f90f6b47d5d3ee4139c281c0d8fa345f"} Jun 09 12:41:54.417766 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:54.417745 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-m8hvz" event={"ID":"48765388-02b2-4591-a720-30d6215fa9a3","Type":"ContainerStarted","Data":"8f26c0833b73633ccf176e5ea88b5c21d7e8dc385c81825ed89c25da56c31dbc"} Jun 09 12:41:54.418688 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:54.418664 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-cscvd" event={"ID":"e9a5c713-1ee4-4293-8b96-29d43eac55f4","Type":"ContainerStarted","Data":"d832077e3d629f26f3189c9fc2dbd09aebc74be5cb2a2e2cee4f3cb2175f3532"} Jun 09 12:41:54.419565 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:54.419547 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-4l59j" event={"ID":"dd28dc2d-f1bc-4022-ad12-dac9c5f8331a","Type":"ContainerStarted","Data":"93f149a71c4f90281fed5e3f0be9f837d319ddc792a78f4c8da8c615a3c764cb"} Jun 09 12:41:56.427737 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:56.427690 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-cscvd" event={"ID":"e9a5c713-1ee4-4293-8b96-29d43eac55f4","Type":"ContainerStarted","Data":"d69b8cc39b8384fbc39493cb538cdb9798c2a7ab1275b78c135d56d06bce01aa"} Jun 09 12:41:56.449597 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:56.449528 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-cscvd" podStartSLOduration=1.637239229 podStartE2EDuration="3.449507726s" totalImagesPullingTime="1.812268497s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:41:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:41:56.447734641 +0000 UTC m=+45.763048634" watchObservedRunningTime="2026-06-09 12:41:56.449507726 +0000 UTC m=+45.764821716" Jun 09 12:41:58.434082 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:58.434052 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-d7689" event={"ID":"5a923537-e481-434d-a73d-675ce3d058b9","Type":"ContainerStarted","Data":"1c9d8821e5e3e3b3ddea05ac5ac48530c9a08edc8863955f7b2ed62b88bc61a5"} Jun 09 12:41:59.236692 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:59.236618 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-kzx87"] Jun 09 12:41:59.257780 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:59.257743 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-kzx87"] Jun 09 12:41:59.257965 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:59.257877 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-kzx87" Jun 09 12:41:59.260961 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:59.260919 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 09 12:41:59.260961 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:59.260937 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-pn874\"" Jun 09 12:41:59.260961 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:59.260947 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 09 12:41:59.317206 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:59.317170 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tp9k\" (UniqueName: \"kubernetes.io/projected/a23beaad-8176-4436-ac70-a2bb4eef355e-kube-api-access-6tp9k\") pod \"migrator-955ffdf5f-kzx87\" (UID: \"a23beaad-8176-4436-ac70-a2bb4eef355e\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-kzx87" Jun 09 12:41:59.418419 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:59.418383 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tp9k\" (UniqueName: \"kubernetes.io/projected/a23beaad-8176-4436-ac70-a2bb4eef355e-kube-api-access-6tp9k\") pod \"migrator-955ffdf5f-kzx87\" (UID: \"a23beaad-8176-4436-ac70-a2bb4eef355e\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-kzx87" Jun 09 12:41:59.430334 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:59.430292 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tp9k\" (UniqueName: \"kubernetes.io/projected/a23beaad-8176-4436-ac70-a2bb4eef355e-kube-api-access-6tp9k\") pod \"migrator-955ffdf5f-kzx87\" (UID: \"a23beaad-8176-4436-ac70-a2bb4eef355e\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-kzx87" Jun 09 12:41:59.437634 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:59.437611 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-m8hvz" event={"ID":"48765388-02b2-4591-a720-30d6215fa9a3","Type":"ContainerStarted","Data":"a2f14abca51fee23c4df82c259baf1ce436bb151e5c00cf7b96afd95db9e8dd7"} Jun 09 12:41:59.439173 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:59.439156 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-4l59j_dd28dc2d-f1bc-4022-ad12-dac9c5f8331a/console-operator/0.log" Jun 09 12:41:59.439280 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:59.439190 2561 generic.go:356] "Generic (PLEG): container finished" podID="dd28dc2d-f1bc-4022-ad12-dac9c5f8331a" containerID="49a80ed1027b43c3479e856e1397cdacea91bf6371c5ad509522fb77654c861a" exitCode=255 Jun 09 12:41:59.439280 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:59.439264 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-4l59j" event={"ID":"dd28dc2d-f1bc-4022-ad12-dac9c5f8331a","Type":"ContainerDied","Data":"49a80ed1027b43c3479e856e1397cdacea91bf6371c5ad509522fb77654c861a"} Jun 09 12:41:59.439425 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:59.439412 2561 scope.go:117] "RemoveContainer" containerID="49a80ed1027b43c3479e856e1397cdacea91bf6371c5ad509522fb77654c861a" Jun 09 12:41:59.457182 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:59.457121 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-m8hvz" podStartSLOduration=2.414085799 podStartE2EDuration="6.457089879s" totalImagesPullingTime="4.04300408s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:41:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:41:59.456161403 +0000 UTC m=+48.771475395" watchObservedRunningTime="2026-06-09 12:41:59.457089879 +0000 UTC m=+48.772403861" Jun 09 12:41:59.473206 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:59.473169 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-d7689" podStartSLOduration=2.457913484 podStartE2EDuration="6.473154317s" totalImagesPullingTime="4.015240833s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:41:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:41:59.472524546 +0000 UTC m=+48.787838536" watchObservedRunningTime="2026-06-09 12:41:59.473154317 +0000 UTC m=+48.788468337" Jun 09 12:41:59.567440 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:59.566909 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-kzx87" Jun 09 12:41:59.718465 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:41:59.718432 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-kzx87"] Jun 09 12:41:59.721437 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:41:59.721410 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda23beaad_8176_4436_ac70_a2bb4eef355e.slice/crio-f01104033f81c2ae4e1e3592935f2cddfcaada89e32bb75f83addc14e6546219 WatchSource:0}: Error finding container f01104033f81c2ae4e1e3592935f2cddfcaada89e32bb75f83addc14e6546219: Status 404 returned error can't find the container with id f01104033f81c2ae4e1e3592935f2cddfcaada89e32bb75f83addc14e6546219 Jun 09 12:42:00.444897 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:00.444871 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-4l59j_dd28dc2d-f1bc-4022-ad12-dac9c5f8331a/console-operator/1.log" Jun 09 12:42:00.445404 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:00.445388 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-4l59j_dd28dc2d-f1bc-4022-ad12-dac9c5f8331a/console-operator/0.log" Jun 09 12:42:00.445457 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:00.445426 2561 generic.go:356] "Generic (PLEG): container finished" podID="dd28dc2d-f1bc-4022-ad12-dac9c5f8331a" containerID="abb900ffc2966cb7052e5f45ce5c1ac232bde0812a77686d85e2042af6be987f" exitCode=255 Jun 09 12:42:00.445513 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:00.445497 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-4l59j" event={"ID":"dd28dc2d-f1bc-4022-ad12-dac9c5f8331a","Type":"ContainerDied","Data":"abb900ffc2966cb7052e5f45ce5c1ac232bde0812a77686d85e2042af6be987f"} Jun 09 12:42:00.445563 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:00.445550 2561 scope.go:117] "RemoveContainer" containerID="49a80ed1027b43c3479e856e1397cdacea91bf6371c5ad509522fb77654c861a" Jun 09 12:42:00.445868 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:00.445788 2561 scope.go:117] "RemoveContainer" containerID="abb900ffc2966cb7052e5f45ce5c1ac232bde0812a77686d85e2042af6be987f" Jun 09 12:42:00.446031 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:42:00.446002 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-4l59j_openshift-console-operator(dd28dc2d-f1bc-4022-ad12-dac9c5f8331a)\"" pod="openshift-console-operator/console-operator-668fdbf85c-4l59j" podUID="dd28dc2d-f1bc-4022-ad12-dac9c5f8331a" Jun 09 12:42:00.447235 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:00.446899 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-kzx87" event={"ID":"a23beaad-8176-4436-ac70-a2bb4eef355e","Type":"ContainerStarted","Data":"f01104033f81c2ae4e1e3592935f2cddfcaada89e32bb75f83addc14e6546219"} Jun 09 12:42:01.450671 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:01.450651 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-4l59j_dd28dc2d-f1bc-4022-ad12-dac9c5f8331a/console-operator/1.log" Jun 09 12:42:01.451088 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:01.451069 2561 scope.go:117] "RemoveContainer" containerID="abb900ffc2966cb7052e5f45ce5c1ac232bde0812a77686d85e2042af6be987f" Jun 09 12:42:01.451258 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:42:01.451236 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-4l59j_openshift-console-operator(dd28dc2d-f1bc-4022-ad12-dac9c5f8331a)\"" pod="openshift-console-operator/console-operator-668fdbf85c-4l59j" podUID="dd28dc2d-f1bc-4022-ad12-dac9c5f8331a" Jun 09 12:42:01.939540 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:01.939500 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/31987512-1565-4167-b4e7-1e9414500b94-metrics-tls\") pod \"dns-default-gd65w\" (UID: \"31987512-1565-4167-b4e7-1e9414500b94\") " pod="openshift-dns/dns-default-gd65w" Jun 09 12:42:01.939756 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:42:01.939654 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 12:42:01.939756 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:42:01.939732 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31987512-1565-4167-b4e7-1e9414500b94-metrics-tls podName:31987512-1565-4167-b4e7-1e9414500b94 nodeName:}" failed. No retries permitted until 2026-06-09 12:42:17.939715063 +0000 UTC m=+67.255029032 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/31987512-1565-4167-b4e7-1e9414500b94-metrics-tls") pod "dns-default-gd65w" (UID: "31987512-1565-4167-b4e7-1e9414500b94") : secret "dns-default-metrics-tls" not found Jun 09 12:42:01.980106 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:01.980074 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-6jjvh"] Jun 09 12:42:01.997138 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:01.997107 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6jjvh"] Jun 09 12:42:01.997309 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:01.997226 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6jjvh" Jun 09 12:42:02.000064 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:02.000041 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 09 12:42:02.000194 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:02.000100 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 09 12:42:02.000354 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:02.000331 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 09 12:42:02.000452 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:02.000365 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-fgmpm\"" Jun 09 12:42:02.001211 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:02.001191 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 09 12:42:02.040237 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:02.040208 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/77ab0a9c-26cc-43a9-b90e-456ce12d2396-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6jjvh\" (UID: \"77ab0a9c-26cc-43a9-b90e-456ce12d2396\") " pod="openshift-insights/insights-runtime-extractor-6jjvh" Jun 09 12:42:02.040394 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:02.040251 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/77ab0a9c-26cc-43a9-b90e-456ce12d2396-data-volume\") pod \"insights-runtime-extractor-6jjvh\" (UID: \"77ab0a9c-26cc-43a9-b90e-456ce12d2396\") " pod="openshift-insights/insights-runtime-extractor-6jjvh" Jun 09 12:42:02.040394 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:02.040310 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/77ab0a9c-26cc-43a9-b90e-456ce12d2396-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6jjvh\" (UID: \"77ab0a9c-26cc-43a9-b90e-456ce12d2396\") " pod="openshift-insights/insights-runtime-extractor-6jjvh" Jun 09 12:42:02.040394 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:02.040327 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpqbr\" (UniqueName: \"kubernetes.io/projected/77ab0a9c-26cc-43a9-b90e-456ce12d2396-kube-api-access-wpqbr\") pod \"insights-runtime-extractor-6jjvh\" (UID: \"77ab0a9c-26cc-43a9-b90e-456ce12d2396\") " pod="openshift-insights/insights-runtime-extractor-6jjvh" Jun 09 12:42:02.040394 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:02.040349 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/77ab0a9c-26cc-43a9-b90e-456ce12d2396-crio-socket\") pod \"insights-runtime-extractor-6jjvh\" (UID: \"77ab0a9c-26cc-43a9-b90e-456ce12d2396\") " pod="openshift-insights/insights-runtime-extractor-6jjvh" Jun 09 12:42:02.140907 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:02.140877 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/77ab0a9c-26cc-43a9-b90e-456ce12d2396-data-volume\") pod \"insights-runtime-extractor-6jjvh\" (UID: \"77ab0a9c-26cc-43a9-b90e-456ce12d2396\") " pod="openshift-insights/insights-runtime-extractor-6jjvh" Jun 09 12:42:02.141091 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:02.140918 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/77ab0a9c-26cc-43a9-b90e-456ce12d2396-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6jjvh\" (UID: \"77ab0a9c-26cc-43a9-b90e-456ce12d2396\") " pod="openshift-insights/insights-runtime-extractor-6jjvh" Jun 09 12:42:02.141091 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:02.140936 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpqbr\" (UniqueName: \"kubernetes.io/projected/77ab0a9c-26cc-43a9-b90e-456ce12d2396-kube-api-access-wpqbr\") pod \"insights-runtime-extractor-6jjvh\" (UID: \"77ab0a9c-26cc-43a9-b90e-456ce12d2396\") " pod="openshift-insights/insights-runtime-extractor-6jjvh" Jun 09 12:42:02.141091 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:02.140952 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/77ab0a9c-26cc-43a9-b90e-456ce12d2396-crio-socket\") pod \"insights-runtime-extractor-6jjvh\" (UID: \"77ab0a9c-26cc-43a9-b90e-456ce12d2396\") " pod="openshift-insights/insights-runtime-extractor-6jjvh" Jun 09 12:42:02.141091 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:02.141022 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/77ab0a9c-26cc-43a9-b90e-456ce12d2396-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6jjvh\" (UID: \"77ab0a9c-26cc-43a9-b90e-456ce12d2396\") " pod="openshift-insights/insights-runtime-extractor-6jjvh" Jun 09 12:42:02.141324 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:42:02.141123 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 09 12:42:02.141324 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:42:02.141184 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77ab0a9c-26cc-43a9-b90e-456ce12d2396-insights-runtime-extractor-tls podName:77ab0a9c-26cc-43a9-b90e-456ce12d2396 nodeName:}" failed. No retries permitted until 2026-06-09 12:42:02.641166509 +0000 UTC m=+51.956480492 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/77ab0a9c-26cc-43a9-b90e-456ce12d2396-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6jjvh" (UID: "77ab0a9c-26cc-43a9-b90e-456ce12d2396") : secret "insights-runtime-extractor-tls" not found Jun 09 12:42:02.141324 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:02.141234 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/77ab0a9c-26cc-43a9-b90e-456ce12d2396-crio-socket\") pod \"insights-runtime-extractor-6jjvh\" (UID: \"77ab0a9c-26cc-43a9-b90e-456ce12d2396\") " pod="openshift-insights/insights-runtime-extractor-6jjvh" Jun 09 12:42:02.141324 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:02.141285 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/77ab0a9c-26cc-43a9-b90e-456ce12d2396-data-volume\") pod \"insights-runtime-extractor-6jjvh\" (UID: \"77ab0a9c-26cc-43a9-b90e-456ce12d2396\") " pod="openshift-insights/insights-runtime-extractor-6jjvh" Jun 09 12:42:02.141509 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:02.141489 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/77ab0a9c-26cc-43a9-b90e-456ce12d2396-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6jjvh\" (UID: \"77ab0a9c-26cc-43a9-b90e-456ce12d2396\") " pod="openshift-insights/insights-runtime-extractor-6jjvh" Jun 09 12:42:02.150770 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:02.150749 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpqbr\" (UniqueName: \"kubernetes.io/projected/77ab0a9c-26cc-43a9-b90e-456ce12d2396-kube-api-access-wpqbr\") pod \"insights-runtime-extractor-6jjvh\" (UID: \"77ab0a9c-26cc-43a9-b90e-456ce12d2396\") " pod="openshift-insights/insights-runtime-extractor-6jjvh" Jun 09 12:42:02.457241 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:02.457187 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-kzx87" event={"ID":"a23beaad-8176-4436-ac70-a2bb4eef355e","Type":"ContainerStarted","Data":"94e4336c7156ff22aa5af1d16011b02ac9c14a8265938d58a92c04ba09979f09"} Jun 09 12:42:02.457615 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:02.457264 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-kzx87" event={"ID":"a23beaad-8176-4436-ac70-a2bb4eef355e","Type":"ContainerStarted","Data":"374ca6599091a36fa2b03a12bc0bcff7dad704369633a0d07e71534cd2f5a9e4"} Jun 09 12:42:02.480935 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:02.480885 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-kzx87" podStartSLOduration=1.812768774 podStartE2EDuration="3.48086958s" totalImagesPullingTime="1.668100806s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:41:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:42:02.480348794 +0000 UTC m=+51.795662787" watchObservedRunningTime="2026-06-09 12:42:02.48086958 +0000 UTC m=+51.796183571" Jun 09 12:42:02.644886 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:02.644843 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/77ab0a9c-26cc-43a9-b90e-456ce12d2396-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6jjvh\" (UID: \"77ab0a9c-26cc-43a9-b90e-456ce12d2396\") " pod="openshift-insights/insights-runtime-extractor-6jjvh" Jun 09 12:42:02.645052 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:42:02.644985 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 09 12:42:02.645093 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:42:02.645057 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77ab0a9c-26cc-43a9-b90e-456ce12d2396-insights-runtime-extractor-tls podName:77ab0a9c-26cc-43a9-b90e-456ce12d2396 nodeName:}" failed. No retries permitted until 2026-06-09 12:42:03.645040372 +0000 UTC m=+52.960354342 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/77ab0a9c-26cc-43a9-b90e-456ce12d2396-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6jjvh" (UID: "77ab0a9c-26cc-43a9-b90e-456ce12d2396") : secret "insights-runtime-extractor-tls" not found Jun 09 12:42:03.653292 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:03.653249 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/77ab0a9c-26cc-43a9-b90e-456ce12d2396-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6jjvh\" (UID: \"77ab0a9c-26cc-43a9-b90e-456ce12d2396\") " pod="openshift-insights/insights-runtime-extractor-6jjvh" Jun 09 12:42:03.653641 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:42:03.653405 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 09 12:42:03.653641 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:42:03.653479 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77ab0a9c-26cc-43a9-b90e-456ce12d2396-insights-runtime-extractor-tls podName:77ab0a9c-26cc-43a9-b90e-456ce12d2396 nodeName:}" failed. No retries permitted until 2026-06-09 12:42:05.653459743 +0000 UTC m=+54.968773712 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/77ab0a9c-26cc-43a9-b90e-456ce12d2396-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6jjvh" (UID: "77ab0a9c-26cc-43a9-b90e-456ce12d2396") : secret "insights-runtime-extractor-tls" not found Jun 09 12:42:04.134876 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:04.134812 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-4l59j" Jun 09 12:42:04.135073 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:04.134902 2561 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-4l59j" Jun 09 12:42:04.135298 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:04.135282 2561 scope.go:117] "RemoveContainer" containerID="abb900ffc2966cb7052e5f45ce5c1ac232bde0812a77686d85e2042af6be987f" Jun 09 12:42:04.135471 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:42:04.135449 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-4l59j_openshift-console-operator(dd28dc2d-f1bc-4022-ad12-dac9c5f8331a)\"" pod="openshift-console-operator/console-operator-668fdbf85c-4l59j" podUID="dd28dc2d-f1bc-4022-ad12-dac9c5f8331a" Jun 09 12:42:05.668807 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:05.668760 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/77ab0a9c-26cc-43a9-b90e-456ce12d2396-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6jjvh\" (UID: \"77ab0a9c-26cc-43a9-b90e-456ce12d2396\") " pod="openshift-insights/insights-runtime-extractor-6jjvh" Jun 09 12:42:05.669446 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:42:05.668943 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 09 12:42:05.669446 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:42:05.669031 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77ab0a9c-26cc-43a9-b90e-456ce12d2396-insights-runtime-extractor-tls podName:77ab0a9c-26cc-43a9-b90e-456ce12d2396 nodeName:}" failed. No retries permitted until 2026-06-09 12:42:09.669010711 +0000 UTC m=+58.984324683 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/77ab0a9c-26cc-43a9-b90e-456ce12d2396-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6jjvh" (UID: "77ab0a9c-26cc-43a9-b90e-456ce12d2396") : secret "insights-runtime-extractor-tls" not found Jun 09 12:42:09.699210 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:09.699154 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/77ab0a9c-26cc-43a9-b90e-456ce12d2396-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6jjvh\" (UID: \"77ab0a9c-26cc-43a9-b90e-456ce12d2396\") " pod="openshift-insights/insights-runtime-extractor-6jjvh" Jun 09 12:42:09.699607 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:42:09.699315 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 09 12:42:09.699607 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:42:09.699386 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77ab0a9c-26cc-43a9-b90e-456ce12d2396-insights-runtime-extractor-tls podName:77ab0a9c-26cc-43a9-b90e-456ce12d2396 nodeName:}" failed. No retries permitted until 2026-06-09 12:42:17.699370989 +0000 UTC m=+67.014684958 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/77ab0a9c-26cc-43a9-b90e-456ce12d2396-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6jjvh" (UID: "77ab0a9c-26cc-43a9-b90e-456ce12d2396") : secret "insights-runtime-extractor-tls" not found Jun 09 12:42:10.377271 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:10.377245 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tsmnb" Jun 09 12:42:15.946748 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:15.946712 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3a86fe59-f4c8-4c09-9f19-6fada48b8194-original-pull-secret\") pod \"global-pull-secret-syncer-br4cc\" (UID: \"3a86fe59-f4c8-4c09-9f19-6fada48b8194\") " pod="kube-system/global-pull-secret-syncer-br4cc" Jun 09 12:42:15.947167 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:15.946763 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9511ce2-9c98-4362-8953-c323b4bdd636-metrics-certs\") pod \"network-metrics-daemon-xcq9r\" (UID: \"c9511ce2-9c98-4362-8953-c323b4bdd636\") " pod="openshift-multus/network-metrics-daemon-xcq9r" Jun 09 12:42:15.950298 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:15.950270 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 12:42:15.950420 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:15.950346 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 12:42:15.959630 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:15.959596 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9511ce2-9c98-4362-8953-c323b4bdd636-metrics-certs\") pod \"network-metrics-daemon-xcq9r\" (UID: \"c9511ce2-9c98-4362-8953-c323b4bdd636\") " pod="openshift-multus/network-metrics-daemon-xcq9r" Jun 09 12:42:15.959630 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:15.959608 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3a86fe59-f4c8-4c09-9f19-6fada48b8194-original-pull-secret\") pod \"global-pull-secret-syncer-br4cc\" (UID: \"3a86fe59-f4c8-4c09-9f19-6fada48b8194\") " pod="kube-system/global-pull-secret-syncer-br4cc" Jun 09 12:42:16.047873 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:16.047848 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhhww\" (UniqueName: \"kubernetes.io/projected/12a5bda4-80f2-4135-ad58-d5a14bceef3f-kube-api-access-mhhww\") pod \"network-check-target-mq44p\" (UID: \"12a5bda4-80f2-4135-ad58-d5a14bceef3f\") " pod="openshift-network-diagnostics/network-check-target-mq44p" Jun 09 12:42:16.051026 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:16.051007 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 12:42:16.061063 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:16.061047 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 12:42:16.070573 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:16.070554 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhhww\" (UniqueName: \"kubernetes.io/projected/12a5bda4-80f2-4135-ad58-d5a14bceef3f-kube-api-access-mhhww\") pod \"network-check-target-mq44p\" (UID: \"12a5bda4-80f2-4135-ad58-d5a14bceef3f\") " pod="openshift-network-diagnostics/network-check-target-mq44p" Jun 09 12:42:16.224796 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:16.224706 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fjw6q\"" Jun 09 12:42:16.231427 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:16.231406 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-sfqkv\"" Jun 09 12:42:16.232462 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:16.232443 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mq44p" Jun 09 12:42:16.234975 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:16.234959 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-br4cc" Jun 09 12:42:16.239877 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:16.239859 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xcq9r" Jun 09 12:42:16.380555 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:16.380525 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mq44p"] Jun 09 12:42:16.384082 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:42:16.384057 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12a5bda4_80f2_4135_ad58_d5a14bceef3f.slice/crio-5facd26ac99a4d30c265fb7515c2146f0f746f858525d701f4a227e9a3de8319 WatchSource:0}: Error finding container 5facd26ac99a4d30c265fb7515c2146f0f746f858525d701f4a227e9a3de8319: Status 404 returned error can't find the container with id 5facd26ac99a4d30c265fb7515c2146f0f746f858525d701f4a227e9a3de8319 Jun 09 12:42:16.501567 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:16.501535 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mq44p" event={"ID":"12a5bda4-80f2-4135-ad58-d5a14bceef3f","Type":"ContainerStarted","Data":"5facd26ac99a4d30c265fb7515c2146f0f746f858525d701f4a227e9a3de8319"} Jun 09 12:42:16.603070 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:16.603028 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-br4cc"] Jun 09 12:42:16.605884 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:16.605858 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xcq9r"] Jun 09 12:42:16.606013 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:42:16.605923 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a86fe59_f4c8_4c09_9f19_6fada48b8194.slice/crio-5439dc924a2701be59b155497610646357b7fe831ba56bfad2a1bccb6ff45e8a WatchSource:0}: Error finding container 5439dc924a2701be59b155497610646357b7fe831ba56bfad2a1bccb6ff45e8a: Status 404 returned error can't find the container with id 5439dc924a2701be59b155497610646357b7fe831ba56bfad2a1bccb6ff45e8a Jun 09 12:42:16.608405 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:42:16.608382 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9511ce2_9c98_4362_8953_c323b4bdd636.slice/crio-cff902958c9b608b86e9c98ee5903da1b47480ecdf5e7dd1e4639f3d3cae06e2 WatchSource:0}: Error finding container cff902958c9b608b86e9c98ee5903da1b47480ecdf5e7dd1e4639f3d3cae06e2: Status 404 returned error can't find the container with id cff902958c9b608b86e9c98ee5903da1b47480ecdf5e7dd1e4639f3d3cae06e2 Jun 09 12:42:17.110891 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:17.110861 2561 scope.go:117] "RemoveContainer" containerID="abb900ffc2966cb7052e5f45ce5c1ac232bde0812a77686d85e2042af6be987f" Jun 09 12:42:17.510773 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:17.510748 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-4l59j_dd28dc2d-f1bc-4022-ad12-dac9c5f8331a/console-operator/1.log" Jun 09 12:42:17.510975 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:17.510873 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-4l59j" event={"ID":"dd28dc2d-f1bc-4022-ad12-dac9c5f8331a","Type":"ContainerStarted","Data":"b570b5aa7953314292e93f260473bdd45c6470ed9a0ac85a0f24a08e0ddefff2"} Jun 09 12:42:17.511578 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:17.511198 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-4l59j" Jun 09 12:42:17.512753 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:17.512498 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xcq9r" event={"ID":"c9511ce2-9c98-4362-8953-c323b4bdd636","Type":"ContainerStarted","Data":"cff902958c9b608b86e9c98ee5903da1b47480ecdf5e7dd1e4639f3d3cae06e2"} Jun 09 12:42:17.513963 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:17.513939 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-br4cc" event={"ID":"3a86fe59-f4c8-4c09-9f19-6fada48b8194","Type":"ContainerStarted","Data":"5439dc924a2701be59b155497610646357b7fe831ba56bfad2a1bccb6ff45e8a"} Jun 09 12:42:17.533563 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:17.533377 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-668fdbf85c-4l59j" podStartSLOduration=20.534255341 podStartE2EDuration="24.53335917s" totalImagesPullingTime="3.999103829s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:41:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:42:17.532536439 +0000 UTC m=+66.847850434" watchObservedRunningTime="2026-06-09 12:42:17.53335917 +0000 UTC m=+66.848673162" Jun 09 12:42:17.762660 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:17.762542 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/77ab0a9c-26cc-43a9-b90e-456ce12d2396-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6jjvh\" (UID: \"77ab0a9c-26cc-43a9-b90e-456ce12d2396\") " pod="openshift-insights/insights-runtime-extractor-6jjvh" Jun 09 12:42:17.765588 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:17.765561 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/77ab0a9c-26cc-43a9-b90e-456ce12d2396-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6jjvh\" (UID: \"77ab0a9c-26cc-43a9-b90e-456ce12d2396\") " pod="openshift-insights/insights-runtime-extractor-6jjvh" Jun 09 12:42:17.909068 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:17.909026 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-fgmpm\"" Jun 09 12:42:17.916691 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:17.916653 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6jjvh" Jun 09 12:42:17.965023 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:17.964969 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/31987512-1565-4167-b4e7-1e9414500b94-metrics-tls\") pod \"dns-default-gd65w\" (UID: \"31987512-1565-4167-b4e7-1e9414500b94\") " pod="openshift-dns/dns-default-gd65w" Jun 09 12:42:17.968839 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:17.968736 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/31987512-1565-4167-b4e7-1e9414500b94-metrics-tls\") pod \"dns-default-gd65w\" (UID: \"31987512-1565-4167-b4e7-1e9414500b94\") " pod="openshift-dns/dns-default-gd65w" Jun 09 12:42:18.105943 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:18.105911 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6jjvh"] Jun 09 12:42:18.177470 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:42:18.177433 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77ab0a9c_26cc_43a9_b90e_456ce12d2396.slice/crio-00a118bf38a05b1aec0238f3b7f8b2273909b72ee4b13dedc04ac8273395aa9c WatchSource:0}: Error finding container 00a118bf38a05b1aec0238f3b7f8b2273909b72ee4b13dedc04ac8273395aa9c: Status 404 returned error can't find the container with id 00a118bf38a05b1aec0238f3b7f8b2273909b72ee4b13dedc04ac8273395aa9c Jun 09 12:42:18.183210 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:18.181952 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-k7xst\"" Jun 09 12:42:18.189694 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:18.189664 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gd65w" Jun 09 12:42:18.198608 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:18.198404 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-668fdbf85c-4l59j" Jun 09 12:42:18.416072 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:18.415855 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gd65w"] Jun 09 12:42:18.419846 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:42:18.419690 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31987512_1565_4167_b4e7_1e9414500b94.slice/crio-986d62509d99197484328289b815c234a05162b8401543ec63632ebafe4a91ad WatchSource:0}: Error finding container 986d62509d99197484328289b815c234a05162b8401543ec63632ebafe4a91ad: Status 404 returned error can't find the container with id 986d62509d99197484328289b815c234a05162b8401543ec63632ebafe4a91ad Jun 09 12:42:18.520999 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:18.520967 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xcq9r" event={"ID":"c9511ce2-9c98-4362-8953-c323b4bdd636","Type":"ContainerStarted","Data":"ab92b90b2e7ef7c12accef37aae97811433eaa48e6faa3466edc03fffdb2e524"} Jun 09 12:42:18.522184 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:18.522156 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gd65w" event={"ID":"31987512-1565-4167-b4e7-1e9414500b94","Type":"ContainerStarted","Data":"986d62509d99197484328289b815c234a05162b8401543ec63632ebafe4a91ad"} Jun 09 12:42:18.523863 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:18.523837 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6jjvh" event={"ID":"77ab0a9c-26cc-43a9-b90e-456ce12d2396","Type":"ContainerStarted","Data":"69d5cd04a135037a61e3c513fe39bad9c8bba46b1e46043e3f04787fb5979578"} Jun 09 12:42:18.523975 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:18.523891 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6jjvh" event={"ID":"77ab0a9c-26cc-43a9-b90e-456ce12d2396","Type":"ContainerStarted","Data":"00a118bf38a05b1aec0238f3b7f8b2273909b72ee4b13dedc04ac8273395aa9c"} Jun 09 12:42:19.531925 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:19.531847 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xcq9r" event={"ID":"c9511ce2-9c98-4362-8953-c323b4bdd636","Type":"ContainerStarted","Data":"90406b171032a7f173adaa6b43cdee912dd8d05bba8a97d59fed5bd334a0f05f"} Jun 09 12:42:19.556903 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:19.555603 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-xcq9r" podStartSLOduration=66.958617084 podStartE2EDuration="1m8.555577749s" totalImagesPullingTime="1.596960665s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:41:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:42:19.551186314 +0000 UTC m=+68.866500312" watchObservedRunningTime="2026-06-09 12:42:19.555577749 +0000 UTC m=+68.870891742" Jun 09 12:42:22.544009 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:22.543973 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mq44p" event={"ID":"12a5bda4-80f2-4135-ad58-d5a14bceef3f","Type":"ContainerStarted","Data":"7ff005692877651d05d98d3cd3e98720f78771d0481eb0509d7705fcd88e3501"} Jun 09 12:42:22.544502 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:22.544059 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-mq44p" Jun 09 12:42:22.546215 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:22.546180 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gd65w" event={"ID":"31987512-1565-4167-b4e7-1e9414500b94","Type":"ContainerStarted","Data":"c3621fac8083384079592feca19a65a4ec3aa8e8a51dd2270b8d3c4e3825e8d7"} Jun 09 12:42:22.546345 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:22.546230 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gd65w" event={"ID":"31987512-1565-4167-b4e7-1e9414500b94","Type":"ContainerStarted","Data":"ea1d1775c5c01cba4acb1a9a5e56b9a2afa23f21622428827817463031a5667c"} Jun 09 12:42:22.546345 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:22.546261 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-gd65w" Jun 09 12:42:22.548365 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:22.548336 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6jjvh" event={"ID":"77ab0a9c-26cc-43a9-b90e-456ce12d2396","Type":"ContainerStarted","Data":"1793dc077855e8da431fb37267eb24a46475584e51e0580b86b268abc8ce8708"} Jun 09 12:42:22.550021 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:22.549996 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-br4cc" event={"ID":"3a86fe59-f4c8-4c09-9f19-6fada48b8194","Type":"ContainerStarted","Data":"1e249d379c38e778b7b62500c88b329497f9f5cd2a22079e5e45dc1dcde84b39"} Jun 09 12:42:22.571803 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:22.571737 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-mq44p" podStartSLOduration=65.912601129 podStartE2EDuration="1m11.57171844s" totalImagesPullingTime="5.659117311s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:41:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:42:22.570476862 +0000 UTC m=+71.885790853" watchObservedRunningTime="2026-06-09 12:42:22.57171844 +0000 UTC m=+71.887032434" Jun 09 12:42:22.616614 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:22.616559 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-gd65w" podStartSLOduration=32.994136363 podStartE2EDuration="36.616542969s" totalImagesPullingTime="3.622406606s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:41:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:42:22.616011452 +0000 UTC m=+71.931325442" watchObservedRunningTime="2026-06-09 12:42:22.616542969 +0000 UTC m=+71.931856960" Jun 09 12:42:22.616789 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:22.616719 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-br4cc" podStartSLOduration=66.167518677 podStartE2EDuration="1m11.616713808s" totalImagesPullingTime="5.449195131s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 12:41:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:42:22.59333143 +0000 UTC m=+71.908645420" watchObservedRunningTime="2026-06-09 12:42:22.616713808 +0000 UTC m=+71.932027799" Jun 09 12:42:23.161045 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:23.161014 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-784c75b5b4-7rn52"] Jun 09 12:42:23.165439 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:23.165410 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-784c75b5b4-7rn52" Jun 09 12:42:23.180067 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:23.180009 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 09 12:42:23.180183 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:23.180068 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 09 12:42:23.180183 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:23.180174 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 09 12:42:23.183774 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:23.183753 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 09 12:42:23.183976 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:23.183958 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 09 12:42:23.184080 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:23.184013 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 09 12:42:23.184671 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:23.184634 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 09 12:42:23.186105 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:23.186085 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-784c75b5b4-7rn52"] Jun 09 12:42:23.311475 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:23.311437 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d59a85eb-fb23-4bf8-8a00-b693481e4c4f-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-784c75b5b4-7rn52\" (UID: \"d59a85eb-fb23-4bf8-8a00-b693481e4c4f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-784c75b5b4-7rn52" Jun 09 12:42:23.311641 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:23.311484 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/d59a85eb-fb23-4bf8-8a00-b693481e4c4f-additional-service-ca\") pod \"cluster-proxy-proxy-agent-784c75b5b4-7rn52\" (UID: \"d59a85eb-fb23-4bf8-8a00-b693481e4c4f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-784c75b5b4-7rn52" Jun 09 12:42:23.311641 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:23.311513 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/d59a85eb-fb23-4bf8-8a00-b693481e4c4f-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-784c75b5b4-7rn52\" (UID: \"d59a85eb-fb23-4bf8-8a00-b693481e4c4f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-784c75b5b4-7rn52" Jun 09 12:42:23.311641 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:23.311582 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9f6p7\" (UniqueName: \"kubernetes.io/projected/d59a85eb-fb23-4bf8-8a00-b693481e4c4f-kube-api-access-9f6p7\") pod \"cluster-proxy-proxy-agent-784c75b5b4-7rn52\" (UID: \"d59a85eb-fb23-4bf8-8a00-b693481e4c4f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-784c75b5b4-7rn52" Jun 09 12:42:23.311641 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:23.311600 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/d59a85eb-fb23-4bf8-8a00-b693481e4c4f-ca\") pod \"cluster-proxy-proxy-agent-784c75b5b4-7rn52\" (UID: \"d59a85eb-fb23-4bf8-8a00-b693481e4c4f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-784c75b5b4-7rn52" Jun 09 12:42:23.311849 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:23.311686 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/d59a85eb-fb23-4bf8-8a00-b693481e4c4f-hub\") pod \"cluster-proxy-proxy-agent-784c75b5b4-7rn52\" (UID: \"d59a85eb-fb23-4bf8-8a00-b693481e4c4f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-784c75b5b4-7rn52" Jun 09 12:42:23.412374 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:23.412283 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/d59a85eb-fb23-4bf8-8a00-b693481e4c4f-hub\") pod \"cluster-proxy-proxy-agent-784c75b5b4-7rn52\" (UID: \"d59a85eb-fb23-4bf8-8a00-b693481e4c4f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-784c75b5b4-7rn52" Jun 09 12:42:23.412374 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:23.412338 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d59a85eb-fb23-4bf8-8a00-b693481e4c4f-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-784c75b5b4-7rn52\" (UID: \"d59a85eb-fb23-4bf8-8a00-b693481e4c4f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-784c75b5b4-7rn52" Jun 09 12:42:23.412578 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:23.412460 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/d59a85eb-fb23-4bf8-8a00-b693481e4c4f-additional-service-ca\") pod \"cluster-proxy-proxy-agent-784c75b5b4-7rn52\" (UID: \"d59a85eb-fb23-4bf8-8a00-b693481e4c4f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-784c75b5b4-7rn52" Jun 09 12:42:23.412578 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:23.412513 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/d59a85eb-fb23-4bf8-8a00-b693481e4c4f-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-784c75b5b4-7rn52\" (UID: \"d59a85eb-fb23-4bf8-8a00-b693481e4c4f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-784c75b5b4-7rn52" Jun 09 12:42:23.412578 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:23.412554 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9f6p7\" (UniqueName: \"kubernetes.io/projected/d59a85eb-fb23-4bf8-8a00-b693481e4c4f-kube-api-access-9f6p7\") pod \"cluster-proxy-proxy-agent-784c75b5b4-7rn52\" (UID: \"d59a85eb-fb23-4bf8-8a00-b693481e4c4f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-784c75b5b4-7rn52" Jun 09 12:42:23.412733 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:23.412578 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/d59a85eb-fb23-4bf8-8a00-b693481e4c4f-ca\") pod \"cluster-proxy-proxy-agent-784c75b5b4-7rn52\" (UID: \"d59a85eb-fb23-4bf8-8a00-b693481e4c4f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-784c75b5b4-7rn52" Jun 09 12:42:23.413322 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:23.413295 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/d59a85eb-fb23-4bf8-8a00-b693481e4c4f-additional-service-ca\") pod \"cluster-proxy-proxy-agent-784c75b5b4-7rn52\" (UID: \"d59a85eb-fb23-4bf8-8a00-b693481e4c4f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-784c75b5b4-7rn52" Jun 09 12:42:23.415146 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:23.415122 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/d59a85eb-fb23-4bf8-8a00-b693481e4c4f-ca\") pod \"cluster-proxy-proxy-agent-784c75b5b4-7rn52\" (UID: \"d59a85eb-fb23-4bf8-8a00-b693481e4c4f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-784c75b5b4-7rn52" Jun 09 12:42:23.415400 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:23.415376 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/d59a85eb-fb23-4bf8-8a00-b693481e4c4f-hub\") pod \"cluster-proxy-proxy-agent-784c75b5b4-7rn52\" (UID: \"d59a85eb-fb23-4bf8-8a00-b693481e4c4f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-784c75b5b4-7rn52" Jun 09 12:42:23.415518 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:23.415426 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/d59a85eb-fb23-4bf8-8a00-b693481e4c4f-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-784c75b5b4-7rn52\" (UID: \"d59a85eb-fb23-4bf8-8a00-b693481e4c4f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-784c75b5b4-7rn52" Jun 09 12:42:23.415581 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:23.415560 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d59a85eb-fb23-4bf8-8a00-b693481e4c4f-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-784c75b5b4-7rn52\" (UID: \"d59a85eb-fb23-4bf8-8a00-b693481e4c4f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-784c75b5b4-7rn52" Jun 09 12:42:23.428443 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:23.428418 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9f6p7\" (UniqueName: \"kubernetes.io/projected/d59a85eb-fb23-4bf8-8a00-b693481e4c4f-kube-api-access-9f6p7\") pod \"cluster-proxy-proxy-agent-784c75b5b4-7rn52\" (UID: \"d59a85eb-fb23-4bf8-8a00-b693481e4c4f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-784c75b5b4-7rn52" Jun 09 12:42:23.485371 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:23.485341 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-784c75b5b4-7rn52" Jun 09 12:42:23.681011 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:23.680990 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-784c75b5b4-7rn52"] Jun 09 12:42:23.686471 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:42:23.686447 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd59a85eb_fb23_4bf8_8a00_b693481e4c4f.slice/crio-e5bea35ff1bf089e49fd1d46a5bdd0199fc7b5f9c1bc0a5a41d7769b2f3a5cf5 WatchSource:0}: Error finding container e5bea35ff1bf089e49fd1d46a5bdd0199fc7b5f9c1bc0a5a41d7769b2f3a5cf5: Status 404 returned error can't find the container with id e5bea35ff1bf089e49fd1d46a5bdd0199fc7b5f9c1bc0a5a41d7769b2f3a5cf5 Jun 09 12:42:24.559830 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:24.559779 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-784c75b5b4-7rn52" event={"ID":"d59a85eb-fb23-4bf8-8a00-b693481e4c4f","Type":"ContainerStarted","Data":"e5bea35ff1bf089e49fd1d46a5bdd0199fc7b5f9c1bc0a5a41d7769b2f3a5cf5"} Jun 09 12:42:24.562041 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:24.562009 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6jjvh" event={"ID":"77ab0a9c-26cc-43a9-b90e-456ce12d2396","Type":"ContainerStarted","Data":"daa0e613c2080ddfc1e4785444b80c4f582c4246fa8601841f6be830445dcc6a"} Jun 09 12:42:24.586727 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:24.586677 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-6jjvh" podStartSLOduration=18.441816586 podStartE2EDuration="23.586656527s" totalImagesPullingTime="5.144839941s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 12:42:01 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:42:24.585059835 +0000 UTC m=+73.900373827" watchObservedRunningTime="2026-06-09 12:42:24.586656527 +0000 UTC m=+73.901970520" Jun 09 12:42:27.574494 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:27.574458 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-784c75b5b4-7rn52" event={"ID":"d59a85eb-fb23-4bf8-8a00-b693481e4c4f","Type":"ContainerStarted","Data":"a10857e7eab34b815725c65470860931b255f6b33adb992a5e18326f88a82d2f"} Jun 09 12:42:28.579868 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:28.579809 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-784c75b5b4-7rn52" event={"ID":"d59a85eb-fb23-4bf8-8a00-b693481e4c4f","Type":"ContainerStarted","Data":"e2e72ba531bea7f8d2a7d91e13d9840e050e71552a85786713c79cdbf399ecd0"} Jun 09 12:42:28.579868 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:28.579875 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-784c75b5b4-7rn52" event={"ID":"d59a85eb-fb23-4bf8-8a00-b693481e4c4f","Type":"ContainerStarted","Data":"209719029d511d145d3a166ae7604ee6db641d939c255cf5fca7c72932a4e1ff"} Jun 09 12:42:28.609171 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:28.609120 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-784c75b5b4-7rn52" podStartSLOduration=1.815858454 podStartE2EDuration="5.609100953s" totalImagesPullingTime="3.793242499s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:42:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:42:28.60840885 +0000 UTC m=+77.923722841" watchObservedRunningTime="2026-06-09 12:42:28.609100953 +0000 UTC m=+77.924414940" Jun 09 12:42:32.335903 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:32.335872 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-94cw9"] Jun 09 12:42:32.362648 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:32.362618 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-94cw9" Jun 09 12:42:32.367177 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:32.367155 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 09 12:42:32.367304 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:32.367251 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 09 12:42:32.367836 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:32.367796 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 09 12:42:32.368574 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:32.368556 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 09 12:42:32.368657 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:32.368608 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 09 12:42:32.368725 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:32.368650 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-hhcpb\"" Jun 09 12:42:32.368777 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:32.368747 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 09 12:42:32.483807 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:32.483769 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/10f4b942-8b8c-4493-9672-e53dd719456e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-94cw9\" (UID: \"10f4b942-8b8c-4493-9672-e53dd719456e\") " pod="openshift-monitoring/node-exporter-94cw9" Jun 09 12:42:32.483807 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:32.483808 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/10f4b942-8b8c-4493-9672-e53dd719456e-sys\") pod \"node-exporter-94cw9\" (UID: \"10f4b942-8b8c-4493-9672-e53dd719456e\") " pod="openshift-monitoring/node-exporter-94cw9" Jun 09 12:42:32.484060 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:32.483881 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kx95\" (UniqueName: \"kubernetes.io/projected/10f4b942-8b8c-4493-9672-e53dd719456e-kube-api-access-7kx95\") pod \"node-exporter-94cw9\" (UID: \"10f4b942-8b8c-4493-9672-e53dd719456e\") " pod="openshift-monitoring/node-exporter-94cw9" Jun 09 12:42:32.484060 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:32.483930 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/10f4b942-8b8c-4493-9672-e53dd719456e-node-exporter-textfile\") pod \"node-exporter-94cw9\" (UID: \"10f4b942-8b8c-4493-9672-e53dd719456e\") " pod="openshift-monitoring/node-exporter-94cw9" Jun 09 12:42:32.484060 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:32.483957 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/10f4b942-8b8c-4493-9672-e53dd719456e-metrics-client-ca\") pod \"node-exporter-94cw9\" (UID: \"10f4b942-8b8c-4493-9672-e53dd719456e\") " pod="openshift-monitoring/node-exporter-94cw9" Jun 09 12:42:32.484060 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:32.483990 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/10f4b942-8b8c-4493-9672-e53dd719456e-node-exporter-wtmp\") pod \"node-exporter-94cw9\" (UID: \"10f4b942-8b8c-4493-9672-e53dd719456e\") " pod="openshift-monitoring/node-exporter-94cw9" Jun 09 12:42:32.484060 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:32.484016 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/10f4b942-8b8c-4493-9672-e53dd719456e-root\") pod \"node-exporter-94cw9\" (UID: \"10f4b942-8b8c-4493-9672-e53dd719456e\") " pod="openshift-monitoring/node-exporter-94cw9" Jun 09 12:42:32.484262 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:32.484083 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/10f4b942-8b8c-4493-9672-e53dd719456e-node-exporter-accelerators-collector-config\") pod \"node-exporter-94cw9\" (UID: \"10f4b942-8b8c-4493-9672-e53dd719456e\") " pod="openshift-monitoring/node-exporter-94cw9" Jun 09 12:42:32.484262 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:32.484126 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/10f4b942-8b8c-4493-9672-e53dd719456e-node-exporter-tls\") pod \"node-exporter-94cw9\" (UID: \"10f4b942-8b8c-4493-9672-e53dd719456e\") " pod="openshift-monitoring/node-exporter-94cw9" Jun 09 12:42:32.557588 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:32.557560 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-gd65w" Jun 09 12:42:32.585427 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:32.585391 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/10f4b942-8b8c-4493-9672-e53dd719456e-node-exporter-accelerators-collector-config\") pod \"node-exporter-94cw9\" (UID: \"10f4b942-8b8c-4493-9672-e53dd719456e\") " pod="openshift-monitoring/node-exporter-94cw9" Jun 09 12:42:32.585627 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:32.585433 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/10f4b942-8b8c-4493-9672-e53dd719456e-node-exporter-tls\") pod \"node-exporter-94cw9\" (UID: \"10f4b942-8b8c-4493-9672-e53dd719456e\") " pod="openshift-monitoring/node-exporter-94cw9" Jun 09 12:42:32.585627 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:32.585471 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/10f4b942-8b8c-4493-9672-e53dd719456e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-94cw9\" (UID: \"10f4b942-8b8c-4493-9672-e53dd719456e\") " pod="openshift-monitoring/node-exporter-94cw9" Jun 09 12:42:32.585627 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:32.585496 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/10f4b942-8b8c-4493-9672-e53dd719456e-sys\") pod \"node-exporter-94cw9\" (UID: \"10f4b942-8b8c-4493-9672-e53dd719456e\") " pod="openshift-monitoring/node-exporter-94cw9" Jun 09 12:42:32.585627 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:32.585519 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kx95\" (UniqueName: \"kubernetes.io/projected/10f4b942-8b8c-4493-9672-e53dd719456e-kube-api-access-7kx95\") pod \"node-exporter-94cw9\" (UID: \"10f4b942-8b8c-4493-9672-e53dd719456e\") " pod="openshift-monitoring/node-exporter-94cw9" Jun 09 12:42:32.585627 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:32.585549 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/10f4b942-8b8c-4493-9672-e53dd719456e-node-exporter-textfile\") pod \"node-exporter-94cw9\" (UID: \"10f4b942-8b8c-4493-9672-e53dd719456e\") " pod="openshift-monitoring/node-exporter-94cw9" Jun 09 12:42:32.585627 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:32.585572 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/10f4b942-8b8c-4493-9672-e53dd719456e-metrics-client-ca\") pod \"node-exporter-94cw9\" (UID: \"10f4b942-8b8c-4493-9672-e53dd719456e\") " pod="openshift-monitoring/node-exporter-94cw9" Jun 09 12:42:32.585627 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:32.585600 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/10f4b942-8b8c-4493-9672-e53dd719456e-sys\") pod \"node-exporter-94cw9\" (UID: \"10f4b942-8b8c-4493-9672-e53dd719456e\") " pod="openshift-monitoring/node-exporter-94cw9" Jun 09 12:42:32.585950 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:32.585610 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/10f4b942-8b8c-4493-9672-e53dd719456e-node-exporter-wtmp\") pod \"node-exporter-94cw9\" (UID: \"10f4b942-8b8c-4493-9672-e53dd719456e\") " pod="openshift-monitoring/node-exporter-94cw9" Jun 09 12:42:32.585950 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:32.585670 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/10f4b942-8b8c-4493-9672-e53dd719456e-root\") pod \"node-exporter-94cw9\" (UID: \"10f4b942-8b8c-4493-9672-e53dd719456e\") " pod="openshift-monitoring/node-exporter-94cw9" Jun 09 12:42:32.585950 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:32.585738 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/10f4b942-8b8c-4493-9672-e53dd719456e-node-exporter-wtmp\") pod \"node-exporter-94cw9\" (UID: \"10f4b942-8b8c-4493-9672-e53dd719456e\") " pod="openshift-monitoring/node-exporter-94cw9" Jun 09 12:42:32.585950 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:32.585761 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/10f4b942-8b8c-4493-9672-e53dd719456e-root\") pod \"node-exporter-94cw9\" (UID: \"10f4b942-8b8c-4493-9672-e53dd719456e\") " pod="openshift-monitoring/node-exporter-94cw9" Jun 09 12:42:32.585950 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:32.585883 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/10f4b942-8b8c-4493-9672-e53dd719456e-node-exporter-textfile\") pod \"node-exporter-94cw9\" (UID: \"10f4b942-8b8c-4493-9672-e53dd719456e\") " pod="openshift-monitoring/node-exporter-94cw9" Jun 09 12:42:32.586105 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:32.586028 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/10f4b942-8b8c-4493-9672-e53dd719456e-node-exporter-accelerators-collector-config\") pod \"node-exporter-94cw9\" (UID: \"10f4b942-8b8c-4493-9672-e53dd719456e\") " pod="openshift-monitoring/node-exporter-94cw9" Jun 09 12:42:32.586594 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:32.586575 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/10f4b942-8b8c-4493-9672-e53dd719456e-metrics-client-ca\") pod \"node-exporter-94cw9\" (UID: \"10f4b942-8b8c-4493-9672-e53dd719456e\") " pod="openshift-monitoring/node-exporter-94cw9" Jun 09 12:42:32.587901 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:32.587881 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/10f4b942-8b8c-4493-9672-e53dd719456e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-94cw9\" (UID: \"10f4b942-8b8c-4493-9672-e53dd719456e\") " pod="openshift-monitoring/node-exporter-94cw9" Jun 09 12:42:32.588005 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:32.587992 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/10f4b942-8b8c-4493-9672-e53dd719456e-node-exporter-tls\") pod \"node-exporter-94cw9\" (UID: \"10f4b942-8b8c-4493-9672-e53dd719456e\") " pod="openshift-monitoring/node-exporter-94cw9" Jun 09 12:42:32.604572 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:32.604540 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kx95\" (UniqueName: \"kubernetes.io/projected/10f4b942-8b8c-4493-9672-e53dd719456e-kube-api-access-7kx95\") pod \"node-exporter-94cw9\" (UID: \"10f4b942-8b8c-4493-9672-e53dd719456e\") " pod="openshift-monitoring/node-exporter-94cw9" Jun 09 12:42:32.671732 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:32.671696 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-94cw9" Jun 09 12:42:32.713423 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:42:32.713395 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10f4b942_8b8c_4493_9672_e53dd719456e.slice/crio-7963fdce0afb35c0be241299f3699140b9f8cc5340ef01b216bb4706bc0d9b9d WatchSource:0}: Error finding container 7963fdce0afb35c0be241299f3699140b9f8cc5340ef01b216bb4706bc0d9b9d: Status 404 returned error can't find the container with id 7963fdce0afb35c0be241299f3699140b9f8cc5340ef01b216bb4706bc0d9b9d Jun 09 12:42:33.597724 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:33.597693 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-94cw9" event={"ID":"10f4b942-8b8c-4493-9672-e53dd719456e","Type":"ContainerStarted","Data":"7963fdce0afb35c0be241299f3699140b9f8cc5340ef01b216bb4706bc0d9b9d"} Jun 09 12:42:34.603271 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:34.603239 2561 generic.go:356] "Generic (PLEG): container finished" podID="10f4b942-8b8c-4493-9672-e53dd719456e" containerID="c4d51a8a569c380b7ba4cfbcfb97684b4a6b1c139565636cdfdb0d559f763323" exitCode=0 Jun 09 12:42:34.603634 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:34.603325 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-94cw9" event={"ID":"10f4b942-8b8c-4493-9672-e53dd719456e","Type":"ContainerDied","Data":"c4d51a8a569c380b7ba4cfbcfb97684b4a6b1c139565636cdfdb0d559f763323"} Jun 09 12:42:35.609254 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:35.609215 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-94cw9" event={"ID":"10f4b942-8b8c-4493-9672-e53dd719456e","Type":"ContainerStarted","Data":"2a150c220f13d42c799c35294dcabf5868f19ab1edf24df3060403f99d9d9da4"} Jun 09 12:42:35.609605 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:35.609278 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-94cw9" event={"ID":"10f4b942-8b8c-4493-9672-e53dd719456e","Type":"ContainerStarted","Data":"bcb6978c59f9ba49cef2bb405f3e6656d954d7f9e68313a7bc4cb9f5767359d0"} Jun 09 12:42:36.785248 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:36.785194 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-94cw9" podStartSLOduration=3.891545391 podStartE2EDuration="4.785177077s" totalImagesPullingTime="827.169345ms" totalInitContainerRuntime="66.462341ms" isStatefulPod=true podCreationTimestamp="2026-06-09 12:42:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:42:35.633793169 +0000 UTC m=+84.949107160" watchObservedRunningTime="2026-06-09 12:42:36.785177077 +0000 UTC m=+86.100491068" Jun 09 12:42:36.785915 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:36.785896 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-f99848b47-2wb6x"] Jun 09 12:42:36.788516 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:36.788500 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-f99848b47-2wb6x" Jun 09 12:42:36.793745 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:36.793721 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 09 12:42:36.794983 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:36.794394 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 09 12:42:36.794983 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:36.794394 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 09 12:42:36.798066 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:36.795380 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 09 12:42:36.798066 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:36.796074 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-r8qnh\"" Jun 09 12:42:36.798066 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:36.796551 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-d81r76vbkudt7\"" Jun 09 12:42:36.802150 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:36.802128 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-f99848b47-2wb6x"] Jun 09 12:42:36.921265 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:36.921224 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4b4vt\" (UniqueName: \"kubernetes.io/projected/41c4d350-f346-42f1-9e2e-476cd5df642a-kube-api-access-4b4vt\") pod \"metrics-server-f99848b47-2wb6x\" (UID: \"41c4d350-f346-42f1-9e2e-476cd5df642a\") " pod="openshift-monitoring/metrics-server-f99848b47-2wb6x" Jun 09 12:42:36.921467 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:36.921286 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41c4d350-f346-42f1-9e2e-476cd5df642a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-f99848b47-2wb6x\" (UID: \"41c4d350-f346-42f1-9e2e-476cd5df642a\") " pod="openshift-monitoring/metrics-server-f99848b47-2wb6x" Jun 09 12:42:36.921467 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:36.921359 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/41c4d350-f346-42f1-9e2e-476cd5df642a-secret-metrics-server-tls\") pod \"metrics-server-f99848b47-2wb6x\" (UID: \"41c4d350-f346-42f1-9e2e-476cd5df642a\") " pod="openshift-monitoring/metrics-server-f99848b47-2wb6x" Jun 09 12:42:36.921467 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:36.921386 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/41c4d350-f346-42f1-9e2e-476cd5df642a-client-ca-bundle\") pod \"metrics-server-f99848b47-2wb6x\" (UID: \"41c4d350-f346-42f1-9e2e-476cd5df642a\") " pod="openshift-monitoring/metrics-server-f99848b47-2wb6x" Jun 09 12:42:36.921467 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:36.921419 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/41c4d350-f346-42f1-9e2e-476cd5df642a-audit-log\") pod \"metrics-server-f99848b47-2wb6x\" (UID: \"41c4d350-f346-42f1-9e2e-476cd5df642a\") " pod="openshift-monitoring/metrics-server-f99848b47-2wb6x" Jun 09 12:42:36.921645 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:36.921477 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/41c4d350-f346-42f1-9e2e-476cd5df642a-secret-metrics-server-client-certs\") pod \"metrics-server-f99848b47-2wb6x\" (UID: \"41c4d350-f346-42f1-9e2e-476cd5df642a\") " pod="openshift-monitoring/metrics-server-f99848b47-2wb6x" Jun 09 12:42:36.921645 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:36.921514 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/41c4d350-f346-42f1-9e2e-476cd5df642a-metrics-server-audit-profiles\") pod \"metrics-server-f99848b47-2wb6x\" (UID: \"41c4d350-f346-42f1-9e2e-476cd5df642a\") " pod="openshift-monitoring/metrics-server-f99848b47-2wb6x" Jun 09 12:42:37.022592 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:37.022548 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/41c4d350-f346-42f1-9e2e-476cd5df642a-secret-metrics-server-tls\") pod \"metrics-server-f99848b47-2wb6x\" (UID: \"41c4d350-f346-42f1-9e2e-476cd5df642a\") " pod="openshift-monitoring/metrics-server-f99848b47-2wb6x" Jun 09 12:42:37.022592 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:37.022594 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/41c4d350-f346-42f1-9e2e-476cd5df642a-client-ca-bundle\") pod \"metrics-server-f99848b47-2wb6x\" (UID: \"41c4d350-f346-42f1-9e2e-476cd5df642a\") " pod="openshift-monitoring/metrics-server-f99848b47-2wb6x" Jun 09 12:42:37.022854 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:37.022618 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/41c4d350-f346-42f1-9e2e-476cd5df642a-audit-log\") pod \"metrics-server-f99848b47-2wb6x\" (UID: \"41c4d350-f346-42f1-9e2e-476cd5df642a\") " pod="openshift-monitoring/metrics-server-f99848b47-2wb6x" Jun 09 12:42:37.022854 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:37.022636 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/41c4d350-f346-42f1-9e2e-476cd5df642a-secret-metrics-server-client-certs\") pod \"metrics-server-f99848b47-2wb6x\" (UID: \"41c4d350-f346-42f1-9e2e-476cd5df642a\") " pod="openshift-monitoring/metrics-server-f99848b47-2wb6x" Jun 09 12:42:37.022854 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:37.022743 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/41c4d350-f346-42f1-9e2e-476cd5df642a-metrics-server-audit-profiles\") pod \"metrics-server-f99848b47-2wb6x\" (UID: \"41c4d350-f346-42f1-9e2e-476cd5df642a\") " pod="openshift-monitoring/metrics-server-f99848b47-2wb6x" Jun 09 12:42:37.022854 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:37.022786 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4b4vt\" (UniqueName: \"kubernetes.io/projected/41c4d350-f346-42f1-9e2e-476cd5df642a-kube-api-access-4b4vt\") pod \"metrics-server-f99848b47-2wb6x\" (UID: \"41c4d350-f346-42f1-9e2e-476cd5df642a\") " pod="openshift-monitoring/metrics-server-f99848b47-2wb6x" Jun 09 12:42:37.023043 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:37.022862 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41c4d350-f346-42f1-9e2e-476cd5df642a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-f99848b47-2wb6x\" (UID: \"41c4d350-f346-42f1-9e2e-476cd5df642a\") " pod="openshift-monitoring/metrics-server-f99848b47-2wb6x" Jun 09 12:42:37.023094 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:37.023078 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/41c4d350-f346-42f1-9e2e-476cd5df642a-audit-log\") pod \"metrics-server-f99848b47-2wb6x\" (UID: \"41c4d350-f346-42f1-9e2e-476cd5df642a\") " pod="openshift-monitoring/metrics-server-f99848b47-2wb6x" Jun 09 12:42:37.023625 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:37.023593 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41c4d350-f346-42f1-9e2e-476cd5df642a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-f99848b47-2wb6x\" (UID: \"41c4d350-f346-42f1-9e2e-476cd5df642a\") " pod="openshift-monitoring/metrics-server-f99848b47-2wb6x" Jun 09 12:42:37.023754 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:37.023737 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/41c4d350-f346-42f1-9e2e-476cd5df642a-metrics-server-audit-profiles\") pod \"metrics-server-f99848b47-2wb6x\" (UID: \"41c4d350-f346-42f1-9e2e-476cd5df642a\") " pod="openshift-monitoring/metrics-server-f99848b47-2wb6x" Jun 09 12:42:37.025331 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:37.025304 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/41c4d350-f346-42f1-9e2e-476cd5df642a-secret-metrics-server-client-certs\") pod \"metrics-server-f99848b47-2wb6x\" (UID: \"41c4d350-f346-42f1-9e2e-476cd5df642a\") " pod="openshift-monitoring/metrics-server-f99848b47-2wb6x" Jun 09 12:42:37.025404 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:37.025370 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/41c4d350-f346-42f1-9e2e-476cd5df642a-client-ca-bundle\") pod \"metrics-server-f99848b47-2wb6x\" (UID: \"41c4d350-f346-42f1-9e2e-476cd5df642a\") " pod="openshift-monitoring/metrics-server-f99848b47-2wb6x" Jun 09 12:42:37.025404 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:37.025383 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/41c4d350-f346-42f1-9e2e-476cd5df642a-secret-metrics-server-tls\") pod \"metrics-server-f99848b47-2wb6x\" (UID: \"41c4d350-f346-42f1-9e2e-476cd5df642a\") " pod="openshift-monitoring/metrics-server-f99848b47-2wb6x" Jun 09 12:42:37.034001 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:37.033980 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4b4vt\" (UniqueName: \"kubernetes.io/projected/41c4d350-f346-42f1-9e2e-476cd5df642a-kube-api-access-4b4vt\") pod \"metrics-server-f99848b47-2wb6x\" (UID: \"41c4d350-f346-42f1-9e2e-476cd5df642a\") " pod="openshift-monitoring/metrics-server-f99848b47-2wb6x" Jun 09 12:42:37.101905 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:37.101794 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-f99848b47-2wb6x" Jun 09 12:42:37.188121 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:37.188090 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-ssk65"] Jun 09 12:42:37.191605 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:37.191583 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-ssk65" Jun 09 12:42:37.201370 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:37.201334 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-sj5mb\"" Jun 09 12:42:37.201563 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:37.201377 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 09 12:42:37.218360 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:37.218331 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-ssk65"] Jun 09 12:42:37.259509 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:37.259478 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-f99848b47-2wb6x"] Jun 09 12:42:37.262488 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:42:37.262464 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41c4d350_f346_42f1_9e2e_476cd5df642a.slice/crio-da52ca63c4ef82f6e49074b6432b4189aa6f7af96ce092560f7e0c52fd05ec35 WatchSource:0}: Error finding container da52ca63c4ef82f6e49074b6432b4189aa6f7af96ce092560f7e0c52fd05ec35: Status 404 returned error can't find the container with id da52ca63c4ef82f6e49074b6432b4189aa6f7af96ce092560f7e0c52fd05ec35 Jun 09 12:42:37.325149 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:37.325113 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l99lw\" (UniqueName: \"kubernetes.io/projected/7c8a4b35-9ec3-4d26-8688-a3bebf6e81f9-kube-api-access-l99lw\") pod \"monitoring-plugin-76b68cc874-ssk65\" (UID: \"7c8a4b35-9ec3-4d26-8688-a3bebf6e81f9\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-ssk65" Jun 09 12:42:37.325298 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:37.325171 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7c8a4b35-9ec3-4d26-8688-a3bebf6e81f9-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-ssk65\" (UID: \"7c8a4b35-9ec3-4d26-8688-a3bebf6e81f9\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-ssk65" Jun 09 12:42:37.426504 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:37.426421 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7c8a4b35-9ec3-4d26-8688-a3bebf6e81f9-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-ssk65\" (UID: \"7c8a4b35-9ec3-4d26-8688-a3bebf6e81f9\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-ssk65" Jun 09 12:42:37.426504 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:37.426485 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l99lw\" (UniqueName: \"kubernetes.io/projected/7c8a4b35-9ec3-4d26-8688-a3bebf6e81f9-kube-api-access-l99lw\") pod \"monitoring-plugin-76b68cc874-ssk65\" (UID: \"7c8a4b35-9ec3-4d26-8688-a3bebf6e81f9\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-ssk65" Jun 09 12:42:37.428920 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:37.428899 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7c8a4b35-9ec3-4d26-8688-a3bebf6e81f9-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-ssk65\" (UID: \"7c8a4b35-9ec3-4d26-8688-a3bebf6e81f9\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-ssk65" Jun 09 12:42:37.437191 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:37.437169 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l99lw\" (UniqueName: \"kubernetes.io/projected/7c8a4b35-9ec3-4d26-8688-a3bebf6e81f9-kube-api-access-l99lw\") pod \"monitoring-plugin-76b68cc874-ssk65\" (UID: \"7c8a4b35-9ec3-4d26-8688-a3bebf6e81f9\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-ssk65" Jun 09 12:42:37.502358 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:37.502314 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-ssk65" Jun 09 12:42:37.619365 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:37.619334 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-f99848b47-2wb6x" event={"ID":"41c4d350-f346-42f1-9e2e-476cd5df642a","Type":"ContainerStarted","Data":"da52ca63c4ef82f6e49074b6432b4189aa6f7af96ce092560f7e0c52fd05ec35"} Jun 09 12:42:37.643997 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:37.643968 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-ssk65"] Jun 09 12:42:37.647034 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:42:37.647007 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c8a4b35_9ec3_4d26_8688_a3bebf6e81f9.slice/crio-f524bcd931907f2723623d5eca3c935ccd421cff8cf90bdf0e9f8b05476ae433 WatchSource:0}: Error finding container f524bcd931907f2723623d5eca3c935ccd421cff8cf90bdf0e9f8b05476ae433: Status 404 returned error can't find the container with id f524bcd931907f2723623d5eca3c935ccd421cff8cf90bdf0e9f8b05476ae433 Jun 09 12:42:38.624795 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:38.624762 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-ssk65" event={"ID":"7c8a4b35-9ec3-4d26-8688-a3bebf6e81f9","Type":"ContainerStarted","Data":"f524bcd931907f2723623d5eca3c935ccd421cff8cf90bdf0e9f8b05476ae433"} Jun 09 12:42:39.629470 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:39.629434 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-f99848b47-2wb6x" event={"ID":"41c4d350-f346-42f1-9e2e-476cd5df642a","Type":"ContainerStarted","Data":"660b505a703417c3e2c8c7ddc67fd0071f691f12f9672ffce9b06597e293622b"} Jun 09 12:42:39.631055 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:39.631026 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-ssk65" event={"ID":"7c8a4b35-9ec3-4d26-8688-a3bebf6e81f9","Type":"ContainerStarted","Data":"08387c13f5936f0941b99535ea1cf6dd7fff1273e2b2ec25e83324b5bc69c3f1"} Jun 09 12:42:39.631238 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:39.631213 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-ssk65" Jun 09 12:42:39.637045 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:39.637025 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-ssk65" Jun 09 12:42:39.666407 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:39.666319 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-f99848b47-2wb6x" podStartSLOduration=1.5314904029999998 podStartE2EDuration="3.666294198s" totalImagesPullingTime="2.134803795s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:42:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:42:39.666166543 +0000 UTC m=+88.981480556" watchObservedRunningTime="2026-06-09 12:42:39.666294198 +0000 UTC m=+88.981608182" Jun 09 12:42:39.690194 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:39.690138 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-76b68cc874-ssk65" podStartSLOduration=0.936206719 podStartE2EDuration="2.690117196s" totalImagesPullingTime="1.753910477s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:42:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:42:39.689355017 +0000 UTC m=+89.004669020" watchObservedRunningTime="2026-06-09 12:42:39.690117196 +0000 UTC m=+89.005431185" Jun 09 12:42:53.557144 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:53.557099 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-mq44p" Jun 09 12:42:57.101949 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:57.101915 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-f99848b47-2wb6x" Jun 09 12:42:57.102343 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:42:57.101978 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-f99848b47-2wb6x" Jun 09 12:43:14.752160 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:43:14.752125 2561 generic.go:356] "Generic (PLEG): container finished" podID="5a923537-e481-434d-a73d-675ce3d058b9" containerID="1c9d8821e5e3e3b3ddea05ac5ac48530c9a08edc8863955f7b2ed62b88bc61a5" exitCode=0 Jun 09 12:43:14.752668 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:43:14.752197 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-d7689" event={"ID":"5a923537-e481-434d-a73d-675ce3d058b9","Type":"ContainerDied","Data":"1c9d8821e5e3e3b3ddea05ac5ac48530c9a08edc8863955f7b2ed62b88bc61a5"} Jun 09 12:43:14.752668 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:43:14.752621 2561 scope.go:117] "RemoveContainer" containerID="1c9d8821e5e3e3b3ddea05ac5ac48530c9a08edc8863955f7b2ed62b88bc61a5" Jun 09 12:43:15.760604 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:43:15.760558 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-d7689" event={"ID":"5a923537-e481-434d-a73d-675ce3d058b9","Type":"ContainerStarted","Data":"fd2d68c12db4d36598ee573b105a9e1226a59b5e5edcc8a304db5186e776b31c"} Jun 09 12:43:17.116049 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:43:17.116021 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-f99848b47-2wb6x" Jun 09 12:43:17.120045 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:43:17.120022 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-f99848b47-2wb6x" Jun 09 12:43:29.813984 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:43:29.813949 2561 generic.go:356] "Generic (PLEG): container finished" podID="48765388-02b2-4591-a720-30d6215fa9a3" containerID="a2f14abca51fee23c4df82c259baf1ce436bb151e5c00cf7b96afd95db9e8dd7" exitCode=0 Jun 09 12:43:29.814524 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:43:29.814028 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-m8hvz" event={"ID":"48765388-02b2-4591-a720-30d6215fa9a3","Type":"ContainerDied","Data":"a2f14abca51fee23c4df82c259baf1ce436bb151e5c00cf7b96afd95db9e8dd7"} Jun 09 12:43:29.814524 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:43:29.814395 2561 scope.go:117] "RemoveContainer" containerID="a2f14abca51fee23c4df82c259baf1ce436bb151e5c00cf7b96afd95db9e8dd7" Jun 09 12:43:30.818826 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:43:30.818792 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-m8hvz" event={"ID":"48765388-02b2-4591-a720-30d6215fa9a3","Type":"ContainerStarted","Data":"898044b6d2533b632460fa8e5ff90b194d66cfae522c3b78c75868e04102a39b"} Jun 09 12:46:11.050026 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:46:11.049994 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-4l59j_dd28dc2d-f1bc-4022-ad12-dac9c5f8331a/console-operator/1.log" Jun 09 12:46:11.050587 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:46:11.050230 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-4l59j_dd28dc2d-f1bc-4022-ad12-dac9c5f8331a/console-operator/1.log" Jun 09 12:46:11.061459 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:46:11.061441 2561 kubelet.go:1648] "Image garbage collection succeeded" Jun 09 12:46:28.256811 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:46:28.256773 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv8bzg"] Jun 09 12:46:28.260129 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:46:28.260112 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv8bzg" Jun 09 12:46:28.263194 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:46:28.263170 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 12:46:28.263194 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:46:28.263182 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 12:46:28.264397 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:46:28.264378 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-dbrkp\"" Jun 09 12:46:28.276493 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:46:28.276470 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv8bzg"] Jun 09 12:46:28.308139 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:46:28.308096 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxsk9\" (UniqueName: \"kubernetes.io/projected/52cfec75-0c42-475f-8a93-c8c7a35cd53c-kube-api-access-nxsk9\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv8bzg\" (UID: \"52cfec75-0c42-475f-8a93-c8c7a35cd53c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv8bzg" Jun 09 12:46:28.308310 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:46:28.308168 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/52cfec75-0c42-475f-8a93-c8c7a35cd53c-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv8bzg\" (UID: \"52cfec75-0c42-475f-8a93-c8c7a35cd53c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv8bzg" Jun 09 12:46:28.308310 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:46:28.308194 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/52cfec75-0c42-475f-8a93-c8c7a35cd53c-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv8bzg\" (UID: \"52cfec75-0c42-475f-8a93-c8c7a35cd53c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv8bzg" Jun 09 12:46:28.409514 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:46:28.409475 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/52cfec75-0c42-475f-8a93-c8c7a35cd53c-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv8bzg\" (UID: \"52cfec75-0c42-475f-8a93-c8c7a35cd53c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv8bzg" Jun 09 12:46:28.409684 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:46:28.409523 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/52cfec75-0c42-475f-8a93-c8c7a35cd53c-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv8bzg\" (UID: \"52cfec75-0c42-475f-8a93-c8c7a35cd53c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv8bzg" Jun 09 12:46:28.409684 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:46:28.409558 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxsk9\" (UniqueName: \"kubernetes.io/projected/52cfec75-0c42-475f-8a93-c8c7a35cd53c-kube-api-access-nxsk9\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv8bzg\" (UID: \"52cfec75-0c42-475f-8a93-c8c7a35cd53c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv8bzg" Jun 09 12:46:28.409979 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:46:28.409957 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/52cfec75-0c42-475f-8a93-c8c7a35cd53c-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv8bzg\" (UID: \"52cfec75-0c42-475f-8a93-c8c7a35cd53c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv8bzg" Jun 09 12:46:28.410019 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:46:28.409972 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/52cfec75-0c42-475f-8a93-c8c7a35cd53c-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv8bzg\" (UID: \"52cfec75-0c42-475f-8a93-c8c7a35cd53c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv8bzg" Jun 09 12:46:28.448564 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:46:28.448525 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxsk9\" (UniqueName: \"kubernetes.io/projected/52cfec75-0c42-475f-8a93-c8c7a35cd53c-kube-api-access-nxsk9\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv8bzg\" (UID: \"52cfec75-0c42-475f-8a93-c8c7a35cd53c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv8bzg" Jun 09 12:46:28.569331 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:46:28.569230 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv8bzg" Jun 09 12:46:28.734282 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:46:28.734089 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv8bzg"] Jun 09 12:46:28.736999 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:46:28.736971 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52cfec75_0c42_475f_8a93_c8c7a35cd53c.slice/crio-6915ad8dd7b2f383ec9922141af0e401691aac7b3adea79a4ba63e0b430a7a99 WatchSource:0}: Error finding container 6915ad8dd7b2f383ec9922141af0e401691aac7b3adea79a4ba63e0b430a7a99: Status 404 returned error can't find the container with id 6915ad8dd7b2f383ec9922141af0e401691aac7b3adea79a4ba63e0b430a7a99 Jun 09 12:46:28.739379 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:46:28.739365 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 12:46:29.444139 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:46:29.444104 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv8bzg" event={"ID":"52cfec75-0c42-475f-8a93-c8c7a35cd53c","Type":"ContainerStarted","Data":"6915ad8dd7b2f383ec9922141af0e401691aac7b3adea79a4ba63e0b430a7a99"} Jun 09 12:46:34.812337 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:46:34.812288 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-gc89b"] Jun 09 12:46:34.817993 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:46:34.817964 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-gc89b" Jun 09 12:46:34.820914 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:46:34.820877 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 09 12:46:34.821221 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:46:34.821199 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 09 12:46:34.822215 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:46:34.822189 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-cspzw\"" Jun 09 12:46:34.826859 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:46:34.826801 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-gc89b"] Jun 09 12:46:34.865880 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:46:34.865834 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5qg5\" (UniqueName: \"kubernetes.io/projected/11d45366-8e7f-4d0e-9e4d-a32a18c1cdb3-kube-api-access-h5qg5\") pod \"cert-manager-cainjector-5d99449ffd-gc89b\" (UID: \"11d45366-8e7f-4d0e-9e4d-a32a18c1cdb3\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-gc89b" Jun 09 12:46:34.866028 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:46:34.865935 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/11d45366-8e7f-4d0e-9e4d-a32a18c1cdb3-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-gc89b\" (UID: \"11d45366-8e7f-4d0e-9e4d-a32a18c1cdb3\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-gc89b" Jun 09 12:46:34.966485 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:46:34.966443 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/11d45366-8e7f-4d0e-9e4d-a32a18c1cdb3-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-gc89b\" (UID: \"11d45366-8e7f-4d0e-9e4d-a32a18c1cdb3\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-gc89b" Jun 09 12:46:34.966670 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:46:34.966515 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5qg5\" (UniqueName: \"kubernetes.io/projected/11d45366-8e7f-4d0e-9e4d-a32a18c1cdb3-kube-api-access-h5qg5\") pod \"cert-manager-cainjector-5d99449ffd-gc89b\" (UID: \"11d45366-8e7f-4d0e-9e4d-a32a18c1cdb3\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-gc89b" Jun 09 12:46:34.978079 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:46:34.978046 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/11d45366-8e7f-4d0e-9e4d-a32a18c1cdb3-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-gc89b\" (UID: \"11d45366-8e7f-4d0e-9e4d-a32a18c1cdb3\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-gc89b" Jun 09 12:46:34.978233 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:46:34.978114 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5qg5\" (UniqueName: \"kubernetes.io/projected/11d45366-8e7f-4d0e-9e4d-a32a18c1cdb3-kube-api-access-h5qg5\") pod \"cert-manager-cainjector-5d99449ffd-gc89b\" (UID: \"11d45366-8e7f-4d0e-9e4d-a32a18c1cdb3\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-gc89b" Jun 09 12:46:35.131046 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:46:35.130965 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-gc89b" Jun 09 12:46:36.255313 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:46:36.255286 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-gc89b"] Jun 09 12:46:36.258076 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:46:36.258049 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod11d45366_8e7f_4d0e_9e4d_a32a18c1cdb3.slice/crio-9720dae915cb21d2e668445d07408f6d969d6e67b69c589366192783141e26d2 WatchSource:0}: Error finding container 9720dae915cb21d2e668445d07408f6d969d6e67b69c589366192783141e26d2: Status 404 returned error can't find the container with id 9720dae915cb21d2e668445d07408f6d969d6e67b69c589366192783141e26d2 Jun 09 12:46:36.475554 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:46:36.475457 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-gc89b" event={"ID":"11d45366-8e7f-4d0e-9e4d-a32a18c1cdb3","Type":"ContainerStarted","Data":"9720dae915cb21d2e668445d07408f6d969d6e67b69c589366192783141e26d2"} Jun 09 12:46:36.476998 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:46:36.476965 2561 generic.go:356] "Generic (PLEG): container finished" podID="52cfec75-0c42-475f-8a93-c8c7a35cd53c" containerID="c087229ed796f576007876880a9e2dbd1f89963fbda4660361ceb30f5bf0edef" exitCode=0 Jun 09 12:46:36.477133 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:46:36.477017 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv8bzg" event={"ID":"52cfec75-0c42-475f-8a93-c8c7a35cd53c","Type":"ContainerDied","Data":"c087229ed796f576007876880a9e2dbd1f89963fbda4660361ceb30f5bf0edef"} Jun 09 12:46:40.493594 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:46:40.493557 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-gc89b" event={"ID":"11d45366-8e7f-4d0e-9e4d-a32a18c1cdb3","Type":"ContainerStarted","Data":"cbb1628a49cf8f1977f33ebc24a8276039cd69d830f32c922a81a1d06f5e27bb"} Jun 09 12:46:40.495247 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:46:40.495213 2561 generic.go:356] "Generic (PLEG): container finished" podID="52cfec75-0c42-475f-8a93-c8c7a35cd53c" containerID="8379139cc09207de1be0965145f8ce67b9c2dcbebedc4c2c8840bf459d6b5490" exitCode=0 Jun 09 12:46:40.495356 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:46:40.495270 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv8bzg" event={"ID":"52cfec75-0c42-475f-8a93-c8c7a35cd53c","Type":"ContainerDied","Data":"8379139cc09207de1be0965145f8ce67b9c2dcbebedc4c2c8840bf459d6b5490"} Jun 09 12:46:40.566696 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:46:40.566645 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-gc89b" podStartSLOduration=2.948043529 podStartE2EDuration="6.566626782s" totalImagesPullingTime="3.618583253s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:46:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:46:40.522118876 +0000 UTC m=+329.837432849" watchObservedRunningTime="2026-06-09 12:46:40.566626782 +0000 UTC m=+329.881940772" Jun 09 12:46:48.530799 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:46:48.530761 2561 generic.go:356] "Generic (PLEG): container finished" podID="52cfec75-0c42-475f-8a93-c8c7a35cd53c" containerID="72142ef8acbad2bf594da86b05d515060f36556b636fef8996b41f08a9e51831" exitCode=0 Jun 09 12:46:48.531192 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:46:48.530859 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv8bzg" event={"ID":"52cfec75-0c42-475f-8a93-c8c7a35cd53c","Type":"ContainerDied","Data":"72142ef8acbad2bf594da86b05d515060f36556b636fef8996b41f08a9e51831"} Jun 09 12:46:49.665936 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:46:49.665913 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv8bzg" Jun 09 12:46:49.793791 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:46:49.793699 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nxsk9\" (UniqueName: \"kubernetes.io/projected/52cfec75-0c42-475f-8a93-c8c7a35cd53c-kube-api-access-nxsk9\") pod \"52cfec75-0c42-475f-8a93-c8c7a35cd53c\" (UID: \"52cfec75-0c42-475f-8a93-c8c7a35cd53c\") " Jun 09 12:46:49.793791 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:46:49.793760 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/52cfec75-0c42-475f-8a93-c8c7a35cd53c-bundle\") pod \"52cfec75-0c42-475f-8a93-c8c7a35cd53c\" (UID: \"52cfec75-0c42-475f-8a93-c8c7a35cd53c\") " Jun 09 12:46:49.794037 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:46:49.793805 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/52cfec75-0c42-475f-8a93-c8c7a35cd53c-util\") pod \"52cfec75-0c42-475f-8a93-c8c7a35cd53c\" (UID: \"52cfec75-0c42-475f-8a93-c8c7a35cd53c\") " Jun 09 12:46:49.794180 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:46:49.794150 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52cfec75-0c42-475f-8a93-c8c7a35cd53c-bundle" (OuterVolumeSpecName: "bundle") pod "52cfec75-0c42-475f-8a93-c8c7a35cd53c" (UID: "52cfec75-0c42-475f-8a93-c8c7a35cd53c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:46:49.796076 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:46:49.796049 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52cfec75-0c42-475f-8a93-c8c7a35cd53c-kube-api-access-nxsk9" (OuterVolumeSpecName: "kube-api-access-nxsk9") pod "52cfec75-0c42-475f-8a93-c8c7a35cd53c" (UID: "52cfec75-0c42-475f-8a93-c8c7a35cd53c"). InnerVolumeSpecName "kube-api-access-nxsk9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:46:49.797954 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:46:49.797930 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52cfec75-0c42-475f-8a93-c8c7a35cd53c-util" (OuterVolumeSpecName: "util") pod "52cfec75-0c42-475f-8a93-c8c7a35cd53c" (UID: "52cfec75-0c42-475f-8a93-c8c7a35cd53c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:46:49.895228 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:46:49.895173 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/52cfec75-0c42-475f-8a93-c8c7a35cd53c-bundle\") on node \"ip-10-0-133-109.ec2.internal\" DevicePath \"\"" Jun 09 12:46:49.895228 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:46:49.895222 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/52cfec75-0c42-475f-8a93-c8c7a35cd53c-util\") on node \"ip-10-0-133-109.ec2.internal\" DevicePath \"\"" Jun 09 12:46:49.895228 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:46:49.895232 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nxsk9\" (UniqueName: \"kubernetes.io/projected/52cfec75-0c42-475f-8a93-c8c7a35cd53c-kube-api-access-nxsk9\") on node \"ip-10-0-133-109.ec2.internal\" DevicePath \"\"" Jun 09 12:46:50.539879 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:46:50.539848 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv8bzg" Jun 09 12:46:50.540040 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:46:50.539845 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fv8bzg" event={"ID":"52cfec75-0c42-475f-8a93-c8c7a35cd53c","Type":"ContainerDied","Data":"6915ad8dd7b2f383ec9922141af0e401691aac7b3adea79a4ba63e0b430a7a99"} Jun 09 12:46:50.540040 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:46:50.539970 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6915ad8dd7b2f383ec9922141af0e401691aac7b3adea79a4ba63e0b430a7a99" Jun 09 12:47:14.502347 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:14.502300 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-54544cfb76-gcz6q"] Jun 09 12:47:14.502843 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:14.502575 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52cfec75-0c42-475f-8a93-c8c7a35cd53c" containerName="extract" Jun 09 12:47:14.502843 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:14.502587 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="52cfec75-0c42-475f-8a93-c8c7a35cd53c" containerName="extract" Jun 09 12:47:14.502843 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:14.502602 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52cfec75-0c42-475f-8a93-c8c7a35cd53c" containerName="util" Jun 09 12:47:14.502843 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:14.502608 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="52cfec75-0c42-475f-8a93-c8c7a35cd53c" containerName="util" Jun 09 12:47:14.502843 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:14.502615 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52cfec75-0c42-475f-8a93-c8c7a35cd53c" containerName="pull" Jun 09 12:47:14.502843 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:14.502621 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="52cfec75-0c42-475f-8a93-c8c7a35cd53c" containerName="pull" Jun 09 12:47:14.502843 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:14.502668 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="52cfec75-0c42-475f-8a93-c8c7a35cd53c" containerName="extract" Jun 09 12:47:14.509301 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:14.509279 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-54544cfb76-gcz6q" Jun 09 12:47:14.512896 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:14.512871 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 09 12:47:14.512896 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:14.512884 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-448xf\"" Jun 09 12:47:14.513061 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:14.512978 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 09 12:47:14.513166 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:14.513152 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 09 12:47:14.513700 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:14.513687 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 09 12:47:14.533924 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:14.533895 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-54544cfb76-gcz6q"] Jun 09 12:47:14.589945 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:14.589906 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7fb4d750-fa0f-4726-a767-4d0a91a9d1bc-webhook-cert\") pod \"opendatahub-operator-controller-manager-54544cfb76-gcz6q\" (UID: \"7fb4d750-fa0f-4726-a767-4d0a91a9d1bc\") " pod="opendatahub/opendatahub-operator-controller-manager-54544cfb76-gcz6q" Jun 09 12:47:14.590126 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:14.589956 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7fb4d750-fa0f-4726-a767-4d0a91a9d1bc-manifests\") pod \"opendatahub-operator-controller-manager-54544cfb76-gcz6q\" (UID: \"7fb4d750-fa0f-4726-a767-4d0a91a9d1bc\") " pod="opendatahub/opendatahub-operator-controller-manager-54544cfb76-gcz6q" Jun 09 12:47:14.590126 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:14.589987 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7fb4d750-fa0f-4726-a767-4d0a91a9d1bc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-54544cfb76-gcz6q\" (UID: \"7fb4d750-fa0f-4726-a767-4d0a91a9d1bc\") " pod="opendatahub/opendatahub-operator-controller-manager-54544cfb76-gcz6q" Jun 09 12:47:14.590126 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:14.590037 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7fb4d750-fa0f-4726-a767-4d0a91a9d1bc-tmp\") pod \"opendatahub-operator-controller-manager-54544cfb76-gcz6q\" (UID: \"7fb4d750-fa0f-4726-a767-4d0a91a9d1bc\") " pod="opendatahub/opendatahub-operator-controller-manager-54544cfb76-gcz6q" Jun 09 12:47:14.590126 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:14.590074 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vm2q\" (UniqueName: \"kubernetes.io/projected/7fb4d750-fa0f-4726-a767-4d0a91a9d1bc-kube-api-access-4vm2q\") pod \"opendatahub-operator-controller-manager-54544cfb76-gcz6q\" (UID: \"7fb4d750-fa0f-4726-a767-4d0a91a9d1bc\") " pod="opendatahub/opendatahub-operator-controller-manager-54544cfb76-gcz6q" Jun 09 12:47:14.691219 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:14.691179 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7fb4d750-fa0f-4726-a767-4d0a91a9d1bc-manifests\") pod \"opendatahub-operator-controller-manager-54544cfb76-gcz6q\" (UID: \"7fb4d750-fa0f-4726-a767-4d0a91a9d1bc\") " pod="opendatahub/opendatahub-operator-controller-manager-54544cfb76-gcz6q" Jun 09 12:47:14.691219 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:14.691225 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7fb4d750-fa0f-4726-a767-4d0a91a9d1bc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-54544cfb76-gcz6q\" (UID: \"7fb4d750-fa0f-4726-a767-4d0a91a9d1bc\") " pod="opendatahub/opendatahub-operator-controller-manager-54544cfb76-gcz6q" Jun 09 12:47:14.691445 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:14.691256 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7fb4d750-fa0f-4726-a767-4d0a91a9d1bc-tmp\") pod \"opendatahub-operator-controller-manager-54544cfb76-gcz6q\" (UID: \"7fb4d750-fa0f-4726-a767-4d0a91a9d1bc\") " pod="opendatahub/opendatahub-operator-controller-manager-54544cfb76-gcz6q" Jun 09 12:47:14.691445 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:14.691280 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vm2q\" (UniqueName: \"kubernetes.io/projected/7fb4d750-fa0f-4726-a767-4d0a91a9d1bc-kube-api-access-4vm2q\") pod \"opendatahub-operator-controller-manager-54544cfb76-gcz6q\" (UID: \"7fb4d750-fa0f-4726-a767-4d0a91a9d1bc\") " pod="opendatahub/opendatahub-operator-controller-manager-54544cfb76-gcz6q" Jun 09 12:47:14.691445 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:14.691308 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7fb4d750-fa0f-4726-a767-4d0a91a9d1bc-webhook-cert\") pod \"opendatahub-operator-controller-manager-54544cfb76-gcz6q\" (UID: \"7fb4d750-fa0f-4726-a767-4d0a91a9d1bc\") " pod="opendatahub/opendatahub-operator-controller-manager-54544cfb76-gcz6q" Jun 09 12:47:14.691658 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:14.691633 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7fb4d750-fa0f-4726-a767-4d0a91a9d1bc-manifests\") pod \"opendatahub-operator-controller-manager-54544cfb76-gcz6q\" (UID: \"7fb4d750-fa0f-4726-a767-4d0a91a9d1bc\") " pod="opendatahub/opendatahub-operator-controller-manager-54544cfb76-gcz6q" Jun 09 12:47:14.693662 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:14.693637 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7fb4d750-fa0f-4726-a767-4d0a91a9d1bc-tmp\") pod \"opendatahub-operator-controller-manager-54544cfb76-gcz6q\" (UID: \"7fb4d750-fa0f-4726-a767-4d0a91a9d1bc\") " pod="opendatahub/opendatahub-operator-controller-manager-54544cfb76-gcz6q" Jun 09 12:47:14.693799 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:14.693780 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7fb4d750-fa0f-4726-a767-4d0a91a9d1bc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-54544cfb76-gcz6q\" (UID: \"7fb4d750-fa0f-4726-a767-4d0a91a9d1bc\") " pod="opendatahub/opendatahub-operator-controller-manager-54544cfb76-gcz6q" Jun 09 12:47:14.693864 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:14.693846 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7fb4d750-fa0f-4726-a767-4d0a91a9d1bc-webhook-cert\") pod \"opendatahub-operator-controller-manager-54544cfb76-gcz6q\" (UID: \"7fb4d750-fa0f-4726-a767-4d0a91a9d1bc\") " pod="opendatahub/opendatahub-operator-controller-manager-54544cfb76-gcz6q" Jun 09 12:47:14.703534 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:14.703500 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vm2q\" (UniqueName: \"kubernetes.io/projected/7fb4d750-fa0f-4726-a767-4d0a91a9d1bc-kube-api-access-4vm2q\") pod \"opendatahub-operator-controller-manager-54544cfb76-gcz6q\" (UID: \"7fb4d750-fa0f-4726-a767-4d0a91a9d1bc\") " pod="opendatahub/opendatahub-operator-controller-manager-54544cfb76-gcz6q" Jun 09 12:47:14.819499 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:14.819409 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-54544cfb76-gcz6q" Jun 09 12:47:14.999070 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:14.998957 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-54544cfb76-gcz6q"] Jun 09 12:47:15.001969 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:47:15.001941 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fb4d750_fa0f_4726_a767_4d0a91a9d1bc.slice/crio-6d0585cf72f7a7a1c5e54d8fbe3004383cccd46933a16086400e0576b2cd5be4 WatchSource:0}: Error finding container 6d0585cf72f7a7a1c5e54d8fbe3004383cccd46933a16086400e0576b2cd5be4: Status 404 returned error can't find the container with id 6d0585cf72f7a7a1c5e54d8fbe3004383cccd46933a16086400e0576b2cd5be4 Jun 09 12:47:15.638576 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:15.638534 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-54544cfb76-gcz6q" event={"ID":"7fb4d750-fa0f-4726-a767-4d0a91a9d1bc","Type":"ContainerStarted","Data":"6d0585cf72f7a7a1c5e54d8fbe3004383cccd46933a16086400e0576b2cd5be4"} Jun 09 12:47:18.654239 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:18.654154 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-54544cfb76-gcz6q" event={"ID":"7fb4d750-fa0f-4726-a767-4d0a91a9d1bc","Type":"ContainerStarted","Data":"7708bf4dc80e7aa89d01172365d96e578ad0ebf21a665e1943116f94eb29b571"} Jun 09 12:47:19.659578 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:19.659543 2561 generic.go:356] "Generic (PLEG): container finished" podID="7fb4d750-fa0f-4726-a767-4d0a91a9d1bc" containerID="7708bf4dc80e7aa89d01172365d96e578ad0ebf21a665e1943116f94eb29b571" exitCode=0 Jun 09 12:47:19.660043 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:19.659629 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-54544cfb76-gcz6q" event={"ID":"7fb4d750-fa0f-4726-a767-4d0a91a9d1bc","Type":"ContainerDied","Data":"7708bf4dc80e7aa89d01172365d96e578ad0ebf21a665e1943116f94eb29b571"} Jun 09 12:47:20.665583 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:20.665546 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-54544cfb76-gcz6q" event={"ID":"7fb4d750-fa0f-4726-a767-4d0a91a9d1bc","Type":"ContainerStarted","Data":"12dc927aa69e998270218601d0b6e4d050012e5f039235b0b2b76cb251d0770a"} Jun 09 12:47:20.666013 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:20.665679 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-54544cfb76-gcz6q" Jun 09 12:47:20.711394 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:20.711339 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-54544cfb76-gcz6q" podStartSLOduration=2.08546387 podStartE2EDuration="6.71132218s" totalImagesPullingTime="3.65462628s" totalInitContainerRuntime="971.23203ms" isStatefulPod=false podCreationTimestamp="2026-06-09 12:47:14 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:47:20.711201082 +0000 UTC m=+370.026515072" watchObservedRunningTime="2026-06-09 12:47:20.71132218 +0000 UTC m=+370.026636170" Jun 09 12:47:31.671754 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:31.671728 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-54544cfb76-gcz6q" Jun 09 12:47:34.551357 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:34.551314 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7ccb5f5468-5jb27"] Jun 09 12:47:34.558190 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:34.558166 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7ccb5f5468-5jb27" Jun 09 12:47:34.563408 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:34.563384 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 09 12:47:34.564331 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:34.564302 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-5w7qh\"" Jun 09 12:47:34.564455 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:34.564327 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 09 12:47:34.579516 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:34.579497 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 09 12:47:34.581573 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:34.581557 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 09 12:47:34.610340 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:34.610308 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7ccb5f5468-5jb27"] Jun 09 12:47:34.654251 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:34.654229 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3fa7cec0-6cd6-4213-af15-c78a75df5c69-tls-certs\") pod \"kube-auth-proxy-7ccb5f5468-5jb27\" (UID: \"3fa7cec0-6cd6-4213-af15-c78a75df5c69\") " pod="openshift-ingress/kube-auth-proxy-7ccb5f5468-5jb27" Jun 09 12:47:34.654373 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:34.654267 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kr74\" (UniqueName: \"kubernetes.io/projected/3fa7cec0-6cd6-4213-af15-c78a75df5c69-kube-api-access-8kr74\") pod \"kube-auth-proxy-7ccb5f5468-5jb27\" (UID: \"3fa7cec0-6cd6-4213-af15-c78a75df5c69\") " pod="openshift-ingress/kube-auth-proxy-7ccb5f5468-5jb27" Jun 09 12:47:34.654373 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:34.654319 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3fa7cec0-6cd6-4213-af15-c78a75df5c69-tmp\") pod \"kube-auth-proxy-7ccb5f5468-5jb27\" (UID: \"3fa7cec0-6cd6-4213-af15-c78a75df5c69\") " pod="openshift-ingress/kube-auth-proxy-7ccb5f5468-5jb27" Jun 09 12:47:34.755388 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:34.755354 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3fa7cec0-6cd6-4213-af15-c78a75df5c69-tmp\") pod \"kube-auth-proxy-7ccb5f5468-5jb27\" (UID: \"3fa7cec0-6cd6-4213-af15-c78a75df5c69\") " pod="openshift-ingress/kube-auth-proxy-7ccb5f5468-5jb27" Jun 09 12:47:34.755535 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:34.755400 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3fa7cec0-6cd6-4213-af15-c78a75df5c69-tls-certs\") pod \"kube-auth-proxy-7ccb5f5468-5jb27\" (UID: \"3fa7cec0-6cd6-4213-af15-c78a75df5c69\") " pod="openshift-ingress/kube-auth-proxy-7ccb5f5468-5jb27" Jun 09 12:47:34.755535 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:34.755441 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kr74\" (UniqueName: \"kubernetes.io/projected/3fa7cec0-6cd6-4213-af15-c78a75df5c69-kube-api-access-8kr74\") pod \"kube-auth-proxy-7ccb5f5468-5jb27\" (UID: \"3fa7cec0-6cd6-4213-af15-c78a75df5c69\") " pod="openshift-ingress/kube-auth-proxy-7ccb5f5468-5jb27" Jun 09 12:47:34.755605 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:47:34.755573 2561 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jun 09 12:47:34.755655 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:47:34.755644 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fa7cec0-6cd6-4213-af15-c78a75df5c69-tls-certs podName:3fa7cec0-6cd6-4213-af15-c78a75df5c69 nodeName:}" failed. No retries permitted until 2026-06-09 12:47:35.255625996 +0000 UTC m=+384.570939967 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/3fa7cec0-6cd6-4213-af15-c78a75df5c69-tls-certs") pod "kube-auth-proxy-7ccb5f5468-5jb27" (UID: "3fa7cec0-6cd6-4213-af15-c78a75df5c69") : secret "kube-auth-proxy-tls" not found Jun 09 12:47:34.757597 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:34.757578 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3fa7cec0-6cd6-4213-af15-c78a75df5c69-tmp\") pod \"kube-auth-proxy-7ccb5f5468-5jb27\" (UID: \"3fa7cec0-6cd6-4213-af15-c78a75df5c69\") " pod="openshift-ingress/kube-auth-proxy-7ccb5f5468-5jb27" Jun 09 12:47:34.794647 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:34.794617 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kr74\" (UniqueName: \"kubernetes.io/projected/3fa7cec0-6cd6-4213-af15-c78a75df5c69-kube-api-access-8kr74\") pod \"kube-auth-proxy-7ccb5f5468-5jb27\" (UID: \"3fa7cec0-6cd6-4213-af15-c78a75df5c69\") " pod="openshift-ingress/kube-auth-proxy-7ccb5f5468-5jb27" Jun 09 12:47:34.866078 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:34.865996 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06kjsp9"] Jun 09 12:47:34.869410 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:34.869394 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06kjsp9" Jun 09 12:47:34.874783 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:34.874758 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-dbrkp\"" Jun 09 12:47:34.874947 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:34.874756 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 12:47:34.874947 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:34.874758 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 12:47:34.889847 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:34.889811 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-ws6pr"] Jun 09 12:47:34.892896 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:34.892879 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06kjsp9"] Jun 09 12:47:34.892973 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:34.892963 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-ws6pr" Jun 09 12:47:34.898190 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:34.898168 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-pkr4r\"" Jun 09 12:47:34.898309 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:34.898210 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 09 12:47:34.914041 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:34.914012 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-ws6pr"] Jun 09 12:47:34.956416 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:34.956382 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1a3ddc73-e23b-4bb3-9593-6fd4a95bce19-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06kjsp9\" (UID: \"1a3ddc73-e23b-4bb3-9593-6fd4a95bce19\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06kjsp9" Jun 09 12:47:34.956585 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:34.956431 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1a3ddc73-e23b-4bb3-9593-6fd4a95bce19-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06kjsp9\" (UID: \"1a3ddc73-e23b-4bb3-9593-6fd4a95bce19\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06kjsp9" Jun 09 12:47:34.956585 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:34.956522 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvwtd\" (UniqueName: \"kubernetes.io/projected/876c63fa-e43e-490c-8381-3a7fc638aeb8-kube-api-access-mvwtd\") pod \"odh-model-controller-6dc94f689f-ws6pr\" (UID: \"876c63fa-e43e-490c-8381-3a7fc638aeb8\") " pod="opendatahub/odh-model-controller-6dc94f689f-ws6pr" Jun 09 12:47:34.956585 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:34.956578 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/876c63fa-e43e-490c-8381-3a7fc638aeb8-cert\") pod \"odh-model-controller-6dc94f689f-ws6pr\" (UID: \"876c63fa-e43e-490c-8381-3a7fc638aeb8\") " pod="opendatahub/odh-model-controller-6dc94f689f-ws6pr" Jun 09 12:47:34.956701 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:34.956626 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frq9h\" (UniqueName: \"kubernetes.io/projected/1a3ddc73-e23b-4bb3-9593-6fd4a95bce19-kube-api-access-frq9h\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06kjsp9\" (UID: \"1a3ddc73-e23b-4bb3-9593-6fd4a95bce19\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06kjsp9" Jun 09 12:47:35.057376 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:35.057341 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/876c63fa-e43e-490c-8381-3a7fc638aeb8-cert\") pod \"odh-model-controller-6dc94f689f-ws6pr\" (UID: \"876c63fa-e43e-490c-8381-3a7fc638aeb8\") " pod="opendatahub/odh-model-controller-6dc94f689f-ws6pr" Jun 09 12:47:35.057565 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:35.057390 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frq9h\" (UniqueName: \"kubernetes.io/projected/1a3ddc73-e23b-4bb3-9593-6fd4a95bce19-kube-api-access-frq9h\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06kjsp9\" (UID: \"1a3ddc73-e23b-4bb3-9593-6fd4a95bce19\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06kjsp9" Jun 09 12:47:35.057565 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:35.057423 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1a3ddc73-e23b-4bb3-9593-6fd4a95bce19-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06kjsp9\" (UID: \"1a3ddc73-e23b-4bb3-9593-6fd4a95bce19\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06kjsp9" Jun 09 12:47:35.057565 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:35.057470 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1a3ddc73-e23b-4bb3-9593-6fd4a95bce19-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06kjsp9\" (UID: \"1a3ddc73-e23b-4bb3-9593-6fd4a95bce19\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06kjsp9" Jun 09 12:47:35.057565 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:47:35.057501 2561 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 09 12:47:35.057565 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:35.057518 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvwtd\" (UniqueName: \"kubernetes.io/projected/876c63fa-e43e-490c-8381-3a7fc638aeb8-kube-api-access-mvwtd\") pod \"odh-model-controller-6dc94f689f-ws6pr\" (UID: \"876c63fa-e43e-490c-8381-3a7fc638aeb8\") " pod="opendatahub/odh-model-controller-6dc94f689f-ws6pr" Jun 09 12:47:35.057845 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:47:35.057644 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/876c63fa-e43e-490c-8381-3a7fc638aeb8-cert podName:876c63fa-e43e-490c-8381-3a7fc638aeb8 nodeName:}" failed. No retries permitted until 2026-06-09 12:47:35.557606815 +0000 UTC m=+384.872920784 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/876c63fa-e43e-490c-8381-3a7fc638aeb8-cert") pod "odh-model-controller-6dc94f689f-ws6pr" (UID: "876c63fa-e43e-490c-8381-3a7fc638aeb8") : secret "odh-model-controller-webhook-cert" not found Jun 09 12:47:35.057990 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:35.057966 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1a3ddc73-e23b-4bb3-9593-6fd4a95bce19-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06kjsp9\" (UID: \"1a3ddc73-e23b-4bb3-9593-6fd4a95bce19\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06kjsp9" Jun 09 12:47:35.057990 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:35.057979 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1a3ddc73-e23b-4bb3-9593-6fd4a95bce19-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06kjsp9\" (UID: \"1a3ddc73-e23b-4bb3-9593-6fd4a95bce19\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06kjsp9" Jun 09 12:47:35.089886 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:35.089856 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-frq9h\" (UniqueName: \"kubernetes.io/projected/1a3ddc73-e23b-4bb3-9593-6fd4a95bce19-kube-api-access-frq9h\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06kjsp9\" (UID: \"1a3ddc73-e23b-4bb3-9593-6fd4a95bce19\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06kjsp9" Jun 09 12:47:35.095157 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:35.095134 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvwtd\" (UniqueName: \"kubernetes.io/projected/876c63fa-e43e-490c-8381-3a7fc638aeb8-kube-api-access-mvwtd\") pod \"odh-model-controller-6dc94f689f-ws6pr\" (UID: \"876c63fa-e43e-490c-8381-3a7fc638aeb8\") " pod="opendatahub/odh-model-controller-6dc94f689f-ws6pr" Jun 09 12:47:35.178718 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:35.178600 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06kjsp9" Jun 09 12:47:35.259299 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:35.259266 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3fa7cec0-6cd6-4213-af15-c78a75df5c69-tls-certs\") pod \"kube-auth-proxy-7ccb5f5468-5jb27\" (UID: \"3fa7cec0-6cd6-4213-af15-c78a75df5c69\") " pod="openshift-ingress/kube-auth-proxy-7ccb5f5468-5jb27" Jun 09 12:47:35.261829 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:35.261795 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3fa7cec0-6cd6-4213-af15-c78a75df5c69-tls-certs\") pod \"kube-auth-proxy-7ccb5f5468-5jb27\" (UID: \"3fa7cec0-6cd6-4213-af15-c78a75df5c69\") " pod="openshift-ingress/kube-auth-proxy-7ccb5f5468-5jb27" Jun 09 12:47:35.323224 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:35.323199 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06kjsp9"] Jun 09 12:47:35.324767 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:47:35.324740 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a3ddc73_e23b_4bb3_9593_6fd4a95bce19.slice/crio-3e41bcdada7be3c7b81d395194c50e58783039310f00196eba9393eb4543374d WatchSource:0}: Error finding container 3e41bcdada7be3c7b81d395194c50e58783039310f00196eba9393eb4543374d: Status 404 returned error can't find the container with id 3e41bcdada7be3c7b81d395194c50e58783039310f00196eba9393eb4543374d Jun 09 12:47:35.467838 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:35.467750 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7ccb5f5468-5jb27" Jun 09 12:47:35.563172 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:35.563141 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/876c63fa-e43e-490c-8381-3a7fc638aeb8-cert\") pod \"odh-model-controller-6dc94f689f-ws6pr\" (UID: \"876c63fa-e43e-490c-8381-3a7fc638aeb8\") " pod="opendatahub/odh-model-controller-6dc94f689f-ws6pr" Jun 09 12:47:35.565506 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:35.565486 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/876c63fa-e43e-490c-8381-3a7fc638aeb8-cert\") pod \"odh-model-controller-6dc94f689f-ws6pr\" (UID: \"876c63fa-e43e-490c-8381-3a7fc638aeb8\") " pod="opendatahub/odh-model-controller-6dc94f689f-ws6pr" Jun 09 12:47:35.606015 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:35.605984 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7ccb5f5468-5jb27"] Jun 09 12:47:35.608954 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:47:35.608930 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fa7cec0_6cd6_4213_af15_c78a75df5c69.slice/crio-a5ffe2356a5a4553774ede7c809395ea340d41d63097f96feda32360ce7c519f WatchSource:0}: Error finding container a5ffe2356a5a4553774ede7c809395ea340d41d63097f96feda32360ce7c519f: Status 404 returned error can't find the container with id a5ffe2356a5a4553774ede7c809395ea340d41d63097f96feda32360ce7c519f Jun 09 12:47:35.725679 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:35.725593 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7ccb5f5468-5jb27" event={"ID":"3fa7cec0-6cd6-4213-af15-c78a75df5c69","Type":"ContainerStarted","Data":"a5ffe2356a5a4553774ede7c809395ea340d41d63097f96feda32360ce7c519f"} Jun 09 12:47:35.727059 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:35.727029 2561 generic.go:356] "Generic (PLEG): container finished" podID="1a3ddc73-e23b-4bb3-9593-6fd4a95bce19" containerID="95549b5fec6b96b6d5443ef1b7cee3dce062955e33378cc0ea24fd0f882979ff" exitCode=0 Jun 09 12:47:35.727166 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:35.727091 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06kjsp9" event={"ID":"1a3ddc73-e23b-4bb3-9593-6fd4a95bce19","Type":"ContainerDied","Data":"95549b5fec6b96b6d5443ef1b7cee3dce062955e33378cc0ea24fd0f882979ff"} Jun 09 12:47:35.727166 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:35.727136 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06kjsp9" event={"ID":"1a3ddc73-e23b-4bb3-9593-6fd4a95bce19","Type":"ContainerStarted","Data":"3e41bcdada7be3c7b81d395194c50e58783039310f00196eba9393eb4543374d"} Jun 09 12:47:35.802360 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:35.802327 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-ws6pr" Jun 09 12:47:35.941512 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:35.941482 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-ws6pr"] Jun 09 12:47:35.944473 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:47:35.944445 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod876c63fa_e43e_490c_8381_3a7fc638aeb8.slice/crio-40b9b3c4f7970847590326b27c724e23d8971218afe1a4f6b84f51ca3b584bf1 WatchSource:0}: Error finding container 40b9b3c4f7970847590326b27c724e23d8971218afe1a4f6b84f51ca3b584bf1: Status 404 returned error can't find the container with id 40b9b3c4f7970847590326b27c724e23d8971218afe1a4f6b84f51ca3b584bf1 Jun 09 12:47:36.354193 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:36.354158 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-s994m"] Jun 09 12:47:36.357856 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:36.357833 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-s994m" Jun 09 12:47:36.362177 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:36.362117 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 09 12:47:36.364226 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:36.364199 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-ksgbk\"" Jun 09 12:47:36.386277 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:36.386201 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-s994m"] Jun 09 12:47:36.471302 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:36.471261 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6033cd00-5b99-4759-97ae-1c3f6c33fc38-tls-certs\") pod \"model-serving-api-5dd488fc48-s994m\" (UID: \"6033cd00-5b99-4759-97ae-1c3f6c33fc38\") " pod="opendatahub/model-serving-api-5dd488fc48-s994m" Jun 09 12:47:36.471485 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:36.471318 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djzqw\" (UniqueName: \"kubernetes.io/projected/6033cd00-5b99-4759-97ae-1c3f6c33fc38-kube-api-access-djzqw\") pod \"model-serving-api-5dd488fc48-s994m\" (UID: \"6033cd00-5b99-4759-97ae-1c3f6c33fc38\") " pod="opendatahub/model-serving-api-5dd488fc48-s994m" Jun 09 12:47:36.573284 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:36.572843 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6033cd00-5b99-4759-97ae-1c3f6c33fc38-tls-certs\") pod \"model-serving-api-5dd488fc48-s994m\" (UID: \"6033cd00-5b99-4759-97ae-1c3f6c33fc38\") " pod="opendatahub/model-serving-api-5dd488fc48-s994m" Jun 09 12:47:36.573284 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:36.572909 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djzqw\" (UniqueName: \"kubernetes.io/projected/6033cd00-5b99-4759-97ae-1c3f6c33fc38-kube-api-access-djzqw\") pod \"model-serving-api-5dd488fc48-s994m\" (UID: \"6033cd00-5b99-4759-97ae-1c3f6c33fc38\") " pod="opendatahub/model-serving-api-5dd488fc48-s994m" Jun 09 12:47:36.578384 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:36.578351 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6033cd00-5b99-4759-97ae-1c3f6c33fc38-tls-certs\") pod \"model-serving-api-5dd488fc48-s994m\" (UID: \"6033cd00-5b99-4759-97ae-1c3f6c33fc38\") " pod="opendatahub/model-serving-api-5dd488fc48-s994m" Jun 09 12:47:36.587684 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:36.587653 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-djzqw\" (UniqueName: \"kubernetes.io/projected/6033cd00-5b99-4759-97ae-1c3f6c33fc38-kube-api-access-djzqw\") pod \"model-serving-api-5dd488fc48-s994m\" (UID: \"6033cd00-5b99-4759-97ae-1c3f6c33fc38\") " pod="opendatahub/model-serving-api-5dd488fc48-s994m" Jun 09 12:47:36.672552 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:36.672471 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-s994m" Jun 09 12:47:36.739665 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:36.739571 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-ws6pr" event={"ID":"876c63fa-e43e-490c-8381-3a7fc638aeb8","Type":"ContainerStarted","Data":"40b9b3c4f7970847590326b27c724e23d8971218afe1a4f6b84f51ca3b584bf1"} Jun 09 12:47:36.868486 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:36.868451 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-s994m"] Jun 09 12:47:37.746352 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:37.746296 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-s994m" event={"ID":"6033cd00-5b99-4759-97ae-1c3f6c33fc38","Type":"ContainerStarted","Data":"359d50ef2569e033ccec4fb20c45e89763253ced9d1b0fa722ba0ab4d92935a9"} Jun 09 12:47:40.764302 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:40.764257 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-s994m" event={"ID":"6033cd00-5b99-4759-97ae-1c3f6c33fc38","Type":"ContainerStarted","Data":"39ecf5992442d9ecc5cab1e43626cf99c56c4a4fd72c1520fe75d859f73f0c85"} Jun 09 12:47:40.764774 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:40.764379 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-s994m" Jun 09 12:47:40.766065 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:40.766015 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7ccb5f5468-5jb27" event={"ID":"3fa7cec0-6cd6-4213-af15-c78a75df5c69","Type":"ContainerStarted","Data":"a81e08d256e330d8e249e9feeff562a736e89fca20eefb8b654eed55087b52e6"} Jun 09 12:47:40.770559 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:40.768049 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-ws6pr" event={"ID":"876c63fa-e43e-490c-8381-3a7fc638aeb8","Type":"ContainerStarted","Data":"4f7b465f9876f314e88febab99a9d3a84e3bca69fab9966cfc4cb3285f80e4fe"} Jun 09 12:47:40.770559 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:40.768229 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-ws6pr" Jun 09 12:47:40.775648 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:40.775621 2561 generic.go:356] "Generic (PLEG): container finished" podID="1a3ddc73-e23b-4bb3-9593-6fd4a95bce19" containerID="3443e77c49d13cab2b837bceaccf0b8c55e180fe8d562ca8d60272aa22b78ff0" exitCode=0 Jun 09 12:47:40.775759 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:40.775702 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06kjsp9" event={"ID":"1a3ddc73-e23b-4bb3-9593-6fd4a95bce19","Type":"ContainerDied","Data":"3443e77c49d13cab2b837bceaccf0b8c55e180fe8d562ca8d60272aa22b78ff0"} Jun 09 12:47:40.802613 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:40.802573 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-s994m" podStartSLOduration=1.484000724 podStartE2EDuration="4.802557066s" totalImagesPullingTime="3.318556342s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:47:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:47:40.800561911 +0000 UTC m=+390.115875896" watchObservedRunningTime="2026-06-09 12:47:40.802557066 +0000 UTC m=+390.117871057" Jun 09 12:47:40.961765 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:40.961712 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7ccb5f5468-5jb27" podStartSLOduration=2.385114325 podStartE2EDuration="6.961694329s" totalImagesPullingTime="4.576580004s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:47:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:47:40.956525089 +0000 UTC m=+390.271839080" watchObservedRunningTime="2026-06-09 12:47:40.961694329 +0000 UTC m=+390.277008320" Jun 09 12:47:41.020009 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:41.019907 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-ws6pr" podStartSLOduration=2.765157259 podStartE2EDuration="7.019889484s" totalImagesPullingTime="4.254732225s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:47:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:47:41.00959408 +0000 UTC m=+390.324908086" watchObservedRunningTime="2026-06-09 12:47:41.019889484 +0000 UTC m=+390.335203475" Jun 09 12:47:41.781958 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:41.781927 2561 generic.go:356] "Generic (PLEG): container finished" podID="1a3ddc73-e23b-4bb3-9593-6fd4a95bce19" containerID="539c216ee52695485030a0721d6aaa236099e56a5b81b0101d0769c47da35084" exitCode=0 Jun 09 12:47:41.782420 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:41.782027 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06kjsp9" event={"ID":"1a3ddc73-e23b-4bb3-9593-6fd4a95bce19","Type":"ContainerDied","Data":"539c216ee52695485030a0721d6aaa236099e56a5b81b0101d0769c47da35084"} Jun 09 12:47:42.919914 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:42.919888 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06kjsp9" Jun 09 12:47:43.027305 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:43.027277 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1a3ddc73-e23b-4bb3-9593-6fd4a95bce19-util\") pod \"1a3ddc73-e23b-4bb3-9593-6fd4a95bce19\" (UID: \"1a3ddc73-e23b-4bb3-9593-6fd4a95bce19\") " Jun 09 12:47:43.027453 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:43.027333 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1a3ddc73-e23b-4bb3-9593-6fd4a95bce19-bundle\") pod \"1a3ddc73-e23b-4bb3-9593-6fd4a95bce19\" (UID: \"1a3ddc73-e23b-4bb3-9593-6fd4a95bce19\") " Jun 09 12:47:43.027453 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:43.027382 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-frq9h\" (UniqueName: \"kubernetes.io/projected/1a3ddc73-e23b-4bb3-9593-6fd4a95bce19-kube-api-access-frq9h\") pod \"1a3ddc73-e23b-4bb3-9593-6fd4a95bce19\" (UID: \"1a3ddc73-e23b-4bb3-9593-6fd4a95bce19\") " Jun 09 12:47:43.028372 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:43.028344 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a3ddc73-e23b-4bb3-9593-6fd4a95bce19-bundle" (OuterVolumeSpecName: "bundle") pod "1a3ddc73-e23b-4bb3-9593-6fd4a95bce19" (UID: "1a3ddc73-e23b-4bb3-9593-6fd4a95bce19"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:47:43.029563 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:43.029538 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a3ddc73-e23b-4bb3-9593-6fd4a95bce19-kube-api-access-frq9h" (OuterVolumeSpecName: "kube-api-access-frq9h") pod "1a3ddc73-e23b-4bb3-9593-6fd4a95bce19" (UID: "1a3ddc73-e23b-4bb3-9593-6fd4a95bce19"). InnerVolumeSpecName "kube-api-access-frq9h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:47:43.033649 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:43.033622 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a3ddc73-e23b-4bb3-9593-6fd4a95bce19-util" (OuterVolumeSpecName: "util") pod "1a3ddc73-e23b-4bb3-9593-6fd4a95bce19" (UID: "1a3ddc73-e23b-4bb3-9593-6fd4a95bce19"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:47:43.128631 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:43.128597 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1a3ddc73-e23b-4bb3-9593-6fd4a95bce19-bundle\") on node \"ip-10-0-133-109.ec2.internal\" DevicePath \"\"" Jun 09 12:47:43.128750 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:43.128636 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-frq9h\" (UniqueName: \"kubernetes.io/projected/1a3ddc73-e23b-4bb3-9593-6fd4a95bce19-kube-api-access-frq9h\") on node \"ip-10-0-133-109.ec2.internal\" DevicePath \"\"" Jun 09 12:47:43.128750 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:43.128653 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1a3ddc73-e23b-4bb3-9593-6fd4a95bce19-util\") on node \"ip-10-0-133-109.ec2.internal\" DevicePath \"\"" Jun 09 12:47:43.792124 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:43.792092 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06kjsp9" event={"ID":"1a3ddc73-e23b-4bb3-9593-6fd4a95bce19","Type":"ContainerDied","Data":"3e41bcdada7be3c7b81d395194c50e58783039310f00196eba9393eb4543374d"} Jun 09 12:47:43.792286 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:43.792138 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3e41bcdada7be3c7b81d395194c50e58783039310f00196eba9393eb4543374d" Jun 09 12:47:43.792286 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:43.792137 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06kjsp9" Jun 09 12:47:45.119883 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:45.119855 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-54ccc4d6c5-wbfhc"] Jun 09 12:47:45.120281 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:45.120107 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a3ddc73-e23b-4bb3-9593-6fd4a95bce19" containerName="pull" Jun 09 12:47:45.120281 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:45.120118 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a3ddc73-e23b-4bb3-9593-6fd4a95bce19" containerName="pull" Jun 09 12:47:45.120281 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:45.120132 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a3ddc73-e23b-4bb3-9593-6fd4a95bce19" containerName="util" Jun 09 12:47:45.120281 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:45.120138 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a3ddc73-e23b-4bb3-9593-6fd4a95bce19" containerName="util" Jun 09 12:47:45.120281 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:45.120144 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a3ddc73-e23b-4bb3-9593-6fd4a95bce19" containerName="extract" Jun 09 12:47:45.120281 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:45.120149 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a3ddc73-e23b-4bb3-9593-6fd4a95bce19" containerName="extract" Jun 09 12:47:45.120281 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:45.120199 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a3ddc73-e23b-4bb3-9593-6fd4a95bce19" containerName="extract" Jun 09 12:47:45.124269 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:45.124252 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-54ccc4d6c5-wbfhc" Jun 09 12:47:45.127617 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:45.127594 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 09 12:47:45.127876 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:45.127860 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 09 12:47:45.127983 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:45.127873 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 09 12:47:45.129068 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:45.129051 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 09 12:47:45.129232 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:45.129215 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-z5pz8\"" Jun 09 12:47:45.129299 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:45.129260 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 09 12:47:45.142851 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:45.142807 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-54ccc4d6c5-wbfhc"] Jun 09 12:47:45.246699 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:45.246670 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8c9a3887-63f9-4839-9950-51aacf9ce3ab-manager-config\") pod \"lws-controller-manager-54ccc4d6c5-wbfhc\" (UID: \"8c9a3887-63f9-4839-9950-51aacf9ce3ab\") " pod="openshift-lws-operator/lws-controller-manager-54ccc4d6c5-wbfhc" Jun 09 12:47:45.246699 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:45.246701 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8c9a3887-63f9-4839-9950-51aacf9ce3ab-cert\") pod \"lws-controller-manager-54ccc4d6c5-wbfhc\" (UID: \"8c9a3887-63f9-4839-9950-51aacf9ce3ab\") " pod="openshift-lws-operator/lws-controller-manager-54ccc4d6c5-wbfhc" Jun 09 12:47:45.246905 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:45.246726 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8c9a3887-63f9-4839-9950-51aacf9ce3ab-metrics-cert\") pod \"lws-controller-manager-54ccc4d6c5-wbfhc\" (UID: \"8c9a3887-63f9-4839-9950-51aacf9ce3ab\") " pod="openshift-lws-operator/lws-controller-manager-54ccc4d6c5-wbfhc" Jun 09 12:47:45.246905 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:45.246744 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzs5v\" (UniqueName: \"kubernetes.io/projected/8c9a3887-63f9-4839-9950-51aacf9ce3ab-kube-api-access-nzs5v\") pod \"lws-controller-manager-54ccc4d6c5-wbfhc\" (UID: \"8c9a3887-63f9-4839-9950-51aacf9ce3ab\") " pod="openshift-lws-operator/lws-controller-manager-54ccc4d6c5-wbfhc" Jun 09 12:47:45.347672 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:45.347620 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8c9a3887-63f9-4839-9950-51aacf9ce3ab-manager-config\") pod \"lws-controller-manager-54ccc4d6c5-wbfhc\" (UID: \"8c9a3887-63f9-4839-9950-51aacf9ce3ab\") " pod="openshift-lws-operator/lws-controller-manager-54ccc4d6c5-wbfhc" Jun 09 12:47:45.347672 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:45.347678 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8c9a3887-63f9-4839-9950-51aacf9ce3ab-cert\") pod \"lws-controller-manager-54ccc4d6c5-wbfhc\" (UID: \"8c9a3887-63f9-4839-9950-51aacf9ce3ab\") " pod="openshift-lws-operator/lws-controller-manager-54ccc4d6c5-wbfhc" Jun 09 12:47:45.347911 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:45.347717 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8c9a3887-63f9-4839-9950-51aacf9ce3ab-metrics-cert\") pod \"lws-controller-manager-54ccc4d6c5-wbfhc\" (UID: \"8c9a3887-63f9-4839-9950-51aacf9ce3ab\") " pod="openshift-lws-operator/lws-controller-manager-54ccc4d6c5-wbfhc" Jun 09 12:47:45.347911 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:45.347743 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzs5v\" (UniqueName: \"kubernetes.io/projected/8c9a3887-63f9-4839-9950-51aacf9ce3ab-kube-api-access-nzs5v\") pod \"lws-controller-manager-54ccc4d6c5-wbfhc\" (UID: \"8c9a3887-63f9-4839-9950-51aacf9ce3ab\") " pod="openshift-lws-operator/lws-controller-manager-54ccc4d6c5-wbfhc" Jun 09 12:47:45.348466 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:45.348441 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8c9a3887-63f9-4839-9950-51aacf9ce3ab-manager-config\") pod \"lws-controller-manager-54ccc4d6c5-wbfhc\" (UID: \"8c9a3887-63f9-4839-9950-51aacf9ce3ab\") " pod="openshift-lws-operator/lws-controller-manager-54ccc4d6c5-wbfhc" Jun 09 12:47:45.350208 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:45.350185 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8c9a3887-63f9-4839-9950-51aacf9ce3ab-cert\") pod \"lws-controller-manager-54ccc4d6c5-wbfhc\" (UID: \"8c9a3887-63f9-4839-9950-51aacf9ce3ab\") " pod="openshift-lws-operator/lws-controller-manager-54ccc4d6c5-wbfhc" Jun 09 12:47:45.350296 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:45.350267 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8c9a3887-63f9-4839-9950-51aacf9ce3ab-metrics-cert\") pod \"lws-controller-manager-54ccc4d6c5-wbfhc\" (UID: \"8c9a3887-63f9-4839-9950-51aacf9ce3ab\") " pod="openshift-lws-operator/lws-controller-manager-54ccc4d6c5-wbfhc" Jun 09 12:47:45.362594 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:45.362568 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzs5v\" (UniqueName: \"kubernetes.io/projected/8c9a3887-63f9-4839-9950-51aacf9ce3ab-kube-api-access-nzs5v\") pod \"lws-controller-manager-54ccc4d6c5-wbfhc\" (UID: \"8c9a3887-63f9-4839-9950-51aacf9ce3ab\") " pod="openshift-lws-operator/lws-controller-manager-54ccc4d6c5-wbfhc" Jun 09 12:47:45.434079 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:45.433997 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-54ccc4d6c5-wbfhc" Jun 09 12:47:45.601620 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:45.601592 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-54ccc4d6c5-wbfhc"] Jun 09 12:47:45.603473 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:47:45.603444 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c9a3887_63f9_4839_9950_51aacf9ce3ab.slice/crio-5018ebfcaed3f87b10793d626f7c8d18b2bcdfbefd687e5caadb5e5e4212bde1 WatchSource:0}: Error finding container 5018ebfcaed3f87b10793d626f7c8d18b2bcdfbefd687e5caadb5e5e4212bde1: Status 404 returned error can't find the container with id 5018ebfcaed3f87b10793d626f7c8d18b2bcdfbefd687e5caadb5e5e4212bde1 Jun 09 12:47:45.801645 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:45.801612 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-54ccc4d6c5-wbfhc" event={"ID":"8c9a3887-63f9-4839-9950-51aacf9ce3ab","Type":"ContainerStarted","Data":"5018ebfcaed3f87b10793d626f7c8d18b2bcdfbefd687e5caadb5e5e4212bde1"} Jun 09 12:47:48.815894 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:48.815853 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-54ccc4d6c5-wbfhc" event={"ID":"8c9a3887-63f9-4839-9950-51aacf9ce3ab","Type":"ContainerStarted","Data":"22e31eef749ae7d48147ed3145e511e947fee4520cee64ae22e32299c4ca2080"} Jun 09 12:47:48.816311 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:48.815927 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-54ccc4d6c5-wbfhc" Jun 09 12:47:48.922207 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:48.922152 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-54ccc4d6c5-wbfhc" podStartSLOduration=1.75778407 podStartE2EDuration="3.922135558s" totalImagesPullingTime="2.164351488s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:47:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:47:48.911928761 +0000 UTC m=+398.227242764" watchObservedRunningTime="2026-06-09 12:47:48.922135558 +0000 UTC m=+398.237449549" Jun 09 12:47:51.785083 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:51.785049 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-ws6pr" Jun 09 12:47:51.786990 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:51.786968 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-s994m" Jun 09 12:47:59.823837 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:47:59.823792 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-54ccc4d6c5-wbfhc" Jun 09 12:49:20.268810 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:49:20.268772 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-2hd5s"] Jun 09 12:49:20.272005 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:49:20.271985 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2hd5s" Jun 09 12:49:20.275697 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:49:20.275676 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 09 12:49:20.275807 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:49:20.275712 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-jjq7b\"" Jun 09 12:49:20.276146 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:49:20.276131 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 09 12:49:20.276990 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:49:20.276977 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 09 12:49:20.279843 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:49:20.279804 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 09 12:49:20.287084 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:49:20.287054 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-2hd5s"] Jun 09 12:49:20.297811 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:49:20.297783 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6d2lz\" (UniqueName: \"kubernetes.io/projected/5383360b-f912-4473-922a-a86e47539de2-kube-api-access-6d2lz\") pod \"kuadrant-console-plugin-66b5774985-2hd5s\" (UID: \"5383360b-f912-4473-922a-a86e47539de2\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2hd5s" Jun 09 12:49:20.297930 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:49:20.297909 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5383360b-f912-4473-922a-a86e47539de2-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-2hd5s\" (UID: \"5383360b-f912-4473-922a-a86e47539de2\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2hd5s" Jun 09 12:49:20.297972 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:49:20.297949 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/5383360b-f912-4473-922a-a86e47539de2-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-2hd5s\" (UID: \"5383360b-f912-4473-922a-a86e47539de2\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2hd5s" Jun 09 12:49:20.399004 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:49:20.398960 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6d2lz\" (UniqueName: \"kubernetes.io/projected/5383360b-f912-4473-922a-a86e47539de2-kube-api-access-6d2lz\") pod \"kuadrant-console-plugin-66b5774985-2hd5s\" (UID: \"5383360b-f912-4473-922a-a86e47539de2\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2hd5s" Jun 09 12:49:20.399166 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:49:20.399023 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5383360b-f912-4473-922a-a86e47539de2-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-2hd5s\" (UID: \"5383360b-f912-4473-922a-a86e47539de2\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2hd5s" Jun 09 12:49:20.399166 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:49:20.399065 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/5383360b-f912-4473-922a-a86e47539de2-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-2hd5s\" (UID: \"5383360b-f912-4473-922a-a86e47539de2\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2hd5s" Jun 09 12:49:20.399166 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:49:20.399156 2561 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jun 09 12:49:20.399267 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:49:20.399222 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5383360b-f912-4473-922a-a86e47539de2-plugin-serving-cert podName:5383360b-f912-4473-922a-a86e47539de2 nodeName:}" failed. No retries permitted until 2026-06-09 12:49:20.899203647 +0000 UTC m=+490.214517619 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/5383360b-f912-4473-922a-a86e47539de2-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-2hd5s" (UID: "5383360b-f912-4473-922a-a86e47539de2") : secret "plugin-serving-cert" not found Jun 09 12:49:20.399685 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:49:20.399665 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5383360b-f912-4473-922a-a86e47539de2-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-2hd5s\" (UID: \"5383360b-f912-4473-922a-a86e47539de2\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2hd5s" Jun 09 12:49:20.419723 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:49:20.419699 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6d2lz\" (UniqueName: \"kubernetes.io/projected/5383360b-f912-4473-922a-a86e47539de2-kube-api-access-6d2lz\") pod \"kuadrant-console-plugin-66b5774985-2hd5s\" (UID: \"5383360b-f912-4473-922a-a86e47539de2\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2hd5s" Jun 09 12:49:20.904407 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:49:20.904372 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/5383360b-f912-4473-922a-a86e47539de2-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-2hd5s\" (UID: \"5383360b-f912-4473-922a-a86e47539de2\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2hd5s" Jun 09 12:49:20.906864 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:49:20.906812 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/5383360b-f912-4473-922a-a86e47539de2-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-2hd5s\" (UID: \"5383360b-f912-4473-922a-a86e47539de2\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2hd5s" Jun 09 12:49:21.181398 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:49:21.181314 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2hd5s" Jun 09 12:49:21.324968 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:49:21.324938 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-2hd5s"] Jun 09 12:49:21.326232 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:49:21.326209 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5383360b_f912_4473_922a_a86e47539de2.slice/crio-8091b6c0de820ed9b56278f838a412e32db2b11c14084c51802af742fd21779f WatchSource:0}: Error finding container 8091b6c0de820ed9b56278f838a412e32db2b11c14084c51802af742fd21779f: Status 404 returned error can't find the container with id 8091b6c0de820ed9b56278f838a412e32db2b11c14084c51802af742fd21779f Jun 09 12:49:22.240476 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:49:22.240445 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2hd5s" event={"ID":"5383360b-f912-4473-922a-a86e47539de2","Type":"ContainerStarted","Data":"8091b6c0de820ed9b56278f838a412e32db2b11c14084c51802af742fd21779f"} Jun 09 12:49:45.355275 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:49:45.355237 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2hd5s" event={"ID":"5383360b-f912-4473-922a-a86e47539de2","Type":"ContainerStarted","Data":"a619ecdc3aef7c28a6f4db0473080b7416c60e573558b53173802abfc28ea8c2"} Jun 09 12:49:45.388343 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:49:45.388288 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2hd5s" podStartSLOduration=1.545795222 podStartE2EDuration="25.388275143s" totalImagesPullingTime="23.842479921s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:49:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:49:45.385937144 +0000 UTC m=+514.701251134" watchObservedRunningTime="2026-06-09 12:49:45.388275143 +0000 UTC m=+514.703589132" Jun 09 12:50:04.942608 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:50:04.942573 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-4tljs"] Jun 09 12:50:05.088646 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:50:05.088615 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-4tljs"] Jun 09 12:50:05.088804 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:50:05.088709 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-4tljs" Jun 09 12:50:05.091648 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:50:05.091621 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-d55gc\"" Jun 09 12:50:05.124441 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:50:05.124413 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-58cqs"] Jun 09 12:50:05.143636 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:50:05.143613 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-58cqs" Jun 09 12:50:05.143747 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:50:05.143617 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-58cqs"] Jun 09 12:50:05.185875 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:50:05.185846 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bltdf\" (UniqueName: \"kubernetes.io/projected/4c29ea5e-3564-4f8f-b7d9-30f6ceac98d5-kube-api-access-bltdf\") pod \"authorino-58cd955675-4tljs\" (UID: \"4c29ea5e-3564-4f8f-b7d9-30f6ceac98d5\") " pod="kuadrant-system/authorino-58cd955675-4tljs" Jun 09 12:50:05.185986 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:50:05.185922 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5jdf\" (UniqueName: \"kubernetes.io/projected/2873e2ed-2fb8-4560-acdb-13b0149246c7-kube-api-access-w5jdf\") pod \"authorino-75d556bd77-58cqs\" (UID: \"2873e2ed-2fb8-4560-acdb-13b0149246c7\") " pod="kuadrant-system/authorino-75d556bd77-58cqs" Jun 09 12:50:05.286937 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:50:05.286908 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bltdf\" (UniqueName: \"kubernetes.io/projected/4c29ea5e-3564-4f8f-b7d9-30f6ceac98d5-kube-api-access-bltdf\") pod \"authorino-58cd955675-4tljs\" (UID: \"4c29ea5e-3564-4f8f-b7d9-30f6ceac98d5\") " pod="kuadrant-system/authorino-58cd955675-4tljs" Jun 09 12:50:05.287083 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:50:05.286967 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5jdf\" (UniqueName: \"kubernetes.io/projected/2873e2ed-2fb8-4560-acdb-13b0149246c7-kube-api-access-w5jdf\") pod \"authorino-75d556bd77-58cqs\" (UID: \"2873e2ed-2fb8-4560-acdb-13b0149246c7\") " pod="kuadrant-system/authorino-75d556bd77-58cqs" Jun 09 12:50:05.297548 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:50:05.297527 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bltdf\" (UniqueName: \"kubernetes.io/projected/4c29ea5e-3564-4f8f-b7d9-30f6ceac98d5-kube-api-access-bltdf\") pod \"authorino-58cd955675-4tljs\" (UID: \"4c29ea5e-3564-4f8f-b7d9-30f6ceac98d5\") " pod="kuadrant-system/authorino-58cd955675-4tljs" Jun 09 12:50:05.298207 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:50:05.298186 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5jdf\" (UniqueName: \"kubernetes.io/projected/2873e2ed-2fb8-4560-acdb-13b0149246c7-kube-api-access-w5jdf\") pod \"authorino-75d556bd77-58cqs\" (UID: \"2873e2ed-2fb8-4560-acdb-13b0149246c7\") " pod="kuadrant-system/authorino-75d556bd77-58cqs" Jun 09 12:50:05.398021 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:50:05.397992 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-4tljs" Jun 09 12:50:05.451794 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:50:05.451766 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-58cqs" Jun 09 12:50:05.580975 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:50:05.580948 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-4tljs"] Jun 09 12:50:05.583541 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:50:05.583513 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4c29ea5e_3564_4f8f_b7d9_30f6ceac98d5.slice/crio-570445516eb985b9ff1812648ab6405e6241d920581525d15342fb8f43959ab5 WatchSource:0}: Error finding container 570445516eb985b9ff1812648ab6405e6241d920581525d15342fb8f43959ab5: Status 404 returned error can't find the container with id 570445516eb985b9ff1812648ab6405e6241d920581525d15342fb8f43959ab5 Jun 09 12:50:05.607436 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:50:05.607372 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-58cqs"] Jun 09 12:50:05.609323 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:50:05.609300 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2873e2ed_2fb8_4560_acdb_13b0149246c7.slice/crio-0cf0f73edbce91bc7db5b77b98371be9a8637132d3a6f5bb0aac945ac6e7a254 WatchSource:0}: Error finding container 0cf0f73edbce91bc7db5b77b98371be9a8637132d3a6f5bb0aac945ac6e7a254: Status 404 returned error can't find the container with id 0cf0f73edbce91bc7db5b77b98371be9a8637132d3a6f5bb0aac945ac6e7a254 Jun 09 12:50:06.442590 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:50:06.442556 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-58cqs" event={"ID":"2873e2ed-2fb8-4560-acdb-13b0149246c7","Type":"ContainerStarted","Data":"0cf0f73edbce91bc7db5b77b98371be9a8637132d3a6f5bb0aac945ac6e7a254"} Jun 09 12:50:06.443599 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:50:06.443577 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-4tljs" event={"ID":"4c29ea5e-3564-4f8f-b7d9-30f6ceac98d5","Type":"ContainerStarted","Data":"570445516eb985b9ff1812648ab6405e6241d920581525d15342fb8f43959ab5"} Jun 09 12:50:10.467325 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:50:10.467246 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-58cqs" event={"ID":"2873e2ed-2fb8-4560-acdb-13b0149246c7","Type":"ContainerStarted","Data":"2a73cae03259c052fcdd4cb72f9812ce33e430b87055813199ceac60f3cd254b"} Jun 09 12:50:10.468654 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:50:10.468629 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-4tljs" event={"ID":"4c29ea5e-3564-4f8f-b7d9-30f6ceac98d5","Type":"ContainerStarted","Data":"e3031478154a8b1f1320aab9ab6864a3109ffe1ccddc8d6deb3dd5c6c0689542"} Jun 09 12:50:10.486304 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:50:10.486262 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-58cqs" podStartSLOduration=0.960175043 podStartE2EDuration="5.486247116s" totalImagesPullingTime="4.526072073s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:50:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:50:10.485108186 +0000 UTC m=+539.800422175" watchObservedRunningTime="2026-06-09 12:50:10.486247116 +0000 UTC m=+539.801561106" Jun 09 12:50:10.502223 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:50:10.502179 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-4tljs" podStartSLOduration=1.936622426 podStartE2EDuration="6.502163758s" totalImagesPullingTime="4.565541332s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:50:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:50:10.501924803 +0000 UTC m=+539.817238793" watchObservedRunningTime="2026-06-09 12:50:10.502163758 +0000 UTC m=+539.817477748" Jun 09 12:50:10.526693 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:50:10.526651 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-4tljs"] Jun 09 12:50:12.478572 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:50:12.478526 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-4tljs" podUID="4c29ea5e-3564-4f8f-b7d9-30f6ceac98d5" containerName="authorino" containerID="cri-o://e3031478154a8b1f1320aab9ab6864a3109ffe1ccddc8d6deb3dd5c6c0689542" gracePeriod=30 Jun 09 12:50:12.726642 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:50:12.726616 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-4tljs" Jun 09 12:50:12.854830 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:50:12.854784 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bltdf\" (UniqueName: \"kubernetes.io/projected/4c29ea5e-3564-4f8f-b7d9-30f6ceac98d5-kube-api-access-bltdf\") pod \"4c29ea5e-3564-4f8f-b7d9-30f6ceac98d5\" (UID: \"4c29ea5e-3564-4f8f-b7d9-30f6ceac98d5\") " Jun 09 12:50:12.856879 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:50:12.856846 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c29ea5e-3564-4f8f-b7d9-30f6ceac98d5-kube-api-access-bltdf" (OuterVolumeSpecName: "kube-api-access-bltdf") pod "4c29ea5e-3564-4f8f-b7d9-30f6ceac98d5" (UID: "4c29ea5e-3564-4f8f-b7d9-30f6ceac98d5"). InnerVolumeSpecName "kube-api-access-bltdf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:50:12.955676 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:50:12.955643 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bltdf\" (UniqueName: \"kubernetes.io/projected/4c29ea5e-3564-4f8f-b7d9-30f6ceac98d5-kube-api-access-bltdf\") on node \"ip-10-0-133-109.ec2.internal\" DevicePath \"\"" Jun 09 12:50:13.484082 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:50:13.483997 2561 generic.go:356] "Generic (PLEG): container finished" podID="4c29ea5e-3564-4f8f-b7d9-30f6ceac98d5" containerID="e3031478154a8b1f1320aab9ab6864a3109ffe1ccddc8d6deb3dd5c6c0689542" exitCode=0 Jun 09 12:50:13.484082 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:50:13.484041 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-4tljs" Jun 09 12:50:13.484525 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:50:13.484086 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-4tljs" event={"ID":"4c29ea5e-3564-4f8f-b7d9-30f6ceac98d5","Type":"ContainerDied","Data":"e3031478154a8b1f1320aab9ab6864a3109ffe1ccddc8d6deb3dd5c6c0689542"} Jun 09 12:50:13.484525 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:50:13.484128 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-4tljs" event={"ID":"4c29ea5e-3564-4f8f-b7d9-30f6ceac98d5","Type":"ContainerDied","Data":"570445516eb985b9ff1812648ab6405e6241d920581525d15342fb8f43959ab5"} Jun 09 12:50:13.484525 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:50:13.484151 2561 scope.go:117] "RemoveContainer" containerID="e3031478154a8b1f1320aab9ab6864a3109ffe1ccddc8d6deb3dd5c6c0689542" Jun 09 12:50:13.492179 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:50:13.492165 2561 scope.go:117] "RemoveContainer" containerID="e3031478154a8b1f1320aab9ab6864a3109ffe1ccddc8d6deb3dd5c6c0689542" Jun 09 12:50:13.492417 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:50:13.492400 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3031478154a8b1f1320aab9ab6864a3109ffe1ccddc8d6deb3dd5c6c0689542\": container with ID starting with e3031478154a8b1f1320aab9ab6864a3109ffe1ccddc8d6deb3dd5c6c0689542 not found: ID does not exist" containerID="e3031478154a8b1f1320aab9ab6864a3109ffe1ccddc8d6deb3dd5c6c0689542" Jun 09 12:50:13.492466 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:50:13.492424 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3031478154a8b1f1320aab9ab6864a3109ffe1ccddc8d6deb3dd5c6c0689542"} err="failed to get container status \"e3031478154a8b1f1320aab9ab6864a3109ffe1ccddc8d6deb3dd5c6c0689542\": rpc error: code = NotFound desc = could not find container \"e3031478154a8b1f1320aab9ab6864a3109ffe1ccddc8d6deb3dd5c6c0689542\": container with ID starting with e3031478154a8b1f1320aab9ab6864a3109ffe1ccddc8d6deb3dd5c6c0689542 not found: ID does not exist" Jun 09 12:50:13.506304 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:50:13.506284 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-4tljs"] Jun 09 12:50:13.513439 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:50:13.513416 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-4tljs"] Jun 09 12:50:15.115919 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:50:15.115887 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c29ea5e-3564-4f8f-b7d9-30f6ceac98d5" path="/var/lib/kubelet/pods/4c29ea5e-3564-4f8f-b7d9-30f6ceac98d5/volumes" Jun 09 12:51:11.075945 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:11.075914 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-4l59j_dd28dc2d-f1bc-4022-ad12-dac9c5f8331a/console-operator/1.log" Jun 09 12:51:11.076657 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:11.076636 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-4l59j_dd28dc2d-f1bc-4022-ad12-dac9c5f8331a/console-operator/1.log" Jun 09 12:51:17.502019 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:17.501980 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 12:51:17.502416 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:17.502283 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c29ea5e-3564-4f8f-b7d9-30f6ceac98d5" containerName="authorino" Jun 09 12:51:17.502416 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:17.502294 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c29ea5e-3564-4f8f-b7d9-30f6ceac98d5" containerName="authorino" Jun 09 12:51:17.502416 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:17.502379 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c29ea5e-3564-4f8f-b7d9-30f6ceac98d5" containerName="authorino" Jun 09 12:51:17.506253 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:17.506234 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 09 12:51:17.508929 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:17.508899 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 09 12:51:17.508929 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:17.508908 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 09 12:51:17.509167 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:17.509142 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 09 12:51:17.510039 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:17.510019 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-fqrhs\"" Jun 09 12:51:17.520974 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:17.520951 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 12:51:17.583412 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:17.583372 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jsv4w\" (UniqueName: \"kubernetes.io/projected/e48c2f51-b487-4c10-8ec4-d9e4f0612487-kube-api-access-jsv4w\") pod \"maas-keycloak-0\" (UID: \"e48c2f51-b487-4c10-8ec4-d9e4f0612487\") " pod="keycloak-system/maas-keycloak-0" Jun 09 12:51:17.684119 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:17.684079 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jsv4w\" (UniqueName: \"kubernetes.io/projected/e48c2f51-b487-4c10-8ec4-d9e4f0612487-kube-api-access-jsv4w\") pod \"maas-keycloak-0\" (UID: \"e48c2f51-b487-4c10-8ec4-d9e4f0612487\") " pod="keycloak-system/maas-keycloak-0" Jun 09 12:51:17.694290 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:17.694268 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsv4w\" (UniqueName: \"kubernetes.io/projected/e48c2f51-b487-4c10-8ec4-d9e4f0612487-kube-api-access-jsv4w\") pod \"maas-keycloak-0\" (UID: \"e48c2f51-b487-4c10-8ec4-d9e4f0612487\") " pod="keycloak-system/maas-keycloak-0" Jun 09 12:51:17.815506 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:17.815427 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 09 12:51:17.956168 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:17.956135 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 12:51:17.958435 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:51:17.958407 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode48c2f51_b487_4c10_8ec4_d9e4f0612487.slice/crio-f522b5467ade1704774179b5f89e45f76360270561cd28bc417882efcd2cf8b4 WatchSource:0}: Error finding container f522b5467ade1704774179b5f89e45f76360270561cd28bc417882efcd2cf8b4: Status 404 returned error can't find the container with id f522b5467ade1704774179b5f89e45f76360270561cd28bc417882efcd2cf8b4 Jun 09 12:51:18.765055 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:18.765021 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"e48c2f51-b487-4c10-8ec4-d9e4f0612487","Type":"ContainerStarted","Data":"f522b5467ade1704774179b5f89e45f76360270561cd28bc417882efcd2cf8b4"} Jun 09 12:51:23.793541 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:23.793504 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"e48c2f51-b487-4c10-8ec4-d9e4f0612487","Type":"ContainerStarted","Data":"9c9b5c8a3defa6f0ddce0230fa5e8a4e23c0559fef65bad0586641ab3435b148"} Jun 09 12:51:23.815884 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:23.815854 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 09 12:51:23.816986 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:23.816929 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.103418535 podStartE2EDuration="6.81690903s" totalImagesPullingTime="5.713490495s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:51:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:51:23.814891961 +0000 UTC m=+613.130205953" watchObservedRunningTime="2026-06-09 12:51:23.81690903 +0000 UTC m=+613.132223021" Jun 09 12:51:23.817235 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:23.817193 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e48c2f51-b487-4c10-8ec4-d9e4f0612487" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.28:9000/health/started\": dial tcp 10.134.0.28:9000: connect: connection refused" Jun 09 12:51:24.816128 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:24.816083 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e48c2f51-b487-4c10-8ec4-d9e4f0612487" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.28:9000/health/started\": dial tcp 10.134.0.28:9000: connect: connection refused" Jun 09 12:51:25.816567 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:25.816523 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e48c2f51-b487-4c10-8ec4-d9e4f0612487" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.28:9000/health/started\": dial tcp 10.134.0.28:9000: connect: connection refused" Jun 09 12:51:26.816896 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:26.816846 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e48c2f51-b487-4c10-8ec4-d9e4f0612487" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.28:9000/health/started\": dial tcp 10.134.0.28:9000: connect: connection refused" Jun 09 12:51:27.816803 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:27.816756 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e48c2f51-b487-4c10-8ec4-d9e4f0612487" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.28:9000/health/started\": dial tcp 10.134.0.28:9000: connect: connection refused" Jun 09 12:51:27.818920 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:27.818896 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 09 12:51:28.816704 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:28.816654 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e48c2f51-b487-4c10-8ec4-d9e4f0612487" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.28:9000/health/started\": dial tcp 10.134.0.28:9000: connect: connection refused" Jun 09 12:51:29.816507 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:29.816461 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e48c2f51-b487-4c10-8ec4-d9e4f0612487" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.28:9000/health/started\": dial tcp 10.134.0.28:9000: connect: connection refused" Jun 09 12:51:30.816361 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:30.816306 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e48c2f51-b487-4c10-8ec4-d9e4f0612487" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.28:9000/health/started\": dial tcp 10.134.0.28:9000: connect: connection refused" Jun 09 12:51:31.816397 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:31.816349 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e48c2f51-b487-4c10-8ec4-d9e4f0612487" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.28:9000/health/started\": dial tcp 10.134.0.28:9000: connect: connection refused" Jun 09 12:51:32.816125 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:32.816074 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e48c2f51-b487-4c10-8ec4-d9e4f0612487" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.28:9000/health/started\": dial tcp 10.134.0.28:9000: connect: connection refused" Jun 09 12:51:33.816976 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:33.816921 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e48c2f51-b487-4c10-8ec4-d9e4f0612487" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.28:9000/health/started\": dial tcp 10.134.0.28:9000: connect: connection refused" Jun 09 12:51:34.816194 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:34.816134 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e48c2f51-b487-4c10-8ec4-d9e4f0612487" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.28:9000/health/started\": dial tcp 10.134.0.28:9000: connect: connection refused" Jun 09 12:51:35.815840 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:35.815768 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e48c2f51-b487-4c10-8ec4-d9e4f0612487" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.28:9000/health/started\": dial tcp 10.134.0.28:9000: connect: connection refused" Jun 09 12:51:36.928351 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:36.928312 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 09 12:51:36.943610 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:36.943563 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="e48c2f51-b487-4c10-8ec4-d9e4f0612487" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 12:51:46.935179 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:46.935145 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 09 12:51:47.896307 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:47.896266 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-sfwn2"] Jun 09 12:51:47.903307 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:47.903284 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-sfwn2" Jun 09 12:51:47.917257 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:47.917232 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-sfwn2"] Jun 09 12:51:48.066958 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:48.066922 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqqrm\" (UniqueName: \"kubernetes.io/projected/1d852a64-3c2b-4512-92da-c7390989bd2e-kube-api-access-dqqrm\") pod \"authorino-5d4b67c446-sfwn2\" (UID: \"1d852a64-3c2b-4512-92da-c7390989bd2e\") " pod="kuadrant-system/authorino-5d4b67c446-sfwn2" Jun 09 12:51:48.142725 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:48.142690 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-sfwn2"] Jun 09 12:51:48.142950 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:51:48.142932 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-dqqrm], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-sfwn2" podUID="1d852a64-3c2b-4512-92da-c7390989bd2e" Jun 09 12:51:48.167385 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:48.167320 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqqrm\" (UniqueName: \"kubernetes.io/projected/1d852a64-3c2b-4512-92da-c7390989bd2e-kube-api-access-dqqrm\") pod \"authorino-5d4b67c446-sfwn2\" (UID: \"1d852a64-3c2b-4512-92da-c7390989bd2e\") " pod="kuadrant-system/authorino-5d4b67c446-sfwn2" Jun 09 12:51:48.177055 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:48.177020 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6565bf54dc-hfsbt"] Jun 09 12:51:48.179189 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:48.179169 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6565bf54dc-hfsbt" Jun 09 12:51:48.181263 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:48.181244 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqqrm\" (UniqueName: \"kubernetes.io/projected/1d852a64-3c2b-4512-92da-c7390989bd2e-kube-api-access-dqqrm\") pod \"authorino-5d4b67c446-sfwn2\" (UID: \"1d852a64-3c2b-4512-92da-c7390989bd2e\") " pod="kuadrant-system/authorino-5d4b67c446-sfwn2" Jun 09 12:51:48.187306 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:48.187281 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6565bf54dc-hfsbt"] Jun 09 12:51:48.369192 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:48.369156 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7t9g\" (UniqueName: \"kubernetes.io/projected/060cbbfc-80bb-4c81-8134-3beb158df1fe-kube-api-access-c7t9g\") pod \"authorino-6565bf54dc-hfsbt\" (UID: \"060cbbfc-80bb-4c81-8134-3beb158df1fe\") " pod="kuadrant-system/authorino-6565bf54dc-hfsbt" Jun 09 12:51:48.470313 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:48.470216 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7t9g\" (UniqueName: \"kubernetes.io/projected/060cbbfc-80bb-4c81-8134-3beb158df1fe-kube-api-access-c7t9g\") pod \"authorino-6565bf54dc-hfsbt\" (UID: \"060cbbfc-80bb-4c81-8134-3beb158df1fe\") " pod="kuadrant-system/authorino-6565bf54dc-hfsbt" Jun 09 12:51:48.474275 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:48.474240 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6565bf54dc-hfsbt"] Jun 09 12:51:48.474489 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:51:48.474471 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-c7t9g], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-6565bf54dc-hfsbt" podUID="060cbbfc-80bb-4c81-8134-3beb158df1fe" Jun 09 12:51:48.480466 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:48.480438 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7t9g\" (UniqueName: \"kubernetes.io/projected/060cbbfc-80bb-4c81-8134-3beb158df1fe-kube-api-access-c7t9g\") pod \"authorino-6565bf54dc-hfsbt\" (UID: \"060cbbfc-80bb-4c81-8134-3beb158df1fe\") " pod="kuadrant-system/authorino-6565bf54dc-hfsbt" Jun 09 12:51:48.504121 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:48.504091 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-65d76f45c9-cs9qs"] Jun 09 12:51:48.506112 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:48.506097 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-65d76f45c9-cs9qs" Jun 09 12:51:48.508569 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:48.508545 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 09 12:51:48.515335 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:48.515315 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-65d76f45c9-cs9qs"] Jun 09 12:51:48.672177 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:48.672142 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2b50ba47-f80b-4c0e-9772-5a18d686f337-tls-cert\") pod \"authorino-65d76f45c9-cs9qs\" (UID: \"2b50ba47-f80b-4c0e-9772-5a18d686f337\") " pod="kuadrant-system/authorino-65d76f45c9-cs9qs" Jun 09 12:51:48.672357 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:48.672212 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g94sj\" (UniqueName: \"kubernetes.io/projected/2b50ba47-f80b-4c0e-9772-5a18d686f337-kube-api-access-g94sj\") pod \"authorino-65d76f45c9-cs9qs\" (UID: \"2b50ba47-f80b-4c0e-9772-5a18d686f337\") " pod="kuadrant-system/authorino-65d76f45c9-cs9qs" Jun 09 12:51:48.773499 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:48.773464 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g94sj\" (UniqueName: \"kubernetes.io/projected/2b50ba47-f80b-4c0e-9772-5a18d686f337-kube-api-access-g94sj\") pod \"authorino-65d76f45c9-cs9qs\" (UID: \"2b50ba47-f80b-4c0e-9772-5a18d686f337\") " pod="kuadrant-system/authorino-65d76f45c9-cs9qs" Jun 09 12:51:48.773681 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:48.773521 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2b50ba47-f80b-4c0e-9772-5a18d686f337-tls-cert\") pod \"authorino-65d76f45c9-cs9qs\" (UID: \"2b50ba47-f80b-4c0e-9772-5a18d686f337\") " pod="kuadrant-system/authorino-65d76f45c9-cs9qs" Jun 09 12:51:48.775974 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:48.775954 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2b50ba47-f80b-4c0e-9772-5a18d686f337-tls-cert\") pod \"authorino-65d76f45c9-cs9qs\" (UID: \"2b50ba47-f80b-4c0e-9772-5a18d686f337\") " pod="kuadrant-system/authorino-65d76f45c9-cs9qs" Jun 09 12:51:48.783861 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:48.783837 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g94sj\" (UniqueName: \"kubernetes.io/projected/2b50ba47-f80b-4c0e-9772-5a18d686f337-kube-api-access-g94sj\") pod \"authorino-65d76f45c9-cs9qs\" (UID: \"2b50ba47-f80b-4c0e-9772-5a18d686f337\") " pod="kuadrant-system/authorino-65d76f45c9-cs9qs" Jun 09 12:51:48.815699 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:48.815652 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-65d76f45c9-cs9qs" Jun 09 12:51:48.930886 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:48.930861 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-sfwn2" Jun 09 12:51:48.931099 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:48.930861 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6565bf54dc-hfsbt" Jun 09 12:51:48.937217 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:48.937190 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-sfwn2" Jun 09 12:51:48.939608 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:48.939592 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6565bf54dc-hfsbt" Jun 09 12:51:48.944795 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:48.944775 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-65d76f45c9-cs9qs"] Jun 09 12:51:48.947930 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:51:48.947896 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2b50ba47_f80b_4c0e_9772_5a18d686f337.slice/crio-7298db1542722a71d6e4230014ddb0d6b261713e6326e7c9415871c6411ae576 WatchSource:0}: Error finding container 7298db1542722a71d6e4230014ddb0d6b261713e6326e7c9415871c6411ae576: Status 404 returned error can't find the container with id 7298db1542722a71d6e4230014ddb0d6b261713e6326e7c9415871c6411ae576 Jun 09 12:51:48.949075 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:48.949059 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 12:51:49.076312 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:49.076230 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c7t9g\" (UniqueName: \"kubernetes.io/projected/060cbbfc-80bb-4c81-8134-3beb158df1fe-kube-api-access-c7t9g\") pod \"060cbbfc-80bb-4c81-8134-3beb158df1fe\" (UID: \"060cbbfc-80bb-4c81-8134-3beb158df1fe\") " Jun 09 12:51:49.076312 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:49.076262 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dqqrm\" (UniqueName: \"kubernetes.io/projected/1d852a64-3c2b-4512-92da-c7390989bd2e-kube-api-access-dqqrm\") pod \"1d852a64-3c2b-4512-92da-c7390989bd2e\" (UID: \"1d852a64-3c2b-4512-92da-c7390989bd2e\") " Jun 09 12:51:49.078371 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:49.078341 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/060cbbfc-80bb-4c81-8134-3beb158df1fe-kube-api-access-c7t9g" (OuterVolumeSpecName: "kube-api-access-c7t9g") pod "060cbbfc-80bb-4c81-8134-3beb158df1fe" (UID: "060cbbfc-80bb-4c81-8134-3beb158df1fe"). InnerVolumeSpecName "kube-api-access-c7t9g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:51:49.078371 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:49.078357 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d852a64-3c2b-4512-92da-c7390989bd2e-kube-api-access-dqqrm" (OuterVolumeSpecName: "kube-api-access-dqqrm") pod "1d852a64-3c2b-4512-92da-c7390989bd2e" (UID: "1d852a64-3c2b-4512-92da-c7390989bd2e"). InnerVolumeSpecName "kube-api-access-dqqrm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:51:49.177092 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:49.177063 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c7t9g\" (UniqueName: \"kubernetes.io/projected/060cbbfc-80bb-4c81-8134-3beb158df1fe-kube-api-access-c7t9g\") on node \"ip-10-0-133-109.ec2.internal\" DevicePath \"\"" Jun 09 12:51:49.177092 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:49.177089 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dqqrm\" (UniqueName: \"kubernetes.io/projected/1d852a64-3c2b-4512-92da-c7390989bd2e-kube-api-access-dqqrm\") on node \"ip-10-0-133-109.ec2.internal\" DevicePath \"\"" Jun 09 12:51:49.937140 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:49.937098 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-65d76f45c9-cs9qs" event={"ID":"2b50ba47-f80b-4c0e-9772-5a18d686f337","Type":"ContainerStarted","Data":"17a543541159ebdc7939f224ebc57b1eec9fadca91d8d408b4331431a7dc98f4"} Jun 09 12:51:49.937140 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:49.937130 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6565bf54dc-hfsbt" Jun 09 12:51:49.937140 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:49.937140 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-sfwn2" Jun 09 12:51:49.937436 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:49.937143 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-65d76f45c9-cs9qs" event={"ID":"2b50ba47-f80b-4c0e-9772-5a18d686f337","Type":"ContainerStarted","Data":"7298db1542722a71d6e4230014ddb0d6b261713e6326e7c9415871c6411ae576"} Jun 09 12:51:49.957303 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:49.957254 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-65d76f45c9-cs9qs" podStartSLOduration=1.573249975 podStartE2EDuration="1.957240805s" totalImagesPullingTime="383.99083ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:51:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:51:49.956803377 +0000 UTC m=+639.272117383" watchObservedRunningTime="2026-06-09 12:51:49.957240805 +0000 UTC m=+639.272554797" Jun 09 12:51:49.989833 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:49.989790 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6565bf54dc-hfsbt"] Jun 09 12:51:49.992668 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:49.992597 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-58cqs"] Jun 09 12:51:49.992839 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:49.992795 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-58cqs" podUID="2873e2ed-2fb8-4560-acdb-13b0149246c7" containerName="authorino" containerID="cri-o://2a73cae03259c052fcdd4cb72f9812ce33e430b87055813199ceac60f3cd254b" gracePeriod=30 Jun 09 12:51:50.004915 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:50.004885 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6565bf54dc-hfsbt"] Jun 09 12:51:50.038477 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:50.038442 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-sfwn2"] Jun 09 12:51:50.047589 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:50.047543 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-sfwn2"] Jun 09 12:51:50.234461 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:50.234437 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-58cqs" Jun 09 12:51:50.386399 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:50.386369 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w5jdf\" (UniqueName: \"kubernetes.io/projected/2873e2ed-2fb8-4560-acdb-13b0149246c7-kube-api-access-w5jdf\") pod \"2873e2ed-2fb8-4560-acdb-13b0149246c7\" (UID: \"2873e2ed-2fb8-4560-acdb-13b0149246c7\") " Jun 09 12:51:50.388449 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:50.388422 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2873e2ed-2fb8-4560-acdb-13b0149246c7-kube-api-access-w5jdf" (OuterVolumeSpecName: "kube-api-access-w5jdf") pod "2873e2ed-2fb8-4560-acdb-13b0149246c7" (UID: "2873e2ed-2fb8-4560-acdb-13b0149246c7"). InnerVolumeSpecName "kube-api-access-w5jdf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:51:50.487511 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:50.487426 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w5jdf\" (UniqueName: \"kubernetes.io/projected/2873e2ed-2fb8-4560-acdb-13b0149246c7-kube-api-access-w5jdf\") on node \"ip-10-0-133-109.ec2.internal\" DevicePath \"\"" Jun 09 12:51:50.942216 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:50.942179 2561 generic.go:356] "Generic (PLEG): container finished" podID="2873e2ed-2fb8-4560-acdb-13b0149246c7" containerID="2a73cae03259c052fcdd4cb72f9812ce33e430b87055813199ceac60f3cd254b" exitCode=0 Jun 09 12:51:50.942416 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:50.942225 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-58cqs" Jun 09 12:51:50.942416 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:50.942264 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-58cqs" event={"ID":"2873e2ed-2fb8-4560-acdb-13b0149246c7","Type":"ContainerDied","Data":"2a73cae03259c052fcdd4cb72f9812ce33e430b87055813199ceac60f3cd254b"} Jun 09 12:51:50.942416 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:50.942313 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-58cqs" event={"ID":"2873e2ed-2fb8-4560-acdb-13b0149246c7","Type":"ContainerDied","Data":"0cf0f73edbce91bc7db5b77b98371be9a8637132d3a6f5bb0aac945ac6e7a254"} Jun 09 12:51:50.942416 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:50.942335 2561 scope.go:117] "RemoveContainer" containerID="2a73cae03259c052fcdd4cb72f9812ce33e430b87055813199ceac60f3cd254b" Jun 09 12:51:50.950976 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:50.950954 2561 scope.go:117] "RemoveContainer" containerID="2a73cae03259c052fcdd4cb72f9812ce33e430b87055813199ceac60f3cd254b" Jun 09 12:51:50.951236 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:51:50.951215 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a73cae03259c052fcdd4cb72f9812ce33e430b87055813199ceac60f3cd254b\": container with ID starting with 2a73cae03259c052fcdd4cb72f9812ce33e430b87055813199ceac60f3cd254b not found: ID does not exist" containerID="2a73cae03259c052fcdd4cb72f9812ce33e430b87055813199ceac60f3cd254b" Jun 09 12:51:50.951299 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:50.951249 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a73cae03259c052fcdd4cb72f9812ce33e430b87055813199ceac60f3cd254b"} err="failed to get container status \"2a73cae03259c052fcdd4cb72f9812ce33e430b87055813199ceac60f3cd254b\": rpc error: code = NotFound desc = could not find container \"2a73cae03259c052fcdd4cb72f9812ce33e430b87055813199ceac60f3cd254b\": container with ID starting with 2a73cae03259c052fcdd4cb72f9812ce33e430b87055813199ceac60f3cd254b not found: ID does not exist" Jun 09 12:51:50.973706 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:50.973676 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-58cqs"] Jun 09 12:51:50.979830 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:50.979787 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-58cqs"] Jun 09 12:51:51.115937 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:51.115907 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="060cbbfc-80bb-4c81-8134-3beb158df1fe" path="/var/lib/kubelet/pods/060cbbfc-80bb-4c81-8134-3beb158df1fe/volumes" Jun 09 12:51:51.116138 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:51.116126 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d852a64-3c2b-4512-92da-c7390989bd2e" path="/var/lib/kubelet/pods/1d852a64-3c2b-4512-92da-c7390989bd2e/volumes" Jun 09 12:51:51.116312 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:51.116301 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2873e2ed-2fb8-4560-acdb-13b0149246c7" path="/var/lib/kubelet/pods/2873e2ed-2fb8-4560-acdb-13b0149246c7/volumes" Jun 09 12:51:53.827011 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:53.826971 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-66cbf5b7d7-5xb65"] Jun 09 12:51:53.827401 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:53.827260 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2873e2ed-2fb8-4560-acdb-13b0149246c7" containerName="authorino" Jun 09 12:51:53.827401 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:53.827270 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2873e2ed-2fb8-4560-acdb-13b0149246c7" containerName="authorino" Jun 09 12:51:53.827401 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:53.827333 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="2873e2ed-2fb8-4560-acdb-13b0149246c7" containerName="authorino" Jun 09 12:51:53.830275 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:53.830259 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-66cbf5b7d7-5xb65" Jun 09 12:51:53.834031 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:53.834007 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 09 12:51:53.834125 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:53.834075 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-jvmj9\"" Jun 09 12:51:53.835087 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:53.835067 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 09 12:51:53.859441 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:53.859419 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-66cbf5b7d7-5xb65"] Jun 09 12:51:53.919071 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:53.919044 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ea19df64-022d-4e8b-9f1b-ee4e785cc60d-webhook-cert\") pod \"maas-controller-66cbf5b7d7-5xb65\" (UID: \"ea19df64-022d-4e8b-9f1b-ee4e785cc60d\") " pod="opendatahub/maas-controller-66cbf5b7d7-5xb65" Jun 09 12:51:53.919201 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:53.919096 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhdl2\" (UniqueName: \"kubernetes.io/projected/ea19df64-022d-4e8b-9f1b-ee4e785cc60d-kube-api-access-bhdl2\") pod \"maas-controller-66cbf5b7d7-5xb65\" (UID: \"ea19df64-022d-4e8b-9f1b-ee4e785cc60d\") " pod="opendatahub/maas-controller-66cbf5b7d7-5xb65" Jun 09 12:51:54.020363 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:54.020328 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ea19df64-022d-4e8b-9f1b-ee4e785cc60d-webhook-cert\") pod \"maas-controller-66cbf5b7d7-5xb65\" (UID: \"ea19df64-022d-4e8b-9f1b-ee4e785cc60d\") " pod="opendatahub/maas-controller-66cbf5b7d7-5xb65" Jun 09 12:51:54.020515 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:54.020392 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhdl2\" (UniqueName: \"kubernetes.io/projected/ea19df64-022d-4e8b-9f1b-ee4e785cc60d-kube-api-access-bhdl2\") pod \"maas-controller-66cbf5b7d7-5xb65\" (UID: \"ea19df64-022d-4e8b-9f1b-ee4e785cc60d\") " pod="opendatahub/maas-controller-66cbf5b7d7-5xb65" Jun 09 12:51:54.020515 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:51:54.020470 2561 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jun 09 12:51:54.020625 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:51:54.020533 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea19df64-022d-4e8b-9f1b-ee4e785cc60d-webhook-cert podName:ea19df64-022d-4e8b-9f1b-ee4e785cc60d nodeName:}" failed. No retries permitted until 2026-06-09 12:51:54.520517554 +0000 UTC m=+643.835831523 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/ea19df64-022d-4e8b-9f1b-ee4e785cc60d-webhook-cert") pod "maas-controller-66cbf5b7d7-5xb65" (UID: "ea19df64-022d-4e8b-9f1b-ee4e785cc60d") : secret "maas-controller-webhook-cert" not found Jun 09 12:51:54.038372 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:54.038341 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhdl2\" (UniqueName: \"kubernetes.io/projected/ea19df64-022d-4e8b-9f1b-ee4e785cc60d-kube-api-access-bhdl2\") pod \"maas-controller-66cbf5b7d7-5xb65\" (UID: \"ea19df64-022d-4e8b-9f1b-ee4e785cc60d\") " pod="opendatahub/maas-controller-66cbf5b7d7-5xb65" Jun 09 12:51:54.049342 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:54.049318 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-9d86f989b-284dg"] Jun 09 12:51:54.052837 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:54.052808 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9d86f989b-284dg" Jun 09 12:51:54.068886 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:54.068863 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-9d86f989b-284dg"] Jun 09 12:51:54.121474 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:54.121394 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c99qj\" (UniqueName: \"kubernetes.io/projected/6f866da7-61fc-4ac2-ae1b-333d014333e7-kube-api-access-c99qj\") pod \"maas-controller-9d86f989b-284dg\" (UID: \"6f866da7-61fc-4ac2-ae1b-333d014333e7\") " pod="opendatahub/maas-controller-9d86f989b-284dg" Jun 09 12:51:54.121612 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:54.121504 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6f866da7-61fc-4ac2-ae1b-333d014333e7-webhook-cert\") pod \"maas-controller-9d86f989b-284dg\" (UID: \"6f866da7-61fc-4ac2-ae1b-333d014333e7\") " pod="opendatahub/maas-controller-9d86f989b-284dg" Jun 09 12:51:54.222386 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:54.222348 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6f866da7-61fc-4ac2-ae1b-333d014333e7-webhook-cert\") pod \"maas-controller-9d86f989b-284dg\" (UID: \"6f866da7-61fc-4ac2-ae1b-333d014333e7\") " pod="opendatahub/maas-controller-9d86f989b-284dg" Jun 09 12:51:54.222544 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:54.222448 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c99qj\" (UniqueName: \"kubernetes.io/projected/6f866da7-61fc-4ac2-ae1b-333d014333e7-kube-api-access-c99qj\") pod \"maas-controller-9d86f989b-284dg\" (UID: \"6f866da7-61fc-4ac2-ae1b-333d014333e7\") " pod="opendatahub/maas-controller-9d86f989b-284dg" Jun 09 12:51:54.224803 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:54.224783 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6f866da7-61fc-4ac2-ae1b-333d014333e7-webhook-cert\") pod \"maas-controller-9d86f989b-284dg\" (UID: \"6f866da7-61fc-4ac2-ae1b-333d014333e7\") " pod="opendatahub/maas-controller-9d86f989b-284dg" Jun 09 12:51:54.234035 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:54.234009 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c99qj\" (UniqueName: \"kubernetes.io/projected/6f866da7-61fc-4ac2-ae1b-333d014333e7-kube-api-access-c99qj\") pod \"maas-controller-9d86f989b-284dg\" (UID: \"6f866da7-61fc-4ac2-ae1b-333d014333e7\") " pod="opendatahub/maas-controller-9d86f989b-284dg" Jun 09 12:51:54.362971 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:54.362934 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9d86f989b-284dg" Jun 09 12:51:54.495781 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:54.495753 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-9d86f989b-284dg"] Jun 09 12:51:54.497769 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:51:54.497746 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f866da7_61fc_4ac2_ae1b_333d014333e7.slice/crio-2ea2c243cda15a66d9f79dc6b159cb13a41c25dcfb1618eb7f35f6d7cc1eafc3 WatchSource:0}: Error finding container 2ea2c243cda15a66d9f79dc6b159cb13a41c25dcfb1618eb7f35f6d7cc1eafc3: Status 404 returned error can't find the container with id 2ea2c243cda15a66d9f79dc6b159cb13a41c25dcfb1618eb7f35f6d7cc1eafc3 Jun 09 12:51:54.524372 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:54.524347 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ea19df64-022d-4e8b-9f1b-ee4e785cc60d-webhook-cert\") pod \"maas-controller-66cbf5b7d7-5xb65\" (UID: \"ea19df64-022d-4e8b-9f1b-ee4e785cc60d\") " pod="opendatahub/maas-controller-66cbf5b7d7-5xb65" Jun 09 12:51:54.526594 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:54.526572 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ea19df64-022d-4e8b-9f1b-ee4e785cc60d-webhook-cert\") pod \"maas-controller-66cbf5b7d7-5xb65\" (UID: \"ea19df64-022d-4e8b-9f1b-ee4e785cc60d\") " pod="opendatahub/maas-controller-66cbf5b7d7-5xb65" Jun 09 12:51:54.740228 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:54.740151 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-66cbf5b7d7-5xb65" Jun 09 12:51:54.880486 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:54.880453 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-66cbf5b7d7-5xb65"] Jun 09 12:51:54.884041 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:51:54.884018 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea19df64_022d_4e8b_9f1b_ee4e785cc60d.slice/crio-820b13dba5291604c6e9dfceeb07169a5104ce0259dd99a8bfda5ea31f81f6f3 WatchSource:0}: Error finding container 820b13dba5291604c6e9dfceeb07169a5104ce0259dd99a8bfda5ea31f81f6f3: Status 404 returned error can't find the container with id 820b13dba5291604c6e9dfceeb07169a5104ce0259dd99a8bfda5ea31f81f6f3 Jun 09 12:51:54.961359 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:54.961324 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-66cbf5b7d7-5xb65" event={"ID":"ea19df64-022d-4e8b-9f1b-ee4e785cc60d","Type":"ContainerStarted","Data":"820b13dba5291604c6e9dfceeb07169a5104ce0259dd99a8bfda5ea31f81f6f3"} Jun 09 12:51:54.962339 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:54.962307 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9d86f989b-284dg" event={"ID":"6f866da7-61fc-4ac2-ae1b-333d014333e7","Type":"ContainerStarted","Data":"2ea2c243cda15a66d9f79dc6b159cb13a41c25dcfb1618eb7f35f6d7cc1eafc3"} Jun 09 12:51:57.980195 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:57.980159 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-66cbf5b7d7-5xb65" event={"ID":"ea19df64-022d-4e8b-9f1b-ee4e785cc60d","Type":"ContainerStarted","Data":"b17f9d1603d1afeb5c2af32b0d591da6b0955300a7635da2edb618d23f6cc599"} Jun 09 12:51:57.980632 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:57.980223 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-66cbf5b7d7-5xb65" Jun 09 12:51:57.981654 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:57.981624 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9d86f989b-284dg" event={"ID":"6f866da7-61fc-4ac2-ae1b-333d014333e7","Type":"ContainerStarted","Data":"9253df30937ad4091e1f676178caaba765c7eb23122ab7bfe94d13881a8ba68a"} Jun 09 12:51:57.981772 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:57.981693 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-9d86f989b-284dg" Jun 09 12:51:58.018599 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:58.018542 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-66cbf5b7d7-5xb65" podStartSLOduration=2.7490784169999998 podStartE2EDuration="5.018523939s" totalImagesPullingTime="2.269445522s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:51:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:51:58.016474806 +0000 UTC m=+647.331788799" watchObservedRunningTime="2026-06-09 12:51:58.018523939 +0000 UTC m=+647.333837931" Jun 09 12:51:58.058213 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:51:58.058168 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-9d86f989b-284dg" podStartSLOduration=1.412050976 podStartE2EDuration="4.058152442s" totalImagesPullingTime="2.646101466s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:51:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:51:58.055801048 +0000 UTC m=+647.371115039" watchObservedRunningTime="2026-06-09 12:51:58.058152442 +0000 UTC m=+647.373466432" Jun 09 12:52:08.993230 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:08.993194 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-66cbf5b7d7-5xb65" Jun 09 12:52:08.993701 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:08.993352 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-9d86f989b-284dg" Jun 09 12:52:09.079245 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:09.079195 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-66cbf5b7d7-5xb65"] Jun 09 12:52:09.079425 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:09.079386 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-66cbf5b7d7-5xb65" podUID="ea19df64-022d-4e8b-9f1b-ee4e785cc60d" containerName="manager" containerID="cri-o://b17f9d1603d1afeb5c2af32b0d591da6b0955300a7635da2edb618d23f6cc599" gracePeriod=30 Jun 09 12:52:09.320464 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:09.320440 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-66cbf5b7d7-5xb65" Jun 09 12:52:09.446430 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:09.446395 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bhdl2\" (UniqueName: \"kubernetes.io/projected/ea19df64-022d-4e8b-9f1b-ee4e785cc60d-kube-api-access-bhdl2\") pod \"ea19df64-022d-4e8b-9f1b-ee4e785cc60d\" (UID: \"ea19df64-022d-4e8b-9f1b-ee4e785cc60d\") " Jun 09 12:52:09.446621 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:09.446446 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ea19df64-022d-4e8b-9f1b-ee4e785cc60d-webhook-cert\") pod \"ea19df64-022d-4e8b-9f1b-ee4e785cc60d\" (UID: \"ea19df64-022d-4e8b-9f1b-ee4e785cc60d\") " Jun 09 12:52:09.448590 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:09.448554 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea19df64-022d-4e8b-9f1b-ee4e785cc60d-kube-api-access-bhdl2" (OuterVolumeSpecName: "kube-api-access-bhdl2") pod "ea19df64-022d-4e8b-9f1b-ee4e785cc60d" (UID: "ea19df64-022d-4e8b-9f1b-ee4e785cc60d"). InnerVolumeSpecName "kube-api-access-bhdl2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:52:09.448701 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:09.448604 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea19df64-022d-4e8b-9f1b-ee4e785cc60d-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "ea19df64-022d-4e8b-9f1b-ee4e785cc60d" (UID: "ea19df64-022d-4e8b-9f1b-ee4e785cc60d"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:52:09.547925 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:09.547841 2561 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ea19df64-022d-4e8b-9f1b-ee4e785cc60d-webhook-cert\") on node \"ip-10-0-133-109.ec2.internal\" DevicePath \"\"" Jun 09 12:52:09.547925 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:09.547869 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bhdl2\" (UniqueName: \"kubernetes.io/projected/ea19df64-022d-4e8b-9f1b-ee4e785cc60d-kube-api-access-bhdl2\") on node \"ip-10-0-133-109.ec2.internal\" DevicePath \"\"" Jun 09 12:52:10.038133 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:10.038099 2561 generic.go:356] "Generic (PLEG): container finished" podID="ea19df64-022d-4e8b-9f1b-ee4e785cc60d" containerID="b17f9d1603d1afeb5c2af32b0d591da6b0955300a7635da2edb618d23f6cc599" exitCode=0 Jun 09 12:52:10.038591 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:10.038145 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-66cbf5b7d7-5xb65" Jun 09 12:52:10.038591 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:10.038170 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-66cbf5b7d7-5xb65" event={"ID":"ea19df64-022d-4e8b-9f1b-ee4e785cc60d","Type":"ContainerDied","Data":"b17f9d1603d1afeb5c2af32b0d591da6b0955300a7635da2edb618d23f6cc599"} Jun 09 12:52:10.038591 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:10.038208 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-66cbf5b7d7-5xb65" event={"ID":"ea19df64-022d-4e8b-9f1b-ee4e785cc60d","Type":"ContainerDied","Data":"820b13dba5291604c6e9dfceeb07169a5104ce0259dd99a8bfda5ea31f81f6f3"} Jun 09 12:52:10.038591 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:10.038229 2561 scope.go:117] "RemoveContainer" containerID="b17f9d1603d1afeb5c2af32b0d591da6b0955300a7635da2edb618d23f6cc599" Jun 09 12:52:10.047450 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:10.047432 2561 scope.go:117] "RemoveContainer" containerID="b17f9d1603d1afeb5c2af32b0d591da6b0955300a7635da2edb618d23f6cc599" Jun 09 12:52:10.047694 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:52:10.047673 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b17f9d1603d1afeb5c2af32b0d591da6b0955300a7635da2edb618d23f6cc599\": container with ID starting with b17f9d1603d1afeb5c2af32b0d591da6b0955300a7635da2edb618d23f6cc599 not found: ID does not exist" containerID="b17f9d1603d1afeb5c2af32b0d591da6b0955300a7635da2edb618d23f6cc599" Jun 09 12:52:10.047738 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:10.047702 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b17f9d1603d1afeb5c2af32b0d591da6b0955300a7635da2edb618d23f6cc599"} err="failed to get container status \"b17f9d1603d1afeb5c2af32b0d591da6b0955300a7635da2edb618d23f6cc599\": rpc error: code = NotFound desc = could not find container \"b17f9d1603d1afeb5c2af32b0d591da6b0955300a7635da2edb618d23f6cc599\": container with ID starting with b17f9d1603d1afeb5c2af32b0d591da6b0955300a7635da2edb618d23f6cc599 not found: ID does not exist" Jun 09 12:52:10.065078 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:10.064100 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-66cbf5b7d7-5xb65"] Jun 09 12:52:10.070969 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:10.070923 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-66cbf5b7d7-5xb65"] Jun 09 12:52:11.115558 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:11.115525 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea19df64-022d-4e8b-9f1b-ee4e785cc60d" path="/var/lib/kubelet/pods/ea19df64-022d-4e8b-9f1b-ee4e785cc60d/volumes" Jun 09 12:52:28.620460 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:28.620427 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["redhat-ai-gateway-infra/maas-api-554464565d-mlxh7"] Jun 09 12:52:28.620967 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:28.620738 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea19df64-022d-4e8b-9f1b-ee4e785cc60d" containerName="manager" Jun 09 12:52:28.620967 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:28.620750 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea19df64-022d-4e8b-9f1b-ee4e785cc60d" containerName="manager" Jun 09 12:52:28.620967 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:28.620844 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea19df64-022d-4e8b-9f1b-ee4e785cc60d" containerName="manager" Jun 09 12:52:28.623877 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:28.623859 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-554464565d-mlxh7" Jun 09 12:52:28.626450 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:28.626428 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jun 09 12:52:28.627376 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:28.627355 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"maas-api-serving-cert\"" Jun 09 12:52:28.627506 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:28.627379 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"maas-api-dockercfg-9xzbx\"" Jun 09 12:52:28.627506 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:28.627405 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jun 09 12:52:28.637860 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:28.637835 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-554464565d-mlxh7"] Jun 09 12:52:28.720049 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:28.720012 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e98c86f7-f3af-4c36-ad59-0c6f1c5a2fd9-maas-api-tls\") pod \"maas-api-554464565d-mlxh7\" (UID: \"e98c86f7-f3af-4c36-ad59-0c6f1c5a2fd9\") " pod="redhat-ai-gateway-infra/maas-api-554464565d-mlxh7" Jun 09 12:52:28.720049 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:28.720048 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72f7r\" (UniqueName: \"kubernetes.io/projected/e98c86f7-f3af-4c36-ad59-0c6f1c5a2fd9-kube-api-access-72f7r\") pod \"maas-api-554464565d-mlxh7\" (UID: \"e98c86f7-f3af-4c36-ad59-0c6f1c5a2fd9\") " pod="redhat-ai-gateway-infra/maas-api-554464565d-mlxh7" Jun 09 12:52:28.821160 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:28.821105 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e98c86f7-f3af-4c36-ad59-0c6f1c5a2fd9-maas-api-tls\") pod \"maas-api-554464565d-mlxh7\" (UID: \"e98c86f7-f3af-4c36-ad59-0c6f1c5a2fd9\") " pod="redhat-ai-gateway-infra/maas-api-554464565d-mlxh7" Jun 09 12:52:28.821160 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:28.821149 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72f7r\" (UniqueName: \"kubernetes.io/projected/e98c86f7-f3af-4c36-ad59-0c6f1c5a2fd9-kube-api-access-72f7r\") pod \"maas-api-554464565d-mlxh7\" (UID: \"e98c86f7-f3af-4c36-ad59-0c6f1c5a2fd9\") " pod="redhat-ai-gateway-infra/maas-api-554464565d-mlxh7" Jun 09 12:52:28.823612 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:28.823586 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e98c86f7-f3af-4c36-ad59-0c6f1c5a2fd9-maas-api-tls\") pod \"maas-api-554464565d-mlxh7\" (UID: \"e98c86f7-f3af-4c36-ad59-0c6f1c5a2fd9\") " pod="redhat-ai-gateway-infra/maas-api-554464565d-mlxh7" Jun 09 12:52:28.832752 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:28.832725 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-72f7r\" (UniqueName: \"kubernetes.io/projected/e98c86f7-f3af-4c36-ad59-0c6f1c5a2fd9-kube-api-access-72f7r\") pod \"maas-api-554464565d-mlxh7\" (UID: \"e98c86f7-f3af-4c36-ad59-0c6f1c5a2fd9\") " pod="redhat-ai-gateway-infra/maas-api-554464565d-mlxh7" Jun 09 12:52:28.933730 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:28.933642 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-554464565d-mlxh7" Jun 09 12:52:29.079759 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:29.079730 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-554464565d-mlxh7"] Jun 09 12:52:29.081979 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:52:29.081949 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode98c86f7_f3af_4c36_ad59_0c6f1c5a2fd9.slice/crio-408fbc5e0761fe777fcd6ed17220a3b4ea20183b9ff23b0f6be36c1b483e9157 WatchSource:0}: Error finding container 408fbc5e0761fe777fcd6ed17220a3b4ea20183b9ff23b0f6be36c1b483e9157: Status 404 returned error can't find the container with id 408fbc5e0761fe777fcd6ed17220a3b4ea20183b9ff23b0f6be36c1b483e9157 Jun 09 12:52:29.125921 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:29.125882 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-554464565d-mlxh7" event={"ID":"e98c86f7-f3af-4c36-ad59-0c6f1c5a2fd9","Type":"ContainerStarted","Data":"408fbc5e0761fe777fcd6ed17220a3b4ea20183b9ff23b0f6be36c1b483e9157"} Jun 09 12:52:29.390175 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:29.390138 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-9gbs8"] Jun 09 12:52:29.394706 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:29.394689 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-67d7689b65-9gbs8" Jun 09 12:52:29.397938 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:29.397917 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 09 12:52:29.415770 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:29.415739 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-9gbs8"] Jun 09 12:52:29.489412 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:29.489379 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-br4qj"] Jun 09 12:52:29.492718 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:29.492702 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7c6c859784-br4qj" Jun 09 12:52:29.497454 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:29.497434 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-9f6nb\"" Jun 09 12:52:29.524065 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:29.524025 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-br4qj"] Jun 09 12:52:29.526173 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:29.526151 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mw4f5\" (UniqueName: \"kubernetes.io/projected/9abd9098-8799-406c-9e8d-7b2025b4d568-kube-api-access-mw4f5\") pod \"payload-pre-processing-67d7689b65-9gbs8\" (UID: \"9abd9098-8799-406c-9e8d-7b2025b4d568\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-9gbs8" Jun 09 12:52:29.627532 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:29.627482 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mw4f5\" (UniqueName: \"kubernetes.io/projected/9abd9098-8799-406c-9e8d-7b2025b4d568-kube-api-access-mw4f5\") pod \"payload-pre-processing-67d7689b65-9gbs8\" (UID: \"9abd9098-8799-406c-9e8d-7b2025b4d568\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-9gbs8" Jun 09 12:52:29.627963 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:29.627571 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6km6h\" (UniqueName: \"kubernetes.io/projected/dad2bf8a-21ae-472c-a9c3-ac81aa411894-kube-api-access-6km6h\") pod \"payload-processing-7c6c859784-br4qj\" (UID: \"dad2bf8a-21ae-472c-a9c3-ac81aa411894\") " pod="openshift-ingress/payload-processing-7c6c859784-br4qj" Jun 09 12:52:29.645369 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:29.645298 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mw4f5\" (UniqueName: \"kubernetes.io/projected/9abd9098-8799-406c-9e8d-7b2025b4d568-kube-api-access-mw4f5\") pod \"payload-pre-processing-67d7689b65-9gbs8\" (UID: \"9abd9098-8799-406c-9e8d-7b2025b4d568\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-9gbs8" Jun 09 12:52:29.705270 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:29.705228 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-67d7689b65-9gbs8" Jun 09 12:52:29.728880 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:29.728769 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6km6h\" (UniqueName: \"kubernetes.io/projected/dad2bf8a-21ae-472c-a9c3-ac81aa411894-kube-api-access-6km6h\") pod \"payload-processing-7c6c859784-br4qj\" (UID: \"dad2bf8a-21ae-472c-a9c3-ac81aa411894\") " pod="openshift-ingress/payload-processing-7c6c859784-br4qj" Jun 09 12:52:29.745429 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:29.745378 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6km6h\" (UniqueName: \"kubernetes.io/projected/dad2bf8a-21ae-472c-a9c3-ac81aa411894-kube-api-access-6km6h\") pod \"payload-processing-7c6c859784-br4qj\" (UID: \"dad2bf8a-21ae-472c-a9c3-ac81aa411894\") " pod="openshift-ingress/payload-processing-7c6c859784-br4qj" Jun 09 12:52:29.803258 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:29.803227 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7c6c859784-br4qj" Jun 09 12:52:29.888596 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:29.888565 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-9gbs8"] Jun 09 12:52:29.891075 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:52:29.891045 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9abd9098_8799_406c_9e8d_7b2025b4d568.slice/crio-c9da77e993addac5a0d6d60c45acd539d7a6ce84b9ba13e7a2479da074d2ce7a WatchSource:0}: Error finding container c9da77e993addac5a0d6d60c45acd539d7a6ce84b9ba13e7a2479da074d2ce7a: Status 404 returned error can't find the container with id c9da77e993addac5a0d6d60c45acd539d7a6ce84b9ba13e7a2479da074d2ce7a Jun 09 12:52:29.961962 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:29.961933 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-br4qj"] Jun 09 12:52:29.964073 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:52:29.964044 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddad2bf8a_21ae_472c_a9c3_ac81aa411894.slice/crio-2061d88708f98f618a60b1921b3cb79f1bca2c9c06465d383b51ba880b3239a6 WatchSource:0}: Error finding container 2061d88708f98f618a60b1921b3cb79f1bca2c9c06465d383b51ba880b3239a6: Status 404 returned error can't find the container with id 2061d88708f98f618a60b1921b3cb79f1bca2c9c06465d383b51ba880b3239a6 Jun 09 12:52:30.134121 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:30.134086 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-67d7689b65-9gbs8" event={"ID":"9abd9098-8799-406c-9e8d-7b2025b4d568","Type":"ContainerStarted","Data":"c9da77e993addac5a0d6d60c45acd539d7a6ce84b9ba13e7a2479da074d2ce7a"} Jun 09 12:52:30.135515 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:30.135483 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-br4qj" event={"ID":"dad2bf8a-21ae-472c-a9c3-ac81aa411894","Type":"ContainerStarted","Data":"2061d88708f98f618a60b1921b3cb79f1bca2c9c06465d383b51ba880b3239a6"} Jun 09 12:52:32.146742 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:32.146703 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-554464565d-mlxh7" event={"ID":"e98c86f7-f3af-4c36-ad59-0c6f1c5a2fd9","Type":"ContainerStarted","Data":"1c310a54104b33dc3d551162e4fc6c178177bb19c55f01b61223b7ccb923f971"} Jun 09 12:52:32.147230 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:32.146866 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ai-gateway-infra/maas-api-554464565d-mlxh7" Jun 09 12:52:32.148228 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:32.148199 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-67d7689b65-9gbs8" event={"ID":"9abd9098-8799-406c-9e8d-7b2025b4d568","Type":"ContainerStarted","Data":"e177bcd2774abfe8940e809e6fe3cbe8e9f79c0269a164202dd9ca72c23eae8e"} Jun 09 12:52:32.148336 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:32.148254 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-67d7689b65-9gbs8" Jun 09 12:52:32.149487 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:32.149460 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-br4qj" event={"ID":"dad2bf8a-21ae-472c-a9c3-ac81aa411894","Type":"ContainerStarted","Data":"c4c0921570fdd434c9544646e6e13f798f8672f705a65a81cf5992c3b1bc37b4"} Jun 09 12:52:32.149588 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:32.149578 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-br4qj" Jun 09 12:52:32.171854 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:32.171785 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="redhat-ai-gateway-infra/maas-api-554464565d-mlxh7" podStartSLOduration=2.091795985 podStartE2EDuration="4.171771829s" totalImagesPullingTime="2.079975844s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:52:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:52:32.17132434 +0000 UTC m=+681.486638331" watchObservedRunningTime="2026-06-09 12:52:32.171771829 +0000 UTC m=+681.487085819" Jun 09 12:52:32.189080 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:32.189035 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-7c6c859784-br4qj" podStartSLOduration=1.933299978 podStartE2EDuration="3.189021147s" totalImagesPullingTime="1.255721169s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:52:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:52:32.187752274 +0000 UTC m=+681.503066266" watchObservedRunningTime="2026-06-09 12:52:32.189021147 +0000 UTC m=+681.504335137" Jun 09 12:52:32.205251 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:32.205200 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-67d7689b65-9gbs8" podStartSLOduration=1.879328662 podStartE2EDuration="3.205185162s" totalImagesPullingTime="1.3258565s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:52:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:52:32.204951964 +0000 UTC m=+681.520265956" watchObservedRunningTime="2026-06-09 12:52:32.205185162 +0000 UTC m=+681.520499209" Jun 09 12:52:38.160056 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:38.160021 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ai-gateway-infra/maas-api-554464565d-mlxh7" Jun 09 12:52:40.086674 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:40.086635 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 12:52:40.087168 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:40.086846 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="e48c2f51-b487-4c10-8ec4-d9e4f0612487" containerName="keycloak" containerID="cri-o://9c9b5c8a3defa6f0ddce0230fa5e8a4e23c0559fef65bad0586641ab3435b148" gracePeriod=30 Jun 09 12:52:41.742179 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:41.742147 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 09 12:52:41.835240 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:41.835129 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jsv4w\" (UniqueName: \"kubernetes.io/projected/e48c2f51-b487-4c10-8ec4-d9e4f0612487-kube-api-access-jsv4w\") pod \"e48c2f51-b487-4c10-8ec4-d9e4f0612487\" (UID: \"e48c2f51-b487-4c10-8ec4-d9e4f0612487\") " Jun 09 12:52:41.837354 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:41.837319 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e48c2f51-b487-4c10-8ec4-d9e4f0612487-kube-api-access-jsv4w" (OuterVolumeSpecName: "kube-api-access-jsv4w") pod "e48c2f51-b487-4c10-8ec4-d9e4f0612487" (UID: "e48c2f51-b487-4c10-8ec4-d9e4f0612487"). InnerVolumeSpecName "kube-api-access-jsv4w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:52:41.936207 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:41.936164 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jsv4w\" (UniqueName: \"kubernetes.io/projected/e48c2f51-b487-4c10-8ec4-d9e4f0612487-kube-api-access-jsv4w\") on node \"ip-10-0-133-109.ec2.internal\" DevicePath \"\"" Jun 09 12:52:42.196063 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:42.195971 2561 generic.go:356] "Generic (PLEG): container finished" podID="e48c2f51-b487-4c10-8ec4-d9e4f0612487" containerID="9c9b5c8a3defa6f0ddce0230fa5e8a4e23c0559fef65bad0586641ab3435b148" exitCode=143 Jun 09 12:52:42.196063 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:42.196017 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 09 12:52:42.196262 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:42.196057 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"e48c2f51-b487-4c10-8ec4-d9e4f0612487","Type":"ContainerDied","Data":"9c9b5c8a3defa6f0ddce0230fa5e8a4e23c0559fef65bad0586641ab3435b148"} Jun 09 12:52:42.196262 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:42.196105 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"e48c2f51-b487-4c10-8ec4-d9e4f0612487","Type":"ContainerDied","Data":"f522b5467ade1704774179b5f89e45f76360270561cd28bc417882efcd2cf8b4"} Jun 09 12:52:42.196262 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:42.196131 2561 scope.go:117] "RemoveContainer" containerID="9c9b5c8a3defa6f0ddce0230fa5e8a4e23c0559fef65bad0586641ab3435b148" Jun 09 12:52:42.205898 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:42.205877 2561 scope.go:117] "RemoveContainer" containerID="9c9b5c8a3defa6f0ddce0230fa5e8a4e23c0559fef65bad0586641ab3435b148" Jun 09 12:52:42.206156 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:52:42.206137 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c9b5c8a3defa6f0ddce0230fa5e8a4e23c0559fef65bad0586641ab3435b148\": container with ID starting with 9c9b5c8a3defa6f0ddce0230fa5e8a4e23c0559fef65bad0586641ab3435b148 not found: ID does not exist" containerID="9c9b5c8a3defa6f0ddce0230fa5e8a4e23c0559fef65bad0586641ab3435b148" Jun 09 12:52:42.206208 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:42.206164 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c9b5c8a3defa6f0ddce0230fa5e8a4e23c0559fef65bad0586641ab3435b148"} err="failed to get container status \"9c9b5c8a3defa6f0ddce0230fa5e8a4e23c0559fef65bad0586641ab3435b148\": rpc error: code = NotFound desc = could not find container \"9c9b5c8a3defa6f0ddce0230fa5e8a4e23c0559fef65bad0586641ab3435b148\": container with ID starting with 9c9b5c8a3defa6f0ddce0230fa5e8a4e23c0559fef65bad0586641ab3435b148 not found: ID does not exist" Jun 09 12:52:42.219465 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:42.219431 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 12:52:42.226915 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:42.226887 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 12:52:42.263191 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:42.263163 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 12:52:42.263485 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:42.263473 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e48c2f51-b487-4c10-8ec4-d9e4f0612487" containerName="keycloak" Jun 09 12:52:42.263527 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:42.263486 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e48c2f51-b487-4c10-8ec4-d9e4f0612487" containerName="keycloak" Jun 09 12:52:42.263587 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:42.263578 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="e48c2f51-b487-4c10-8ec4-d9e4f0612487" containerName="keycloak" Jun 09 12:52:42.267579 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:42.267560 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 09 12:52:42.270319 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:42.270285 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 09 12:52:42.270319 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:42.270299 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 09 12:52:42.270511 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:42.270493 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 09 12:52:42.270579 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:42.270535 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 09 12:52:42.270630 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:42.270584 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-fqrhs\"" Jun 09 12:52:42.277585 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:42.277559 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 12:52:42.339213 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:42.339171 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cth7t\" (UniqueName: \"kubernetes.io/projected/f7262654-d8ea-46e3-82bc-b1bb03628897-kube-api-access-cth7t\") pod \"maas-keycloak-0\" (UID: \"f7262654-d8ea-46e3-82bc-b1bb03628897\") " pod="keycloak-system/maas-keycloak-0" Jun 09 12:52:42.339370 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:42.339239 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/f7262654-d8ea-46e3-82bc-b1bb03628897-test-realms\") pod \"maas-keycloak-0\" (UID: \"f7262654-d8ea-46e3-82bc-b1bb03628897\") " pod="keycloak-system/maas-keycloak-0" Jun 09 12:52:42.440096 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:42.440058 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/f7262654-d8ea-46e3-82bc-b1bb03628897-test-realms\") pod \"maas-keycloak-0\" (UID: \"f7262654-d8ea-46e3-82bc-b1bb03628897\") " pod="keycloak-system/maas-keycloak-0" Jun 09 12:52:42.440266 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:42.440121 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cth7t\" (UniqueName: \"kubernetes.io/projected/f7262654-d8ea-46e3-82bc-b1bb03628897-kube-api-access-cth7t\") pod \"maas-keycloak-0\" (UID: \"f7262654-d8ea-46e3-82bc-b1bb03628897\") " pod="keycloak-system/maas-keycloak-0" Jun 09 12:52:42.440754 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:42.440734 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/f7262654-d8ea-46e3-82bc-b1bb03628897-test-realms\") pod \"maas-keycloak-0\" (UID: \"f7262654-d8ea-46e3-82bc-b1bb03628897\") " pod="keycloak-system/maas-keycloak-0" Jun 09 12:52:42.450287 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:42.450227 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cth7t\" (UniqueName: \"kubernetes.io/projected/f7262654-d8ea-46e3-82bc-b1bb03628897-kube-api-access-cth7t\") pod \"maas-keycloak-0\" (UID: \"f7262654-d8ea-46e3-82bc-b1bb03628897\") " pod="keycloak-system/maas-keycloak-0" Jun 09 12:52:42.577887 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:42.577854 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 09 12:52:42.716061 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:42.716036 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 12:52:43.117886 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:43.117856 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e48c2f51-b487-4c10-8ec4-d9e4f0612487" path="/var/lib/kubelet/pods/e48c2f51-b487-4c10-8ec4-d9e4f0612487/volumes" Jun 09 12:52:43.156322 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:43.156296 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-br4qj" Jun 09 12:52:43.156474 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:43.156466 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-67d7689b65-9gbs8" Jun 09 12:52:43.205768 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:43.205730 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"f7262654-d8ea-46e3-82bc-b1bb03628897","Type":"ContainerStarted","Data":"d891b5a593a798c491262ae117bde5de4ca2986c27425c04cb87eb729c00a9f9"} Jun 09 12:52:43.205984 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:43.205792 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"f7262654-d8ea-46e3-82bc-b1bb03628897","Type":"ContainerStarted","Data":"ef9e4047fba777f99a7ce6bfcd5af594e378b93351d674c34f7f71b49da83d40"} Jun 09 12:52:43.227645 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:43.227501 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=0.855351562 podStartE2EDuration="1.227477543s" totalImagesPullingTime="372.125981ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:52:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:52:43.225494905 +0000 UTC m=+692.540808919" watchObservedRunningTime="2026-06-09 12:52:43.227477543 +0000 UTC m=+692.542791535" Jun 09 12:52:43.578721 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:43.578678 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 09 12:52:43.580375 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:43.580334 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f7262654-d8ea-46e3-82bc-b1bb03628897" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jun 09 12:52:44.578782 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:44.578731 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f7262654-d8ea-46e3-82bc-b1bb03628897" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jun 09 12:52:45.578895 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:45.578836 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f7262654-d8ea-46e3-82bc-b1bb03628897" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jun 09 12:52:46.578652 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:46.578592 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f7262654-d8ea-46e3-82bc-b1bb03628897" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jun 09 12:52:47.578540 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:47.578487 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f7262654-d8ea-46e3-82bc-b1bb03628897" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jun 09 12:52:48.579503 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:48.579052 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f7262654-d8ea-46e3-82bc-b1bb03628897" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jun 09 12:52:49.578371 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:49.578298 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f7262654-d8ea-46e3-82bc-b1bb03628897" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jun 09 12:52:50.579292 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:50.579233 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f7262654-d8ea-46e3-82bc-b1bb03628897" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jun 09 12:52:51.578774 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:51.578728 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f7262654-d8ea-46e3-82bc-b1bb03628897" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jun 09 12:52:52.578207 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:52.578145 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 09 12:52:52.578707 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:52.578452 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f7262654-d8ea-46e3-82bc-b1bb03628897" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jun 09 12:52:53.578917 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:53.578869 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f7262654-d8ea-46e3-82bc-b1bb03628897" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jun 09 12:52:54.578567 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:54.578514 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f7262654-d8ea-46e3-82bc-b1bb03628897" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jun 09 12:52:55.579024 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:55.578984 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f7262654-d8ea-46e3-82bc-b1bb03628897" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Jun 09 12:52:56.686142 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:56.686106 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 09 12:52:56.703995 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:52:56.703933 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="f7262654-d8ea-46e3-82bc-b1bb03628897" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 12:53:06.692895 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:53:06.692860 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 09 12:53:17.415317 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:53:17.415286 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6d47c7f5b7-957d5"] Jun 09 12:53:17.420146 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:53:17.420128 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d47c7f5b7-957d5" Jun 09 12:53:17.422768 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:53:17.422748 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 09 12:53:17.426925 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:53:17.426898 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d47c7f5b7-957d5"] Jun 09 12:53:17.552653 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:53:17.552613 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ql77p\" (UniqueName: \"kubernetes.io/projected/dd518fb6-e1a9-41c4-92b9-e1027462e15c-kube-api-access-ql77p\") pod \"authorino-6d47c7f5b7-957d5\" (UID: \"dd518fb6-e1a9-41c4-92b9-e1027462e15c\") " pod="kuadrant-system/authorino-6d47c7f5b7-957d5" Jun 09 12:53:17.552653 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:53:17.552655 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/dd518fb6-e1a9-41c4-92b9-e1027462e15c-oidc-ca\") pod \"authorino-6d47c7f5b7-957d5\" (UID: \"dd518fb6-e1a9-41c4-92b9-e1027462e15c\") " pod="kuadrant-system/authorino-6d47c7f5b7-957d5" Jun 09 12:53:17.552938 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:53:17.552676 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dd518fb6-e1a9-41c4-92b9-e1027462e15c-tls-cert\") pod \"authorino-6d47c7f5b7-957d5\" (UID: \"dd518fb6-e1a9-41c4-92b9-e1027462e15c\") " pod="kuadrant-system/authorino-6d47c7f5b7-957d5" Jun 09 12:53:17.653248 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:53:17.653210 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ql77p\" (UniqueName: \"kubernetes.io/projected/dd518fb6-e1a9-41c4-92b9-e1027462e15c-kube-api-access-ql77p\") pod \"authorino-6d47c7f5b7-957d5\" (UID: \"dd518fb6-e1a9-41c4-92b9-e1027462e15c\") " pod="kuadrant-system/authorino-6d47c7f5b7-957d5" Jun 09 12:53:17.653248 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:53:17.653251 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/dd518fb6-e1a9-41c4-92b9-e1027462e15c-oidc-ca\") pod \"authorino-6d47c7f5b7-957d5\" (UID: \"dd518fb6-e1a9-41c4-92b9-e1027462e15c\") " pod="kuadrant-system/authorino-6d47c7f5b7-957d5" Jun 09 12:53:17.653466 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:53:17.653276 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dd518fb6-e1a9-41c4-92b9-e1027462e15c-tls-cert\") pod \"authorino-6d47c7f5b7-957d5\" (UID: \"dd518fb6-e1a9-41c4-92b9-e1027462e15c\") " pod="kuadrant-system/authorino-6d47c7f5b7-957d5" Jun 09 12:53:17.653987 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:53:17.653963 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/dd518fb6-e1a9-41c4-92b9-e1027462e15c-oidc-ca\") pod \"authorino-6d47c7f5b7-957d5\" (UID: \"dd518fb6-e1a9-41c4-92b9-e1027462e15c\") " pod="kuadrant-system/authorino-6d47c7f5b7-957d5" Jun 09 12:53:17.655760 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:53:17.655737 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dd518fb6-e1a9-41c4-92b9-e1027462e15c-tls-cert\") pod \"authorino-6d47c7f5b7-957d5\" (UID: \"dd518fb6-e1a9-41c4-92b9-e1027462e15c\") " pod="kuadrant-system/authorino-6d47c7f5b7-957d5" Jun 09 12:53:17.662734 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:53:17.662713 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ql77p\" (UniqueName: \"kubernetes.io/projected/dd518fb6-e1a9-41c4-92b9-e1027462e15c-kube-api-access-ql77p\") pod \"authorino-6d47c7f5b7-957d5\" (UID: \"dd518fb6-e1a9-41c4-92b9-e1027462e15c\") " pod="kuadrant-system/authorino-6d47c7f5b7-957d5" Jun 09 12:53:17.731718 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:53:17.731617 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d47c7f5b7-957d5" Jun 09 12:53:17.893126 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:53:17.893093 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d47c7f5b7-957d5"] Jun 09 12:53:17.895781 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:53:17.895752 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddd518fb6_e1a9_41c4_92b9_e1027462e15c.slice/crio-c3a438ae19f3310f415f6f495fc542443393f69abb7200c98e91841777c1e99c WatchSource:0}: Error finding container c3a438ae19f3310f415f6f495fc542443393f69abb7200c98e91841777c1e99c: Status 404 returned error can't find the container with id c3a438ae19f3310f415f6f495fc542443393f69abb7200c98e91841777c1e99c Jun 09 12:53:18.411201 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:53:18.411160 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6d47c7f5b7-957d5" event={"ID":"dd518fb6-e1a9-41c4-92b9-e1027462e15c","Type":"ContainerStarted","Data":"1970198a7b145fb5ef373deae6a91985931876ec0020fbd1baa85652c10c8833"} Jun 09 12:53:18.411402 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:53:18.411209 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6d47c7f5b7-957d5" event={"ID":"dd518fb6-e1a9-41c4-92b9-e1027462e15c","Type":"ContainerStarted","Data":"c3a438ae19f3310f415f6f495fc542443393f69abb7200c98e91841777c1e99c"} Jun 09 12:53:18.430679 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:53:18.430605 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6d47c7f5b7-957d5" podStartSLOduration=1.039455837 podStartE2EDuration="1.430585631s" totalImagesPullingTime="391.129794ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:53:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:53:18.428443087 +0000 UTC m=+727.743757078" watchObservedRunningTime="2026-06-09 12:53:18.430585631 +0000 UTC m=+727.745899623" Jun 09 12:53:18.459357 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:53:18.459326 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-65d76f45c9-cs9qs"] Jun 09 12:53:18.459542 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:53:18.459520 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-65d76f45c9-cs9qs" podUID="2b50ba47-f80b-4c0e-9772-5a18d686f337" containerName="authorino" containerID="cri-o://17a543541159ebdc7939f224ebc57b1eec9fadca91d8d408b4331431a7dc98f4" gracePeriod=30 Jun 09 12:53:18.735076 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:53:18.735047 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-65d76f45c9-cs9qs" Jun 09 12:53:18.863542 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:53:18.863449 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2b50ba47-f80b-4c0e-9772-5a18d686f337-tls-cert\") pod \"2b50ba47-f80b-4c0e-9772-5a18d686f337\" (UID: \"2b50ba47-f80b-4c0e-9772-5a18d686f337\") " Jun 09 12:53:18.863681 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:53:18.863575 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g94sj\" (UniqueName: \"kubernetes.io/projected/2b50ba47-f80b-4c0e-9772-5a18d686f337-kube-api-access-g94sj\") pod \"2b50ba47-f80b-4c0e-9772-5a18d686f337\" (UID: \"2b50ba47-f80b-4c0e-9772-5a18d686f337\") " Jun 09 12:53:18.865902 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:53:18.865875 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b50ba47-f80b-4c0e-9772-5a18d686f337-kube-api-access-g94sj" (OuterVolumeSpecName: "kube-api-access-g94sj") pod "2b50ba47-f80b-4c0e-9772-5a18d686f337" (UID: "2b50ba47-f80b-4c0e-9772-5a18d686f337"). InnerVolumeSpecName "kube-api-access-g94sj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:53:18.874304 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:53:18.874272 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b50ba47-f80b-4c0e-9772-5a18d686f337-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "2b50ba47-f80b-4c0e-9772-5a18d686f337" (UID: "2b50ba47-f80b-4c0e-9772-5a18d686f337"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:53:18.964476 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:53:18.964439 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g94sj\" (UniqueName: \"kubernetes.io/projected/2b50ba47-f80b-4c0e-9772-5a18d686f337-kube-api-access-g94sj\") on node \"ip-10-0-133-109.ec2.internal\" DevicePath \"\"" Jun 09 12:53:18.964476 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:53:18.964471 2561 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2b50ba47-f80b-4c0e-9772-5a18d686f337-tls-cert\") on node \"ip-10-0-133-109.ec2.internal\" DevicePath \"\"" Jun 09 12:53:19.416690 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:53:19.416594 2561 generic.go:356] "Generic (PLEG): container finished" podID="2b50ba47-f80b-4c0e-9772-5a18d686f337" containerID="17a543541159ebdc7939f224ebc57b1eec9fadca91d8d408b4331431a7dc98f4" exitCode=0 Jun 09 12:53:19.416690 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:53:19.416640 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-65d76f45c9-cs9qs" Jun 09 12:53:19.416690 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:53:19.416676 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-65d76f45c9-cs9qs" event={"ID":"2b50ba47-f80b-4c0e-9772-5a18d686f337","Type":"ContainerDied","Data":"17a543541159ebdc7939f224ebc57b1eec9fadca91d8d408b4331431a7dc98f4"} Jun 09 12:53:19.416974 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:53:19.416715 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-65d76f45c9-cs9qs" event={"ID":"2b50ba47-f80b-4c0e-9772-5a18d686f337","Type":"ContainerDied","Data":"7298db1542722a71d6e4230014ddb0d6b261713e6326e7c9415871c6411ae576"} Jun 09 12:53:19.416974 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:53:19.416734 2561 scope.go:117] "RemoveContainer" containerID="17a543541159ebdc7939f224ebc57b1eec9fadca91d8d408b4331431a7dc98f4" Jun 09 12:53:19.425138 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:53:19.425122 2561 scope.go:117] "RemoveContainer" containerID="17a543541159ebdc7939f224ebc57b1eec9fadca91d8d408b4331431a7dc98f4" Jun 09 12:53:19.425391 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:53:19.425363 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17a543541159ebdc7939f224ebc57b1eec9fadca91d8d408b4331431a7dc98f4\": container with ID starting with 17a543541159ebdc7939f224ebc57b1eec9fadca91d8d408b4331431a7dc98f4 not found: ID does not exist" containerID="17a543541159ebdc7939f224ebc57b1eec9fadca91d8d408b4331431a7dc98f4" Jun 09 12:53:19.425482 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:53:19.425396 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17a543541159ebdc7939f224ebc57b1eec9fadca91d8d408b4331431a7dc98f4"} err="failed to get container status \"17a543541159ebdc7939f224ebc57b1eec9fadca91d8d408b4331431a7dc98f4\": rpc error: code = NotFound desc = could not find container \"17a543541159ebdc7939f224ebc57b1eec9fadca91d8d408b4331431a7dc98f4\": container with ID starting with 17a543541159ebdc7939f224ebc57b1eec9fadca91d8d408b4331431a7dc98f4 not found: ID does not exist" Jun 09 12:53:19.434939 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:53:19.434917 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-65d76f45c9-cs9qs"] Jun 09 12:53:19.440311 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:53:19.440288 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-65d76f45c9-cs9qs"] Jun 09 12:53:21.115978 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:53:21.115945 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b50ba47-f80b-4c0e-9772-5a18d686f337" path="/var/lib/kubelet/pods/2b50ba47-f80b-4c0e-9772-5a18d686f337/volumes" Jun 09 12:53:36.415228 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:53:36.415196 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-mcfg6"] Jun 09 12:53:36.415618 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:53:36.415540 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b50ba47-f80b-4c0e-9772-5a18d686f337" containerName="authorino" Jun 09 12:53:36.415618 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:53:36.415552 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b50ba47-f80b-4c0e-9772-5a18d686f337" containerName="authorino" Jun 09 12:53:36.415618 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:53:36.415618 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b50ba47-f80b-4c0e-9772-5a18d686f337" containerName="authorino" Jun 09 12:53:36.418800 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:53:36.418779 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mcfg6" Jun 09 12:53:36.423093 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:53:36.423069 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 09 12:53:36.423211 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:53:36.423072 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 09 12:53:36.423273 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:53:36.423071 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-vr7pf\"" Jun 09 12:53:36.423447 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:53:36.423425 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 09 12:53:36.432204 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:53:36.432185 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-mcfg6"] Jun 09 12:53:36.511718 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:53:36.511684 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xjvh\" (UniqueName: \"kubernetes.io/projected/8927eb7c-8f83-426a-be3b-5f004e17bce4-kube-api-access-9xjvh\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-mcfg6\" (UID: \"8927eb7c-8f83-426a-be3b-5f004e17bce4\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mcfg6" Jun 09 12:53:36.511904 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:53:36.511731 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8927eb7c-8f83-426a-be3b-5f004e17bce4-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-mcfg6\" (UID: \"8927eb7c-8f83-426a-be3b-5f004e17bce4\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mcfg6" Jun 09 12:53:36.511904 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:53:36.511758 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8927eb7c-8f83-426a-be3b-5f004e17bce4-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-mcfg6\" (UID: \"8927eb7c-8f83-426a-be3b-5f004e17bce4\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mcfg6" Jun 09 12:53:36.511904 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:53:36.511781 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8927eb7c-8f83-426a-be3b-5f004e17bce4-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-mcfg6\" (UID: \"8927eb7c-8f83-426a-be3b-5f004e17bce4\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mcfg6" Jun 09 12:53:36.511904 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:53:36.511812 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8927eb7c-8f83-426a-be3b-5f004e17bce4-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-mcfg6\" (UID: \"8927eb7c-8f83-426a-be3b-5f004e17bce4\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mcfg6" Jun 09 12:53:36.511904 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:53:36.511860 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8927eb7c-8f83-426a-be3b-5f004e17bce4-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-mcfg6\" (UID: \"8927eb7c-8f83-426a-be3b-5f004e17bce4\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mcfg6" Jun 09 12:53:36.612671 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:53:36.612639 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8927eb7c-8f83-426a-be3b-5f004e17bce4-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-mcfg6\" (UID: \"8927eb7c-8f83-426a-be3b-5f004e17bce4\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mcfg6" Jun 09 12:53:36.612788 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:53:36.612683 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xjvh\" (UniqueName: \"kubernetes.io/projected/8927eb7c-8f83-426a-be3b-5f004e17bce4-kube-api-access-9xjvh\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-mcfg6\" (UID: \"8927eb7c-8f83-426a-be3b-5f004e17bce4\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mcfg6" Jun 09 12:53:36.612788 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:53:36.612718 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8927eb7c-8f83-426a-be3b-5f004e17bce4-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-mcfg6\" (UID: \"8927eb7c-8f83-426a-be3b-5f004e17bce4\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mcfg6" Jun 09 12:53:36.612908 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:53:36.612832 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8927eb7c-8f83-426a-be3b-5f004e17bce4-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-mcfg6\" (UID: \"8927eb7c-8f83-426a-be3b-5f004e17bce4\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mcfg6" Jun 09 12:53:36.612908 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:53:36.612887 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8927eb7c-8f83-426a-be3b-5f004e17bce4-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-mcfg6\" (UID: \"8927eb7c-8f83-426a-be3b-5f004e17bce4\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mcfg6" Jun 09 12:53:36.612989 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:53:36.612928 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8927eb7c-8f83-426a-be3b-5f004e17bce4-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-mcfg6\" (UID: \"8927eb7c-8f83-426a-be3b-5f004e17bce4\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mcfg6" Jun 09 12:53:36.613123 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:53:36.613104 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8927eb7c-8f83-426a-be3b-5f004e17bce4-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-mcfg6\" (UID: \"8927eb7c-8f83-426a-be3b-5f004e17bce4\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mcfg6" Jun 09 12:53:36.613286 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:53:36.613266 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8927eb7c-8f83-426a-be3b-5f004e17bce4-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-mcfg6\" (UID: \"8927eb7c-8f83-426a-be3b-5f004e17bce4\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mcfg6" Jun 09 12:53:36.613286 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:53:36.613281 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8927eb7c-8f83-426a-be3b-5f004e17bce4-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-mcfg6\" (UID: \"8927eb7c-8f83-426a-be3b-5f004e17bce4\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mcfg6" Jun 09 12:53:36.614988 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:53:36.614966 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8927eb7c-8f83-426a-be3b-5f004e17bce4-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-mcfg6\" (UID: \"8927eb7c-8f83-426a-be3b-5f004e17bce4\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mcfg6" Jun 09 12:53:36.615155 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:53:36.615138 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8927eb7c-8f83-426a-be3b-5f004e17bce4-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-mcfg6\" (UID: \"8927eb7c-8f83-426a-be3b-5f004e17bce4\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mcfg6" Jun 09 12:53:36.627055 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:53:36.627025 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xjvh\" (UniqueName: \"kubernetes.io/projected/8927eb7c-8f83-426a-be3b-5f004e17bce4-kube-api-access-9xjvh\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-mcfg6\" (UID: \"8927eb7c-8f83-426a-be3b-5f004e17bce4\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mcfg6" Jun 09 12:53:36.730066 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:53:36.730002 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mcfg6" Jun 09 12:53:36.875781 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:53:36.875750 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-mcfg6"] Jun 09 12:53:36.877312 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:53:36.877284 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8927eb7c_8f83_426a_be3b_5f004e17bce4.slice/crio-11967c2ed58bcf6fa3b21068c008f0899e03ecc23511591bebf0c758cac28dff WatchSource:0}: Error finding container 11967c2ed58bcf6fa3b21068c008f0899e03ecc23511591bebf0c758cac28dff: Status 404 returned error can't find the container with id 11967c2ed58bcf6fa3b21068c008f0899e03ecc23511591bebf0c758cac28dff Jun 09 12:53:37.506413 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:53:37.506371 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mcfg6" event={"ID":"8927eb7c-8f83-426a-be3b-5f004e17bce4","Type":"ContainerStarted","Data":"11967c2ed58bcf6fa3b21068c008f0899e03ecc23511591bebf0c758cac28dff"} Jun 09 12:53:40.525053 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:53:40.525009 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mcfg6" event={"ID":"8927eb7c-8f83-426a-be3b-5f004e17bce4","Type":"ContainerStarted","Data":"d7b372cb32641065ad8138c09cbe64165f14ccbe2ff63047b6f8715dec60c809"} Jun 09 12:53:42.535433 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:53:42.535402 2561 generic.go:356] "Generic (PLEG): container finished" podID="8927eb7c-8f83-426a-be3b-5f004e17bce4" containerID="d7b372cb32641065ad8138c09cbe64165f14ccbe2ff63047b6f8715dec60c809" exitCode=0 Jun 09 12:53:42.535909 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:53:42.535448 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mcfg6" event={"ID":"8927eb7c-8f83-426a-be3b-5f004e17bce4","Type":"ContainerDied","Data":"d7b372cb32641065ad8138c09cbe64165f14ccbe2ff63047b6f8715dec60c809"} Jun 09 12:53:44.548870 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:53:44.548832 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mcfg6" event={"ID":"8927eb7c-8f83-426a-be3b-5f004e17bce4","Type":"ContainerStarted","Data":"1e4df749afedc6ab06264948863e95834d0efe56a4b0d11064025df46a413baf"} Jun 09 12:53:44.569788 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:53:44.569740 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mcfg6" podStartSLOduration=2.337888009 podStartE2EDuration="8.569718866s" totalImagesPullingTime="4.171817318s" totalInitContainerRuntime="2.060013539s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:53:36 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:53:44.568929465 +0000 UTC m=+753.884243457" watchObservedRunningTime="2026-06-09 12:53:44.569718866 +0000 UTC m=+753.885032880" Jun 09 12:53:46.730612 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:53:46.730571 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mcfg6" Jun 09 12:53:46.731141 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:53:46.730635 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mcfg6" Jun 09 12:53:46.742973 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:53:46.742950 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mcfg6" Jun 09 12:53:47.573905 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:53:47.573877 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-mcfg6" Jun 09 12:54:20.845100 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:54:20.845020 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-5lnnl"] Jun 09 12:54:20.854604 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:54:20.854578 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5lnnl" Jun 09 12:54:20.857432 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:54:20.857416 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 09 12:54:20.862791 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:54:20.862764 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-5lnnl"] Jun 09 12:54:20.984246 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:54:20.984214 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/01c6ca55-6fb0-4450-8738-9b3e6cdb5faa-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-5lnnl\" (UID: \"01c6ca55-6fb0-4450-8738-9b3e6cdb5faa\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5lnnl" Jun 09 12:54:20.984397 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:54:20.984285 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdw59\" (UniqueName: \"kubernetes.io/projected/01c6ca55-6fb0-4450-8738-9b3e6cdb5faa-kube-api-access-wdw59\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-5lnnl\" (UID: \"01c6ca55-6fb0-4450-8738-9b3e6cdb5faa\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5lnnl" Jun 09 12:54:20.984397 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:54:20.984335 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/01c6ca55-6fb0-4450-8738-9b3e6cdb5faa-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-5lnnl\" (UID: \"01c6ca55-6fb0-4450-8738-9b3e6cdb5faa\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5lnnl" Jun 09 12:54:20.984397 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:54:20.984365 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/01c6ca55-6fb0-4450-8738-9b3e6cdb5faa-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-5lnnl\" (UID: \"01c6ca55-6fb0-4450-8738-9b3e6cdb5faa\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5lnnl" Jun 09 12:54:20.984503 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:54:20.984411 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/01c6ca55-6fb0-4450-8738-9b3e6cdb5faa-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-5lnnl\" (UID: \"01c6ca55-6fb0-4450-8738-9b3e6cdb5faa\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5lnnl" Jun 09 12:54:20.984503 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:54:20.984441 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/01c6ca55-6fb0-4450-8738-9b3e6cdb5faa-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-5lnnl\" (UID: \"01c6ca55-6fb0-4450-8738-9b3e6cdb5faa\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5lnnl" Jun 09 12:54:21.085408 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:54:21.085375 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdw59\" (UniqueName: \"kubernetes.io/projected/01c6ca55-6fb0-4450-8738-9b3e6cdb5faa-kube-api-access-wdw59\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-5lnnl\" (UID: \"01c6ca55-6fb0-4450-8738-9b3e6cdb5faa\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5lnnl" Jun 09 12:54:21.085544 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:54:21.085423 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/01c6ca55-6fb0-4450-8738-9b3e6cdb5faa-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-5lnnl\" (UID: \"01c6ca55-6fb0-4450-8738-9b3e6cdb5faa\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5lnnl" Jun 09 12:54:21.085544 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:54:21.085449 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/01c6ca55-6fb0-4450-8738-9b3e6cdb5faa-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-5lnnl\" (UID: \"01c6ca55-6fb0-4450-8738-9b3e6cdb5faa\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5lnnl" Jun 09 12:54:21.085544 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:54:21.085478 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/01c6ca55-6fb0-4450-8738-9b3e6cdb5faa-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-5lnnl\" (UID: \"01c6ca55-6fb0-4450-8738-9b3e6cdb5faa\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5lnnl" Jun 09 12:54:21.085544 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:54:21.085507 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/01c6ca55-6fb0-4450-8738-9b3e6cdb5faa-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-5lnnl\" (UID: \"01c6ca55-6fb0-4450-8738-9b3e6cdb5faa\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5lnnl" Jun 09 12:54:21.085544 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:54:21.085534 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/01c6ca55-6fb0-4450-8738-9b3e6cdb5faa-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-5lnnl\" (UID: \"01c6ca55-6fb0-4450-8738-9b3e6cdb5faa\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5lnnl" Jun 09 12:54:21.085890 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:54:21.085865 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/01c6ca55-6fb0-4450-8738-9b3e6cdb5faa-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-5lnnl\" (UID: \"01c6ca55-6fb0-4450-8738-9b3e6cdb5faa\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5lnnl" Jun 09 12:54:21.085973 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:54:21.085894 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/01c6ca55-6fb0-4450-8738-9b3e6cdb5faa-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-5lnnl\" (UID: \"01c6ca55-6fb0-4450-8738-9b3e6cdb5faa\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5lnnl" Jun 09 12:54:21.085973 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:54:21.085929 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/01c6ca55-6fb0-4450-8738-9b3e6cdb5faa-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-5lnnl\" (UID: \"01c6ca55-6fb0-4450-8738-9b3e6cdb5faa\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5lnnl" Jun 09 12:54:21.087757 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:54:21.087734 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/01c6ca55-6fb0-4450-8738-9b3e6cdb5faa-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-5lnnl\" (UID: \"01c6ca55-6fb0-4450-8738-9b3e6cdb5faa\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5lnnl" Jun 09 12:54:21.088025 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:54:21.088008 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/01c6ca55-6fb0-4450-8738-9b3e6cdb5faa-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-5lnnl\" (UID: \"01c6ca55-6fb0-4450-8738-9b3e6cdb5faa\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5lnnl" Jun 09 12:54:21.096501 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:54:21.096450 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdw59\" (UniqueName: \"kubernetes.io/projected/01c6ca55-6fb0-4450-8738-9b3e6cdb5faa-kube-api-access-wdw59\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-5lnnl\" (UID: \"01c6ca55-6fb0-4450-8738-9b3e6cdb5faa\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5lnnl" Jun 09 12:54:21.167379 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:54:21.167353 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5lnnl" Jun 09 12:54:21.312654 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:54:21.312625 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-5lnnl"] Jun 09 12:54:21.315065 ip-10-0-133-109 kubenswrapper[2561]: W0609 12:54:21.315041 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01c6ca55_6fb0_4450_8738_9b3e6cdb5faa.slice/crio-6bc328542718de3cd54eac6c5cb432fc2d877ba2de26238d094d6de3b06c34f4 WatchSource:0}: Error finding container 6bc328542718de3cd54eac6c5cb432fc2d877ba2de26238d094d6de3b06c34f4: Status 404 returned error can't find the container with id 6bc328542718de3cd54eac6c5cb432fc2d877ba2de26238d094d6de3b06c34f4 Jun 09 12:54:21.742271 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:54:21.742173 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5lnnl" event={"ID":"01c6ca55-6fb0-4450-8738-9b3e6cdb5faa","Type":"ContainerStarted","Data":"16fa2fbdf88f1932443bcc588ceea0b4296e5fe2988366e4c178a743a67dfd33"} Jun 09 12:54:21.742271 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:54:21.742233 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5lnnl" event={"ID":"01c6ca55-6fb0-4450-8738-9b3e6cdb5faa","Type":"ContainerStarted","Data":"6bc328542718de3cd54eac6c5cb432fc2d877ba2de26238d094d6de3b06c34f4"} Jun 09 12:54:23.752546 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:54:23.752510 2561 generic.go:356] "Generic (PLEG): container finished" podID="01c6ca55-6fb0-4450-8738-9b3e6cdb5faa" containerID="16fa2fbdf88f1932443bcc588ceea0b4296e5fe2988366e4c178a743a67dfd33" exitCode=0 Jun 09 12:54:23.752955 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:54:23.752576 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5lnnl" event={"ID":"01c6ca55-6fb0-4450-8738-9b3e6cdb5faa","Type":"ContainerDied","Data":"16fa2fbdf88f1932443bcc588ceea0b4296e5fe2988366e4c178a743a67dfd33"} Jun 09 12:54:24.759027 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:54:24.758988 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5lnnl" event={"ID":"01c6ca55-6fb0-4450-8738-9b3e6cdb5faa","Type":"ContainerStarted","Data":"da2ebeeff5d929d57d349419f35bed4fea6b21a923bca6896feb556362f605e3"} Jun 09 12:54:24.780625 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:54:24.780578 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5lnnl" podStartSLOduration=2.954142428 podStartE2EDuration="4.78056339s" totalImagesPullingTime="236.313425ms" totalInitContainerRuntime="1.590107537s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:54:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:54:24.778306695 +0000 UTC m=+794.093620687" watchObservedRunningTime="2026-06-09 12:54:24.78056339 +0000 UTC m=+794.095877410" Jun 09 12:54:31.167502 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:54:31.167464 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5lnnl" Jun 09 12:54:31.167960 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:54:31.167530 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5lnnl" Jun 09 12:54:31.179941 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:54:31.179915 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5lnnl" Jun 09 12:54:31.793931 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:54:31.793897 2561 generic.go:356] "Generic (PLEG): container finished" podID="dad2bf8a-21ae-472c-a9c3-ac81aa411894" containerID="c4c0921570fdd434c9544646e6e13f798f8672f705a65a81cf5992c3b1bc37b4" exitCode=1 Jun 09 12:54:31.794126 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:54:31.793968 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-br4qj" event={"ID":"dad2bf8a-21ae-472c-a9c3-ac81aa411894","Type":"ContainerDied","Data":"c4c0921570fdd434c9544646e6e13f798f8672f705a65a81cf5992c3b1bc37b4"} Jun 09 12:54:31.794547 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:54:31.794521 2561 scope.go:117] "RemoveContainer" containerID="c4c0921570fdd434c9544646e6e13f798f8672f705a65a81cf5992c3b1bc37b4" Jun 09 12:54:31.806193 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:54:31.806173 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-5lnnl" Jun 09 12:54:32.800456 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:54:32.800425 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-br4qj" event={"ID":"dad2bf8a-21ae-472c-a9c3-ac81aa411894","Type":"ContainerStarted","Data":"e2c091190cc886bf47159201b02607d11fee851d4cac8fde8860f7475f41fa4f"} Jun 09 12:54:32.800855 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:54:32.800783 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-br4qj" Jun 09 12:54:43.807873 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:54:43.807809 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-br4qj" Jun 09 12:56:11.116111 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:56:11.116083 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-4l59j_dd28dc2d-f1bc-4022-ad12-dac9c5f8331a/console-operator/1.log" Jun 09 12:56:11.117402 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:56:11.117378 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-4l59j_dd28dc2d-f1bc-4022-ad12-dac9c5f8331a/console-operator/1.log" Jun 09 12:56:32.372270 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:56:32.372236 2561 generic.go:356] "Generic (PLEG): container finished" podID="dad2bf8a-21ae-472c-a9c3-ac81aa411894" containerID="e2c091190cc886bf47159201b02607d11fee851d4cac8fde8860f7475f41fa4f" exitCode=1 Jun 09 12:56:32.372724 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:56:32.372312 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-br4qj" event={"ID":"dad2bf8a-21ae-472c-a9c3-ac81aa411894","Type":"ContainerDied","Data":"e2c091190cc886bf47159201b02607d11fee851d4cac8fde8860f7475f41fa4f"} Jun 09 12:56:32.372724 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:56:32.372374 2561 scope.go:117] "RemoveContainer" containerID="c4c0921570fdd434c9544646e6e13f798f8672f705a65a81cf5992c3b1bc37b4" Jun 09 12:56:32.372724 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:56:32.372643 2561 scope.go:117] "RemoveContainer" containerID="e2c091190cc886bf47159201b02607d11fee851d4cac8fde8860f7475f41fa4f" Jun 09 12:56:32.372917 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:56:32.372897 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 10s restarting failed container=payload-processing pod=payload-processing-7c6c859784-br4qj_openshift-ingress(dad2bf8a-21ae-472c-a9c3-ac81aa411894)\"" pod="openshift-ingress/payload-processing-7c6c859784-br4qj" podUID="dad2bf8a-21ae-472c-a9c3-ac81aa411894" Jun 09 12:56:33.806426 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:56:33.806391 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-br4qj" Jun 09 12:56:33.806811 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:56:33.806715 2561 scope.go:117] "RemoveContainer" containerID="e2c091190cc886bf47159201b02607d11fee851d4cac8fde8860f7475f41fa4f" Jun 09 12:56:33.806953 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:56:33.806933 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 10s restarting failed container=payload-processing pod=payload-processing-7c6c859784-br4qj_openshift-ingress(dad2bf8a-21ae-472c-a9c3-ac81aa411894)\"" pod="openshift-ingress/payload-processing-7c6c859784-br4qj" podUID="dad2bf8a-21ae-472c-a9c3-ac81aa411894" Jun 09 12:56:47.111159 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:56:47.111127 2561 scope.go:117] "RemoveContainer" containerID="e2c091190cc886bf47159201b02607d11fee851d4cac8fde8860f7475f41fa4f" Jun 09 12:56:47.447362 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:56:47.447283 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-br4qj" event={"ID":"dad2bf8a-21ae-472c-a9c3-ac81aa411894","Type":"ContainerStarted","Data":"ebe132793af2fe7be30b5afe450822da338c003fabbf3080f69ba9b42acf1f47"} Jun 09 12:56:47.447516 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:56:47.447485 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-br4qj" Jun 09 12:56:58.454250 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:56:58.454217 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-br4qj" Jun 09 12:58:48.022491 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:58:48.022438 2561 generic.go:356] "Generic (PLEG): container finished" podID="dad2bf8a-21ae-472c-a9c3-ac81aa411894" containerID="ebe132793af2fe7be30b5afe450822da338c003fabbf3080f69ba9b42acf1f47" exitCode=1 Jun 09 12:58:48.022959 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:58:48.022509 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-br4qj" event={"ID":"dad2bf8a-21ae-472c-a9c3-ac81aa411894","Type":"ContainerDied","Data":"ebe132793af2fe7be30b5afe450822da338c003fabbf3080f69ba9b42acf1f47"} Jun 09 12:58:48.022959 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:58:48.022569 2561 scope.go:117] "RemoveContainer" containerID="e2c091190cc886bf47159201b02607d11fee851d4cac8fde8860f7475f41fa4f" Jun 09 12:58:48.022959 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:58:48.022804 2561 scope.go:117] "RemoveContainer" containerID="ebe132793af2fe7be30b5afe450822da338c003fabbf3080f69ba9b42acf1f47" Jun 09 12:58:48.023112 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:58:48.023070 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-br4qj_openshift-ingress(dad2bf8a-21ae-472c-a9c3-ac81aa411894)\"" pod="openshift-ingress/payload-processing-7c6c859784-br4qj" podUID="dad2bf8a-21ae-472c-a9c3-ac81aa411894" Jun 09 12:58:48.452632 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:58:48.452549 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-br4qj" Jun 09 12:58:49.029364 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:58:49.029335 2561 scope.go:117] "RemoveContainer" containerID="ebe132793af2fe7be30b5afe450822da338c003fabbf3080f69ba9b42acf1f47" Jun 09 12:58:49.029747 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:58:49.029548 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-br4qj_openshift-ingress(dad2bf8a-21ae-472c-a9c3-ac81aa411894)\"" pod="openshift-ingress/payload-processing-7c6c859784-br4qj" podUID="dad2bf8a-21ae-472c-a9c3-ac81aa411894" Jun 09 12:58:49.803634 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:58:49.803589 2561 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-ingress/payload-processing-7c6c859784-br4qj" Jun 09 12:58:50.033914 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:58:50.033889 2561 scope.go:117] "RemoveContainer" containerID="ebe132793af2fe7be30b5afe450822da338c003fabbf3080f69ba9b42acf1f47" Jun 09 12:58:50.034267 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:58:50.034092 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-br4qj_openshift-ingress(dad2bf8a-21ae-472c-a9c3-ac81aa411894)\"" pod="openshift-ingress/payload-processing-7c6c859784-br4qj" podUID="dad2bf8a-21ae-472c-a9c3-ac81aa411894" Jun 09 12:59:02.111182 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:59:02.111146 2561 scope.go:117] "RemoveContainer" containerID="ebe132793af2fe7be30b5afe450822da338c003fabbf3080f69ba9b42acf1f47" Jun 09 12:59:02.111565 ip-10-0-133-109 kubenswrapper[2561]: E0609 12:59:02.111302 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-br4qj_openshift-ingress(dad2bf8a-21ae-472c-a9c3-ac81aa411894)\"" pod="openshift-ingress/payload-processing-7c6c859784-br4qj" podUID="dad2bf8a-21ae-472c-a9c3-ac81aa411894" Jun 09 12:59:17.110970 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:59:17.110938 2561 scope.go:117] "RemoveContainer" containerID="ebe132793af2fe7be30b5afe450822da338c003fabbf3080f69ba9b42acf1f47" Jun 09 12:59:18.166086 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:59:18.166049 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-br4qj" event={"ID":"dad2bf8a-21ae-472c-a9c3-ac81aa411894","Type":"ContainerStarted","Data":"fa58c5e4a6d91496b1af81921818b152e4233be946c879722990c464738ca963"} Jun 09 12:59:18.166693 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:59:18.166287 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-br4qj" Jun 09 12:59:29.173977 ip-10-0-133-109 kubenswrapper[2561]: I0609 12:59:29.173943 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-br4qj" Jun 09 13:00:11.576151 ip-10-0-133-109 kubenswrapper[2561]: I0609 13:00:11.576118 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6d47c7f5b7-957d5_dd518fb6-e1a9-41c4-92b9-e1027462e15c/authorino/0.log" Jun 09 13:00:17.025103 ip-10-0-133-109 kubenswrapper[2561]: I0609 13:00:17.025069 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-9d86f989b-284dg_6f866da7-61fc-4ac2-ae1b-333d014333e7/manager/0.log" Jun 09 13:00:17.154164 ip-10-0-133-109 kubenswrapper[2561]: I0609 13:00:17.154136 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-s994m_6033cd00-5b99-4759-97ae-1c3f6c33fc38/server/0.log" Jun 09 13:00:17.318975 ip-10-0-133-109 kubenswrapper[2561]: I0609 13:00:17.318902 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-ws6pr_876c63fa-e43e-490c-8381-3a7fc638aeb8/manager/0.log" Jun 09 13:00:17.477306 ip-10-0-133-109 kubenswrapper[2561]: I0609 13:00:17.477279 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-54544cfb76-gcz6q_7fb4d750-fa0f-4726-a767-4d0a91a9d1bc/copy-manifests/0.log" Jun 09 13:00:17.487994 ip-10-0-133-109 kubenswrapper[2561]: I0609 13:00:17.487972 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-54544cfb76-gcz6q_7fb4d750-fa0f-4726-a767-4d0a91a9d1bc/manager/0.log" Jun 09 13:00:19.142060 ip-10-0-133-109 kubenswrapper[2561]: I0609 13:00:19.142030 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6d47c7f5b7-957d5_dd518fb6-e1a9-41c4-92b9-e1027462e15c/authorino/0.log" Jun 09 13:00:19.519703 ip-10-0-133-109 kubenswrapper[2561]: I0609 13:00:19.519677 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-2hd5s_5383360b-f912-4473-922a-a86e47539de2/kuadrant-console-plugin/0.log" Jun 09 13:00:20.670891 ip-10-0-133-109 kubenswrapper[2561]: I0609 13:00:20.670800 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7ccb5f5468-5jb27_3fa7cec0-6cd6-4213-af15-c78a75df5c69/kube-auth-proxy/0.log" Jun 09 13:00:21.029157 ip-10-0-133-109 kubenswrapper[2561]: I0609 13:00:21.029127 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-9gbs8_9abd9098-8799-406c-9e8d-7b2025b4d568/payload-pre-processing/0.log" Jun 09 13:00:21.148749 ip-10-0-133-109 kubenswrapper[2561]: I0609 13:00:21.148717 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-br4qj_dad2bf8a-21ae-472c-a9c3-ac81aa411894/payload-processing/3.log" Jun 09 13:00:21.755943 ip-10-0-133-109 kubenswrapper[2561]: I0609 13:00:21.755915 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-mcfg6_8927eb7c-8f83-426a-be3b-5f004e17bce4/storage-initializer/0.log" Jun 09 13:00:21.764033 ip-10-0-133-109 kubenswrapper[2561]: I0609 13:00:21.764010 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-mcfg6_8927eb7c-8f83-426a-be3b-5f004e17bce4/main/0.log" Jun 09 13:00:22.139784 ip-10-0-133-109 kubenswrapper[2561]: I0609 13:00:22.139707 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-5lnnl_01c6ca55-6fb0-4450-8738-9b3e6cdb5faa/main/0.log" Jun 09 13:00:22.148548 ip-10-0-133-109 kubenswrapper[2561]: I0609 13:00:22.148520 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-5lnnl_01c6ca55-6fb0-4450-8738-9b3e6cdb5faa/storage-initializer/0.log" Jun 09 13:00:29.889543 ip-10-0-133-109 kubenswrapper[2561]: I0609 13:00:29.889512 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-br4cc_3a86fe59-f4c8-4c09-9f19-6fada48b8194/global-pull-secret-syncer/0.log" Jun 09 13:00:30.068938 ip-10-0-133-109 kubenswrapper[2561]: I0609 13:00:30.068902 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-kj5x2_98f6370c-d970-420a-afcc-7abb56d7c44e/konnectivity-agent/0.log" Jun 09 13:00:30.140610 ip-10-0-133-109 kubenswrapper[2561]: I0609 13:00:30.140540 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-109.ec2.internal_627b185f30291ffb2e9813e90451a240/haproxy/0.log" Jun 09 13:00:35.029974 ip-10-0-133-109 kubenswrapper[2561]: I0609 13:00:35.029941 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6d47c7f5b7-957d5_dd518fb6-e1a9-41c4-92b9-e1027462e15c/authorino/0.log" Jun 09 13:00:35.143753 ip-10-0-133-109 kubenswrapper[2561]: I0609 13:00:35.143722 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-2hd5s_5383360b-f912-4473-922a-a86e47539de2/kuadrant-console-plugin/0.log" Jun 09 13:00:37.516960 ip-10-0-133-109 kubenswrapper[2561]: I0609 13:00:37.516931 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-f99848b47-2wb6x_41c4d350-f346-42f1-9e2e-476cd5df642a/metrics-server/0.log" Jun 09 13:00:37.554848 ip-10-0-133-109 kubenswrapper[2561]: I0609 13:00:37.554806 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-ssk65_7c8a4b35-9ec3-4d26-8688-a3bebf6e81f9/monitoring-plugin/0.log" Jun 09 13:00:37.626020 ip-10-0-133-109 kubenswrapper[2561]: I0609 13:00:37.625995 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-94cw9_10f4b942-8b8c-4493-9672-e53dd719456e/node-exporter/0.log" Jun 09 13:00:37.654604 ip-10-0-133-109 kubenswrapper[2561]: I0609 13:00:37.654573 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-94cw9_10f4b942-8b8c-4493-9672-e53dd719456e/kube-rbac-proxy/0.log" Jun 09 13:00:37.679911 ip-10-0-133-109 kubenswrapper[2561]: I0609 13:00:37.679889 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-94cw9_10f4b942-8b8c-4493-9672-e53dd719456e/init-textfile/0.log" Jun 09 13:00:40.355555 ip-10-0-133-109 kubenswrapper[2561]: I0609 13:00:40.355514 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-m6d7h/perf-node-gather-daemonset-5pjcv"] Jun 09 13:00:40.358905 ip-10-0-133-109 kubenswrapper[2561]: I0609 13:00:40.358884 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-m6d7h/perf-node-gather-daemonset-5pjcv" Jun 09 13:00:40.362171 ip-10-0-133-109 kubenswrapper[2561]: I0609 13:00:40.362145 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-m6d7h\"/\"default-dockercfg-9hjpv\"" Jun 09 13:00:40.363171 ip-10-0-133-109 kubenswrapper[2561]: I0609 13:00:40.363152 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-m6d7h\"/\"openshift-service-ca.crt\"" Jun 09 13:00:40.363294 ip-10-0-133-109 kubenswrapper[2561]: I0609 13:00:40.363189 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-m6d7h\"/\"kube-root-ca.crt\"" Jun 09 13:00:40.367560 ip-10-0-133-109 kubenswrapper[2561]: I0609 13:00:40.367535 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-m6d7h/perf-node-gather-daemonset-5pjcv"] Jun 09 13:00:40.535744 ip-10-0-133-109 kubenswrapper[2561]: I0609 13:00:40.535711 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/38971407-0446-445f-8022-e2482b2eb443-proc\") pod \"perf-node-gather-daemonset-5pjcv\" (UID: \"38971407-0446-445f-8022-e2482b2eb443\") " pod="openshift-must-gather-m6d7h/perf-node-gather-daemonset-5pjcv" Jun 09 13:00:40.535744 ip-10-0-133-109 kubenswrapper[2561]: I0609 13:00:40.535747 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/38971407-0446-445f-8022-e2482b2eb443-sys\") pod \"perf-node-gather-daemonset-5pjcv\" (UID: \"38971407-0446-445f-8022-e2482b2eb443\") " pod="openshift-must-gather-m6d7h/perf-node-gather-daemonset-5pjcv" Jun 09 13:00:40.536014 ip-10-0-133-109 kubenswrapper[2561]: I0609 13:00:40.535871 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/38971407-0446-445f-8022-e2482b2eb443-lib-modules\") pod \"perf-node-gather-daemonset-5pjcv\" (UID: \"38971407-0446-445f-8022-e2482b2eb443\") " pod="openshift-must-gather-m6d7h/perf-node-gather-daemonset-5pjcv" Jun 09 13:00:40.536014 ip-10-0-133-109 kubenswrapper[2561]: I0609 13:00:40.535926 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/38971407-0446-445f-8022-e2482b2eb443-podres\") pod \"perf-node-gather-daemonset-5pjcv\" (UID: \"38971407-0446-445f-8022-e2482b2eb443\") " pod="openshift-must-gather-m6d7h/perf-node-gather-daemonset-5pjcv" Jun 09 13:00:40.536014 ip-10-0-133-109 kubenswrapper[2561]: I0609 13:00:40.535972 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zswk8\" (UniqueName: \"kubernetes.io/projected/38971407-0446-445f-8022-e2482b2eb443-kube-api-access-zswk8\") pod \"perf-node-gather-daemonset-5pjcv\" (UID: \"38971407-0446-445f-8022-e2482b2eb443\") " pod="openshift-must-gather-m6d7h/perf-node-gather-daemonset-5pjcv" Jun 09 13:00:40.637425 ip-10-0-133-109 kubenswrapper[2561]: I0609 13:00:40.637324 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/38971407-0446-445f-8022-e2482b2eb443-proc\") pod \"perf-node-gather-daemonset-5pjcv\" (UID: \"38971407-0446-445f-8022-e2482b2eb443\") " pod="openshift-must-gather-m6d7h/perf-node-gather-daemonset-5pjcv" Jun 09 13:00:40.637425 ip-10-0-133-109 kubenswrapper[2561]: I0609 13:00:40.637375 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/38971407-0446-445f-8022-e2482b2eb443-sys\") pod \"perf-node-gather-daemonset-5pjcv\" (UID: \"38971407-0446-445f-8022-e2482b2eb443\") " pod="openshift-must-gather-m6d7h/perf-node-gather-daemonset-5pjcv" Jun 09 13:00:40.637645 ip-10-0-133-109 kubenswrapper[2561]: I0609 13:00:40.637441 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/38971407-0446-445f-8022-e2482b2eb443-lib-modules\") pod \"perf-node-gather-daemonset-5pjcv\" (UID: \"38971407-0446-445f-8022-e2482b2eb443\") " pod="openshift-must-gather-m6d7h/perf-node-gather-daemonset-5pjcv" Jun 09 13:00:40.637645 ip-10-0-133-109 kubenswrapper[2561]: I0609 13:00:40.637457 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/38971407-0446-445f-8022-e2482b2eb443-proc\") pod \"perf-node-gather-daemonset-5pjcv\" (UID: \"38971407-0446-445f-8022-e2482b2eb443\") " pod="openshift-must-gather-m6d7h/perf-node-gather-daemonset-5pjcv" Jun 09 13:00:40.637645 ip-10-0-133-109 kubenswrapper[2561]: I0609 13:00:40.637483 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/38971407-0446-445f-8022-e2482b2eb443-podres\") pod \"perf-node-gather-daemonset-5pjcv\" (UID: \"38971407-0446-445f-8022-e2482b2eb443\") " pod="openshift-must-gather-m6d7h/perf-node-gather-daemonset-5pjcv" Jun 09 13:00:40.637645 ip-10-0-133-109 kubenswrapper[2561]: I0609 13:00:40.637519 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zswk8\" (UniqueName: \"kubernetes.io/projected/38971407-0446-445f-8022-e2482b2eb443-kube-api-access-zswk8\") pod \"perf-node-gather-daemonset-5pjcv\" (UID: \"38971407-0446-445f-8022-e2482b2eb443\") " pod="openshift-must-gather-m6d7h/perf-node-gather-daemonset-5pjcv" Jun 09 13:00:40.637645 ip-10-0-133-109 kubenswrapper[2561]: I0609 13:00:40.637518 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/38971407-0446-445f-8022-e2482b2eb443-sys\") pod \"perf-node-gather-daemonset-5pjcv\" (UID: \"38971407-0446-445f-8022-e2482b2eb443\") " pod="openshift-must-gather-m6d7h/perf-node-gather-daemonset-5pjcv" Jun 09 13:00:40.637645 ip-10-0-133-109 kubenswrapper[2561]: I0609 13:00:40.637573 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/38971407-0446-445f-8022-e2482b2eb443-lib-modules\") pod \"perf-node-gather-daemonset-5pjcv\" (UID: \"38971407-0446-445f-8022-e2482b2eb443\") " pod="openshift-must-gather-m6d7h/perf-node-gather-daemonset-5pjcv" Jun 09 13:00:40.637645 ip-10-0-133-109 kubenswrapper[2561]: I0609 13:00:40.637610 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/38971407-0446-445f-8022-e2482b2eb443-podres\") pod \"perf-node-gather-daemonset-5pjcv\" (UID: \"38971407-0446-445f-8022-e2482b2eb443\") " pod="openshift-must-gather-m6d7h/perf-node-gather-daemonset-5pjcv" Jun 09 13:00:40.651342 ip-10-0-133-109 kubenswrapper[2561]: I0609 13:00:40.651323 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zswk8\" (UniqueName: \"kubernetes.io/projected/38971407-0446-445f-8022-e2482b2eb443-kube-api-access-zswk8\") pod \"perf-node-gather-daemonset-5pjcv\" (UID: \"38971407-0446-445f-8022-e2482b2eb443\") " pod="openshift-must-gather-m6d7h/perf-node-gather-daemonset-5pjcv" Jun 09 13:00:40.655633 ip-10-0-133-109 kubenswrapper[2561]: I0609 13:00:40.655613 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-4l59j_dd28dc2d-f1bc-4022-ad12-dac9c5f8331a/console-operator/1.log" Jun 09 13:00:40.661468 ip-10-0-133-109 kubenswrapper[2561]: I0609 13:00:40.661444 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-4l59j_dd28dc2d-f1bc-4022-ad12-dac9c5f8331a/console-operator/2.log" Jun 09 13:00:40.669713 ip-10-0-133-109 kubenswrapper[2561]: I0609 13:00:40.669697 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-m6d7h/perf-node-gather-daemonset-5pjcv" Jun 09 13:00:40.807796 ip-10-0-133-109 kubenswrapper[2561]: I0609 13:00:40.807771 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-m6d7h/perf-node-gather-daemonset-5pjcv"] Jun 09 13:00:40.809870 ip-10-0-133-109 kubenswrapper[2561]: W0609 13:00:40.809840 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod38971407_0446_445f_8022_e2482b2eb443.slice/crio-4d9880b9ab0d40c771dd294d465aa54025a6bbdfd88f9df526841cf18995572f WatchSource:0}: Error finding container 4d9880b9ab0d40c771dd294d465aa54025a6bbdfd88f9df526841cf18995572f: Status 404 returned error can't find the container with id 4d9880b9ab0d40c771dd294d465aa54025a6bbdfd88f9df526841cf18995572f Jun 09 13:00:41.563382 ip-10-0-133-109 kubenswrapper[2561]: I0609 13:00:41.563338 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-m6d7h/perf-node-gather-daemonset-5pjcv" event={"ID":"38971407-0446-445f-8022-e2482b2eb443","Type":"ContainerStarted","Data":"13576c683b3b31bfaaa11f5ac187a071898c07593862466acfeebe7524dd6c44"} Jun 09 13:00:41.563810 ip-10-0-133-109 kubenswrapper[2561]: I0609 13:00:41.563399 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-m6d7h/perf-node-gather-daemonset-5pjcv" Jun 09 13:00:41.563810 ip-10-0-133-109 kubenswrapper[2561]: I0609 13:00:41.563416 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-m6d7h/perf-node-gather-daemonset-5pjcv" event={"ID":"38971407-0446-445f-8022-e2482b2eb443","Type":"ContainerStarted","Data":"4d9880b9ab0d40c771dd294d465aa54025a6bbdfd88f9df526841cf18995572f"} Jun 09 13:00:41.584274 ip-10-0-133-109 kubenswrapper[2561]: I0609 13:00:41.584227 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-m6d7h/perf-node-gather-daemonset-5pjcv" podStartSLOduration=1.584213133 podStartE2EDuration="1.584213133s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 13:00:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:00:41.582941481 +0000 UTC m=+1170.898255472" watchObservedRunningTime="2026-06-09 13:00:41.584213133 +0000 UTC m=+1170.899527124" Jun 09 13:00:42.045635 ip-10-0-133-109 kubenswrapper[2561]: I0609 13:00:42.045607 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78dd696465-cscvd_e9a5c713-1ee4-4293-8b96-29d43eac55f4/volume-data-source-validator/0.log" Jun 09 13:00:43.323488 ip-10-0-133-109 kubenswrapper[2561]: I0609 13:00:43.323456 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gd65w_31987512-1565-4167-b4e7-1e9414500b94/dns/0.log" Jun 09 13:00:43.357509 ip-10-0-133-109 kubenswrapper[2561]: I0609 13:00:43.357485 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gd65w_31987512-1565-4167-b4e7-1e9414500b94/kube-rbac-proxy/0.log" Jun 09 13:00:43.471712 ip-10-0-133-109 kubenswrapper[2561]: I0609 13:00:43.471685 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xlxkq_00dcaa51-80f6-4fcd-9eb0-8c27466112df/dns-node-resolver/0.log" Jun 09 13:00:44.142025 ip-10-0-133-109 kubenswrapper[2561]: I0609 13:00:44.141998 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4n62g_a8b7f08f-8ac0-4cc8-b9c3-9dc0451f79c8/node-ca/0.log" Jun 09 13:00:45.343290 ip-10-0-133-109 kubenswrapper[2561]: I0609 13:00:45.343262 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7ccb5f5468-5jb27_3fa7cec0-6cd6-4213-af15-c78a75df5c69/kube-auth-proxy/0.log" Jun 09 13:00:45.441747 ip-10-0-133-109 kubenswrapper[2561]: I0609 13:00:45.441719 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-9gbs8_9abd9098-8799-406c-9e8d-7b2025b4d568/payload-pre-processing/0.log" Jun 09 13:00:45.475977 ip-10-0-133-109 kubenswrapper[2561]: I0609 13:00:45.475952 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-br4qj_dad2bf8a-21ae-472c-a9c3-ac81aa411894/payload-processing/3.log" Jun 09 13:00:45.476636 ip-10-0-133-109 kubenswrapper[2561]: I0609 13:00:45.476616 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-br4qj_dad2bf8a-21ae-472c-a9c3-ac81aa411894/payload-processing/2.log" Jun 09 13:00:46.264253 ip-10-0-133-109 kubenswrapper[2561]: I0609 13:00:46.264223 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gckgj_3d830b16-2fa4-4b5d-b5e5-0fbc3a4261d3/serve-healthcheck-canary/0.log" Jun 09 13:00:46.877157 ip-10-0-133-109 kubenswrapper[2561]: I0609 13:00:46.877128 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6jjvh_77ab0a9c-26cc-43a9-b90e-456ce12d2396/kube-rbac-proxy/0.log" Jun 09 13:00:46.903153 ip-10-0-133-109 kubenswrapper[2561]: I0609 13:00:46.903122 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6jjvh_77ab0a9c-26cc-43a9-b90e-456ce12d2396/exporter/0.log" Jun 09 13:00:46.928518 ip-10-0-133-109 kubenswrapper[2561]: I0609 13:00:46.928496 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6jjvh_77ab0a9c-26cc-43a9-b90e-456ce12d2396/extractor/0.log" Jun 09 13:00:47.578523 ip-10-0-133-109 kubenswrapper[2561]: I0609 13:00:47.578496 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-m6d7h/perf-node-gather-daemonset-5pjcv" Jun 09 13:00:49.851673 ip-10-0-133-109 kubenswrapper[2561]: I0609 13:00:49.851627 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-9d86f989b-284dg_6f866da7-61fc-4ac2-ae1b-333d014333e7/manager/0.log" Jun 09 13:00:49.875612 ip-10-0-133-109 kubenswrapper[2561]: I0609 13:00:49.875593 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-s994m_6033cd00-5b99-4759-97ae-1c3f6c33fc38/server/0.log" Jun 09 13:00:49.928101 ip-10-0-133-109 kubenswrapper[2561]: I0609 13:00:49.928062 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-ws6pr_876c63fa-e43e-490c-8381-3a7fc638aeb8/manager/0.log" Jun 09 13:00:49.953323 ip-10-0-133-109 kubenswrapper[2561]: I0609 13:00:49.953297 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-54544cfb76-gcz6q_7fb4d750-fa0f-4726-a767-4d0a91a9d1bc/manager/0.log" Jun 09 13:00:49.982367 ip-10-0-133-109 kubenswrapper[2561]: I0609 13:00:49.982340 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-54544cfb76-gcz6q_7fb4d750-fa0f-4726-a767-4d0a91a9d1bc/copy-manifests/0.log" Jun 09 13:00:51.906725 ip-10-0-133-109 kubenswrapper[2561]: I0609 13:00:51.906692 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-54ccc4d6c5-wbfhc_8c9a3887-63f9-4839-9950-51aacf9ce3ab/manager/0.log" Jun 09 13:00:54.290286 ip-10-0-133-109 kubenswrapper[2561]: I0609 13:00:54.290256 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7ccb5f5468-5jb27_3fa7cec0-6cd6-4213-af15-c78a75df5c69/kube-auth-proxy/0.log" Jun 09 13:00:54.348584 ip-10-0-133-109 kubenswrapper[2561]: I0609 13:00:54.348544 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-9gbs8_9abd9098-8799-406c-9e8d-7b2025b4d568/payload-pre-processing/0.log" Jun 09 13:00:54.368691 ip-10-0-133-109 kubenswrapper[2561]: I0609 13:00:54.368670 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-br4qj_dad2bf8a-21ae-472c-a9c3-ac81aa411894/payload-processing/2.log" Jun 09 13:00:54.370193 ip-10-0-133-109 kubenswrapper[2561]: I0609 13:00:54.370173 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-br4qj_dad2bf8a-21ae-472c-a9c3-ac81aa411894/payload-processing/3.log" Jun 09 13:00:55.606275 ip-10-0-133-109 kubenswrapper[2561]: I0609 13:00:55.606248 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7ccb5f5468-5jb27_3fa7cec0-6cd6-4213-af15-c78a75df5c69/kube-auth-proxy/0.log" Jun 09 13:00:55.669225 ip-10-0-133-109 kubenswrapper[2561]: I0609 13:00:55.669196 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-9gbs8_9abd9098-8799-406c-9e8d-7b2025b4d568/payload-pre-processing/0.log" Jun 09 13:00:55.693418 ip-10-0-133-109 kubenswrapper[2561]: I0609 13:00:55.693377 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-br4qj_dad2bf8a-21ae-472c-a9c3-ac81aa411894/payload-processing/3.log" Jun 09 13:00:55.693781 ip-10-0-133-109 kubenswrapper[2561]: I0609 13:00:55.693765 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-br4qj_dad2bf8a-21ae-472c-a9c3-ac81aa411894/payload-processing/2.log" Jun 09 13:00:57.608363 ip-10-0-133-109 kubenswrapper[2561]: I0609 13:00:57.608335 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-kzx87_a23beaad-8176-4436-ac70-a2bb4eef355e/migrator/0.log" Jun 09 13:00:57.636525 ip-10-0-133-109 kubenswrapper[2561]: I0609 13:00:57.636488 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-kzx87_a23beaad-8176-4436-ac70-a2bb4eef355e/graceful-termination/0.log" Jun 09 13:00:57.640406 ip-10-0-133-109 kubenswrapper[2561]: I0609 13:00:57.640386 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7ccb5f5468-5jb27_3fa7cec0-6cd6-4213-af15-c78a75df5c69/kube-auth-proxy/0.log" Jun 09 13:00:57.698699 ip-10-0-133-109 kubenswrapper[2561]: I0609 13:00:57.698668 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-9gbs8_9abd9098-8799-406c-9e8d-7b2025b4d568/payload-pre-processing/0.log" Jun 09 13:00:57.717018 ip-10-0-133-109 kubenswrapper[2561]: I0609 13:00:57.716989 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-br4qj_dad2bf8a-21ae-472c-a9c3-ac81aa411894/payload-processing/3.log" Jun 09 13:00:57.717446 ip-10-0-133-109 kubenswrapper[2561]: I0609 13:00:57.717417 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-br4qj_dad2bf8a-21ae-472c-a9c3-ac81aa411894/payload-processing/2.log" Jun 09 13:00:58.113926 ip-10-0-133-109 kubenswrapper[2561]: I0609 13:00:58.113896 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-m8hvz_48765388-02b2-4591-a720-30d6215fa9a3/kube-storage-version-migrator-operator/1.log" Jun 09 13:00:58.114648 ip-10-0-133-109 kubenswrapper[2561]: I0609 13:00:58.114633 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-m8hvz_48765388-02b2-4591-a720-30d6215fa9a3/kube-storage-version-migrator-operator/0.log"