Jun 10 12:36:42.997453 ip-10-0-133-72 systemd[1]: Starting Kubernetes Kubelet... Jun 10 12:36:43.395058 ip-10-0-133-72 kubenswrapper[2557]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 12:36:43.395058 ip-10-0-133-72 kubenswrapper[2557]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 10 12:36:43.395058 ip-10-0-133-72 kubenswrapper[2557]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 12:36:43.395058 ip-10-0-133-72 kubenswrapper[2557]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 10 12:36:43.395058 ip-10-0-133-72 kubenswrapper[2557]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 12:36:43.396159 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.395121 2557 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 10 12:36:43.400038 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400023 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 12:36:43.400038 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400037 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 12:36:43.400102 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400042 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 12:36:43.400102 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400045 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 12:36:43.400102 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400048 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 12:36:43.400102 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400051 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 12:36:43.400102 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400054 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 12:36:43.400102 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400056 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 12:36:43.400102 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400059 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 12:36:43.400102 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400061 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 12:36:43.400102 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400066 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 12:36:43.400102 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400069 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 12:36:43.400102 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400072 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 12:36:43.400102 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400075 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 12:36:43.400102 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400078 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 12:36:43.400102 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400082 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 12:36:43.400102 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400085 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 12:36:43.400102 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400088 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 12:36:43.400102 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400091 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 12:36:43.400102 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400094 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 12:36:43.400102 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400096 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 12:36:43.400555 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400106 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 12:36:43.400555 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400110 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 12:36:43.400555 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400113 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 12:36:43.400555 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400115 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 12:36:43.400555 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400118 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 12:36:43.400555 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400121 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 12:36:43.400555 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400123 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 12:36:43.400555 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400125 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 12:36:43.400555 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400128 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 12:36:43.400555 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400130 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 12:36:43.400555 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400133 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 12:36:43.400555 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400136 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 12:36:43.400555 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400138 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 12:36:43.400555 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400141 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 12:36:43.400555 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400143 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 12:36:43.400555 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400145 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 12:36:43.400555 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400148 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 12:36:43.400555 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400150 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 12:36:43.400555 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400153 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 12:36:43.400555 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400155 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 12:36:43.401371 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400158 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 12:36:43.401371 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400160 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 12:36:43.401371 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400163 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 12:36:43.401371 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400166 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 12:36:43.401371 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400168 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 12:36:43.401371 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400170 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 12:36:43.401371 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400172 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 12:36:43.401371 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400175 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 12:36:43.401371 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400192 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 12:36:43.401371 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400195 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 12:36:43.401371 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400198 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 12:36:43.401371 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400200 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 12:36:43.401371 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400203 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 12:36:43.401371 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400207 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 12:36:43.401371 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400211 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 12:36:43.401371 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400213 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 12:36:43.401371 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400217 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 12:36:43.401371 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400221 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 12:36:43.401371 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400224 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 12:36:43.401828 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400226 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 12:36:43.401828 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400229 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 12:36:43.401828 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400231 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 12:36:43.401828 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400234 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 12:36:43.401828 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400236 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 12:36:43.401828 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400239 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 12:36:43.401828 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400241 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 12:36:43.401828 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400245 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 12:36:43.401828 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400247 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 12:36:43.401828 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400250 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 12:36:43.401828 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400252 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 12:36:43.401828 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400254 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 12:36:43.401828 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400257 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 12:36:43.401828 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400259 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 12:36:43.401828 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400262 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 12:36:43.401828 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400264 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 12:36:43.401828 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400267 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 12:36:43.401828 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400269 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 12:36:43.401828 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400271 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 12:36:43.401828 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400275 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 12:36:43.402463 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400277 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 12:36:43.402463 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400280 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 12:36:43.402463 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400283 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 12:36:43.402463 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400285 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 12:36:43.402463 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400288 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 12:36:43.402463 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400290 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 12:36:43.402463 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400294 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 12:36:43.402463 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400297 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 12:36:43.402463 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400299 2557 feature_gate.go:328] unrecognized feature gate: Example Jun 10 12:36:43.402463 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400302 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 12:36:43.402463 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400304 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 12:36:43.402463 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400307 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 12:36:43.402463 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400309 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 12:36:43.402463 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400312 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 12:36:43.402463 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400314 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 12:36:43.402463 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400317 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 12:36:43.402463 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400319 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 12:36:43.402463 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400321 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 12:36:43.402463 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.400324 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 12:36:43.403000 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.402856 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 12:36:43.403000 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.402866 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 12:36:43.403000 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.402869 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 12:36:43.403000 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.402872 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 12:36:43.403000 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.402875 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 12:36:43.403000 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.402878 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 12:36:43.403000 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.402881 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 12:36:43.403000 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.402883 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 12:36:43.403000 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.402886 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 12:36:43.403000 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.402889 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 12:36:43.403000 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.402892 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 12:36:43.403000 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.402894 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 12:36:43.403000 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.402897 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 12:36:43.403000 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.402899 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 12:36:43.403000 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.402902 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 12:36:43.403000 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.402905 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 12:36:43.403000 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.402907 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 12:36:43.403000 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.402910 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 12:36:43.403000 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.402912 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 12:36:43.403000 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.402915 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 12:36:43.403505 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.402917 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 12:36:43.403505 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.402920 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 12:36:43.403505 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.402922 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 12:36:43.403505 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.402926 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 12:36:43.403505 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.402929 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 12:36:43.403505 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.402931 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 12:36:43.403505 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.402934 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 12:36:43.403505 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.402936 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 12:36:43.403505 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.402940 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 12:36:43.403505 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.402943 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 12:36:43.403505 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.402946 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 12:36:43.403505 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.402949 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 12:36:43.403505 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.402952 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 12:36:43.403505 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.402956 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 12:36:43.403505 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.402959 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 12:36:43.403505 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.402962 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 12:36:43.403505 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.402965 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 12:36:43.403505 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.402968 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 12:36:43.403505 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.402971 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 12:36:43.403982 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.402973 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 12:36:43.403982 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.402976 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 12:36:43.403982 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.402979 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 12:36:43.403982 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.402981 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 12:36:43.403982 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.402984 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 12:36:43.403982 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.402986 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 12:36:43.403982 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.402989 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 12:36:43.403982 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.402991 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 12:36:43.403982 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.402994 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 12:36:43.403982 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.402996 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 12:36:43.403982 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.402999 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 12:36:43.403982 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403002 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 12:36:43.403982 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403005 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 12:36:43.403982 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403008 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 12:36:43.403982 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403010 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 12:36:43.403982 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403013 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 12:36:43.403982 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403015 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 12:36:43.403982 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403018 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 12:36:43.403982 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403020 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 12:36:43.403982 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403023 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 12:36:43.404482 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403025 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 12:36:43.404482 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403027 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 12:36:43.404482 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403030 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 12:36:43.404482 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403033 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 12:36:43.404482 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403035 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 12:36:43.404482 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403037 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 12:36:43.404482 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403041 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 12:36:43.404482 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403044 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 12:36:43.404482 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403047 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 12:36:43.404482 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403049 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 12:36:43.404482 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403052 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 12:36:43.404482 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403056 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 12:36:43.404482 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403060 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 12:36:43.404482 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403064 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 12:36:43.404482 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403066 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 12:36:43.404482 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403070 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 12:36:43.404482 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403072 2557 feature_gate.go:328] unrecognized feature gate: Example Jun 10 12:36:43.404482 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403075 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 12:36:43.404482 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403078 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 12:36:43.404482 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403081 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 12:36:43.404957 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403084 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 12:36:43.404957 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403087 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 12:36:43.404957 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403090 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 12:36:43.404957 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403093 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 12:36:43.404957 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403096 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 12:36:43.404957 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403099 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 12:36:43.404957 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403102 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 12:36:43.404957 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403105 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 12:36:43.404957 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403107 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 12:36:43.404957 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403110 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 12:36:43.404957 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403112 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 12:36:43.404957 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403115 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 12:36:43.404957 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403117 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 12:36:43.404957 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403120 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 12:36:43.404957 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403122 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 12:36:43.404957 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403125 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 12:36:43.404957 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403128 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 12:36:43.404957 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403130 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 12:36:43.404957 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403133 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 12:36:43.404957 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403136 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 12:36:43.405469 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403495 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 12:36:43.405469 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403500 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 12:36:43.405469 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403503 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 12:36:43.405469 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403506 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 12:36:43.405469 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403509 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 12:36:43.405469 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403512 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 12:36:43.405469 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403515 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 12:36:43.405469 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403517 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 12:36:43.405469 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403520 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 12:36:43.405469 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403523 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 12:36:43.405469 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403525 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 12:36:43.405469 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403528 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 12:36:43.405469 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403531 2557 feature_gate.go:328] unrecognized feature gate: Example Jun 10 12:36:43.405469 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403533 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 12:36:43.405469 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403535 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 12:36:43.405469 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403538 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 12:36:43.405469 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403541 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 12:36:43.405469 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403544 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 12:36:43.405469 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403546 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 12:36:43.405469 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403549 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 12:36:43.405928 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403551 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 12:36:43.405928 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403554 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 12:36:43.405928 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403556 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 12:36:43.405928 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403559 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 12:36:43.405928 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403561 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 12:36:43.405928 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403564 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 12:36:43.405928 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403566 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 12:36:43.405928 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403569 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 12:36:43.405928 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403571 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 12:36:43.405928 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403574 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 12:36:43.405928 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403576 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 12:36:43.405928 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403579 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 12:36:43.405928 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403581 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 12:36:43.405928 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403584 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 12:36:43.405928 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403586 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 12:36:43.405928 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403588 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 12:36:43.405928 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403591 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 12:36:43.405928 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403595 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 12:36:43.405928 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403598 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 12:36:43.406375 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403601 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 12:36:43.406375 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403604 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 12:36:43.406375 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403607 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 12:36:43.406375 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403609 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 12:36:43.406375 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403612 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 12:36:43.406375 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403616 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 12:36:43.406375 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403618 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 12:36:43.406375 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403621 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 12:36:43.406375 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403623 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 12:36:43.406375 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403626 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 12:36:43.406375 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403631 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 12:36:43.406375 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403634 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 12:36:43.406375 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403637 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 12:36:43.406375 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403639 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 12:36:43.406375 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403642 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 12:36:43.406375 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403645 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 12:36:43.406375 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403648 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 12:36:43.406375 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403650 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 12:36:43.406375 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403653 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 12:36:43.406846 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403655 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 12:36:43.406846 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403658 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 12:36:43.406846 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403660 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 12:36:43.406846 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403662 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 12:36:43.406846 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403665 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 12:36:43.406846 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403667 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 12:36:43.406846 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403669 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 12:36:43.406846 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403672 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 12:36:43.406846 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403674 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 12:36:43.406846 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403676 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 12:36:43.406846 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403679 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 12:36:43.406846 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403681 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 12:36:43.406846 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403683 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 12:36:43.406846 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403686 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 12:36:43.406846 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403688 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 12:36:43.406846 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403691 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 12:36:43.406846 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403693 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 12:36:43.406846 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403695 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 12:36:43.406846 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403698 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 12:36:43.406846 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403702 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 12:36:43.407334 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403704 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 12:36:43.407334 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403707 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 12:36:43.407334 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403709 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 12:36:43.407334 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403711 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 12:36:43.407334 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403714 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 12:36:43.407334 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403717 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 12:36:43.407334 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403719 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 12:36:43.407334 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403722 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 12:36:43.407334 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403725 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 12:36:43.407334 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403728 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 12:36:43.407334 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403732 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 12:36:43.407334 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403734 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 12:36:43.407334 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403736 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 12:36:43.407334 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403739 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 12:36:43.407334 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403741 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 12:36:43.407334 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403744 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 12:36:43.407334 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403746 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 12:36:43.407334 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403748 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 12:36:43.407334 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403751 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 12:36:43.407806 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403753 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 12:36:43.407806 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.403756 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 12:36:43.407806 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.403830 2557 flags.go:64] FLAG: --address="0.0.0.0" Jun 10 12:36:43.407806 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.403840 2557 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 10 12:36:43.407806 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.403846 2557 flags.go:64] FLAG: --anonymous-auth="true" Jun 10 12:36:43.407806 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.403850 2557 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 10 12:36:43.407806 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.403853 2557 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 10 12:36:43.407806 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.403856 2557 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 10 12:36:43.407806 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.403860 2557 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 10 12:36:43.407806 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.403864 2557 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 10 12:36:43.407806 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.403867 2557 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 10 12:36:43.407806 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.403870 2557 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 10 12:36:43.407806 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.403873 2557 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 10 12:36:43.407806 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.403876 2557 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 10 12:36:43.407806 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.403879 2557 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 10 12:36:43.407806 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.403882 2557 flags.go:64] FLAG: --cgroup-root="" Jun 10 12:36:43.407806 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.403884 2557 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 10 12:36:43.407806 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.403887 2557 flags.go:64] FLAG: --client-ca-file="" Jun 10 12:36:43.407806 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.403890 2557 flags.go:64] FLAG: --cloud-provider="external" Jun 10 12:36:43.407806 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.403893 2557 flags.go:64] FLAG: --cluster-dns="[]" Jun 10 12:36:43.407806 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.403898 2557 flags.go:64] FLAG: --cluster-domain="" Jun 10 12:36:43.407806 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.403900 2557 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 10 12:36:43.407806 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.403903 2557 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 10 12:36:43.407806 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.403906 2557 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 10 12:36:43.408404 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.403909 2557 flags.go:64] FLAG: --container-log-max-files="5" Jun 10 12:36:43.408404 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.403912 2557 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 10 12:36:43.408404 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.403915 2557 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 10 12:36:43.408404 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.403918 2557 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 10 12:36:43.408404 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.403921 2557 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 10 12:36:43.408404 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.403924 2557 flags.go:64] FLAG: --contention-profiling="false" Jun 10 12:36:43.408404 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.403927 2557 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 10 12:36:43.408404 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.403929 2557 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 10 12:36:43.408404 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.403933 2557 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 10 12:36:43.408404 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.403935 2557 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 10 12:36:43.408404 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.403939 2557 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 10 12:36:43.408404 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.403942 2557 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 10 12:36:43.408404 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.403944 2557 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 10 12:36:43.408404 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.403947 2557 flags.go:64] FLAG: --enable-load-reader="false" Jun 10 12:36:43.408404 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.403950 2557 flags.go:64] FLAG: --enable-server="true" Jun 10 12:36:43.408404 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.403953 2557 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 10 12:36:43.408404 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.403956 2557 flags.go:64] FLAG: --event-burst="100" Jun 10 12:36:43.408404 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.403959 2557 flags.go:64] FLAG: --event-qps="50" Jun 10 12:36:43.408404 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.403962 2557 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 10 12:36:43.408404 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.403965 2557 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 10 12:36:43.408404 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.403968 2557 flags.go:64] FLAG: --eviction-hard="" Jun 10 12:36:43.408404 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.403971 2557 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 10 12:36:43.408404 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.403974 2557 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 10 12:36:43.408404 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.403976 2557 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 10 12:36:43.408404 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.403979 2557 flags.go:64] FLAG: --eviction-soft="" Jun 10 12:36:43.408973 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.403982 2557 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 10 12:36:43.408973 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.403985 2557 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 10 12:36:43.408973 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.403990 2557 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 10 12:36:43.408973 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.403993 2557 flags.go:64] FLAG: --experimental-mounter-path="" Jun 10 12:36:43.408973 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.403996 2557 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 10 12:36:43.408973 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.403999 2557 flags.go:64] FLAG: --fail-swap-on="true" Jun 10 12:36:43.408973 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404001 2557 flags.go:64] FLAG: --feature-gates="" Jun 10 12:36:43.408973 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404005 2557 flags.go:64] FLAG: --file-check-frequency="20s" Jun 10 12:36:43.408973 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404008 2557 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 10 12:36:43.408973 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404010 2557 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 10 12:36:43.408973 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404013 2557 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 10 12:36:43.408973 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404016 2557 flags.go:64] FLAG: --healthz-port="10248" Jun 10 12:36:43.408973 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404019 2557 flags.go:64] FLAG: --help="false" Jun 10 12:36:43.408973 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404022 2557 flags.go:64] FLAG: --hostname-override="ip-10-0-133-72.ec2.internal" Jun 10 12:36:43.408973 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404025 2557 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 10 12:36:43.408973 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404028 2557 flags.go:64] FLAG: --http-check-frequency="20s" Jun 10 12:36:43.408973 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404030 2557 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 10 12:36:43.408973 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404033 2557 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 10 12:36:43.408973 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404036 2557 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 10 12:36:43.408973 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404039 2557 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 10 12:36:43.408973 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404042 2557 flags.go:64] FLAG: --image-service-endpoint="" Jun 10 12:36:43.408973 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404044 2557 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 10 12:36:43.408973 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404047 2557 flags.go:64] FLAG: --kube-api-burst="100" Jun 10 12:36:43.409603 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404050 2557 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 10 12:36:43.409603 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404053 2557 flags.go:64] FLAG: --kube-api-qps="50" Jun 10 12:36:43.409603 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404056 2557 flags.go:64] FLAG: --kube-reserved="" Jun 10 12:36:43.409603 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404062 2557 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 10 12:36:43.409603 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404065 2557 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 10 12:36:43.409603 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404067 2557 flags.go:64] FLAG: --kubelet-cgroups="" Jun 10 12:36:43.409603 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404070 2557 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 10 12:36:43.409603 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404073 2557 flags.go:64] FLAG: --lock-file="" Jun 10 12:36:43.409603 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404076 2557 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 10 12:36:43.409603 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404078 2557 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 10 12:36:43.409603 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404081 2557 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 10 12:36:43.409603 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404087 2557 flags.go:64] FLAG: --log-json-split-stream="false" Jun 10 12:36:43.409603 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404090 2557 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 10 12:36:43.409603 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404093 2557 flags.go:64] FLAG: --log-text-split-stream="false" Jun 10 12:36:43.409603 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404096 2557 flags.go:64] FLAG: --logging-format="text" Jun 10 12:36:43.409603 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404099 2557 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 10 12:36:43.409603 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404102 2557 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 10 12:36:43.409603 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404105 2557 flags.go:64] FLAG: --manifest-url="" Jun 10 12:36:43.409603 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404107 2557 flags.go:64] FLAG: --manifest-url-header="" Jun 10 12:36:43.409603 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404111 2557 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 10 12:36:43.409603 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404114 2557 flags.go:64] FLAG: --max-open-files="1000000" Jun 10 12:36:43.409603 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404118 2557 flags.go:64] FLAG: --max-pods="110" Jun 10 12:36:43.409603 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404121 2557 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 10 12:36:43.409603 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404124 2557 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 10 12:36:43.409603 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404126 2557 flags.go:64] FLAG: --memory-manager-policy="None" Jun 10 12:36:43.410202 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404129 2557 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 10 12:36:43.410202 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404132 2557 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 10 12:36:43.410202 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404134 2557 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 10 12:36:43.410202 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404137 2557 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 10 12:36:43.410202 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404144 2557 flags.go:64] FLAG: --node-status-max-images="50" Jun 10 12:36:43.410202 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404147 2557 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 10 12:36:43.410202 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404149 2557 flags.go:64] FLAG: --oom-score-adj="-999" Jun 10 12:36:43.410202 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404152 2557 flags.go:64] FLAG: --pod-cidr="" Jun 10 12:36:43.410202 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404155 2557 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 10 12:36:43.410202 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404160 2557 flags.go:64] FLAG: --pod-manifest-path="" Jun 10 12:36:43.410202 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404163 2557 flags.go:64] FLAG: --pod-max-pids="-1" Jun 10 12:36:43.410202 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404168 2557 flags.go:64] FLAG: --pods-per-core="0" Jun 10 12:36:43.410202 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404170 2557 flags.go:64] FLAG: --port="10250" Jun 10 12:36:43.410202 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404173 2557 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 10 12:36:43.410202 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404176 2557 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-01be7aa86471d1b42" Jun 10 12:36:43.410202 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404194 2557 flags.go:64] FLAG: --qos-reserved="" Jun 10 12:36:43.410202 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404199 2557 flags.go:64] FLAG: --read-only-port="10255" Jun 10 12:36:43.410202 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404203 2557 flags.go:64] FLAG: --register-node="true" Jun 10 12:36:43.410202 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404206 2557 flags.go:64] FLAG: --register-with-taints="" Jun 10 12:36:43.410202 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404210 2557 flags.go:64] FLAG: --registry-burst="10" Jun 10 12:36:43.410202 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404213 2557 flags.go:64] FLAG: --registry-qps="5" Jun 10 12:36:43.410202 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404216 2557 flags.go:64] FLAG: --reserved-cpus="" Jun 10 12:36:43.410202 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404219 2557 flags.go:64] FLAG: --reserved-memory="" Jun 10 12:36:43.410202 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404222 2557 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 10 12:36:43.410202 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404225 2557 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 10 12:36:43.410791 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404228 2557 flags.go:64] FLAG: --rotate-certificates="false" Jun 10 12:36:43.410791 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404231 2557 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 10 12:36:43.410791 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404233 2557 flags.go:64] FLAG: --runonce="false" Jun 10 12:36:43.410791 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404237 2557 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 10 12:36:43.410791 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404240 2557 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 10 12:36:43.410791 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404243 2557 flags.go:64] FLAG: --seccomp-default="false" Jun 10 12:36:43.410791 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404245 2557 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 10 12:36:43.410791 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404248 2557 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 10 12:36:43.410791 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404251 2557 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 10 12:36:43.410791 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404254 2557 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 10 12:36:43.410791 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404257 2557 flags.go:64] FLAG: --storage-driver-password="root" Jun 10 12:36:43.410791 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404259 2557 flags.go:64] FLAG: --storage-driver-secure="false" Jun 10 12:36:43.410791 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404262 2557 flags.go:64] FLAG: --storage-driver-table="stats" Jun 10 12:36:43.410791 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404265 2557 flags.go:64] FLAG: --storage-driver-user="root" Jun 10 12:36:43.410791 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404267 2557 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 10 12:36:43.410791 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404270 2557 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 10 12:36:43.410791 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404273 2557 flags.go:64] FLAG: --system-cgroups="" Jun 10 12:36:43.410791 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404276 2557 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 10 12:36:43.410791 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404283 2557 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 10 12:36:43.410791 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404286 2557 flags.go:64] FLAG: --tls-cert-file="" Jun 10 12:36:43.410791 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404289 2557 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 10 12:36:43.410791 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404293 2557 flags.go:64] FLAG: --tls-min-version="" Jun 10 12:36:43.410791 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404295 2557 flags.go:64] FLAG: --tls-private-key-file="" Jun 10 12:36:43.410791 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404298 2557 flags.go:64] FLAG: --topology-manager-policy="none" Jun 10 12:36:43.410791 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404301 2557 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 10 12:36:43.411406 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404308 2557 flags.go:64] FLAG: --topology-manager-scope="container" Jun 10 12:36:43.411406 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404310 2557 flags.go:64] FLAG: --v="2" Jun 10 12:36:43.411406 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404314 2557 flags.go:64] FLAG: --version="false" Jun 10 12:36:43.411406 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404318 2557 flags.go:64] FLAG: --vmodule="" Jun 10 12:36:43.411406 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404322 2557 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 10 12:36:43.411406 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404325 2557 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 10 12:36:43.411406 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404435 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 12:36:43.411406 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404439 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 12:36:43.411406 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404442 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 12:36:43.411406 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404444 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 12:36:43.411406 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404447 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 12:36:43.411406 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404450 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 12:36:43.411406 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404452 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 12:36:43.411406 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404455 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 12:36:43.411406 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404458 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 12:36:43.411406 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404460 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 12:36:43.411406 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404463 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 12:36:43.411406 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404465 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 12:36:43.411406 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404468 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 12:36:43.411406 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404470 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 12:36:43.411406 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404473 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 12:36:43.411406 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404475 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 12:36:43.411920 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404478 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 12:36:43.411920 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404480 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 12:36:43.411920 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404483 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 12:36:43.411920 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404491 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 12:36:43.411920 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404495 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 12:36:43.411920 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404497 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 12:36:43.411920 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404500 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 12:36:43.411920 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404502 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 12:36:43.411920 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404505 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 12:36:43.411920 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404508 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 12:36:43.411920 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404510 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 12:36:43.411920 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404512 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 12:36:43.411920 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404515 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 12:36:43.411920 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404517 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 12:36:43.411920 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404520 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 12:36:43.411920 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404523 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 12:36:43.411920 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404526 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 12:36:43.411920 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404528 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 12:36:43.411920 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404531 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 12:36:43.411920 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404533 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 12:36:43.412414 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404536 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 12:36:43.412414 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404538 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 12:36:43.412414 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404541 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 12:36:43.412414 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404544 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 12:36:43.412414 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404546 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 12:36:43.412414 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404549 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 12:36:43.412414 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404551 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 12:36:43.412414 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404555 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 12:36:43.412414 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404558 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 12:36:43.412414 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404561 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 12:36:43.412414 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404564 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 12:36:43.412414 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404567 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 12:36:43.412414 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404569 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 12:36:43.412414 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404572 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 12:36:43.412414 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404576 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 12:36:43.412414 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404581 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 12:36:43.412414 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404584 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 12:36:43.412414 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404587 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 12:36:43.412414 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404589 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 12:36:43.412871 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404592 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 12:36:43.412871 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404595 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 12:36:43.412871 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404597 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 12:36:43.412871 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404599 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 12:36:43.412871 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404602 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 12:36:43.412871 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404606 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 12:36:43.412871 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404608 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 12:36:43.412871 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404611 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 12:36:43.412871 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404614 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 12:36:43.412871 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404617 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 12:36:43.412871 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404620 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 12:36:43.412871 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404623 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 12:36:43.412871 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404626 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 12:36:43.412871 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404629 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 12:36:43.412871 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404632 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 12:36:43.412871 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404634 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 12:36:43.412871 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404637 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 12:36:43.412871 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404639 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 12:36:43.412871 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404642 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 12:36:43.413342 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404644 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 12:36:43.413342 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404647 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 12:36:43.413342 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404649 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 12:36:43.413342 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404652 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 12:36:43.413342 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404655 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 12:36:43.413342 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404657 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 12:36:43.413342 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404660 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 12:36:43.413342 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404662 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 12:36:43.413342 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404664 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 12:36:43.413342 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404670 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 12:36:43.413342 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404673 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 12:36:43.413342 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404676 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 12:36:43.413342 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404678 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 12:36:43.413342 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404681 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 12:36:43.413342 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404683 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 12:36:43.413342 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404685 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 12:36:43.413342 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404688 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 12:36:43.413342 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404690 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 12:36:43.413342 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404693 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 12:36:43.413794 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404695 2557 feature_gate.go:328] unrecognized feature gate: Example Jun 10 12:36:43.413794 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404698 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 12:36:43.413794 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404700 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 12:36:43.413794 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404704 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 12:36:43.413794 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404706 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 12:36:43.413794 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.404709 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 12:36:43.413794 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.404714 2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 12:36:43.413794 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.410941 2557 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 10 12:36:43.413794 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.410955 2557 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 10 12:36:43.413794 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.410972 2557 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 10 12:36:43.413794 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.410980 2557 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 10 12:36:43.413794 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411031 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 12:36:43.413794 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411035 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 12:36:43.413794 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411039 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 12:36:43.413794 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411042 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 12:36:43.414165 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411045 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 12:36:43.414165 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411048 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 12:36:43.414165 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411050 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 12:36:43.414165 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411053 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 12:36:43.414165 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411056 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 12:36:43.414165 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411058 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 12:36:43.414165 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411061 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 12:36:43.414165 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411063 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 12:36:43.414165 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411066 2557 feature_gate.go:328] unrecognized feature gate: Example Jun 10 12:36:43.414165 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411068 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 12:36:43.414165 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411071 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 12:36:43.414165 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411073 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 12:36:43.414165 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411076 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 12:36:43.414165 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411078 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 12:36:43.414165 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411081 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 12:36:43.414165 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411083 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 12:36:43.414165 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411086 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 12:36:43.414165 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411089 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 12:36:43.414165 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411092 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 12:36:43.414165 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411096 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 12:36:43.414635 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411109 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 12:36:43.414635 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411113 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 12:36:43.414635 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411117 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 12:36:43.414635 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411121 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 12:36:43.414635 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411124 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 12:36:43.414635 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411128 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 12:36:43.414635 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411131 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 12:36:43.414635 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411133 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 12:36:43.414635 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411136 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 12:36:43.414635 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411138 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 12:36:43.414635 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411141 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 12:36:43.414635 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411143 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 12:36:43.414635 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411146 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 12:36:43.414635 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411150 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 12:36:43.414635 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411153 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 12:36:43.414635 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411157 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 12:36:43.414635 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411160 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 12:36:43.414635 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411163 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 12:36:43.414635 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411165 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 12:36:43.415113 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411168 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 12:36:43.415113 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411170 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 12:36:43.415113 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411174 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 12:36:43.415113 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411193 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 12:36:43.415113 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411197 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 12:36:43.415113 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411200 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 12:36:43.415113 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411202 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 12:36:43.415113 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411205 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 12:36:43.415113 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411207 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 12:36:43.415113 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411210 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 12:36:43.415113 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411213 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 12:36:43.415113 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411215 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 12:36:43.415113 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411218 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 12:36:43.415113 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411220 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 12:36:43.415113 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411224 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 12:36:43.415113 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411226 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 12:36:43.415113 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411229 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 12:36:43.415113 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411231 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 12:36:43.415113 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411234 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 12:36:43.415113 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411238 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 12:36:43.415688 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411240 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 12:36:43.415688 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411243 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 12:36:43.415688 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411245 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 12:36:43.415688 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411248 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 12:36:43.415688 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411250 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 12:36:43.415688 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411253 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 12:36:43.415688 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411255 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 12:36:43.415688 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411257 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 12:36:43.415688 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411260 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 12:36:43.415688 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411264 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 12:36:43.415688 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411267 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 12:36:43.415688 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411270 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 12:36:43.415688 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411273 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 12:36:43.415688 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411276 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 12:36:43.415688 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411279 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 12:36:43.415688 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411281 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 12:36:43.415688 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411284 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 12:36:43.415688 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411287 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 12:36:43.415688 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411289 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 12:36:43.416138 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411291 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 12:36:43.416138 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411294 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 12:36:43.416138 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411297 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 12:36:43.416138 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411299 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 12:36:43.416138 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411302 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 12:36:43.416138 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411304 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 12:36:43.416138 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411306 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 12:36:43.416138 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411309 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 12:36:43.416138 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411312 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 12:36:43.416138 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411315 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 12:36:43.416138 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411317 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 12:36:43.416138 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411320 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 12:36:43.416138 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411322 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 12:36:43.416138 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411325 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 12:36:43.416138 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411327 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 12:36:43.416138 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411330 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 12:36:43.416138 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411332 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 12:36:43.416550 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.411338 2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 12:36:43.416550 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411440 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 12:36:43.416550 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411444 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 12:36:43.416550 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411446 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 12:36:43.416550 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411449 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 12:36:43.416550 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411453 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 12:36:43.416550 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411457 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 12:36:43.416550 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411459 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 12:36:43.416550 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411462 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 12:36:43.416550 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411465 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 12:36:43.416550 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411467 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 12:36:43.416550 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411470 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 12:36:43.416550 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411472 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 12:36:43.416550 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411475 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 12:36:43.416550 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411477 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 12:36:43.416908 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411480 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 12:36:43.416908 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411482 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 12:36:43.416908 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411485 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 12:36:43.416908 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411487 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 12:36:43.416908 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411490 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 12:36:43.416908 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411492 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 12:36:43.416908 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411495 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 12:36:43.416908 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411498 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 12:36:43.416908 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411500 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 12:36:43.416908 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411503 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 12:36:43.416908 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411506 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 12:36:43.416908 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411509 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 12:36:43.416908 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411511 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 12:36:43.416908 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411514 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 12:36:43.416908 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411516 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 12:36:43.416908 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411519 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 12:36:43.416908 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411521 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 12:36:43.416908 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411524 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 12:36:43.416908 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411526 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 12:36:43.417356 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411529 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 12:36:43.417356 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411531 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 12:36:43.417356 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411533 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 12:36:43.417356 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411536 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 12:36:43.417356 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411538 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 12:36:43.417356 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411540 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 12:36:43.417356 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411543 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 12:36:43.417356 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411546 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 12:36:43.417356 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411548 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 12:36:43.417356 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411551 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 12:36:43.417356 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411553 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 12:36:43.417356 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411555 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 12:36:43.417356 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411558 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 12:36:43.417356 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411560 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 12:36:43.417356 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411562 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 12:36:43.417356 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411565 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 12:36:43.417356 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411567 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 12:36:43.417356 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411570 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 12:36:43.417356 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411572 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 12:36:43.417356 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411574 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 12:36:43.417819 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411577 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 12:36:43.417819 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411579 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 12:36:43.417819 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411582 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 12:36:43.417819 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411584 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 12:36:43.417819 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411587 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 12:36:43.417819 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411589 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 12:36:43.417819 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411592 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 12:36:43.417819 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411595 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 12:36:43.417819 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411597 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 12:36:43.417819 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411600 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 12:36:43.417819 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411602 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 12:36:43.417819 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411605 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 12:36:43.417819 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411607 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 12:36:43.417819 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411610 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 12:36:43.417819 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411612 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 12:36:43.417819 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411615 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 12:36:43.417819 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411619 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 12:36:43.417819 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411622 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 12:36:43.417819 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411624 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 12:36:43.418274 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411630 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 12:36:43.418274 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411633 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 12:36:43.418274 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411635 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 12:36:43.418274 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411638 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 12:36:43.418274 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411641 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 12:36:43.418274 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411643 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 12:36:43.418274 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411646 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 12:36:43.418274 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411648 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 12:36:43.418274 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411651 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 12:36:43.418274 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411653 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 12:36:43.418274 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411656 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 12:36:43.418274 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411658 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 12:36:43.418274 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411661 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 12:36:43.418274 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411663 2557 feature_gate.go:328] unrecognized feature gate: Example Jun 10 12:36:43.418274 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411666 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 12:36:43.418274 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411669 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 12:36:43.418274 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411672 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 12:36:43.418274 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411675 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 12:36:43.418274 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411678 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 12:36:43.418274 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411681 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 12:36:43.418733 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411683 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 12:36:43.418733 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411686 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 12:36:43.418733 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411688 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 12:36:43.418733 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411691 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 12:36:43.418733 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411693 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 12:36:43.418733 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411696 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 12:36:43.418733 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:43.411698 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 12:36:43.418733 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.411703 2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 12:36:43.418733 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.411788 2557 server.go:962] "Client rotation is on, will bootstrap in background" Jun 10 12:36:43.418733 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.413671 2557 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 10 12:36:43.418733 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.415256 2557 server.go:1019] "Starting client certificate rotation" Jun 10 12:36:43.418733 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.415355 2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 10 12:36:43.418733 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.415392 2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 10 12:36:43.419055 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.418033 2557 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 10 12:36:43.419085 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.419069 2557 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 10 12:36:43.429289 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.429274 2557 log.go:25] "Validated CRI v1 runtime API" Jun 10 12:36:43.433023 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.433009 2557 log.go:25] "Validated CRI v1 image API" Jun 10 12:36:43.435583 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.435564 2557 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 10 12:36:43.437879 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.437864 2557 fs.go:135] Filesystem UUIDs: map[13ae48d4-cff7-43bf-bec5-2ec20a1952f6:/dev/nvme0n1p3 18f8330e-bd5c-4ebd-8d93-43e20543aec7:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jun 10 12:36:43.437927 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.437880 2557 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 10 12:36:43.443962 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.443852 2557 manager.go:216] Machine: {Timestamp:2026-06-10 12:36:43.441644642 +0000 UTC m=+0.324248707 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3207747 MemoryCapacity:33164505088 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2c70f8d5088e30d4344f023018fe5f SystemUUID:ec2c70f8-d508-8e30-d434-4f023018fe5f BootID:0fe25511-2553-441e-aa58-c8cded9b448a Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582254592 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:c8:7e:45:ec:c9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:c8:7e:45:ec:c9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:d6:83:a0:33:eb:52 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164505088 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 10 12:36:43.443962 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.443959 2557 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 10 12:36:43.444075 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.444027 2557 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 10 12:36:43.445924 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.445908 2557 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 10 12:36:43.446405 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.446384 2557 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 10 12:36:43.446538 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.446408 2557 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-72.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 10 12:36:43.447040 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.447031 2557 topology_manager.go:138] "Creating topology manager with none policy" Jun 10 12:36:43.447078 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.447042 2557 container_manager_linux.go:309] "Creating device plugin manager" Jun 10 12:36:43.447078 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.447049 2557 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 10 12:36:43.447849 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.447838 2557 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 10 12:36:43.448684 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.448674 2557 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 10 12:36:43.451643 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.451632 2557 state_mem.go:36] "Initialized new in-memory state store" Jun 10 12:36:43.451901 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.451891 2557 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 10 12:36:43.451939 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.451923 2557 kubelet.go:486] "Attempting to sync node with API server" Jun 10 12:36:43.451939 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.451932 2557 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 10 12:36:43.451995 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.451945 2557 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 10 12:36:43.451995 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.451956 2557 kubelet.go:398] "Adding apiserver pod source" Jun 10 12:36:43.451995 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.451965 2557 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 10 12:36:43.452321 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.452309 2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 10 12:36:43.452359 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.452328 2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 10 12:36:43.454194 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.454157 2557 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 10 12:36:43.455833 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.455820 2557 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 10 12:36:43.455869 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.455850 2557 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 10 12:36:43.456808 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.456797 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 10 12:36:43.456843 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.456813 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 10 12:36:43.456843 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.456819 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 10 12:36:43.456843 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.456824 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 10 12:36:43.456843 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.456832 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 10 12:36:43.456843 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.456837 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 10 12:36:43.456843 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.456845 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 10 12:36:43.457063 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.456850 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 10 12:36:43.457063 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.456856 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 10 12:36:43.457063 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.456861 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 10 12:36:43.457063 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.456870 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 10 12:36:43.457063 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.456875 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 10 12:36:43.458339 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.458326 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 10 12:36:43.458339 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.458338 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 10 12:36:43.461208 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.461193 2557 server.go:1268] "Started kubelet" Jun 10 12:36:43.461361 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.461274 2557 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 10 12:36:43.461417 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.461385 2557 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 10 12:36:43.461462 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.461295 2557 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 10 12:36:43.462133 ip-10-0-133-72 systemd[1]: Started Kubernetes Kubelet. Jun 10 12:36:43.463358 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.463338 2557 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 10 12:36:43.463593 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.463578 2557 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-72.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 10 12:36:43.464838 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:36:43.464674 2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-72.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 10 12:36:43.464942 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:36:43.464669 2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 10 12:36:43.465328 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.465308 2557 server.go:310] "Adding debug handlers to kubelet server" Jun 10 12:36:43.467458 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:36:43.467440 2557 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 10 12:36:43.469890 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.469876 2557 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 10 12:36:43.469978 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.469958 2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 10 12:36:43.470068 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:36:43.470014 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-72.ec2.internal\" not found" Jun 10 12:36:43.470605 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.470585 2557 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 10 12:36:43.470605 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.470601 2557 factory.go:55] Registering systemd factory Jun 10 12:36:43.470758 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.470619 2557 factory.go:223] Registration of the systemd container factory successfully Jun 10 12:36:43.470758 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.470608 2557 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 10 12:36:43.470758 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.470585 2557 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 10 12:36:43.470758 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.470748 2557 reconstruct.go:97] "Volume reconstruction finished" Jun 10 12:36:43.470758 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.470757 2557 reconciler.go:29] "Reconciler: start to sync state" Jun 10 12:36:43.470930 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.470833 2557 factory.go:153] Registering CRI-O factory Jun 10 12:36:43.470930 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.470849 2557 factory.go:223] Registration of the crio container factory successfully Jun 10 12:36:43.470930 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.470899 2557 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 10 12:36:43.470930 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.470925 2557 factory.go:103] Registering Raw factory Jun 10 12:36:43.471096 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.470940 2557 manager.go:1196] Started watching for new ooms in manager Jun 10 12:36:43.471432 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.471419 2557 manager.go:349] Starting recovery of all containers Jun 10 12:36:43.471688 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:36:43.469914 2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-72.ec2.internal.18b7b87810867ea5 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-72.ec2.internal,UID:ip-10-0-133-72.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-72.ec2.internal,},FirstTimestamp:2026-06-10 12:36:43.461156517 +0000 UTC m=+0.343760582,LastTimestamp:2026-06-10 12:36:43.461156517 +0000 UTC m=+0.343760582,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-72.ec2.internal,}" Jun 10 12:36:43.475339 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:36:43.475314 2557 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 10 12:36:43.475429 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:36:43.475407 2557 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-72.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 10 12:36:43.478012 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.477869 2557 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 10 12:36:43.482914 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.482826 2557 manager.go:354] Recovery completed Jun 10 12:36:43.486704 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.486692 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 12:36:43.488339 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.488279 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-72.ec2.internal" event="NodeHasSufficientMemory" Jun 10 12:36:43.488339 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.488319 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-72.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 12:36:43.488339 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.488332 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-72.ec2.internal" event="NodeHasSufficientPID" Jun 10 12:36:43.489147 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.489131 2557 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 10 12:36:43.489147 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.489144 2557 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 10 12:36:43.489277 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.489154 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 12:36:43.489277 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.489163 2557 state_mem.go:36] "Initialized new in-memory state store" Jun 10 12:36:43.489783 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.489771 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-72.ec2.internal" event="NodeHasSufficientMemory" Jun 10 12:36:43.489823 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.489793 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-72.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 12:36:43.489823 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.489803 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-72.ec2.internal" event="NodeHasSufficientPID" Jun 10 12:36:43.490291 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.490280 2557 policy_none.go:49] "None policy: Start" Jun 10 12:36:43.490332 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.490304 2557 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 10 12:36:43.490332 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.490315 2557 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 10 12:36:43.490630 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:36:43.490557 2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-72.ec2.internal.18b7b8781224b878 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-72.ec2.internal,UID:ip-10-0-133-72.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-133-72.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-133-72.ec2.internal,},FirstTimestamp:2026-06-10 12:36:43.488303224 +0000 UTC m=+0.370907291,LastTimestamp:2026-06-10 12:36:43.488303224 +0000 UTC m=+0.370907291,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-72.ec2.internal,}" Jun 10 12:36:43.491287 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.491275 2557 policy_none.go:47] "Start" Jun 10 12:36:43.498601 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.498582 2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gbz8z" Jun 10 12:36:43.499278 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:36:43.499224 2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-72.ec2.internal.18b7b87812250f01 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-72.ec2.internal,UID:ip-10-0-133-72.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-133-72.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-133-72.ec2.internal,},FirstTimestamp:2026-06-10 12:36:43.488325377 +0000 UTC m=+0.370929445,LastTimestamp:2026-06-10 12:36:43.488325377 +0000 UTC m=+0.370929445,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-72.ec2.internal,}" Jun 10 12:36:43.504269 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.504252 2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gbz8z" Jun 10 12:36:43.529882 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.529865 2557 manager.go:337] "Starting Device Plugin manager" Jun 10 12:36:43.539516 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:36:43.529910 2557 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 10 12:36:43.539516 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.529922 2557 server.go:87] "Starting device plugin registration server" Jun 10 12:36:43.539516 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.530119 2557 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 10 12:36:43.539516 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.530130 2557 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 10 12:36:43.539516 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.530228 2557 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 10 12:36:43.539516 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.530309 2557 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 10 12:36:43.539516 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.530319 2557 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 10 12:36:43.539516 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:36:43.530756 2557 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 10 12:36:43.539516 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:36:43.530794 2557 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-72.ec2.internal\" not found" Jun 10 12:36:43.539516 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.535639 2557 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 10 12:36:43.539516 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.535674 2557 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 10 12:36:43.539516 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.535691 2557 kubelet.go:2448] "Starting kubelet main sync loop" Jun 10 12:36:43.539516 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:36:43.535722 2557 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 10 12:36:43.539516 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.537828 2557 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 12:36:43.630498 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.630480 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 12:36:43.631462 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.631447 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-72.ec2.internal" event="NodeHasSufficientMemory" Jun 10 12:36:43.631534 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.631473 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-72.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 12:36:43.631534 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.631484 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-72.ec2.internal" event="NodeHasSufficientPID" Jun 10 12:36:43.631534 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.631510 2557 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-72.ec2.internal" Jun 10 12:36:43.636610 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.636596 2557 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-72.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-72.ec2.internal"] Jun 10 12:36:43.636663 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.636655 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 12:36:43.637407 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.637394 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-72.ec2.internal" event="NodeHasSufficientMemory" Jun 10 12:36:43.637467 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.637418 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-72.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 12:36:43.637467 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.637427 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-72.ec2.internal" event="NodeHasSufficientPID" Jun 10 12:36:43.638843 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.638831 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 12:36:43.638974 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.638960 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-72.ec2.internal" Jun 10 12:36:43.639029 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.638994 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 12:36:43.639507 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.639491 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-72.ec2.internal" event="NodeHasSufficientMemory" Jun 10 12:36:43.639587 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.639516 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-72.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 12:36:43.639587 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.639529 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-72.ec2.internal" event="NodeHasSufficientPID" Jun 10 12:36:43.639587 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.639561 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-72.ec2.internal" event="NodeHasSufficientMemory" Jun 10 12:36:43.639587 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.639580 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-72.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 12:36:43.639769 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.639596 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-72.ec2.internal" event="NodeHasSufficientPID" Jun 10 12:36:43.641443 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.641429 2557 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-72.ec2.internal" Jun 10 12:36:43.641516 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:36:43.641449 2557 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-72.ec2.internal\": node \"ip-10-0-133-72.ec2.internal\" not found" Jun 10 12:36:43.642479 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.642466 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-72.ec2.internal" Jun 10 12:36:43.642533 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.642490 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 12:36:43.643081 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.643068 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-72.ec2.internal" event="NodeHasSufficientMemory" Jun 10 12:36:43.643132 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.643092 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-72.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 12:36:43.643132 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.643103 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-72.ec2.internal" event="NodeHasSufficientPID" Jun 10 12:36:43.665749 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:36:43.665711 2557 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-72.ec2.internal\" not found" node="ip-10-0-133-72.ec2.internal" Jun 10 12:36:43.669727 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:36:43.669711 2557 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-72.ec2.internal\" not found" node="ip-10-0-133-72.ec2.internal" Jun 10 12:36:43.684574 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:36:43.684560 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-72.ec2.internal\" not found" Jun 10 12:36:43.772850 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.772834 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/28b90b0c042d27f85555b2608eecccce-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-72.ec2.internal\" (UID: \"28b90b0c042d27f85555b2608eecccce\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-72.ec2.internal" Jun 10 12:36:43.772947 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.772856 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/28b90b0c042d27f85555b2608eecccce-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-72.ec2.internal\" (UID: \"28b90b0c042d27f85555b2608eecccce\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-72.ec2.internal" Jun 10 12:36:43.772947 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.772873 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6b087f13d248dbe4b0232602445486c4-config\") pod \"kube-apiserver-proxy-ip-10-0-133-72.ec2.internal\" (UID: \"6b087f13d248dbe4b0232602445486c4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-72.ec2.internal" Jun 10 12:36:43.785293 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:36:43.785276 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-72.ec2.internal\" not found" Jun 10 12:36:43.873711 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.873681 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/28b90b0c042d27f85555b2608eecccce-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-72.ec2.internal\" (UID: \"28b90b0c042d27f85555b2608eecccce\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-72.ec2.internal" Jun 10 12:36:43.873711 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.873714 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/28b90b0c042d27f85555b2608eecccce-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-72.ec2.internal\" (UID: \"28b90b0c042d27f85555b2608eecccce\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-72.ec2.internal" Jun 10 12:36:43.873837 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.873733 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6b087f13d248dbe4b0232602445486c4-config\") pod \"kube-apiserver-proxy-ip-10-0-133-72.ec2.internal\" (UID: \"6b087f13d248dbe4b0232602445486c4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-72.ec2.internal" Jun 10 12:36:43.873837 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.873771 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6b087f13d248dbe4b0232602445486c4-config\") pod \"kube-apiserver-proxy-ip-10-0-133-72.ec2.internal\" (UID: \"6b087f13d248dbe4b0232602445486c4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-72.ec2.internal" Jun 10 12:36:43.873837 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.873784 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/28b90b0c042d27f85555b2608eecccce-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-72.ec2.internal\" (UID: \"28b90b0c042d27f85555b2608eecccce\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-72.ec2.internal" Jun 10 12:36:43.873837 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.873807 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/28b90b0c042d27f85555b2608eecccce-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-72.ec2.internal\" (UID: \"28b90b0c042d27f85555b2608eecccce\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-72.ec2.internal" Jun 10 12:36:43.885801 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:36:43.885783 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-72.ec2.internal\" not found" Jun 10 12:36:43.969285 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.969226 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-72.ec2.internal" Jun 10 12:36:43.973967 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:43.973953 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-72.ec2.internal" Jun 10 12:36:43.986573 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:36:43.986553 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-72.ec2.internal\" not found" Jun 10 12:36:44.087037 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:36:44.087007 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-72.ec2.internal\" not found" Jun 10 12:36:44.187530 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:36:44.187505 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-72.ec2.internal\" not found" Jun 10 12:36:44.288075 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:36:44.288022 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-72.ec2.internal\" not found" Jun 10 12:36:44.386452 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:44.386428 2557 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 12:36:44.388691 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:36:44.388667 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-72.ec2.internal\" not found" Jun 10 12:36:44.414845 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:44.414824 2557 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 10 12:36:44.415347 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:44.414942 2557 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 10 12:36:44.415347 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:44.414976 2557 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 10 12:36:44.455759 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:44.455732 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b087f13d248dbe4b0232602445486c4.slice/crio-31d2d094b3a539a3a1f476d3ce2cc6c6880e40603db4f9197261c3ef18d85bc3 WatchSource:0}: Error finding container 31d2d094b3a539a3a1f476d3ce2cc6c6880e40603db4f9197261c3ef18d85bc3: Status 404 returned error can't find the container with id 31d2d094b3a539a3a1f476d3ce2cc6c6880e40603db4f9197261c3ef18d85bc3 Jun 10 12:36:44.456169 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:44.456148 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28b90b0c042d27f85555b2608eecccce.slice/crio-e8e1b5d82bc4c50657cdadab2a6b3cb9820b8c64e520ae3a53e500fd589667a8 WatchSource:0}: Error finding container e8e1b5d82bc4c50657cdadab2a6b3cb9820b8c64e520ae3a53e500fd589667a8: Status 404 returned error can't find the container with id e8e1b5d82bc4c50657cdadab2a6b3cb9820b8c64e520ae3a53e500fd589667a8 Jun 10 12:36:44.460890 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:44.460876 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 12:36:44.489161 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:36:44.489131 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-72.ec2.internal\" not found" Jun 10 12:36:44.506363 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:44.506338 2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-09 12:31:43 +0000 UTC" deadline="2028-03-25 02:41:25.424546324 +0000 UTC" Jun 10 12:36:44.506420 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:44.506361 2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15686h4m40.918189416s" Jun 10 12:36:44.538534 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:44.538467 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-72.ec2.internal" event={"ID":"28b90b0c042d27f85555b2608eecccce","Type":"ContainerStarted","Data":"e8e1b5d82bc4c50657cdadab2a6b3cb9820b8c64e520ae3a53e500fd589667a8"} Jun 10 12:36:44.539286 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:44.539267 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-72.ec2.internal" event={"ID":"6b087f13d248dbe4b0232602445486c4","Type":"ContainerStarted","Data":"31d2d094b3a539a3a1f476d3ce2cc6c6880e40603db4f9197261c3ef18d85bc3"} Jun 10 12:36:44.589716 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:36:44.589700 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-72.ec2.internal\" not found" Jun 10 12:36:44.626570 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:44.626553 2557 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 12:36:44.654798 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:44.654771 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 12:36:44.655608 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:44.655592 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-72.ec2.internal" event="NodeHasSufficientMemory" Jun 10 12:36:44.655663 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:44.655620 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-72.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 12:36:44.655663 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:44.655633 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-72.ec2.internal" event="NodeHasSufficientPID" Jun 10 12:36:44.690741 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:36:44.690722 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-72.ec2.internal\" not found" Jun 10 12:36:44.698788 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:44.698764 2557 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 12:36:44.770331 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:44.770302 2557 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-72.ec2.internal" Jun 10 12:36:44.785849 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:44.785831 2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 10 12:36:44.786732 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:44.786708 2557 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-72.ec2.internal" Jun 10 12:36:44.796273 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:44.796227 2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 10 12:36:45.338406 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.338377 2557 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 12:36:45.453411 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.453377 2557 apiserver.go:52] "Watching apiserver" Jun 10 12:36:45.461957 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.461935 2557 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 10 12:36:45.463132 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.463106 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-n4lrk","openshift-network-operator/iptables-alerter-688zv","kube-system/konnectivity-agent-f9rmw","openshift-cluster-node-tuning-operator/tuned-gj6k8","openshift-dns/node-resolver-mvcnc","openshift-image-registry/node-ca-4c6gv","openshift-multus/multus-2qfc9","openshift-network-diagnostics/network-check-target-p8pxq","openshift-ovn-kubernetes/ovnkube-node-5jhbt","kube-system/global-pull-secret-syncer-q25rc","kube-system/kube-apiserver-proxy-ip-10-0-133-72.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l26ng","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-72.ec2.internal","openshift-multus/multus-additional-cni-plugins-q6jq4"] Jun 10 12:36:45.464538 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.464515 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2qfc9" Jun 10 12:36:45.465752 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.465734 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l26ng" Jun 10 12:36:45.466924 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.466904 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-f9rmw" Jun 10 12:36:45.467529 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.467421 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 10 12:36:45.467529 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.467429 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-nbf5x\"" Jun 10 12:36:45.467529 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.467483 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 10 12:36:45.467529 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.467521 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 10 12:36:45.467778 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.467533 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 10 12:36:45.468268 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.468250 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-gj6k8" Jun 10 12:36:45.468535 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.468515 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-ts4rk\"" Jun 10 12:36:45.468702 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.468685 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 10 12:36:45.469968 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.468961 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 10 12:36:45.469968 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.468976 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 10 12:36:45.469968 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.469415 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-q6jq4" Jun 10 12:36:45.469968 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.469776 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 10 12:36:45.469968 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.469863 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-v4sl6\"" Jun 10 12:36:45.470283 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.469973 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 10 12:36:45.470654 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.470600 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-qkf89\"" Jun 10 12:36:45.470654 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.470642 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4c6gv" Jun 10 12:36:45.471358 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.470986 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 10 12:36:45.471358 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.470989 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 10 12:36:45.471358 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.471004 2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 10 12:36:45.471796 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.471768 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-wjggs\"" Jun 10 12:36:45.471957 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.471929 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 10 12:36:45.472269 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.472254 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5jhbt" Jun 10 12:36:45.472573 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.472554 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 10 12:36:45.473281 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.473262 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 10 12:36:45.475278 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.473726 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 10 12:36:45.475278 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.474502 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n4lrk" Jun 10 12:36:45.475278 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:36:45.474587 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n4lrk" podUID="65533745-1c5b-48e0-b4a2-77fc1cc7908d" Jun 10 12:36:45.475447 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.475321 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-pq6rb\"" Jun 10 12:36:45.475447 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.475368 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 10 12:36:45.476597 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.476549 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 10 12:36:45.476687 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.476613 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-sv8wn\"" Jun 10 12:36:45.476801 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.476785 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 10 12:36:45.476873 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.476836 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 10 12:36:45.477262 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.477044 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 10 12:36:45.477262 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.477096 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 10 12:36:45.477262 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.477210 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 10 12:36:45.478905 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.478584 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-688zv" Jun 10 12:36:45.480052 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.480007 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b7b38392-e294-4941-813e-14c7e728b0bd-os-release\") pod \"multus-2qfc9\" (UID: \"b7b38392-e294-4941-813e-14c7e728b0bd\") " pod="openshift-multus/multus-2qfc9" Jun 10 12:36:45.480052 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.480043 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b7b38392-e294-4941-813e-14c7e728b0bd-host-var-lib-kubelet\") pod \"multus-2qfc9\" (UID: \"b7b38392-e294-4941-813e-14c7e728b0bd\") " pod="openshift-multus/multus-2qfc9" Jun 10 12:36:45.480272 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.480066 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/847f076b-7998-42c3-b0cd-77cdee30f5ac-systemd-units\") pod \"ovnkube-node-5jhbt\" (UID: \"847f076b-7998-42c3-b0cd-77cdee30f5ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jhbt" Jun 10 12:36:45.480272 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.480110 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/847f076b-7998-42c3-b0cd-77cdee30f5ac-host-run-netns\") pod \"ovnkube-node-5jhbt\" (UID: \"847f076b-7998-42c3-b0cd-77cdee30f5ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jhbt" Jun 10 12:36:45.480272 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.480213 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/847f076b-7998-42c3-b0cd-77cdee30f5ac-node-log\") pod \"ovnkube-node-5jhbt\" (UID: \"847f076b-7998-42c3-b0cd-77cdee30f5ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jhbt" Jun 10 12:36:45.480272 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.480221 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8pxq" Jun 10 12:36:45.480456 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.480282 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/847f076b-7998-42c3-b0cd-77cdee30f5ac-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5jhbt\" (UID: \"847f076b-7998-42c3-b0cd-77cdee30f5ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jhbt" Jun 10 12:36:45.480456 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:36:45.480290 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p8pxq" podUID="9ed82178-699a-4219-84bc-d56643bb7337" Jun 10 12:36:45.480456 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.480318 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b7b38392-e294-4941-813e-14c7e728b0bd-multus-conf-dir\") pod \"multus-2qfc9\" (UID: \"b7b38392-e294-4941-813e-14c7e728b0bd\") " pod="openshift-multus/multus-2qfc9" Jun 10 12:36:45.480456 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.480343 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0b5cd784-4247-44f1-b9cd-394ae4294de9-agent-certs\") pod \"konnectivity-agent-f9rmw\" (UID: \"0b5cd784-4247-44f1-b9cd-394ae4294de9\") " pod="kube-system/konnectivity-agent-f9rmw" Jun 10 12:36:45.480456 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.480366 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9e6db1bd-99cf-4a32-b43f-4daca8b04204-system-cni-dir\") pod \"multus-additional-cni-plugins-q6jq4\" (UID: \"9e6db1bd-99cf-4a32-b43f-4daca8b04204\") " pod="openshift-multus/multus-additional-cni-plugins-q6jq4" Jun 10 12:36:45.480456 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.480392 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9ced5103-eb3b-4070-9c0a-06df4cd9c0a8-host\") pod \"node-ca-4c6gv\" (UID: \"9ced5103-eb3b-4070-9c0a-06df4cd9c0a8\") " pod="openshift-image-registry/node-ca-4c6gv" Jun 10 12:36:45.480456 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.480423 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b7b38392-e294-4941-813e-14c7e728b0bd-host-run-k8s-cni-cncf-io\") pod \"multus-2qfc9\" (UID: \"b7b38392-e294-4941-813e-14c7e728b0bd\") " pod="openshift-multus/multus-2qfc9" Jun 10 12:36:45.480868 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.480448 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7a1ad94d-15c8-4022-8ab9-d7b292a60bdc-etc-sysconfig\") pod \"tuned-gj6k8\" (UID: \"7a1ad94d-15c8-4022-8ab9-d7b292a60bdc\") " pod="openshift-cluster-node-tuning-operator/tuned-gj6k8" Jun 10 12:36:45.480868 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.480492 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9e6db1bd-99cf-4a32-b43f-4daca8b04204-os-release\") pod \"multus-additional-cni-plugins-q6jq4\" (UID: \"9e6db1bd-99cf-4a32-b43f-4daca8b04204\") " pod="openshift-multus/multus-additional-cni-plugins-q6jq4" Jun 10 12:36:45.480868 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.480529 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/847f076b-7998-42c3-b0cd-77cdee30f5ac-run-systemd\") pod \"ovnkube-node-5jhbt\" (UID: \"847f076b-7998-42c3-b0cd-77cdee30f5ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jhbt" Jun 10 12:36:45.480868 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.480553 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9e6db1bd-99cf-4a32-b43f-4daca8b04204-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-q6jq4\" (UID: \"9e6db1bd-99cf-4a32-b43f-4daca8b04204\") " pod="openshift-multus/multus-additional-cni-plugins-q6jq4" Jun 10 12:36:45.480868 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.480576 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9ced5103-eb3b-4070-9c0a-06df4cd9c0a8-serviceca\") pod \"node-ca-4c6gv\" (UID: \"9ced5103-eb3b-4070-9c0a-06df4cd9c0a8\") " pod="openshift-image-registry/node-ca-4c6gv" Jun 10 12:36:45.480868 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.480597 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/847f076b-7998-42c3-b0cd-77cdee30f5ac-etc-openvswitch\") pod \"ovnkube-node-5jhbt\" (UID: \"847f076b-7998-42c3-b0cd-77cdee30f5ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jhbt" Jun 10 12:36:45.480868 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.480649 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/847f076b-7998-42c3-b0cd-77cdee30f5ac-env-overrides\") pod \"ovnkube-node-5jhbt\" (UID: \"847f076b-7998-42c3-b0cd-77cdee30f5ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jhbt" Jun 10 12:36:45.480868 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.480672 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9e6db1bd-99cf-4a32-b43f-4daca8b04204-tuning-conf-dir\") pod \"multus-additional-cni-plugins-q6jq4\" (UID: \"9e6db1bd-99cf-4a32-b43f-4daca8b04204\") " pod="openshift-multus/multus-additional-cni-plugins-q6jq4" Jun 10 12:36:45.480868 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.480697 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxlc9\" (UniqueName: \"kubernetes.io/projected/9e6db1bd-99cf-4a32-b43f-4daca8b04204-kube-api-access-wxlc9\") pod \"multus-additional-cni-plugins-q6jq4\" (UID: \"9e6db1bd-99cf-4a32-b43f-4daca8b04204\") " pod="openshift-multus/multus-additional-cni-plugins-q6jq4" Jun 10 12:36:45.480868 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.480721 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b7b38392-e294-4941-813e-14c7e728b0bd-multus-socket-dir-parent\") pod \"multus-2qfc9\" (UID: \"b7b38392-e294-4941-813e-14c7e728b0bd\") " pod="openshift-multus/multus-2qfc9" Jun 10 12:36:45.480868 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.480747 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b7b38392-e294-4941-813e-14c7e728b0bd-host-var-lib-cni-multus\") pod \"multus-2qfc9\" (UID: \"b7b38392-e294-4941-813e-14c7e728b0bd\") " pod="openshift-multus/multus-2qfc9" Jun 10 12:36:45.480868 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.480771 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7a1ad94d-15c8-4022-8ab9-d7b292a60bdc-sys\") pod \"tuned-gj6k8\" (UID: \"7a1ad94d-15c8-4022-8ab9-d7b292a60bdc\") " pod="openshift-cluster-node-tuning-operator/tuned-gj6k8" Jun 10 12:36:45.480868 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.480819 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b7b38392-e294-4941-813e-14c7e728b0bd-system-cni-dir\") pod \"multus-2qfc9\" (UID: \"b7b38392-e294-4941-813e-14c7e728b0bd\") " pod="openshift-multus/multus-2qfc9" Jun 10 12:36:45.481520 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.480893 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1038db63-9904-4677-867f-21f05dd4095e-socket-dir\") pod \"aws-ebs-csi-driver-node-l26ng\" (UID: \"1038db63-9904-4677-867f-21f05dd4095e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l26ng" Jun 10 12:36:45.481520 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.480949 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7a1ad94d-15c8-4022-8ab9-d7b292a60bdc-etc-systemd\") pod \"tuned-gj6k8\" (UID: \"7a1ad94d-15c8-4022-8ab9-d7b292a60bdc\") " pod="openshift-cluster-node-tuning-operator/tuned-gj6k8" Jun 10 12:36:45.481520 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.480986 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7a1ad94d-15c8-4022-8ab9-d7b292a60bdc-host\") pod \"tuned-gj6k8\" (UID: \"7a1ad94d-15c8-4022-8ab9-d7b292a60bdc\") " pod="openshift-cluster-node-tuning-operator/tuned-gj6k8" Jun 10 12:36:45.481520 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.481056 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/847f076b-7998-42c3-b0cd-77cdee30f5ac-host-slash\") pod \"ovnkube-node-5jhbt\" (UID: \"847f076b-7998-42c3-b0cd-77cdee30f5ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jhbt" Jun 10 12:36:45.481520 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.481080 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1038db63-9904-4677-867f-21f05dd4095e-registration-dir\") pod \"aws-ebs-csi-driver-node-l26ng\" (UID: \"1038db63-9904-4677-867f-21f05dd4095e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l26ng" Jun 10 12:36:45.481520 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.481121 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7a1ad94d-15c8-4022-8ab9-d7b292a60bdc-etc-sysctl-conf\") pod \"tuned-gj6k8\" (UID: \"7a1ad94d-15c8-4022-8ab9-d7b292a60bdc\") " pod="openshift-cluster-node-tuning-operator/tuned-gj6k8" Jun 10 12:36:45.481520 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.481144 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/847f076b-7998-42c3-b0cd-77cdee30f5ac-ovnkube-script-lib\") pod \"ovnkube-node-5jhbt\" (UID: \"847f076b-7998-42c3-b0cd-77cdee30f5ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jhbt" Jun 10 12:36:45.481520 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.481213 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b7b38392-e294-4941-813e-14c7e728b0bd-cnibin\") pod \"multus-2qfc9\" (UID: \"b7b38392-e294-4941-813e-14c7e728b0bd\") " pod="openshift-multus/multus-2qfc9" Jun 10 12:36:45.481520 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.481251 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1038db63-9904-4677-867f-21f05dd4095e-device-dir\") pod \"aws-ebs-csi-driver-node-l26ng\" (UID: \"1038db63-9904-4677-867f-21f05dd4095e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l26ng" Jun 10 12:36:45.481520 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.481275 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1038db63-9904-4677-867f-21f05dd4095e-etc-selinux\") pod \"aws-ebs-csi-driver-node-l26ng\" (UID: \"1038db63-9904-4677-867f-21f05dd4095e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l26ng" Jun 10 12:36:45.481520 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.481294 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a1ad94d-15c8-4022-8ab9-d7b292a60bdc-tmp\") pod \"tuned-gj6k8\" (UID: \"7a1ad94d-15c8-4022-8ab9-d7b292a60bdc\") " pod="openshift-cluster-node-tuning-operator/tuned-gj6k8" Jun 10 12:36:45.481520 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.481334 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/847f076b-7998-42c3-b0cd-77cdee30f5ac-host-kubelet\") pod \"ovnkube-node-5jhbt\" (UID: \"847f076b-7998-42c3-b0cd-77cdee30f5ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jhbt" Jun 10 12:36:45.481520 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.481401 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 10 12:36:45.481520 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.481407 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 10 12:36:45.481520 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.481408 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/847f076b-7998-42c3-b0cd-77cdee30f5ac-run-openvswitch\") pod \"ovnkube-node-5jhbt\" (UID: \"847f076b-7998-42c3-b0cd-77cdee30f5ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jhbt" Jun 10 12:36:45.481520 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.481449 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b7b38392-e294-4941-813e-14c7e728b0bd-cni-binary-copy\") pod \"multus-2qfc9\" (UID: \"b7b38392-e294-4941-813e-14c7e728b0bd\") " pod="openshift-multus/multus-2qfc9" Jun 10 12:36:45.481520 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.481453 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 10 12:36:45.481520 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.481489 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7a1ad94d-15c8-4022-8ab9-d7b292a60bdc-etc-modprobe-d\") pod \"tuned-gj6k8\" (UID: \"7a1ad94d-15c8-4022-8ab9-d7b292a60bdc\") " pod="openshift-cluster-node-tuning-operator/tuned-gj6k8" Jun 10 12:36:45.482390 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.481511 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/847f076b-7998-42c3-b0cd-77cdee30f5ac-host-cni-bin\") pod \"ovnkube-node-5jhbt\" (UID: \"847f076b-7998-42c3-b0cd-77cdee30f5ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jhbt" Jun 10 12:36:45.482390 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.481536 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b7b38392-e294-4941-813e-14c7e728b0bd-multus-cni-dir\") pod \"multus-2qfc9\" (UID: \"b7b38392-e294-4941-813e-14c7e728b0bd\") " pod="openshift-multus/multus-2qfc9" Jun 10 12:36:45.482390 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.481584 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8s6pm\" (UniqueName: \"kubernetes.io/projected/b7b38392-e294-4941-813e-14c7e728b0bd-kube-api-access-8s6pm\") pod \"multus-2qfc9\" (UID: \"b7b38392-e294-4941-813e-14c7e728b0bd\") " pod="openshift-multus/multus-2qfc9" Jun 10 12:36:45.482390 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.481606 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0b5cd784-4247-44f1-b9cd-394ae4294de9-konnectivity-ca\") pod \"konnectivity-agent-f9rmw\" (UID: \"0b5cd784-4247-44f1-b9cd-394ae4294de9\") " pod="kube-system/konnectivity-agent-f9rmw" Jun 10 12:36:45.482390 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.481648 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7a1ad94d-15c8-4022-8ab9-d7b292a60bdc-etc-kubernetes\") pod \"tuned-gj6k8\" (UID: \"7a1ad94d-15c8-4022-8ab9-d7b292a60bdc\") " pod="openshift-cluster-node-tuning-operator/tuned-gj6k8" Jun 10 12:36:45.482390 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.481704 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m69pz\" (UniqueName: \"kubernetes.io/projected/1038db63-9904-4677-867f-21f05dd4095e-kube-api-access-m69pz\") pod \"aws-ebs-csi-driver-node-l26ng\" (UID: \"1038db63-9904-4677-867f-21f05dd4095e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l26ng" Jun 10 12:36:45.482390 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.481722 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/847f076b-7998-42c3-b0cd-77cdee30f5ac-host-cni-netd\") pod \"ovnkube-node-5jhbt\" (UID: \"847f076b-7998-42c3-b0cd-77cdee30f5ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jhbt" Jun 10 12:36:45.482390 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.481722 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-g4j6c\"" Jun 10 12:36:45.482390 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.481752 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b7b38392-e294-4941-813e-14c7e728b0bd-etc-kubernetes\") pod \"multus-2qfc9\" (UID: \"b7b38392-e294-4941-813e-14c7e728b0bd\") " pod="openshift-multus/multus-2qfc9" Jun 10 12:36:45.482390 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.481774 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7a1ad94d-15c8-4022-8ab9-d7b292a60bdc-lib-modules\") pod \"tuned-gj6k8\" (UID: \"7a1ad94d-15c8-4022-8ab9-d7b292a60bdc\") " pod="openshift-cluster-node-tuning-operator/tuned-gj6k8" Jun 10 12:36:45.482390 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.481796 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjcxb\" (UniqueName: \"kubernetes.io/projected/847f076b-7998-42c3-b0cd-77cdee30f5ac-kube-api-access-vjcxb\") pod \"ovnkube-node-5jhbt\" (UID: \"847f076b-7998-42c3-b0cd-77cdee30f5ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jhbt" Jun 10 12:36:45.482390 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.481815 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5n75\" (UniqueName: \"kubernetes.io/projected/9ced5103-eb3b-4070-9c0a-06df4cd9c0a8-kube-api-access-p5n75\") pod \"node-ca-4c6gv\" (UID: \"9ced5103-eb3b-4070-9c0a-06df4cd9c0a8\") " pod="openshift-image-registry/node-ca-4c6gv" Jun 10 12:36:45.482390 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.481834 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b7b38392-e294-4941-813e-14c7e728b0bd-host-var-lib-cni-bin\") pod \"multus-2qfc9\" (UID: \"b7b38392-e294-4941-813e-14c7e728b0bd\") " pod="openshift-multus/multus-2qfc9" Jun 10 12:36:45.482390 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.481858 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b7b38392-e294-4941-813e-14c7e728b0bd-host-run-multus-certs\") pod \"multus-2qfc9\" (UID: \"b7b38392-e294-4941-813e-14c7e728b0bd\") " pod="openshift-multus/multus-2qfc9" Jun 10 12:36:45.482390 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.481878 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7a1ad94d-15c8-4022-8ab9-d7b292a60bdc-etc-sysctl-d\") pod \"tuned-gj6k8\" (UID: \"7a1ad94d-15c8-4022-8ab9-d7b292a60bdc\") " pod="openshift-cluster-node-tuning-operator/tuned-gj6k8" Jun 10 12:36:45.482390 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.481913 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7a1ad94d-15c8-4022-8ab9-d7b292a60bdc-run\") pod \"tuned-gj6k8\" (UID: \"7a1ad94d-15c8-4022-8ab9-d7b292a60bdc\") " pod="openshift-cluster-node-tuning-operator/tuned-gj6k8" Jun 10 12:36:45.482390 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.481934 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7a1ad94d-15c8-4022-8ab9-d7b292a60bdc-etc-tuned\") pod \"tuned-gj6k8\" (UID: \"7a1ad94d-15c8-4022-8ab9-d7b292a60bdc\") " pod="openshift-cluster-node-tuning-operator/tuned-gj6k8" Jun 10 12:36:45.483242 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.481949 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/847f076b-7998-42c3-b0cd-77cdee30f5ac-ovn-node-metrics-cert\") pod \"ovnkube-node-5jhbt\" (UID: \"847f076b-7998-42c3-b0cd-77cdee30f5ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jhbt" Jun 10 12:36:45.483242 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.481979 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b7b38392-e294-4941-813e-14c7e728b0bd-multus-daemon-config\") pod \"multus-2qfc9\" (UID: \"b7b38392-e294-4941-813e-14c7e728b0bd\") " pod="openshift-multus/multus-2qfc9" Jun 10 12:36:45.483242 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.482013 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpkjd\" (UniqueName: \"kubernetes.io/projected/7a1ad94d-15c8-4022-8ab9-d7b292a60bdc-kube-api-access-fpkjd\") pod \"tuned-gj6k8\" (UID: \"7a1ad94d-15c8-4022-8ab9-d7b292a60bdc\") " pod="openshift-cluster-node-tuning-operator/tuned-gj6k8" Jun 10 12:36:45.483242 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.482037 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q25rc" Jun 10 12:36:45.483242 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.482048 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9e6db1bd-99cf-4a32-b43f-4daca8b04204-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-q6jq4\" (UID: \"9e6db1bd-99cf-4a32-b43f-4daca8b04204\") " pod="openshift-multus/multus-additional-cni-plugins-q6jq4" Jun 10 12:36:45.483242 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.482083 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/847f076b-7998-42c3-b0cd-77cdee30f5ac-run-ovn\") pod \"ovnkube-node-5jhbt\" (UID: \"847f076b-7998-42c3-b0cd-77cdee30f5ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jhbt" Jun 10 12:36:45.483242 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:36:45.482117 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q25rc" podUID="b893d76d-5c4b-4d52-9658-7d87236b1b2e" Jun 10 12:36:45.483242 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.482120 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/847f076b-7998-42c3-b0cd-77cdee30f5ac-host-run-ovn-kubernetes\") pod \"ovnkube-node-5jhbt\" (UID: \"847f076b-7998-42c3-b0cd-77cdee30f5ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jhbt" Jun 10 12:36:45.483242 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.482176 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b7b38392-e294-4941-813e-14c7e728b0bd-host-run-netns\") pod \"multus-2qfc9\" (UID: \"b7b38392-e294-4941-813e-14c7e728b0bd\") " pod="openshift-multus/multus-2qfc9" Jun 10 12:36:45.483242 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.482214 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b7b38392-e294-4941-813e-14c7e728b0bd-hostroot\") pod \"multus-2qfc9\" (UID: \"b7b38392-e294-4941-813e-14c7e728b0bd\") " pod="openshift-multus/multus-2qfc9" Jun 10 12:36:45.483242 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.482235 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7a1ad94d-15c8-4022-8ab9-d7b292a60bdc-var-lib-kubelet\") pod \"tuned-gj6k8\" (UID: \"7a1ad94d-15c8-4022-8ab9-d7b292a60bdc\") " pod="openshift-cluster-node-tuning-operator/tuned-gj6k8" Jun 10 12:36:45.483242 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.482268 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9e6db1bd-99cf-4a32-b43f-4daca8b04204-cnibin\") pod \"multus-additional-cni-plugins-q6jq4\" (UID: \"9e6db1bd-99cf-4a32-b43f-4daca8b04204\") " pod="openshift-multus/multus-additional-cni-plugins-q6jq4" Jun 10 12:36:45.483242 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.482291 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9e6db1bd-99cf-4a32-b43f-4daca8b04204-cni-binary-copy\") pod \"multus-additional-cni-plugins-q6jq4\" (UID: \"9e6db1bd-99cf-4a32-b43f-4daca8b04204\") " pod="openshift-multus/multus-additional-cni-plugins-q6jq4" Jun 10 12:36:45.483242 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.482313 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/847f076b-7998-42c3-b0cd-77cdee30f5ac-var-lib-openvswitch\") pod \"ovnkube-node-5jhbt\" (UID: \"847f076b-7998-42c3-b0cd-77cdee30f5ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jhbt" Jun 10 12:36:45.483242 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.482335 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/847f076b-7998-42c3-b0cd-77cdee30f5ac-log-socket\") pod \"ovnkube-node-5jhbt\" (UID: \"847f076b-7998-42c3-b0cd-77cdee30f5ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jhbt" Jun 10 12:36:45.483242 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.482367 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/847f076b-7998-42c3-b0cd-77cdee30f5ac-ovnkube-config\") pod \"ovnkube-node-5jhbt\" (UID: \"847f076b-7998-42c3-b0cd-77cdee30f5ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jhbt" Jun 10 12:36:45.483242 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.482390 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1038db63-9904-4677-867f-21f05dd4095e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-l26ng\" (UID: \"1038db63-9904-4677-867f-21f05dd4095e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l26ng" Jun 10 12:36:45.483999 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.482430 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1038db63-9904-4677-867f-21f05dd4095e-sys-fs\") pod \"aws-ebs-csi-driver-node-l26ng\" (UID: \"1038db63-9904-4677-867f-21f05dd4095e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l26ng" Jun 10 12:36:45.483999 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.483252 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mvcnc" Jun 10 12:36:45.485860 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.485744 2557 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 10 12:36:45.485860 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.485793 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 10 12:36:45.486017 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.486004 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-9h6sl\"" Jun 10 12:36:45.486302 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.486278 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 10 12:36:45.513642 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.513619 2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-zr9hn" Jun 10 12:36:45.523177 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.523153 2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-zr9hn" Jun 10 12:36:45.572154 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.572135 2557 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 10 12:36:45.582796 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.582764 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5n75\" (UniqueName: \"kubernetes.io/projected/9ced5103-eb3b-4070-9c0a-06df4cd9c0a8-kube-api-access-p5n75\") pod \"node-ca-4c6gv\" (UID: \"9ced5103-eb3b-4070-9c0a-06df4cd9c0a8\") " pod="openshift-image-registry/node-ca-4c6gv" Jun 10 12:36:45.582916 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.582802 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b7b38392-e294-4941-813e-14c7e728b0bd-host-var-lib-cni-bin\") pod \"multus-2qfc9\" (UID: \"b7b38392-e294-4941-813e-14c7e728b0bd\") " pod="openshift-multus/multus-2qfc9" Jun 10 12:36:45.582916 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.582824 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b7b38392-e294-4941-813e-14c7e728b0bd-host-run-multus-certs\") pod \"multus-2qfc9\" (UID: \"b7b38392-e294-4941-813e-14c7e728b0bd\") " pod="openshift-multus/multus-2qfc9" Jun 10 12:36:45.582916 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.582846 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7a1ad94d-15c8-4022-8ab9-d7b292a60bdc-etc-sysctl-d\") pod \"tuned-gj6k8\" (UID: \"7a1ad94d-15c8-4022-8ab9-d7b292a60bdc\") " pod="openshift-cluster-node-tuning-operator/tuned-gj6k8" Jun 10 12:36:45.582916 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.582897 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b7b38392-e294-4941-813e-14c7e728b0bd-host-var-lib-cni-bin\") pod \"multus-2qfc9\" (UID: \"b7b38392-e294-4941-813e-14c7e728b0bd\") " pod="openshift-multus/multus-2qfc9" Jun 10 12:36:45.583123 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.582915 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b7b38392-e294-4941-813e-14c7e728b0bd-host-run-multus-certs\") pod \"multus-2qfc9\" (UID: \"b7b38392-e294-4941-813e-14c7e728b0bd\") " pod="openshift-multus/multus-2qfc9" Jun 10 12:36:45.583123 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.582958 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7a1ad94d-15c8-4022-8ab9-d7b292a60bdc-run\") pod \"tuned-gj6k8\" (UID: \"7a1ad94d-15c8-4022-8ab9-d7b292a60bdc\") " pod="openshift-cluster-node-tuning-operator/tuned-gj6k8" Jun 10 12:36:45.583123 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.582985 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7a1ad94d-15c8-4022-8ab9-d7b292a60bdc-etc-sysctl-d\") pod \"tuned-gj6k8\" (UID: \"7a1ad94d-15c8-4022-8ab9-d7b292a60bdc\") " pod="openshift-cluster-node-tuning-operator/tuned-gj6k8" Jun 10 12:36:45.583123 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.583007 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7a1ad94d-15c8-4022-8ab9-d7b292a60bdc-etc-tuned\") pod \"tuned-gj6k8\" (UID: \"7a1ad94d-15c8-4022-8ab9-d7b292a60bdc\") " pod="openshift-cluster-node-tuning-operator/tuned-gj6k8" Jun 10 12:36:45.583123 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.583034 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/847f076b-7998-42c3-b0cd-77cdee30f5ac-ovn-node-metrics-cert\") pod \"ovnkube-node-5jhbt\" (UID: \"847f076b-7998-42c3-b0cd-77cdee30f5ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jhbt" Jun 10 12:36:45.583123 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.583047 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7a1ad94d-15c8-4022-8ab9-d7b292a60bdc-run\") pod \"tuned-gj6k8\" (UID: \"7a1ad94d-15c8-4022-8ab9-d7b292a60bdc\") " pod="openshift-cluster-node-tuning-operator/tuned-gj6k8" Jun 10 12:36:45.583123 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.583065 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65533745-1c5b-48e0-b4a2-77fc1cc7908d-metrics-certs\") pod \"network-metrics-daemon-n4lrk\" (UID: \"65533745-1c5b-48e0-b4a2-77fc1cc7908d\") " pod="openshift-multus/network-metrics-daemon-n4lrk" Jun 10 12:36:45.583123 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.583097 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b7b38392-e294-4941-813e-14c7e728b0bd-multus-daemon-config\") pod \"multus-2qfc9\" (UID: \"b7b38392-e294-4941-813e-14c7e728b0bd\") " pod="openshift-multus/multus-2qfc9" Jun 10 12:36:45.583496 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.583127 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpkjd\" (UniqueName: \"kubernetes.io/projected/7a1ad94d-15c8-4022-8ab9-d7b292a60bdc-kube-api-access-fpkjd\") pod \"tuned-gj6k8\" (UID: \"7a1ad94d-15c8-4022-8ab9-d7b292a60bdc\") " pod="openshift-cluster-node-tuning-operator/tuned-gj6k8" Jun 10 12:36:45.583496 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.583156 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9e6db1bd-99cf-4a32-b43f-4daca8b04204-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-q6jq4\" (UID: \"9e6db1bd-99cf-4a32-b43f-4daca8b04204\") " pod="openshift-multus/multus-additional-cni-plugins-q6jq4" Jun 10 12:36:45.583496 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.583195 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/847f076b-7998-42c3-b0cd-77cdee30f5ac-run-ovn\") pod \"ovnkube-node-5jhbt\" (UID: \"847f076b-7998-42c3-b0cd-77cdee30f5ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jhbt" Jun 10 12:36:45.583496 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.583222 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/847f076b-7998-42c3-b0cd-77cdee30f5ac-host-run-ovn-kubernetes\") pod \"ovnkube-node-5jhbt\" (UID: \"847f076b-7998-42c3-b0cd-77cdee30f5ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jhbt" Jun 10 12:36:45.583496 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.583245 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b7b38392-e294-4941-813e-14c7e728b0bd-host-run-netns\") pod \"multus-2qfc9\" (UID: \"b7b38392-e294-4941-813e-14c7e728b0bd\") " pod="openshift-multus/multus-2qfc9" Jun 10 12:36:45.583496 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.583272 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b7b38392-e294-4941-813e-14c7e728b0bd-hostroot\") pod \"multus-2qfc9\" (UID: \"b7b38392-e294-4941-813e-14c7e728b0bd\") " pod="openshift-multus/multus-2qfc9" Jun 10 12:36:45.583496 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.583298 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7a1ad94d-15c8-4022-8ab9-d7b292a60bdc-var-lib-kubelet\") pod \"tuned-gj6k8\" (UID: \"7a1ad94d-15c8-4022-8ab9-d7b292a60bdc\") " pod="openshift-cluster-node-tuning-operator/tuned-gj6k8" Jun 10 12:36:45.583496 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.583323 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9e6db1bd-99cf-4a32-b43f-4daca8b04204-cnibin\") pod \"multus-additional-cni-plugins-q6jq4\" (UID: \"9e6db1bd-99cf-4a32-b43f-4daca8b04204\") " pod="openshift-multus/multus-additional-cni-plugins-q6jq4" Jun 10 12:36:45.583496 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.583331 2557 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 10 12:36:45.583496 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.583374 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/847f076b-7998-42c3-b0cd-77cdee30f5ac-run-ovn\") pod \"ovnkube-node-5jhbt\" (UID: \"847f076b-7998-42c3-b0cd-77cdee30f5ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jhbt" Jun 10 12:36:45.583496 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.583417 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/847f076b-7998-42c3-b0cd-77cdee30f5ac-host-run-ovn-kubernetes\") pod \"ovnkube-node-5jhbt\" (UID: \"847f076b-7998-42c3-b0cd-77cdee30f5ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jhbt" Jun 10 12:36:45.583496 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.583492 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b7b38392-e294-4941-813e-14c7e728b0bd-hostroot\") pod \"multus-2qfc9\" (UID: \"b7b38392-e294-4941-813e-14c7e728b0bd\") " pod="openshift-multus/multus-2qfc9" Jun 10 12:36:45.584032 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.583497 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7a1ad94d-15c8-4022-8ab9-d7b292a60bdc-var-lib-kubelet\") pod \"tuned-gj6k8\" (UID: \"7a1ad94d-15c8-4022-8ab9-d7b292a60bdc\") " pod="openshift-cluster-node-tuning-operator/tuned-gj6k8" Jun 10 12:36:45.584032 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.583349 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9e6db1bd-99cf-4a32-b43f-4daca8b04204-cni-binary-copy\") pod \"multus-additional-cni-plugins-q6jq4\" (UID: \"9e6db1bd-99cf-4a32-b43f-4daca8b04204\") " pod="openshift-multus/multus-additional-cni-plugins-q6jq4" Jun 10 12:36:45.584032 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.583555 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b7b38392-e294-4941-813e-14c7e728b0bd-host-run-netns\") pod \"multus-2qfc9\" (UID: \"b7b38392-e294-4941-813e-14c7e728b0bd\") " pod="openshift-multus/multus-2qfc9" Jun 10 12:36:45.584032 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.583559 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/847f076b-7998-42c3-b0cd-77cdee30f5ac-var-lib-openvswitch\") pod \"ovnkube-node-5jhbt\" (UID: \"847f076b-7998-42c3-b0cd-77cdee30f5ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jhbt" Jun 10 12:36:45.584032 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.583587 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/847f076b-7998-42c3-b0cd-77cdee30f5ac-log-socket\") pod \"ovnkube-node-5jhbt\" (UID: \"847f076b-7998-42c3-b0cd-77cdee30f5ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jhbt" Jun 10 12:36:45.584032 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.583625 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/847f076b-7998-42c3-b0cd-77cdee30f5ac-ovnkube-config\") pod \"ovnkube-node-5jhbt\" (UID: \"847f076b-7998-42c3-b0cd-77cdee30f5ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jhbt" Jun 10 12:36:45.584032 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.583641 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/847f076b-7998-42c3-b0cd-77cdee30f5ac-var-lib-openvswitch\") pod \"ovnkube-node-5jhbt\" (UID: \"847f076b-7998-42c3-b0cd-77cdee30f5ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jhbt" Jun 10 12:36:45.584032 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.583650 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1038db63-9904-4677-867f-21f05dd4095e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-l26ng\" (UID: \"1038db63-9904-4677-867f-21f05dd4095e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l26ng" Jun 10 12:36:45.584032 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.583659 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/847f076b-7998-42c3-b0cd-77cdee30f5ac-log-socket\") pod \"ovnkube-node-5jhbt\" (UID: \"847f076b-7998-42c3-b0cd-77cdee30f5ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jhbt" Jun 10 12:36:45.584032 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.583688 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1038db63-9904-4677-867f-21f05dd4095e-sys-fs\") pod \"aws-ebs-csi-driver-node-l26ng\" (UID: \"1038db63-9904-4677-867f-21f05dd4095e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l26ng" Jun 10 12:36:45.584032 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.583628 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9e6db1bd-99cf-4a32-b43f-4daca8b04204-cnibin\") pod \"multus-additional-cni-plugins-q6jq4\" (UID: \"9e6db1bd-99cf-4a32-b43f-4daca8b04204\") " pod="openshift-multus/multus-additional-cni-plugins-q6jq4" Jun 10 12:36:45.584032 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.583720 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b7b38392-e294-4941-813e-14c7e728b0bd-os-release\") pod \"multus-2qfc9\" (UID: \"b7b38392-e294-4941-813e-14c7e728b0bd\") " pod="openshift-multus/multus-2qfc9" Jun 10 12:36:45.584032 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.583726 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b7b38392-e294-4941-813e-14c7e728b0bd-multus-daemon-config\") pod \"multus-2qfc9\" (UID: \"b7b38392-e294-4941-813e-14c7e728b0bd\") " pod="openshift-multus/multus-2qfc9" Jun 10 12:36:45.584032 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.583745 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b7b38392-e294-4941-813e-14c7e728b0bd-host-var-lib-kubelet\") pod \"multus-2qfc9\" (UID: \"b7b38392-e294-4941-813e-14c7e728b0bd\") " pod="openshift-multus/multus-2qfc9" Jun 10 12:36:45.584032 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.583765 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/847f076b-7998-42c3-b0cd-77cdee30f5ac-systemd-units\") pod \"ovnkube-node-5jhbt\" (UID: \"847f076b-7998-42c3-b0cd-77cdee30f5ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jhbt" Jun 10 12:36:45.584032 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.583760 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1038db63-9904-4677-867f-21f05dd4095e-sys-fs\") pod \"aws-ebs-csi-driver-node-l26ng\" (UID: \"1038db63-9904-4677-867f-21f05dd4095e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l26ng" Jun 10 12:36:45.584032 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.583689 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1038db63-9904-4677-867f-21f05dd4095e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-l26ng\" (UID: \"1038db63-9904-4677-867f-21f05dd4095e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l26ng" Jun 10 12:36:45.584822 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.583805 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/847f076b-7998-42c3-b0cd-77cdee30f5ac-host-run-netns\") pod \"ovnkube-node-5jhbt\" (UID: \"847f076b-7998-42c3-b0cd-77cdee30f5ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jhbt" Jun 10 12:36:45.584822 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.583821 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9e6db1bd-99cf-4a32-b43f-4daca8b04204-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-q6jq4\" (UID: \"9e6db1bd-99cf-4a32-b43f-4daca8b04204\") " pod="openshift-multus/multus-additional-cni-plugins-q6jq4" Jun 10 12:36:45.584822 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.583831 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/847f076b-7998-42c3-b0cd-77cdee30f5ac-host-run-netns\") pod \"ovnkube-node-5jhbt\" (UID: \"847f076b-7998-42c3-b0cd-77cdee30f5ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jhbt" Jun 10 12:36:45.584822 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.583838 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/847f076b-7998-42c3-b0cd-77cdee30f5ac-node-log\") pod \"ovnkube-node-5jhbt\" (UID: \"847f076b-7998-42c3-b0cd-77cdee30f5ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jhbt" Jun 10 12:36:45.584822 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.583824 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b7b38392-e294-4941-813e-14c7e728b0bd-os-release\") pod \"multus-2qfc9\" (UID: \"b7b38392-e294-4941-813e-14c7e728b0bd\") " pod="openshift-multus/multus-2qfc9" Jun 10 12:36:45.584822 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.583855 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b7b38392-e294-4941-813e-14c7e728b0bd-host-var-lib-kubelet\") pod \"multus-2qfc9\" (UID: \"b7b38392-e294-4941-813e-14c7e728b0bd\") " pod="openshift-multus/multus-2qfc9" Jun 10 12:36:45.584822 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.583862 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/847f076b-7998-42c3-b0cd-77cdee30f5ac-systemd-units\") pod \"ovnkube-node-5jhbt\" (UID: \"847f076b-7998-42c3-b0cd-77cdee30f5ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jhbt" Jun 10 12:36:45.584822 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.583864 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/847f076b-7998-42c3-b0cd-77cdee30f5ac-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5jhbt\" (UID: \"847f076b-7998-42c3-b0cd-77cdee30f5ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jhbt" Jun 10 12:36:45.584822 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.583890 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/847f076b-7998-42c3-b0cd-77cdee30f5ac-node-log\") pod \"ovnkube-node-5jhbt\" (UID: \"847f076b-7998-42c3-b0cd-77cdee30f5ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jhbt" Jun 10 12:36:45.584822 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.583898 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9e6db1bd-99cf-4a32-b43f-4daca8b04204-cni-binary-copy\") pod \"multus-additional-cni-plugins-q6jq4\" (UID: \"9e6db1bd-99cf-4a32-b43f-4daca8b04204\") " pod="openshift-multus/multus-additional-cni-plugins-q6jq4" Jun 10 12:36:45.584822 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.583928 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b7b38392-e294-4941-813e-14c7e728b0bd-multus-conf-dir\") pod \"multus-2qfc9\" (UID: \"b7b38392-e294-4941-813e-14c7e728b0bd\") " pod="openshift-multus/multus-2qfc9" Jun 10 12:36:45.584822 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.583954 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0b5cd784-4247-44f1-b9cd-394ae4294de9-agent-certs\") pod \"konnectivity-agent-f9rmw\" (UID: \"0b5cd784-4247-44f1-b9cd-394ae4294de9\") " pod="kube-system/konnectivity-agent-f9rmw" Jun 10 12:36:45.584822 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.583967 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/847f076b-7998-42c3-b0cd-77cdee30f5ac-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5jhbt\" (UID: \"847f076b-7998-42c3-b0cd-77cdee30f5ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jhbt" Jun 10 12:36:45.584822 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.584007 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b7b38392-e294-4941-813e-14c7e728b0bd-multus-conf-dir\") pod \"multus-2qfc9\" (UID: \"b7b38392-e294-4941-813e-14c7e728b0bd\") " pod="openshift-multus/multus-2qfc9" Jun 10 12:36:45.584822 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.584044 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9e6db1bd-99cf-4a32-b43f-4daca8b04204-system-cni-dir\") pod \"multus-additional-cni-plugins-q6jq4\" (UID: \"9e6db1bd-99cf-4a32-b43f-4daca8b04204\") " pod="openshift-multus/multus-additional-cni-plugins-q6jq4" Jun 10 12:36:45.584822 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.584070 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9ced5103-eb3b-4070-9c0a-06df4cd9c0a8-host\") pod \"node-ca-4c6gv\" (UID: \"9ced5103-eb3b-4070-9c0a-06df4cd9c0a8\") " pod="openshift-image-registry/node-ca-4c6gv" Jun 10 12:36:45.584822 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.584097 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b893d76d-5c4b-4d52-9658-7d87236b1b2e-kubelet-config\") pod \"global-pull-secret-syncer-q25rc\" (UID: \"b893d76d-5c4b-4d52-9658-7d87236b1b2e\") " pod="kube-system/global-pull-secret-syncer-q25rc" Jun 10 12:36:45.585552 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.584097 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9e6db1bd-99cf-4a32-b43f-4daca8b04204-system-cni-dir\") pod \"multus-additional-cni-plugins-q6jq4\" (UID: \"9e6db1bd-99cf-4a32-b43f-4daca8b04204\") " pod="openshift-multus/multus-additional-cni-plugins-q6jq4" Jun 10 12:36:45.585552 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.584121 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f324d4da-090d-4e3e-99f7-5a5393276463-hosts-file\") pod \"node-resolver-mvcnc\" (UID: \"f324d4da-090d-4e3e-99f7-5a5393276463\") " pod="openshift-dns/node-resolver-mvcnc" Jun 10 12:36:45.585552 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.584143 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9ced5103-eb3b-4070-9c0a-06df4cd9c0a8-host\") pod \"node-ca-4c6gv\" (UID: \"9ced5103-eb3b-4070-9c0a-06df4cd9c0a8\") " pod="openshift-image-registry/node-ca-4c6gv" Jun 10 12:36:45.585552 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.584148 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f324d4da-090d-4e3e-99f7-5a5393276463-tmp-dir\") pod \"node-resolver-mvcnc\" (UID: \"f324d4da-090d-4e3e-99f7-5a5393276463\") " pod="openshift-dns/node-resolver-mvcnc" Jun 10 12:36:45.585552 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.584200 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b7b38392-e294-4941-813e-14c7e728b0bd-host-run-k8s-cni-cncf-io\") pod \"multus-2qfc9\" (UID: \"b7b38392-e294-4941-813e-14c7e728b0bd\") " pod="openshift-multus/multus-2qfc9" Jun 10 12:36:45.585552 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.584234 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7a1ad94d-15c8-4022-8ab9-d7b292a60bdc-etc-sysconfig\") pod \"tuned-gj6k8\" (UID: \"7a1ad94d-15c8-4022-8ab9-d7b292a60bdc\") " pod="openshift-cluster-node-tuning-operator/tuned-gj6k8" Jun 10 12:36:45.585552 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.584262 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9e6db1bd-99cf-4a32-b43f-4daca8b04204-os-release\") pod \"multus-additional-cni-plugins-q6jq4\" (UID: \"9e6db1bd-99cf-4a32-b43f-4daca8b04204\") " pod="openshift-multus/multus-additional-cni-plugins-q6jq4" Jun 10 12:36:45.585552 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.584291 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/847f076b-7998-42c3-b0cd-77cdee30f5ac-run-systemd\") pod \"ovnkube-node-5jhbt\" (UID: \"847f076b-7998-42c3-b0cd-77cdee30f5ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jhbt" Jun 10 12:36:45.585552 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.584313 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/847f076b-7998-42c3-b0cd-77cdee30f5ac-ovnkube-config\") pod \"ovnkube-node-5jhbt\" (UID: \"847f076b-7998-42c3-b0cd-77cdee30f5ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jhbt" Jun 10 12:36:45.585552 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.584314 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8rpn\" (UniqueName: \"kubernetes.io/projected/9ed82178-699a-4219-84bc-d56643bb7337-kube-api-access-d8rpn\") pod \"network-check-target-p8pxq\" (UID: \"9ed82178-699a-4219-84bc-d56643bb7337\") " pod="openshift-network-diagnostics/network-check-target-p8pxq" Jun 10 12:36:45.585552 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.584318 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b7b38392-e294-4941-813e-14c7e728b0bd-host-run-k8s-cni-cncf-io\") pod \"multus-2qfc9\" (UID: \"b7b38392-e294-4941-813e-14c7e728b0bd\") " pod="openshift-multus/multus-2qfc9" Jun 10 12:36:45.585552 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.584366 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/847f076b-7998-42c3-b0cd-77cdee30f5ac-run-systemd\") pod \"ovnkube-node-5jhbt\" (UID: \"847f076b-7998-42c3-b0cd-77cdee30f5ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jhbt" Jun 10 12:36:45.585552 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.584359 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9e6db1bd-99cf-4a32-b43f-4daca8b04204-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-q6jq4\" (UID: \"9e6db1bd-99cf-4a32-b43f-4daca8b04204\") " pod="openshift-multus/multus-additional-cni-plugins-q6jq4" Jun 10 12:36:45.585552 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.584376 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9e6db1bd-99cf-4a32-b43f-4daca8b04204-os-release\") pod \"multus-additional-cni-plugins-q6jq4\" (UID: \"9e6db1bd-99cf-4a32-b43f-4daca8b04204\") " pod="openshift-multus/multus-additional-cni-plugins-q6jq4" Jun 10 12:36:45.585552 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.584403 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9ced5103-eb3b-4070-9c0a-06df4cd9c0a8-serviceca\") pod \"node-ca-4c6gv\" (UID: \"9ced5103-eb3b-4070-9c0a-06df4cd9c0a8\") " pod="openshift-image-registry/node-ca-4c6gv" Jun 10 12:36:45.585552 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.584427 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7a1ad94d-15c8-4022-8ab9-d7b292a60bdc-etc-sysconfig\") pod \"tuned-gj6k8\" (UID: \"7a1ad94d-15c8-4022-8ab9-d7b292a60bdc\") " pod="openshift-cluster-node-tuning-operator/tuned-gj6k8" Jun 10 12:36:45.585552 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.584433 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/847f076b-7998-42c3-b0cd-77cdee30f5ac-etc-openvswitch\") pod \"ovnkube-node-5jhbt\" (UID: \"847f076b-7998-42c3-b0cd-77cdee30f5ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jhbt" Jun 10 12:36:45.586389 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.584462 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/847f076b-7998-42c3-b0cd-77cdee30f5ac-etc-openvswitch\") pod \"ovnkube-node-5jhbt\" (UID: \"847f076b-7998-42c3-b0cd-77cdee30f5ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jhbt" Jun 10 12:36:45.586389 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.584469 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/847f076b-7998-42c3-b0cd-77cdee30f5ac-env-overrides\") pod \"ovnkube-node-5jhbt\" (UID: \"847f076b-7998-42c3-b0cd-77cdee30f5ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jhbt" Jun 10 12:36:45.586389 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.584497 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9e6db1bd-99cf-4a32-b43f-4daca8b04204-tuning-conf-dir\") pod \"multus-additional-cni-plugins-q6jq4\" (UID: \"9e6db1bd-99cf-4a32-b43f-4daca8b04204\") " pod="openshift-multus/multus-additional-cni-plugins-q6jq4" Jun 10 12:36:45.586389 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.584522 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxlc9\" (UniqueName: \"kubernetes.io/projected/9e6db1bd-99cf-4a32-b43f-4daca8b04204-kube-api-access-wxlc9\") pod \"multus-additional-cni-plugins-q6jq4\" (UID: \"9e6db1bd-99cf-4a32-b43f-4daca8b04204\") " pod="openshift-multus/multus-additional-cni-plugins-q6jq4" Jun 10 12:36:45.586389 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.584543 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b7b38392-e294-4941-813e-14c7e728b0bd-multus-socket-dir-parent\") pod \"multus-2qfc9\" (UID: \"b7b38392-e294-4941-813e-14c7e728b0bd\") " pod="openshift-multus/multus-2qfc9" Jun 10 12:36:45.586389 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.584564 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b7b38392-e294-4941-813e-14c7e728b0bd-host-var-lib-cni-multus\") pod \"multus-2qfc9\" (UID: \"b7b38392-e294-4941-813e-14c7e728b0bd\") " pod="openshift-multus/multus-2qfc9" Jun 10 12:36:45.586389 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.584585 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7a1ad94d-15c8-4022-8ab9-d7b292a60bdc-sys\") pod \"tuned-gj6k8\" (UID: \"7a1ad94d-15c8-4022-8ab9-d7b292a60bdc\") " pod="openshift-cluster-node-tuning-operator/tuned-gj6k8" Jun 10 12:36:45.586389 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.584607 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b7b38392-e294-4941-813e-14c7e728b0bd-system-cni-dir\") pod \"multus-2qfc9\" (UID: \"b7b38392-e294-4941-813e-14c7e728b0bd\") " pod="openshift-multus/multus-2qfc9" Jun 10 12:36:45.586389 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.584664 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1038db63-9904-4677-867f-21f05dd4095e-socket-dir\") pod \"aws-ebs-csi-driver-node-l26ng\" (UID: \"1038db63-9904-4677-867f-21f05dd4095e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l26ng" Jun 10 12:36:45.586389 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.584685 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9e6db1bd-99cf-4a32-b43f-4daca8b04204-tuning-conf-dir\") pod \"multus-additional-cni-plugins-q6jq4\" (UID: \"9e6db1bd-99cf-4a32-b43f-4daca8b04204\") " pod="openshift-multus/multus-additional-cni-plugins-q6jq4" Jun 10 12:36:45.586389 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.584735 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b7b38392-e294-4941-813e-14c7e728b0bd-multus-socket-dir-parent\") pod \"multus-2qfc9\" (UID: \"b7b38392-e294-4941-813e-14c7e728b0bd\") " pod="openshift-multus/multus-2qfc9" Jun 10 12:36:45.586389 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.584735 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7a1ad94d-15c8-4022-8ab9-d7b292a60bdc-etc-systemd\") pod \"tuned-gj6k8\" (UID: \"7a1ad94d-15c8-4022-8ab9-d7b292a60bdc\") " pod="openshift-cluster-node-tuning-operator/tuned-gj6k8" Jun 10 12:36:45.586389 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.584776 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b7b38392-e294-4941-813e-14c7e728b0bd-host-var-lib-cni-multus\") pod \"multus-2qfc9\" (UID: \"b7b38392-e294-4941-813e-14c7e728b0bd\") " pod="openshift-multus/multus-2qfc9" Jun 10 12:36:45.586389 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.584802 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b7b38392-e294-4941-813e-14c7e728b0bd-system-cni-dir\") pod \"multus-2qfc9\" (UID: \"b7b38392-e294-4941-813e-14c7e728b0bd\") " pod="openshift-multus/multus-2qfc9" Jun 10 12:36:45.586389 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.584823 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9ced5103-eb3b-4070-9c0a-06df4cd9c0a8-serviceca\") pod \"node-ca-4c6gv\" (UID: \"9ced5103-eb3b-4070-9c0a-06df4cd9c0a8\") " pod="openshift-image-registry/node-ca-4c6gv" Jun 10 12:36:45.586389 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.584688 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7a1ad94d-15c8-4022-8ab9-d7b292a60bdc-etc-systemd\") pod \"tuned-gj6k8\" (UID: \"7a1ad94d-15c8-4022-8ab9-d7b292a60bdc\") " pod="openshift-cluster-node-tuning-operator/tuned-gj6k8" Jun 10 12:36:45.586389 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.584845 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7a1ad94d-15c8-4022-8ab9-d7b292a60bdc-sys\") pod \"tuned-gj6k8\" (UID: \"7a1ad94d-15c8-4022-8ab9-d7b292a60bdc\") " pod="openshift-cluster-node-tuning-operator/tuned-gj6k8" Jun 10 12:36:45.586389 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.584873 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7a1ad94d-15c8-4022-8ab9-d7b292a60bdc-host\") pod \"tuned-gj6k8\" (UID: \"7a1ad94d-15c8-4022-8ab9-d7b292a60bdc\") " pod="openshift-cluster-node-tuning-operator/tuned-gj6k8" Jun 10 12:36:45.587177 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.584885 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1038db63-9904-4677-867f-21f05dd4095e-socket-dir\") pod \"aws-ebs-csi-driver-node-l26ng\" (UID: \"1038db63-9904-4677-867f-21f05dd4095e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l26ng" Jun 10 12:36:45.587177 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.584901 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/847f076b-7998-42c3-b0cd-77cdee30f5ac-host-slash\") pod \"ovnkube-node-5jhbt\" (UID: \"847f076b-7998-42c3-b0cd-77cdee30f5ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jhbt" Jun 10 12:36:45.587177 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.584930 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5c6b4070-7839-413d-bbf0-1e15a95201bd-host-slash\") pod \"iptables-alerter-688zv\" (UID: \"5c6b4070-7839-413d-bbf0-1e15a95201bd\") " pod="openshift-network-operator/iptables-alerter-688zv" Jun 10 12:36:45.587177 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.584945 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7a1ad94d-15c8-4022-8ab9-d7b292a60bdc-host\") pod \"tuned-gj6k8\" (UID: \"7a1ad94d-15c8-4022-8ab9-d7b292a60bdc\") " pod="openshift-cluster-node-tuning-operator/tuned-gj6k8" Jun 10 12:36:45.587177 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.584954 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b893d76d-5c4b-4d52-9658-7d87236b1b2e-dbus\") pod \"global-pull-secret-syncer-q25rc\" (UID: \"b893d76d-5c4b-4d52-9658-7d87236b1b2e\") " pod="kube-system/global-pull-secret-syncer-q25rc" Jun 10 12:36:45.587177 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.584957 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/847f076b-7998-42c3-b0cd-77cdee30f5ac-host-slash\") pod \"ovnkube-node-5jhbt\" (UID: \"847f076b-7998-42c3-b0cd-77cdee30f5ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jhbt" Jun 10 12:36:45.587177 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.585119 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/847f076b-7998-42c3-b0cd-77cdee30f5ac-env-overrides\") pod \"ovnkube-node-5jhbt\" (UID: \"847f076b-7998-42c3-b0cd-77cdee30f5ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jhbt" Jun 10 12:36:45.587177 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.585298 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9e6db1bd-99cf-4a32-b43f-4daca8b04204-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-q6jq4\" (UID: \"9e6db1bd-99cf-4a32-b43f-4daca8b04204\") " pod="openshift-multus/multus-additional-cni-plugins-q6jq4" Jun 10 12:36:45.587177 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.584989 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b893d76d-5c4b-4d52-9658-7d87236b1b2e-original-pull-secret\") pod \"global-pull-secret-syncer-q25rc\" (UID: \"b893d76d-5c4b-4d52-9658-7d87236b1b2e\") " pod="kube-system/global-pull-secret-syncer-q25rc" Jun 10 12:36:45.587177 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.585509 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1038db63-9904-4677-867f-21f05dd4095e-registration-dir\") pod \"aws-ebs-csi-driver-node-l26ng\" (UID: \"1038db63-9904-4677-867f-21f05dd4095e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l26ng" Jun 10 12:36:45.587177 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.585537 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7a1ad94d-15c8-4022-8ab9-d7b292a60bdc-etc-sysctl-conf\") pod \"tuned-gj6k8\" (UID: \"7a1ad94d-15c8-4022-8ab9-d7b292a60bdc\") " pod="openshift-cluster-node-tuning-operator/tuned-gj6k8" Jun 10 12:36:45.587177 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.585560 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/847f076b-7998-42c3-b0cd-77cdee30f5ac-ovnkube-script-lib\") pod \"ovnkube-node-5jhbt\" (UID: \"847f076b-7998-42c3-b0cd-77cdee30f5ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jhbt" Jun 10 12:36:45.587177 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.585581 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b7b38392-e294-4941-813e-14c7e728b0bd-cnibin\") pod \"multus-2qfc9\" (UID: \"b7b38392-e294-4941-813e-14c7e728b0bd\") " pod="openshift-multus/multus-2qfc9" Jun 10 12:36:45.587177 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.585603 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1038db63-9904-4677-867f-21f05dd4095e-device-dir\") pod \"aws-ebs-csi-driver-node-l26ng\" (UID: \"1038db63-9904-4677-867f-21f05dd4095e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l26ng" Jun 10 12:36:45.587177 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.585625 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1038db63-9904-4677-867f-21f05dd4095e-etc-selinux\") pod \"aws-ebs-csi-driver-node-l26ng\" (UID: \"1038db63-9904-4677-867f-21f05dd4095e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l26ng" Jun 10 12:36:45.587177 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.585631 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1038db63-9904-4677-867f-21f05dd4095e-registration-dir\") pod \"aws-ebs-csi-driver-node-l26ng\" (UID: \"1038db63-9904-4677-867f-21f05dd4095e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l26ng" Jun 10 12:36:45.587177 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.585647 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a1ad94d-15c8-4022-8ab9-d7b292a60bdc-tmp\") pod \"tuned-gj6k8\" (UID: \"7a1ad94d-15c8-4022-8ab9-d7b292a60bdc\") " pod="openshift-cluster-node-tuning-operator/tuned-gj6k8" Jun 10 12:36:45.588012 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.585671 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/847f076b-7998-42c3-b0cd-77cdee30f5ac-host-kubelet\") pod \"ovnkube-node-5jhbt\" (UID: \"847f076b-7998-42c3-b0cd-77cdee30f5ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jhbt" Jun 10 12:36:45.588012 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.585689 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b7b38392-e294-4941-813e-14c7e728b0bd-cnibin\") pod \"multus-2qfc9\" (UID: \"b7b38392-e294-4941-813e-14c7e728b0bd\") " pod="openshift-multus/multus-2qfc9" Jun 10 12:36:45.588012 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.585694 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/847f076b-7998-42c3-b0cd-77cdee30f5ac-run-openvswitch\") pod \"ovnkube-node-5jhbt\" (UID: \"847f076b-7998-42c3-b0cd-77cdee30f5ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jhbt" Jun 10 12:36:45.588012 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.585719 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b7b38392-e294-4941-813e-14c7e728b0bd-cni-binary-copy\") pod \"multus-2qfc9\" (UID: \"b7b38392-e294-4941-813e-14c7e728b0bd\") " pod="openshift-multus/multus-2qfc9" Jun 10 12:36:45.588012 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.585743 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7a1ad94d-15c8-4022-8ab9-d7b292a60bdc-etc-modprobe-d\") pod \"tuned-gj6k8\" (UID: \"7a1ad94d-15c8-4022-8ab9-d7b292a60bdc\") " pod="openshift-cluster-node-tuning-operator/tuned-gj6k8" Jun 10 12:36:45.588012 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.585753 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1038db63-9904-4677-867f-21f05dd4095e-etc-selinux\") pod \"aws-ebs-csi-driver-node-l26ng\" (UID: \"1038db63-9904-4677-867f-21f05dd4095e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l26ng" Jun 10 12:36:45.588012 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.585765 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/847f076b-7998-42c3-b0cd-77cdee30f5ac-host-cni-bin\") pod \"ovnkube-node-5jhbt\" (UID: \"847f076b-7998-42c3-b0cd-77cdee30f5ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jhbt" Jun 10 12:36:45.588012 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.585792 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kp8w5\" (UniqueName: \"kubernetes.io/projected/65533745-1c5b-48e0-b4a2-77fc1cc7908d-kube-api-access-kp8w5\") pod \"network-metrics-daemon-n4lrk\" (UID: \"65533745-1c5b-48e0-b4a2-77fc1cc7908d\") " pod="openshift-multus/network-metrics-daemon-n4lrk" Jun 10 12:36:45.588012 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.585814 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1038db63-9904-4677-867f-21f05dd4095e-device-dir\") pod \"aws-ebs-csi-driver-node-l26ng\" (UID: \"1038db63-9904-4677-867f-21f05dd4095e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l26ng" Jun 10 12:36:45.588012 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.585822 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b7b38392-e294-4941-813e-14c7e728b0bd-multus-cni-dir\") pod \"multus-2qfc9\" (UID: \"b7b38392-e294-4941-813e-14c7e728b0bd\") " pod="openshift-multus/multus-2qfc9" Jun 10 12:36:45.588012 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.585848 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8s6pm\" (UniqueName: \"kubernetes.io/projected/b7b38392-e294-4941-813e-14c7e728b0bd-kube-api-access-8s6pm\") pod \"multus-2qfc9\" (UID: \"b7b38392-e294-4941-813e-14c7e728b0bd\") " pod="openshift-multus/multus-2qfc9" Jun 10 12:36:45.588012 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.585871 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0b5cd784-4247-44f1-b9cd-394ae4294de9-konnectivity-ca\") pod \"konnectivity-agent-f9rmw\" (UID: \"0b5cd784-4247-44f1-b9cd-394ae4294de9\") " pod="kube-system/konnectivity-agent-f9rmw" Jun 10 12:36:45.588012 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.585895 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7a1ad94d-15c8-4022-8ab9-d7b292a60bdc-etc-kubernetes\") pod \"tuned-gj6k8\" (UID: \"7a1ad94d-15c8-4022-8ab9-d7b292a60bdc\") " pod="openshift-cluster-node-tuning-operator/tuned-gj6k8" Jun 10 12:36:45.588012 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.585894 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/847f076b-7998-42c3-b0cd-77cdee30f5ac-host-kubelet\") pod \"ovnkube-node-5jhbt\" (UID: \"847f076b-7998-42c3-b0cd-77cdee30f5ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jhbt" Jun 10 12:36:45.588012 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.585930 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/847f076b-7998-42c3-b0cd-77cdee30f5ac-run-openvswitch\") pod \"ovnkube-node-5jhbt\" (UID: \"847f076b-7998-42c3-b0cd-77cdee30f5ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jhbt" Jun 10 12:36:45.588012 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.585962 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5c6b4070-7839-413d-bbf0-1e15a95201bd-iptables-alerter-script\") pod \"iptables-alerter-688zv\" (UID: \"5c6b4070-7839-413d-bbf0-1e15a95201bd\") " pod="openshift-network-operator/iptables-alerter-688zv" Jun 10 12:36:45.588012 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.586002 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7a1ad94d-15c8-4022-8ab9-d7b292a60bdc-etc-modprobe-d\") pod \"tuned-gj6k8\" (UID: \"7a1ad94d-15c8-4022-8ab9-d7b292a60bdc\") " pod="openshift-cluster-node-tuning-operator/tuned-gj6k8" Jun 10 12:36:45.588879 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.586017 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbvlb\" (UniqueName: \"kubernetes.io/projected/5c6b4070-7839-413d-bbf0-1e15a95201bd-kube-api-access-sbvlb\") pod \"iptables-alerter-688zv\" (UID: \"5c6b4070-7839-413d-bbf0-1e15a95201bd\") " pod="openshift-network-operator/iptables-alerter-688zv" Jun 10 12:36:45.588879 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.586039 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcbm8\" (UniqueName: \"kubernetes.io/projected/f324d4da-090d-4e3e-99f7-5a5393276463-kube-api-access-rcbm8\") pod \"node-resolver-mvcnc\" (UID: \"f324d4da-090d-4e3e-99f7-5a5393276463\") " pod="openshift-dns/node-resolver-mvcnc" Jun 10 12:36:45.588879 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.586074 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m69pz\" (UniqueName: \"kubernetes.io/projected/1038db63-9904-4677-867f-21f05dd4095e-kube-api-access-m69pz\") pod \"aws-ebs-csi-driver-node-l26ng\" (UID: \"1038db63-9904-4677-867f-21f05dd4095e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l26ng" Jun 10 12:36:45.588879 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.586095 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/847f076b-7998-42c3-b0cd-77cdee30f5ac-host-cni-netd\") pod \"ovnkube-node-5jhbt\" (UID: \"847f076b-7998-42c3-b0cd-77cdee30f5ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jhbt" Jun 10 12:36:45.588879 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.586117 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b7b38392-e294-4941-813e-14c7e728b0bd-etc-kubernetes\") pod \"multus-2qfc9\" (UID: \"b7b38392-e294-4941-813e-14c7e728b0bd\") " pod="openshift-multus/multus-2qfc9" Jun 10 12:36:45.588879 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.586139 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7a1ad94d-15c8-4022-8ab9-d7b292a60bdc-lib-modules\") pod \"tuned-gj6k8\" (UID: \"7a1ad94d-15c8-4022-8ab9-d7b292a60bdc\") " pod="openshift-cluster-node-tuning-operator/tuned-gj6k8" Jun 10 12:36:45.588879 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.586142 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b7b38392-e294-4941-813e-14c7e728b0bd-multus-cni-dir\") pod \"multus-2qfc9\" (UID: \"b7b38392-e294-4941-813e-14c7e728b0bd\") " pod="openshift-multus/multus-2qfc9" Jun 10 12:36:45.588879 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.586131 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/847f076b-7998-42c3-b0cd-77cdee30f5ac-ovnkube-script-lib\") pod \"ovnkube-node-5jhbt\" (UID: \"847f076b-7998-42c3-b0cd-77cdee30f5ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jhbt" Jun 10 12:36:45.588879 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.585690 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7a1ad94d-15c8-4022-8ab9-d7b292a60bdc-etc-sysctl-conf\") pod \"tuned-gj6k8\" (UID: \"7a1ad94d-15c8-4022-8ab9-d7b292a60bdc\") " pod="openshift-cluster-node-tuning-operator/tuned-gj6k8" Jun 10 12:36:45.588879 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.586166 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjcxb\" (UniqueName: \"kubernetes.io/projected/847f076b-7998-42c3-b0cd-77cdee30f5ac-kube-api-access-vjcxb\") pod \"ovnkube-node-5jhbt\" (UID: \"847f076b-7998-42c3-b0cd-77cdee30f5ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jhbt" Jun 10 12:36:45.588879 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.586046 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/847f076b-7998-42c3-b0cd-77cdee30f5ac-host-cni-bin\") pod \"ovnkube-node-5jhbt\" (UID: \"847f076b-7998-42c3-b0cd-77cdee30f5ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jhbt" Jun 10 12:36:45.588879 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.586497 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b7b38392-e294-4941-813e-14c7e728b0bd-etc-kubernetes\") pod \"multus-2qfc9\" (UID: \"b7b38392-e294-4941-813e-14c7e728b0bd\") " pod="openshift-multus/multus-2qfc9" Jun 10 12:36:45.588879 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.586547 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/847f076b-7998-42c3-b0cd-77cdee30f5ac-host-cni-netd\") pod \"ovnkube-node-5jhbt\" (UID: \"847f076b-7998-42c3-b0cd-77cdee30f5ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jhbt" Jun 10 12:36:45.588879 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.586629 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7a1ad94d-15c8-4022-8ab9-d7b292a60bdc-lib-modules\") pod \"tuned-gj6k8\" (UID: \"7a1ad94d-15c8-4022-8ab9-d7b292a60bdc\") " pod="openshift-cluster-node-tuning-operator/tuned-gj6k8" Jun 10 12:36:45.588879 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.586650 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b7b38392-e294-4941-813e-14c7e728b0bd-cni-binary-copy\") pod \"multus-2qfc9\" (UID: \"b7b38392-e294-4941-813e-14c7e728b0bd\") " pod="openshift-multus/multus-2qfc9" Jun 10 12:36:45.588879 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.586736 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7a1ad94d-15c8-4022-8ab9-d7b292a60bdc-etc-kubernetes\") pod \"tuned-gj6k8\" (UID: \"7a1ad94d-15c8-4022-8ab9-d7b292a60bdc\") " pod="openshift-cluster-node-tuning-operator/tuned-gj6k8" Jun 10 12:36:45.588879 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.587024 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/847f076b-7998-42c3-b0cd-77cdee30f5ac-ovn-node-metrics-cert\") pod \"ovnkube-node-5jhbt\" (UID: \"847f076b-7998-42c3-b0cd-77cdee30f5ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jhbt" Jun 10 12:36:45.589659 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.587135 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0b5cd784-4247-44f1-b9cd-394ae4294de9-konnectivity-ca\") pod \"konnectivity-agent-f9rmw\" (UID: \"0b5cd784-4247-44f1-b9cd-394ae4294de9\") " pod="kube-system/konnectivity-agent-f9rmw" Jun 10 12:36:45.589659 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.587567 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7a1ad94d-15c8-4022-8ab9-d7b292a60bdc-etc-tuned\") pod \"tuned-gj6k8\" (UID: \"7a1ad94d-15c8-4022-8ab9-d7b292a60bdc\") " pod="openshift-cluster-node-tuning-operator/tuned-gj6k8" Jun 10 12:36:45.589659 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.587913 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0b5cd784-4247-44f1-b9cd-394ae4294de9-agent-certs\") pod \"konnectivity-agent-f9rmw\" (UID: \"0b5cd784-4247-44f1-b9cd-394ae4294de9\") " pod="kube-system/konnectivity-agent-f9rmw" Jun 10 12:36:45.589659 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.588564 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a1ad94d-15c8-4022-8ab9-d7b292a60bdc-tmp\") pod \"tuned-gj6k8\" (UID: \"7a1ad94d-15c8-4022-8ab9-d7b292a60bdc\") " pod="openshift-cluster-node-tuning-operator/tuned-gj6k8" Jun 10 12:36:45.596506 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.596487 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxlc9\" (UniqueName: \"kubernetes.io/projected/9e6db1bd-99cf-4a32-b43f-4daca8b04204-kube-api-access-wxlc9\") pod \"multus-additional-cni-plugins-q6jq4\" (UID: \"9e6db1bd-99cf-4a32-b43f-4daca8b04204\") " pod="openshift-multus/multus-additional-cni-plugins-q6jq4" Jun 10 12:36:45.596834 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.596816 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpkjd\" (UniqueName: \"kubernetes.io/projected/7a1ad94d-15c8-4022-8ab9-d7b292a60bdc-kube-api-access-fpkjd\") pod \"tuned-gj6k8\" (UID: \"7a1ad94d-15c8-4022-8ab9-d7b292a60bdc\") " pod="openshift-cluster-node-tuning-operator/tuned-gj6k8" Jun 10 12:36:45.599433 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.599414 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m69pz\" (UniqueName: \"kubernetes.io/projected/1038db63-9904-4677-867f-21f05dd4095e-kube-api-access-m69pz\") pod \"aws-ebs-csi-driver-node-l26ng\" (UID: \"1038db63-9904-4677-867f-21f05dd4095e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l26ng" Jun 10 12:36:45.599662 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.599635 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjcxb\" (UniqueName: \"kubernetes.io/projected/847f076b-7998-42c3-b0cd-77cdee30f5ac-kube-api-access-vjcxb\") pod \"ovnkube-node-5jhbt\" (UID: \"847f076b-7998-42c3-b0cd-77cdee30f5ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jhbt" Jun 10 12:36:45.600360 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.600342 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5n75\" (UniqueName: \"kubernetes.io/projected/9ced5103-eb3b-4070-9c0a-06df4cd9c0a8-kube-api-access-p5n75\") pod \"node-ca-4c6gv\" (UID: \"9ced5103-eb3b-4070-9c0a-06df4cd9c0a8\") " pod="openshift-image-registry/node-ca-4c6gv" Jun 10 12:36:45.602538 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.602519 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8s6pm\" (UniqueName: \"kubernetes.io/projected/b7b38392-e294-4941-813e-14c7e728b0bd-kube-api-access-8s6pm\") pod \"multus-2qfc9\" (UID: \"b7b38392-e294-4941-813e-14c7e728b0bd\") " pod="openshift-multus/multus-2qfc9" Jun 10 12:36:45.687468 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.687433 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65533745-1c5b-48e0-b4a2-77fc1cc7908d-metrics-certs\") pod \"network-metrics-daemon-n4lrk\" (UID: \"65533745-1c5b-48e0-b4a2-77fc1cc7908d\") " pod="openshift-multus/network-metrics-daemon-n4lrk" Jun 10 12:36:45.687622 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.687478 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b893d76d-5c4b-4d52-9658-7d87236b1b2e-kubelet-config\") pod \"global-pull-secret-syncer-q25rc\" (UID: \"b893d76d-5c4b-4d52-9658-7d87236b1b2e\") " pod="kube-system/global-pull-secret-syncer-q25rc" Jun 10 12:36:45.687622 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.687494 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f324d4da-090d-4e3e-99f7-5a5393276463-hosts-file\") pod \"node-resolver-mvcnc\" (UID: \"f324d4da-090d-4e3e-99f7-5a5393276463\") " pod="openshift-dns/node-resolver-mvcnc" Jun 10 12:36:45.687622 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.687514 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f324d4da-090d-4e3e-99f7-5a5393276463-tmp-dir\") pod \"node-resolver-mvcnc\" (UID: \"f324d4da-090d-4e3e-99f7-5a5393276463\") " pod="openshift-dns/node-resolver-mvcnc" Jun 10 12:36:45.687622 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.687538 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8rpn\" (UniqueName: \"kubernetes.io/projected/9ed82178-699a-4219-84bc-d56643bb7337-kube-api-access-d8rpn\") pod \"network-check-target-p8pxq\" (UID: \"9ed82178-699a-4219-84bc-d56643bb7337\") " pod="openshift-network-diagnostics/network-check-target-p8pxq" Jun 10 12:36:45.687622 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.687568 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5c6b4070-7839-413d-bbf0-1e15a95201bd-host-slash\") pod \"iptables-alerter-688zv\" (UID: \"5c6b4070-7839-413d-bbf0-1e15a95201bd\") " pod="openshift-network-operator/iptables-alerter-688zv" Jun 10 12:36:45.687622 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.687579 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b893d76d-5c4b-4d52-9658-7d87236b1b2e-kubelet-config\") pod \"global-pull-secret-syncer-q25rc\" (UID: \"b893d76d-5c4b-4d52-9658-7d87236b1b2e\") " pod="kube-system/global-pull-secret-syncer-q25rc" Jun 10 12:36:45.687622 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.687589 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b893d76d-5c4b-4d52-9658-7d87236b1b2e-dbus\") pod \"global-pull-secret-syncer-q25rc\" (UID: \"b893d76d-5c4b-4d52-9658-7d87236b1b2e\") " pod="kube-system/global-pull-secret-syncer-q25rc" Jun 10 12:36:45.687622 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.687590 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f324d4da-090d-4e3e-99f7-5a5393276463-hosts-file\") pod \"node-resolver-mvcnc\" (UID: \"f324d4da-090d-4e3e-99f7-5a5393276463\") " pod="openshift-dns/node-resolver-mvcnc" Jun 10 12:36:45.687622 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:36:45.687596 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 12:36:45.687622 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.687611 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b893d76d-5c4b-4d52-9658-7d87236b1b2e-original-pull-secret\") pod \"global-pull-secret-syncer-q25rc\" (UID: \"b893d76d-5c4b-4d52-9658-7d87236b1b2e\") " pod="kube-system/global-pull-secret-syncer-q25rc" Jun 10 12:36:45.688072 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.687631 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5c6b4070-7839-413d-bbf0-1e15a95201bd-host-slash\") pod \"iptables-alerter-688zv\" (UID: \"5c6b4070-7839-413d-bbf0-1e15a95201bd\") " pod="openshift-network-operator/iptables-alerter-688zv" Jun 10 12:36:45.688072 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.687644 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kp8w5\" (UniqueName: \"kubernetes.io/projected/65533745-1c5b-48e0-b4a2-77fc1cc7908d-kube-api-access-kp8w5\") pod \"network-metrics-daemon-n4lrk\" (UID: \"65533745-1c5b-48e0-b4a2-77fc1cc7908d\") " pod="openshift-multus/network-metrics-daemon-n4lrk" Jun 10 12:36:45.688072 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:36:45.687673 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65533745-1c5b-48e0-b4a2-77fc1cc7908d-metrics-certs podName:65533745-1c5b-48e0-b4a2-77fc1cc7908d nodeName:}" failed. No retries permitted until 2026-06-10 12:36:46.187651537 +0000 UTC m=+3.070255606 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/65533745-1c5b-48e0-b4a2-77fc1cc7908d-metrics-certs") pod "network-metrics-daemon-n4lrk" (UID: "65533745-1c5b-48e0-b4a2-77fc1cc7908d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 12:36:45.688072 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.687709 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5c6b4070-7839-413d-bbf0-1e15a95201bd-iptables-alerter-script\") pod \"iptables-alerter-688zv\" (UID: \"5c6b4070-7839-413d-bbf0-1e15a95201bd\") " pod="openshift-network-operator/iptables-alerter-688zv" Jun 10 12:36:45.688072 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.687736 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbvlb\" (UniqueName: \"kubernetes.io/projected/5c6b4070-7839-413d-bbf0-1e15a95201bd-kube-api-access-sbvlb\") pod \"iptables-alerter-688zv\" (UID: \"5c6b4070-7839-413d-bbf0-1e15a95201bd\") " pod="openshift-network-operator/iptables-alerter-688zv" Jun 10 12:36:45.688072 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.687759 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b893d76d-5c4b-4d52-9658-7d87236b1b2e-dbus\") pod \"global-pull-secret-syncer-q25rc\" (UID: \"b893d76d-5c4b-4d52-9658-7d87236b1b2e\") " pod="kube-system/global-pull-secret-syncer-q25rc" Jun 10 12:36:45.688072 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.687758 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcbm8\" (UniqueName: \"kubernetes.io/projected/f324d4da-090d-4e3e-99f7-5a5393276463-kube-api-access-rcbm8\") pod \"node-resolver-mvcnc\" (UID: \"f324d4da-090d-4e3e-99f7-5a5393276463\") " pod="openshift-dns/node-resolver-mvcnc" Jun 10 12:36:45.688072 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:36:45.687811 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 12:36:45.688072 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.687848 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f324d4da-090d-4e3e-99f7-5a5393276463-tmp-dir\") pod \"node-resolver-mvcnc\" (UID: \"f324d4da-090d-4e3e-99f7-5a5393276463\") " pod="openshift-dns/node-resolver-mvcnc" Jun 10 12:36:45.688072 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:36:45.687855 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b893d76d-5c4b-4d52-9658-7d87236b1b2e-original-pull-secret podName:b893d76d-5c4b-4d52-9658-7d87236b1b2e nodeName:}" failed. No retries permitted until 2026-06-10 12:36:46.187840127 +0000 UTC m=+3.070444220 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b893d76d-5c4b-4d52-9658-7d87236b1b2e-original-pull-secret") pod "global-pull-secret-syncer-q25rc" (UID: "b893d76d-5c4b-4d52-9658-7d87236b1b2e") : object "kube-system"/"original-pull-secret" not registered Jun 10 12:36:45.688571 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.688362 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5c6b4070-7839-413d-bbf0-1e15a95201bd-iptables-alerter-script\") pod \"iptables-alerter-688zv\" (UID: \"5c6b4070-7839-413d-bbf0-1e15a95201bd\") " pod="openshift-network-operator/iptables-alerter-688zv" Jun 10 12:36:45.694454 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:36:45.694434 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 12:36:45.694565 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:36:45.694460 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 12:36:45.694565 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:36:45.694474 2557 projected.go:196] Error preparing data for projected volume kube-api-access-d8rpn for pod openshift-network-diagnostics/network-check-target-p8pxq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 12:36:45.694565 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:36:45.694519 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ed82178-699a-4219-84bc-d56643bb7337-kube-api-access-d8rpn podName:9ed82178-699a-4219-84bc-d56643bb7337 nodeName:}" failed. No retries permitted until 2026-06-10 12:36:46.194508103 +0000 UTC m=+3.077112175 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-d8rpn" (UniqueName: "kubernetes.io/projected/9ed82178-699a-4219-84bc-d56643bb7337-kube-api-access-d8rpn") pod "network-check-target-p8pxq" (UID: "9ed82178-699a-4219-84bc-d56643bb7337") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 12:36:45.698377 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.698357 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcbm8\" (UniqueName: \"kubernetes.io/projected/f324d4da-090d-4e3e-99f7-5a5393276463-kube-api-access-rcbm8\") pod \"node-resolver-mvcnc\" (UID: \"f324d4da-090d-4e3e-99f7-5a5393276463\") " pod="openshift-dns/node-resolver-mvcnc" Jun 10 12:36:45.698492 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.698473 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbvlb\" (UniqueName: \"kubernetes.io/projected/5c6b4070-7839-413d-bbf0-1e15a95201bd-kube-api-access-sbvlb\") pod \"iptables-alerter-688zv\" (UID: \"5c6b4070-7839-413d-bbf0-1e15a95201bd\") " pod="openshift-network-operator/iptables-alerter-688zv" Jun 10 12:36:45.698751 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.698733 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kp8w5\" (UniqueName: \"kubernetes.io/projected/65533745-1c5b-48e0-b4a2-77fc1cc7908d-kube-api-access-kp8w5\") pod \"network-metrics-daemon-n4lrk\" (UID: \"65533745-1c5b-48e0-b4a2-77fc1cc7908d\") " pod="openshift-multus/network-metrics-daemon-n4lrk" Jun 10 12:36:45.779022 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.778998 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2qfc9" Jun 10 12:36:45.784280 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.784258 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l26ng" Jun 10 12:36:45.792055 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.792036 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-f9rmw" Jun 10 12:36:45.797655 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.797639 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-gj6k8" Jun 10 12:36:45.805611 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.805595 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-q6jq4" Jun 10 12:36:45.812256 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.812239 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4c6gv" Jun 10 12:36:45.819882 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.819859 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5jhbt" Jun 10 12:36:45.828396 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.828377 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-688zv" Jun 10 12:36:45.833072 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:45.833041 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mvcnc" Jun 10 12:36:46.185610 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:46.185575 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod847f076b_7998_42c3_b0cd_77cdee30f5ac.slice/crio-12ba43fc05150fb2fb5f3d63aace778a1bd11ebcea544ddf57fb759716de7a0c WatchSource:0}: Error finding container 12ba43fc05150fb2fb5f3d63aace778a1bd11ebcea544ddf57fb759716de7a0c: Status 404 returned error can't find the container with id 12ba43fc05150fb2fb5f3d63aace778a1bd11ebcea544ddf57fb759716de7a0c Jun 10 12:36:46.187002 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:46.186667 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf324d4da_090d_4e3e_99f7_5a5393276463.slice/crio-211c33a23e9f37d6334428582e1d08cfb73d89380a3263f1f6fce1c3d7a87f53 WatchSource:0}: Error finding container 211c33a23e9f37d6334428582e1d08cfb73d89380a3263f1f6fce1c3d7a87f53: Status 404 returned error can't find the container with id 211c33a23e9f37d6334428582e1d08cfb73d89380a3263f1f6fce1c3d7a87f53 Jun 10 12:36:46.190564 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:46.190544 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c6b4070_7839_413d_bbf0_1e15a95201bd.slice/crio-7496b1bc681109fe9c41de6f602fa9d9b510460930b78597e7cf01ee90fcc5eb WatchSource:0}: Error finding container 7496b1bc681109fe9c41de6f602fa9d9b510460930b78597e7cf01ee90fcc5eb: Status 404 returned error can't find the container with id 7496b1bc681109fe9c41de6f602fa9d9b510460930b78597e7cf01ee90fcc5eb Jun 10 12:36:46.192071 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:46.192048 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65533745-1c5b-48e0-b4a2-77fc1cc7908d-metrics-certs\") pod \"network-metrics-daemon-n4lrk\" (UID: \"65533745-1c5b-48e0-b4a2-77fc1cc7908d\") " pod="openshift-multus/network-metrics-daemon-n4lrk" Jun 10 12:36:46.192170 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:46.192121 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b893d76d-5c4b-4d52-9658-7d87236b1b2e-original-pull-secret\") pod \"global-pull-secret-syncer-q25rc\" (UID: \"b893d76d-5c4b-4d52-9658-7d87236b1b2e\") " pod="kube-system/global-pull-secret-syncer-q25rc" Jun 10 12:36:46.192262 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:36:46.192227 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 12:36:46.192262 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:36:46.192243 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 12:36:46.192378 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:36:46.192280 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65533745-1c5b-48e0-b4a2-77fc1cc7908d-metrics-certs podName:65533745-1c5b-48e0-b4a2-77fc1cc7908d nodeName:}" failed. No retries permitted until 2026-06-10 12:36:47.192261454 +0000 UTC m=+4.074865521 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/65533745-1c5b-48e0-b4a2-77fc1cc7908d-metrics-certs") pod "network-metrics-daemon-n4lrk" (UID: "65533745-1c5b-48e0-b4a2-77fc1cc7908d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 12:36:46.192378 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:36:46.192299 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b893d76d-5c4b-4d52-9658-7d87236b1b2e-original-pull-secret podName:b893d76d-5c4b-4d52-9658-7d87236b1b2e nodeName:}" failed. No retries permitted until 2026-06-10 12:36:47.19228996 +0000 UTC m=+4.074894017 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b893d76d-5c4b-4d52-9658-7d87236b1b2e-original-pull-secret") pod "global-pull-secret-syncer-q25rc" (UID: "b893d76d-5c4b-4d52-9658-7d87236b1b2e") : object "kube-system"/"original-pull-secret" not registered Jun 10 12:36:46.192378 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:46.192307 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ced5103_eb3b_4070_9c0a_06df4cd9c0a8.slice/crio-c3511df37ee59b856b90460bc2975b589b7663e8aa88c186556819da3b48d55a WatchSource:0}: Error finding container c3511df37ee59b856b90460bc2975b589b7663e8aa88c186556819da3b48d55a: Status 404 returned error can't find the container with id c3511df37ee59b856b90460bc2975b589b7663e8aa88c186556819da3b48d55a Jun 10 12:36:46.193091 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:46.193073 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e6db1bd_99cf_4a32_b43f_4daca8b04204.slice/crio-8a36057315fed39e441926c2f9bb4f83b98840264e3566796653eade65913495 WatchSource:0}: Error finding container 8a36057315fed39e441926c2f9bb4f83b98840264e3566796653eade65913495: Status 404 returned error can't find the container with id 8a36057315fed39e441926c2f9bb4f83b98840264e3566796653eade65913495 Jun 10 12:36:46.194723 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:46.194663 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1038db63_9904_4677_867f_21f05dd4095e.slice/crio-7f35f34d00d929feaaf53c7a106362e2ea642f1aee80277d6d84ef2272c9c750 WatchSource:0}: Error finding container 7f35f34d00d929feaaf53c7a106362e2ea642f1aee80277d6d84ef2272c9c750: Status 404 returned error can't find the container with id 7f35f34d00d929feaaf53c7a106362e2ea642f1aee80277d6d84ef2272c9c750 Jun 10 12:36:46.195755 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:46.195740 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7b38392_e294_4941_813e_14c7e728b0bd.slice/crio-590a12b36d572818583d4bcdbe6bd9727abcce517847249eae9146b69ae09353 WatchSource:0}: Error finding container 590a12b36d572818583d4bcdbe6bd9727abcce517847249eae9146b69ae09353: Status 404 returned error can't find the container with id 590a12b36d572818583d4bcdbe6bd9727abcce517847249eae9146b69ae09353 Jun 10 12:36:46.196967 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:36:46.196941 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a1ad94d_15c8_4022_8ab9_d7b292a60bdc.slice/crio-8acaf11c41c343b1e2f610bf94fc2fcb260db4973971b1091f274fa1cb241aff WatchSource:0}: Error finding container 8acaf11c41c343b1e2f610bf94fc2fcb260db4973971b1091f274fa1cb241aff: Status 404 returned error can't find the container with id 8acaf11c41c343b1e2f610bf94fc2fcb260db4973971b1091f274fa1cb241aff Jun 10 12:36:46.293214 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:46.293061 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8rpn\" (UniqueName: \"kubernetes.io/projected/9ed82178-699a-4219-84bc-d56643bb7337-kube-api-access-d8rpn\") pod \"network-check-target-p8pxq\" (UID: \"9ed82178-699a-4219-84bc-d56643bb7337\") " pod="openshift-network-diagnostics/network-check-target-p8pxq" Jun 10 12:36:46.293300 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:36:46.293237 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 12:36:46.293300 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:36:46.293258 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 12:36:46.293300 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:36:46.293267 2557 projected.go:196] Error preparing data for projected volume kube-api-access-d8rpn for pod openshift-network-diagnostics/network-check-target-p8pxq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 12:36:46.293404 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:36:46.293310 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ed82178-699a-4219-84bc-d56643bb7337-kube-api-access-d8rpn podName:9ed82178-699a-4219-84bc-d56643bb7337 nodeName:}" failed. No retries permitted until 2026-06-10 12:36:47.293297187 +0000 UTC m=+4.175901239 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-d8rpn" (UniqueName: "kubernetes.io/projected/9ed82178-699a-4219-84bc-d56643bb7337-kube-api-access-d8rpn") pod "network-check-target-p8pxq" (UID: "9ed82178-699a-4219-84bc-d56643bb7337") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 12:36:46.525805 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:46.525754 2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-09 12:31:45 +0000 UTC" deadline="2027-11-11 17:42:07.317878879 +0000 UTC" Jun 10 12:36:46.525805 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:46.525800 2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12461h5m20.79208178s" Jun 10 12:36:46.545508 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:46.545474 2557 generic.go:356] "Generic (PLEG): container finished" podID="28b90b0c042d27f85555b2608eecccce" containerID="f1b65354495b4ba931b018cc07aeeea38cad91a91aa452be560226f86f8effd6" exitCode=0 Jun 10 12:36:46.545686 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:46.545645 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-72.ec2.internal" event={"ID":"28b90b0c042d27f85555b2608eecccce","Type":"ContainerDied","Data":"f1b65354495b4ba931b018cc07aeeea38cad91a91aa452be560226f86f8effd6"} Jun 10 12:36:46.547493 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:46.547417 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4c6gv" event={"ID":"9ced5103-eb3b-4070-9c0a-06df4cd9c0a8","Type":"ContainerStarted","Data":"c3511df37ee59b856b90460bc2975b589b7663e8aa88c186556819da3b48d55a"} Jun 10 12:36:46.548857 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:46.548834 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-f9rmw" event={"ID":"0b5cd784-4247-44f1-b9cd-394ae4294de9","Type":"ContainerStarted","Data":"784faf53cef0b257d109aafb160bb2801cf24df7f044a854eb6f28174dc976c5"} Jun 10 12:36:46.551429 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:46.551205 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mvcnc" event={"ID":"f324d4da-090d-4e3e-99f7-5a5393276463","Type":"ContainerStarted","Data":"211c33a23e9f37d6334428582e1d08cfb73d89380a3263f1f6fce1c3d7a87f53"} Jun 10 12:36:46.552901 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:46.552873 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5jhbt" event={"ID":"847f076b-7998-42c3-b0cd-77cdee30f5ac","Type":"ContainerStarted","Data":"12ba43fc05150fb2fb5f3d63aace778a1bd11ebcea544ddf57fb759716de7a0c"} Jun 10 12:36:46.554777 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:46.554753 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-72.ec2.internal" event={"ID":"6b087f13d248dbe4b0232602445486c4","Type":"ContainerStarted","Data":"734f2ea1d05e0e5d7e37f2383658efd65d8a177eca701b8a9725e97467950c0e"} Jun 10 12:36:46.557070 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:46.556981 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2qfc9" event={"ID":"b7b38392-e294-4941-813e-14c7e728b0bd","Type":"ContainerStarted","Data":"590a12b36d572818583d4bcdbe6bd9727abcce517847249eae9146b69ae09353"} Jun 10 12:36:46.559268 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:46.559233 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-gj6k8" event={"ID":"7a1ad94d-15c8-4022-8ab9-d7b292a60bdc","Type":"ContainerStarted","Data":"8acaf11c41c343b1e2f610bf94fc2fcb260db4973971b1091f274fa1cb241aff"} Jun 10 12:36:46.564839 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:46.564813 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l26ng" event={"ID":"1038db63-9904-4677-867f-21f05dd4095e","Type":"ContainerStarted","Data":"7f35f34d00d929feaaf53c7a106362e2ea642f1aee80277d6d84ef2272c9c750"} Jun 10 12:36:46.568491 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:46.568425 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q6jq4" event={"ID":"9e6db1bd-99cf-4a32-b43f-4daca8b04204","Type":"ContainerStarted","Data":"8a36057315fed39e441926c2f9bb4f83b98840264e3566796653eade65913495"} Jun 10 12:36:46.570110 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:46.570059 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-688zv" event={"ID":"5c6b4070-7839-413d-bbf0-1e15a95201bd","Type":"ContainerStarted","Data":"7496b1bc681109fe9c41de6f602fa9d9b510460930b78597e7cf01ee90fcc5eb"} Jun 10 12:36:47.201481 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:47.201443 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65533745-1c5b-48e0-b4a2-77fc1cc7908d-metrics-certs\") pod \"network-metrics-daemon-n4lrk\" (UID: \"65533745-1c5b-48e0-b4a2-77fc1cc7908d\") " pod="openshift-multus/network-metrics-daemon-n4lrk" Jun 10 12:36:47.201650 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:47.201538 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b893d76d-5c4b-4d52-9658-7d87236b1b2e-original-pull-secret\") pod \"global-pull-secret-syncer-q25rc\" (UID: \"b893d76d-5c4b-4d52-9658-7d87236b1b2e\") " pod="kube-system/global-pull-secret-syncer-q25rc" Jun 10 12:36:47.201723 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:36:47.201665 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 12:36:47.201775 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:36:47.201729 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b893d76d-5c4b-4d52-9658-7d87236b1b2e-original-pull-secret podName:b893d76d-5c4b-4d52-9658-7d87236b1b2e nodeName:}" failed. No retries permitted until 2026-06-10 12:36:49.201711557 +0000 UTC m=+6.084315612 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b893d76d-5c4b-4d52-9658-7d87236b1b2e-original-pull-secret") pod "global-pull-secret-syncer-q25rc" (UID: "b893d76d-5c4b-4d52-9658-7d87236b1b2e") : object "kube-system"/"original-pull-secret" not registered Jun 10 12:36:47.202133 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:36:47.202110 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 12:36:47.202233 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:36:47.202173 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65533745-1c5b-48e0-b4a2-77fc1cc7908d-metrics-certs podName:65533745-1c5b-48e0-b4a2-77fc1cc7908d nodeName:}" failed. No retries permitted until 2026-06-10 12:36:49.202156878 +0000 UTC m=+6.084760959 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/65533745-1c5b-48e0-b4a2-77fc1cc7908d-metrics-certs") pod "network-metrics-daemon-n4lrk" (UID: "65533745-1c5b-48e0-b4a2-77fc1cc7908d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 12:36:47.302882 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:47.302847 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8rpn\" (UniqueName: \"kubernetes.io/projected/9ed82178-699a-4219-84bc-d56643bb7337-kube-api-access-d8rpn\") pod \"network-check-target-p8pxq\" (UID: \"9ed82178-699a-4219-84bc-d56643bb7337\") " pod="openshift-network-diagnostics/network-check-target-p8pxq" Jun 10 12:36:47.303058 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:36:47.303021 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 12:36:47.303058 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:36:47.303040 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 12:36:47.303058 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:36:47.303052 2557 projected.go:196] Error preparing data for projected volume kube-api-access-d8rpn for pod openshift-network-diagnostics/network-check-target-p8pxq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 12:36:47.303250 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:36:47.303106 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ed82178-699a-4219-84bc-d56643bb7337-kube-api-access-d8rpn podName:9ed82178-699a-4219-84bc-d56643bb7337 nodeName:}" failed. No retries permitted until 2026-06-10 12:36:49.303088798 +0000 UTC m=+6.185692867 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-d8rpn" (UniqueName: "kubernetes.io/projected/9ed82178-699a-4219-84bc-d56643bb7337-kube-api-access-d8rpn") pod "network-check-target-p8pxq" (UID: "9ed82178-699a-4219-84bc-d56643bb7337") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 12:36:47.352208 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:47.350620 2557 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 12:36:47.526297 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:47.526211 2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-09 12:31:45 +0000 UTC" deadline="2028-02-18 10:20:00.062671666 +0000 UTC" Jun 10 12:36:47.526297 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:47.526251 2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14829h43m12.536425392s" Jun 10 12:36:47.538998 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:47.538959 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n4lrk" Jun 10 12:36:47.539122 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:36:47.539094 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n4lrk" podUID="65533745-1c5b-48e0-b4a2-77fc1cc7908d" Jun 10 12:36:47.539765 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:47.539487 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8pxq" Jun 10 12:36:47.539765 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:36:47.539581 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p8pxq" podUID="9ed82178-699a-4219-84bc-d56643bb7337" Jun 10 12:36:47.539765 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:47.539643 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q25rc" Jun 10 12:36:47.539765 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:36:47.539721 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q25rc" podUID="b893d76d-5c4b-4d52-9658-7d87236b1b2e" Jun 10 12:36:47.586855 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:47.586785 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-72.ec2.internal" event={"ID":"28b90b0c042d27f85555b2608eecccce","Type":"ContainerStarted","Data":"29ffa81c866c5f6398d037faf0c33dc3d4be0b0668457481c0e21d3de6d5e40d"} Jun 10 12:36:47.608431 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:47.607091 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-72.ec2.internal" podStartSLOduration=3.6070723 podStartE2EDuration="3.6070723s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 12:36:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:36:46.599301059 +0000 UTC m=+3.481905135" watchObservedRunningTime="2026-06-10 12:36:47.6070723 +0000 UTC m=+4.489676374" Jun 10 12:36:47.608431 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:47.607277 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-72.ec2.internal" podStartSLOduration=3.607266986 podStartE2EDuration="3.607266986s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 12:36:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:36:47.606588123 +0000 UTC m=+4.489192198" watchObservedRunningTime="2026-06-10 12:36:47.607266986 +0000 UTC m=+4.489871060" Jun 10 12:36:49.217533 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:49.217495 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65533745-1c5b-48e0-b4a2-77fc1cc7908d-metrics-certs\") pod \"network-metrics-daemon-n4lrk\" (UID: \"65533745-1c5b-48e0-b4a2-77fc1cc7908d\") " pod="openshift-multus/network-metrics-daemon-n4lrk" Jun 10 12:36:49.217964 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:49.217576 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b893d76d-5c4b-4d52-9658-7d87236b1b2e-original-pull-secret\") pod \"global-pull-secret-syncer-q25rc\" (UID: \"b893d76d-5c4b-4d52-9658-7d87236b1b2e\") " pod="kube-system/global-pull-secret-syncer-q25rc" Jun 10 12:36:49.217964 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:36:49.217695 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 12:36:49.217964 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:36:49.217751 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b893d76d-5c4b-4d52-9658-7d87236b1b2e-original-pull-secret podName:b893d76d-5c4b-4d52-9658-7d87236b1b2e nodeName:}" failed. No retries permitted until 2026-06-10 12:36:53.217733139 +0000 UTC m=+10.100337195 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b893d76d-5c4b-4d52-9658-7d87236b1b2e-original-pull-secret") pod "global-pull-secret-syncer-q25rc" (UID: "b893d76d-5c4b-4d52-9658-7d87236b1b2e") : object "kube-system"/"original-pull-secret" not registered Jun 10 12:36:49.218147 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:36:49.218136 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 12:36:49.218223 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:36:49.218201 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65533745-1c5b-48e0-b4a2-77fc1cc7908d-metrics-certs podName:65533745-1c5b-48e0-b4a2-77fc1cc7908d nodeName:}" failed. No retries permitted until 2026-06-10 12:36:53.21816902 +0000 UTC m=+10.100773074 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/65533745-1c5b-48e0-b4a2-77fc1cc7908d-metrics-certs") pod "network-metrics-daemon-n4lrk" (UID: "65533745-1c5b-48e0-b4a2-77fc1cc7908d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 12:36:49.319011 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:49.318971 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8rpn\" (UniqueName: \"kubernetes.io/projected/9ed82178-699a-4219-84bc-d56643bb7337-kube-api-access-d8rpn\") pod \"network-check-target-p8pxq\" (UID: \"9ed82178-699a-4219-84bc-d56643bb7337\") " pod="openshift-network-diagnostics/network-check-target-p8pxq" Jun 10 12:36:49.319218 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:36:49.319153 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 12:36:49.319218 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:36:49.319195 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 12:36:49.319218 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:36:49.319210 2557 projected.go:196] Error preparing data for projected volume kube-api-access-d8rpn for pod openshift-network-diagnostics/network-check-target-p8pxq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 12:36:49.319393 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:36:49.319271 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ed82178-699a-4219-84bc-d56643bb7337-kube-api-access-d8rpn podName:9ed82178-699a-4219-84bc-d56643bb7337 nodeName:}" failed. No retries permitted until 2026-06-10 12:36:53.319251922 +0000 UTC m=+10.201855978 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-d8rpn" (UniqueName: "kubernetes.io/projected/9ed82178-699a-4219-84bc-d56643bb7337-kube-api-access-d8rpn") pod "network-check-target-p8pxq" (UID: "9ed82178-699a-4219-84bc-d56643bb7337") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 12:36:49.536614 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:49.536536 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n4lrk" Jun 10 12:36:49.536764 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:36:49.536689 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n4lrk" podUID="65533745-1c5b-48e0-b4a2-77fc1cc7908d" Jun 10 12:36:49.536764 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:49.536551 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q25rc" Jun 10 12:36:49.536764 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:49.536536 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8pxq" Jun 10 12:36:49.536920 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:36:49.536788 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q25rc" podUID="b893d76d-5c4b-4d52-9658-7d87236b1b2e" Jun 10 12:36:49.536920 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:36:49.536855 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p8pxq" podUID="9ed82178-699a-4219-84bc-d56643bb7337" Jun 10 12:36:51.536391 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:51.535943 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8pxq" Jun 10 12:36:51.536391 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:36:51.536072 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p8pxq" podUID="9ed82178-699a-4219-84bc-d56643bb7337" Jun 10 12:36:51.536391 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:51.536175 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q25rc" Jun 10 12:36:51.536391 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:36:51.536280 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q25rc" podUID="b893d76d-5c4b-4d52-9658-7d87236b1b2e" Jun 10 12:36:51.536391 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:51.536307 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n4lrk" Jun 10 12:36:51.536391 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:36:51.536382 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n4lrk" podUID="65533745-1c5b-48e0-b4a2-77fc1cc7908d" Jun 10 12:36:53.252007 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:53.251970 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b893d76d-5c4b-4d52-9658-7d87236b1b2e-original-pull-secret\") pod \"global-pull-secret-syncer-q25rc\" (UID: \"b893d76d-5c4b-4d52-9658-7d87236b1b2e\") " pod="kube-system/global-pull-secret-syncer-q25rc" Jun 10 12:36:53.252462 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:53.252040 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65533745-1c5b-48e0-b4a2-77fc1cc7908d-metrics-certs\") pod \"network-metrics-daemon-n4lrk\" (UID: \"65533745-1c5b-48e0-b4a2-77fc1cc7908d\") " pod="openshift-multus/network-metrics-daemon-n4lrk" Jun 10 12:36:53.252462 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:36:53.252141 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 12:36:53.252462 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:36:53.252140 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 12:36:53.252462 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:36:53.252215 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65533745-1c5b-48e0-b4a2-77fc1cc7908d-metrics-certs podName:65533745-1c5b-48e0-b4a2-77fc1cc7908d nodeName:}" failed. No retries permitted until 2026-06-10 12:37:01.252195889 +0000 UTC m=+18.134799965 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/65533745-1c5b-48e0-b4a2-77fc1cc7908d-metrics-certs") pod "network-metrics-daemon-n4lrk" (UID: "65533745-1c5b-48e0-b4a2-77fc1cc7908d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 12:36:53.252462 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:36:53.252241 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b893d76d-5c4b-4d52-9658-7d87236b1b2e-original-pull-secret podName:b893d76d-5c4b-4d52-9658-7d87236b1b2e nodeName:}" failed. No retries permitted until 2026-06-10 12:37:01.252230038 +0000 UTC m=+18.134834097 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b893d76d-5c4b-4d52-9658-7d87236b1b2e-original-pull-secret") pod "global-pull-secret-syncer-q25rc" (UID: "b893d76d-5c4b-4d52-9658-7d87236b1b2e") : object "kube-system"/"original-pull-secret" not registered Jun 10 12:36:53.352668 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:53.352635 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8rpn\" (UniqueName: \"kubernetes.io/projected/9ed82178-699a-4219-84bc-d56643bb7337-kube-api-access-d8rpn\") pod \"network-check-target-p8pxq\" (UID: \"9ed82178-699a-4219-84bc-d56643bb7337\") " pod="openshift-network-diagnostics/network-check-target-p8pxq" Jun 10 12:36:53.352843 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:36:53.352808 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 12:36:53.352843 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:36:53.352832 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 12:36:53.352843 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:36:53.352844 2557 projected.go:196] Error preparing data for projected volume kube-api-access-d8rpn for pod openshift-network-diagnostics/network-check-target-p8pxq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 12:36:53.352993 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:36:53.352926 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ed82178-699a-4219-84bc-d56643bb7337-kube-api-access-d8rpn podName:9ed82178-699a-4219-84bc-d56643bb7337 nodeName:}" failed. No retries permitted until 2026-06-10 12:37:01.352907489 +0000 UTC m=+18.235511558 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-d8rpn" (UniqueName: "kubernetes.io/projected/9ed82178-699a-4219-84bc-d56643bb7337-kube-api-access-d8rpn") pod "network-check-target-p8pxq" (UID: "9ed82178-699a-4219-84bc-d56643bb7337") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 12:36:53.536720 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:53.536646 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n4lrk" Jun 10 12:36:53.536869 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:53.536704 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8pxq" Jun 10 12:36:53.536869 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:36:53.536849 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n4lrk" podUID="65533745-1c5b-48e0-b4a2-77fc1cc7908d" Jun 10 12:36:53.536976 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:53.536727 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q25rc" Jun 10 12:36:53.536976 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:36:53.536937 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p8pxq" podUID="9ed82178-699a-4219-84bc-d56643bb7337" Jun 10 12:36:53.537950 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:36:53.537902 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q25rc" podUID="b893d76d-5c4b-4d52-9658-7d87236b1b2e" Jun 10 12:36:55.536795 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:55.536762 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n4lrk" Jun 10 12:36:55.537283 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:55.536898 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8pxq" Jun 10 12:36:55.537283 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:36:55.536991 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p8pxq" podUID="9ed82178-699a-4219-84bc-d56643bb7337" Jun 10 12:36:55.537283 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:36:55.536895 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n4lrk" podUID="65533745-1c5b-48e0-b4a2-77fc1cc7908d" Jun 10 12:36:55.537283 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:55.537015 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q25rc" Jun 10 12:36:55.537283 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:36:55.537116 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q25rc" podUID="b893d76d-5c4b-4d52-9658-7d87236b1b2e" Jun 10 12:36:57.536394 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:57.536359 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n4lrk" Jun 10 12:36:57.536394 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:57.536396 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q25rc" Jun 10 12:36:57.536876 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:57.536359 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8pxq" Jun 10 12:36:57.536876 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:36:57.536493 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n4lrk" podUID="65533745-1c5b-48e0-b4a2-77fc1cc7908d" Jun 10 12:36:57.536876 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:36:57.536604 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p8pxq" podUID="9ed82178-699a-4219-84bc-d56643bb7337" Jun 10 12:36:57.536876 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:36:57.536678 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q25rc" podUID="b893d76d-5c4b-4d52-9658-7d87236b1b2e" Jun 10 12:36:59.536296 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:59.536260 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n4lrk" Jun 10 12:36:59.536736 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:59.536260 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q25rc" Jun 10 12:36:59.536736 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:36:59.536383 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n4lrk" podUID="65533745-1c5b-48e0-b4a2-77fc1cc7908d" Jun 10 12:36:59.536736 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:36:59.536260 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8pxq" Jun 10 12:36:59.536736 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:36:59.536438 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q25rc" podUID="b893d76d-5c4b-4d52-9658-7d87236b1b2e" Jun 10 12:36:59.536736 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:36:59.536568 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p8pxq" podUID="9ed82178-699a-4219-84bc-d56643bb7337" Jun 10 12:37:01.308009 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:01.307973 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65533745-1c5b-48e0-b4a2-77fc1cc7908d-metrics-certs\") pod \"network-metrics-daemon-n4lrk\" (UID: \"65533745-1c5b-48e0-b4a2-77fc1cc7908d\") " pod="openshift-multus/network-metrics-daemon-n4lrk" Jun 10 12:37:01.308457 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:01.308038 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b893d76d-5c4b-4d52-9658-7d87236b1b2e-original-pull-secret\") pod \"global-pull-secret-syncer-q25rc\" (UID: \"b893d76d-5c4b-4d52-9658-7d87236b1b2e\") " pod="kube-system/global-pull-secret-syncer-q25rc" Jun 10 12:37:01.308457 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:37:01.308126 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 12:37:01.308457 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:37:01.308134 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 12:37:01.308457 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:37:01.308209 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b893d76d-5c4b-4d52-9658-7d87236b1b2e-original-pull-secret podName:b893d76d-5c4b-4d52-9658-7d87236b1b2e nodeName:}" failed. No retries permitted until 2026-06-10 12:37:17.308177859 +0000 UTC m=+34.190781913 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b893d76d-5c4b-4d52-9658-7d87236b1b2e-original-pull-secret") pod "global-pull-secret-syncer-q25rc" (UID: "b893d76d-5c4b-4d52-9658-7d87236b1b2e") : object "kube-system"/"original-pull-secret" not registered Jun 10 12:37:01.308457 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:37:01.308228 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65533745-1c5b-48e0-b4a2-77fc1cc7908d-metrics-certs podName:65533745-1c5b-48e0-b4a2-77fc1cc7908d nodeName:}" failed. No retries permitted until 2026-06-10 12:37:17.3082199 +0000 UTC m=+34.190823954 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/65533745-1c5b-48e0-b4a2-77fc1cc7908d-metrics-certs") pod "network-metrics-daemon-n4lrk" (UID: "65533745-1c5b-48e0-b4a2-77fc1cc7908d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 12:37:01.408612 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:01.408573 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8rpn\" (UniqueName: \"kubernetes.io/projected/9ed82178-699a-4219-84bc-d56643bb7337-kube-api-access-d8rpn\") pod \"network-check-target-p8pxq\" (UID: \"9ed82178-699a-4219-84bc-d56643bb7337\") " pod="openshift-network-diagnostics/network-check-target-p8pxq" Jun 10 12:37:01.408763 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:37:01.408742 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 12:37:01.408842 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:37:01.408774 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 12:37:01.408842 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:37:01.408787 2557 projected.go:196] Error preparing data for projected volume kube-api-access-d8rpn for pod openshift-network-diagnostics/network-check-target-p8pxq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 12:37:01.408842 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:37:01.408840 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ed82178-699a-4219-84bc-d56643bb7337-kube-api-access-d8rpn podName:9ed82178-699a-4219-84bc-d56643bb7337 nodeName:}" failed. No retries permitted until 2026-06-10 12:37:17.408826266 +0000 UTC m=+34.291430319 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-d8rpn" (UniqueName: "kubernetes.io/projected/9ed82178-699a-4219-84bc-d56643bb7337-kube-api-access-d8rpn") pod "network-check-target-p8pxq" (UID: "9ed82178-699a-4219-84bc-d56643bb7337") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 12:37:01.536064 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:01.535971 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q25rc" Jun 10 12:37:01.536260 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:37:01.536115 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q25rc" podUID="b893d76d-5c4b-4d52-9658-7d87236b1b2e" Jun 10 12:37:01.536260 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:01.536127 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8pxq" Jun 10 12:37:01.536260 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:01.536157 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n4lrk" Jun 10 12:37:01.536260 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:37:01.536222 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p8pxq" podUID="9ed82178-699a-4219-84bc-d56643bb7337" Jun 10 12:37:01.536423 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:37:01.536307 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n4lrk" podUID="65533745-1c5b-48e0-b4a2-77fc1cc7908d" Jun 10 12:37:03.537142 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:03.537107 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n4lrk" Jun 10 12:37:03.537569 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:03.537224 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q25rc" Jun 10 12:37:03.537569 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:03.537266 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8pxq" Jun 10 12:37:03.537569 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:37:03.537282 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n4lrk" podUID="65533745-1c5b-48e0-b4a2-77fc1cc7908d" Jun 10 12:37:03.537569 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:37:03.537341 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p8pxq" podUID="9ed82178-699a-4219-84bc-d56643bb7337" Jun 10 12:37:03.537569 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:37:03.537431 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q25rc" podUID="b893d76d-5c4b-4d52-9658-7d87236b1b2e" Jun 10 12:37:05.536665 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:05.536366 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n4lrk" Jun 10 12:37:05.537278 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:05.536366 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8pxq" Jun 10 12:37:05.537278 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:37:05.536754 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n4lrk" podUID="65533745-1c5b-48e0-b4a2-77fc1cc7908d" Jun 10 12:37:05.537278 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:05.536384 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q25rc" Jun 10 12:37:05.537278 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:37:05.536808 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p8pxq" podUID="9ed82178-699a-4219-84bc-d56643bb7337" Jun 10 12:37:05.537278 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:37:05.536894 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q25rc" podUID="b893d76d-5c4b-4d52-9658-7d87236b1b2e" Jun 10 12:37:05.630194 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:05.630098 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l26ng" event={"ID":"1038db63-9904-4677-867f-21f05dd4095e","Type":"ContainerStarted","Data":"d2aebcf0b8e48f4dc81f0c686e8fac7c5f4e21038b183c91ab585b9250ca967d"} Jun 10 12:37:05.631640 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:05.631613 2557 generic.go:356] "Generic (PLEG): container finished" podID="9e6db1bd-99cf-4a32-b43f-4daca8b04204" containerID="e55c2c1dd2eb43dc804a5a81266c136c782ecf4b1e7d2e1571b15271e888a625" exitCode=0 Jun 10 12:37:05.631776 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:05.631694 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q6jq4" event={"ID":"9e6db1bd-99cf-4a32-b43f-4daca8b04204","Type":"ContainerDied","Data":"e55c2c1dd2eb43dc804a5a81266c136c782ecf4b1e7d2e1571b15271e888a625"} Jun 10 12:37:05.633169 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:05.633142 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4c6gv" event={"ID":"9ced5103-eb3b-4070-9c0a-06df4cd9c0a8","Type":"ContainerStarted","Data":"fd805bc07923fe67fddaada9b9658e8c26d5556b5719b439b05092515277190a"} Jun 10 12:37:05.635391 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:05.635042 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-f9rmw" event={"ID":"0b5cd784-4247-44f1-b9cd-394ae4294de9","Type":"ContainerStarted","Data":"48a5cd1e0a1d2e8d613403854e1fbd4a6c48bf33bbc9aa10fba519ec7984fb54"} Jun 10 12:37:05.636630 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:05.636591 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mvcnc" event={"ID":"f324d4da-090d-4e3e-99f7-5a5393276463","Type":"ContainerStarted","Data":"e42c78aa3904c6f639128610e6a50dd9665f2a6aa0fb9d25591ea4d17cbca04c"} Jun 10 12:37:05.639678 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:05.639660 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5jhbt" event={"ID":"847f076b-7998-42c3-b0cd-77cdee30f5ac","Type":"ContainerStarted","Data":"3181da61894b642b230009f5fcb7f27c3ed045898fb29d3c8d79909dfeb70ccc"} Jun 10 12:37:05.639769 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:05.639716 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5jhbt" event={"ID":"847f076b-7998-42c3-b0cd-77cdee30f5ac","Type":"ContainerStarted","Data":"625c41000e73d773c36391723a0b12aa494aa58cf14f152f09c57fd9112d2ce0"} Jun 10 12:37:05.639769 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:05.639750 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5jhbt" event={"ID":"847f076b-7998-42c3-b0cd-77cdee30f5ac","Type":"ContainerStarted","Data":"8400dd20b5d63caaa3cf3e18417f3ed44c2d0a84f46f77e56f4a20e0a495bd59"} Jun 10 12:37:05.639875 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:05.639792 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5jhbt" event={"ID":"847f076b-7998-42c3-b0cd-77cdee30f5ac","Type":"ContainerStarted","Data":"9f0e671b984ac470be505044d92074faf82e649d4417921d0604ef77d955329d"} Jun 10 12:37:05.639875 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:05.639829 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5jhbt" event={"ID":"847f076b-7998-42c3-b0cd-77cdee30f5ac","Type":"ContainerStarted","Data":"7c8e87d4e35d91e6e1ed3e65974e75ae17c070106f857e2effad0cc3f8472e03"} Jun 10 12:37:05.639875 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:05.639864 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5jhbt" event={"ID":"847f076b-7998-42c3-b0cd-77cdee30f5ac","Type":"ContainerStarted","Data":"c885683a9eb2243ba9c5faa4c797f0d0d063c9953338a9bd42773d7041905a90"} Jun 10 12:37:05.641159 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:05.641133 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2qfc9" event={"ID":"b7b38392-e294-4941-813e-14c7e728b0bd","Type":"ContainerStarted","Data":"395b435e01c55589fed071da3235e9c4f8b0896b42af8df3f639760a81bb76c5"} Jun 10 12:37:05.643047 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:05.643024 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-gj6k8" event={"ID":"7a1ad94d-15c8-4022-8ab9-d7b292a60bdc","Type":"ContainerStarted","Data":"9319c138e56491b80144ebf994f9bf800c185d76637f5a92c834de9c7ccb6766"} Jun 10 12:37:05.673867 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:05.673824 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-4c6gv" podStartSLOduration=4.305118879 podStartE2EDuration="22.673811486s" totalImagesPullingTime="18.368692607s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 12:36:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:37:05.673605117 +0000 UTC m=+22.556209194" watchObservedRunningTime="2026-06-10 12:37:05.673811486 +0000 UTC m=+22.556415601" Jun 10 12:37:05.689126 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:05.689085 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-f9rmw" podStartSLOduration=12.716915721 podStartE2EDuration="22.68907634s" totalImagesPullingTime="9.972160619s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:36:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:37:05.688969475 +0000 UTC m=+22.571573552" watchObservedRunningTime="2026-06-10 12:37:05.68907634 +0000 UTC m=+22.571680415" Jun 10 12:37:05.715359 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:05.715319 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-gj6k8" podStartSLOduration=4.163046007 podStartE2EDuration="22.715304418s" totalImagesPullingTime="18.552258411s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 12:36:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:37:05.71498536 +0000 UTC m=+22.597589437" watchObservedRunningTime="2026-06-10 12:37:05.715304418 +0000 UTC m=+22.597908493" Jun 10 12:37:05.765352 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:05.765294 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-mvcnc" podStartSLOduration=3.23848284 podStartE2EDuration="21.765273796s" totalImagesPullingTime="18.526790956s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 12:36:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:37:05.738949263 +0000 UTC m=+22.621553340" watchObservedRunningTime="2026-06-10 12:37:05.765273796 +0000 UTC m=+22.647877873" Jun 10 12:37:05.765521 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:05.765441 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-2qfc9" podStartSLOduration=4.212195152 podStartE2EDuration="22.765433442s" totalImagesPullingTime="18.55323829s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 12:36:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:37:05.76501984 +0000 UTC m=+22.647623915" watchObservedRunningTime="2026-06-10 12:37:05.765433442 +0000 UTC m=+22.648037519" Jun 10 12:37:06.141095 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:06.141067 2557 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 10 12:37:06.540198 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:06.539963 2557 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-10T12:37:06.141089475Z","UUID":"d0e84707-8c72-45f9-97b2-892e8611fa17","Handler":null,"Name":"","Endpoint":""} Jun 10 12:37:06.542009 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:06.541984 2557 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 10 12:37:06.542134 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:06.542031 2557 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 10 12:37:06.648255 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:06.648222 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l26ng" event={"ID":"1038db63-9904-4677-867f-21f05dd4095e","Type":"ContainerStarted","Data":"1476e0545bef035ee9554a67b4e74ac2bb6d4ff32648c0c3f78bd9a4885505f9"} Jun 10 12:37:06.650166 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:06.650139 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-688zv" event={"ID":"5c6b4070-7839-413d-bbf0-1e15a95201bd","Type":"ContainerStarted","Data":"97202b2933553ea8c3c02ae1a24e824cffc231616499d8c6066e4ed5416f6985"} Jun 10 12:37:06.667615 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:06.667569 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-688zv" podStartSLOduration=5.297053834 podStartE2EDuration="23.667550622s" totalImagesPullingTime="18.370496788s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 12:36:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:37:06.667505075 +0000 UTC m=+23.550109154" watchObservedRunningTime="2026-06-10 12:37:06.667550622 +0000 UTC m=+23.550154698" Jun 10 12:37:06.697917 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:06.697782 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-f9rmw" Jun 10 12:37:06.698418 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:06.698396 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-f9rmw" Jun 10 12:37:07.536536 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:07.536504 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q25rc" Jun 10 12:37:07.536717 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:37:07.536658 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q25rc" podUID="b893d76d-5c4b-4d52-9658-7d87236b1b2e" Jun 10 12:37:07.536717 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:07.536504 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n4lrk" Jun 10 12:37:07.536832 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:37:07.536767 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n4lrk" podUID="65533745-1c5b-48e0-b4a2-77fc1cc7908d" Jun 10 12:37:07.536832 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:07.536504 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8pxq" Jun 10 12:37:07.536936 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:37:07.536837 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p8pxq" podUID="9ed82178-699a-4219-84bc-d56643bb7337" Jun 10 12:37:07.656675 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:07.656419 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5jhbt" event={"ID":"847f076b-7998-42c3-b0cd-77cdee30f5ac","Type":"ContainerStarted","Data":"8fafd1a4a04e81e21c19f5dcb1f2f816d19e84a21ba2a91042d50ce7de46f112"} Jun 10 12:37:07.658967 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:07.658934 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l26ng" event={"ID":"1038db63-9904-4677-867f-21f05dd4095e","Type":"ContainerStarted","Data":"fd773ca8d09aa28b1e1656f66e7961ed9b8a04c6465c1239c3f8b7fd94982fd7"} Jun 10 12:37:07.659415 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:07.659377 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-f9rmw" Jun 10 12:37:07.659718 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:07.659702 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-f9rmw" Jun 10 12:37:07.702819 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:07.702770 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l26ng" podStartSLOduration=4.330808059 podStartE2EDuration="24.702749639s" totalImagesPullingTime="20.37194158s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 12:36:43 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:37:07.680734461 +0000 UTC m=+24.563338539" watchObservedRunningTime="2026-06-10 12:37:07.702749639 +0000 UTC m=+24.585353713" Jun 10 12:37:09.536835 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:09.536801 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8pxq" Jun 10 12:37:09.537486 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:09.536803 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n4lrk" Jun 10 12:37:09.537486 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:37:09.536927 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p8pxq" podUID="9ed82178-699a-4219-84bc-d56643bb7337" Jun 10 12:37:09.537486 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:37:09.537017 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n4lrk" podUID="65533745-1c5b-48e0-b4a2-77fc1cc7908d" Jun 10 12:37:09.537486 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:09.536803 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q25rc" Jun 10 12:37:09.537486 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:37:09.537128 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q25rc" podUID="b893d76d-5c4b-4d52-9658-7d87236b1b2e" Jun 10 12:37:10.668550 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:10.668514 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5jhbt" event={"ID":"847f076b-7998-42c3-b0cd-77cdee30f5ac","Type":"ContainerStarted","Data":"7dfa90a4093b8b85c24d268b7dca35478e3fb4ba0d83cbb50e9b55d48cb320c3"} Jun 10 12:37:10.669240 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:10.668724 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5jhbt" Jun 10 12:37:10.669240 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:10.668794 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5jhbt" Jun 10 12:37:10.670437 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:10.670402 2557 generic.go:356] "Generic (PLEG): container finished" podID="9e6db1bd-99cf-4a32-b43f-4daca8b04204" containerID="07bea1e7d43e0f8c5d1f2dd66a498404988079cee6964601d373bbe83892fc8c" exitCode=0 Jun 10 12:37:10.670549 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:10.670441 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q6jq4" event={"ID":"9e6db1bd-99cf-4a32-b43f-4daca8b04204","Type":"ContainerDied","Data":"07bea1e7d43e0f8c5d1f2dd66a498404988079cee6964601d373bbe83892fc8c"} Jun 10 12:37:10.684533 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:10.684510 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5jhbt" Jun 10 12:37:10.700812 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:10.700768 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-5jhbt" podStartSLOduration=8.97693303 podStartE2EDuration="27.700756134s" totalImagesPullingTime="18.723823104s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 12:36:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:37:10.700278896 +0000 UTC m=+27.582882974" watchObservedRunningTime="2026-06-10 12:37:10.700756134 +0000 UTC m=+27.583360215" Jun 10 12:37:11.536551 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:11.536530 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8pxq" Jun 10 12:37:11.536683 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:11.536581 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q25rc" Jun 10 12:37:11.536683 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:11.536593 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n4lrk" Jun 10 12:37:11.536683 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:37:11.536664 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q25rc" podUID="b893d76d-5c4b-4d52-9658-7d87236b1b2e" Jun 10 12:37:11.536829 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:37:11.536776 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p8pxq" podUID="9ed82178-699a-4219-84bc-d56643bb7337" Jun 10 12:37:11.536889 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:37:11.536875 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n4lrk" podUID="65533745-1c5b-48e0-b4a2-77fc1cc7908d" Jun 10 12:37:11.675485 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:11.675455 2557 generic.go:356] "Generic (PLEG): container finished" podID="9e6db1bd-99cf-4a32-b43f-4daca8b04204" containerID="00a0d85967a05f12c073fd3ec5abe3fd45f0de80a90b7dd081e42de26c7324bc" exitCode=0 Jun 10 12:37:11.675807 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:11.675523 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q6jq4" event={"ID":"9e6db1bd-99cf-4a32-b43f-4daca8b04204","Type":"ContainerDied","Data":"00a0d85967a05f12c073fd3ec5abe3fd45f0de80a90b7dd081e42de26c7324bc"} Jun 10 12:37:11.675984 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:11.675949 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5jhbt" Jun 10 12:37:11.692269 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:11.692243 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5jhbt" Jun 10 12:37:11.705912 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:11.705883 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-q25rc"] Jun 10 12:37:11.706040 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:11.705982 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q25rc" Jun 10 12:37:11.706226 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:37:11.706065 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q25rc" podUID="b893d76d-5c4b-4d52-9658-7d87236b1b2e" Jun 10 12:37:11.707437 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:11.707412 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-p8pxq"] Jun 10 12:37:11.707535 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:11.707501 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8pxq" Jun 10 12:37:11.707613 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:37:11.707593 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p8pxq" podUID="9ed82178-699a-4219-84bc-d56643bb7337" Jun 10 12:37:11.708049 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:11.708019 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-n4lrk"] Jun 10 12:37:11.708127 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:11.708094 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n4lrk" Jun 10 12:37:11.708203 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:37:11.708170 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n4lrk" podUID="65533745-1c5b-48e0-b4a2-77fc1cc7908d" Jun 10 12:37:13.536773 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:13.536744 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n4lrk" Jun 10 12:37:13.537214 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:13.536841 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q25rc" Jun 10 12:37:13.537214 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:37:13.536859 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n4lrk" podUID="65533745-1c5b-48e0-b4a2-77fc1cc7908d" Jun 10 12:37:13.537214 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:13.536914 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8pxq" Jun 10 12:37:13.537214 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:37:13.536914 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q25rc" podUID="b893d76d-5c4b-4d52-9658-7d87236b1b2e" Jun 10 12:37:13.537214 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:37:13.537008 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p8pxq" podUID="9ed82178-699a-4219-84bc-d56643bb7337" Jun 10 12:37:13.681684 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:13.681652 2557 generic.go:356] "Generic (PLEG): container finished" podID="9e6db1bd-99cf-4a32-b43f-4daca8b04204" containerID="f65415825e402e78e9a9a95412d089ec22bcdb0aaf1210641299c361a4db7824" exitCode=0 Jun 10 12:37:13.681845 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:13.681715 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q6jq4" event={"ID":"9e6db1bd-99cf-4a32-b43f-4daca8b04204","Type":"ContainerDied","Data":"f65415825e402e78e9a9a95412d089ec22bcdb0aaf1210641299c361a4db7824"} Jun 10 12:37:15.537121 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:15.536910 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n4lrk" Jun 10 12:37:15.537596 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:15.536910 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q25rc" Jun 10 12:37:15.537596 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:37:15.537239 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n4lrk" podUID="65533745-1c5b-48e0-b4a2-77fc1cc7908d" Jun 10 12:37:15.537596 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:15.536911 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8pxq" Jun 10 12:37:15.537596 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:37:15.537279 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q25rc" podUID="b893d76d-5c4b-4d52-9658-7d87236b1b2e" Jun 10 12:37:15.537596 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:37:15.537373 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p8pxq" podUID="9ed82178-699a-4219-84bc-d56643bb7337" Jun 10 12:37:17.330950 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:17.330905 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b893d76d-5c4b-4d52-9658-7d87236b1b2e-original-pull-secret\") pod \"global-pull-secret-syncer-q25rc\" (UID: \"b893d76d-5c4b-4d52-9658-7d87236b1b2e\") " pod="kube-system/global-pull-secret-syncer-q25rc" Jun 10 12:37:17.331498 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:17.330964 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65533745-1c5b-48e0-b4a2-77fc1cc7908d-metrics-certs\") pod \"network-metrics-daemon-n4lrk\" (UID: \"65533745-1c5b-48e0-b4a2-77fc1cc7908d\") " pod="openshift-multus/network-metrics-daemon-n4lrk" Jun 10 12:37:17.331498 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:37:17.331080 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 12:37:17.331498 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:37:17.331141 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65533745-1c5b-48e0-b4a2-77fc1cc7908d-metrics-certs podName:65533745-1c5b-48e0-b4a2-77fc1cc7908d nodeName:}" failed. No retries permitted until 2026-06-10 12:37:49.33112693 +0000 UTC m=+66.213730983 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/65533745-1c5b-48e0-b4a2-77fc1cc7908d-metrics-certs") pod "network-metrics-daemon-n4lrk" (UID: "65533745-1c5b-48e0-b4a2-77fc1cc7908d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 12:37:17.331498 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:37:17.331080 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 12:37:17.331498 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:37:17.331253 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b893d76d-5c4b-4d52-9658-7d87236b1b2e-original-pull-secret podName:b893d76d-5c4b-4d52-9658-7d87236b1b2e nodeName:}" failed. No retries permitted until 2026-06-10 12:37:49.331233304 +0000 UTC m=+66.213837360 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b893d76d-5c4b-4d52-9658-7d87236b1b2e-original-pull-secret") pod "global-pull-secret-syncer-q25rc" (UID: "b893d76d-5c4b-4d52-9658-7d87236b1b2e") : object "kube-system"/"original-pull-secret" not registered Jun 10 12:37:17.410514 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:17.410486 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-72.ec2.internal" event="NodeReady" Jun 10 12:37:17.410697 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:17.410638 2557 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 10 12:37:17.431556 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:17.431512 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8rpn\" (UniqueName: \"kubernetes.io/projected/9ed82178-699a-4219-84bc-d56643bb7337-kube-api-access-d8rpn\") pod \"network-check-target-p8pxq\" (UID: \"9ed82178-699a-4219-84bc-d56643bb7337\") " pod="openshift-network-diagnostics/network-check-target-p8pxq" Jun 10 12:37:17.431753 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:37:17.431711 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 12:37:17.431753 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:37:17.431738 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 12:37:17.431753 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:37:17.431748 2557 projected.go:196] Error preparing data for projected volume kube-api-access-d8rpn for pod openshift-network-diagnostics/network-check-target-p8pxq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 12:37:17.431903 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:37:17.431809 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ed82178-699a-4219-84bc-d56643bb7337-kube-api-access-d8rpn podName:9ed82178-699a-4219-84bc-d56643bb7337 nodeName:}" failed. No retries permitted until 2026-06-10 12:37:49.431791426 +0000 UTC m=+66.314395484 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-d8rpn" (UniqueName: "kubernetes.io/projected/9ed82178-699a-4219-84bc-d56643bb7337-kube-api-access-d8rpn") pod "network-check-target-p8pxq" (UID: "9ed82178-699a-4219-84bc-d56643bb7337") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 12:37:17.460255 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:17.460229 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-855748cdfb-4zc8x"] Jun 10 12:37:17.464313 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:17.464288 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-855748cdfb-4zc8x" Jun 10 12:37:17.471417 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:17.471344 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 10 12:37:17.472425 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:17.472090 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 10 12:37:17.472558 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:17.472543 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 10 12:37:17.474973 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:17.473667 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-gzwg7\"" Jun 10 12:37:17.505024 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:17.504991 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 10 12:37:17.512301 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:17.512273 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-slqcw"] Jun 10 12:37:17.516021 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:17.515998 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-fwbxx"] Jun 10 12:37:17.516156 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:17.516141 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-slqcw" Jun 10 12:37:17.520048 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:17.520022 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fwbxx" Jun 10 12:37:17.520208 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:17.520176 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 10 12:37:17.520563 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:17.520542 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hpqfd\"" Jun 10 12:37:17.527439 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:17.527411 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 10 12:37:17.531065 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:17.531045 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 10 12:37:17.532265 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:17.532247 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 10 12:37:17.532479 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:17.532464 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9kr2v\"" Jun 10 12:37:17.534071 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:17.534032 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 10 12:37:17.536292 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:17.536274 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q25rc" Jun 10 12:37:17.536397 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:17.536281 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8pxq" Jun 10 12:37:17.536460 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:17.536406 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n4lrk" Jun 10 12:37:17.539974 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:17.539956 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 10 12:37:17.540696 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:17.540669 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 10 12:37:17.541380 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:17.541261 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 10 12:37:17.541380 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:17.541275 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 10 12:37:17.541380 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:17.541321 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bmpcd\"" Jun 10 12:37:17.541589 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:17.541570 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vpjkq\"" Jun 10 12:37:17.555924 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:17.555873 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-slqcw"] Jun 10 12:37:17.557044 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:17.557023 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fwbxx"] Jun 10 12:37:17.601974 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:17.601936 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-855748cdfb-4zc8x"] Jun 10 12:37:17.633119 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:17.633088 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/aa4b745b-dca9-4769-981b-cf7eb4be811f-ca-trust-extracted\") pod \"image-registry-855748cdfb-4zc8x\" (UID: \"aa4b745b-dca9-4769-981b-cf7eb4be811f\") " pod="openshift-image-registry/image-registry-855748cdfb-4zc8x" Jun 10 12:37:17.633119 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:17.633123 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbtnc\" (UniqueName: \"kubernetes.io/projected/32bc9549-c4d5-4180-9d38-cb7c9d22d920-kube-api-access-mbtnc\") pod \"ingress-canary-fwbxx\" (UID: \"32bc9549-c4d5-4180-9d38-cb7c9d22d920\") " pod="openshift-ingress-canary/ingress-canary-fwbxx" Jun 10 12:37:17.633335 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:17.633169 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/32bc9549-c4d5-4180-9d38-cb7c9d22d920-cert\") pod \"ingress-canary-fwbxx\" (UID: \"32bc9549-c4d5-4180-9d38-cb7c9d22d920\") " pod="openshift-ingress-canary/ingress-canary-fwbxx" Jun 10 12:37:17.633335 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:17.633219 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6f28a11c-ee9f-40ec-a10e-1b6b54178990-config-volume\") pod \"dns-default-slqcw\" (UID: \"6f28a11c-ee9f-40ec-a10e-1b6b54178990\") " pod="openshift-dns/dns-default-slqcw" Jun 10 12:37:17.633335 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:17.633242 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aa4b745b-dca9-4769-981b-cf7eb4be811f-registry-tls\") pod \"image-registry-855748cdfb-4zc8x\" (UID: \"aa4b745b-dca9-4769-981b-cf7eb4be811f\") " pod="openshift-image-registry/image-registry-855748cdfb-4zc8x" Jun 10 12:37:17.633335 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:17.633259 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aa4b745b-dca9-4769-981b-cf7eb4be811f-bound-sa-token\") pod \"image-registry-855748cdfb-4zc8x\" (UID: \"aa4b745b-dca9-4769-981b-cf7eb4be811f\") " pod="openshift-image-registry/image-registry-855748cdfb-4zc8x" Jun 10 12:37:17.633335 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:17.633273 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d58ww\" (UniqueName: \"kubernetes.io/projected/6f28a11c-ee9f-40ec-a10e-1b6b54178990-kube-api-access-d58ww\") pod \"dns-default-slqcw\" (UID: \"6f28a11c-ee9f-40ec-a10e-1b6b54178990\") " pod="openshift-dns/dns-default-slqcw" Jun 10 12:37:17.633335 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:17.633294 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-655fh\" (UniqueName: \"kubernetes.io/projected/aa4b745b-dca9-4769-981b-cf7eb4be811f-kube-api-access-655fh\") pod \"image-registry-855748cdfb-4zc8x\" (UID: \"aa4b745b-dca9-4769-981b-cf7eb4be811f\") " pod="openshift-image-registry/image-registry-855748cdfb-4zc8x" Jun 10 12:37:17.633335 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:17.633327 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/aa4b745b-dca9-4769-981b-cf7eb4be811f-image-registry-private-configuration\") pod \"image-registry-855748cdfb-4zc8x\" (UID: \"aa4b745b-dca9-4769-981b-cf7eb4be811f\") " pod="openshift-image-registry/image-registry-855748cdfb-4zc8x" Jun 10 12:37:17.633561 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:17.633351 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/aa4b745b-dca9-4769-981b-cf7eb4be811f-registry-certificates\") pod \"image-registry-855748cdfb-4zc8x\" (UID: \"aa4b745b-dca9-4769-981b-cf7eb4be811f\") " pod="openshift-image-registry/image-registry-855748cdfb-4zc8x" Jun 10 12:37:17.633561 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:17.633387 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/aa4b745b-dca9-4769-981b-cf7eb4be811f-installation-pull-secrets\") pod \"image-registry-855748cdfb-4zc8x\" (UID: \"aa4b745b-dca9-4769-981b-cf7eb4be811f\") " pod="openshift-image-registry/image-registry-855748cdfb-4zc8x" Jun 10 12:37:17.633561 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:17.633409 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aa4b745b-dca9-4769-981b-cf7eb4be811f-trusted-ca\") pod \"image-registry-855748cdfb-4zc8x\" (UID: \"aa4b745b-dca9-4769-981b-cf7eb4be811f\") " pod="openshift-image-registry/image-registry-855748cdfb-4zc8x" Jun 10 12:37:17.633561 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:17.633445 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f28a11c-ee9f-40ec-a10e-1b6b54178990-tmp-dir\") pod \"dns-default-slqcw\" (UID: \"6f28a11c-ee9f-40ec-a10e-1b6b54178990\") " pod="openshift-dns/dns-default-slqcw" Jun 10 12:37:17.633561 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:17.633508 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6f28a11c-ee9f-40ec-a10e-1b6b54178990-metrics-tls\") pod \"dns-default-slqcw\" (UID: \"6f28a11c-ee9f-40ec-a10e-1b6b54178990\") " pod="openshift-dns/dns-default-slqcw" Jun 10 12:37:17.734104 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:17.734073 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aa4b745b-dca9-4769-981b-cf7eb4be811f-trusted-ca\") pod \"image-registry-855748cdfb-4zc8x\" (UID: \"aa4b745b-dca9-4769-981b-cf7eb4be811f\") " pod="openshift-image-registry/image-registry-855748cdfb-4zc8x" Jun 10 12:37:17.734308 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:17.734124 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f28a11c-ee9f-40ec-a10e-1b6b54178990-tmp-dir\") pod \"dns-default-slqcw\" (UID: \"6f28a11c-ee9f-40ec-a10e-1b6b54178990\") " pod="openshift-dns/dns-default-slqcw" Jun 10 12:37:17.734308 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:17.734152 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6f28a11c-ee9f-40ec-a10e-1b6b54178990-metrics-tls\") pod \"dns-default-slqcw\" (UID: \"6f28a11c-ee9f-40ec-a10e-1b6b54178990\") " pod="openshift-dns/dns-default-slqcw" Jun 10 12:37:17.734308 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:17.734197 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/aa4b745b-dca9-4769-981b-cf7eb4be811f-ca-trust-extracted\") pod \"image-registry-855748cdfb-4zc8x\" (UID: \"aa4b745b-dca9-4769-981b-cf7eb4be811f\") " pod="openshift-image-registry/image-registry-855748cdfb-4zc8x" Jun 10 12:37:17.734308 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:17.734225 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbtnc\" (UniqueName: \"kubernetes.io/projected/32bc9549-c4d5-4180-9d38-cb7c9d22d920-kube-api-access-mbtnc\") pod \"ingress-canary-fwbxx\" (UID: \"32bc9549-c4d5-4180-9d38-cb7c9d22d920\") " pod="openshift-ingress-canary/ingress-canary-fwbxx" Jun 10 12:37:17.734308 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:17.734273 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/32bc9549-c4d5-4180-9d38-cb7c9d22d920-cert\") pod \"ingress-canary-fwbxx\" (UID: \"32bc9549-c4d5-4180-9d38-cb7c9d22d920\") " pod="openshift-ingress-canary/ingress-canary-fwbxx" Jun 10 12:37:17.734721 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:37:17.734301 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 12:37:17.734721 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:37:17.734392 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f28a11c-ee9f-40ec-a10e-1b6b54178990-metrics-tls podName:6f28a11c-ee9f-40ec-a10e-1b6b54178990 nodeName:}" failed. No retries permitted until 2026-06-10 12:37:18.234367019 +0000 UTC m=+35.116971097 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6f28a11c-ee9f-40ec-a10e-1b6b54178990-metrics-tls") pod "dns-default-slqcw" (UID: "6f28a11c-ee9f-40ec-a10e-1b6b54178990") : secret "dns-default-metrics-tls" not found Jun 10 12:37:17.734721 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:17.734303 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6f28a11c-ee9f-40ec-a10e-1b6b54178990-config-volume\") pod \"dns-default-slqcw\" (UID: \"6f28a11c-ee9f-40ec-a10e-1b6b54178990\") " pod="openshift-dns/dns-default-slqcw" Jun 10 12:37:17.734721 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:17.734530 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f28a11c-ee9f-40ec-a10e-1b6b54178990-tmp-dir\") pod \"dns-default-slqcw\" (UID: \"6f28a11c-ee9f-40ec-a10e-1b6b54178990\") " pod="openshift-dns/dns-default-slqcw" Jun 10 12:37:17.734721 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:17.734541 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aa4b745b-dca9-4769-981b-cf7eb4be811f-registry-tls\") pod \"image-registry-855748cdfb-4zc8x\" (UID: \"aa4b745b-dca9-4769-981b-cf7eb4be811f\") " pod="openshift-image-registry/image-registry-855748cdfb-4zc8x" Jun 10 12:37:17.734721 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:17.734573 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aa4b745b-dca9-4769-981b-cf7eb4be811f-bound-sa-token\") pod \"image-registry-855748cdfb-4zc8x\" (UID: \"aa4b745b-dca9-4769-981b-cf7eb4be811f\") " pod="openshift-image-registry/image-registry-855748cdfb-4zc8x" Jun 10 12:37:17.734721 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:17.734602 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d58ww\" (UniqueName: \"kubernetes.io/projected/6f28a11c-ee9f-40ec-a10e-1b6b54178990-kube-api-access-d58ww\") pod \"dns-default-slqcw\" (UID: \"6f28a11c-ee9f-40ec-a10e-1b6b54178990\") " pod="openshift-dns/dns-default-slqcw" Jun 10 12:37:17.734721 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:17.734617 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/aa4b745b-dca9-4769-981b-cf7eb4be811f-ca-trust-extracted\") pod \"image-registry-855748cdfb-4zc8x\" (UID: \"aa4b745b-dca9-4769-981b-cf7eb4be811f\") " pod="openshift-image-registry/image-registry-855748cdfb-4zc8x" Jun 10 12:37:17.734721 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:17.734632 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-655fh\" (UniqueName: \"kubernetes.io/projected/aa4b745b-dca9-4769-981b-cf7eb4be811f-kube-api-access-655fh\") pod \"image-registry-855748cdfb-4zc8x\" (UID: \"aa4b745b-dca9-4769-981b-cf7eb4be811f\") " pod="openshift-image-registry/image-registry-855748cdfb-4zc8x" Jun 10 12:37:17.734721 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:17.734705 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/aa4b745b-dca9-4769-981b-cf7eb4be811f-image-registry-private-configuration\") pod \"image-registry-855748cdfb-4zc8x\" (UID: \"aa4b745b-dca9-4769-981b-cf7eb4be811f\") " pod="openshift-image-registry/image-registry-855748cdfb-4zc8x" Jun 10 12:37:17.735297 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:17.734731 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/aa4b745b-dca9-4769-981b-cf7eb4be811f-registry-certificates\") pod \"image-registry-855748cdfb-4zc8x\" (UID: \"aa4b745b-dca9-4769-981b-cf7eb4be811f\") " pod="openshift-image-registry/image-registry-855748cdfb-4zc8x" Jun 10 12:37:17.735297 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:17.734781 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/aa4b745b-dca9-4769-981b-cf7eb4be811f-installation-pull-secrets\") pod \"image-registry-855748cdfb-4zc8x\" (UID: \"aa4b745b-dca9-4769-981b-cf7eb4be811f\") " pod="openshift-image-registry/image-registry-855748cdfb-4zc8x" Jun 10 12:37:17.735297 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:37:17.734891 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 12:37:17.735297 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:37:17.734905 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-855748cdfb-4zc8x: secret "image-registry-tls" not found Jun 10 12:37:17.735297 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:37:17.734946 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa4b745b-dca9-4769-981b-cf7eb4be811f-registry-tls podName:aa4b745b-dca9-4769-981b-cf7eb4be811f nodeName:}" failed. No retries permitted until 2026-06-10 12:37:18.234934429 +0000 UTC m=+35.117538484 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/aa4b745b-dca9-4769-981b-cf7eb4be811f-registry-tls") pod "image-registry-855748cdfb-4zc8x" (UID: "aa4b745b-dca9-4769-981b-cf7eb4be811f") : secret "image-registry-tls" not found Jun 10 12:37:17.735297 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:17.735062 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6f28a11c-ee9f-40ec-a10e-1b6b54178990-config-volume\") pod \"dns-default-slqcw\" (UID: \"6f28a11c-ee9f-40ec-a10e-1b6b54178990\") " pod="openshift-dns/dns-default-slqcw" Jun 10 12:37:17.735599 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:17.735544 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/aa4b745b-dca9-4769-981b-cf7eb4be811f-registry-certificates\") pod \"image-registry-855748cdfb-4zc8x\" (UID: \"aa4b745b-dca9-4769-981b-cf7eb4be811f\") " pod="openshift-image-registry/image-registry-855748cdfb-4zc8x" Jun 10 12:37:17.735861 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:17.735642 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aa4b745b-dca9-4769-981b-cf7eb4be811f-trusted-ca\") pod \"image-registry-855748cdfb-4zc8x\" (UID: \"aa4b745b-dca9-4769-981b-cf7eb4be811f\") " pod="openshift-image-registry/image-registry-855748cdfb-4zc8x" Jun 10 12:37:17.739162 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:17.739139 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/aa4b745b-dca9-4769-981b-cf7eb4be811f-image-registry-private-configuration\") pod \"image-registry-855748cdfb-4zc8x\" (UID: \"aa4b745b-dca9-4769-981b-cf7eb4be811f\") " pod="openshift-image-registry/image-registry-855748cdfb-4zc8x" Jun 10 12:37:17.739289 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:17.739163 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/aa4b745b-dca9-4769-981b-cf7eb4be811f-installation-pull-secrets\") pod \"image-registry-855748cdfb-4zc8x\" (UID: \"aa4b745b-dca9-4769-981b-cf7eb4be811f\") " pod="openshift-image-registry/image-registry-855748cdfb-4zc8x" Jun 10 12:37:17.739289 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:17.739262 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/32bc9549-c4d5-4180-9d38-cb7c9d22d920-cert\") pod \"ingress-canary-fwbxx\" (UID: \"32bc9549-c4d5-4180-9d38-cb7c9d22d920\") " pod="openshift-ingress-canary/ingress-canary-fwbxx" Jun 10 12:37:17.744147 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:17.744123 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbtnc\" (UniqueName: \"kubernetes.io/projected/32bc9549-c4d5-4180-9d38-cb7c9d22d920-kube-api-access-mbtnc\") pod \"ingress-canary-fwbxx\" (UID: \"32bc9549-c4d5-4180-9d38-cb7c9d22d920\") " pod="openshift-ingress-canary/ingress-canary-fwbxx" Jun 10 12:37:17.744288 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:17.744259 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aa4b745b-dca9-4769-981b-cf7eb4be811f-bound-sa-token\") pod \"image-registry-855748cdfb-4zc8x\" (UID: \"aa4b745b-dca9-4769-981b-cf7eb4be811f\") " pod="openshift-image-registry/image-registry-855748cdfb-4zc8x" Jun 10 12:37:17.744564 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:17.744544 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d58ww\" (UniqueName: \"kubernetes.io/projected/6f28a11c-ee9f-40ec-a10e-1b6b54178990-kube-api-access-d58ww\") pod \"dns-default-slqcw\" (UID: \"6f28a11c-ee9f-40ec-a10e-1b6b54178990\") " pod="openshift-dns/dns-default-slqcw" Jun 10 12:37:17.744629 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:17.744590 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-655fh\" (UniqueName: \"kubernetes.io/projected/aa4b745b-dca9-4769-981b-cf7eb4be811f-kube-api-access-655fh\") pod \"image-registry-855748cdfb-4zc8x\" (UID: \"aa4b745b-dca9-4769-981b-cf7eb4be811f\") " pod="openshift-image-registry/image-registry-855748cdfb-4zc8x" Jun 10 12:37:17.833922 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:17.833889 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fwbxx" Jun 10 12:37:17.979361 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:17.979163 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fwbxx"] Jun 10 12:37:17.982441 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:37:17.982416 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32bc9549_c4d5_4180_9d38_cb7c9d22d920.slice/crio-b5948c7148cc4ed90f195b1629c6293d699586e37301b80560f66c61fc2c4bdd WatchSource:0}: Error finding container b5948c7148cc4ed90f195b1629c6293d699586e37301b80560f66c61fc2c4bdd: Status 404 returned error can't find the container with id b5948c7148cc4ed90f195b1629c6293d699586e37301b80560f66c61fc2c4bdd Jun 10 12:37:18.237917 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:18.237800 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aa4b745b-dca9-4769-981b-cf7eb4be811f-registry-tls\") pod \"image-registry-855748cdfb-4zc8x\" (UID: \"aa4b745b-dca9-4769-981b-cf7eb4be811f\") " pod="openshift-image-registry/image-registry-855748cdfb-4zc8x" Jun 10 12:37:18.237917 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:18.237877 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6f28a11c-ee9f-40ec-a10e-1b6b54178990-metrics-tls\") pod \"dns-default-slqcw\" (UID: \"6f28a11c-ee9f-40ec-a10e-1b6b54178990\") " pod="openshift-dns/dns-default-slqcw" Jun 10 12:37:18.238090 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:37:18.237959 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 12:37:18.238090 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:37:18.237977 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-855748cdfb-4zc8x: secret "image-registry-tls" not found Jun 10 12:37:18.238090 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:37:18.237994 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 12:37:18.238090 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:37:18.238031 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa4b745b-dca9-4769-981b-cf7eb4be811f-registry-tls podName:aa4b745b-dca9-4769-981b-cf7eb4be811f nodeName:}" failed. No retries permitted until 2026-06-10 12:37:19.238017019 +0000 UTC m=+36.120621072 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/aa4b745b-dca9-4769-981b-cf7eb4be811f-registry-tls") pod "image-registry-855748cdfb-4zc8x" (UID: "aa4b745b-dca9-4769-981b-cf7eb4be811f") : secret "image-registry-tls" not found Jun 10 12:37:18.238090 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:37:18.238043 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f28a11c-ee9f-40ec-a10e-1b6b54178990-metrics-tls podName:6f28a11c-ee9f-40ec-a10e-1b6b54178990 nodeName:}" failed. No retries permitted until 2026-06-10 12:37:19.238038074 +0000 UTC m=+36.120642126 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6f28a11c-ee9f-40ec-a10e-1b6b54178990-metrics-tls") pod "dns-default-slqcw" (UID: "6f28a11c-ee9f-40ec-a10e-1b6b54178990") : secret "dns-default-metrics-tls" not found Jun 10 12:37:18.693752 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:18.693719 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fwbxx" event={"ID":"32bc9549-c4d5-4180-9d38-cb7c9d22d920","Type":"ContainerStarted","Data":"b5948c7148cc4ed90f195b1629c6293d699586e37301b80560f66c61fc2c4bdd"} Jun 10 12:37:18.699696 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:18.699668 2557 generic.go:356] "Generic (PLEG): container finished" podID="9e6db1bd-99cf-4a32-b43f-4daca8b04204" containerID="faba3e7fffdae98936de9740114dcd99a79996bc9f5ff2a39db87609d82fdeaf" exitCode=0 Jun 10 12:37:18.699800 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:18.699704 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q6jq4" event={"ID":"9e6db1bd-99cf-4a32-b43f-4daca8b04204","Type":"ContainerDied","Data":"faba3e7fffdae98936de9740114dcd99a79996bc9f5ff2a39db87609d82fdeaf"} Jun 10 12:37:19.246196 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:19.246156 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aa4b745b-dca9-4769-981b-cf7eb4be811f-registry-tls\") pod \"image-registry-855748cdfb-4zc8x\" (UID: \"aa4b745b-dca9-4769-981b-cf7eb4be811f\") " pod="openshift-image-registry/image-registry-855748cdfb-4zc8x" Jun 10 12:37:19.246428 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:19.246267 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6f28a11c-ee9f-40ec-a10e-1b6b54178990-metrics-tls\") pod \"dns-default-slqcw\" (UID: \"6f28a11c-ee9f-40ec-a10e-1b6b54178990\") " pod="openshift-dns/dns-default-slqcw" Jun 10 12:37:19.246428 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:37:19.246307 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 12:37:19.246428 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:37:19.246327 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-855748cdfb-4zc8x: secret "image-registry-tls" not found Jun 10 12:37:19.246428 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:37:19.246378 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa4b745b-dca9-4769-981b-cf7eb4be811f-registry-tls podName:aa4b745b-dca9-4769-981b-cf7eb4be811f nodeName:}" failed. No retries permitted until 2026-06-10 12:37:21.24636473 +0000 UTC m=+38.128968783 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/aa4b745b-dca9-4769-981b-cf7eb4be811f-registry-tls") pod "image-registry-855748cdfb-4zc8x" (UID: "aa4b745b-dca9-4769-981b-cf7eb4be811f") : secret "image-registry-tls" not found Jun 10 12:37:19.246428 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:37:19.246378 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 12:37:19.246428 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:37:19.246427 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f28a11c-ee9f-40ec-a10e-1b6b54178990-metrics-tls podName:6f28a11c-ee9f-40ec-a10e-1b6b54178990 nodeName:}" failed. No retries permitted until 2026-06-10 12:37:21.246413009 +0000 UTC m=+38.129017063 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6f28a11c-ee9f-40ec-a10e-1b6b54178990-metrics-tls") pod "dns-default-slqcw" (UID: "6f28a11c-ee9f-40ec-a10e-1b6b54178990") : secret "dns-default-metrics-tls" not found Jun 10 12:37:19.706027 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:19.705987 2557 generic.go:356] "Generic (PLEG): container finished" podID="9e6db1bd-99cf-4a32-b43f-4daca8b04204" containerID="dc0b3f8cb09a4d85b3001b90cc0d034bb9dcec990be891c6486f0c28b04ecc7f" exitCode=0 Jun 10 12:37:19.706581 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:19.706047 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q6jq4" event={"ID":"9e6db1bd-99cf-4a32-b43f-4daca8b04204","Type":"ContainerDied","Data":"dc0b3f8cb09a4d85b3001b90cc0d034bb9dcec990be891c6486f0c28b04ecc7f"} Jun 10 12:37:20.711372 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:20.711295 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q6jq4" event={"ID":"9e6db1bd-99cf-4a32-b43f-4daca8b04204","Type":"ContainerStarted","Data":"23e6a92345e68f3708c7f7d7dbcd9492221ceeeadf8a3c3a187d2578ac299cd7"} Jun 10 12:37:20.738951 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:20.738898 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-q6jq4" podStartSLOduration=9.342738168 podStartE2EDuration="37.738881152s" totalImagesPullingTime="28.396142984s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 12:36:43 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:37:20.738692421 +0000 UTC m=+37.621296520" watchObservedRunningTime="2026-06-10 12:37:20.738881152 +0000 UTC m=+37.621485228" Jun 10 12:37:21.262875 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:21.262680 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6f28a11c-ee9f-40ec-a10e-1b6b54178990-metrics-tls\") pod \"dns-default-slqcw\" (UID: \"6f28a11c-ee9f-40ec-a10e-1b6b54178990\") " pod="openshift-dns/dns-default-slqcw" Jun 10 12:37:21.263024 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:21.262927 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aa4b745b-dca9-4769-981b-cf7eb4be811f-registry-tls\") pod \"image-registry-855748cdfb-4zc8x\" (UID: \"aa4b745b-dca9-4769-981b-cf7eb4be811f\") " pod="openshift-image-registry/image-registry-855748cdfb-4zc8x" Jun 10 12:37:21.263024 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:37:21.262854 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 12:37:21.263112 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:37:21.263038 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f28a11c-ee9f-40ec-a10e-1b6b54178990-metrics-tls podName:6f28a11c-ee9f-40ec-a10e-1b6b54178990 nodeName:}" failed. No retries permitted until 2026-06-10 12:37:25.263014862 +0000 UTC m=+42.145618938 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6f28a11c-ee9f-40ec-a10e-1b6b54178990-metrics-tls") pod "dns-default-slqcw" (UID: "6f28a11c-ee9f-40ec-a10e-1b6b54178990") : secret "dns-default-metrics-tls" not found Jun 10 12:37:21.263153 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:37:21.263113 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 12:37:21.263153 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:37:21.263133 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-855748cdfb-4zc8x: secret "image-registry-tls" not found Jun 10 12:37:21.263259 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:37:21.263216 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa4b745b-dca9-4769-981b-cf7eb4be811f-registry-tls podName:aa4b745b-dca9-4769-981b-cf7eb4be811f nodeName:}" failed. No retries permitted until 2026-06-10 12:37:25.263196567 +0000 UTC m=+42.145800623 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/aa4b745b-dca9-4769-981b-cf7eb4be811f-registry-tls") pod "image-registry-855748cdfb-4zc8x" (UID: "aa4b745b-dca9-4769-981b-cf7eb4be811f") : secret "image-registry-tls" not found Jun 10 12:37:22.225280 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:22.225177 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9c9fd4cc4-96m2l"] Jun 10 12:37:22.247792 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:22.247768 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9c9fd4cc4-96m2l"] Jun 10 12:37:22.247944 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:22.247855 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9c9fd4cc4-96m2l" Jun 10 12:37:22.250619 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:22.250596 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-br54f\"" Jun 10 12:37:22.252317 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:22.252292 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 10 12:37:22.252509 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:22.252488 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 10 12:37:22.252599 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:22.252491 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 10 12:37:22.253022 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:22.253006 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 10 12:37:22.263224 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:22.263203 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f9f449699-8h67q"] Jun 10 12:37:22.287687 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:22.287667 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d7b4756b-9bl2b"] Jun 10 12:37:22.287808 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:22.287792 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f9f449699-8h67q" Jun 10 12:37:22.290373 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:22.290355 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 10 12:37:22.308174 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:22.308153 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f9f449699-8h67q"] Jun 10 12:37:22.308273 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:22.308207 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d7b4756b-9bl2b"] Jun 10 12:37:22.308273 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:22.308265 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d7b4756b-9bl2b" Jun 10 12:37:22.311258 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:22.311243 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 10 12:37:22.311472 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:22.311443 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 10 12:37:22.311563 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:22.311523 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 10 12:37:22.311642 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:22.311622 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 10 12:37:22.371443 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:22.371411 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-785ww\" (UniqueName: \"kubernetes.io/projected/6c97d4e2-3c6b-4480-b5bc-065fcfe1237f-kube-api-access-785ww\") pod \"managed-serviceaccount-addon-agent-9c9fd4cc4-96m2l\" (UID: \"6c97d4e2-3c6b-4480-b5bc-065fcfe1237f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9c9fd4cc4-96m2l" Jun 10 12:37:22.371443 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:22.371445 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpcg9\" (UniqueName: \"kubernetes.io/projected/e2bd25e2-66a5-42d8-91f2-bf7f786df20f-kube-api-access-rpcg9\") pod \"klusterlet-addon-workmgr-5f9f449699-8h67q\" (UID: \"e2bd25e2-66a5-42d8-91f2-bf7f786df20f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f9f449699-8h67q" Jun 10 12:37:22.371633 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:22.371477 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e2bd25e2-66a5-42d8-91f2-bf7f786df20f-tmp\") pod \"klusterlet-addon-workmgr-5f9f449699-8h67q\" (UID: \"e2bd25e2-66a5-42d8-91f2-bf7f786df20f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f9f449699-8h67q" Jun 10 12:37:22.371633 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:22.371533 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/e2bd25e2-66a5-42d8-91f2-bf7f786df20f-klusterlet-config\") pod \"klusterlet-addon-workmgr-5f9f449699-8h67q\" (UID: \"e2bd25e2-66a5-42d8-91f2-bf7f786df20f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f9f449699-8h67q" Jun 10 12:37:22.371633 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:22.371592 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6c97d4e2-3c6b-4480-b5bc-065fcfe1237f-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-9c9fd4cc4-96m2l\" (UID: \"6c97d4e2-3c6b-4480-b5bc-065fcfe1237f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9c9fd4cc4-96m2l" Jun 10 12:37:22.472057 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:22.472019 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-785ww\" (UniqueName: \"kubernetes.io/projected/6c97d4e2-3c6b-4480-b5bc-065fcfe1237f-kube-api-access-785ww\") pod \"managed-serviceaccount-addon-agent-9c9fd4cc4-96m2l\" (UID: \"6c97d4e2-3c6b-4480-b5bc-065fcfe1237f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9c9fd4cc4-96m2l" Jun 10 12:37:22.472057 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:22.472055 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpcg9\" (UniqueName: \"kubernetes.io/projected/e2bd25e2-66a5-42d8-91f2-bf7f786df20f-kube-api-access-rpcg9\") pod \"klusterlet-addon-workmgr-5f9f449699-8h67q\" (UID: \"e2bd25e2-66a5-42d8-91f2-bf7f786df20f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f9f449699-8h67q" Jun 10 12:37:22.472327 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:22.472080 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/fad9cf3c-9f7a-4d84-9770-1953d9416305-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5d7b4756b-9bl2b\" (UID: \"fad9cf3c-9f7a-4d84-9770-1953d9416305\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d7b4756b-9bl2b" Jun 10 12:37:22.472327 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:22.472107 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e2bd25e2-66a5-42d8-91f2-bf7f786df20f-tmp\") pod \"klusterlet-addon-workmgr-5f9f449699-8h67q\" (UID: \"e2bd25e2-66a5-42d8-91f2-bf7f786df20f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f9f449699-8h67q" Jun 10 12:37:22.472327 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:22.472142 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/e2bd25e2-66a5-42d8-91f2-bf7f786df20f-klusterlet-config\") pod \"klusterlet-addon-workmgr-5f9f449699-8h67q\" (UID: \"e2bd25e2-66a5-42d8-91f2-bf7f786df20f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f9f449699-8h67q" Jun 10 12:37:22.472327 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:22.472162 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/fad9cf3c-9f7a-4d84-9770-1953d9416305-ca\") pod \"cluster-proxy-proxy-agent-5d7b4756b-9bl2b\" (UID: \"fad9cf3c-9f7a-4d84-9770-1953d9416305\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d7b4756b-9bl2b" Jun 10 12:37:22.472327 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:22.472215 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6c97d4e2-3c6b-4480-b5bc-065fcfe1237f-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-9c9fd4cc4-96m2l\" (UID: \"6c97d4e2-3c6b-4480-b5bc-065fcfe1237f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9c9fd4cc4-96m2l" Jun 10 12:37:22.472327 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:22.472250 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/fad9cf3c-9f7a-4d84-9770-1953d9416305-hub\") pod \"cluster-proxy-proxy-agent-5d7b4756b-9bl2b\" (UID: \"fad9cf3c-9f7a-4d84-9770-1953d9416305\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d7b4756b-9bl2b" Jun 10 12:37:22.472327 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:22.472275 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/fad9cf3c-9f7a-4d84-9770-1953d9416305-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5d7b4756b-9bl2b\" (UID: \"fad9cf3c-9f7a-4d84-9770-1953d9416305\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d7b4756b-9bl2b" Jun 10 12:37:22.472327 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:22.472299 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7t6jf\" (UniqueName: \"kubernetes.io/projected/fad9cf3c-9f7a-4d84-9770-1953d9416305-kube-api-access-7t6jf\") pod \"cluster-proxy-proxy-agent-5d7b4756b-9bl2b\" (UID: \"fad9cf3c-9f7a-4d84-9770-1953d9416305\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d7b4756b-9bl2b" Jun 10 12:37:22.472687 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:22.472333 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fad9cf3c-9f7a-4d84-9770-1953d9416305-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5d7b4756b-9bl2b\" (UID: \"fad9cf3c-9f7a-4d84-9770-1953d9416305\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d7b4756b-9bl2b" Jun 10 12:37:22.472687 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:22.472594 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e2bd25e2-66a5-42d8-91f2-bf7f786df20f-tmp\") pod \"klusterlet-addon-workmgr-5f9f449699-8h67q\" (UID: \"e2bd25e2-66a5-42d8-91f2-bf7f786df20f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f9f449699-8h67q" Jun 10 12:37:22.476379 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:22.476316 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6c97d4e2-3c6b-4480-b5bc-065fcfe1237f-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-9c9fd4cc4-96m2l\" (UID: \"6c97d4e2-3c6b-4480-b5bc-065fcfe1237f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9c9fd4cc4-96m2l" Jun 10 12:37:22.476379 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:22.476326 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/e2bd25e2-66a5-42d8-91f2-bf7f786df20f-klusterlet-config\") pod \"klusterlet-addon-workmgr-5f9f449699-8h67q\" (UID: \"e2bd25e2-66a5-42d8-91f2-bf7f786df20f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f9f449699-8h67q" Jun 10 12:37:22.481138 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:22.481114 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpcg9\" (UniqueName: \"kubernetes.io/projected/e2bd25e2-66a5-42d8-91f2-bf7f786df20f-kube-api-access-rpcg9\") pod \"klusterlet-addon-workmgr-5f9f449699-8h67q\" (UID: \"e2bd25e2-66a5-42d8-91f2-bf7f786df20f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f9f449699-8h67q" Jun 10 12:37:22.481247 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:22.481223 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-785ww\" (UniqueName: \"kubernetes.io/projected/6c97d4e2-3c6b-4480-b5bc-065fcfe1237f-kube-api-access-785ww\") pod \"managed-serviceaccount-addon-agent-9c9fd4cc4-96m2l\" (UID: \"6c97d4e2-3c6b-4480-b5bc-065fcfe1237f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9c9fd4cc4-96m2l" Jun 10 12:37:22.569420 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:22.569385 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9c9fd4cc4-96m2l" Jun 10 12:37:22.573687 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:22.573667 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/fad9cf3c-9f7a-4d84-9770-1953d9416305-ca\") pod \"cluster-proxy-proxy-agent-5d7b4756b-9bl2b\" (UID: \"fad9cf3c-9f7a-4d84-9770-1953d9416305\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d7b4756b-9bl2b" Jun 10 12:37:22.573772 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:22.573710 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/fad9cf3c-9f7a-4d84-9770-1953d9416305-hub\") pod \"cluster-proxy-proxy-agent-5d7b4756b-9bl2b\" (UID: \"fad9cf3c-9f7a-4d84-9770-1953d9416305\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d7b4756b-9bl2b" Jun 10 12:37:22.573772 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:22.573726 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/fad9cf3c-9f7a-4d84-9770-1953d9416305-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5d7b4756b-9bl2b\" (UID: \"fad9cf3c-9f7a-4d84-9770-1953d9416305\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d7b4756b-9bl2b" Jun 10 12:37:22.573772 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:22.573747 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7t6jf\" (UniqueName: \"kubernetes.io/projected/fad9cf3c-9f7a-4d84-9770-1953d9416305-kube-api-access-7t6jf\") pod \"cluster-proxy-proxy-agent-5d7b4756b-9bl2b\" (UID: \"fad9cf3c-9f7a-4d84-9770-1953d9416305\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d7b4756b-9bl2b" Jun 10 12:37:22.573923 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:22.573775 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fad9cf3c-9f7a-4d84-9770-1953d9416305-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5d7b4756b-9bl2b\" (UID: \"fad9cf3c-9f7a-4d84-9770-1953d9416305\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d7b4756b-9bl2b" Jun 10 12:37:22.573923 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:22.573841 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/fad9cf3c-9f7a-4d84-9770-1953d9416305-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5d7b4756b-9bl2b\" (UID: \"fad9cf3c-9f7a-4d84-9770-1953d9416305\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d7b4756b-9bl2b" Jun 10 12:37:22.574554 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:22.574529 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/fad9cf3c-9f7a-4d84-9770-1953d9416305-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5d7b4756b-9bl2b\" (UID: \"fad9cf3c-9f7a-4d84-9770-1953d9416305\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d7b4756b-9bl2b" Jun 10 12:37:22.576324 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:22.576301 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/fad9cf3c-9f7a-4d84-9770-1953d9416305-hub\") pod \"cluster-proxy-proxy-agent-5d7b4756b-9bl2b\" (UID: \"fad9cf3c-9f7a-4d84-9770-1953d9416305\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d7b4756b-9bl2b" Jun 10 12:37:22.576429 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:22.576384 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/fad9cf3c-9f7a-4d84-9770-1953d9416305-ca\") pod \"cluster-proxy-proxy-agent-5d7b4756b-9bl2b\" (UID: \"fad9cf3c-9f7a-4d84-9770-1953d9416305\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d7b4756b-9bl2b" Jun 10 12:37:22.576429 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:22.576397 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/fad9cf3c-9f7a-4d84-9770-1953d9416305-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5d7b4756b-9bl2b\" (UID: \"fad9cf3c-9f7a-4d84-9770-1953d9416305\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d7b4756b-9bl2b" Jun 10 12:37:22.576510 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:22.576437 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fad9cf3c-9f7a-4d84-9770-1953d9416305-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5d7b4756b-9bl2b\" (UID: \"fad9cf3c-9f7a-4d84-9770-1953d9416305\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d7b4756b-9bl2b" Jun 10 12:37:22.583167 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:22.583149 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7t6jf\" (UniqueName: \"kubernetes.io/projected/fad9cf3c-9f7a-4d84-9770-1953d9416305-kube-api-access-7t6jf\") pod \"cluster-proxy-proxy-agent-5d7b4756b-9bl2b\" (UID: \"fad9cf3c-9f7a-4d84-9770-1953d9416305\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d7b4756b-9bl2b" Jun 10 12:37:22.596472 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:22.596421 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f9f449699-8h67q" Jun 10 12:37:22.616579 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:22.616552 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d7b4756b-9bl2b" Jun 10 12:37:22.718497 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:22.718422 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fwbxx" event={"ID":"32bc9549-c4d5-4180-9d38-cb7c9d22d920","Type":"ContainerStarted","Data":"3341ec3b87e6addbb3dac435e6afbb52df91c3ef801b8707247c325fed2e05f8"} Jun 10 12:37:22.722975 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:22.722954 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9c9fd4cc4-96m2l"] Jun 10 12:37:22.737694 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:37:22.737652 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6c97d4e2_3c6b_4480_b5bc_065fcfe1237f.slice/crio-cd89b0a7b44de73be59fd83020adc10670f19ae80b9f47a44ec6d89b94ae505b WatchSource:0}: Error finding container cd89b0a7b44de73be59fd83020adc10670f19ae80b9f47a44ec6d89b94ae505b: Status 404 returned error can't find the container with id cd89b0a7b44de73be59fd83020adc10670f19ae80b9f47a44ec6d89b94ae505b Jun 10 12:37:22.740667 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:22.740489 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-fwbxx" podStartSLOduration=1.750427002 podStartE2EDuration="5.740467509s" totalImagesPullingTime="3.990040507s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:37:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:37:22.739828496 +0000 UTC m=+39.622432572" watchObservedRunningTime="2026-06-10 12:37:22.740467509 +0000 UTC m=+39.623071587" Jun 10 12:37:22.801321 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:22.801290 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f9f449699-8h67q"] Jun 10 12:37:22.804856 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:37:22.804826 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2bd25e2_66a5_42d8_91f2_bf7f786df20f.slice/crio-b7dd17a356010a943dec5f4ed7f37a5187cfef560b51f01db635acebb2cd9f25 WatchSource:0}: Error finding container b7dd17a356010a943dec5f4ed7f37a5187cfef560b51f01db635acebb2cd9f25: Status 404 returned error can't find the container with id b7dd17a356010a943dec5f4ed7f37a5187cfef560b51f01db635acebb2cd9f25 Jun 10 12:37:22.821740 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:22.821717 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d7b4756b-9bl2b"] Jun 10 12:37:22.824610 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:37:22.824587 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfad9cf3c_9f7a_4d84_9770_1953d9416305.slice/crio-69d6e4dbce919857ed12489bb654c539e6a08c453ae70da0dba820104b3b95c0 WatchSource:0}: Error finding container 69d6e4dbce919857ed12489bb654c539e6a08c453ae70da0dba820104b3b95c0: Status 404 returned error can't find the container with id 69d6e4dbce919857ed12489bb654c539e6a08c453ae70da0dba820104b3b95c0 Jun 10 12:37:23.724813 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:23.724747 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f9f449699-8h67q" event={"ID":"e2bd25e2-66a5-42d8-91f2-bf7f786df20f","Type":"ContainerStarted","Data":"b7dd17a356010a943dec5f4ed7f37a5187cfef560b51f01db635acebb2cd9f25"} Jun 10 12:37:23.726868 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:23.726801 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9c9fd4cc4-96m2l" event={"ID":"6c97d4e2-3c6b-4480-b5bc-065fcfe1237f","Type":"ContainerStarted","Data":"cd89b0a7b44de73be59fd83020adc10670f19ae80b9f47a44ec6d89b94ae505b"} Jun 10 12:37:23.729933 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:23.729406 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d7b4756b-9bl2b" event={"ID":"fad9cf3c-9f7a-4d84-9770-1953d9416305","Type":"ContainerStarted","Data":"69d6e4dbce919857ed12489bb654c539e6a08c453ae70da0dba820104b3b95c0"} Jun 10 12:37:25.305380 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:25.305068 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6f28a11c-ee9f-40ec-a10e-1b6b54178990-metrics-tls\") pod \"dns-default-slqcw\" (UID: \"6f28a11c-ee9f-40ec-a10e-1b6b54178990\") " pod="openshift-dns/dns-default-slqcw" Jun 10 12:37:25.305380 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:25.305151 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aa4b745b-dca9-4769-981b-cf7eb4be811f-registry-tls\") pod \"image-registry-855748cdfb-4zc8x\" (UID: \"aa4b745b-dca9-4769-981b-cf7eb4be811f\") " pod="openshift-image-registry/image-registry-855748cdfb-4zc8x" Jun 10 12:37:25.305380 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:37:25.305240 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 12:37:25.305380 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:37:25.305318 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f28a11c-ee9f-40ec-a10e-1b6b54178990-metrics-tls podName:6f28a11c-ee9f-40ec-a10e-1b6b54178990 nodeName:}" failed. No retries permitted until 2026-06-10 12:37:33.305296021 +0000 UTC m=+50.187900097 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6f28a11c-ee9f-40ec-a10e-1b6b54178990-metrics-tls") pod "dns-default-slqcw" (UID: "6f28a11c-ee9f-40ec-a10e-1b6b54178990") : secret "dns-default-metrics-tls" not found Jun 10 12:37:25.305380 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:37:25.305329 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 12:37:25.305380 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:37:25.305353 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-855748cdfb-4zc8x: secret "image-registry-tls" not found Jun 10 12:37:25.306108 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:37:25.305482 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa4b745b-dca9-4769-981b-cf7eb4be811f-registry-tls podName:aa4b745b-dca9-4769-981b-cf7eb4be811f nodeName:}" failed. No retries permitted until 2026-06-10 12:37:33.305462434 +0000 UTC m=+50.188066500 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/aa4b745b-dca9-4769-981b-cf7eb4be811f-registry-tls") pod "image-registry-855748cdfb-4zc8x" (UID: "aa4b745b-dca9-4769-981b-cf7eb4be811f") : secret "image-registry-tls" not found Jun 10 12:37:30.750233 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:30.750142 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f9f449699-8h67q" event={"ID":"e2bd25e2-66a5-42d8-91f2-bf7f786df20f","Type":"ContainerStarted","Data":"eef4dd7b9dd49a0b7da413d827ff9ca738e291bec6d05f122d4f7e665d40bb59"} Jun 10 12:37:30.750661 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:30.750313 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f9f449699-8h67q" Jun 10 12:37:30.751888 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:30.751859 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9c9fd4cc4-96m2l" event={"ID":"6c97d4e2-3c6b-4480-b5bc-065fcfe1237f","Type":"ContainerStarted","Data":"767bf56c3c06af89d510a9a5bd2dfe411d331d9f71e5395db34769d72ce9d99e"} Jun 10 12:37:30.752268 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:30.752250 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f9f449699-8h67q" Jun 10 12:37:30.753935 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:30.753913 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d7b4756b-9bl2b" event={"ID":"fad9cf3c-9f7a-4d84-9770-1953d9416305","Type":"ContainerStarted","Data":"90f8202268aee3f2227e4a03185a7086dc34937d543c4c6a96f34fc513360c3c"} Jun 10 12:37:30.754014 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:30.753945 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d7b4756b-9bl2b" event={"ID":"fad9cf3c-9f7a-4d84-9770-1953d9416305","Type":"ContainerStarted","Data":"c2d9b8565f82a86632c3bffe0e92a8eff0ef2f202180fba4c64d8b0e51c25d39"} Jun 10 12:37:30.754014 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:30.753957 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d7b4756b-9bl2b" event={"ID":"fad9cf3c-9f7a-4d84-9770-1953d9416305","Type":"ContainerStarted","Data":"e571f1d3da93da0e14b36ce887649b41ed5d1fb0134fae11aa7f6d0b8851dd37"} Jun 10 12:37:30.770847 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:30.770806 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f9f449699-8h67q" podStartSLOduration=1.397337557 podStartE2EDuration="8.770790307s" totalImagesPullingTime="7.37345275s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:37:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:37:30.770677943 +0000 UTC m=+47.653282057" watchObservedRunningTime="2026-06-10 12:37:30.770790307 +0000 UTC m=+47.653394382" Jun 10 12:37:30.798544 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:30.798506 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d7b4756b-9bl2b" podStartSLOduration=1.429148919 podStartE2EDuration="8.798492796s" totalImagesPullingTime="7.369343877s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:37:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:37:30.798482414 +0000 UTC m=+47.681086489" watchObservedRunningTime="2026-06-10 12:37:30.798492796 +0000 UTC m=+47.681096870" Jun 10 12:37:30.819331 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:30.819297 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9c9fd4cc4-96m2l" podStartSLOduration=1.380571193 podStartE2EDuration="8.819285653s" totalImagesPullingTime="7.43871446s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:37:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:37:30.818885296 +0000 UTC m=+47.701489370" watchObservedRunningTime="2026-06-10 12:37:30.819285653 +0000 UTC m=+47.701889721" Jun 10 12:37:33.361668 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:33.361621 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6f28a11c-ee9f-40ec-a10e-1b6b54178990-metrics-tls\") pod \"dns-default-slqcw\" (UID: \"6f28a11c-ee9f-40ec-a10e-1b6b54178990\") " pod="openshift-dns/dns-default-slqcw" Jun 10 12:37:33.362023 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:33.361693 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aa4b745b-dca9-4769-981b-cf7eb4be811f-registry-tls\") pod \"image-registry-855748cdfb-4zc8x\" (UID: \"aa4b745b-dca9-4769-981b-cf7eb4be811f\") " pod="openshift-image-registry/image-registry-855748cdfb-4zc8x" Jun 10 12:37:33.362023 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:37:33.361767 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 12:37:33.362023 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:37:33.361826 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f28a11c-ee9f-40ec-a10e-1b6b54178990-metrics-tls podName:6f28a11c-ee9f-40ec-a10e-1b6b54178990 nodeName:}" failed. No retries permitted until 2026-06-10 12:37:49.361810773 +0000 UTC m=+66.244414826 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6f28a11c-ee9f-40ec-a10e-1b6b54178990-metrics-tls") pod "dns-default-slqcw" (UID: "6f28a11c-ee9f-40ec-a10e-1b6b54178990") : secret "dns-default-metrics-tls" not found Jun 10 12:37:33.362023 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:37:33.361775 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 12:37:33.362023 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:37:33.361858 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-855748cdfb-4zc8x: secret "image-registry-tls" not found Jun 10 12:37:33.362023 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:37:33.361898 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa4b745b-dca9-4769-981b-cf7eb4be811f-registry-tls podName:aa4b745b-dca9-4769-981b-cf7eb4be811f nodeName:}" failed. No retries permitted until 2026-06-10 12:37:49.361887189 +0000 UTC m=+66.244491242 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/aa4b745b-dca9-4769-981b-cf7eb4be811f-registry-tls") pod "image-registry-855748cdfb-4zc8x" (UID: "aa4b745b-dca9-4769-981b-cf7eb4be811f") : secret "image-registry-tls" not found Jun 10 12:37:43.694956 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:43.694931 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5jhbt" Jun 10 12:37:49.378968 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:49.378927 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6f28a11c-ee9f-40ec-a10e-1b6b54178990-metrics-tls\") pod \"dns-default-slqcw\" (UID: \"6f28a11c-ee9f-40ec-a10e-1b6b54178990\") " pod="openshift-dns/dns-default-slqcw" Jun 10 12:37:49.379503 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:49.378984 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aa4b745b-dca9-4769-981b-cf7eb4be811f-registry-tls\") pod \"image-registry-855748cdfb-4zc8x\" (UID: \"aa4b745b-dca9-4769-981b-cf7eb4be811f\") " pod="openshift-image-registry/image-registry-855748cdfb-4zc8x" Jun 10 12:37:49.379503 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:37:49.379077 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 12:37:49.379503 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:37:49.379088 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-855748cdfb-4zc8x: secret "image-registry-tls" not found Jun 10 12:37:49.379503 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:37:49.379089 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 12:37:49.379503 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:49.379106 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b893d76d-5c4b-4d52-9658-7d87236b1b2e-original-pull-secret\") pod \"global-pull-secret-syncer-q25rc\" (UID: \"b893d76d-5c4b-4d52-9658-7d87236b1b2e\") " pod="kube-system/global-pull-secret-syncer-q25rc" Jun 10 12:37:49.379503 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:37:49.379140 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa4b745b-dca9-4769-981b-cf7eb4be811f-registry-tls podName:aa4b745b-dca9-4769-981b-cf7eb4be811f nodeName:}" failed. No retries permitted until 2026-06-10 12:38:21.379126881 +0000 UTC m=+98.261730933 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/aa4b745b-dca9-4769-981b-cf7eb4be811f-registry-tls") pod "image-registry-855748cdfb-4zc8x" (UID: "aa4b745b-dca9-4769-981b-cf7eb4be811f") : secret "image-registry-tls" not found Jun 10 12:37:49.379503 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:49.379177 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65533745-1c5b-48e0-b4a2-77fc1cc7908d-metrics-certs\") pod \"network-metrics-daemon-n4lrk\" (UID: \"65533745-1c5b-48e0-b4a2-77fc1cc7908d\") " pod="openshift-multus/network-metrics-daemon-n4lrk" Jun 10 12:37:49.379503 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:37:49.379216 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f28a11c-ee9f-40ec-a10e-1b6b54178990-metrics-tls podName:6f28a11c-ee9f-40ec-a10e-1b6b54178990 nodeName:}" failed. No retries permitted until 2026-06-10 12:38:21.379197864 +0000 UTC m=+98.261801931 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6f28a11c-ee9f-40ec-a10e-1b6b54178990-metrics-tls") pod "dns-default-slqcw" (UID: "6f28a11c-ee9f-40ec-a10e-1b6b54178990") : secret "dns-default-metrics-tls" not found Jun 10 12:37:49.382094 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:49.382074 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 10 12:37:49.382151 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:49.382123 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 10 12:37:49.390129 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:37:49.390103 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 10 12:37:49.390267 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:37:49.390174 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65533745-1c5b-48e0-b4a2-77fc1cc7908d-metrics-certs podName:65533745-1c5b-48e0-b4a2-77fc1cc7908d nodeName:}" failed. No retries permitted until 2026-06-10 12:38:53.390155668 +0000 UTC m=+130.272759722 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/65533745-1c5b-48e0-b4a2-77fc1cc7908d-metrics-certs") pod "network-metrics-daemon-n4lrk" (UID: "65533745-1c5b-48e0-b4a2-77fc1cc7908d") : secret "metrics-daemon-secret" not found Jun 10 12:37:49.392268 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:49.392248 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b893d76d-5c4b-4d52-9658-7d87236b1b2e-original-pull-secret\") pod \"global-pull-secret-syncer-q25rc\" (UID: \"b893d76d-5c4b-4d52-9658-7d87236b1b2e\") " pod="kube-system/global-pull-secret-syncer-q25rc" Jun 10 12:37:49.480356 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:49.480300 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8rpn\" (UniqueName: \"kubernetes.io/projected/9ed82178-699a-4219-84bc-d56643bb7337-kube-api-access-d8rpn\") pod \"network-check-target-p8pxq\" (UID: \"9ed82178-699a-4219-84bc-d56643bb7337\") " pod="openshift-network-diagnostics/network-check-target-p8pxq" Jun 10 12:37:49.483438 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:49.483413 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 10 12:37:49.494156 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:49.494124 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 10 12:37:49.503987 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:49.503960 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8rpn\" (UniqueName: \"kubernetes.io/projected/9ed82178-699a-4219-84bc-d56643bb7337-kube-api-access-d8rpn\") pod \"network-check-target-p8pxq\" (UID: \"9ed82178-699a-4219-84bc-d56643bb7337\") " pod="openshift-network-diagnostics/network-check-target-p8pxq" Jun 10 12:37:49.647885 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:49.647783 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q25rc" Jun 10 12:37:49.657967 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:49.657944 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bmpcd\"" Jun 10 12:37:49.665910 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:49.665886 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p8pxq" Jun 10 12:37:49.788956 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:49.788924 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-q25rc"] Jun 10 12:37:49.793279 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:37:49.793254 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb893d76d_5c4b_4d52_9658_7d87236b1b2e.slice/crio-e17cd4125e1d243aad474dfcb255a650e80636d9bd0fd5f704f11f5c47b7b883 WatchSource:0}: Error finding container e17cd4125e1d243aad474dfcb255a650e80636d9bd0fd5f704f11f5c47b7b883: Status 404 returned error can't find the container with id e17cd4125e1d243aad474dfcb255a650e80636d9bd0fd5f704f11f5c47b7b883 Jun 10 12:37:49.807347 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:49.807319 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-q25rc" event={"ID":"b893d76d-5c4b-4d52-9658-7d87236b1b2e","Type":"ContainerStarted","Data":"e17cd4125e1d243aad474dfcb255a650e80636d9bd0fd5f704f11f5c47b7b883"} Jun 10 12:37:49.807432 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:49.807373 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-p8pxq"] Jun 10 12:37:49.809951 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:37:49.809928 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ed82178_699a_4219_84bc_d56643bb7337.slice/crio-11b94ad742c84316e67c90ef43c8469a6e6010e7e16249fa22c63bea5a87f277 WatchSource:0}: Error finding container 11b94ad742c84316e67c90ef43c8469a6e6010e7e16249fa22c63bea5a87f277: Status 404 returned error can't find the container with id 11b94ad742c84316e67c90ef43c8469a6e6010e7e16249fa22c63bea5a87f277 Jun 10 12:37:50.812116 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:50.812079 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-p8pxq" event={"ID":"9ed82178-699a-4219-84bc-d56643bb7337","Type":"ContainerStarted","Data":"11b94ad742c84316e67c90ef43c8469a6e6010e7e16249fa22c63bea5a87f277"} Jun 10 12:37:53.825343 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:53.825303 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-p8pxq" event={"ID":"9ed82178-699a-4219-84bc-d56643bb7337","Type":"ContainerStarted","Data":"26b0f3ecd86cb4c2294e4b7b28426d9b9a2cac9ef50480cd2bd4a50fd9f632c1"} Jun 10 12:37:53.825825 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:53.825527 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-p8pxq" Jun 10 12:37:53.846857 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:53.846807 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-p8pxq" podStartSLOduration=67.639377394 podStartE2EDuration="1m10.846790911s" totalImagesPullingTime="3.207413517s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:36:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:37:53.846668103 +0000 UTC m=+70.729272179" watchObservedRunningTime="2026-06-10 12:37:53.846790911 +0000 UTC m=+70.729394986" Jun 10 12:37:55.832333 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:55.832300 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-q25rc" event={"ID":"b893d76d-5c4b-4d52-9658-7d87236b1b2e","Type":"ContainerStarted","Data":"295a128ead93335660ed9c8086428233dfb90ab4d4c5fda4430e796654725507"} Jun 10 12:37:55.851175 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:37:55.851126 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-q25rc" podStartSLOduration=66.696465677 podStartE2EDuration="1m11.85111113s" totalImagesPullingTime="5.154645453s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 12:36:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:37:55.850367699 +0000 UTC m=+72.732971774" watchObservedRunningTime="2026-06-10 12:37:55.85111113 +0000 UTC m=+72.733715199" Jun 10 12:38:21.413717 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:38:21.413670 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6f28a11c-ee9f-40ec-a10e-1b6b54178990-metrics-tls\") pod \"dns-default-slqcw\" (UID: \"6f28a11c-ee9f-40ec-a10e-1b6b54178990\") " pod="openshift-dns/dns-default-slqcw" Jun 10 12:38:21.413717 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:38:21.413721 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aa4b745b-dca9-4769-981b-cf7eb4be811f-registry-tls\") pod \"image-registry-855748cdfb-4zc8x\" (UID: \"aa4b745b-dca9-4769-981b-cf7eb4be811f\") " pod="openshift-image-registry/image-registry-855748cdfb-4zc8x" Jun 10 12:38:21.414112 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:38:21.413825 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 12:38:21.414112 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:38:21.413825 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 12:38:21.414112 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:38:21.413895 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f28a11c-ee9f-40ec-a10e-1b6b54178990-metrics-tls podName:6f28a11c-ee9f-40ec-a10e-1b6b54178990 nodeName:}" failed. No retries permitted until 2026-06-10 12:39:25.413879403 +0000 UTC m=+162.296483455 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6f28a11c-ee9f-40ec-a10e-1b6b54178990-metrics-tls") pod "dns-default-slqcw" (UID: "6f28a11c-ee9f-40ec-a10e-1b6b54178990") : secret "dns-default-metrics-tls" not found Jun 10 12:38:21.414112 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:38:21.413837 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-855748cdfb-4zc8x: secret "image-registry-tls" not found Jun 10 12:38:21.414112 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:38:21.413964 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa4b745b-dca9-4769-981b-cf7eb4be811f-registry-tls podName:aa4b745b-dca9-4769-981b-cf7eb4be811f nodeName:}" failed. No retries permitted until 2026-06-10 12:39:25.413951957 +0000 UTC m=+162.296556010 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/aa4b745b-dca9-4769-981b-cf7eb4be811f-registry-tls") pod "image-registry-855748cdfb-4zc8x" (UID: "aa4b745b-dca9-4769-981b-cf7eb4be811f") : secret "image-registry-tls" not found Jun 10 12:38:24.830569 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:38:24.830540 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-p8pxq" Jun 10 12:38:53.434095 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:38:53.434055 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65533745-1c5b-48e0-b4a2-77fc1cc7908d-metrics-certs\") pod \"network-metrics-daemon-n4lrk\" (UID: \"65533745-1c5b-48e0-b4a2-77fc1cc7908d\") " pod="openshift-multus/network-metrics-daemon-n4lrk" Jun 10 12:38:53.434637 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:38:53.434156 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 10 12:38:53.434637 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:38:53.434243 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65533745-1c5b-48e0-b4a2-77fc1cc7908d-metrics-certs podName:65533745-1c5b-48e0-b4a2-77fc1cc7908d nodeName:}" failed. No retries permitted until 2026-06-10 12:40:55.434226715 +0000 UTC m=+252.316830768 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/65533745-1c5b-48e0-b4a2-77fc1cc7908d-metrics-certs") pod "network-metrics-daemon-n4lrk" (UID: "65533745-1c5b-48e0-b4a2-77fc1cc7908d") : secret "metrics-daemon-secret" not found Jun 10 12:39:20.477589 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:39:20.477526 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-855748cdfb-4zc8x" podUID="aa4b745b-dca9-4769-981b-cf7eb4be811f" Jun 10 12:39:20.527567 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:39:20.527527 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-slqcw" podUID="6f28a11c-ee9f-40ec-a10e-1b6b54178990" Jun 10 12:39:20.562838 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:39:20.562797 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-n4lrk" podUID="65533745-1c5b-48e0-b4a2-77fc1cc7908d" Jun 10 12:39:21.072570 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:39:21.072544 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-855748cdfb-4zc8x" Jun 10 12:39:21.072729 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:39:21.072544 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-slqcw" Jun 10 12:39:25.453324 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:39:25.453273 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6f28a11c-ee9f-40ec-a10e-1b6b54178990-metrics-tls\") pod \"dns-default-slqcw\" (UID: \"6f28a11c-ee9f-40ec-a10e-1b6b54178990\") " pod="openshift-dns/dns-default-slqcw" Jun 10 12:39:25.453324 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:39:25.453329 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aa4b745b-dca9-4769-981b-cf7eb4be811f-registry-tls\") pod \"image-registry-855748cdfb-4zc8x\" (UID: \"aa4b745b-dca9-4769-981b-cf7eb4be811f\") " pod="openshift-image-registry/image-registry-855748cdfb-4zc8x" Jun 10 12:39:25.453828 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:39:25.453425 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 12:39:25.453828 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:39:25.453425 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 12:39:25.453828 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:39:25.453510 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f28a11c-ee9f-40ec-a10e-1b6b54178990-metrics-tls podName:6f28a11c-ee9f-40ec-a10e-1b6b54178990 nodeName:}" failed. No retries permitted until 2026-06-10 12:41:27.453493015 +0000 UTC m=+284.336097068 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6f28a11c-ee9f-40ec-a10e-1b6b54178990-metrics-tls") pod "dns-default-slqcw" (UID: "6f28a11c-ee9f-40ec-a10e-1b6b54178990") : secret "dns-default-metrics-tls" not found Jun 10 12:39:25.453828 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:39:25.453437 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-855748cdfb-4zc8x: secret "image-registry-tls" not found Jun 10 12:39:25.453828 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:39:25.453590 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa4b745b-dca9-4769-981b-cf7eb4be811f-registry-tls podName:aa4b745b-dca9-4769-981b-cf7eb4be811f nodeName:}" failed. No retries permitted until 2026-06-10 12:41:27.453574061 +0000 UTC m=+284.336178114 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/aa4b745b-dca9-4769-981b-cf7eb4be811f-registry-tls") pod "image-registry-855748cdfb-4zc8x" (UID: "aa4b745b-dca9-4769-981b-cf7eb4be811f") : secret "image-registry-tls" not found Jun 10 12:39:30.751332 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:39:30.751252 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f9f449699-8h67q" podUID="e2bd25e2-66a5-42d8-91f2-bf7f786df20f" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.10:8000/readyz\": dial tcp 10.132.0.10:8000: connect: connection refused" Jun 10 12:39:31.103601 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:39:31.103569 2557 generic.go:356] "Generic (PLEG): container finished" podID="6c97d4e2-3c6b-4480-b5bc-065fcfe1237f" containerID="767bf56c3c06af89d510a9a5bd2dfe411d331d9f71e5395db34769d72ce9d99e" exitCode=255 Jun 10 12:39:31.103752 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:39:31.103651 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9c9fd4cc4-96m2l" event={"ID":"6c97d4e2-3c6b-4480-b5bc-065fcfe1237f","Type":"ContainerDied","Data":"767bf56c3c06af89d510a9a5bd2dfe411d331d9f71e5395db34769d72ce9d99e"} Jun 10 12:39:31.104005 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:39:31.103978 2557 scope.go:117] "RemoveContainer" containerID="767bf56c3c06af89d510a9a5bd2dfe411d331d9f71e5395db34769d72ce9d99e" Jun 10 12:39:31.105509 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:39:31.105484 2557 generic.go:356] "Generic (PLEG): container finished" podID="e2bd25e2-66a5-42d8-91f2-bf7f786df20f" containerID="eef4dd7b9dd49a0b7da413d827ff9ca738e291bec6d05f122d4f7e665d40bb59" exitCode=1 Jun 10 12:39:31.105611 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:39:31.105549 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f9f449699-8h67q" event={"ID":"e2bd25e2-66a5-42d8-91f2-bf7f786df20f","Type":"ContainerDied","Data":"eef4dd7b9dd49a0b7da413d827ff9ca738e291bec6d05f122d4f7e665d40bb59"} Jun 10 12:39:31.105844 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:39:31.105829 2557 scope.go:117] "RemoveContainer" containerID="eef4dd7b9dd49a0b7da413d827ff9ca738e291bec6d05f122d4f7e665d40bb59" Jun 10 12:39:32.110586 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:39:32.110549 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9c9fd4cc4-96m2l" event={"ID":"6c97d4e2-3c6b-4480-b5bc-065fcfe1237f","Type":"ContainerStarted","Data":"4eb9b1434ab446cb79a1efe4c9ca88273031adc76277c272720a1bae829c4423"} Jun 10 12:39:32.112369 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:39:32.112344 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f9f449699-8h67q" event={"ID":"e2bd25e2-66a5-42d8-91f2-bf7f786df20f","Type":"ContainerStarted","Data":"f377e98584165615a5bceda42ed7cec9abc399471a6526acf1590becda15ea80"} Jun 10 12:39:32.112590 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:39:32.112573 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f9f449699-8h67q" Jun 10 12:39:32.113198 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:39:32.113163 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f9f449699-8h67q" Jun 10 12:39:33.537972 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:39:33.537889 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n4lrk" Jun 10 12:40:54.185791 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:40:54.185761 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mvcnc_f324d4da-090d-4e3e-99f7-5a5393276463/dns-node-resolver/0.log" Jun 10 12:40:54.787744 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:40:54.787719 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4c6gv_9ced5103-eb3b-4070-9c0a-06df4cd9c0a8/node-ca/0.log" Jun 10 12:40:55.454033 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:40:55.453993 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65533745-1c5b-48e0-b4a2-77fc1cc7908d-metrics-certs\") pod \"network-metrics-daemon-n4lrk\" (UID: \"65533745-1c5b-48e0-b4a2-77fc1cc7908d\") " pod="openshift-multus/network-metrics-daemon-n4lrk" Jun 10 12:40:55.454488 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:40:55.454125 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 10 12:40:55.454488 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:40:55.454232 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65533745-1c5b-48e0-b4a2-77fc1cc7908d-metrics-certs podName:65533745-1c5b-48e0-b4a2-77fc1cc7908d nodeName:}" failed. No retries permitted until 2026-06-10 12:42:57.454212222 +0000 UTC m=+374.336816289 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/65533745-1c5b-48e0-b4a2-77fc1cc7908d-metrics-certs") pod "network-metrics-daemon-n4lrk" (UID: "65533745-1c5b-48e0-b4a2-77fc1cc7908d") : secret "metrics-daemon-secret" not found Jun 10 12:40:55.786418 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:40:55.786393 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fwbxx_32bc9549-c4d5-4180-9d38-cb7c9d22d920/serve-healthcheck-canary/0.log" Jun 10 12:41:12.617969 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:12.617877 2557 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d7b4756b-9bl2b" podUID="fad9cf3c-9f7a-4d84-9770-1953d9416305" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 10 12:41:16.969959 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:16.969929 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-9xcjs"] Jun 10 12:41:16.971812 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:16.971798 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9xcjs" Jun 10 12:41:16.977781 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:16.977758 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 10 12:41:16.978509 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:16.978451 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 10 12:41:16.978687 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:16.978670 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 10 12:41:16.978773 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:16.978757 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-hlzxg\"" Jun 10 12:41:16.980315 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:16.980295 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 10 12:41:16.991709 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:16.991687 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9xcjs"] Jun 10 12:41:17.014923 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:17.014902 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0d1e8746-7256-46a9-bda4-b316ddae71f7-crio-socket\") pod \"insights-runtime-extractor-9xcjs\" (UID: \"0d1e8746-7256-46a9-bda4-b316ddae71f7\") " pod="openshift-insights/insights-runtime-extractor-9xcjs" Jun 10 12:41:17.015016 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:17.014928 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0d1e8746-7256-46a9-bda4-b316ddae71f7-data-volume\") pod \"insights-runtime-extractor-9xcjs\" (UID: \"0d1e8746-7256-46a9-bda4-b316ddae71f7\") " pod="openshift-insights/insights-runtime-extractor-9xcjs" Jun 10 12:41:17.015016 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:17.015005 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0d1e8746-7256-46a9-bda4-b316ddae71f7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9xcjs\" (UID: \"0d1e8746-7256-46a9-bda4-b316ddae71f7\") " pod="openshift-insights/insights-runtime-extractor-9xcjs" Jun 10 12:41:17.015098 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:17.015026 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7k8hb\" (UniqueName: \"kubernetes.io/projected/0d1e8746-7256-46a9-bda4-b316ddae71f7-kube-api-access-7k8hb\") pod \"insights-runtime-extractor-9xcjs\" (UID: \"0d1e8746-7256-46a9-bda4-b316ddae71f7\") " pod="openshift-insights/insights-runtime-extractor-9xcjs" Jun 10 12:41:17.015098 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:17.015085 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0d1e8746-7256-46a9-bda4-b316ddae71f7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9xcjs\" (UID: \"0d1e8746-7256-46a9-bda4-b316ddae71f7\") " pod="openshift-insights/insights-runtime-extractor-9xcjs" Jun 10 12:41:17.116068 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:17.116042 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0d1e8746-7256-46a9-bda4-b316ddae71f7-crio-socket\") pod \"insights-runtime-extractor-9xcjs\" (UID: \"0d1e8746-7256-46a9-bda4-b316ddae71f7\") " pod="openshift-insights/insights-runtime-extractor-9xcjs" Jun 10 12:41:17.116068 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:17.116070 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0d1e8746-7256-46a9-bda4-b316ddae71f7-data-volume\") pod \"insights-runtime-extractor-9xcjs\" (UID: \"0d1e8746-7256-46a9-bda4-b316ddae71f7\") " pod="openshift-insights/insights-runtime-extractor-9xcjs" Jun 10 12:41:17.116258 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:17.116121 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0d1e8746-7256-46a9-bda4-b316ddae71f7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9xcjs\" (UID: \"0d1e8746-7256-46a9-bda4-b316ddae71f7\") " pod="openshift-insights/insights-runtime-extractor-9xcjs" Jun 10 12:41:17.116258 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:17.116138 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7k8hb\" (UniqueName: \"kubernetes.io/projected/0d1e8746-7256-46a9-bda4-b316ddae71f7-kube-api-access-7k8hb\") pod \"insights-runtime-extractor-9xcjs\" (UID: \"0d1e8746-7256-46a9-bda4-b316ddae71f7\") " pod="openshift-insights/insights-runtime-extractor-9xcjs" Jun 10 12:41:17.116258 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:17.116157 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0d1e8746-7256-46a9-bda4-b316ddae71f7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9xcjs\" (UID: \"0d1e8746-7256-46a9-bda4-b316ddae71f7\") " pod="openshift-insights/insights-runtime-extractor-9xcjs" Jun 10 12:41:17.116258 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:17.116164 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0d1e8746-7256-46a9-bda4-b316ddae71f7-crio-socket\") pod \"insights-runtime-extractor-9xcjs\" (UID: \"0d1e8746-7256-46a9-bda4-b316ddae71f7\") " pod="openshift-insights/insights-runtime-extractor-9xcjs" Jun 10 12:41:17.116571 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:17.116553 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0d1e8746-7256-46a9-bda4-b316ddae71f7-data-volume\") pod \"insights-runtime-extractor-9xcjs\" (UID: \"0d1e8746-7256-46a9-bda4-b316ddae71f7\") " pod="openshift-insights/insights-runtime-extractor-9xcjs" Jun 10 12:41:17.116728 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:17.116712 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0d1e8746-7256-46a9-bda4-b316ddae71f7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9xcjs\" (UID: \"0d1e8746-7256-46a9-bda4-b316ddae71f7\") " pod="openshift-insights/insights-runtime-extractor-9xcjs" Jun 10 12:41:17.118374 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:17.118356 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0d1e8746-7256-46a9-bda4-b316ddae71f7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9xcjs\" (UID: \"0d1e8746-7256-46a9-bda4-b316ddae71f7\") " pod="openshift-insights/insights-runtime-extractor-9xcjs" Jun 10 12:41:17.154838 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:17.154788 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7k8hb\" (UniqueName: \"kubernetes.io/projected/0d1e8746-7256-46a9-bda4-b316ddae71f7-kube-api-access-7k8hb\") pod \"insights-runtime-extractor-9xcjs\" (UID: \"0d1e8746-7256-46a9-bda4-b316ddae71f7\") " pod="openshift-insights/insights-runtime-extractor-9xcjs" Jun 10 12:41:17.280830 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:17.280805 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9xcjs" Jun 10 12:41:17.418782 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:17.418700 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9xcjs"] Jun 10 12:41:17.422652 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:41:17.422628 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d1e8746_7256_46a9_bda4_b316ddae71f7.slice/crio-af79793422f7c85fa91b1e3c114055c31ecda5924a16468cba270140c320d798 WatchSource:0}: Error finding container af79793422f7c85fa91b1e3c114055c31ecda5924a16468cba270140c320d798: Status 404 returned error can't find the container with id af79793422f7c85fa91b1e3c114055c31ecda5924a16468cba270140c320d798 Jun 10 12:41:18.419850 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:18.419770 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9xcjs" event={"ID":"0d1e8746-7256-46a9-bda4-b316ddae71f7","Type":"ContainerStarted","Data":"74d5b2516776d863f02564d2683c99c6837e88a8b80b22d584ca0b5db00fe32d"} Jun 10 12:41:18.419850 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:18.419824 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9xcjs" event={"ID":"0d1e8746-7256-46a9-bda4-b316ddae71f7","Type":"ContainerStarted","Data":"a9aa5b70e2b52ec56a9aa3396290ccb1a2792590f750f55057581d4ab92a882e"} Jun 10 12:41:18.419850 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:18.419842 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9xcjs" event={"ID":"0d1e8746-7256-46a9-bda4-b316ddae71f7","Type":"ContainerStarted","Data":"af79793422f7c85fa91b1e3c114055c31ecda5924a16468cba270140c320d798"} Jun 10 12:41:20.427537 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:20.427509 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9xcjs" event={"ID":"0d1e8746-7256-46a9-bda4-b316ddae71f7","Type":"ContainerStarted","Data":"9dc0a163b7156793fbf9029ef0aa5fbc2bbc2fc3a8a715f18ac181d2106db1c6"} Jun 10 12:41:20.447651 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:20.447606 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-9xcjs" podStartSLOduration=2.373853846 podStartE2EDuration="4.447589613s" totalImagesPullingTime="2.073735767s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 12:41:16 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:41:20.446814544 +0000 UTC m=+277.329418630" watchObservedRunningTime="2026-06-10 12:41:20.447589613 +0000 UTC m=+277.330193687" Jun 10 12:41:22.617720 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:22.617677 2557 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d7b4756b-9bl2b" podUID="fad9cf3c-9f7a-4d84-9770-1953d9416305" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 10 12:41:24.073469 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:41:24.073418 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-slqcw" podUID="6f28a11c-ee9f-40ec-a10e-1b6b54178990" Jun 10 12:41:24.073469 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:41:24.073441 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-855748cdfb-4zc8x" podUID="aa4b745b-dca9-4769-981b-cf7eb4be811f" Jun 10 12:41:24.438828 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:24.438745 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-slqcw" Jun 10 12:41:24.439002 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:24.438745 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-855748cdfb-4zc8x" Jun 10 12:41:27.488790 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:27.488747 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aa4b745b-dca9-4769-981b-cf7eb4be811f-registry-tls\") pod \"image-registry-855748cdfb-4zc8x\" (UID: \"aa4b745b-dca9-4769-981b-cf7eb4be811f\") " pod="openshift-image-registry/image-registry-855748cdfb-4zc8x" Jun 10 12:41:27.489294 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:27.488826 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6f28a11c-ee9f-40ec-a10e-1b6b54178990-metrics-tls\") pod \"dns-default-slqcw\" (UID: \"6f28a11c-ee9f-40ec-a10e-1b6b54178990\") " pod="openshift-dns/dns-default-slqcw" Jun 10 12:41:27.491064 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:27.491042 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6f28a11c-ee9f-40ec-a10e-1b6b54178990-metrics-tls\") pod \"dns-default-slqcw\" (UID: \"6f28a11c-ee9f-40ec-a10e-1b6b54178990\") " pod="openshift-dns/dns-default-slqcw" Jun 10 12:41:27.491232 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:27.491215 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aa4b745b-dca9-4769-981b-cf7eb4be811f-registry-tls\") pod \"image-registry-855748cdfb-4zc8x\" (UID: \"aa4b745b-dca9-4769-981b-cf7eb4be811f\") " pod="openshift-image-registry/image-registry-855748cdfb-4zc8x" Jun 10 12:41:27.744390 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:27.744309 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-gzwg7\"" Jun 10 12:41:27.744390 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:27.744322 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hpqfd\"" Jun 10 12:41:27.750904 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:27.750879 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-855748cdfb-4zc8x" Jun 10 12:41:27.751012 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:27.750967 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-slqcw" Jun 10 12:41:27.895392 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:27.895362 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-slqcw"] Jun 10 12:41:27.899800 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:41:27.899771 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f28a11c_ee9f_40ec_a10e_1b6b54178990.slice/crio-119bfef60568fa4ad10cd7f526d1eaa327e52caef26519585902b73493acbdd5 WatchSource:0}: Error finding container 119bfef60568fa4ad10cd7f526d1eaa327e52caef26519585902b73493acbdd5: Status 404 returned error can't find the container with id 119bfef60568fa4ad10cd7f526d1eaa327e52caef26519585902b73493acbdd5 Jun 10 12:41:27.924103 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:27.924071 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-855748cdfb-4zc8x"] Jun 10 12:41:27.927111 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:41:27.927086 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa4b745b_dca9_4769_981b_cf7eb4be811f.slice/crio-2ca3930439178f6bf145f5dcbe002d5ebcc104e8ca5d280d44e55aa525729ad2 WatchSource:0}: Error finding container 2ca3930439178f6bf145f5dcbe002d5ebcc104e8ca5d280d44e55aa525729ad2: Status 404 returned error can't find the container with id 2ca3930439178f6bf145f5dcbe002d5ebcc104e8ca5d280d44e55aa525729ad2 Jun 10 12:41:28.142421 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:28.142384 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-kxnx9"] Jun 10 12:41:28.144940 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:28.144924 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kxnx9" Jun 10 12:41:28.147857 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:28.147835 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 10 12:41:28.148081 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:28.148066 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 10 12:41:28.148165 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:28.148112 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 10 12:41:28.148244 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:28.148205 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 10 12:41:28.148355 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:28.148339 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 10 12:41:28.149091 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:28.149073 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 10 12:41:28.149167 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:28.149107 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-8wwkk\"" Jun 10 12:41:28.194066 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:28.194036 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4c974817-a56e-48c3-a975-a00d2d1167e2-sys\") pod \"node-exporter-kxnx9\" (UID: \"4c974817-a56e-48c3-a975-a00d2d1167e2\") " pod="openshift-monitoring/node-exporter-kxnx9" Jun 10 12:41:28.194262 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:28.194073 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4c974817-a56e-48c3-a975-a00d2d1167e2-root\") pod \"node-exporter-kxnx9\" (UID: \"4c974817-a56e-48c3-a975-a00d2d1167e2\") " pod="openshift-monitoring/node-exporter-kxnx9" Jun 10 12:41:28.194262 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:28.194100 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d44zg\" (UniqueName: \"kubernetes.io/projected/4c974817-a56e-48c3-a975-a00d2d1167e2-kube-api-access-d44zg\") pod \"node-exporter-kxnx9\" (UID: \"4c974817-a56e-48c3-a975-a00d2d1167e2\") " pod="openshift-monitoring/node-exporter-kxnx9" Jun 10 12:41:28.194262 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:28.194129 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4c974817-a56e-48c3-a975-a00d2d1167e2-node-exporter-textfile\") pod \"node-exporter-kxnx9\" (UID: \"4c974817-a56e-48c3-a975-a00d2d1167e2\") " pod="openshift-monitoring/node-exporter-kxnx9" Jun 10 12:41:28.194262 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:28.194150 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4c974817-a56e-48c3-a975-a00d2d1167e2-node-exporter-wtmp\") pod \"node-exporter-kxnx9\" (UID: \"4c974817-a56e-48c3-a975-a00d2d1167e2\") " pod="openshift-monitoring/node-exporter-kxnx9" Jun 10 12:41:28.194262 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:28.194176 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c974817-a56e-48c3-a975-a00d2d1167e2-metrics-client-ca\") pod \"node-exporter-kxnx9\" (UID: \"4c974817-a56e-48c3-a975-a00d2d1167e2\") " pod="openshift-monitoring/node-exporter-kxnx9" Jun 10 12:41:28.194449 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:28.194264 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4c974817-a56e-48c3-a975-a00d2d1167e2-node-exporter-tls\") pod \"node-exporter-kxnx9\" (UID: \"4c974817-a56e-48c3-a975-a00d2d1167e2\") " pod="openshift-monitoring/node-exporter-kxnx9" Jun 10 12:41:28.194449 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:28.194325 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4c974817-a56e-48c3-a975-a00d2d1167e2-node-exporter-accelerators-collector-config\") pod \"node-exporter-kxnx9\" (UID: \"4c974817-a56e-48c3-a975-a00d2d1167e2\") " pod="openshift-monitoring/node-exporter-kxnx9" Jun 10 12:41:28.194449 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:28.194353 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4c974817-a56e-48c3-a975-a00d2d1167e2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kxnx9\" (UID: \"4c974817-a56e-48c3-a975-a00d2d1167e2\") " pod="openshift-monitoring/node-exporter-kxnx9" Jun 10 12:41:28.295544 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:28.295505 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c974817-a56e-48c3-a975-a00d2d1167e2-metrics-client-ca\") pod \"node-exporter-kxnx9\" (UID: \"4c974817-a56e-48c3-a975-a00d2d1167e2\") " pod="openshift-monitoring/node-exporter-kxnx9" Jun 10 12:41:28.295544 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:28.295552 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4c974817-a56e-48c3-a975-a00d2d1167e2-node-exporter-tls\") pod \"node-exporter-kxnx9\" (UID: \"4c974817-a56e-48c3-a975-a00d2d1167e2\") " pod="openshift-monitoring/node-exporter-kxnx9" Jun 10 12:41:28.295791 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:28.295658 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4c974817-a56e-48c3-a975-a00d2d1167e2-node-exporter-accelerators-collector-config\") pod \"node-exporter-kxnx9\" (UID: \"4c974817-a56e-48c3-a975-a00d2d1167e2\") " pod="openshift-monitoring/node-exporter-kxnx9" Jun 10 12:41:28.295791 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:28.295691 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4c974817-a56e-48c3-a975-a00d2d1167e2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kxnx9\" (UID: \"4c974817-a56e-48c3-a975-a00d2d1167e2\") " pod="openshift-monitoring/node-exporter-kxnx9" Jun 10 12:41:28.295791 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:41:28.295661 2557 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 10 12:41:28.295791 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:28.295745 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4c974817-a56e-48c3-a975-a00d2d1167e2-sys\") pod \"node-exporter-kxnx9\" (UID: \"4c974817-a56e-48c3-a975-a00d2d1167e2\") " pod="openshift-monitoring/node-exporter-kxnx9" Jun 10 12:41:28.295791 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:41:28.295792 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c974817-a56e-48c3-a975-a00d2d1167e2-node-exporter-tls podName:4c974817-a56e-48c3-a975-a00d2d1167e2 nodeName:}" failed. No retries permitted until 2026-06-10 12:41:28.795772383 +0000 UTC m=+285.678376443 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/4c974817-a56e-48c3-a975-a00d2d1167e2-node-exporter-tls") pod "node-exporter-kxnx9" (UID: "4c974817-a56e-48c3-a975-a00d2d1167e2") : secret "node-exporter-tls" not found Jun 10 12:41:28.296064 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:28.295804 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4c974817-a56e-48c3-a975-a00d2d1167e2-sys\") pod \"node-exporter-kxnx9\" (UID: \"4c974817-a56e-48c3-a975-a00d2d1167e2\") " pod="openshift-monitoring/node-exporter-kxnx9" Jun 10 12:41:28.296064 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:28.295907 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4c974817-a56e-48c3-a975-a00d2d1167e2-root\") pod \"node-exporter-kxnx9\" (UID: \"4c974817-a56e-48c3-a975-a00d2d1167e2\") " pod="openshift-monitoring/node-exporter-kxnx9" Jun 10 12:41:28.296064 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:28.295935 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d44zg\" (UniqueName: \"kubernetes.io/projected/4c974817-a56e-48c3-a975-a00d2d1167e2-kube-api-access-d44zg\") pod \"node-exporter-kxnx9\" (UID: \"4c974817-a56e-48c3-a975-a00d2d1167e2\") " pod="openshift-monitoring/node-exporter-kxnx9" Jun 10 12:41:28.296064 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:28.295966 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4c974817-a56e-48c3-a975-a00d2d1167e2-node-exporter-textfile\") pod \"node-exporter-kxnx9\" (UID: \"4c974817-a56e-48c3-a975-a00d2d1167e2\") " pod="openshift-monitoring/node-exporter-kxnx9" Jun 10 12:41:28.296064 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:28.295991 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4c974817-a56e-48c3-a975-a00d2d1167e2-node-exporter-wtmp\") pod \"node-exporter-kxnx9\" (UID: \"4c974817-a56e-48c3-a975-a00d2d1167e2\") " pod="openshift-monitoring/node-exporter-kxnx9" Jun 10 12:41:28.296064 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:28.296024 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4c974817-a56e-48c3-a975-a00d2d1167e2-root\") pod \"node-exporter-kxnx9\" (UID: \"4c974817-a56e-48c3-a975-a00d2d1167e2\") " pod="openshift-monitoring/node-exporter-kxnx9" Jun 10 12:41:28.296396 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:28.296153 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4c974817-a56e-48c3-a975-a00d2d1167e2-node-exporter-wtmp\") pod \"node-exporter-kxnx9\" (UID: \"4c974817-a56e-48c3-a975-a00d2d1167e2\") " pod="openshift-monitoring/node-exporter-kxnx9" Jun 10 12:41:28.296396 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:28.296162 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c974817-a56e-48c3-a975-a00d2d1167e2-metrics-client-ca\") pod \"node-exporter-kxnx9\" (UID: \"4c974817-a56e-48c3-a975-a00d2d1167e2\") " pod="openshift-monitoring/node-exporter-kxnx9" Jun 10 12:41:28.296396 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:28.296290 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4c974817-a56e-48c3-a975-a00d2d1167e2-node-exporter-textfile\") pod \"node-exporter-kxnx9\" (UID: \"4c974817-a56e-48c3-a975-a00d2d1167e2\") " pod="openshift-monitoring/node-exporter-kxnx9" Jun 10 12:41:28.296552 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:28.296505 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4c974817-a56e-48c3-a975-a00d2d1167e2-node-exporter-accelerators-collector-config\") pod \"node-exporter-kxnx9\" (UID: \"4c974817-a56e-48c3-a975-a00d2d1167e2\") " pod="openshift-monitoring/node-exporter-kxnx9" Jun 10 12:41:28.298307 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:28.298285 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4c974817-a56e-48c3-a975-a00d2d1167e2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kxnx9\" (UID: \"4c974817-a56e-48c3-a975-a00d2d1167e2\") " pod="openshift-monitoring/node-exporter-kxnx9" Jun 10 12:41:28.307141 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:28.307111 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d44zg\" (UniqueName: \"kubernetes.io/projected/4c974817-a56e-48c3-a975-a00d2d1167e2-kube-api-access-d44zg\") pod \"node-exporter-kxnx9\" (UID: \"4c974817-a56e-48c3-a975-a00d2d1167e2\") " pod="openshift-monitoring/node-exporter-kxnx9" Jun 10 12:41:28.451712 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:28.451616 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-slqcw" event={"ID":"6f28a11c-ee9f-40ec-a10e-1b6b54178990","Type":"ContainerStarted","Data":"119bfef60568fa4ad10cd7f526d1eaa327e52caef26519585902b73493acbdd5"} Jun 10 12:41:28.453001 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:28.452977 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-855748cdfb-4zc8x" event={"ID":"aa4b745b-dca9-4769-981b-cf7eb4be811f","Type":"ContainerStarted","Data":"1e46aeeff967565a92c5044058e2992f2c8dbe21306e827f1f5c28747bb6126e"} Jun 10 12:41:28.453065 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:28.453019 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-855748cdfb-4zc8x" event={"ID":"aa4b745b-dca9-4769-981b-cf7eb4be811f","Type":"ContainerStarted","Data":"2ca3930439178f6bf145f5dcbe002d5ebcc104e8ca5d280d44e55aa525729ad2"} Jun 10 12:41:28.453065 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:28.453055 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-855748cdfb-4zc8x" Jun 10 12:41:28.477068 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:28.477020 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-855748cdfb-4zc8x" podStartSLOduration=284.477001487 podStartE2EDuration="4m44.477001487s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:36:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:41:28.476031585 +0000 UTC m=+285.358635701" watchObservedRunningTime="2026-06-10 12:41:28.477001487 +0000 UTC m=+285.359605563" Jun 10 12:41:28.800708 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:28.800673 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4c974817-a56e-48c3-a975-a00d2d1167e2-node-exporter-tls\") pod \"node-exporter-kxnx9\" (UID: \"4c974817-a56e-48c3-a975-a00d2d1167e2\") " pod="openshift-monitoring/node-exporter-kxnx9" Jun 10 12:41:28.803235 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:28.803201 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4c974817-a56e-48c3-a975-a00d2d1167e2-node-exporter-tls\") pod \"node-exporter-kxnx9\" (UID: \"4c974817-a56e-48c3-a975-a00d2d1167e2\") " pod="openshift-monitoring/node-exporter-kxnx9" Jun 10 12:41:29.054305 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:29.054227 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kxnx9" Jun 10 12:41:29.066991 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:41:29.066961 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c974817_a56e_48c3_a975_a00d2d1167e2.slice/crio-04920cc5723f17ca4bdf01768da96f06061539f415a19db537c7011b265a63f1 WatchSource:0}: Error finding container 04920cc5723f17ca4bdf01768da96f06061539f415a19db537c7011b265a63f1: Status 404 returned error can't find the container with id 04920cc5723f17ca4bdf01768da96f06061539f415a19db537c7011b265a63f1 Jun 10 12:41:29.457591 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:29.457501 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kxnx9" event={"ID":"4c974817-a56e-48c3-a975-a00d2d1167e2","Type":"ContainerStarted","Data":"04920cc5723f17ca4bdf01768da96f06061539f415a19db537c7011b265a63f1"} Jun 10 12:41:30.465519 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:30.465480 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-slqcw" event={"ID":"6f28a11c-ee9f-40ec-a10e-1b6b54178990","Type":"ContainerStarted","Data":"b3613de2707558acf2301fde7d57eb3ef2345acf5700cc6cf6a7747c9d0b73c3"} Jun 10 12:41:30.465933 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:30.465639 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-slqcw" Jun 10 12:41:30.465933 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:30.465683 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-slqcw" event={"ID":"6f28a11c-ee9f-40ec-a10e-1b6b54178990","Type":"ContainerStarted","Data":"5697685d52e84a09f041a4fc1304fba41bf40181be6973a16051db575224c34e"} Jun 10 12:41:30.466995 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:30.466973 2557 generic.go:356] "Generic (PLEG): container finished" podID="4c974817-a56e-48c3-a975-a00d2d1167e2" containerID="00410faac013a26d4d0515eaa78fb4b485672a1328a92f4615ee74ff3b8c935d" exitCode=0 Jun 10 12:41:30.467118 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:30.467007 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kxnx9" event={"ID":"4c974817-a56e-48c3-a975-a00d2d1167e2","Type":"ContainerDied","Data":"00410faac013a26d4d0515eaa78fb4b485672a1328a92f4615ee74ff3b8c935d"} Jun 10 12:41:30.488829 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:30.488786 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-slqcw" podStartSLOduration=251.608881706 podStartE2EDuration="4m13.488770766s" totalImagesPullingTime="1.87988906s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:37:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:41:30.487826741 +0000 UTC m=+287.370430845" watchObservedRunningTime="2026-06-10 12:41:30.488770766 +0000 UTC m=+287.371374818" Jun 10 12:41:31.471642 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:31.471549 2557 generic.go:356] "Generic (PLEG): container finished" podID="6c97d4e2-3c6b-4480-b5bc-065fcfe1237f" containerID="4eb9b1434ab446cb79a1efe4c9ca88273031adc76277c272720a1bae829c4423" exitCode=255 Jun 10 12:41:31.471642 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:31.471628 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9c9fd4cc4-96m2l" event={"ID":"6c97d4e2-3c6b-4480-b5bc-065fcfe1237f","Type":"ContainerDied","Data":"4eb9b1434ab446cb79a1efe4c9ca88273031adc76277c272720a1bae829c4423"} Jun 10 12:41:31.472106 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:31.471680 2557 scope.go:117] "RemoveContainer" containerID="767bf56c3c06af89d510a9a5bd2dfe411d331d9f71e5395db34769d72ce9d99e" Jun 10 12:41:31.472106 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:31.471986 2557 scope.go:117] "RemoveContainer" containerID="4eb9b1434ab446cb79a1efe4c9ca88273031adc76277c272720a1bae829c4423" Jun 10 12:41:31.472241 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:41:31.472221 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-9c9fd4cc4-96m2l_open-cluster-management-agent-addon(6c97d4e2-3c6b-4480-b5bc-065fcfe1237f)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9c9fd4cc4-96m2l" podUID="6c97d4e2-3c6b-4480-b5bc-065fcfe1237f" Jun 10 12:41:31.473396 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:31.473378 2557 generic.go:356] "Generic (PLEG): container finished" podID="e2bd25e2-66a5-42d8-91f2-bf7f786df20f" containerID="f377e98584165615a5bceda42ed7cec9abc399471a6526acf1590becda15ea80" exitCode=1 Jun 10 12:41:31.473494 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:31.473457 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f9f449699-8h67q" event={"ID":"e2bd25e2-66a5-42d8-91f2-bf7f786df20f","Type":"ContainerDied","Data":"f377e98584165615a5bceda42ed7cec9abc399471a6526acf1590becda15ea80"} Jun 10 12:41:31.473808 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:31.473788 2557 scope.go:117] "RemoveContainer" containerID="f377e98584165615a5bceda42ed7cec9abc399471a6526acf1590becda15ea80" Jun 10 12:41:31.473943 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:41:31.473926 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-5f9f449699-8h67q_open-cluster-management-agent-addon(e2bd25e2-66a5-42d8-91f2-bf7f786df20f)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f9f449699-8h67q" podUID="e2bd25e2-66a5-42d8-91f2-bf7f786df20f" Jun 10 12:41:31.475452 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:31.475420 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kxnx9" event={"ID":"4c974817-a56e-48c3-a975-a00d2d1167e2","Type":"ContainerStarted","Data":"99e520393949c4cc562cba9681f38429cf5f161bb1e441885f15f18f94347670"} Jun 10 12:41:31.475564 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:31.475477 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kxnx9" event={"ID":"4c974817-a56e-48c3-a975-a00d2d1167e2","Type":"ContainerStarted","Data":"6abd4c4b961e26123998cb8bb27f56d8c2ec99403e447dd6d29ec6324738c454"} Jun 10 12:41:31.481801 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:31.481780 2557 scope.go:117] "RemoveContainer" containerID="eef4dd7b9dd49a0b7da413d827ff9ca738e291bec6d05f122d4f7e665d40bb59" Jun 10 12:41:31.525028 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:31.522300 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-kxnx9" podStartSLOduration=2.228458474 podStartE2EDuration="3.522277312s" totalImagesPullingTime="1.227969973s" totalInitContainerRuntime="65.848865ms" isStatefulPod=true podCreationTimestamp="2026-06-10 12:41:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:41:31.519391343 +0000 UTC m=+288.401995420" watchObservedRunningTime="2026-06-10 12:41:31.522277312 +0000 UTC m=+288.404881391" Jun 10 12:41:32.113094 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:32.113044 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f9f449699-8h67q" Jun 10 12:41:32.481130 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:32.481053 2557 scope.go:117] "RemoveContainer" containerID="f377e98584165615a5bceda42ed7cec9abc399471a6526acf1590becda15ea80" Jun 10 12:41:32.481481 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:41:32.481240 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-5f9f449699-8h67q_open-cluster-management-agent-addon(e2bd25e2-66a5-42d8-91f2-bf7f786df20f)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f9f449699-8h67q" podUID="e2bd25e2-66a5-42d8-91f2-bf7f786df20f" Jun 10 12:41:32.569721 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:32.569667 2557 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9c9fd4cc4-96m2l" Jun 10 12:41:32.570043 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:32.570026 2557 scope.go:117] "RemoveContainer" containerID="4eb9b1434ab446cb79a1efe4c9ca88273031adc76277c272720a1bae829c4423" Jun 10 12:41:32.570210 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:41:32.570169 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-9c9fd4cc4-96m2l_open-cluster-management-agent-addon(6c97d4e2-3c6b-4480-b5bc-065fcfe1237f)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9c9fd4cc4-96m2l" podUID="6c97d4e2-3c6b-4480-b5bc-065fcfe1237f" Jun 10 12:41:32.597286 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:32.597253 2557 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f9f449699-8h67q" Jun 10 12:41:32.618398 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:32.618367 2557 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d7b4756b-9bl2b" podUID="fad9cf3c-9f7a-4d84-9770-1953d9416305" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 10 12:41:32.618518 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:32.618432 2557 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d7b4756b-9bl2b" Jun 10 12:41:32.618935 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:32.618902 2557 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"90f8202268aee3f2227e4a03185a7086dc34937d543c4c6a96f34fc513360c3c"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d7b4756b-9bl2b" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 10 12:41:32.619023 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:32.618959 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d7b4756b-9bl2b" podUID="fad9cf3c-9f7a-4d84-9770-1953d9416305" containerName="service-proxy" containerID="cri-o://90f8202268aee3f2227e4a03185a7086dc34937d543c4c6a96f34fc513360c3c" gracePeriod=30 Jun 10 12:41:33.486613 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:33.486578 2557 generic.go:356] "Generic (PLEG): container finished" podID="fad9cf3c-9f7a-4d84-9770-1953d9416305" containerID="90f8202268aee3f2227e4a03185a7086dc34937d543c4c6a96f34fc513360c3c" exitCode=2 Jun 10 12:41:33.487058 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:33.486654 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d7b4756b-9bl2b" event={"ID":"fad9cf3c-9f7a-4d84-9770-1953d9416305","Type":"ContainerDied","Data":"90f8202268aee3f2227e4a03185a7086dc34937d543c4c6a96f34fc513360c3c"} Jun 10 12:41:33.487058 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:33.486709 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d7b4756b-9bl2b" event={"ID":"fad9cf3c-9f7a-4d84-9770-1953d9416305","Type":"ContainerStarted","Data":"27cd140c614f37667b43aa43b79a28452910505701b6fa713189c86ff6f21d25"} Jun 10 12:41:33.487058 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:33.486892 2557 scope.go:117] "RemoveContainer" containerID="f377e98584165615a5bceda42ed7cec9abc399471a6526acf1590becda15ea80" Jun 10 12:41:33.487275 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:41:33.487059 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-5f9f449699-8h67q_open-cluster-management-agent-addon(e2bd25e2-66a5-42d8-91f2-bf7f786df20f)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f9f449699-8h67q" podUID="e2bd25e2-66a5-42d8-91f2-bf7f786df20f" Jun 10 12:41:36.538461 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:41:36.538422 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-n4lrk" podUID="65533745-1c5b-48e0-b4a2-77fc1cc7908d" Jun 10 12:41:40.478121 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:40.478091 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-slqcw" Jun 10 12:41:43.490220 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:43.490173 2557 kubelet.go:1648] "Image garbage collection succeeded" Jun 10 12:41:45.536868 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:45.536841 2557 scope.go:117] "RemoveContainer" containerID="4eb9b1434ab446cb79a1efe4c9ca88273031adc76277c272720a1bae829c4423" Jun 10 12:41:46.535816 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:46.535786 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9c9fd4cc4-96m2l" event={"ID":"6c97d4e2-3c6b-4480-b5bc-065fcfe1237f","Type":"ContainerStarted","Data":"80715d201b3e9a2082659d13a25f6dcc2c09996daaa70f690805a8dbc97a2df8"} Jun 10 12:41:47.536863 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:47.536830 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n4lrk" Jun 10 12:41:47.537292 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:47.537142 2557 scope.go:117] "RemoveContainer" containerID="f377e98584165615a5bceda42ed7cec9abc399471a6526acf1590becda15ea80" Jun 10 12:41:47.755121 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:47.755087 2557 patch_prober.go:28] interesting pod/image-registry-855748cdfb-4zc8x container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 10 12:41:47.755296 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:47.755142 2557 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-855748cdfb-4zc8x" podUID="aa4b745b-dca9-4769-981b-cf7eb4be811f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 12:41:48.543489 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:48.543456 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f9f449699-8h67q" event={"ID":"e2bd25e2-66a5-42d8-91f2-bf7f786df20f","Type":"ContainerStarted","Data":"387b7157a83bd1468fcce78f9066e33af28a78cac9cb20f29e7b99bc08070367"} Jun 10 12:41:48.543847 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:48.543742 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f9f449699-8h67q" Jun 10 12:41:48.545244 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:48.545224 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f9f449699-8h67q" Jun 10 12:41:49.103016 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:49.102982 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-855748cdfb-4zc8x"] Jun 10 12:41:49.107212 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:41:49.107175 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-855748cdfb-4zc8x" Jun 10 12:42:00.703323 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:42:00.703299 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kxnx9_4c974817-a56e-48c3-a975-a00d2d1167e2/init-textfile/0.log" Jun 10 12:42:00.903915 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:42:00.903889 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kxnx9_4c974817-a56e-48c3-a975-a00d2d1167e2/node-exporter/0.log" Jun 10 12:42:01.104763 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:42:01.104728 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kxnx9_4c974817-a56e-48c3-a975-a00d2d1167e2/kube-rbac-proxy/0.log" Jun 10 12:42:07.304442 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:42:07.304409 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-slqcw_6f28a11c-ee9f-40ec-a10e-1b6b54178990/dns/0.log" Jun 10 12:42:07.503486 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:42:07.503461 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-slqcw_6f28a11c-ee9f-40ec-a10e-1b6b54178990/kube-rbac-proxy/0.log" Jun 10 12:42:08.902639 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:42:08.902604 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mvcnc_f324d4da-090d-4e3e-99f7-5a5393276463/dns-node-resolver/0.log" Jun 10 12:42:14.122065 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:42:14.122019 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-855748cdfb-4zc8x" podUID="aa4b745b-dca9-4769-981b-cf7eb4be811f" containerName="registry" containerID="cri-o://1e46aeeff967565a92c5044058e2992f2c8dbe21306e827f1f5c28747bb6126e" gracePeriod=30 Jun 10 12:42:14.352851 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:42:14.352825 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-855748cdfb-4zc8x" Jun 10 12:42:14.441816 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:42:14.441756 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/aa4b745b-dca9-4769-981b-cf7eb4be811f-image-registry-private-configuration\") pod \"aa4b745b-dca9-4769-981b-cf7eb4be811f\" (UID: \"aa4b745b-dca9-4769-981b-cf7eb4be811f\") " Jun 10 12:42:14.441816 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:42:14.441791 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-655fh\" (UniqueName: \"kubernetes.io/projected/aa4b745b-dca9-4769-981b-cf7eb4be811f-kube-api-access-655fh\") pod \"aa4b745b-dca9-4769-981b-cf7eb4be811f\" (UID: \"aa4b745b-dca9-4769-981b-cf7eb4be811f\") " Jun 10 12:42:14.441816 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:42:14.441815 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/aa4b745b-dca9-4769-981b-cf7eb4be811f-installation-pull-secrets\") pod \"aa4b745b-dca9-4769-981b-cf7eb4be811f\" (UID: \"aa4b745b-dca9-4769-981b-cf7eb4be811f\") " Jun 10 12:42:14.442044 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:42:14.441841 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aa4b745b-dca9-4769-981b-cf7eb4be811f-registry-tls\") pod \"aa4b745b-dca9-4769-981b-cf7eb4be811f\" (UID: \"aa4b745b-dca9-4769-981b-cf7eb4be811f\") " Jun 10 12:42:14.442044 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:42:14.441860 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/aa4b745b-dca9-4769-981b-cf7eb4be811f-ca-trust-extracted\") pod \"aa4b745b-dca9-4769-981b-cf7eb4be811f\" (UID: \"aa4b745b-dca9-4769-981b-cf7eb4be811f\") " Jun 10 12:42:14.442044 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:42:14.441888 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aa4b745b-dca9-4769-981b-cf7eb4be811f-bound-sa-token\") pod \"aa4b745b-dca9-4769-981b-cf7eb4be811f\" (UID: \"aa4b745b-dca9-4769-981b-cf7eb4be811f\") " Jun 10 12:42:14.442044 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:42:14.441935 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aa4b745b-dca9-4769-981b-cf7eb4be811f-trusted-ca\") pod \"aa4b745b-dca9-4769-981b-cf7eb4be811f\" (UID: \"aa4b745b-dca9-4769-981b-cf7eb4be811f\") " Jun 10 12:42:14.442423 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:42:14.442393 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa4b745b-dca9-4769-981b-cf7eb4be811f-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "aa4b745b-dca9-4769-981b-cf7eb4be811f" (UID: "aa4b745b-dca9-4769-981b-cf7eb4be811f"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 12:42:14.442544 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:42:14.441965 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/aa4b745b-dca9-4769-981b-cf7eb4be811f-registry-certificates\") pod \"aa4b745b-dca9-4769-981b-cf7eb4be811f\" (UID: \"aa4b745b-dca9-4769-981b-cf7eb4be811f\") " Jun 10 12:42:14.443280 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:42:14.442897 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa4b745b-dca9-4769-981b-cf7eb4be811f-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "aa4b745b-dca9-4769-981b-cf7eb4be811f" (UID: "aa4b745b-dca9-4769-981b-cf7eb4be811f"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 12:42:14.443280 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:42:14.443215 2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aa4b745b-dca9-4769-981b-cf7eb4be811f-trusted-ca\") on node \"ip-10-0-133-72.ec2.internal\" DevicePath \"\"" Jun 10 12:42:14.443280 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:42:14.443237 2557 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/aa4b745b-dca9-4769-981b-cf7eb4be811f-registry-certificates\") on node \"ip-10-0-133-72.ec2.internal\" DevicePath \"\"" Jun 10 12:42:14.444556 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:42:14.444510 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa4b745b-dca9-4769-981b-cf7eb4be811f-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "aa4b745b-dca9-4769-981b-cf7eb4be811f" (UID: "aa4b745b-dca9-4769-981b-cf7eb4be811f"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 12:42:14.444669 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:42:14.444561 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa4b745b-dca9-4769-981b-cf7eb4be811f-kube-api-access-655fh" (OuterVolumeSpecName: "kube-api-access-655fh") pod "aa4b745b-dca9-4769-981b-cf7eb4be811f" (UID: "aa4b745b-dca9-4769-981b-cf7eb4be811f"). InnerVolumeSpecName "kube-api-access-655fh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 12:42:14.444669 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:42:14.444605 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa4b745b-dca9-4769-981b-cf7eb4be811f-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "aa4b745b-dca9-4769-981b-cf7eb4be811f" (UID: "aa4b745b-dca9-4769-981b-cf7eb4be811f"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 12:42:14.444669 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:42:14.444634 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa4b745b-dca9-4769-981b-cf7eb4be811f-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "aa4b745b-dca9-4769-981b-cf7eb4be811f" (UID: "aa4b745b-dca9-4769-981b-cf7eb4be811f"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 12:42:14.444669 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:42:14.444638 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa4b745b-dca9-4769-981b-cf7eb4be811f-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "aa4b745b-dca9-4769-981b-cf7eb4be811f" (UID: "aa4b745b-dca9-4769-981b-cf7eb4be811f"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 12:42:14.451701 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:42:14.451676 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa4b745b-dca9-4769-981b-cf7eb4be811f-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "aa4b745b-dca9-4769-981b-cf7eb4be811f" (UID: "aa4b745b-dca9-4769-981b-cf7eb4be811f"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 12:42:14.543953 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:42:14.543928 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-655fh\" (UniqueName: \"kubernetes.io/projected/aa4b745b-dca9-4769-981b-cf7eb4be811f-kube-api-access-655fh\") on node \"ip-10-0-133-72.ec2.internal\" DevicePath \"\"" Jun 10 12:42:14.543953 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:42:14.543951 2557 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/aa4b745b-dca9-4769-981b-cf7eb4be811f-installation-pull-secrets\") on node \"ip-10-0-133-72.ec2.internal\" DevicePath \"\"" Jun 10 12:42:14.544084 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:42:14.543964 2557 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aa4b745b-dca9-4769-981b-cf7eb4be811f-registry-tls\") on node \"ip-10-0-133-72.ec2.internal\" DevicePath \"\"" Jun 10 12:42:14.544084 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:42:14.543977 2557 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/aa4b745b-dca9-4769-981b-cf7eb4be811f-ca-trust-extracted\") on node \"ip-10-0-133-72.ec2.internal\" DevicePath \"\"" Jun 10 12:42:14.544084 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:42:14.543988 2557 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aa4b745b-dca9-4769-981b-cf7eb4be811f-bound-sa-token\") on node \"ip-10-0-133-72.ec2.internal\" DevicePath \"\"" Jun 10 12:42:14.544084 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:42:14.544001 2557 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/aa4b745b-dca9-4769-981b-cf7eb4be811f-image-registry-private-configuration\") on node \"ip-10-0-133-72.ec2.internal\" DevicePath \"\"" Jun 10 12:42:14.630621 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:42:14.630595 2557 generic.go:356] "Generic (PLEG): container finished" podID="aa4b745b-dca9-4769-981b-cf7eb4be811f" containerID="1e46aeeff967565a92c5044058e2992f2c8dbe21306e827f1f5c28747bb6126e" exitCode=0 Jun 10 12:42:14.630709 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:42:14.630633 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-855748cdfb-4zc8x" event={"ID":"aa4b745b-dca9-4769-981b-cf7eb4be811f","Type":"ContainerDied","Data":"1e46aeeff967565a92c5044058e2992f2c8dbe21306e827f1f5c28747bb6126e"} Jun 10 12:42:14.630709 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:42:14.630644 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-855748cdfb-4zc8x" Jun 10 12:42:14.630709 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:42:14.630689 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-855748cdfb-4zc8x" event={"ID":"aa4b745b-dca9-4769-981b-cf7eb4be811f","Type":"ContainerDied","Data":"2ca3930439178f6bf145f5dcbe002d5ebcc104e8ca5d280d44e55aa525729ad2"} Jun 10 12:42:14.630709 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:42:14.630708 2557 scope.go:117] "RemoveContainer" containerID="1e46aeeff967565a92c5044058e2992f2c8dbe21306e827f1f5c28747bb6126e" Jun 10 12:42:14.640538 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:42:14.640508 2557 scope.go:117] "RemoveContainer" containerID="1e46aeeff967565a92c5044058e2992f2c8dbe21306e827f1f5c28747bb6126e" Jun 10 12:42:14.640891 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:42:14.640871 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e46aeeff967565a92c5044058e2992f2c8dbe21306e827f1f5c28747bb6126e\": container with ID starting with 1e46aeeff967565a92c5044058e2992f2c8dbe21306e827f1f5c28747bb6126e not found: ID does not exist" containerID="1e46aeeff967565a92c5044058e2992f2c8dbe21306e827f1f5c28747bb6126e" Jun 10 12:42:14.640987 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:42:14.640902 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e46aeeff967565a92c5044058e2992f2c8dbe21306e827f1f5c28747bb6126e"} err="failed to get container status \"1e46aeeff967565a92c5044058e2992f2c8dbe21306e827f1f5c28747bb6126e\": rpc error: code = NotFound desc = could not find container \"1e46aeeff967565a92c5044058e2992f2c8dbe21306e827f1f5c28747bb6126e\": container with ID starting with 1e46aeeff967565a92c5044058e2992f2c8dbe21306e827f1f5c28747bb6126e not found: ID does not exist" Jun 10 12:42:14.651719 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:42:14.651699 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-855748cdfb-4zc8x"] Jun 10 12:42:14.657257 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:42:14.657240 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-855748cdfb-4zc8x"] Jun 10 12:42:15.541502 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:42:15.541465 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa4b745b-dca9-4769-981b-cf7eb4be811f" path="/var/lib/kubelet/pods/aa4b745b-dca9-4769-981b-cf7eb4be811f/volumes" Jun 10 12:42:57.531001 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:42:57.530958 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65533745-1c5b-48e0-b4a2-77fc1cc7908d-metrics-certs\") pod \"network-metrics-daemon-n4lrk\" (UID: \"65533745-1c5b-48e0-b4a2-77fc1cc7908d\") " pod="openshift-multus/network-metrics-daemon-n4lrk" Jun 10 12:42:57.533196 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:42:57.533161 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65533745-1c5b-48e0-b4a2-77fc1cc7908d-metrics-certs\") pod \"network-metrics-daemon-n4lrk\" (UID: \"65533745-1c5b-48e0-b4a2-77fc1cc7908d\") " pod="openshift-multus/network-metrics-daemon-n4lrk" Jun 10 12:42:57.740463 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:42:57.740432 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vpjkq\"" Jun 10 12:42:57.748883 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:42:57.748867 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n4lrk" Jun 10 12:42:57.897273 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:42:57.897237 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-n4lrk"] Jun 10 12:42:57.899979 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:42:57.899951 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65533745_1c5b_48e0_b4a2_77fc1cc7908d.slice/crio-a4e375f8937c686ef9c9adb1cc013da96e2544a756338cfe7f5d6ada04569cf3 WatchSource:0}: Error finding container a4e375f8937c686ef9c9adb1cc013da96e2544a756338cfe7f5d6ada04569cf3: Status 404 returned error can't find the container with id a4e375f8937c686ef9c9adb1cc013da96e2544a756338cfe7f5d6ada04569cf3 Jun 10 12:42:57.901754 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:42:57.901740 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 12:42:58.773066 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:42:58.773025 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-n4lrk" event={"ID":"65533745-1c5b-48e0-b4a2-77fc1cc7908d","Type":"ContainerStarted","Data":"a4e375f8937c686ef9c9adb1cc013da96e2544a756338cfe7f5d6ada04569cf3"} Jun 10 12:42:59.778025 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:42:59.777989 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-n4lrk" event={"ID":"65533745-1c5b-48e0-b4a2-77fc1cc7908d","Type":"ContainerStarted","Data":"ab672d8f18f9d71e0bb1ad4b315e267318e1f9bfc358a9ad1b9f8606001aa728"} Jun 10 12:42:59.778375 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:42:59.778050 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-n4lrk" event={"ID":"65533745-1c5b-48e0-b4a2-77fc1cc7908d","Type":"ContainerStarted","Data":"58b0bf3b7a76006edf36bc988ecd1eb63425087c0256f7f8a61b99cb733cfb5d"} Jun 10 12:42:59.799977 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:42:59.799931 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-n4lrk" podStartSLOduration=375.859091852 podStartE2EDuration="6m16.799915034s" totalImagesPullingTime="940.823182ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:36:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:42:59.799628934 +0000 UTC m=+376.682233013" watchObservedRunningTime="2026-06-10 12:42:59.799915034 +0000 UTC m=+376.682519109" Jun 10 12:44:07.047717 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:44:07.047684 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-kcqkp"] Jun 10 12:44:07.048115 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:44:07.047913 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa4b745b-dca9-4769-981b-cf7eb4be811f" containerName="registry" Jun 10 12:44:07.048115 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:44:07.047924 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa4b745b-dca9-4769-981b-cf7eb4be811f" containerName="registry" Jun 10 12:44:07.048115 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:44:07.047961 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa4b745b-dca9-4769-981b-cf7eb4be811f" containerName="registry" Jun 10 12:44:07.050565 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:44:07.050550 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-kcqkp" Jun 10 12:44:07.053288 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:44:07.053244 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 10 12:44:07.053419 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:44:07.053323 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-vz6xw\"" Jun 10 12:44:07.054499 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:44:07.054480 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 10 12:44:07.063910 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:44:07.063889 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-kcqkp"] Jun 10 12:44:07.090592 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:44:07.090571 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3a0a60a8-89dc-47ed-bcef-8a748e55cb60-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-kcqkp\" (UID: \"3a0a60a8-89dc-47ed-bcef-8a748e55cb60\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-kcqkp" Jun 10 12:44:07.090709 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:44:07.090608 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcpqv\" (UniqueName: \"kubernetes.io/projected/3a0a60a8-89dc-47ed-bcef-8a748e55cb60-kube-api-access-qcpqv\") pod \"cert-manager-webhook-7dc76cbb94-kcqkp\" (UID: \"3a0a60a8-89dc-47ed-bcef-8a748e55cb60\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-kcqkp" Jun 10 12:44:07.191658 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:44:07.191640 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3a0a60a8-89dc-47ed-bcef-8a748e55cb60-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-kcqkp\" (UID: \"3a0a60a8-89dc-47ed-bcef-8a748e55cb60\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-kcqkp" Jun 10 12:44:07.191773 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:44:07.191668 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcpqv\" (UniqueName: \"kubernetes.io/projected/3a0a60a8-89dc-47ed-bcef-8a748e55cb60-kube-api-access-qcpqv\") pod \"cert-manager-webhook-7dc76cbb94-kcqkp\" (UID: \"3a0a60a8-89dc-47ed-bcef-8a748e55cb60\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-kcqkp" Jun 10 12:44:07.204606 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:44:07.204579 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3a0a60a8-89dc-47ed-bcef-8a748e55cb60-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-kcqkp\" (UID: \"3a0a60a8-89dc-47ed-bcef-8a748e55cb60\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-kcqkp" Jun 10 12:44:07.204757 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:44:07.204739 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcpqv\" (UniqueName: \"kubernetes.io/projected/3a0a60a8-89dc-47ed-bcef-8a748e55cb60-kube-api-access-qcpqv\") pod \"cert-manager-webhook-7dc76cbb94-kcqkp\" (UID: \"3a0a60a8-89dc-47ed-bcef-8a748e55cb60\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-kcqkp" Jun 10 12:44:07.358688 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:44:07.358625 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-kcqkp" Jun 10 12:44:07.483693 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:44:07.483663 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-kcqkp"] Jun 10 12:44:07.486876 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:44:07.486849 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3a0a60a8_89dc_47ed_bcef_8a748e55cb60.slice/crio-69f8089d2aeab84097cf088bc8c4ae4350508848928633aca1d7ac2818b97fdd WatchSource:0}: Error finding container 69f8089d2aeab84097cf088bc8c4ae4350508848928633aca1d7ac2818b97fdd: Status 404 returned error can't find the container with id 69f8089d2aeab84097cf088bc8c4ae4350508848928633aca1d7ac2818b97fdd Jun 10 12:44:08.000807 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:44:08.000767 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-kcqkp" event={"ID":"3a0a60a8-89dc-47ed-bcef-8a748e55cb60","Type":"ContainerStarted","Data":"69f8089d2aeab84097cf088bc8c4ae4350508848928633aca1d7ac2818b97fdd"} Jun 10 12:44:11.015376 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:44:11.015335 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-kcqkp" event={"ID":"3a0a60a8-89dc-47ed-bcef-8a748e55cb60","Type":"ContainerStarted","Data":"112d342518845f1c79a5d30ffd95c1db793ac4623f1d0074dc6b8a8bd10009b5"} Jun 10 12:44:11.015802 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:44:11.015409 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-kcqkp" Jun 10 12:44:11.041050 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:44:11.041008 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-kcqkp" podStartSLOduration=1.570220141 podStartE2EDuration="4.040994471s" totalImagesPullingTime="2.47077433s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:44:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:44:11.039266048 +0000 UTC m=+447.921870135" watchObservedRunningTime="2026-06-10 12:44:11.040994471 +0000 UTC m=+447.923598545" Jun 10 12:44:17.020053 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:44:17.020017 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-kcqkp" Jun 10 12:44:37.147599 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:44:37.147568 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6c7bd9b77-8mt7d"] Jun 10 12:44:37.150439 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:44:37.150423 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6c7bd9b77-8mt7d" Jun 10 12:44:37.156326 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:44:37.156177 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 10 12:44:37.156326 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:44:37.156226 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 10 12:44:37.156608 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:44:37.156589 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 10 12:44:37.156670 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:44:37.156629 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 10 12:44:37.156722 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:44:37.156680 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-s7ppv\"" Jun 10 12:44:37.171595 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:44:37.171574 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0e7b03f9-1027-42b7-a308-f0fe39dcb572-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6c7bd9b77-8mt7d\" (UID: \"0e7b03f9-1027-42b7-a308-f0fe39dcb572\") " pod="opendatahub/opendatahub-operator-controller-manager-6c7bd9b77-8mt7d" Jun 10 12:44:37.171688 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:44:37.171605 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0e7b03f9-1027-42b7-a308-f0fe39dcb572-manifests\") pod \"opendatahub-operator-controller-manager-6c7bd9b77-8mt7d\" (UID: \"0e7b03f9-1027-42b7-a308-f0fe39dcb572\") " pod="opendatahub/opendatahub-operator-controller-manager-6c7bd9b77-8mt7d" Jun 10 12:44:37.171688 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:44:37.171623 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0e7b03f9-1027-42b7-a308-f0fe39dcb572-webhook-cert\") pod \"opendatahub-operator-controller-manager-6c7bd9b77-8mt7d\" (UID: \"0e7b03f9-1027-42b7-a308-f0fe39dcb572\") " pod="opendatahub/opendatahub-operator-controller-manager-6c7bd9b77-8mt7d" Jun 10 12:44:37.171688 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:44:37.171641 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0e7b03f9-1027-42b7-a308-f0fe39dcb572-tmp\") pod \"opendatahub-operator-controller-manager-6c7bd9b77-8mt7d\" (UID: \"0e7b03f9-1027-42b7-a308-f0fe39dcb572\") " pod="opendatahub/opendatahub-operator-controller-manager-6c7bd9b77-8mt7d" Jun 10 12:44:37.171785 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:44:37.171702 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfx9c\" (UniqueName: \"kubernetes.io/projected/0e7b03f9-1027-42b7-a308-f0fe39dcb572-kube-api-access-nfx9c\") pod \"opendatahub-operator-controller-manager-6c7bd9b77-8mt7d\" (UID: \"0e7b03f9-1027-42b7-a308-f0fe39dcb572\") " pod="opendatahub/opendatahub-operator-controller-manager-6c7bd9b77-8mt7d" Jun 10 12:44:37.182898 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:44:37.182879 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6c7bd9b77-8mt7d"] Jun 10 12:44:37.272622 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:44:37.272596 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0e7b03f9-1027-42b7-a308-f0fe39dcb572-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6c7bd9b77-8mt7d\" (UID: \"0e7b03f9-1027-42b7-a308-f0fe39dcb572\") " pod="opendatahub/opendatahub-operator-controller-manager-6c7bd9b77-8mt7d" Jun 10 12:44:37.272723 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:44:37.272635 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0e7b03f9-1027-42b7-a308-f0fe39dcb572-manifests\") pod \"opendatahub-operator-controller-manager-6c7bd9b77-8mt7d\" (UID: \"0e7b03f9-1027-42b7-a308-f0fe39dcb572\") " pod="opendatahub/opendatahub-operator-controller-manager-6c7bd9b77-8mt7d" Jun 10 12:44:37.272723 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:44:37.272662 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0e7b03f9-1027-42b7-a308-f0fe39dcb572-webhook-cert\") pod \"opendatahub-operator-controller-manager-6c7bd9b77-8mt7d\" (UID: \"0e7b03f9-1027-42b7-a308-f0fe39dcb572\") " pod="opendatahub/opendatahub-operator-controller-manager-6c7bd9b77-8mt7d" Jun 10 12:44:37.272723 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:44:37.272690 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0e7b03f9-1027-42b7-a308-f0fe39dcb572-tmp\") pod \"opendatahub-operator-controller-manager-6c7bd9b77-8mt7d\" (UID: \"0e7b03f9-1027-42b7-a308-f0fe39dcb572\") " pod="opendatahub/opendatahub-operator-controller-manager-6c7bd9b77-8mt7d" Jun 10 12:44:37.272875 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:44:37.272721 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfx9c\" (UniqueName: \"kubernetes.io/projected/0e7b03f9-1027-42b7-a308-f0fe39dcb572-kube-api-access-nfx9c\") pod \"opendatahub-operator-controller-manager-6c7bd9b77-8mt7d\" (UID: \"0e7b03f9-1027-42b7-a308-f0fe39dcb572\") " pod="opendatahub/opendatahub-operator-controller-manager-6c7bd9b77-8mt7d" Jun 10 12:44:37.272959 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:44:37.272941 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0e7b03f9-1027-42b7-a308-f0fe39dcb572-manifests\") pod \"opendatahub-operator-controller-manager-6c7bd9b77-8mt7d\" (UID: \"0e7b03f9-1027-42b7-a308-f0fe39dcb572\") " pod="opendatahub/opendatahub-operator-controller-manager-6c7bd9b77-8mt7d" Jun 10 12:44:37.274835 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:44:37.274817 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0e7b03f9-1027-42b7-a308-f0fe39dcb572-tmp\") pod \"opendatahub-operator-controller-manager-6c7bd9b77-8mt7d\" (UID: \"0e7b03f9-1027-42b7-a308-f0fe39dcb572\") " pod="opendatahub/opendatahub-operator-controller-manager-6c7bd9b77-8mt7d" Jun 10 12:44:37.274948 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:44:37.274934 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0e7b03f9-1027-42b7-a308-f0fe39dcb572-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6c7bd9b77-8mt7d\" (UID: \"0e7b03f9-1027-42b7-a308-f0fe39dcb572\") " pod="opendatahub/opendatahub-operator-controller-manager-6c7bd9b77-8mt7d" Jun 10 12:44:37.274992 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:44:37.274976 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0e7b03f9-1027-42b7-a308-f0fe39dcb572-webhook-cert\") pod \"opendatahub-operator-controller-manager-6c7bd9b77-8mt7d\" (UID: \"0e7b03f9-1027-42b7-a308-f0fe39dcb572\") " pod="opendatahub/opendatahub-operator-controller-manager-6c7bd9b77-8mt7d" Jun 10 12:44:37.285193 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:44:37.285161 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfx9c\" (UniqueName: \"kubernetes.io/projected/0e7b03f9-1027-42b7-a308-f0fe39dcb572-kube-api-access-nfx9c\") pod \"opendatahub-operator-controller-manager-6c7bd9b77-8mt7d\" (UID: \"0e7b03f9-1027-42b7-a308-f0fe39dcb572\") " pod="opendatahub/opendatahub-operator-controller-manager-6c7bd9b77-8mt7d" Jun 10 12:44:37.459911 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:44:37.459856 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6c7bd9b77-8mt7d" Jun 10 12:44:37.596708 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:44:37.596688 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6c7bd9b77-8mt7d"] Jun 10 12:44:37.599136 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:44:37.599115 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e7b03f9_1027_42b7_a308_f0fe39dcb572.slice/crio-35764db193fd65038cd89a205a51d5c39adafa389626b1dd5b27b6fbfc511779 WatchSource:0}: Error finding container 35764db193fd65038cd89a205a51d5c39adafa389626b1dd5b27b6fbfc511779: Status 404 returned error can't find the container with id 35764db193fd65038cd89a205a51d5c39adafa389626b1dd5b27b6fbfc511779 Jun 10 12:44:38.103873 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:44:38.103842 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c7bd9b77-8mt7d" event={"ID":"0e7b03f9-1027-42b7-a308-f0fe39dcb572","Type":"ContainerStarted","Data":"35764db193fd65038cd89a205a51d5c39adafa389626b1dd5b27b6fbfc511779"} Jun 10 12:44:41.116860 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:44:41.116822 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c7bd9b77-8mt7d" event={"ID":"0e7b03f9-1027-42b7-a308-f0fe39dcb572","Type":"ContainerStarted","Data":"d102d799c945f182409929257b7e228f2ef6be0e44221e216cb38afa28fd9cea"} Jun 10 12:44:42.121445 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:44:42.121408 2557 generic.go:356] "Generic (PLEG): container finished" podID="0e7b03f9-1027-42b7-a308-f0fe39dcb572" containerID="d102d799c945f182409929257b7e228f2ef6be0e44221e216cb38afa28fd9cea" exitCode=0 Jun 10 12:44:42.121934 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:44:42.121494 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c7bd9b77-8mt7d" event={"ID":"0e7b03f9-1027-42b7-a308-f0fe39dcb572","Type":"ContainerDied","Data":"d102d799c945f182409929257b7e228f2ef6be0e44221e216cb38afa28fd9cea"} Jun 10 12:44:43.126299 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:44:43.126267 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c7bd9b77-8mt7d" event={"ID":"0e7b03f9-1027-42b7-a308-f0fe39dcb572","Type":"ContainerStarted","Data":"296d5e96a416676c6d678c17522b03ebd2d41ccf42b3893c68c31f5a631c3e1a"} Jun 10 12:44:43.126650 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:44:43.126409 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6c7bd9b77-8mt7d" Jun 10 12:44:43.154997 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:44:43.154953 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6c7bd9b77-8mt7d" podStartSLOduration=2.178071046 podStartE2EDuration="6.154942395s" totalImagesPullingTime="3.073872494s" totalInitContainerRuntime="902.998855ms" isStatefulPod=false podCreationTimestamp="2026-06-10 12:44:37 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:44:43.152974651 +0000 UTC m=+480.035578751" watchObservedRunningTime="2026-06-10 12:44:43.154942395 +0000 UTC m=+480.037546469" Jun 10 12:44:54.132070 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:44:54.132036 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6c7bd9b77-8mt7d" Jun 10 12:44:56.155711 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:44:56.155678 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-54854d4f7-6r5ts"] Jun 10 12:44:56.167061 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:44:56.167038 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-54854d4f7-6r5ts" Jun 10 12:44:56.182236 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:44:56.182215 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 10 12:44:56.182344 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:44:56.182270 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 10 12:44:56.183624 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:44:56.183603 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 10 12:44:56.183730 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:44:56.183654 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 10 12:44:56.185660 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:44:56.185638 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-5llzz\"" Jun 10 12:44:56.186524 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:44:56.186508 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 10 12:44:56.196434 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:44:56.196412 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbj6t\" (UniqueName: \"kubernetes.io/projected/f2c1aa38-3ae3-42a3-8332-b8dccb49cfda-kube-api-access-kbj6t\") pod \"lws-controller-manager-54854d4f7-6r5ts\" (UID: \"f2c1aa38-3ae3-42a3-8332-b8dccb49cfda\") " pod="openshift-lws-operator/lws-controller-manager-54854d4f7-6r5ts" Jun 10 12:44:56.196542 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:44:56.196450 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f2c1aa38-3ae3-42a3-8332-b8dccb49cfda-manager-config\") pod \"lws-controller-manager-54854d4f7-6r5ts\" (UID: \"f2c1aa38-3ae3-42a3-8332-b8dccb49cfda\") " pod="openshift-lws-operator/lws-controller-manager-54854d4f7-6r5ts" Jun 10 12:44:56.196542 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:44:56.196488 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f2c1aa38-3ae3-42a3-8332-b8dccb49cfda-metrics-cert\") pod \"lws-controller-manager-54854d4f7-6r5ts\" (UID: \"f2c1aa38-3ae3-42a3-8332-b8dccb49cfda\") " pod="openshift-lws-operator/lws-controller-manager-54854d4f7-6r5ts" Jun 10 12:44:56.196542 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:44:56.196513 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f2c1aa38-3ae3-42a3-8332-b8dccb49cfda-cert\") pod \"lws-controller-manager-54854d4f7-6r5ts\" (UID: \"f2c1aa38-3ae3-42a3-8332-b8dccb49cfda\") " pod="openshift-lws-operator/lws-controller-manager-54854d4f7-6r5ts" Jun 10 12:44:56.206641 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:44:56.206620 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-54854d4f7-6r5ts"] Jun 10 12:44:56.297748 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:44:56.297725 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbj6t\" (UniqueName: \"kubernetes.io/projected/f2c1aa38-3ae3-42a3-8332-b8dccb49cfda-kube-api-access-kbj6t\") pod \"lws-controller-manager-54854d4f7-6r5ts\" (UID: \"f2c1aa38-3ae3-42a3-8332-b8dccb49cfda\") " pod="openshift-lws-operator/lws-controller-manager-54854d4f7-6r5ts" Jun 10 12:44:56.297837 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:44:56.297753 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f2c1aa38-3ae3-42a3-8332-b8dccb49cfda-manager-config\") pod \"lws-controller-manager-54854d4f7-6r5ts\" (UID: \"f2c1aa38-3ae3-42a3-8332-b8dccb49cfda\") " pod="openshift-lws-operator/lws-controller-manager-54854d4f7-6r5ts" Jun 10 12:44:56.297837 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:44:56.297769 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f2c1aa38-3ae3-42a3-8332-b8dccb49cfda-metrics-cert\") pod \"lws-controller-manager-54854d4f7-6r5ts\" (UID: \"f2c1aa38-3ae3-42a3-8332-b8dccb49cfda\") " pod="openshift-lws-operator/lws-controller-manager-54854d4f7-6r5ts" Jun 10 12:44:56.297837 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:44:56.297784 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f2c1aa38-3ae3-42a3-8332-b8dccb49cfda-cert\") pod \"lws-controller-manager-54854d4f7-6r5ts\" (UID: \"f2c1aa38-3ae3-42a3-8332-b8dccb49cfda\") " pod="openshift-lws-operator/lws-controller-manager-54854d4f7-6r5ts" Jun 10 12:44:56.298384 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:44:56.298356 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f2c1aa38-3ae3-42a3-8332-b8dccb49cfda-manager-config\") pod \"lws-controller-manager-54854d4f7-6r5ts\" (UID: \"f2c1aa38-3ae3-42a3-8332-b8dccb49cfda\") " pod="openshift-lws-operator/lws-controller-manager-54854d4f7-6r5ts" Jun 10 12:44:56.300216 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:44:56.300195 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f2c1aa38-3ae3-42a3-8332-b8dccb49cfda-cert\") pod \"lws-controller-manager-54854d4f7-6r5ts\" (UID: \"f2c1aa38-3ae3-42a3-8332-b8dccb49cfda\") " pod="openshift-lws-operator/lws-controller-manager-54854d4f7-6r5ts" Jun 10 12:44:56.300303 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:44:56.300224 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f2c1aa38-3ae3-42a3-8332-b8dccb49cfda-metrics-cert\") pod \"lws-controller-manager-54854d4f7-6r5ts\" (UID: \"f2c1aa38-3ae3-42a3-8332-b8dccb49cfda\") " pod="openshift-lws-operator/lws-controller-manager-54854d4f7-6r5ts" Jun 10 12:44:56.340452 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:44:56.340425 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbj6t\" (UniqueName: \"kubernetes.io/projected/f2c1aa38-3ae3-42a3-8332-b8dccb49cfda-kube-api-access-kbj6t\") pod \"lws-controller-manager-54854d4f7-6r5ts\" (UID: \"f2c1aa38-3ae3-42a3-8332-b8dccb49cfda\") " pod="openshift-lws-operator/lws-controller-manager-54854d4f7-6r5ts" Jun 10 12:44:56.475214 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:44:56.475153 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-54854d4f7-6r5ts" Jun 10 12:44:56.622152 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:44:56.622124 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2c1aa38_3ae3_42a3_8332_b8dccb49cfda.slice/crio-12a1a88800a3c5af41d96d31abd99d439ef41b3124a3654cbe3dd776603c2807 WatchSource:0}: Error finding container 12a1a88800a3c5af41d96d31abd99d439ef41b3124a3654cbe3dd776603c2807: Status 404 returned error can't find the container with id 12a1a88800a3c5af41d96d31abd99d439ef41b3124a3654cbe3dd776603c2807 Jun 10 12:44:56.622409 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:44:56.622389 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-54854d4f7-6r5ts"] Jun 10 12:44:57.171379 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:44:57.171347 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-54854d4f7-6r5ts" event={"ID":"f2c1aa38-3ae3-42a3-8332-b8dccb49cfda","Type":"ContainerStarted","Data":"12a1a88800a3c5af41d96d31abd99d439ef41b3124a3654cbe3dd776603c2807"} Jun 10 12:45:01.187976 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:45:01.187940 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-54854d4f7-6r5ts" event={"ID":"f2c1aa38-3ae3-42a3-8332-b8dccb49cfda","Type":"ContainerStarted","Data":"a0dc01ca12d840a6015751c2544fbf321355efec80200f5f07f788e2dbd63476"} Jun 10 12:45:01.188352 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:45:01.188086 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-54854d4f7-6r5ts" Jun 10 12:45:01.206863 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:45:01.206815 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-54854d4f7-6r5ts" podStartSLOduration=1.3898647450000001 podStartE2EDuration="5.206801117s" totalImagesPullingTime="3.816936372s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:44:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:45:01.205247376 +0000 UTC m=+498.087851449" watchObservedRunningTime="2026-06-10 12:45:01.206801117 +0000 UTC m=+498.089405194" Jun 10 12:45:12.192704 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:45:12.192673 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-54854d4f7-6r5ts" Jun 10 12:45:28.108408 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:45:28.108374 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-f676969f4-hbg2b"] Jun 10 12:45:28.111925 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:45:28.111906 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-f676969f4-hbg2b" Jun 10 12:45:28.114480 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:45:28.114441 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-7cc8g\"" Jun 10 12:45:28.114681 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:45:28.114669 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 10 12:45:28.125404 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:45:28.125381 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-f676969f4-hbg2b"] Jun 10 12:45:28.207876 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:45:28.207854 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/f89ac2d3-977d-4f4a-a472-40a137561b94-redirect-config\") pod \"dashboard-redirect-f676969f4-hbg2b\" (UID: \"f89ac2d3-977d-4f4a-a472-40a137561b94\") " pod="opendatahub/dashboard-redirect-f676969f4-hbg2b" Jun 10 12:45:28.207967 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:45:28.207899 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s66vj\" (UniqueName: \"kubernetes.io/projected/f89ac2d3-977d-4f4a-a472-40a137561b94-kube-api-access-s66vj\") pod \"dashboard-redirect-f676969f4-hbg2b\" (UID: \"f89ac2d3-977d-4f4a-a472-40a137561b94\") " pod="opendatahub/dashboard-redirect-f676969f4-hbg2b" Jun 10 12:45:28.308412 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:45:28.308388 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/f89ac2d3-977d-4f4a-a472-40a137561b94-redirect-config\") pod \"dashboard-redirect-f676969f4-hbg2b\" (UID: \"f89ac2d3-977d-4f4a-a472-40a137561b94\") " pod="opendatahub/dashboard-redirect-f676969f4-hbg2b" Jun 10 12:45:28.308504 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:45:28.308433 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s66vj\" (UniqueName: \"kubernetes.io/projected/f89ac2d3-977d-4f4a-a472-40a137561b94-kube-api-access-s66vj\") pod \"dashboard-redirect-f676969f4-hbg2b\" (UID: \"f89ac2d3-977d-4f4a-a472-40a137561b94\") " pod="opendatahub/dashboard-redirect-f676969f4-hbg2b" Jun 10 12:45:28.309072 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:45:28.309054 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/f89ac2d3-977d-4f4a-a472-40a137561b94-redirect-config\") pod \"dashboard-redirect-f676969f4-hbg2b\" (UID: \"f89ac2d3-977d-4f4a-a472-40a137561b94\") " pod="opendatahub/dashboard-redirect-f676969f4-hbg2b" Jun 10 12:45:28.317731 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:45:28.317703 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s66vj\" (UniqueName: \"kubernetes.io/projected/f89ac2d3-977d-4f4a-a472-40a137561b94-kube-api-access-s66vj\") pod \"dashboard-redirect-f676969f4-hbg2b\" (UID: \"f89ac2d3-977d-4f4a-a472-40a137561b94\") " pod="opendatahub/dashboard-redirect-f676969f4-hbg2b" Jun 10 12:45:28.421880 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:45:28.421833 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-f676969f4-hbg2b" Jun 10 12:45:28.542842 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:45:28.542807 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-f676969f4-hbg2b"] Jun 10 12:45:28.545989 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:45:28.545960 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf89ac2d3_977d_4f4a_a472_40a137561b94.slice/crio-a8055b2b14dc463fdedaa156d72f5e36db06b1bc8c14309d646558ea48dcf1ea WatchSource:0}: Error finding container a8055b2b14dc463fdedaa156d72f5e36db06b1bc8c14309d646558ea48dcf1ea: Status 404 returned error can't find the container with id a8055b2b14dc463fdedaa156d72f5e36db06b1bc8c14309d646558ea48dcf1ea Jun 10 12:45:29.279358 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:45:29.279326 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-f676969f4-hbg2b" event={"ID":"f89ac2d3-977d-4f4a-a472-40a137561b94","Type":"ContainerStarted","Data":"a8055b2b14dc463fdedaa156d72f5e36db06b1bc8c14309d646558ea48dcf1ea"} Jun 10 12:45:33.295079 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:45:33.295051 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-f676969f4-hbg2b" event={"ID":"f89ac2d3-977d-4f4a-a472-40a137561b94","Type":"ContainerStarted","Data":"d27560b2f17ef1be512801aeec8c0e47747a9274fa2172e39c6e9a0f6837576f"} Jun 10 12:45:33.315941 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:45:33.315897 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-f676969f4-hbg2b" podStartSLOduration=1.033235443 podStartE2EDuration="5.315882577s" totalImagesPullingTime="4.282647134s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:45:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:45:33.314429312 +0000 UTC m=+530.197033385" watchObservedRunningTime="2026-06-10 12:45:33.315882577 +0000 UTC m=+530.198486697" Jun 10 12:45:55.500025 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:45:55.499992 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795bqqck"] Jun 10 12:45:55.505349 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:45:55.505318 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795bqqck" Jun 10 12:45:55.508195 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:45:55.508155 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 10 12:45:55.508333 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:45:55.508262 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 10 12:45:55.508403 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:45:55.508327 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-77wvn\"" Jun 10 12:45:55.508493 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:45:55.508476 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 10 12:45:55.516320 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:45:55.516301 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795bqqck"] Jun 10 12:45:55.588747 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:45:55.588719 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f70e904-fbfd-4b35-8fea-99805c3c5690-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795bqqck\" (UID: \"1f70e904-fbfd-4b35-8fea-99805c3c5690\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795bqqck" Jun 10 12:45:55.588852 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:45:55.588756 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1f70e904-fbfd-4b35-8fea-99805c3c5690-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795bqqck\" (UID: \"1f70e904-fbfd-4b35-8fea-99805c3c5690\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795bqqck" Jun 10 12:45:55.588852 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:45:55.588783 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1f70e904-fbfd-4b35-8fea-99805c3c5690-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795bqqck\" (UID: \"1f70e904-fbfd-4b35-8fea-99805c3c5690\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795bqqck" Jun 10 12:45:55.588950 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:45:55.588848 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1f70e904-fbfd-4b35-8fea-99805c3c5690-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795bqqck\" (UID: \"1f70e904-fbfd-4b35-8fea-99805c3c5690\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795bqqck" Jun 10 12:45:55.588950 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:45:55.588884 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f70e904-fbfd-4b35-8fea-99805c3c5690-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795bqqck\" (UID: \"1f70e904-fbfd-4b35-8fea-99805c3c5690\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795bqqck" Jun 10 12:45:55.589023 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:45:55.588956 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1f70e904-fbfd-4b35-8fea-99805c3c5690-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795bqqck\" (UID: \"1f70e904-fbfd-4b35-8fea-99805c3c5690\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795bqqck" Jun 10 12:45:55.589023 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:45:55.588986 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1f70e904-fbfd-4b35-8fea-99805c3c5690-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795bqqck\" (UID: \"1f70e904-fbfd-4b35-8fea-99805c3c5690\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795bqqck" Jun 10 12:45:55.589023 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:45:55.589010 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1f70e904-fbfd-4b35-8fea-99805c3c5690-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795bqqck\" (UID: \"1f70e904-fbfd-4b35-8fea-99805c3c5690\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795bqqck" Jun 10 12:45:55.589126 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:45:55.589033 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjqxw\" (UniqueName: \"kubernetes.io/projected/1f70e904-fbfd-4b35-8fea-99805c3c5690-kube-api-access-hjqxw\") pod \"data-science-gateway-data-science-gateway-class-74759f9795bqqck\" (UID: \"1f70e904-fbfd-4b35-8fea-99805c3c5690\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795bqqck" Jun 10 12:45:55.689416 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:45:55.689394 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1f70e904-fbfd-4b35-8fea-99805c3c5690-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795bqqck\" (UID: \"1f70e904-fbfd-4b35-8fea-99805c3c5690\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795bqqck" Jun 10 12:45:55.689518 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:45:55.689422 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1f70e904-fbfd-4b35-8fea-99805c3c5690-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795bqqck\" (UID: \"1f70e904-fbfd-4b35-8fea-99805c3c5690\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795bqqck" Jun 10 12:45:55.689518 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:45:55.689452 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1f70e904-fbfd-4b35-8fea-99805c3c5690-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795bqqck\" (UID: \"1f70e904-fbfd-4b35-8fea-99805c3c5690\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795bqqck" Jun 10 12:45:55.689612 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:45:55.689554 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f70e904-fbfd-4b35-8fea-99805c3c5690-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795bqqck\" (UID: \"1f70e904-fbfd-4b35-8fea-99805c3c5690\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795bqqck" Jun 10 12:45:55.689612 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:45:55.689601 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1f70e904-fbfd-4b35-8fea-99805c3c5690-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795bqqck\" (UID: \"1f70e904-fbfd-4b35-8fea-99805c3c5690\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795bqqck" Jun 10 12:45:55.689714 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:45:55.689640 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1f70e904-fbfd-4b35-8fea-99805c3c5690-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795bqqck\" (UID: \"1f70e904-fbfd-4b35-8fea-99805c3c5690\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795bqqck" Jun 10 12:45:55.689714 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:45:55.689675 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1f70e904-fbfd-4b35-8fea-99805c3c5690-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795bqqck\" (UID: \"1f70e904-fbfd-4b35-8fea-99805c3c5690\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795bqqck" Jun 10 12:45:55.689714 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:45:55.689699 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjqxw\" (UniqueName: \"kubernetes.io/projected/1f70e904-fbfd-4b35-8fea-99805c3c5690-kube-api-access-hjqxw\") pod \"data-science-gateway-data-science-gateway-class-74759f9795bqqck\" (UID: \"1f70e904-fbfd-4b35-8fea-99805c3c5690\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795bqqck" Jun 10 12:45:55.689870 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:45:55.689730 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f70e904-fbfd-4b35-8fea-99805c3c5690-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795bqqck\" (UID: \"1f70e904-fbfd-4b35-8fea-99805c3c5690\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795bqqck" Jun 10 12:45:55.689870 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:45:55.689734 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1f70e904-fbfd-4b35-8fea-99805c3c5690-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795bqqck\" (UID: \"1f70e904-fbfd-4b35-8fea-99805c3c5690\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795bqqck" Jun 10 12:45:55.690045 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:45:55.690006 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1f70e904-fbfd-4b35-8fea-99805c3c5690-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795bqqck\" (UID: \"1f70e904-fbfd-4b35-8fea-99805c3c5690\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795bqqck" Jun 10 12:45:55.690135 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:45:55.690069 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f70e904-fbfd-4b35-8fea-99805c3c5690-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795bqqck\" (UID: \"1f70e904-fbfd-4b35-8fea-99805c3c5690\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795bqqck" Jun 10 12:45:55.690135 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:45:55.690084 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f70e904-fbfd-4b35-8fea-99805c3c5690-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795bqqck\" (UID: \"1f70e904-fbfd-4b35-8fea-99805c3c5690\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795bqqck" Jun 10 12:45:55.690484 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:45:55.690460 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1f70e904-fbfd-4b35-8fea-99805c3c5690-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795bqqck\" (UID: \"1f70e904-fbfd-4b35-8fea-99805c3c5690\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795bqqck" Jun 10 12:45:55.691794 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:45:55.691776 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1f70e904-fbfd-4b35-8fea-99805c3c5690-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795bqqck\" (UID: \"1f70e904-fbfd-4b35-8fea-99805c3c5690\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795bqqck" Jun 10 12:45:55.692013 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:45:55.691993 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1f70e904-fbfd-4b35-8fea-99805c3c5690-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795bqqck\" (UID: \"1f70e904-fbfd-4b35-8fea-99805c3c5690\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795bqqck" Jun 10 12:45:55.700336 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:45:55.700313 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjqxw\" (UniqueName: \"kubernetes.io/projected/1f70e904-fbfd-4b35-8fea-99805c3c5690-kube-api-access-hjqxw\") pod \"data-science-gateway-data-science-gateway-class-74759f9795bqqck\" (UID: \"1f70e904-fbfd-4b35-8fea-99805c3c5690\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795bqqck" Jun 10 12:45:55.700694 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:45:55.700676 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1f70e904-fbfd-4b35-8fea-99805c3c5690-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795bqqck\" (UID: \"1f70e904-fbfd-4b35-8fea-99805c3c5690\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795bqqck" Jun 10 12:45:55.815453 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:45:55.815437 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795bqqck" Jun 10 12:45:55.955573 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:45:55.955544 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795bqqck"] Jun 10 12:45:55.957423 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:45:55.957399 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f70e904_fbfd_4b35_8fea_99805c3c5690.slice/crio-984b31820b9e7ac608c9691a1dfa90196a4c629de5d4fa606bd9fcf595f40d7d WatchSource:0}: Error finding container 984b31820b9e7ac608c9691a1dfa90196a4c629de5d4fa606bd9fcf595f40d7d: Status 404 returned error can't find the container with id 984b31820b9e7ac608c9691a1dfa90196a4c629de5d4fa606bd9fcf595f40d7d Jun 10 12:45:56.372883 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:45:56.372850 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795bqqck" event={"ID":"1f70e904-fbfd-4b35-8fea-99805c3c5690","Type":"ContainerStarted","Data":"984b31820b9e7ac608c9691a1dfa90196a4c629de5d4fa606bd9fcf595f40d7d"} Jun 10 12:45:58.367816 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:45:58.367786 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-49srr"] Jun 10 12:45:58.374507 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:45:58.374470 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-49srr" Jun 10 12:45:58.377470 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:45:58.377376 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 10 12:45:58.377470 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:45:58.377428 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 10 12:45:58.377470 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:45:58.377388 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-hg88n\"" Jun 10 12:45:58.384510 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:45:58.384486 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-49srr"] Jun 10 12:45:58.513573 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:45:58.513538 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrdqj\" (UniqueName: \"kubernetes.io/projected/95077326-e12a-4775-97ee-8f019cfba187-kube-api-access-hrdqj\") pod \"kuadrant-operator-catalog-49srr\" (UID: \"95077326-e12a-4775-97ee-8f019cfba187\") " pod="kuadrant-system/kuadrant-operator-catalog-49srr" Jun 10 12:45:58.614681 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:45:58.614649 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrdqj\" (UniqueName: \"kubernetes.io/projected/95077326-e12a-4775-97ee-8f019cfba187-kube-api-access-hrdqj\") pod \"kuadrant-operator-catalog-49srr\" (UID: \"95077326-e12a-4775-97ee-8f019cfba187\") " pod="kuadrant-system/kuadrant-operator-catalog-49srr" Jun 10 12:45:58.627921 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:45:58.627857 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrdqj\" (UniqueName: \"kubernetes.io/projected/95077326-e12a-4775-97ee-8f019cfba187-kube-api-access-hrdqj\") pod \"kuadrant-operator-catalog-49srr\" (UID: \"95077326-e12a-4775-97ee-8f019cfba187\") " pod="kuadrant-system/kuadrant-operator-catalog-49srr" Jun 10 12:45:58.686412 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:45:58.686377 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-49srr" Jun 10 12:45:58.733995 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:45:58.733964 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-49srr"] Jun 10 12:45:58.947284 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:45:58.947203 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zhmdk"] Jun 10 12:45:58.950398 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:45:58.950373 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zhmdk" Jun 10 12:45:58.963979 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:45:58.963949 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zhmdk"] Jun 10 12:45:59.018255 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:45:59.018224 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6m4ph\" (UniqueName: \"kubernetes.io/projected/dee0659c-e6b3-4c1a-8efc-b9a7f2f749fe-kube-api-access-6m4ph\") pod \"kuadrant-operator-catalog-zhmdk\" (UID: \"dee0659c-e6b3-4c1a-8efc-b9a7f2f749fe\") " pod="kuadrant-system/kuadrant-operator-catalog-zhmdk" Jun 10 12:45:59.119560 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:45:59.119523 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6m4ph\" (UniqueName: \"kubernetes.io/projected/dee0659c-e6b3-4c1a-8efc-b9a7f2f749fe-kube-api-access-6m4ph\") pod \"kuadrant-operator-catalog-zhmdk\" (UID: \"dee0659c-e6b3-4c1a-8efc-b9a7f2f749fe\") " pod="kuadrant-system/kuadrant-operator-catalog-zhmdk" Jun 10 12:45:59.129941 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:45:59.129902 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6m4ph\" (UniqueName: \"kubernetes.io/projected/dee0659c-e6b3-4c1a-8efc-b9a7f2f749fe-kube-api-access-6m4ph\") pod \"kuadrant-operator-catalog-zhmdk\" (UID: \"dee0659c-e6b3-4c1a-8efc-b9a7f2f749fe\") " pod="kuadrant-system/kuadrant-operator-catalog-zhmdk" Jun 10 12:45:59.260435 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:45:59.260403 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zhmdk" Jun 10 12:45:59.304642 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:45:59.304582 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jun 10 12:45:59.304760 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:45:59.304719 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jun 10 12:45:59.304820 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:45:59.304764 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jun 10 12:45:59.380610 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:45:59.380481 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-49srr"] Jun 10 12:45:59.383758 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:45:59.383712 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95077326_e12a_4775_97ee_8f019cfba187.slice/crio-3a0f1b8bde977288f93466f739434c757d556c7d5b44f00ae2b162d5c9c5d554 WatchSource:0}: Error finding container 3a0f1b8bde977288f93466f739434c757d556c7d5b44f00ae2b162d5c9c5d554: Status 404 returned error can't find the container with id 3a0f1b8bde977288f93466f739434c757d556c7d5b44f00ae2b162d5c9c5d554 Jun 10 12:45:59.394972 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:45:59.394901 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795bqqck" event={"ID":"1f70e904-fbfd-4b35-8fea-99805c3c5690","Type":"ContainerStarted","Data":"c6f214c41420cef63e4061123633b90c0b05770054cdc41c2ed84dfa6c60bd15"} Jun 10 12:45:59.418226 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:45:59.418145 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795bqqck" podStartSLOduration=1.07308867 podStartE2EDuration="4.418121745s" totalImagesPullingTime="3.345033075s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:45:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:45:59.417608139 +0000 UTC m=+556.300212215" watchObservedRunningTime="2026-06-10 12:45:59.418121745 +0000 UTC m=+556.300725821" Jun 10 12:45:59.438168 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:45:59.438132 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zhmdk"] Jun 10 12:45:59.441706 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:45:59.441683 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddee0659c_e6b3_4c1a_8efc_b9a7f2f749fe.slice/crio-f64484d6c7d284eb348f10a1c6997f34cb10ca33d01f13d35e6d15617837fd53 WatchSource:0}: Error finding container f64484d6c7d284eb348f10a1c6997f34cb10ca33d01f13d35e6d15617837fd53: Status 404 returned error can't find the container with id f64484d6c7d284eb348f10a1c6997f34cb10ca33d01f13d35e6d15617837fd53 Jun 10 12:45:59.815530 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:45:59.815497 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795bqqck" Jun 10 12:46:00.399932 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:46:00.399894 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zhmdk" event={"ID":"dee0659c-e6b3-4c1a-8efc-b9a7f2f749fe","Type":"ContainerStarted","Data":"f64484d6c7d284eb348f10a1c6997f34cb10ca33d01f13d35e6d15617837fd53"} Jun 10 12:46:00.401009 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:46:00.400984 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-49srr" event={"ID":"95077326-e12a-4775-97ee-8f019cfba187","Type":"ContainerStarted","Data":"3a0f1b8bde977288f93466f739434c757d556c7d5b44f00ae2b162d5c9c5d554"} Jun 10 12:46:00.822345 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:46:00.822313 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795bqqck" Jun 10 12:46:01.405667 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:46:01.405636 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795bqqck" Jun 10 12:46:01.406732 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:46:01.406708 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795bqqck" Jun 10 12:46:02.410904 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:46:02.410866 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zhmdk" event={"ID":"dee0659c-e6b3-4c1a-8efc-b9a7f2f749fe","Type":"ContainerStarted","Data":"81b332452ca42ec281ded214105ef0b9aac17c2b27853f3ee35372acf04e1ee8"} Jun 10 12:46:02.412398 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:46:02.412369 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-49srr" event={"ID":"95077326-e12a-4775-97ee-8f019cfba187","Type":"ContainerStarted","Data":"019726cea5ef780b47e6e2aef45d887e01ab42a76185379e4b2cd7e9ea8f9319"} Jun 10 12:46:02.412398 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:46:02.412381 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-49srr" podUID="95077326-e12a-4775-97ee-8f019cfba187" containerName="registry-server" containerID="cri-o://019726cea5ef780b47e6e2aef45d887e01ab42a76185379e4b2cd7e9ea8f9319" gracePeriod=2 Jun 10 12:46:02.428094 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:46:02.428049 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-zhmdk" podStartSLOduration=1.972266662 podStartE2EDuration="4.428035375s" totalImagesPullingTime="2.455768713s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:45:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:46:02.427262361 +0000 UTC m=+559.309866437" watchObservedRunningTime="2026-06-10 12:46:02.428035375 +0000 UTC m=+559.310639450" Jun 10 12:46:02.447322 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:46:02.447283 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-49srr" podStartSLOduration=1.9297007750000001 podStartE2EDuration="4.447268169s" totalImagesPullingTime="2.517567394s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:45:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:46:02.445846206 +0000 UTC m=+559.328450275" watchObservedRunningTime="2026-06-10 12:46:02.447268169 +0000 UTC m=+559.329872243" Jun 10 12:46:02.652149 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:46:02.652126 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-49srr" Jun 10 12:46:02.753328 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:46:02.753236 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hrdqj\" (UniqueName: \"kubernetes.io/projected/95077326-e12a-4775-97ee-8f019cfba187-kube-api-access-hrdqj\") pod \"95077326-e12a-4775-97ee-8f019cfba187\" (UID: \"95077326-e12a-4775-97ee-8f019cfba187\") " Jun 10 12:46:02.755336 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:46:02.755315 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95077326-e12a-4775-97ee-8f019cfba187-kube-api-access-hrdqj" (OuterVolumeSpecName: "kube-api-access-hrdqj") pod "95077326-e12a-4775-97ee-8f019cfba187" (UID: "95077326-e12a-4775-97ee-8f019cfba187"). InnerVolumeSpecName "kube-api-access-hrdqj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 12:46:02.853991 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:46:02.853965 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hrdqj\" (UniqueName: \"kubernetes.io/projected/95077326-e12a-4775-97ee-8f019cfba187-kube-api-access-hrdqj\") on node \"ip-10-0-133-72.ec2.internal\" DevicePath \"\"" Jun 10 12:46:03.418126 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:46:03.418094 2557 generic.go:356] "Generic (PLEG): container finished" podID="95077326-e12a-4775-97ee-8f019cfba187" containerID="019726cea5ef780b47e6e2aef45d887e01ab42a76185379e4b2cd7e9ea8f9319" exitCode=0 Jun 10 12:46:03.418637 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:46:03.418146 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-49srr" Jun 10 12:46:03.418637 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:46:03.418209 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-49srr" event={"ID":"95077326-e12a-4775-97ee-8f019cfba187","Type":"ContainerDied","Data":"019726cea5ef780b47e6e2aef45d887e01ab42a76185379e4b2cd7e9ea8f9319"} Jun 10 12:46:03.418637 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:46:03.418263 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-49srr" event={"ID":"95077326-e12a-4775-97ee-8f019cfba187","Type":"ContainerDied","Data":"3a0f1b8bde977288f93466f739434c757d556c7d5b44f00ae2b162d5c9c5d554"} Jun 10 12:46:03.418637 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:46:03.418287 2557 scope.go:117] "RemoveContainer" containerID="019726cea5ef780b47e6e2aef45d887e01ab42a76185379e4b2cd7e9ea8f9319" Jun 10 12:46:03.427736 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:46:03.427719 2557 scope.go:117] "RemoveContainer" containerID="019726cea5ef780b47e6e2aef45d887e01ab42a76185379e4b2cd7e9ea8f9319" Jun 10 12:46:03.427986 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:46:03.427969 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"019726cea5ef780b47e6e2aef45d887e01ab42a76185379e4b2cd7e9ea8f9319\": container with ID starting with 019726cea5ef780b47e6e2aef45d887e01ab42a76185379e4b2cd7e9ea8f9319 not found: ID does not exist" containerID="019726cea5ef780b47e6e2aef45d887e01ab42a76185379e4b2cd7e9ea8f9319" Jun 10 12:46:03.428020 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:46:03.427995 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"019726cea5ef780b47e6e2aef45d887e01ab42a76185379e4b2cd7e9ea8f9319"} err="failed to get container status \"019726cea5ef780b47e6e2aef45d887e01ab42a76185379e4b2cd7e9ea8f9319\": rpc error: code = NotFound desc = could not find container \"019726cea5ef780b47e6e2aef45d887e01ab42a76185379e4b2cd7e9ea8f9319\": container with ID starting with 019726cea5ef780b47e6e2aef45d887e01ab42a76185379e4b2cd7e9ea8f9319 not found: ID does not exist" Jun 10 12:46:03.440565 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:46:03.440532 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-49srr"] Jun 10 12:46:03.444025 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:46:03.444003 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-49srr"] Jun 10 12:46:03.540891 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:46:03.540850 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95077326-e12a-4775-97ee-8f019cfba187" path="/var/lib/kubelet/pods/95077326-e12a-4775-97ee-8f019cfba187/volumes" Jun 10 12:46:09.261536 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:46:09.261494 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-zhmdk" Jun 10 12:46:09.261979 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:46:09.261586 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-zhmdk" Jun 10 12:46:09.283272 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:46:09.283246 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-zhmdk" Jun 10 12:46:09.463694 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:46:09.463668 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-zhmdk" Jun 10 12:46:31.417129 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:46:31.417095 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-jcrj9"] Jun 10 12:46:31.417621 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:46:31.417355 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95077326-e12a-4775-97ee-8f019cfba187" containerName="registry-server" Jun 10 12:46:31.417621 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:46:31.417366 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="95077326-e12a-4775-97ee-8f019cfba187" containerName="registry-server" Jun 10 12:46:31.417621 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:46:31.417423 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="95077326-e12a-4775-97ee-8f019cfba187" containerName="registry-server" Jun 10 12:46:31.439044 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:46:31.439010 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jcrj9" Jun 10 12:46:31.442801 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:46:31.442778 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-l62dx\"" Jun 10 12:46:31.442801 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:46:31.442782 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 10 12:46:31.448528 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:46:31.448504 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-jcrj9"] Jun 10 12:46:31.475483 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:46:31.475458 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkbw7\" (UniqueName: \"kubernetes.io/projected/9262d06d-38ab-4746-b751-4666abee72d2-kube-api-access-vkbw7\") pod \"dns-operator-controller-manager-864dd78c4c-jcrj9\" (UID: \"9262d06d-38ab-4746-b751-4666abee72d2\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jcrj9" Jun 10 12:46:31.576446 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:46:31.576413 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkbw7\" (UniqueName: \"kubernetes.io/projected/9262d06d-38ab-4746-b751-4666abee72d2-kube-api-access-vkbw7\") pod \"dns-operator-controller-manager-864dd78c4c-jcrj9\" (UID: \"9262d06d-38ab-4746-b751-4666abee72d2\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jcrj9" Jun 10 12:46:31.592715 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:46:31.592681 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkbw7\" (UniqueName: \"kubernetes.io/projected/9262d06d-38ab-4746-b751-4666abee72d2-kube-api-access-vkbw7\") pod \"dns-operator-controller-manager-864dd78c4c-jcrj9\" (UID: \"9262d06d-38ab-4746-b751-4666abee72d2\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jcrj9" Jun 10 12:46:31.749585 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:46:31.749506 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jcrj9" Jun 10 12:46:31.886884 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:46:31.886841 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-jcrj9"] Jun 10 12:46:31.890788 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:46:31.890761 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9262d06d_38ab_4746_b751_4666abee72d2.slice/crio-122061eda1e0d96dcf196b28f00cf586ec9a0eb4afea8f5ba564c72d235e1541 WatchSource:0}: Error finding container 122061eda1e0d96dcf196b28f00cf586ec9a0eb4afea8f5ba564c72d235e1541: Status 404 returned error can't find the container with id 122061eda1e0d96dcf196b28f00cf586ec9a0eb4afea8f5ba564c72d235e1541 Jun 10 12:46:32.534600 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:46:32.534560 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jcrj9" event={"ID":"9262d06d-38ab-4746-b751-4666abee72d2","Type":"ContainerStarted","Data":"122061eda1e0d96dcf196b28f00cf586ec9a0eb4afea8f5ba564c72d235e1541"} Jun 10 12:46:34.545457 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:46:34.545410 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jcrj9" event={"ID":"9262d06d-38ab-4746-b751-4666abee72d2","Type":"ContainerStarted","Data":"dc5cc6e18fe555c5fbf768b3a259493b134b2c27c5d7fcfe5b0894d33481b53d"} Jun 10 12:46:34.545887 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:46:34.545485 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jcrj9" Jun 10 12:46:34.587128 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:46:34.587080 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jcrj9" podStartSLOduration=1.128502458 podStartE2EDuration="3.587066158s" totalImagesPullingTime="2.4585637s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:46:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:46:34.58505342 +0000 UTC m=+591.467657495" watchObservedRunningTime="2026-06-10 12:46:34.587066158 +0000 UTC m=+591.469670235" Jun 10 12:46:36.955160 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:46:36.955124 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-h825l"] Jun 10 12:46:36.958151 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:46:36.958134 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-h825l" Jun 10 12:46:36.962325 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:46:36.962300 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-h2nkw\"" Jun 10 12:46:36.974016 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:46:36.973988 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-h825l"] Jun 10 12:46:37.016409 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:46:37.016374 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvm6c\" (UniqueName: \"kubernetes.io/projected/b8db3bc7-28f7-4c29-be1e-49d60c5e0f8e-kube-api-access-jvm6c\") pod \"authorino-operator-75cc8d5cb7-h825l\" (UID: \"b8db3bc7-28f7-4c29-be1e-49d60c5e0f8e\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-h825l" Jun 10 12:46:37.116725 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:46:37.116696 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvm6c\" (UniqueName: \"kubernetes.io/projected/b8db3bc7-28f7-4c29-be1e-49d60c5e0f8e-kube-api-access-jvm6c\") pod \"authorino-operator-75cc8d5cb7-h825l\" (UID: \"b8db3bc7-28f7-4c29-be1e-49d60c5e0f8e\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-h825l" Jun 10 12:46:37.139999 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:46:37.139967 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvm6c\" (UniqueName: \"kubernetes.io/projected/b8db3bc7-28f7-4c29-be1e-49d60c5e0f8e-kube-api-access-jvm6c\") pod \"authorino-operator-75cc8d5cb7-h825l\" (UID: \"b8db3bc7-28f7-4c29-be1e-49d60c5e0f8e\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-h825l" Jun 10 12:46:37.267790 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:46:37.267763 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-h825l" Jun 10 12:46:37.401176 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:46:37.401150 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-h825l"] Jun 10 12:46:37.403660 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:46:37.403637 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8db3bc7_28f7_4c29_be1e_49d60c5e0f8e.slice/crio-de77026d07cb6366dbafd4b1f866baed8c4a11b5cd6621b2bd2ba484f1b8968c WatchSource:0}: Error finding container de77026d07cb6366dbafd4b1f866baed8c4a11b5cd6621b2bd2ba484f1b8968c: Status 404 returned error can't find the container with id de77026d07cb6366dbafd4b1f866baed8c4a11b5cd6621b2bd2ba484f1b8968c Jun 10 12:46:37.556716 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:46:37.556639 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-h825l" event={"ID":"b8db3bc7-28f7-4c29-be1e-49d60c5e0f8e","Type":"ContainerStarted","Data":"de77026d07cb6366dbafd4b1f866baed8c4a11b5cd6621b2bd2ba484f1b8968c"} Jun 10 12:46:40.570392 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:46:40.570357 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-h825l" event={"ID":"b8db3bc7-28f7-4c29-be1e-49d60c5e0f8e","Type":"ContainerStarted","Data":"b015637ec5d7b64ac1e9e19937c27c960fc356276d6bbe2648276533bf6e676b"} Jun 10 12:46:40.570757 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:46:40.570475 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-h825l" Jun 10 12:46:40.604808 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:46:40.604762 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-h825l" podStartSLOduration=2.312743568 podStartE2EDuration="4.604750115s" totalImagesPullingTime="2.292006547s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:46:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:46:40.603146322 +0000 UTC m=+597.485750392" watchObservedRunningTime="2026-06-10 12:46:40.604750115 +0000 UTC m=+597.487354188" Jun 10 12:46:45.551060 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:46:45.550945 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jcrj9" Jun 10 12:46:51.581002 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:46:51.580971 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-h825l" Jun 10 12:46:52.930862 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:46:52.930832 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-bfzt6"] Jun 10 12:46:52.933899 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:46:52.933884 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bfzt6" Jun 10 12:46:52.939080 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:46:52.939055 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 10 12:46:52.939241 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:46:52.939063 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 10 12:46:52.940357 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:46:52.940342 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-5qnsx\"" Jun 10 12:46:52.946814 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:46:52.946783 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-bfzt6"] Jun 10 12:46:53.040948 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:46:53.040916 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c0708f9d-3ac4-407a-8107-3141dd5d6c4e-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-bfzt6\" (UID: \"c0708f9d-3ac4-407a-8107-3141dd5d6c4e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bfzt6" Jun 10 12:46:53.040948 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:46:53.040951 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/c0708f9d-3ac4-407a-8107-3141dd5d6c4e-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-bfzt6\" (UID: \"c0708f9d-3ac4-407a-8107-3141dd5d6c4e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bfzt6" Jun 10 12:46:53.041153 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:46:53.040987 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpw7v\" (UniqueName: \"kubernetes.io/projected/c0708f9d-3ac4-407a-8107-3141dd5d6c4e-kube-api-access-mpw7v\") pod \"kuadrant-console-plugin-66b5774985-bfzt6\" (UID: \"c0708f9d-3ac4-407a-8107-3141dd5d6c4e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bfzt6" Jun 10 12:46:53.141741 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:46:53.141711 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c0708f9d-3ac4-407a-8107-3141dd5d6c4e-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-bfzt6\" (UID: \"c0708f9d-3ac4-407a-8107-3141dd5d6c4e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bfzt6" Jun 10 12:46:53.141908 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:46:53.141749 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/c0708f9d-3ac4-407a-8107-3141dd5d6c4e-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-bfzt6\" (UID: \"c0708f9d-3ac4-407a-8107-3141dd5d6c4e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bfzt6" Jun 10 12:46:53.141908 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:46:53.141860 2557 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jun 10 12:46:53.141908 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:46:53.141880 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpw7v\" (UniqueName: \"kubernetes.io/projected/c0708f9d-3ac4-407a-8107-3141dd5d6c4e-kube-api-access-mpw7v\") pod \"kuadrant-console-plugin-66b5774985-bfzt6\" (UID: \"c0708f9d-3ac4-407a-8107-3141dd5d6c4e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bfzt6" Jun 10 12:46:53.142016 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:46:53.141922 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0708f9d-3ac4-407a-8107-3141dd5d6c4e-plugin-serving-cert podName:c0708f9d-3ac4-407a-8107-3141dd5d6c4e nodeName:}" failed. No retries permitted until 2026-06-10 12:46:53.641903483 +0000 UTC m=+610.524507535 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/c0708f9d-3ac4-407a-8107-3141dd5d6c4e-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-bfzt6" (UID: "c0708f9d-3ac4-407a-8107-3141dd5d6c4e") : secret "plugin-serving-cert" not found Jun 10 12:46:53.142351 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:46:53.142333 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c0708f9d-3ac4-407a-8107-3141dd5d6c4e-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-bfzt6\" (UID: \"c0708f9d-3ac4-407a-8107-3141dd5d6c4e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bfzt6" Jun 10 12:46:53.154609 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:46:53.154583 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpw7v\" (UniqueName: \"kubernetes.io/projected/c0708f9d-3ac4-407a-8107-3141dd5d6c4e-kube-api-access-mpw7v\") pod \"kuadrant-console-plugin-66b5774985-bfzt6\" (UID: \"c0708f9d-3ac4-407a-8107-3141dd5d6c4e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bfzt6" Jun 10 12:46:53.646284 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:46:53.646253 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/c0708f9d-3ac4-407a-8107-3141dd5d6c4e-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-bfzt6\" (UID: \"c0708f9d-3ac4-407a-8107-3141dd5d6c4e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bfzt6" Jun 10 12:46:53.648580 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:46:53.648563 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/c0708f9d-3ac4-407a-8107-3141dd5d6c4e-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-bfzt6\" (UID: \"c0708f9d-3ac4-407a-8107-3141dd5d6c4e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bfzt6" Jun 10 12:46:53.847339 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:46:53.847308 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bfzt6" Jun 10 12:46:53.987885 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:46:53.987785 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-bfzt6"] Jun 10 12:46:53.989906 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:46:53.989880 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc0708f9d_3ac4_407a_8107_3141dd5d6c4e.slice/crio-9403189d94fbc17860577a064bae950d64e9b1b04b895d296298c8ef1f3d1d59 WatchSource:0}: Error finding container 9403189d94fbc17860577a064bae950d64e9b1b04b895d296298c8ef1f3d1d59: Status 404 returned error can't find the container with id 9403189d94fbc17860577a064bae950d64e9b1b04b895d296298c8ef1f3d1d59 Jun 10 12:46:54.629081 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:46:54.629046 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bfzt6" event={"ID":"c0708f9d-3ac4-407a-8107-3141dd5d6c4e","Type":"ContainerStarted","Data":"9403189d94fbc17860577a064bae950d64e9b1b04b895d296298c8ef1f3d1d59"} Jun 10 12:47:17.744403 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:47:17.744359 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bfzt6" event={"ID":"c0708f9d-3ac4-407a-8107-3141dd5d6c4e","Type":"ContainerStarted","Data":"d29509a17ce0452572abbb5c15880ac1b07da951601594903d5a62b99e4e9165"} Jun 10 12:47:17.771074 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:47:17.771021 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bfzt6" podStartSLOduration=2.172250699 podStartE2EDuration="25.771006282s" totalImagesPullingTime="23.598755583s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:46:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:47:17.769661567 +0000 UTC m=+634.652265642" watchObservedRunningTime="2026-06-10 12:47:17.771006282 +0000 UTC m=+634.653610357" Jun 10 12:47:33.834262 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:47:33.834237 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-djdfb"] Jun 10 12:47:33.851523 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:47:33.851501 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-djdfb" Jun 10 12:47:33.859300 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:47:33.859280 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-w7p8h\"" Jun 10 12:47:33.863815 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:47:33.863797 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-djdfb"] Jun 10 12:47:33.874818 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:47:33.874789 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/417bf846-d5a5-4acc-a10f-901fa12dbdbf-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-djdfb\" (UID: \"417bf846-d5a5-4acc-a10f-901fa12dbdbf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-djdfb" Jun 10 12:47:33.874932 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:47:33.874828 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/417bf846-d5a5-4acc-a10f-901fa12dbdbf-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-djdfb\" (UID: \"417bf846-d5a5-4acc-a10f-901fa12dbdbf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-djdfb" Jun 10 12:47:33.874932 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:47:33.874861 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/417bf846-d5a5-4acc-a10f-901fa12dbdbf-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-djdfb\" (UID: \"417bf846-d5a5-4acc-a10f-901fa12dbdbf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-djdfb" Jun 10 12:47:33.875043 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:47:33.874971 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/417bf846-d5a5-4acc-a10f-901fa12dbdbf-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-djdfb\" (UID: \"417bf846-d5a5-4acc-a10f-901fa12dbdbf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-djdfb" Jun 10 12:47:33.875043 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:47:33.875016 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/417bf846-d5a5-4acc-a10f-901fa12dbdbf-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-djdfb\" (UID: \"417bf846-d5a5-4acc-a10f-901fa12dbdbf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-djdfb" Jun 10 12:47:33.875141 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:47:33.875039 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/417bf846-d5a5-4acc-a10f-901fa12dbdbf-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-djdfb\" (UID: \"417bf846-d5a5-4acc-a10f-901fa12dbdbf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-djdfb" Jun 10 12:47:33.875141 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:47:33.875122 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/417bf846-d5a5-4acc-a10f-901fa12dbdbf-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-djdfb\" (UID: \"417bf846-d5a5-4acc-a10f-901fa12dbdbf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-djdfb" Jun 10 12:47:33.875272 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:47:33.875228 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vn5ws\" (UniqueName: \"kubernetes.io/projected/417bf846-d5a5-4acc-a10f-901fa12dbdbf-kube-api-access-vn5ws\") pod \"maas-default-gateway-openshift-default-687ff6996-djdfb\" (UID: \"417bf846-d5a5-4acc-a10f-901fa12dbdbf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-djdfb" Jun 10 12:47:33.875324 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:47:33.875269 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/417bf846-d5a5-4acc-a10f-901fa12dbdbf-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-djdfb\" (UID: \"417bf846-d5a5-4acc-a10f-901fa12dbdbf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-djdfb" Jun 10 12:47:33.975966 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:47:33.975938 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/417bf846-d5a5-4acc-a10f-901fa12dbdbf-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-djdfb\" (UID: \"417bf846-d5a5-4acc-a10f-901fa12dbdbf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-djdfb" Jun 10 12:47:33.976119 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:47:33.975973 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/417bf846-d5a5-4acc-a10f-901fa12dbdbf-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-djdfb\" (UID: \"417bf846-d5a5-4acc-a10f-901fa12dbdbf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-djdfb" Jun 10 12:47:33.976119 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:47:33.975990 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/417bf846-d5a5-4acc-a10f-901fa12dbdbf-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-djdfb\" (UID: \"417bf846-d5a5-4acc-a10f-901fa12dbdbf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-djdfb" Jun 10 12:47:33.976119 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:47:33.976042 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/417bf846-d5a5-4acc-a10f-901fa12dbdbf-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-djdfb\" (UID: \"417bf846-d5a5-4acc-a10f-901fa12dbdbf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-djdfb" Jun 10 12:47:33.976119 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:47:33.976108 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vn5ws\" (UniqueName: \"kubernetes.io/projected/417bf846-d5a5-4acc-a10f-901fa12dbdbf-kube-api-access-vn5ws\") pod \"maas-default-gateway-openshift-default-687ff6996-djdfb\" (UID: \"417bf846-d5a5-4acc-a10f-901fa12dbdbf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-djdfb" Jun 10 12:47:33.976352 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:47:33.976146 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/417bf846-d5a5-4acc-a10f-901fa12dbdbf-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-djdfb\" (UID: \"417bf846-d5a5-4acc-a10f-901fa12dbdbf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-djdfb" Jun 10 12:47:33.976352 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:47:33.976213 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/417bf846-d5a5-4acc-a10f-901fa12dbdbf-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-djdfb\" (UID: \"417bf846-d5a5-4acc-a10f-901fa12dbdbf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-djdfb" Jun 10 12:47:33.976352 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:47:33.976238 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/417bf846-d5a5-4acc-a10f-901fa12dbdbf-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-djdfb\" (UID: \"417bf846-d5a5-4acc-a10f-901fa12dbdbf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-djdfb" Jun 10 12:47:33.976352 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:47:33.976270 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/417bf846-d5a5-4acc-a10f-901fa12dbdbf-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-djdfb\" (UID: \"417bf846-d5a5-4acc-a10f-901fa12dbdbf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-djdfb" Jun 10 12:47:33.976544 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:47:33.976467 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/417bf846-d5a5-4acc-a10f-901fa12dbdbf-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-djdfb\" (UID: \"417bf846-d5a5-4acc-a10f-901fa12dbdbf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-djdfb" Jun 10 12:47:33.976721 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:47:33.976700 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/417bf846-d5a5-4acc-a10f-901fa12dbdbf-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-djdfb\" (UID: \"417bf846-d5a5-4acc-a10f-901fa12dbdbf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-djdfb" Jun 10 12:47:33.976796 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:47:33.976758 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/417bf846-d5a5-4acc-a10f-901fa12dbdbf-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-djdfb\" (UID: \"417bf846-d5a5-4acc-a10f-901fa12dbdbf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-djdfb" Jun 10 12:47:33.976796 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:47:33.976780 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/417bf846-d5a5-4acc-a10f-901fa12dbdbf-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-djdfb\" (UID: \"417bf846-d5a5-4acc-a10f-901fa12dbdbf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-djdfb" Jun 10 12:47:33.976796 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:47:33.976760 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/417bf846-d5a5-4acc-a10f-901fa12dbdbf-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-djdfb\" (UID: \"417bf846-d5a5-4acc-a10f-901fa12dbdbf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-djdfb" Jun 10 12:47:33.978417 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:47:33.978391 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/417bf846-d5a5-4acc-a10f-901fa12dbdbf-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-djdfb\" (UID: \"417bf846-d5a5-4acc-a10f-901fa12dbdbf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-djdfb" Jun 10 12:47:33.978523 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:47:33.978506 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/417bf846-d5a5-4acc-a10f-901fa12dbdbf-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-djdfb\" (UID: \"417bf846-d5a5-4acc-a10f-901fa12dbdbf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-djdfb" Jun 10 12:47:33.987647 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:47:33.987627 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/417bf846-d5a5-4acc-a10f-901fa12dbdbf-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-djdfb\" (UID: \"417bf846-d5a5-4acc-a10f-901fa12dbdbf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-djdfb" Jun 10 12:47:33.987734 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:47:33.987687 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vn5ws\" (UniqueName: \"kubernetes.io/projected/417bf846-d5a5-4acc-a10f-901fa12dbdbf-kube-api-access-vn5ws\") pod \"maas-default-gateway-openshift-default-687ff6996-djdfb\" (UID: \"417bf846-d5a5-4acc-a10f-901fa12dbdbf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-djdfb" Jun 10 12:47:34.161344 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:47:34.161264 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-djdfb" Jun 10 12:47:34.302526 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:47:34.302372 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-djdfb"] Jun 10 12:47:34.305117 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:47:34.305088 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod417bf846_d5a5_4acc_a10f_901fa12dbdbf.slice/crio-c2d9c9a4ca783af465e508efb8aa9a743491b5b829749aa4fb1872cc4f80631c WatchSource:0}: Error finding container c2d9c9a4ca783af465e508efb8aa9a743491b5b829749aa4fb1872cc4f80631c: Status 404 returned error can't find the container with id c2d9c9a4ca783af465e508efb8aa9a743491b5b829749aa4fb1872cc4f80631c Jun 10 12:47:34.307339 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:47:34.307303 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jun 10 12:47:34.307422 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:47:34.307381 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jun 10 12:47:34.307463 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:47:34.307447 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jun 10 12:47:34.810000 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:47:34.809965 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-djdfb" event={"ID":"417bf846-d5a5-4acc-a10f-901fa12dbdbf","Type":"ContainerStarted","Data":"158ec57479fc1b07618704f8bfb9c6a39d4827fe3fd41bf6a48cb4ba998262de"} Jun 10 12:47:34.810204 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:47:34.810018 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-djdfb" event={"ID":"417bf846-d5a5-4acc-a10f-901fa12dbdbf","Type":"ContainerStarted","Data":"c2d9c9a4ca783af465e508efb8aa9a743491b5b829749aa4fb1872cc4f80631c"} Jun 10 12:47:34.844267 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:47:34.844220 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-djdfb" podStartSLOduration=1.844204468 podStartE2EDuration="1.844204468s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:47:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:47:34.843065871 +0000 UTC m=+651.725669971" watchObservedRunningTime="2026-06-10 12:47:34.844204468 +0000 UTC m=+651.726808542" Jun 10 12:47:35.162448 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:47:35.162374 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-djdfb" Jun 10 12:47:35.166846 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:47:35.166822 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-djdfb" Jun 10 12:47:35.814125 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:47:35.814086 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-djdfb" Jun 10 12:47:35.815112 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:47:35.815094 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-djdfb" Jun 10 12:47:38.990350 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:47:38.990314 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-25hp5"] Jun 10 12:47:39.041047 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:47:39.041011 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-25hp5"] Jun 10 12:47:39.041228 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:47:39.041107 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-25hp5" Jun 10 12:47:39.043975 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:47:39.043949 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-2cj9v\"" Jun 10 12:47:39.116327 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:47:39.116290 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44ddq\" (UniqueName: \"kubernetes.io/projected/363b8935-2f6c-4828-bb29-2c7fff035deb-kube-api-access-44ddq\") pod \"authorino-58cd955675-25hp5\" (UID: \"363b8935-2f6c-4828-bb29-2c7fff035deb\") " pod="kuadrant-system/authorino-58cd955675-25hp5" Jun 10 12:47:39.217767 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:47:39.217724 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44ddq\" (UniqueName: \"kubernetes.io/projected/363b8935-2f6c-4828-bb29-2c7fff035deb-kube-api-access-44ddq\") pod \"authorino-58cd955675-25hp5\" (UID: \"363b8935-2f6c-4828-bb29-2c7fff035deb\") " pod="kuadrant-system/authorino-58cd955675-25hp5" Jun 10 12:47:39.226679 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:47:39.226650 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-44ddq\" (UniqueName: \"kubernetes.io/projected/363b8935-2f6c-4828-bb29-2c7fff035deb-kube-api-access-44ddq\") pod \"authorino-58cd955675-25hp5\" (UID: \"363b8935-2f6c-4828-bb29-2c7fff035deb\") " pod="kuadrant-system/authorino-58cd955675-25hp5" Jun 10 12:47:39.350619 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:47:39.350575 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-25hp5" Jun 10 12:47:39.546384 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:47:39.546342 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-25hp5"] Jun 10 12:47:39.548559 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:47:39.548534 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod363b8935_2f6c_4828_bb29_2c7fff035deb.slice/crio-8e37d9a5e2c0e5cbbfd421a4f52cbe068c6d797ca3dccdc0570c337e9956c0ec WatchSource:0}: Error finding container 8e37d9a5e2c0e5cbbfd421a4f52cbe068c6d797ca3dccdc0570c337e9956c0ec: Status 404 returned error can't find the container with id 8e37d9a5e2c0e5cbbfd421a4f52cbe068c6d797ca3dccdc0570c337e9956c0ec Jun 10 12:47:39.831233 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:47:39.831196 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-25hp5" event={"ID":"363b8935-2f6c-4828-bb29-2c7fff035deb","Type":"ContainerStarted","Data":"8e37d9a5e2c0e5cbbfd421a4f52cbe068c6d797ca3dccdc0570c337e9956c0ec"} Jun 10 12:47:44.650787 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:47:44.650751 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-25hp5"] Jun 10 12:47:44.857363 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:47:44.857325 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-25hp5" event={"ID":"363b8935-2f6c-4828-bb29-2c7fff035deb","Type":"ContainerStarted","Data":"5ddd52409ea2eb121a82c700ebad834764f1ab86c77e8be8af470a45883c5def"} Jun 10 12:47:44.877811 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:47:44.877757 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-25hp5" podStartSLOduration=2.401053495 podStartE2EDuration="6.877740841s" totalImagesPullingTime="4.476687346s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:47:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:47:44.876288819 +0000 UTC m=+661.758892895" watchObservedRunningTime="2026-06-10 12:47:44.877740841 +0000 UTC m=+661.760344915" Jun 10 12:47:45.860862 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:47:45.860822 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-25hp5" podUID="363b8935-2f6c-4828-bb29-2c7fff035deb" containerName="authorino" containerID="cri-o://5ddd52409ea2eb121a82c700ebad834764f1ab86c77e8be8af470a45883c5def" gracePeriod=30 Jun 10 12:47:46.102014 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:47:46.101988 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-25hp5" Jun 10 12:47:46.177995 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:47:46.177928 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-44ddq\" (UniqueName: \"kubernetes.io/projected/363b8935-2f6c-4828-bb29-2c7fff035deb-kube-api-access-44ddq\") pod \"363b8935-2f6c-4828-bb29-2c7fff035deb\" (UID: \"363b8935-2f6c-4828-bb29-2c7fff035deb\") " Jun 10 12:47:46.179883 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:47:46.179858 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/363b8935-2f6c-4828-bb29-2c7fff035deb-kube-api-access-44ddq" (OuterVolumeSpecName: "kube-api-access-44ddq") pod "363b8935-2f6c-4828-bb29-2c7fff035deb" (UID: "363b8935-2f6c-4828-bb29-2c7fff035deb"). InnerVolumeSpecName "kube-api-access-44ddq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 12:47:46.278612 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:47:46.278587 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-44ddq\" (UniqueName: \"kubernetes.io/projected/363b8935-2f6c-4828-bb29-2c7fff035deb-kube-api-access-44ddq\") on node \"ip-10-0-133-72.ec2.internal\" DevicePath \"\"" Jun 10 12:47:46.865654 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:47:46.865622 2557 generic.go:356] "Generic (PLEG): container finished" podID="363b8935-2f6c-4828-bb29-2c7fff035deb" containerID="5ddd52409ea2eb121a82c700ebad834764f1ab86c77e8be8af470a45883c5def" exitCode=0 Jun 10 12:47:46.866105 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:47:46.865663 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-25hp5" Jun 10 12:47:46.866105 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:47:46.865712 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-25hp5" event={"ID":"363b8935-2f6c-4828-bb29-2c7fff035deb","Type":"ContainerDied","Data":"5ddd52409ea2eb121a82c700ebad834764f1ab86c77e8be8af470a45883c5def"} Jun 10 12:47:46.866105 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:47:46.865760 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-25hp5" event={"ID":"363b8935-2f6c-4828-bb29-2c7fff035deb","Type":"ContainerDied","Data":"8e37d9a5e2c0e5cbbfd421a4f52cbe068c6d797ca3dccdc0570c337e9956c0ec"} Jun 10 12:47:46.866105 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:47:46.865784 2557 scope.go:117] "RemoveContainer" containerID="5ddd52409ea2eb121a82c700ebad834764f1ab86c77e8be8af470a45883c5def" Jun 10 12:47:46.874073 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:47:46.874056 2557 scope.go:117] "RemoveContainer" containerID="5ddd52409ea2eb121a82c700ebad834764f1ab86c77e8be8af470a45883c5def" Jun 10 12:47:46.874442 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:47:46.874423 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ddd52409ea2eb121a82c700ebad834764f1ab86c77e8be8af470a45883c5def\": container with ID starting with 5ddd52409ea2eb121a82c700ebad834764f1ab86c77e8be8af470a45883c5def not found: ID does not exist" containerID="5ddd52409ea2eb121a82c700ebad834764f1ab86c77e8be8af470a45883c5def" Jun 10 12:47:46.874509 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:47:46.874450 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ddd52409ea2eb121a82c700ebad834764f1ab86c77e8be8af470a45883c5def"} err="failed to get container status \"5ddd52409ea2eb121a82c700ebad834764f1ab86c77e8be8af470a45883c5def\": rpc error: code = NotFound desc = could not find container \"5ddd52409ea2eb121a82c700ebad834764f1ab86c77e8be8af470a45883c5def\": container with ID starting with 5ddd52409ea2eb121a82c700ebad834764f1ab86c77e8be8af470a45883c5def not found: ID does not exist" Jun 10 12:47:46.886579 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:47:46.886558 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-25hp5"] Jun 10 12:47:46.892207 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:47:46.892171 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-25hp5"] Jun 10 12:47:47.541873 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:47:47.541840 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="363b8935-2f6c-4828-bb29-2c7fff035deb" path="/var/lib/kubelet/pods/363b8935-2f6c-4828-bb29-2c7fff035deb/volumes" Jun 10 12:47:59.647152 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:47:59.647115 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["redhat-ai-gateway-infra/postgres-69fb4594cf-wqkw4"] Jun 10 12:47:59.647636 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:47:59.647555 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="363b8935-2f6c-4828-bb29-2c7fff035deb" containerName="authorino" Jun 10 12:47:59.647636 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:47:59.647570 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="363b8935-2f6c-4828-bb29-2c7fff035deb" containerName="authorino" Jun 10 12:47:59.647719 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:47:59.647657 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="363b8935-2f6c-4828-bb29-2c7fff035deb" containerName="authorino" Jun 10 12:47:59.703402 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:47:59.703364 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/postgres-69fb4594cf-wqkw4"] Jun 10 12:47:59.703576 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:47:59.703385 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-wqkw4" Jun 10 12:47:59.706324 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:47:59.706299 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jun 10 12:47:59.706448 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:47:59.706299 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jun 10 12:47:59.706448 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:47:59.706363 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"default-dockercfg-xh29w\"" Jun 10 12:47:59.706448 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:47:59.706397 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"postgres-creds\"" Jun 10 12:47:59.789677 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:47:59.789640 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/7982e01a-1ad2-409a-acd4-dc3c210cb8f6-data\") pod \"postgres-69fb4594cf-wqkw4\" (UID: \"7982e01a-1ad2-409a-acd4-dc3c210cb8f6\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-wqkw4" Jun 10 12:47:59.789875 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:47:59.789693 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vbsk\" (UniqueName: \"kubernetes.io/projected/7982e01a-1ad2-409a-acd4-dc3c210cb8f6-kube-api-access-9vbsk\") pod \"postgres-69fb4594cf-wqkw4\" (UID: \"7982e01a-1ad2-409a-acd4-dc3c210cb8f6\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-wqkw4" Jun 10 12:47:59.890607 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:47:59.890571 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/7982e01a-1ad2-409a-acd4-dc3c210cb8f6-data\") pod \"postgres-69fb4594cf-wqkw4\" (UID: \"7982e01a-1ad2-409a-acd4-dc3c210cb8f6\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-wqkw4" Jun 10 12:47:59.890762 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:47:59.890622 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vbsk\" (UniqueName: \"kubernetes.io/projected/7982e01a-1ad2-409a-acd4-dc3c210cb8f6-kube-api-access-9vbsk\") pod \"postgres-69fb4594cf-wqkw4\" (UID: \"7982e01a-1ad2-409a-acd4-dc3c210cb8f6\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-wqkw4" Jun 10 12:47:59.890969 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:47:59.890947 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/7982e01a-1ad2-409a-acd4-dc3c210cb8f6-data\") pod \"postgres-69fb4594cf-wqkw4\" (UID: \"7982e01a-1ad2-409a-acd4-dc3c210cb8f6\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-wqkw4" Jun 10 12:47:59.901559 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:47:59.901492 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vbsk\" (UniqueName: \"kubernetes.io/projected/7982e01a-1ad2-409a-acd4-dc3c210cb8f6-kube-api-access-9vbsk\") pod \"postgres-69fb4594cf-wqkw4\" (UID: \"7982e01a-1ad2-409a-acd4-dc3c210cb8f6\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-wqkw4" Jun 10 12:48:00.013198 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:48:00.013156 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-wqkw4" Jun 10 12:48:00.150608 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:48:00.150580 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7982e01a_1ad2_409a_acd4_dc3c210cb8f6.slice/crio-ee2c428af64397dbe5f6d53cc202e56e1e97a098e2760b7b554352988e5a8930 WatchSource:0}: Error finding container ee2c428af64397dbe5f6d53cc202e56e1e97a098e2760b7b554352988e5a8930: Status 404 returned error can't find the container with id ee2c428af64397dbe5f6d53cc202e56e1e97a098e2760b7b554352988e5a8930 Jun 10 12:48:00.151069 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:48:00.151048 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/postgres-69fb4594cf-wqkw4"] Jun 10 12:48:00.151956 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:48:00.151910 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 12:48:00.929633 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:48:00.929594 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-wqkw4" event={"ID":"7982e01a-1ad2-409a-acd4-dc3c210cb8f6","Type":"ContainerStarted","Data":"ee2c428af64397dbe5f6d53cc202e56e1e97a098e2760b7b554352988e5a8930"} Jun 10 12:48:03.944171 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:48:03.944125 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-wqkw4" event={"ID":"7982e01a-1ad2-409a-acd4-dc3c210cb8f6","Type":"ContainerStarted","Data":"dbbcc86340d4a193bea154b207891951ca093704c820fc5474d33588aa1a3934"} Jun 10 12:48:03.944646 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:48:03.944256 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-wqkw4" Jun 10 12:48:03.965244 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:48:03.965198 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-wqkw4" podStartSLOduration=1.742034957 podStartE2EDuration="4.965166677s" totalImagesPullingTime="3.22313172s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:47:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:48:03.963731946 +0000 UTC m=+680.846336020" watchObservedRunningTime="2026-06-10 12:48:03.965166677 +0000 UTC m=+680.847770752" Jun 10 12:48:09.977302 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:48:09.977271 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-wqkw4" Jun 10 12:48:36.171688 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:48:36.171613 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 12:48:36.174568 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:48:36.174552 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 12:48:36.177285 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:48:36.177264 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 10 12:48:36.178477 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:48:36.178457 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 10 12:48:36.178605 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:48:36.178479 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-dgfzz\"" Jun 10 12:48:36.178605 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:48:36.178513 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 10 12:48:36.184808 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:48:36.184787 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 12:48:36.267827 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:48:36.267805 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8x7l\" (UniqueName: \"kubernetes.io/projected/a4a97bf6-5e12-4e0f-8925-c78a3862e578-kube-api-access-h8x7l\") pod \"maas-keycloak-0\" (UID: \"a4a97bf6-5e12-4e0f-8925-c78a3862e578\") " pod="keycloak-system/maas-keycloak-0" Jun 10 12:48:36.368197 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:48:36.368157 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8x7l\" (UniqueName: \"kubernetes.io/projected/a4a97bf6-5e12-4e0f-8925-c78a3862e578-kube-api-access-h8x7l\") pod \"maas-keycloak-0\" (UID: \"a4a97bf6-5e12-4e0f-8925-c78a3862e578\") " pod="keycloak-system/maas-keycloak-0" Jun 10 12:48:36.377421 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:48:36.377389 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8x7l\" (UniqueName: \"kubernetes.io/projected/a4a97bf6-5e12-4e0f-8925-c78a3862e578-kube-api-access-h8x7l\") pod \"maas-keycloak-0\" (UID: \"a4a97bf6-5e12-4e0f-8925-c78a3862e578\") " pod="keycloak-system/maas-keycloak-0" Jun 10 12:48:36.483979 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:48:36.483921 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 12:48:36.617752 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:48:36.617723 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 12:48:37.073899 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:48:37.073864 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"a4a97bf6-5e12-4e0f-8925-c78a3862e578","Type":"ContainerStarted","Data":"9da492677e2ee8f182b8d1e80752a584dbf333d45cca9e8866067de0571507f9"} Jun 10 12:48:43.106285 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:48:43.106248 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"a4a97bf6-5e12-4e0f-8925-c78a3862e578","Type":"ContainerStarted","Data":"3d39c366bcfd9fcafb8cb9754af3df13bded7c72910d7fa5ee4fe30dcc5127a8"} Jun 10 12:48:43.128932 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:48:43.128878 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.160272098 podStartE2EDuration="7.128862332s" totalImagesPullingTime="5.968590234s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:48:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:48:43.125456466 +0000 UTC m=+720.008060541" watchObservedRunningTime="2026-06-10 12:48:43.128862332 +0000 UTC m=+720.011466406" Jun 10 12:48:43.484156 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:48:43.484070 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 10 12:48:43.485382 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:48:43.485352 2557 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a4a97bf6-5e12-4e0f-8925-c78a3862e578" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.26:9000/health/started\": dial tcp 10.132.0.26:9000: connect: connection refused" Jun 10 12:48:44.485200 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:48:44.485126 2557 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a4a97bf6-5e12-4e0f-8925-c78a3862e578" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.26:9000/health/started\": dial tcp 10.132.0.26:9000: connect: connection refused" Jun 10 12:48:45.484866 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:48:45.484799 2557 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a4a97bf6-5e12-4e0f-8925-c78a3862e578" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.26:9000/health/started\": dial tcp 10.132.0.26:9000: connect: connection refused" Jun 10 12:48:46.484707 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:48:46.484664 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 10 12:48:46.485212 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:48:46.484974 2557 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a4a97bf6-5e12-4e0f-8925-c78a3862e578" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.26:9000/health/started\": dial tcp 10.132.0.26:9000: connect: connection refused" Jun 10 12:48:47.485035 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:48:47.484982 2557 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a4a97bf6-5e12-4e0f-8925-c78a3862e578" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.26:9000/health/started\": dial tcp 10.132.0.26:9000: connect: connection refused" Jun 10 12:48:48.485166 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:48:48.485111 2557 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a4a97bf6-5e12-4e0f-8925-c78a3862e578" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.26:9000/health/started\": dial tcp 10.132.0.26:9000: connect: connection refused" Jun 10 12:48:49.484552 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:48:49.484506 2557 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a4a97bf6-5e12-4e0f-8925-c78a3862e578" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.26:9000/health/started\": dial tcp 10.132.0.26:9000: connect: connection refused" Jun 10 12:48:50.485161 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:48:50.485112 2557 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a4a97bf6-5e12-4e0f-8925-c78a3862e578" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.26:9000/health/started\": dial tcp 10.132.0.26:9000: connect: connection refused" Jun 10 12:48:51.484641 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:48:51.484597 2557 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a4a97bf6-5e12-4e0f-8925-c78a3862e578" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.26:9000/health/started\": dial tcp 10.132.0.26:9000: connect: connection refused" Jun 10 12:48:52.485198 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:48:52.485144 2557 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a4a97bf6-5e12-4e0f-8925-c78a3862e578" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.26:9000/health/started\": dial tcp 10.132.0.26:9000: connect: connection refused" Jun 10 12:48:53.485325 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:48:53.485268 2557 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a4a97bf6-5e12-4e0f-8925-c78a3862e578" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.26:9000/health/started\": dial tcp 10.132.0.26:9000: connect: connection refused" Jun 10 12:48:54.484439 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:48:54.484390 2557 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a4a97bf6-5e12-4e0f-8925-c78a3862e578" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.26:9000/health/started\": dial tcp 10.132.0.26:9000: connect: connection refused" Jun 10 12:48:55.584257 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:48:55.584223 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 10 12:48:55.601325 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:48:55.601280 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="a4a97bf6-5e12-4e0f-8925-c78a3862e578" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 12:49:05.590638 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:05.590610 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 10 12:49:07.129904 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:07.129874 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7ff576ddbd-zzssv"] Jun 10 12:49:07.133017 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:07.133001 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7ff576ddbd-zzssv" Jun 10 12:49:07.136663 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:07.136642 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 10 12:49:07.136798 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:07.136641 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-2cj9v\"" Jun 10 12:49:07.145215 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:07.145191 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7ff576ddbd-zzssv"] Jun 10 12:49:07.239521 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:07.239497 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7qp7\" (UniqueName: \"kubernetes.io/projected/3c4b7910-e873-4d0b-9135-b4f855fbbf9d-kube-api-access-j7qp7\") pod \"authorino-7ff576ddbd-zzssv\" (UID: \"3c4b7910-e873-4d0b-9135-b4f855fbbf9d\") " pod="kuadrant-system/authorino-7ff576ddbd-zzssv" Jun 10 12:49:07.239633 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:07.239524 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3c4b7910-e873-4d0b-9135-b4f855fbbf9d-tls-cert\") pod \"authorino-7ff576ddbd-zzssv\" (UID: \"3c4b7910-e873-4d0b-9135-b4f855fbbf9d\") " pod="kuadrant-system/authorino-7ff576ddbd-zzssv" Jun 10 12:49:07.340476 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:07.340448 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7qp7\" (UniqueName: \"kubernetes.io/projected/3c4b7910-e873-4d0b-9135-b4f855fbbf9d-kube-api-access-j7qp7\") pod \"authorino-7ff576ddbd-zzssv\" (UID: \"3c4b7910-e873-4d0b-9135-b4f855fbbf9d\") " pod="kuadrant-system/authorino-7ff576ddbd-zzssv" Jun 10 12:49:07.340476 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:07.340478 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3c4b7910-e873-4d0b-9135-b4f855fbbf9d-tls-cert\") pod \"authorino-7ff576ddbd-zzssv\" (UID: \"3c4b7910-e873-4d0b-9135-b4f855fbbf9d\") " pod="kuadrant-system/authorino-7ff576ddbd-zzssv" Jun 10 12:49:07.342684 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:07.342662 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3c4b7910-e873-4d0b-9135-b4f855fbbf9d-tls-cert\") pod \"authorino-7ff576ddbd-zzssv\" (UID: \"3c4b7910-e873-4d0b-9135-b4f855fbbf9d\") " pod="kuadrant-system/authorino-7ff576ddbd-zzssv" Jun 10 12:49:07.348676 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:07.348653 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7qp7\" (UniqueName: \"kubernetes.io/projected/3c4b7910-e873-4d0b-9135-b4f855fbbf9d-kube-api-access-j7qp7\") pod \"authorino-7ff576ddbd-zzssv\" (UID: \"3c4b7910-e873-4d0b-9135-b4f855fbbf9d\") " pod="kuadrant-system/authorino-7ff576ddbd-zzssv" Jun 10 12:49:07.442126 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:07.442063 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7ff576ddbd-zzssv" Jun 10 12:49:07.569799 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:07.569779 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7ff576ddbd-zzssv"] Jun 10 12:49:07.572163 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:49:07.572138 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3c4b7910_e873_4d0b_9135_b4f855fbbf9d.slice/crio-36c7ea435632aa2775047bc537ffc2bb5cdff1cc7eafb2f76c7bfab61a270aeb WatchSource:0}: Error finding container 36c7ea435632aa2775047bc537ffc2bb5cdff1cc7eafb2f76c7bfab61a270aeb: Status 404 returned error can't find the container with id 36c7ea435632aa2775047bc537ffc2bb5cdff1cc7eafb2f76c7bfab61a270aeb Jun 10 12:49:08.242944 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:08.242904 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7ff576ddbd-zzssv" event={"ID":"3c4b7910-e873-4d0b-9135-b4f855fbbf9d","Type":"ContainerStarted","Data":"f3c29aeb574630b763d591c85dadc86fd5d80798773927353285142292e5bafe"} Jun 10 12:49:08.243354 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:08.242951 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7ff576ddbd-zzssv" event={"ID":"3c4b7910-e873-4d0b-9135-b4f855fbbf9d","Type":"ContainerStarted","Data":"36c7ea435632aa2775047bc537ffc2bb5cdff1cc7eafb2f76c7bfab61a270aeb"} Jun 10 12:49:08.264608 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:08.264559 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7ff576ddbd-zzssv" podStartSLOduration=0.792812697 podStartE2EDuration="1.264542213s" totalImagesPullingTime="471.729516ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:49:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:49:08.263804883 +0000 UTC m=+745.146408957" watchObservedRunningTime="2026-06-10 12:49:08.264542213 +0000 UTC m=+745.147146282" Jun 10 12:49:11.934153 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:11.934121 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-c6474c966-n59xb"] Jun 10 12:49:11.937517 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:11.937500 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c6474c966-n59xb" Jun 10 12:49:11.941537 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:11.941517 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 10 12:49:11.942441 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:11.942425 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 10 12:49:11.942666 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:11.942649 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-md5t9\"" Jun 10 12:49:11.955606 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:11.955586 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-c6474c966-n59xb"] Jun 10 12:49:12.073772 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:12.073740 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9tdp\" (UniqueName: \"kubernetes.io/projected/1aaff223-23da-49a4-8c15-838c6d3353fc-kube-api-access-f9tdp\") pod \"maas-controller-c6474c966-n59xb\" (UID: \"1aaff223-23da-49a4-8c15-838c6d3353fc\") " pod="opendatahub/maas-controller-c6474c966-n59xb" Jun 10 12:49:12.073902 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:12.073787 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1aaff223-23da-49a4-8c15-838c6d3353fc-webhook-cert\") pod \"maas-controller-c6474c966-n59xb\" (UID: \"1aaff223-23da-49a4-8c15-838c6d3353fc\") " pod="opendatahub/maas-controller-c6474c966-n59xb" Jun 10 12:49:12.144246 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:12.144219 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-f8c579895-5mkr8"] Jun 10 12:49:12.147353 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:12.147332 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f8c579895-5mkr8" Jun 10 12:49:12.162909 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:12.162887 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-f8c579895-5mkr8"] Jun 10 12:49:12.174208 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:12.174168 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9tdp\" (UniqueName: \"kubernetes.io/projected/1aaff223-23da-49a4-8c15-838c6d3353fc-kube-api-access-f9tdp\") pod \"maas-controller-c6474c966-n59xb\" (UID: \"1aaff223-23da-49a4-8c15-838c6d3353fc\") " pod="opendatahub/maas-controller-c6474c966-n59xb" Jun 10 12:49:12.174308 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:12.174249 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1aaff223-23da-49a4-8c15-838c6d3353fc-webhook-cert\") pod \"maas-controller-c6474c966-n59xb\" (UID: \"1aaff223-23da-49a4-8c15-838c6d3353fc\") " pod="opendatahub/maas-controller-c6474c966-n59xb" Jun 10 12:49:12.176981 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:12.176957 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1aaff223-23da-49a4-8c15-838c6d3353fc-webhook-cert\") pod \"maas-controller-c6474c966-n59xb\" (UID: \"1aaff223-23da-49a4-8c15-838c6d3353fc\") " pod="opendatahub/maas-controller-c6474c966-n59xb" Jun 10 12:49:12.182981 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:12.182961 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9tdp\" (UniqueName: \"kubernetes.io/projected/1aaff223-23da-49a4-8c15-838c6d3353fc-kube-api-access-f9tdp\") pod \"maas-controller-c6474c966-n59xb\" (UID: \"1aaff223-23da-49a4-8c15-838c6d3353fc\") " pod="opendatahub/maas-controller-c6474c966-n59xb" Jun 10 12:49:12.248260 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:12.248204 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c6474c966-n59xb" Jun 10 12:49:12.275374 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:12.275348 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dw7c\" (UniqueName: \"kubernetes.io/projected/cc8b0daa-8574-4ddf-8886-82bb945f4f39-kube-api-access-7dw7c\") pod \"maas-controller-f8c579895-5mkr8\" (UID: \"cc8b0daa-8574-4ddf-8886-82bb945f4f39\") " pod="opendatahub/maas-controller-f8c579895-5mkr8" Jun 10 12:49:12.275482 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:12.275463 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cc8b0daa-8574-4ddf-8886-82bb945f4f39-webhook-cert\") pod \"maas-controller-f8c579895-5mkr8\" (UID: \"cc8b0daa-8574-4ddf-8886-82bb945f4f39\") " pod="opendatahub/maas-controller-f8c579895-5mkr8" Jun 10 12:49:12.374775 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:12.374746 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-c6474c966-n59xb"] Jun 10 12:49:12.376867 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:12.376839 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dw7c\" (UniqueName: \"kubernetes.io/projected/cc8b0daa-8574-4ddf-8886-82bb945f4f39-kube-api-access-7dw7c\") pod \"maas-controller-f8c579895-5mkr8\" (UID: \"cc8b0daa-8574-4ddf-8886-82bb945f4f39\") " pod="opendatahub/maas-controller-f8c579895-5mkr8" Jun 10 12:49:12.376968 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:12.376947 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cc8b0daa-8574-4ddf-8886-82bb945f4f39-webhook-cert\") pod \"maas-controller-f8c579895-5mkr8\" (UID: \"cc8b0daa-8574-4ddf-8886-82bb945f4f39\") " pod="opendatahub/maas-controller-f8c579895-5mkr8" Jun 10 12:49:12.377464 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:49:12.377439 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1aaff223_23da_49a4_8c15_838c6d3353fc.slice/crio-36d37f37a58611b89555e663988efadf1bec8a4e71b0baf3dcd1966c589c915f WatchSource:0}: Error finding container 36d37f37a58611b89555e663988efadf1bec8a4e71b0baf3dcd1966c589c915f: Status 404 returned error can't find the container with id 36d37f37a58611b89555e663988efadf1bec8a4e71b0baf3dcd1966c589c915f Jun 10 12:49:12.379296 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:12.379274 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cc8b0daa-8574-4ddf-8886-82bb945f4f39-webhook-cert\") pod \"maas-controller-f8c579895-5mkr8\" (UID: \"cc8b0daa-8574-4ddf-8886-82bb945f4f39\") " pod="opendatahub/maas-controller-f8c579895-5mkr8" Jun 10 12:49:12.385361 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:12.385334 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dw7c\" (UniqueName: \"kubernetes.io/projected/cc8b0daa-8574-4ddf-8886-82bb945f4f39-kube-api-access-7dw7c\") pod \"maas-controller-f8c579895-5mkr8\" (UID: \"cc8b0daa-8574-4ddf-8886-82bb945f4f39\") " pod="opendatahub/maas-controller-f8c579895-5mkr8" Jun 10 12:49:12.457066 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:12.457045 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f8c579895-5mkr8" Jun 10 12:49:12.585039 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:12.585015 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-f8c579895-5mkr8"] Jun 10 12:49:12.586690 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:49:12.586659 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc8b0daa_8574_4ddf_8886_82bb945f4f39.slice/crio-f386f224c38fa14bbf278e7201ad12125afa7ea1c58e73cd6035506f725a9d89 WatchSource:0}: Error finding container f386f224c38fa14bbf278e7201ad12125afa7ea1c58e73cd6035506f725a9d89: Status 404 returned error can't find the container with id f386f224c38fa14bbf278e7201ad12125afa7ea1c58e73cd6035506f725a9d89 Jun 10 12:49:13.275370 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:13.275327 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f8c579895-5mkr8" event={"ID":"cc8b0daa-8574-4ddf-8886-82bb945f4f39","Type":"ContainerStarted","Data":"f386f224c38fa14bbf278e7201ad12125afa7ea1c58e73cd6035506f725a9d89"} Jun 10 12:49:13.277418 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:13.277342 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c6474c966-n59xb" event={"ID":"1aaff223-23da-49a4-8c15-838c6d3353fc","Type":"ContainerStarted","Data":"36d37f37a58611b89555e663988efadf1bec8a4e71b0baf3dcd1966c589c915f"} Jun 10 12:49:16.293249 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:16.293216 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f8c579895-5mkr8" event={"ID":"cc8b0daa-8574-4ddf-8886-82bb945f4f39","Type":"ContainerStarted","Data":"f93ec40e3b470ab0e5445eb9002e4b2f6175b76193493d4d3fe38a563c43b2f2"} Jun 10 12:49:16.293735 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:16.293495 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-f8c579895-5mkr8" Jun 10 12:49:16.294751 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:16.294721 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c6474c966-n59xb" event={"ID":"1aaff223-23da-49a4-8c15-838c6d3353fc","Type":"ContainerStarted","Data":"a45903ce51ae70d5eae39b68cf7d7b7b67db52266bf9ee9e52ec045c61b817ca"} Jun 10 12:49:16.294867 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:16.294845 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-c6474c966-n59xb" Jun 10 12:49:16.313961 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:16.313915 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-f8c579895-5mkr8" podStartSLOduration=1.6601176020000001 podStartE2EDuration="4.313900572s" totalImagesPullingTime="2.65378297s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:49:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:49:16.313342755 +0000 UTC m=+753.195946829" watchObservedRunningTime="2026-06-10 12:49:16.313900572 +0000 UTC m=+753.196504647" Jun 10 12:49:16.332073 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:16.332037 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-c6474c966-n59xb" podStartSLOduration=2.4742990750000002 podStartE2EDuration="5.332023848s" totalImagesPullingTime="2.857724773s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:49:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:49:16.331713284 +0000 UTC m=+753.214317387" watchObservedRunningTime="2026-06-10 12:49:16.332023848 +0000 UTC m=+753.214627923" Jun 10 12:49:27.306003 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:27.305967 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-f8c579895-5mkr8" Jun 10 12:49:27.306508 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:27.306170 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-c6474c966-n59xb" Jun 10 12:49:27.383478 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:27.383441 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-c6474c966-n59xb"] Jun 10 12:49:27.383669 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:27.383643 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-c6474c966-n59xb" podUID="1aaff223-23da-49a4-8c15-838c6d3353fc" containerName="manager" containerID="cri-o://a45903ce51ae70d5eae39b68cf7d7b7b67db52266bf9ee9e52ec045c61b817ca" gracePeriod=30 Jun 10 12:49:27.617316 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:27.617295 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c6474c966-n59xb" Jun 10 12:49:27.796314 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:27.796279 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f9tdp\" (UniqueName: \"kubernetes.io/projected/1aaff223-23da-49a4-8c15-838c6d3353fc-kube-api-access-f9tdp\") pod \"1aaff223-23da-49a4-8c15-838c6d3353fc\" (UID: \"1aaff223-23da-49a4-8c15-838c6d3353fc\") " Jun 10 12:49:27.796497 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:27.796379 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1aaff223-23da-49a4-8c15-838c6d3353fc-webhook-cert\") pod \"1aaff223-23da-49a4-8c15-838c6d3353fc\" (UID: \"1aaff223-23da-49a4-8c15-838c6d3353fc\") " Jun 10 12:49:27.798446 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:27.798414 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1aaff223-23da-49a4-8c15-838c6d3353fc-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "1aaff223-23da-49a4-8c15-838c6d3353fc" (UID: "1aaff223-23da-49a4-8c15-838c6d3353fc"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 12:49:27.798557 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:27.798494 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1aaff223-23da-49a4-8c15-838c6d3353fc-kube-api-access-f9tdp" (OuterVolumeSpecName: "kube-api-access-f9tdp") pod "1aaff223-23da-49a4-8c15-838c6d3353fc" (UID: "1aaff223-23da-49a4-8c15-838c6d3353fc"). InnerVolumeSpecName "kube-api-access-f9tdp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 12:49:27.897339 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:27.897256 2557 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1aaff223-23da-49a4-8c15-838c6d3353fc-webhook-cert\") on node \"ip-10-0-133-72.ec2.internal\" DevicePath \"\"" Jun 10 12:49:27.897339 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:27.897287 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f9tdp\" (UniqueName: \"kubernetes.io/projected/1aaff223-23da-49a4-8c15-838c6d3353fc-kube-api-access-f9tdp\") on node \"ip-10-0-133-72.ec2.internal\" DevicePath \"\"" Jun 10 12:49:28.346598 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:28.346566 2557 generic.go:356] "Generic (PLEG): container finished" podID="1aaff223-23da-49a4-8c15-838c6d3353fc" containerID="a45903ce51ae70d5eae39b68cf7d7b7b67db52266bf9ee9e52ec045c61b817ca" exitCode=0 Jun 10 12:49:28.347090 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:28.346610 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c6474c966-n59xb" event={"ID":"1aaff223-23da-49a4-8c15-838c6d3353fc","Type":"ContainerDied","Data":"a45903ce51ae70d5eae39b68cf7d7b7b67db52266bf9ee9e52ec045c61b817ca"} Jun 10 12:49:28.347090 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:28.346622 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c6474c966-n59xb" Jun 10 12:49:28.347090 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:28.346652 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c6474c966-n59xb" event={"ID":"1aaff223-23da-49a4-8c15-838c6d3353fc","Type":"ContainerDied","Data":"36d37f37a58611b89555e663988efadf1bec8a4e71b0baf3dcd1966c589c915f"} Jun 10 12:49:28.347090 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:28.346673 2557 scope.go:117] "RemoveContainer" containerID="a45903ce51ae70d5eae39b68cf7d7b7b67db52266bf9ee9e52ec045c61b817ca" Jun 10 12:49:28.355578 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:28.355560 2557 scope.go:117] "RemoveContainer" containerID="a45903ce51ae70d5eae39b68cf7d7b7b67db52266bf9ee9e52ec045c61b817ca" Jun 10 12:49:28.355793 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:49:28.355774 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a45903ce51ae70d5eae39b68cf7d7b7b67db52266bf9ee9e52ec045c61b817ca\": container with ID starting with a45903ce51ae70d5eae39b68cf7d7b7b67db52266bf9ee9e52ec045c61b817ca not found: ID does not exist" containerID="a45903ce51ae70d5eae39b68cf7d7b7b67db52266bf9ee9e52ec045c61b817ca" Jun 10 12:49:28.355859 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:28.355806 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a45903ce51ae70d5eae39b68cf7d7b7b67db52266bf9ee9e52ec045c61b817ca"} err="failed to get container status \"a45903ce51ae70d5eae39b68cf7d7b7b67db52266bf9ee9e52ec045c61b817ca\": rpc error: code = NotFound desc = could not find container \"a45903ce51ae70d5eae39b68cf7d7b7b67db52266bf9ee9e52ec045c61b817ca\": container with ID starting with a45903ce51ae70d5eae39b68cf7d7b7b67db52266bf9ee9e52ec045c61b817ca not found: ID does not exist" Jun 10 12:49:28.370274 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:28.370243 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-c6474c966-n59xb"] Jun 10 12:49:28.374430 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:28.374409 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-c6474c966-n59xb"] Jun 10 12:49:29.541867 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:29.541832 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1aaff223-23da-49a4-8c15-838c6d3353fc" path="/var/lib/kubelet/pods/1aaff223-23da-49a4-8c15-838c6d3353fc/volumes" Jun 10 12:49:45.761662 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:45.761628 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["redhat-ai-gateway-infra/maas-api-7d567bbfcc-lgz5s"] Jun 10 12:49:45.762008 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:45.761926 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1aaff223-23da-49a4-8c15-838c6d3353fc" containerName="manager" Jun 10 12:49:45.762008 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:45.761937 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="1aaff223-23da-49a4-8c15-838c6d3353fc" containerName="manager" Jun 10 12:49:45.762008 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:45.761988 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="1aaff223-23da-49a4-8c15-838c6d3353fc" containerName="manager" Jun 10 12:49:45.766234 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:45.766213 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-7d567bbfcc-lgz5s" Jun 10 12:49:45.771344 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:45.771326 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"maas-api-serving-cert\"" Jun 10 12:49:45.771451 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:45.771336 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"maas-api-dockercfg-b9sbg\"" Jun 10 12:49:45.777676 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:45.777653 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-7d567bbfcc-lgz5s"] Jun 10 12:49:45.829387 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:45.829355 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d15b2ad-b8c4-44a1-a08c-191eca06340f-maas-api-tls\") pod \"maas-api-7d567bbfcc-lgz5s\" (UID: \"4d15b2ad-b8c4-44a1-a08c-191eca06340f\") " pod="redhat-ai-gateway-infra/maas-api-7d567bbfcc-lgz5s" Jun 10 12:49:45.829504 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:45.829438 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjgdf\" (UniqueName: \"kubernetes.io/projected/4d15b2ad-b8c4-44a1-a08c-191eca06340f-kube-api-access-hjgdf\") pod \"maas-api-7d567bbfcc-lgz5s\" (UID: \"4d15b2ad-b8c4-44a1-a08c-191eca06340f\") " pod="redhat-ai-gateway-infra/maas-api-7d567bbfcc-lgz5s" Jun 10 12:49:45.930402 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:45.930371 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d15b2ad-b8c4-44a1-a08c-191eca06340f-maas-api-tls\") pod \"maas-api-7d567bbfcc-lgz5s\" (UID: \"4d15b2ad-b8c4-44a1-a08c-191eca06340f\") " pod="redhat-ai-gateway-infra/maas-api-7d567bbfcc-lgz5s" Jun 10 12:49:45.930542 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:45.930440 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjgdf\" (UniqueName: \"kubernetes.io/projected/4d15b2ad-b8c4-44a1-a08c-191eca06340f-kube-api-access-hjgdf\") pod \"maas-api-7d567bbfcc-lgz5s\" (UID: \"4d15b2ad-b8c4-44a1-a08c-191eca06340f\") " pod="redhat-ai-gateway-infra/maas-api-7d567bbfcc-lgz5s" Jun 10 12:49:45.932803 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:45.932774 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d15b2ad-b8c4-44a1-a08c-191eca06340f-maas-api-tls\") pod \"maas-api-7d567bbfcc-lgz5s\" (UID: \"4d15b2ad-b8c4-44a1-a08c-191eca06340f\") " pod="redhat-ai-gateway-infra/maas-api-7d567bbfcc-lgz5s" Jun 10 12:49:45.939598 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:45.939569 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjgdf\" (UniqueName: \"kubernetes.io/projected/4d15b2ad-b8c4-44a1-a08c-191eca06340f-kube-api-access-hjgdf\") pod \"maas-api-7d567bbfcc-lgz5s\" (UID: \"4d15b2ad-b8c4-44a1-a08c-191eca06340f\") " pod="redhat-ai-gateway-infra/maas-api-7d567bbfcc-lgz5s" Jun 10 12:49:46.076061 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:46.076041 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-7d567bbfcc-lgz5s" Jun 10 12:49:46.233769 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:46.233596 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-7d567bbfcc-lgz5s"] Jun 10 12:49:46.236722 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:49:46.236692 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d15b2ad_b8c4_44a1_a08c_191eca06340f.slice/crio-b12527c8fe46c12ab8b19114cdec10219c46f8ad0eb1b8fc27be5f33932aa5c8 WatchSource:0}: Error finding container b12527c8fe46c12ab8b19114cdec10219c46f8ad0eb1b8fc27be5f33932aa5c8: Status 404 returned error can't find the container with id b12527c8fe46c12ab8b19114cdec10219c46f8ad0eb1b8fc27be5f33932aa5c8 Jun 10 12:49:46.390215 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:46.390122 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-2mm42"] Jun 10 12:49:46.420910 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:46.420539 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-2mm42"] Jun 10 12:49:46.420910 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:46.420689 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-2mm42" Jun 10 12:49:46.423764 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:46.423745 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-vtnkk\"" Jun 10 12:49:46.423910 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:46.423889 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 10 12:49:46.432023 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:46.431997 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-7d567bbfcc-lgz5s" event={"ID":"4d15b2ad-b8c4-44a1-a08c-191eca06340f","Type":"ContainerStarted","Data":"b12527c8fe46c12ab8b19114cdec10219c46f8ad0eb1b8fc27be5f33932aa5c8"} Jun 10 12:49:46.535332 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:46.535293 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9z2wp\" (UniqueName: \"kubernetes.io/projected/d0033ace-4459-4996-88d9-e181b05736de-kube-api-access-9z2wp\") pod \"payload-pre-processing-579785bc64-2mm42\" (UID: \"d0033ace-4459-4996-88d9-e181b05736de\") " pod="openshift-ingress/payload-pre-processing-579785bc64-2mm42" Jun 10 12:49:46.636622 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:46.636587 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9z2wp\" (UniqueName: \"kubernetes.io/projected/d0033ace-4459-4996-88d9-e181b05736de-kube-api-access-9z2wp\") pod \"payload-pre-processing-579785bc64-2mm42\" (UID: \"d0033ace-4459-4996-88d9-e181b05736de\") " pod="openshift-ingress/payload-pre-processing-579785bc64-2mm42" Jun 10 12:49:46.645305 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:46.645244 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9z2wp\" (UniqueName: \"kubernetes.io/projected/d0033ace-4459-4996-88d9-e181b05736de-kube-api-access-9z2wp\") pod \"payload-pre-processing-579785bc64-2mm42\" (UID: \"d0033ace-4459-4996-88d9-e181b05736de\") " pod="openshift-ingress/payload-pre-processing-579785bc64-2mm42" Jun 10 12:49:46.732443 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:46.732415 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-2mm42" Jun 10 12:49:46.892492 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:46.892405 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-2mm42"] Jun 10 12:49:46.902718 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:49:46.902675 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0033ace_4459_4996_88d9_e181b05736de.slice/crio-179973dfc2179aa493b43ec963f9bd55e4ffd63f1144d6b387388782752a08aa WatchSource:0}: Error finding container 179973dfc2179aa493b43ec963f9bd55e4ffd63f1144d6b387388782752a08aa: Status 404 returned error can't find the container with id 179973dfc2179aa493b43ec963f9bd55e4ffd63f1144d6b387388782752a08aa Jun 10 12:49:47.439516 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:47.439477 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-2mm42" event={"ID":"d0033ace-4459-4996-88d9-e181b05736de","Type":"ContainerStarted","Data":"179973dfc2179aa493b43ec963f9bd55e4ffd63f1144d6b387388782752a08aa"} Jun 10 12:49:48.446209 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:48.446153 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-7d567bbfcc-lgz5s" event={"ID":"4d15b2ad-b8c4-44a1-a08c-191eca06340f","Type":"ContainerStarted","Data":"c84af3aa719dd817fff9b79c3cbcb505f551aa05442df029fdde0447f9eaf5ab"} Jun 10 12:49:48.446661 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:48.446314 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ai-gateway-infra/maas-api-7d567bbfcc-lgz5s" Jun 10 12:49:48.466333 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:48.466251 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="redhat-ai-gateway-infra/maas-api-7d567bbfcc-lgz5s" podStartSLOduration=1.493250454 podStartE2EDuration="3.466233255s" totalImagesPullingTime="1.972982801s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:49:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:49:48.464677655 +0000 UTC m=+785.347281765" watchObservedRunningTime="2026-06-10 12:49:48.466233255 +0000 UTC m=+785.348837331" Jun 10 12:49:50.458732 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:50.458699 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-2mm42" event={"ID":"d0033ace-4459-4996-88d9-e181b05736de","Type":"ContainerStarted","Data":"b0fc8615c55d99af933fc4773a99476f7f09a24000fb7891c9e057ad183e0d17"} Jun 10 12:49:50.459104 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:50.458833 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-579785bc64-2mm42" Jun 10 12:49:50.477826 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:50.477783 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-579785bc64-2mm42" podStartSLOduration=1.598719193 podStartE2EDuration="4.477769255s" totalImagesPullingTime="2.879050062s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:49:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:49:50.476283498 +0000 UTC m=+787.358887585" watchObservedRunningTime="2026-06-10 12:49:50.477769255 +0000 UTC m=+787.360373329" Jun 10 12:49:54.460046 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:54.460010 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ai-gateway-infra/maas-api-7d567bbfcc-lgz5s" Jun 10 12:49:54.477754 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:54.477726 2557 generic.go:356] "Generic (PLEG): container finished" podID="417bf846-d5a5-4acc-a10f-901fa12dbdbf" containerID="158ec57479fc1b07618704f8bfb9c6a39d4827fe3fd41bf6a48cb4ba998262de" exitCode=0 Jun 10 12:49:54.477914 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:54.477763 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-djdfb" event={"ID":"417bf846-d5a5-4acc-a10f-901fa12dbdbf","Type":"ContainerDied","Data":"158ec57479fc1b07618704f8bfb9c6a39d4827fe3fd41bf6a48cb4ba998262de"} Jun 10 12:49:54.478137 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:54.478121 2557 scope.go:117] "RemoveContainer" containerID="158ec57479fc1b07618704f8bfb9c6a39d4827fe3fd41bf6a48cb4ba998262de" Jun 10 12:49:54.479386 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:54.479351 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jun 10 12:49:54.479513 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:54.479432 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jun 10 12:49:54.479513 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:54.479490 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236236Ki","pods":"250"} Jun 10 12:49:55.483532 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:55.483495 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-djdfb" event={"ID":"417bf846-d5a5-4acc-a10f-901fa12dbdbf","Type":"ContainerStarted","Data":"0df0dcb6254dd33cf4bfb98b8e012b0a0d90c75500d3062bbb190bc0da5345bd"} Jun 10 12:49:56.161797 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:56.161764 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-djdfb" Jun 10 12:49:56.161992 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:56.161950 2557 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-djdfb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.23:15021/healthz/ready\": dial tcp 10.132.0.23:15021: connect: connection refused" start-of-body= Jun 10 12:49:56.162074 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:56.162007 2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-djdfb" podUID="417bf846-d5a5-4acc-a10f-901fa12dbdbf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.23:15021/healthz/ready\": dial tcp 10.132.0.23:15021: connect: connection refused" Jun 10 12:49:56.252874 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:56.252841 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 12:49:56.253093 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:56.253067 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="a4a97bf6-5e12-4e0f-8925-c78a3862e578" containerName="keycloak" containerID="cri-o://3d39c366bcfd9fcafb8cb9754af3df13bded7c72910d7fa5ee4fe30dcc5127a8" gracePeriod=30 Jun 10 12:49:57.162133 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:57.162096 2557 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-djdfb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.23:15021/healthz/ready\": dial tcp 10.132.0.23:15021: connect: connection refused" start-of-body= Jun 10 12:49:57.162520 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:57.162152 2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-djdfb" podUID="417bf846-d5a5-4acc-a10f-901fa12dbdbf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.23:15021/healthz/ready\": dial tcp 10.132.0.23:15021: connect: connection refused" Jun 10 12:49:57.942989 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:57.942963 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 12:49:58.033747 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:58.033718 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h8x7l\" (UniqueName: \"kubernetes.io/projected/a4a97bf6-5e12-4e0f-8925-c78a3862e578-kube-api-access-h8x7l\") pod \"a4a97bf6-5e12-4e0f-8925-c78a3862e578\" (UID: \"a4a97bf6-5e12-4e0f-8925-c78a3862e578\") " Jun 10 12:49:58.035929 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:58.035895 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4a97bf6-5e12-4e0f-8925-c78a3862e578-kube-api-access-h8x7l" (OuterVolumeSpecName: "kube-api-access-h8x7l") pod "a4a97bf6-5e12-4e0f-8925-c78a3862e578" (UID: "a4a97bf6-5e12-4e0f-8925-c78a3862e578"). InnerVolumeSpecName "kube-api-access-h8x7l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 12:49:58.134955 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:58.134921 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h8x7l\" (UniqueName: \"kubernetes.io/projected/a4a97bf6-5e12-4e0f-8925-c78a3862e578-kube-api-access-h8x7l\") on node \"ip-10-0-133-72.ec2.internal\" DevicePath \"\"" Jun 10 12:49:58.161673 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:58.161643 2557 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-djdfb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.23:15021/healthz/ready\": dial tcp 10.132.0.23:15021: connect: connection refused" start-of-body= Jun 10 12:49:58.161807 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:58.161695 2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-djdfb" podUID="417bf846-d5a5-4acc-a10f-901fa12dbdbf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.23:15021/healthz/ready\": dial tcp 10.132.0.23:15021: connect: connection refused" Jun 10 12:49:58.499384 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:58.499288 2557 generic.go:356] "Generic (PLEG): container finished" podID="a4a97bf6-5e12-4e0f-8925-c78a3862e578" containerID="3d39c366bcfd9fcafb8cb9754af3df13bded7c72910d7fa5ee4fe30dcc5127a8" exitCode=143 Jun 10 12:49:58.499384 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:58.499370 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"a4a97bf6-5e12-4e0f-8925-c78a3862e578","Type":"ContainerDied","Data":"3d39c366bcfd9fcafb8cb9754af3df13bded7c72910d7fa5ee4fe30dcc5127a8"} Jun 10 12:49:58.499889 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:58.499416 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"a4a97bf6-5e12-4e0f-8925-c78a3862e578","Type":"ContainerDied","Data":"9da492677e2ee8f182b8d1e80752a584dbf333d45cca9e8866067de0571507f9"} Jun 10 12:49:58.499889 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:58.499444 2557 scope.go:117] "RemoveContainer" containerID="3d39c366bcfd9fcafb8cb9754af3df13bded7c72910d7fa5ee4fe30dcc5127a8" Jun 10 12:49:58.499889 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:58.499605 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 12:49:58.525943 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:58.525892 2557 scope.go:117] "RemoveContainer" containerID="3d39c366bcfd9fcafb8cb9754af3df13bded7c72910d7fa5ee4fe30dcc5127a8" Jun 10 12:49:58.526230 ip-10-0-133-72 kubenswrapper[2557]: E0610 12:49:58.526206 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d39c366bcfd9fcafb8cb9754af3df13bded7c72910d7fa5ee4fe30dcc5127a8\": container with ID starting with 3d39c366bcfd9fcafb8cb9754af3df13bded7c72910d7fa5ee4fe30dcc5127a8 not found: ID does not exist" containerID="3d39c366bcfd9fcafb8cb9754af3df13bded7c72910d7fa5ee4fe30dcc5127a8" Jun 10 12:49:58.526309 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:58.526237 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d39c366bcfd9fcafb8cb9754af3df13bded7c72910d7fa5ee4fe30dcc5127a8"} err="failed to get container status \"3d39c366bcfd9fcafb8cb9754af3df13bded7c72910d7fa5ee4fe30dcc5127a8\": rpc error: code = NotFound desc = could not find container \"3d39c366bcfd9fcafb8cb9754af3df13bded7c72910d7fa5ee4fe30dcc5127a8\": container with ID starting with 3d39c366bcfd9fcafb8cb9754af3df13bded7c72910d7fa5ee4fe30dcc5127a8 not found: ID does not exist" Jun 10 12:49:58.541993 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:58.541972 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 12:49:58.547531 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:58.547512 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 12:49:58.578733 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:58.578713 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 12:49:58.579039 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:58.579028 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4a97bf6-5e12-4e0f-8925-c78a3862e578" containerName="keycloak" Jun 10 12:49:58.579082 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:58.579041 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4a97bf6-5e12-4e0f-8925-c78a3862e578" containerName="keycloak" Jun 10 12:49:58.579116 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:58.579109 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4a97bf6-5e12-4e0f-8925-c78a3862e578" containerName="keycloak" Jun 10 12:49:58.581472 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:58.581456 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 12:49:58.584402 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:58.584381 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 10 12:49:58.584487 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:58.584441 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 10 12:49:58.584544 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:58.584445 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 10 12:49:58.584544 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:58.584495 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-dgfzz\"" Jun 10 12:49:58.584858 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:58.584845 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 10 12:49:58.591840 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:58.591820 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 12:49:58.639277 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:58.639251 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/07a686ef-6068-41e5-be27-a259de16ee8d-test-realms\") pod \"maas-keycloak-0\" (UID: \"07a686ef-6068-41e5-be27-a259de16ee8d\") " pod="keycloak-system/maas-keycloak-0" Jun 10 12:49:58.639437 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:58.639416 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7q7t\" (UniqueName: \"kubernetes.io/projected/07a686ef-6068-41e5-be27-a259de16ee8d-kube-api-access-h7q7t\") pod \"maas-keycloak-0\" (UID: \"07a686ef-6068-41e5-be27-a259de16ee8d\") " pod="keycloak-system/maas-keycloak-0" Jun 10 12:49:58.740040 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:58.740012 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7q7t\" (UniqueName: \"kubernetes.io/projected/07a686ef-6068-41e5-be27-a259de16ee8d-kube-api-access-h7q7t\") pod \"maas-keycloak-0\" (UID: \"07a686ef-6068-41e5-be27-a259de16ee8d\") " pod="keycloak-system/maas-keycloak-0" Jun 10 12:49:58.740164 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:58.740043 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/07a686ef-6068-41e5-be27-a259de16ee8d-test-realms\") pod \"maas-keycloak-0\" (UID: \"07a686ef-6068-41e5-be27-a259de16ee8d\") " pod="keycloak-system/maas-keycloak-0" Jun 10 12:49:58.740739 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:58.740721 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/07a686ef-6068-41e5-be27-a259de16ee8d-test-realms\") pod \"maas-keycloak-0\" (UID: \"07a686ef-6068-41e5-be27-a259de16ee8d\") " pod="keycloak-system/maas-keycloak-0" Jun 10 12:49:58.748785 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:58.748762 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7q7t\" (UniqueName: \"kubernetes.io/projected/07a686ef-6068-41e5-be27-a259de16ee8d-kube-api-access-h7q7t\") pod \"maas-keycloak-0\" (UID: \"07a686ef-6068-41e5-be27-a259de16ee8d\") " pod="keycloak-system/maas-keycloak-0" Jun 10 12:49:58.890908 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:58.890885 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 12:49:59.071818 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:59.071795 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 12:49:59.074385 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:49:59.074356 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07a686ef_6068_41e5_be27_a259de16ee8d.slice/crio-fa152d3f776e5ff8cf039ddf1d85469c13f071b8a8784b10e6fa537e3e029ce2 WatchSource:0}: Error finding container fa152d3f776e5ff8cf039ddf1d85469c13f071b8a8784b10e6fa537e3e029ce2: Status 404 returned error can't find the container with id fa152d3f776e5ff8cf039ddf1d85469c13f071b8a8784b10e6fa537e3e029ce2 Jun 10 12:49:59.162030 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:59.161953 2557 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-djdfb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.23:15021/healthz/ready\": dial tcp 10.132.0.23:15021: connect: connection refused" start-of-body= Jun 10 12:49:59.162030 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:59.162007 2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-djdfb" podUID="417bf846-d5a5-4acc-a10f-901fa12dbdbf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.23:15021/healthz/ready\": dial tcp 10.132.0.23:15021: connect: connection refused" Jun 10 12:49:59.511679 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:59.511599 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"07a686ef-6068-41e5-be27-a259de16ee8d","Type":"ContainerStarted","Data":"fa152d3f776e5ff8cf039ddf1d85469c13f071b8a8784b10e6fa537e3e029ce2"} Jun 10 12:49:59.541714 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:49:59.541685 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4a97bf6-5e12-4e0f-8925-c78a3862e578" path="/var/lib/kubelet/pods/a4a97bf6-5e12-4e0f-8925-c78a3862e578/volumes" Jun 10 12:50:00.165201 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:50:00.165155 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-djdfb" Jun 10 12:50:00.165607 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:50:00.165589 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-djdfb" Jun 10 12:50:00.166392 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:50:00.166373 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-djdfb" Jun 10 12:50:00.523500 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:50:00.523312 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"07a686ef-6068-41e5-be27-a259de16ee8d","Type":"ContainerStarted","Data":"791cf7dcb0f674dd010170719b03ef3e9d4b61617adda71d3b5d24c0a0e588d8"} Jun 10 12:50:00.546518 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:50:00.546451 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=2.110142657 podStartE2EDuration="2.546430369s" totalImagesPullingTime="436.287712ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:49:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:50:00.545282152 +0000 UTC m=+797.427886228" watchObservedRunningTime="2026-06-10 12:50:00.546430369 +0000 UTC m=+797.429034445" Jun 10 12:50:00.891922 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:50:00.891745 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 10 12:50:00.893290 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:50:00.893247 2557 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="07a686ef-6068-41e5-be27-a259de16ee8d" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.32:9000/health/started\": dial tcp 10.132.0.32:9000: connect: connection refused" Jun 10 12:50:01.465438 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:50:01.465380 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-579785bc64-2mm42" podUID="d0033ace-4459-4996-88d9-e181b05736de" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.132.0.31:9004: connect: connection refused" Jun 10 12:50:01.891453 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:50:01.891408 2557 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="07a686ef-6068-41e5-be27-a259de16ee8d" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.32:9000/health/started\": dial tcp 10.132.0.32:9000: connect: connection refused" Jun 10 12:50:02.892058 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:50:02.892012 2557 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="07a686ef-6068-41e5-be27-a259de16ee8d" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.32:9000/health/started\": dial tcp 10.132.0.32:9000: connect: connection refused" Jun 10 12:50:03.891826 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:50:03.891770 2557 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="07a686ef-6068-41e5-be27-a259de16ee8d" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.32:9000/health/started\": dial tcp 10.132.0.32:9000: connect: connection refused" Jun 10 12:50:04.891564 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:50:04.891460 2557 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="07a686ef-6068-41e5-be27-a259de16ee8d" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.32:9000/health/started\": dial tcp 10.132.0.32:9000: connect: connection refused" Jun 10 12:50:05.892375 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:50:05.892322 2557 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="07a686ef-6068-41e5-be27-a259de16ee8d" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.32:9000/health/started\": dial tcp 10.132.0.32:9000: connect: connection refused" Jun 10 12:50:06.892300 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:50:06.892230 2557 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="07a686ef-6068-41e5-be27-a259de16ee8d" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.32:9000/health/started\": dial tcp 10.132.0.32:9000: connect: connection refused" Jun 10 12:50:07.891434 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:50:07.891387 2557 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="07a686ef-6068-41e5-be27-a259de16ee8d" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.32:9000/health/started\": dial tcp 10.132.0.32:9000: connect: connection refused" Jun 10 12:50:08.891890 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:50:08.891848 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 10 12:50:08.892425 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:50:08.892196 2557 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="07a686ef-6068-41e5-be27-a259de16ee8d" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.32:9000/health/started\": dial tcp 10.132.0.32:9000: connect: connection refused" Jun 10 12:50:09.891398 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:50:09.891331 2557 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="07a686ef-6068-41e5-be27-a259de16ee8d" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.32:9000/health/started\": dial tcp 10.132.0.32:9000: connect: connection refused" Jun 10 12:50:10.892044 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:50:10.892002 2557 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="07a686ef-6068-41e5-be27-a259de16ee8d" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.32:9000/health/started\": dial tcp 10.132.0.32:9000: connect: connection refused" Jun 10 12:50:11.464284 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:50:11.464251 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-579785bc64-2mm42" Jun 10 12:50:11.892191 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:50:11.892146 2557 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="07a686ef-6068-41e5-be27-a259de16ee8d" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.32:9000/health/started\": dial tcp 10.132.0.32:9000: connect: connection refused" Jun 10 12:50:13.015622 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:50:13.015586 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 10 12:50:13.034367 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:50:13.034308 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="07a686ef-6068-41e5-be27-a259de16ee8d" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 12:50:23.022338 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:50:23.022305 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 10 12:50:35.485320 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:50:35.485286 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7ff576ddbd-zzssv"] Jun 10 12:50:35.485774 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:50:35.485460 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-7ff576ddbd-zzssv" podUID="3c4b7910-e873-4d0b-9135-b4f855fbbf9d" containerName="authorino" containerID="cri-o://f3c29aeb574630b763d591c85dadc86fd5d80798773927353285142292e5bafe" gracePeriod=30 Jun 10 12:50:35.703409 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:50:35.703375 2557 generic.go:356] "Generic (PLEG): container finished" podID="3c4b7910-e873-4d0b-9135-b4f855fbbf9d" containerID="f3c29aeb574630b763d591c85dadc86fd5d80798773927353285142292e5bafe" exitCode=0 Jun 10 12:50:35.703552 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:50:35.703444 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7ff576ddbd-zzssv" event={"ID":"3c4b7910-e873-4d0b-9135-b4f855fbbf9d","Type":"ContainerDied","Data":"f3c29aeb574630b763d591c85dadc86fd5d80798773927353285142292e5bafe"} Jun 10 12:50:35.738301 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:50:35.738250 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7ff576ddbd-zzssv" Jun 10 12:50:35.792028 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:50:35.792000 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3c4b7910-e873-4d0b-9135-b4f855fbbf9d-tls-cert\") pod \"3c4b7910-e873-4d0b-9135-b4f855fbbf9d\" (UID: \"3c4b7910-e873-4d0b-9135-b4f855fbbf9d\") " Jun 10 12:50:35.792151 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:50:35.792059 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j7qp7\" (UniqueName: \"kubernetes.io/projected/3c4b7910-e873-4d0b-9135-b4f855fbbf9d-kube-api-access-j7qp7\") pod \"3c4b7910-e873-4d0b-9135-b4f855fbbf9d\" (UID: \"3c4b7910-e873-4d0b-9135-b4f855fbbf9d\") " Jun 10 12:50:35.793961 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:50:35.793939 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c4b7910-e873-4d0b-9135-b4f855fbbf9d-kube-api-access-j7qp7" (OuterVolumeSpecName: "kube-api-access-j7qp7") pod "3c4b7910-e873-4d0b-9135-b4f855fbbf9d" (UID: "3c4b7910-e873-4d0b-9135-b4f855fbbf9d"). InnerVolumeSpecName "kube-api-access-j7qp7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 12:50:35.802785 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:50:35.802764 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c4b7910-e873-4d0b-9135-b4f855fbbf9d-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "3c4b7910-e873-4d0b-9135-b4f855fbbf9d" (UID: "3c4b7910-e873-4d0b-9135-b4f855fbbf9d"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 12:50:35.892520 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:50:35.892497 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j7qp7\" (UniqueName: \"kubernetes.io/projected/3c4b7910-e873-4d0b-9135-b4f855fbbf9d-kube-api-access-j7qp7\") on node \"ip-10-0-133-72.ec2.internal\" DevicePath \"\"" Jun 10 12:50:35.892606 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:50:35.892521 2557 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3c4b7910-e873-4d0b-9135-b4f855fbbf9d-tls-cert\") on node \"ip-10-0-133-72.ec2.internal\" DevicePath \"\"" Jun 10 12:50:36.709142 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:50:36.709113 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7ff576ddbd-zzssv" Jun 10 12:50:36.709527 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:50:36.709156 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7ff576ddbd-zzssv" event={"ID":"3c4b7910-e873-4d0b-9135-b4f855fbbf9d","Type":"ContainerDied","Data":"36c7ea435632aa2775047bc537ffc2bb5cdff1cc7eafb2f76c7bfab61a270aeb"} Jun 10 12:50:36.709527 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:50:36.709234 2557 scope.go:117] "RemoveContainer" containerID="f3c29aeb574630b763d591c85dadc86fd5d80798773927353285142292e5bafe" Jun 10 12:50:36.741446 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:50:36.741422 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7ff576ddbd-zzssv"] Jun 10 12:50:36.743998 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:50:36.743971 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7ff576ddbd-zzssv"] Jun 10 12:50:37.542028 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:50:37.541991 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c4b7910-e873-4d0b-9135-b4f855fbbf9d" path="/var/lib/kubelet/pods/3c4b7910-e873-4d0b-9135-b4f855fbbf9d/volumes" Jun 10 12:50:48.747003 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:50:48.746969 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-gvb4v"] Jun 10 12:50:48.747371 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:50:48.747318 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c4b7910-e873-4d0b-9135-b4f855fbbf9d" containerName="authorino" Jun 10 12:50:48.747371 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:50:48.747330 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c4b7910-e873-4d0b-9135-b4f855fbbf9d" containerName="authorino" Jun 10 12:50:48.747452 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:50:48.747382 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c4b7910-e873-4d0b-9135-b4f855fbbf9d" containerName="authorino" Jun 10 12:50:48.752007 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:50:48.751987 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-gvb4v" Jun 10 12:50:48.755808 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:50:48.755778 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-nn99j\"" Jun 10 12:50:48.755941 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:50:48.755882 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 10 12:50:48.756900 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:50:48.756878 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 10 12:50:48.757045 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:50:48.756882 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 10 12:50:48.767245 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:50:48.767226 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-gvb4v"] Jun 10 12:50:48.790889 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:50:48.790864 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6cn5r\" (UniqueName: \"kubernetes.io/projected/a7b3ab02-eb5f-4098-a18f-253cc3599c4e-kube-api-access-6cn5r\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-gvb4v\" (UID: \"a7b3ab02-eb5f-4098-a18f-253cc3599c4e\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-gvb4v" Jun 10 12:50:48.790983 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:50:48.790896 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a7b3ab02-eb5f-4098-a18f-253cc3599c4e-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-gvb4v\" (UID: \"a7b3ab02-eb5f-4098-a18f-253cc3599c4e\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-gvb4v" Jun 10 12:50:48.790983 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:50:48.790970 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a7b3ab02-eb5f-4098-a18f-253cc3599c4e-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-gvb4v\" (UID: \"a7b3ab02-eb5f-4098-a18f-253cc3599c4e\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-gvb4v" Jun 10 12:50:48.791064 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:50:48.791017 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a7b3ab02-eb5f-4098-a18f-253cc3599c4e-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-gvb4v\" (UID: \"a7b3ab02-eb5f-4098-a18f-253cc3599c4e\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-gvb4v" Jun 10 12:50:48.791064 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:50:48.791042 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a7b3ab02-eb5f-4098-a18f-253cc3599c4e-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-gvb4v\" (UID: \"a7b3ab02-eb5f-4098-a18f-253cc3599c4e\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-gvb4v" Jun 10 12:50:48.791064 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:50:48.791060 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a7b3ab02-eb5f-4098-a18f-253cc3599c4e-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-gvb4v\" (UID: \"a7b3ab02-eb5f-4098-a18f-253cc3599c4e\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-gvb4v" Jun 10 12:50:48.891867 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:50:48.891824 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cn5r\" (UniqueName: \"kubernetes.io/projected/a7b3ab02-eb5f-4098-a18f-253cc3599c4e-kube-api-access-6cn5r\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-gvb4v\" (UID: \"a7b3ab02-eb5f-4098-a18f-253cc3599c4e\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-gvb4v" Jun 10 12:50:48.892046 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:50:48.891877 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a7b3ab02-eb5f-4098-a18f-253cc3599c4e-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-gvb4v\" (UID: \"a7b3ab02-eb5f-4098-a18f-253cc3599c4e\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-gvb4v" Jun 10 12:50:48.892046 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:50:48.891939 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a7b3ab02-eb5f-4098-a18f-253cc3599c4e-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-gvb4v\" (UID: \"a7b3ab02-eb5f-4098-a18f-253cc3599c4e\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-gvb4v" Jun 10 12:50:48.892046 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:50:48.891966 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a7b3ab02-eb5f-4098-a18f-253cc3599c4e-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-gvb4v\" (UID: \"a7b3ab02-eb5f-4098-a18f-253cc3599c4e\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-gvb4v" Jun 10 12:50:48.892046 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:50:48.891988 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a7b3ab02-eb5f-4098-a18f-253cc3599c4e-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-gvb4v\" (UID: \"a7b3ab02-eb5f-4098-a18f-253cc3599c4e\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-gvb4v" Jun 10 12:50:48.892046 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:50:48.892014 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a7b3ab02-eb5f-4098-a18f-253cc3599c4e-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-gvb4v\" (UID: \"a7b3ab02-eb5f-4098-a18f-253cc3599c4e\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-gvb4v" Jun 10 12:50:48.892395 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:50:48.892365 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a7b3ab02-eb5f-4098-a18f-253cc3599c4e-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-gvb4v\" (UID: \"a7b3ab02-eb5f-4098-a18f-253cc3599c4e\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-gvb4v" Jun 10 12:50:48.892514 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:50:48.892437 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a7b3ab02-eb5f-4098-a18f-253cc3599c4e-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-gvb4v\" (UID: \"a7b3ab02-eb5f-4098-a18f-253cc3599c4e\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-gvb4v" Jun 10 12:50:48.892621 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:50:48.892600 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a7b3ab02-eb5f-4098-a18f-253cc3599c4e-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-gvb4v\" (UID: \"a7b3ab02-eb5f-4098-a18f-253cc3599c4e\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-gvb4v" Jun 10 12:50:48.894320 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:50:48.894298 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a7b3ab02-eb5f-4098-a18f-253cc3599c4e-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-gvb4v\" (UID: \"a7b3ab02-eb5f-4098-a18f-253cc3599c4e\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-gvb4v" Jun 10 12:50:48.894596 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:50:48.894571 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a7b3ab02-eb5f-4098-a18f-253cc3599c4e-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-gvb4v\" (UID: \"a7b3ab02-eb5f-4098-a18f-253cc3599c4e\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-gvb4v" Jun 10 12:50:48.907712 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:50:48.907685 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6cn5r\" (UniqueName: \"kubernetes.io/projected/a7b3ab02-eb5f-4098-a18f-253cc3599c4e-kube-api-access-6cn5r\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-gvb4v\" (UID: \"a7b3ab02-eb5f-4098-a18f-253cc3599c4e\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-gvb4v" Jun 10 12:50:49.063336 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:50:49.063289 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-gvb4v" Jun 10 12:50:49.195768 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:50:49.195742 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-gvb4v"] Jun 10 12:50:49.197662 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:50:49.197638 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7b3ab02_eb5f_4098_a18f_253cc3599c4e.slice/crio-086cdf3490b29fb7fd98214b2368b950ec4a6eef3def8a19849556611c7020ba WatchSource:0}: Error finding container 086cdf3490b29fb7fd98214b2368b950ec4a6eef3def8a19849556611c7020ba: Status 404 returned error can't find the container with id 086cdf3490b29fb7fd98214b2368b950ec4a6eef3def8a19849556611c7020ba Jun 10 12:50:49.769573 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:50:49.769531 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-gvb4v" event={"ID":"a7b3ab02-eb5f-4098-a18f-253cc3599c4e","Type":"ContainerStarted","Data":"086cdf3490b29fb7fd98214b2368b950ec4a6eef3def8a19849556611c7020ba"} Jun 10 12:50:52.787945 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:50:52.787913 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-gvb4v" event={"ID":"a7b3ab02-eb5f-4098-a18f-253cc3599c4e","Type":"ContainerStarted","Data":"1378499e61564296dd95a9eca5dcec6cce98593f154d883a88a9488636a967d0"} Jun 10 12:50:58.814644 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:50:58.814607 2557 generic.go:356] "Generic (PLEG): container finished" podID="a7b3ab02-eb5f-4098-a18f-253cc3599c4e" containerID="1378499e61564296dd95a9eca5dcec6cce98593f154d883a88a9488636a967d0" exitCode=0 Jun 10 12:50:58.815166 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:50:58.814678 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-gvb4v" event={"ID":"a7b3ab02-eb5f-4098-a18f-253cc3599c4e","Type":"ContainerDied","Data":"1378499e61564296dd95a9eca5dcec6cce98593f154d883a88a9488636a967d0"} Jun 10 12:51:00.825486 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:51:00.825455 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-gvb4v" event={"ID":"a7b3ab02-eb5f-4098-a18f-253cc3599c4e","Type":"ContainerStarted","Data":"e6f14487e6901edb721e5d6525a939a8443652848fedb4c0ea42c31cc1a07033"} Jun 10 12:51:00.848840 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:51:00.848794 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-gvb4v" podStartSLOduration=3.102397278 podStartE2EDuration="12.848780805s" totalImagesPullingTime="4.584263142s" totalInitContainerRuntime="5.162120385s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:50:48 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:51:00.846759299 +0000 UTC m=+857.729363396" watchObservedRunningTime="2026-06-10 12:51:00.848780805 +0000 UTC m=+857.731384879" Jun 10 12:51:09.064018 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:51:09.063980 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-gvb4v" Jun 10 12:51:09.064423 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:51:09.064051 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-gvb4v" Jun 10 12:51:09.076229 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:51:09.076201 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-gvb4v" Jun 10 12:51:09.876620 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:51:09.876594 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-gvb4v" Jun 10 12:51:37.388932 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:51:37.388857 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnr5lx"] Jun 10 12:51:37.391472 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:51:37.391453 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnr5lx" Jun 10 12:51:37.394869 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:51:37.394849 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 10 12:51:37.407382 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:51:37.407360 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnr5lx"] Jun 10 12:51:37.577481 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:51:37.577452 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5de2623c-707e-4aa5-ad95-317de919de56-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnr5lx\" (UID: \"5de2623c-707e-4aa5-ad95-317de919de56\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnr5lx" Jun 10 12:51:37.577654 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:51:37.577489 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5de2623c-707e-4aa5-ad95-317de919de56-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnr5lx\" (UID: \"5de2623c-707e-4aa5-ad95-317de919de56\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnr5lx" Jun 10 12:51:37.577654 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:51:37.577509 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnc6m\" (UniqueName: \"kubernetes.io/projected/5de2623c-707e-4aa5-ad95-317de919de56-kube-api-access-wnc6m\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnr5lx\" (UID: \"5de2623c-707e-4aa5-ad95-317de919de56\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnr5lx" Jun 10 12:51:37.577654 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:51:37.577528 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5de2623c-707e-4aa5-ad95-317de919de56-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnr5lx\" (UID: \"5de2623c-707e-4aa5-ad95-317de919de56\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnr5lx" Jun 10 12:51:37.577654 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:51:37.577576 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5de2623c-707e-4aa5-ad95-317de919de56-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnr5lx\" (UID: \"5de2623c-707e-4aa5-ad95-317de919de56\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnr5lx" Jun 10 12:51:37.577654 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:51:37.577606 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5de2623c-707e-4aa5-ad95-317de919de56-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnr5lx\" (UID: \"5de2623c-707e-4aa5-ad95-317de919de56\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnr5lx" Jun 10 12:51:37.678496 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:51:37.678421 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5de2623c-707e-4aa5-ad95-317de919de56-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnr5lx\" (UID: \"5de2623c-707e-4aa5-ad95-317de919de56\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnr5lx" Jun 10 12:51:37.678496 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:51:37.678454 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5de2623c-707e-4aa5-ad95-317de919de56-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnr5lx\" (UID: \"5de2623c-707e-4aa5-ad95-317de919de56\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnr5lx" Jun 10 12:51:37.678496 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:51:37.678472 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnc6m\" (UniqueName: \"kubernetes.io/projected/5de2623c-707e-4aa5-ad95-317de919de56-kube-api-access-wnc6m\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnr5lx\" (UID: \"5de2623c-707e-4aa5-ad95-317de919de56\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnr5lx" Jun 10 12:51:37.678752 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:51:37.678597 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5de2623c-707e-4aa5-ad95-317de919de56-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnr5lx\" (UID: \"5de2623c-707e-4aa5-ad95-317de919de56\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnr5lx" Jun 10 12:51:37.678752 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:51:37.678641 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5de2623c-707e-4aa5-ad95-317de919de56-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnr5lx\" (UID: \"5de2623c-707e-4aa5-ad95-317de919de56\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnr5lx" Jun 10 12:51:37.678752 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:51:37.678681 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5de2623c-707e-4aa5-ad95-317de919de56-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnr5lx\" (UID: \"5de2623c-707e-4aa5-ad95-317de919de56\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnr5lx" Jun 10 12:51:37.678915 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:51:37.678904 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5de2623c-707e-4aa5-ad95-317de919de56-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnr5lx\" (UID: \"5de2623c-707e-4aa5-ad95-317de919de56\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnr5lx" Jun 10 12:51:37.678995 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:51:37.678973 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5de2623c-707e-4aa5-ad95-317de919de56-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnr5lx\" (UID: \"5de2623c-707e-4aa5-ad95-317de919de56\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnr5lx" Jun 10 12:51:37.679054 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:51:37.679039 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5de2623c-707e-4aa5-ad95-317de919de56-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnr5lx\" (UID: \"5de2623c-707e-4aa5-ad95-317de919de56\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnr5lx" Jun 10 12:51:37.680699 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:51:37.680671 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5de2623c-707e-4aa5-ad95-317de919de56-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnr5lx\" (UID: \"5de2623c-707e-4aa5-ad95-317de919de56\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnr5lx" Jun 10 12:51:37.681104 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:51:37.681083 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5de2623c-707e-4aa5-ad95-317de919de56-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnr5lx\" (UID: \"5de2623c-707e-4aa5-ad95-317de919de56\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnr5lx" Jun 10 12:51:37.687047 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:51:37.687025 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnc6m\" (UniqueName: \"kubernetes.io/projected/5de2623c-707e-4aa5-ad95-317de919de56-kube-api-access-wnc6m\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnr5lx\" (UID: \"5de2623c-707e-4aa5-ad95-317de919de56\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnr5lx" Jun 10 12:51:37.731923 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:51:37.731900 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnr5lx" Jun 10 12:51:37.865158 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:51:37.865127 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnr5lx"] Jun 10 12:51:37.868255 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:51:37.868226 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5de2623c_707e_4aa5_ad95_317de919de56.slice/crio-5dc629d83be990dfad832e6d1d2a3706e9787807eebad6b2ed8de52cc0979b85 WatchSource:0}: Error finding container 5dc629d83be990dfad832e6d1d2a3706e9787807eebad6b2ed8de52cc0979b85: Status 404 returned error can't find the container with id 5dc629d83be990dfad832e6d1d2a3706e9787807eebad6b2ed8de52cc0979b85 Jun 10 12:51:37.990691 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:51:37.990604 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnr5lx" event={"ID":"5de2623c-707e-4aa5-ad95-317de919de56","Type":"ContainerStarted","Data":"5899d753f6e710d9d9ba4f976e9c251fcd85c687645243bae63a255536426b57"} Jun 10 12:51:37.990691 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:51:37.990664 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnr5lx" event={"ID":"5de2623c-707e-4aa5-ad95-317de919de56","Type":"ContainerStarted","Data":"5dc629d83be990dfad832e6d1d2a3706e9787807eebad6b2ed8de52cc0979b85"} Jun 10 12:51:42.009051 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:51:42.008963 2557 generic.go:356] "Generic (PLEG): container finished" podID="5de2623c-707e-4aa5-ad95-317de919de56" containerID="5899d753f6e710d9d9ba4f976e9c251fcd85c687645243bae63a255536426b57" exitCode=0 Jun 10 12:51:42.009407 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:51:42.009041 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnr5lx" event={"ID":"5de2623c-707e-4aa5-ad95-317de919de56","Type":"ContainerDied","Data":"5899d753f6e710d9d9ba4f976e9c251fcd85c687645243bae63a255536426b57"} Jun 10 12:51:43.015365 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:51:43.015328 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnr5lx" event={"ID":"5de2623c-707e-4aa5-ad95-317de919de56","Type":"ContainerStarted","Data":"e04f92c629f267fc19e79d0a8c510e95ea7f1c52e1b5311ecbee44d5142ca36f"} Jun 10 12:51:43.037595 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:51:43.037531 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnr5lx" podStartSLOduration=2.197008115 podStartE2EDuration="6.037515777s" totalImagesPullingTime="231.886855ms" totalInitContainerRuntime="3.608620807s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:51:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:51:43.036618359 +0000 UTC m=+899.919222435" watchObservedRunningTime="2026-06-10 12:51:43.037515777 +0000 UTC m=+899.920119851" Jun 10 12:51:44.807419 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:51:44.807385 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-txhn5"] Jun 10 12:51:44.812307 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:51:44.812281 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-txhn5" Jun 10 12:51:44.815137 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:51:44.815099 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 10 12:51:44.835356 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:51:44.835331 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2787f7a4-d6a5-4ff9-b774-783bab867f70-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-txhn5\" (UID: \"2787f7a4-d6a5-4ff9-b774-783bab867f70\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-txhn5" Jun 10 12:51:44.835448 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:51:44.835382 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2787f7a4-d6a5-4ff9-b774-783bab867f70-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-txhn5\" (UID: \"2787f7a4-d6a5-4ff9-b774-783bab867f70\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-txhn5" Jun 10 12:51:44.835448 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:51:44.835421 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2787f7a4-d6a5-4ff9-b774-783bab867f70-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-txhn5\" (UID: \"2787f7a4-d6a5-4ff9-b774-783bab867f70\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-txhn5" Jun 10 12:51:44.835519 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:51:44.835474 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2787f7a4-d6a5-4ff9-b774-783bab867f70-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-txhn5\" (UID: \"2787f7a4-d6a5-4ff9-b774-783bab867f70\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-txhn5" Jun 10 12:51:44.835519 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:51:44.835492 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6thlg\" (UniqueName: \"kubernetes.io/projected/2787f7a4-d6a5-4ff9-b774-783bab867f70-kube-api-access-6thlg\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-txhn5\" (UID: \"2787f7a4-d6a5-4ff9-b774-783bab867f70\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-txhn5" Jun 10 12:51:44.835585 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:51:44.835515 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2787f7a4-d6a5-4ff9-b774-783bab867f70-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-txhn5\" (UID: \"2787f7a4-d6a5-4ff9-b774-783bab867f70\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-txhn5" Jun 10 12:51:44.870272 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:51:44.870250 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-txhn5"] Jun 10 12:51:44.936454 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:51:44.936426 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2787f7a4-d6a5-4ff9-b774-783bab867f70-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-txhn5\" (UID: \"2787f7a4-d6a5-4ff9-b774-783bab867f70\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-txhn5" Jun 10 12:51:44.936548 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:51:44.936460 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2787f7a4-d6a5-4ff9-b774-783bab867f70-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-txhn5\" (UID: \"2787f7a4-d6a5-4ff9-b774-783bab867f70\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-txhn5" Jun 10 12:51:44.936548 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:51:44.936499 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2787f7a4-d6a5-4ff9-b774-783bab867f70-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-txhn5\" (UID: \"2787f7a4-d6a5-4ff9-b774-783bab867f70\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-txhn5" Jun 10 12:51:44.936548 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:51:44.936523 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6thlg\" (UniqueName: \"kubernetes.io/projected/2787f7a4-d6a5-4ff9-b774-783bab867f70-kube-api-access-6thlg\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-txhn5\" (UID: \"2787f7a4-d6a5-4ff9-b774-783bab867f70\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-txhn5" Jun 10 12:51:44.936678 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:51:44.936556 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2787f7a4-d6a5-4ff9-b774-783bab867f70-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-txhn5\" (UID: \"2787f7a4-d6a5-4ff9-b774-783bab867f70\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-txhn5" Jun 10 12:51:44.936678 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:51:44.936602 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2787f7a4-d6a5-4ff9-b774-783bab867f70-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-txhn5\" (UID: \"2787f7a4-d6a5-4ff9-b774-783bab867f70\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-txhn5" Jun 10 12:51:44.936909 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:51:44.936888 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2787f7a4-d6a5-4ff9-b774-783bab867f70-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-txhn5\" (UID: \"2787f7a4-d6a5-4ff9-b774-783bab867f70\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-txhn5" Jun 10 12:51:44.936979 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:51:44.936920 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2787f7a4-d6a5-4ff9-b774-783bab867f70-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-txhn5\" (UID: \"2787f7a4-d6a5-4ff9-b774-783bab867f70\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-txhn5" Jun 10 12:51:44.936979 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:51:44.936969 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2787f7a4-d6a5-4ff9-b774-783bab867f70-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-txhn5\" (UID: \"2787f7a4-d6a5-4ff9-b774-783bab867f70\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-txhn5" Jun 10 12:51:44.938779 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:51:44.938756 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2787f7a4-d6a5-4ff9-b774-783bab867f70-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-txhn5\" (UID: \"2787f7a4-d6a5-4ff9-b774-783bab867f70\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-txhn5" Jun 10 12:51:44.939021 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:51:44.939004 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2787f7a4-d6a5-4ff9-b774-783bab867f70-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-txhn5\" (UID: \"2787f7a4-d6a5-4ff9-b774-783bab867f70\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-txhn5" Jun 10 12:51:44.946141 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:51:44.946117 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6thlg\" (UniqueName: \"kubernetes.io/projected/2787f7a4-d6a5-4ff9-b774-783bab867f70-kube-api-access-6thlg\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-txhn5\" (UID: \"2787f7a4-d6a5-4ff9-b774-783bab867f70\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-txhn5" Jun 10 12:51:45.124999 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:51:45.124932 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-txhn5" Jun 10 12:51:45.258849 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:51:45.258816 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-txhn5"] Jun 10 12:51:45.261222 ip-10-0-133-72 kubenswrapper[2557]: W0610 12:51:45.261193 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2787f7a4_d6a5_4ff9_b774_783bab867f70.slice/crio-93a39ac229f22f9b87bdd4e98a931cbff7201f26796eb65bfe70004ec995ebb3 WatchSource:0}: Error finding container 93a39ac229f22f9b87bdd4e98a931cbff7201f26796eb65bfe70004ec995ebb3: Status 404 returned error can't find the container with id 93a39ac229f22f9b87bdd4e98a931cbff7201f26796eb65bfe70004ec995ebb3 Jun 10 12:51:46.031268 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:51:46.031225 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-txhn5" event={"ID":"2787f7a4-d6a5-4ff9-b774-783bab867f70","Type":"ContainerStarted","Data":"0ee39b2bf1a595e928aa346a32e1681b9d99bc74fa4fb7c64ed09072b91211cd"} Jun 10 12:51:46.031689 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:51:46.031288 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-txhn5" event={"ID":"2787f7a4-d6a5-4ff9-b774-783bab867f70","Type":"ContainerStarted","Data":"93a39ac229f22f9b87bdd4e98a931cbff7201f26796eb65bfe70004ec995ebb3"} Jun 10 12:51:47.732937 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:51:47.732901 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnr5lx" Jun 10 12:51:47.733332 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:51:47.732977 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnr5lx" Jun 10 12:51:47.745671 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:51:47.745649 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnr5lx" Jun 10 12:51:48.051595 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:51:48.051568 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnr5lx" Jun 10 12:54:35.774819 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:54:35.774788 2557 generic.go:356] "Generic (PLEG): container finished" podID="2787f7a4-d6a5-4ff9-b774-783bab867f70" containerID="0ee39b2bf1a595e928aa346a32e1681b9d99bc74fa4fb7c64ed09072b91211cd" exitCode=0 Jun 10 12:54:35.775237 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:54:35.774835 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-txhn5" event={"ID":"2787f7a4-d6a5-4ff9-b774-783bab867f70","Type":"ContainerDied","Data":"0ee39b2bf1a595e928aa346a32e1681b9d99bc74fa4fb7c64ed09072b91211cd"} Jun 10 12:54:35.775438 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:54:35.775421 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 12:54:36.781634 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:54:36.781603 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-txhn5" event={"ID":"2787f7a4-d6a5-4ff9-b774-783bab867f70","Type":"ContainerStarted","Data":"39286b6d3e6a3ade465bcc49723f77fdf602fa846ce6d277589f223e70014be9"} Jun 10 12:54:36.808308 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:54:36.808265 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-txhn5" podStartSLOduration=2.197476328 podStartE2EDuration="2m52.808250641s" totalImagesPullingTime="284.709622ms" totalInitContainerRuntime="2m50.326064691s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:51:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:54:36.806278533 +0000 UTC m=+1073.688882602" watchObservedRunningTime="2026-06-10 12:54:36.808250641 +0000 UTC m=+1073.690854717" Jun 10 12:54:45.125636 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:54:45.125601 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-txhn5" Jun 10 12:54:45.125999 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:54:45.125655 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-txhn5" Jun 10 12:54:45.138111 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:54:45.138083 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-txhn5" Jun 10 12:54:45.829329 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:54:45.829298 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-txhn5" Jun 10 12:59:53.315826 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:59:53.315785 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-f676969f4-hbg2b_f89ac2d3-977d-4f4a-a472-40a137561b94/nginx/0.log" Jun 10 12:59:53.713352 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:59:53.713279 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-f8c579895-5mkr8_cc8b0daa-8574-4ddf-8886-82bb945f4f39/manager/0.log" Jun 10 12:59:54.093910 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:59:54.093884 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c7bd9b77-8mt7d_0e7b03f9-1027-42b7-a308-f0fe39dcb572/copy-manifests/0.log" Jun 10 12:59:54.101600 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:59:54.101577 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c7bd9b77-8mt7d_0e7b03f9-1027-42b7-a308-f0fe39dcb572/manager/0.log" Jun 10 12:59:55.765153 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:59:55.765119 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-h825l_b8db3bc7-28f7-4c29-be1e-49d60c5e0f8e/manager/0.log" Jun 10 12:59:55.875485 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:59:55.875462 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-jcrj9_9262d06d-38ab-4746-b751-4666abee72d2/manager/0.log" Jun 10 12:59:55.983289 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:59:55.983267 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-bfzt6_c0708f9d-3ac4-407a-8107-3141dd5d6c4e/kuadrant-console-plugin/0.log" Jun 10 12:59:56.099607 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:59:56.099580 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-zhmdk_dee0659c-e6b3-4c1a-8efc-b9a7f2f749fe/registry-server/0.log" Jun 10 12:59:56.801171 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:59:56.801132 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795bqqck_1f70e904-fbfd-4b35-8fea-99805c3c5690/istio-proxy/0.log" Jun 10 12:59:57.265858 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:59:57.265777 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-djdfb_417bf846-d5a5-4acc-a10f-901fa12dbdbf/istio-proxy/1.log" Jun 10 12:59:57.379698 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:59:57.379670 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-2mm42_d0033ace-4459-4996-88d9-e181b05736de/payload-pre-processing/0.log" Jun 10 12:59:57.948174 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:59:57.948139 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-gvb4v_a7b3ab02-eb5f-4098-a18f-253cc3599c4e/main/0.log" Jun 10 12:59:57.956507 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:59:57.956485 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-gvb4v_a7b3ab02-eb5f-4098-a18f-253cc3599c4e/storage-initializer/0.log" Jun 10 12:59:58.320017 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:59:58.319991 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnr5lx_5de2623c-707e-4aa5-ad95-317de919de56/main/0.log" Jun 10 12:59:58.327358 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:59:58.327337 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cnr5lx_5de2623c-707e-4aa5-ad95-317de919de56/storage-initializer/0.log" Jun 10 12:59:58.442075 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:59:58.442049 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-txhn5_2787f7a4-d6a5-4ff9-b774-783bab867f70/storage-initializer/0.log" Jun 10 12:59:58.450068 ip-10-0-133-72 kubenswrapper[2557]: I0610 12:59:58.450050 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-txhn5_2787f7a4-d6a5-4ff9-b774-783bab867f70/main/0.log" Jun 10 13:00:05.725911 ip-10-0-133-72 kubenswrapper[2557]: I0610 13:00:05.725885 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-q25rc_b893d76d-5c4b-4d52-9658-7d87236b1b2e/global-pull-secret-syncer/0.log" Jun 10 13:00:05.811428 ip-10-0-133-72 kubenswrapper[2557]: I0610 13:00:05.811406 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-f9rmw_0b5cd784-4247-44f1-b9cd-394ae4294de9/konnectivity-agent/0.log" Jun 10 13:00:05.888246 ip-10-0-133-72 kubenswrapper[2557]: I0610 13:00:05.888205 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-72.ec2.internal_6b087f13d248dbe4b0232602445486c4/haproxy/0.log" Jun 10 13:00:11.078374 ip-10-0-133-72 kubenswrapper[2557]: I0610 13:00:11.078335 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-h825l_b8db3bc7-28f7-4c29-be1e-49d60c5e0f8e/manager/0.log" Jun 10 13:00:11.110612 ip-10-0-133-72 kubenswrapper[2557]: I0610 13:00:11.110585 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-jcrj9_9262d06d-38ab-4746-b751-4666abee72d2/manager/0.log" Jun 10 13:00:11.138825 ip-10-0-133-72 kubenswrapper[2557]: I0610 13:00:11.138804 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-bfzt6_c0708f9d-3ac4-407a-8107-3141dd5d6c4e/kuadrant-console-plugin/0.log" Jun 10 13:00:11.180754 ip-10-0-133-72 kubenswrapper[2557]: I0610 13:00:11.180728 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-zhmdk_dee0659c-e6b3-4c1a-8efc-b9a7f2f749fe/registry-server/0.log" Jun 10 13:00:13.663003 ip-10-0-133-72 kubenswrapper[2557]: I0610 13:00:13.662981 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kxnx9_4c974817-a56e-48c3-a975-a00d2d1167e2/node-exporter/0.log" Jun 10 13:00:13.690611 ip-10-0-133-72 kubenswrapper[2557]: I0610 13:00:13.690585 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kxnx9_4c974817-a56e-48c3-a975-a00d2d1167e2/kube-rbac-proxy/0.log" Jun 10 13:00:13.716623 ip-10-0-133-72 kubenswrapper[2557]: I0610 13:00:13.716604 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kxnx9_4c974817-a56e-48c3-a975-a00d2d1167e2/init-textfile/0.log" Jun 10 13:00:15.922244 ip-10-0-133-72 kubenswrapper[2557]: I0610 13:00:15.922214 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-42cd4/perf-node-gather-daemonset-dbfqm"] Jun 10 13:00:15.925357 ip-10-0-133-72 kubenswrapper[2557]: I0610 13:00:15.925335 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-42cd4/perf-node-gather-daemonset-dbfqm" Jun 10 13:00:15.930155 ip-10-0-133-72 kubenswrapper[2557]: I0610 13:00:15.930135 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-42cd4\"/\"kube-root-ca.crt\"" Jun 10 13:00:15.930932 ip-10-0-133-72 kubenswrapper[2557]: I0610 13:00:15.930914 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-42cd4\"/\"default-dockercfg-4pwrt\"" Jun 10 13:00:15.930991 ip-10-0-133-72 kubenswrapper[2557]: I0610 13:00:15.930947 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-42cd4\"/\"openshift-service-ca.crt\"" Jun 10 13:00:15.938220 ip-10-0-133-72 kubenswrapper[2557]: I0610 13:00:15.938197 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-42cd4/perf-node-gather-daemonset-dbfqm"] Jun 10 13:00:16.060651 ip-10-0-133-72 kubenswrapper[2557]: I0610 13:00:16.060628 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e12edf2a-26b6-4aac-ac80-523c5b300045-podres\") pod \"perf-node-gather-daemonset-dbfqm\" (UID: \"e12edf2a-26b6-4aac-ac80-523c5b300045\") " pod="openshift-must-gather-42cd4/perf-node-gather-daemonset-dbfqm" Jun 10 13:00:16.060755 ip-10-0-133-72 kubenswrapper[2557]: I0610 13:00:16.060656 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e12edf2a-26b6-4aac-ac80-523c5b300045-proc\") pod \"perf-node-gather-daemonset-dbfqm\" (UID: \"e12edf2a-26b6-4aac-ac80-523c5b300045\") " pod="openshift-must-gather-42cd4/perf-node-gather-daemonset-dbfqm" Jun 10 13:00:16.060755 ip-10-0-133-72 kubenswrapper[2557]: I0610 13:00:16.060676 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxg4f\" (UniqueName: \"kubernetes.io/projected/e12edf2a-26b6-4aac-ac80-523c5b300045-kube-api-access-zxg4f\") pod \"perf-node-gather-daemonset-dbfqm\" (UID: \"e12edf2a-26b6-4aac-ac80-523c5b300045\") " pod="openshift-must-gather-42cd4/perf-node-gather-daemonset-dbfqm" Jun 10 13:00:16.060755 ip-10-0-133-72 kubenswrapper[2557]: I0610 13:00:16.060700 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e12edf2a-26b6-4aac-ac80-523c5b300045-lib-modules\") pod \"perf-node-gather-daemonset-dbfqm\" (UID: \"e12edf2a-26b6-4aac-ac80-523c5b300045\") " pod="openshift-must-gather-42cd4/perf-node-gather-daemonset-dbfqm" Jun 10 13:00:16.060866 ip-10-0-133-72 kubenswrapper[2557]: I0610 13:00:16.060769 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e12edf2a-26b6-4aac-ac80-523c5b300045-sys\") pod \"perf-node-gather-daemonset-dbfqm\" (UID: \"e12edf2a-26b6-4aac-ac80-523c5b300045\") " pod="openshift-must-gather-42cd4/perf-node-gather-daemonset-dbfqm" Jun 10 13:00:16.161207 ip-10-0-133-72 kubenswrapper[2557]: I0610 13:00:16.161172 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxg4f\" (UniqueName: \"kubernetes.io/projected/e12edf2a-26b6-4aac-ac80-523c5b300045-kube-api-access-zxg4f\") pod \"perf-node-gather-daemonset-dbfqm\" (UID: \"e12edf2a-26b6-4aac-ac80-523c5b300045\") " pod="openshift-must-gather-42cd4/perf-node-gather-daemonset-dbfqm" Jun 10 13:00:16.161309 ip-10-0-133-72 kubenswrapper[2557]: I0610 13:00:16.161217 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e12edf2a-26b6-4aac-ac80-523c5b300045-lib-modules\") pod \"perf-node-gather-daemonset-dbfqm\" (UID: \"e12edf2a-26b6-4aac-ac80-523c5b300045\") " pod="openshift-must-gather-42cd4/perf-node-gather-daemonset-dbfqm" Jun 10 13:00:16.161309 ip-10-0-133-72 kubenswrapper[2557]: I0610 13:00:16.161245 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e12edf2a-26b6-4aac-ac80-523c5b300045-sys\") pod \"perf-node-gather-daemonset-dbfqm\" (UID: \"e12edf2a-26b6-4aac-ac80-523c5b300045\") " pod="openshift-must-gather-42cd4/perf-node-gather-daemonset-dbfqm" Jun 10 13:00:16.161309 ip-10-0-133-72 kubenswrapper[2557]: I0610 13:00:16.161299 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e12edf2a-26b6-4aac-ac80-523c5b300045-podres\") pod \"perf-node-gather-daemonset-dbfqm\" (UID: \"e12edf2a-26b6-4aac-ac80-523c5b300045\") " pod="openshift-must-gather-42cd4/perf-node-gather-daemonset-dbfqm" Jun 10 13:00:16.161449 ip-10-0-133-72 kubenswrapper[2557]: I0610 13:00:16.161318 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e12edf2a-26b6-4aac-ac80-523c5b300045-proc\") pod \"perf-node-gather-daemonset-dbfqm\" (UID: \"e12edf2a-26b6-4aac-ac80-523c5b300045\") " pod="openshift-must-gather-42cd4/perf-node-gather-daemonset-dbfqm" Jun 10 13:00:16.161449 ip-10-0-133-72 kubenswrapper[2557]: I0610 13:00:16.161345 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e12edf2a-26b6-4aac-ac80-523c5b300045-lib-modules\") pod \"perf-node-gather-daemonset-dbfqm\" (UID: \"e12edf2a-26b6-4aac-ac80-523c5b300045\") " pod="openshift-must-gather-42cd4/perf-node-gather-daemonset-dbfqm" Jun 10 13:00:16.161449 ip-10-0-133-72 kubenswrapper[2557]: I0610 13:00:16.161378 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e12edf2a-26b6-4aac-ac80-523c5b300045-sys\") pod \"perf-node-gather-daemonset-dbfqm\" (UID: \"e12edf2a-26b6-4aac-ac80-523c5b300045\") " pod="openshift-must-gather-42cd4/perf-node-gather-daemonset-dbfqm" Jun 10 13:00:16.161449 ip-10-0-133-72 kubenswrapper[2557]: I0610 13:00:16.161435 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e12edf2a-26b6-4aac-ac80-523c5b300045-proc\") pod \"perf-node-gather-daemonset-dbfqm\" (UID: \"e12edf2a-26b6-4aac-ac80-523c5b300045\") " pod="openshift-must-gather-42cd4/perf-node-gather-daemonset-dbfqm" Jun 10 13:00:16.161603 ip-10-0-133-72 kubenswrapper[2557]: I0610 13:00:16.161453 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e12edf2a-26b6-4aac-ac80-523c5b300045-podres\") pod \"perf-node-gather-daemonset-dbfqm\" (UID: \"e12edf2a-26b6-4aac-ac80-523c5b300045\") " pod="openshift-must-gather-42cd4/perf-node-gather-daemonset-dbfqm" Jun 10 13:00:16.175290 ip-10-0-133-72 kubenswrapper[2557]: I0610 13:00:16.175247 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxg4f\" (UniqueName: \"kubernetes.io/projected/e12edf2a-26b6-4aac-ac80-523c5b300045-kube-api-access-zxg4f\") pod \"perf-node-gather-daemonset-dbfqm\" (UID: \"e12edf2a-26b6-4aac-ac80-523c5b300045\") " pod="openshift-must-gather-42cd4/perf-node-gather-daemonset-dbfqm" Jun 10 13:00:16.237768 ip-10-0-133-72 kubenswrapper[2557]: I0610 13:00:16.237749 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-42cd4/perf-node-gather-daemonset-dbfqm" Jun 10 13:00:16.370517 ip-10-0-133-72 kubenswrapper[2557]: I0610 13:00:16.370495 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-42cd4/perf-node-gather-daemonset-dbfqm"] Jun 10 13:00:16.372472 ip-10-0-133-72 kubenswrapper[2557]: W0610 13:00:16.372447 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode12edf2a_26b6_4aac_ac80_523c5b300045.slice/crio-7c23e241151da693d05fe3a400a4c9b6ed1785b009ac5bf8687de71f9880fbd0 WatchSource:0}: Error finding container 7c23e241151da693d05fe3a400a4c9b6ed1785b009ac5bf8687de71f9880fbd0: Status 404 returned error can't find the container with id 7c23e241151da693d05fe3a400a4c9b6ed1785b009ac5bf8687de71f9880fbd0 Jun 10 13:00:17.332556 ip-10-0-133-72 kubenswrapper[2557]: I0610 13:00:17.332517 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-42cd4/perf-node-gather-daemonset-dbfqm" event={"ID":"e12edf2a-26b6-4aac-ac80-523c5b300045","Type":"ContainerStarted","Data":"b84e7ad00df4d594f3cdc6c155bdfb49b0292e348cf83f0211994ca827e0da38"} Jun 10 13:00:17.332905 ip-10-0-133-72 kubenswrapper[2557]: I0610 13:00:17.332614 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-42cd4/perf-node-gather-daemonset-dbfqm" event={"ID":"e12edf2a-26b6-4aac-ac80-523c5b300045","Type":"ContainerStarted","Data":"7c23e241151da693d05fe3a400a4c9b6ed1785b009ac5bf8687de71f9880fbd0"} Jun 10 13:00:17.332905 ip-10-0-133-72 kubenswrapper[2557]: I0610 13:00:17.332663 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-42cd4/perf-node-gather-daemonset-dbfqm" Jun 10 13:00:19.060986 ip-10-0-133-72 kubenswrapper[2557]: I0610 13:00:19.060962 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-slqcw_6f28a11c-ee9f-40ec-a10e-1b6b54178990/dns/0.log" Jun 10 13:00:19.086687 ip-10-0-133-72 kubenswrapper[2557]: I0610 13:00:19.086661 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-slqcw_6f28a11c-ee9f-40ec-a10e-1b6b54178990/kube-rbac-proxy/0.log" Jun 10 13:00:19.315848 ip-10-0-133-72 kubenswrapper[2557]: I0610 13:00:19.315777 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mvcnc_f324d4da-090d-4e3e-99f7-5a5393276463/dns-node-resolver/0.log" Jun 10 13:00:19.995308 ip-10-0-133-72 kubenswrapper[2557]: I0610 13:00:19.995286 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4c6gv_9ced5103-eb3b-4070-9c0a-06df4cd9c0a8/node-ca/0.log" Jun 10 13:00:21.095838 ip-10-0-133-72 kubenswrapper[2557]: I0610 13:00:21.095812 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795bqqck_1f70e904-fbfd-4b35-8fea-99805c3c5690/istio-proxy/0.log" Jun 10 13:00:21.252426 ip-10-0-133-72 kubenswrapper[2557]: I0610 13:00:21.252398 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-djdfb_417bf846-d5a5-4acc-a10f-901fa12dbdbf/istio-proxy/1.log" Jun 10 13:00:21.252728 ip-10-0-133-72 kubenswrapper[2557]: I0610 13:00:21.252710 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-djdfb_417bf846-d5a5-4acc-a10f-901fa12dbdbf/istio-proxy/0.log" Jun 10 13:00:21.280717 ip-10-0-133-72 kubenswrapper[2557]: I0610 13:00:21.280694 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-2mm42_d0033ace-4459-4996-88d9-e181b05736de/payload-pre-processing/0.log" Jun 10 13:00:22.127147 ip-10-0-133-72 kubenswrapper[2557]: I0610 13:00:22.127115 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fwbxx_32bc9549-c4d5-4180-9d38-cb7c9d22d920/serve-healthcheck-canary/0.log" Jun 10 13:00:22.877789 ip-10-0-133-72 kubenswrapper[2557]: I0610 13:00:22.877759 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9xcjs_0d1e8746-7256-46a9-bda4-b316ddae71f7/kube-rbac-proxy/0.log" Jun 10 13:00:22.913479 ip-10-0-133-72 kubenswrapper[2557]: I0610 13:00:22.913446 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9xcjs_0d1e8746-7256-46a9-bda4-b316ddae71f7/exporter/0.log" Jun 10 13:00:22.943116 ip-10-0-133-72 kubenswrapper[2557]: I0610 13:00:22.943089 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9xcjs_0d1e8746-7256-46a9-bda4-b316ddae71f7/extractor/0.log" Jun 10 13:00:23.346099 ip-10-0-133-72 kubenswrapper[2557]: I0610 13:00:23.346070 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-42cd4/perf-node-gather-daemonset-dbfqm" Jun 10 13:00:23.367063 ip-10-0-133-72 kubenswrapper[2557]: I0610 13:00:23.367009 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-42cd4/perf-node-gather-daemonset-dbfqm" podStartSLOduration=8.366993069 podStartE2EDuration="8.366993069s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 13:00:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:00:17.392212815 +0000 UTC m=+1414.274816889" watchObservedRunningTime="2026-06-10 13:00:23.366993069 +0000 UTC m=+1420.249597142" Jun 10 13:00:25.738040 ip-10-0-133-72 kubenswrapper[2557]: I0610 13:00:25.737990 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-f676969f4-hbg2b_f89ac2d3-977d-4f4a-a472-40a137561b94/nginx/0.log" Jun 10 13:00:25.891007 ip-10-0-133-72 kubenswrapper[2557]: I0610 13:00:25.890984 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-f8c579895-5mkr8_cc8b0daa-8574-4ddf-8886-82bb945f4f39/manager/0.log" Jun 10 13:00:26.112768 ip-10-0-133-72 kubenswrapper[2557]: I0610 13:00:26.112746 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c7bd9b77-8mt7d_0e7b03f9-1027-42b7-a308-f0fe39dcb572/manager/0.log" Jun 10 13:00:26.159491 ip-10-0-133-72 kubenswrapper[2557]: I0610 13:00:26.159467 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c7bd9b77-8mt7d_0e7b03f9-1027-42b7-a308-f0fe39dcb572/copy-manifests/0.log" Jun 10 13:00:28.158124 ip-10-0-133-72 kubenswrapper[2557]: I0610 13:00:28.158062 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-54854d4f7-6r5ts_f2c1aa38-3ae3-42a3-8332-b8dccb49cfda/manager/0.log" Jun 10 13:00:30.579383 ip-10-0-133-72 kubenswrapper[2557]: I0610 13:00:30.579351 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795bqqck_1f70e904-fbfd-4b35-8fea-99805c3c5690/istio-proxy/0.log" Jun 10 13:00:30.698394 ip-10-0-133-72 kubenswrapper[2557]: I0610 13:00:30.698360 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-djdfb_417bf846-d5a5-4acc-a10f-901fa12dbdbf/istio-proxy/1.log" Jun 10 13:00:30.698768 ip-10-0-133-72 kubenswrapper[2557]: I0610 13:00:30.698730 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-djdfb_417bf846-d5a5-4acc-a10f-901fa12dbdbf/istio-proxy/0.log" Jun 10 13:00:30.714347 ip-10-0-133-72 kubenswrapper[2557]: I0610 13:00:30.714292 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-2mm42_d0033ace-4459-4996-88d9-e181b05736de/payload-pre-processing/0.log" Jun 10 13:00:31.810925 ip-10-0-133-72 kubenswrapper[2557]: I0610 13:00:31.810888 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795bqqck_1f70e904-fbfd-4b35-8fea-99805c3c5690/istio-proxy/0.log" Jun 10 13:00:31.917998 ip-10-0-133-72 kubenswrapper[2557]: I0610 13:00:31.917897 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-djdfb_417bf846-d5a5-4acc-a10f-901fa12dbdbf/istio-proxy/1.log" Jun 10 13:00:31.918349 ip-10-0-133-72 kubenswrapper[2557]: I0610 13:00:31.918331 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-djdfb_417bf846-d5a5-4acc-a10f-901fa12dbdbf/istio-proxy/0.log" Jun 10 13:00:31.932010 ip-10-0-133-72 kubenswrapper[2557]: I0610 13:00:31.931988 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-2mm42_d0033ace-4459-4996-88d9-e181b05736de/payload-pre-processing/0.log"