Jun 10 13:14:52.601133 ip-10-0-136-19 systemd[1]: Starting Kubernetes Kubelet... Jun 10 13:14:53.048311 ip-10-0-136-19 kubenswrapper[2567]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 13:14:53.048311 ip-10-0-136-19 kubenswrapper[2567]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 10 13:14:53.048311 ip-10-0-136-19 kubenswrapper[2567]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 13:14:53.048311 ip-10-0-136-19 kubenswrapper[2567]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 10 13:14:53.048311 ip-10-0-136-19 kubenswrapper[2567]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 13:14:53.049355 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.049243 2567 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 10 13:14:53.054113 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054088 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 13:14:53.054113 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054105 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 13:14:53.054113 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054110 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 13:14:53.054113 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054116 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 13:14:53.054113 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054120 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 13:14:53.054406 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054124 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 13:14:53.054406 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054128 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 13:14:53.054406 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054132 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 13:14:53.054406 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054135 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 13:14:53.054406 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054139 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 13:14:53.054406 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054143 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 13:14:53.054406 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054147 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 13:14:53.054406 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054150 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 13:14:53.054406 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054154 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 13:14:53.054406 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054158 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 13:14:53.054406 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054161 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 13:14:53.054406 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054165 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 13:14:53.054406 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054169 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 13:14:53.054406 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054173 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 13:14:53.054406 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054177 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 13:14:53.054406 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054181 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 13:14:53.054406 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054184 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 13:14:53.054406 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054188 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 13:14:53.054406 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054203 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 13:14:53.055189 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054211 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 13:14:53.055189 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054215 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 13:14:53.055189 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054219 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 13:14:53.055189 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054224 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 13:14:53.055189 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054228 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 13:14:53.055189 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054234 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 13:14:53.055189 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054239 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 13:14:53.055189 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054244 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 13:14:53.055189 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054254 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 13:14:53.055189 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054259 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 13:14:53.055189 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054264 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 13:14:53.055189 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054268 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 13:14:53.055189 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054272 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 10 13:14:53.055189 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054276 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 13:14:53.055189 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054281 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 13:14:53.055189 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054286 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 13:14:53.055189 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054290 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 13:14:53.055189 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054294 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 13:14:53.055189 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054299 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 13:14:53.055189 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054304 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 13:14:53.056041 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054308 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 13:14:53.056041 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054312 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 13:14:53.056041 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054316 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 13:14:53.056041 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054320 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 13:14:53.056041 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054325 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 13:14:53.056041 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054329 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 13:14:53.056041 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054335 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 13:14:53.056041 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054339 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 13:14:53.056041 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054344 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 13:14:53.056041 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054348 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 13:14:53.056041 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054352 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 13:14:53.056041 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054356 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 13:14:53.056041 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054360 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 13:14:53.056041 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054365 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 13:14:53.056041 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054369 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 13:14:53.056041 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054373 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 13:14:53.056041 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054377 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 13:14:53.056041 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054382 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 13:14:53.056041 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054386 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 13:14:53.056041 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054390 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 13:14:53.056905 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054394 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 13:14:53.056905 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054399 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 13:14:53.056905 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054402 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 13:14:53.056905 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054406 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 13:14:53.056905 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054410 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 13:14:53.056905 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054414 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 13:14:53.056905 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054420 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 13:14:53.056905 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054425 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 13:14:53.056905 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054429 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 13:14:53.056905 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054434 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 13:14:53.056905 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054438 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 13:14:53.056905 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054445 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 13:14:53.056905 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054449 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 13:14:53.056905 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054453 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 13:14:53.056905 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054460 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 13:14:53.056905 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054465 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 13:14:53.056905 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054469 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 13:14:53.056905 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054474 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 13:14:53.056905 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054479 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 13:14:53.056905 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054485 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 13:14:53.057734 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054489 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 13:14:53.057734 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054494 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 13:14:53.057734 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054498 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 13:14:53.057734 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054502 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 13:14:53.057734 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054506 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 13:14:53.057734 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054510 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 13:14:53.057734 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054515 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 13:14:53.057734 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054520 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 13:14:53.057734 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054524 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 13:14:53.057734 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054536 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 13:14:53.057734 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054540 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 13:14:53.057734 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054544 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 13:14:53.057734 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054549 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 13:14:53.057734 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054553 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 13:14:53.057734 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.054557 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 13:14:53.057734 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.055749 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 13:14:53.057734 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.055760 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 13:14:53.057734 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.055765 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 13:14:53.057734 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.055771 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 13:14:53.058569 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.055775 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 13:14:53.058569 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.055780 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 13:14:53.058569 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.055784 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 13:14:53.058569 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.055789 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 13:14:53.058569 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.055794 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 13:14:53.058569 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.055798 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 13:14:53.058569 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.055802 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 13:14:53.058569 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.055806 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 13:14:53.058569 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.055810 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 13:14:53.058569 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.055815 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 13:14:53.058569 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.055822 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 13:14:53.058569 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.055828 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 13:14:53.058569 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.055832 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 13:14:53.058569 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.055855 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 13:14:53.058569 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.055861 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 13:14:53.058569 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.055865 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 13:14:53.058569 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.055869 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 13:14:53.058569 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.055874 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 13:14:53.058569 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.055878 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 10 13:14:53.059225 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.055882 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 13:14:53.059225 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.055886 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 13:14:53.059225 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.055891 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 13:14:53.059225 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.055895 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 13:14:53.059225 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.055900 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 13:14:53.059225 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.055904 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 13:14:53.059225 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.055910 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 13:14:53.059225 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.055916 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 13:14:53.059225 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.055920 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 13:14:53.059225 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.055926 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 13:14:53.059225 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.055931 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 13:14:53.059225 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.055935 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 13:14:53.059225 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.055940 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 13:14:53.059225 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.055944 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 13:14:53.059225 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.055948 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 13:14:53.059225 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.055952 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 13:14:53.059225 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.055956 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 13:14:53.059225 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.055963 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 13:14:53.059225 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.055968 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 13:14:53.059735 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.055973 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 13:14:53.059735 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.055978 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 13:14:53.059735 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.055983 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 13:14:53.059735 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.055987 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 13:14:53.059735 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.055991 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 13:14:53.059735 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.055995 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 13:14:53.059735 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.055999 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 13:14:53.059735 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.056003 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 13:14:53.059735 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.056008 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 13:14:53.059735 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.056013 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 13:14:53.059735 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.056017 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 13:14:53.059735 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.056021 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 13:14:53.059735 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.056025 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 13:14:53.059735 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.056030 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 13:14:53.059735 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.056034 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 13:14:53.059735 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.056037 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 13:14:53.059735 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.056041 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 13:14:53.059735 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.056046 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 13:14:53.059735 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.056049 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 13:14:53.059735 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.056053 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 13:14:53.060326 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.056057 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 13:14:53.060326 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.056061 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 13:14:53.060326 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.056065 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 13:14:53.060326 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.056070 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 13:14:53.060326 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.056074 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 13:14:53.060326 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.056079 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 13:14:53.060326 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.056083 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 13:14:53.060326 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.056088 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 13:14:53.060326 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.056094 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 13:14:53.060326 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.056098 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 13:14:53.060326 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.056102 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 13:14:53.060326 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.056106 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 13:14:53.060326 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.056111 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 13:14:53.060326 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.056115 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 13:14:53.060326 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.056119 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 13:14:53.060326 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.056124 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 13:14:53.060326 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.056128 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 13:14:53.060326 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.056132 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 13:14:53.060326 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.056136 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 13:14:53.060326 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.056140 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 13:14:53.061059 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.056145 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 13:14:53.061059 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.056150 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 13:14:53.061059 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.056154 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 13:14:53.061059 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.056159 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 13:14:53.061059 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.056163 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 13:14:53.061059 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.056168 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 13:14:53.061059 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.056172 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 13:14:53.061059 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.056176 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 13:14:53.061059 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.056181 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 13:14:53.061059 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.056185 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 13:14:53.061059 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.056189 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 13:14:53.061059 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.056199 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 13:14:53.061059 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.056204 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 13:14:53.061059 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.056208 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 13:14:53.061059 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.056213 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 13:14:53.061059 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.056217 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 13:14:53.061059 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.056221 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 13:14:53.061059 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.056827 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 13:14:53.061059 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.056850 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 13:14:53.061059 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.056855 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 13:14:53.061563 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.056859 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 13:14:53.061563 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.056864 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 13:14:53.061563 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.056868 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 13:14:53.061563 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.056872 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 13:14:53.061563 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.056876 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 13:14:53.061563 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.056881 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 13:14:53.061563 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.056885 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 13:14:53.061563 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.056889 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 13:14:53.061563 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.056893 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 13:14:53.061563 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.056900 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 13:14:53.061563 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.056904 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 13:14:53.061563 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.056908 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 13:14:53.061563 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.056912 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 13:14:53.061563 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.056917 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 13:14:53.061563 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.056921 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 13:14:53.061563 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.056925 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 13:14:53.061563 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.056929 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 13:14:53.061563 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.056933 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 13:14:53.061563 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.056937 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 13:14:53.061563 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.056942 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 10 13:14:53.062147 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.056946 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 13:14:53.062147 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.056951 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 13:14:53.062147 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.056955 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 13:14:53.062147 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.056960 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 13:14:53.062147 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.056965 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 13:14:53.062147 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.056969 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 13:14:53.062147 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.056973 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 13:14:53.062147 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.056977 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 13:14:53.062147 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.056981 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 13:14:53.062147 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.056986 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 13:14:53.062147 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.056991 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 13:14:53.062147 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.056995 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 13:14:53.062147 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.056999 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 13:14:53.062147 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.057003 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 13:14:53.062147 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.057007 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 13:14:53.062147 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.057011 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 13:14:53.062147 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.057015 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 13:14:53.062147 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.057019 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 13:14:53.062147 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.057023 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 13:14:53.062147 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.057028 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 13:14:53.062638 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.057032 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 13:14:53.062638 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.057039 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 13:14:53.062638 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.057045 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 13:14:53.062638 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.057051 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 13:14:53.062638 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.057056 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 13:14:53.062638 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.057061 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 13:14:53.062638 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.057066 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 13:14:53.062638 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.057071 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 13:14:53.062638 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.057076 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 13:14:53.062638 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.057080 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 13:14:53.062638 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.057085 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 13:14:53.062638 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.057090 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 13:14:53.062638 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.057097 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 13:14:53.062638 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.057101 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 13:14:53.062638 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.057105 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 13:14:53.062638 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.057110 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 13:14:53.062638 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.057114 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 13:14:53.062638 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.057119 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 13:14:53.062638 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.057123 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 13:14:53.063138 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.057127 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 13:14:53.063138 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.057132 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 13:14:53.063138 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.057136 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 13:14:53.063138 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.057140 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 13:14:53.063138 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.057144 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 13:14:53.063138 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.057148 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 13:14:53.063138 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.057155 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 13:14:53.063138 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.057159 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 13:14:53.063138 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.057163 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 13:14:53.063138 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.057167 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 13:14:53.063138 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.057172 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 13:14:53.063138 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.057176 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 13:14:53.063138 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.057180 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 13:14:53.063138 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.057185 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 13:14:53.063138 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.057189 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 13:14:53.063138 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.057193 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 13:14:53.063138 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.057197 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 13:14:53.063138 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.057201 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 13:14:53.063138 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.057205 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 13:14:53.063138 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.057209 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 13:14:53.063629 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.057215 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 13:14:53.063629 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.057219 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 13:14:53.063629 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.057223 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 13:14:53.063629 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.057227 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 13:14:53.063629 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.057231 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 13:14:53.063629 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.057237 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 13:14:53.063629 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.057242 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 13:14:53.063629 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.057246 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 13:14:53.063629 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.057250 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 13:14:53.063629 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.057254 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 13:14:53.063629 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.057258 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 13:14:53.063629 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.057263 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 13:14:53.063629 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.057269 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 13:14:53.063629 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.057275 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 13:14:53.063629 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.057280 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 13:14:53.063629 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.057284 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 13:14:53.063629 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.057289 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 13:14:53.063629 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057388 2567 flags.go:64] FLAG: --address="0.0.0.0" Jun 10 13:14:53.063629 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057399 2567 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 10 13:14:53.063629 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057408 2567 flags.go:64] FLAG: --anonymous-auth="true" Jun 10 13:14:53.063629 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057415 2567 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 10 13:14:53.064161 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057422 2567 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 10 13:14:53.064161 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057427 2567 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 10 13:14:53.064161 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057434 2567 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 10 13:14:53.064161 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057440 2567 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 10 13:14:53.064161 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057445 2567 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 10 13:14:53.064161 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057451 2567 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 10 13:14:53.064161 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057457 2567 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 10 13:14:53.064161 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057462 2567 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 10 13:14:53.064161 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057468 2567 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 10 13:14:53.064161 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057472 2567 flags.go:64] FLAG: --cgroup-root="" Jun 10 13:14:53.064161 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057477 2567 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 10 13:14:53.064161 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057482 2567 flags.go:64] FLAG: --client-ca-file="" Jun 10 13:14:53.064161 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057487 2567 flags.go:64] FLAG: --cloud-provider="external" Jun 10 13:14:53.064161 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057492 2567 flags.go:64] FLAG: --cluster-dns="[]" Jun 10 13:14:53.064161 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057498 2567 flags.go:64] FLAG: --cluster-domain="" Jun 10 13:14:53.064161 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057502 2567 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 10 13:14:53.064161 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057509 2567 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 10 13:14:53.064161 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057514 2567 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 10 13:14:53.064161 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057520 2567 flags.go:64] FLAG: --container-log-max-files="5" Jun 10 13:14:53.064161 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057526 2567 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 10 13:14:53.064161 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057530 2567 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 10 13:14:53.064161 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057535 2567 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 10 13:14:53.064161 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057541 2567 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 10 13:14:53.064786 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057545 2567 flags.go:64] FLAG: --contention-profiling="false" Jun 10 13:14:53.064786 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057550 2567 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 10 13:14:53.064786 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057555 2567 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 10 13:14:53.064786 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057560 2567 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 10 13:14:53.064786 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057564 2567 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 10 13:14:53.064786 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057571 2567 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 10 13:14:53.064786 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057576 2567 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 10 13:14:53.064786 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057581 2567 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 10 13:14:53.064786 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057586 2567 flags.go:64] FLAG: --enable-load-reader="false" Jun 10 13:14:53.064786 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057590 2567 flags.go:64] FLAG: --enable-server="true" Jun 10 13:14:53.064786 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057595 2567 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 10 13:14:53.064786 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057602 2567 flags.go:64] FLAG: --event-burst="100" Jun 10 13:14:53.064786 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057607 2567 flags.go:64] FLAG: --event-qps="50" Jun 10 13:14:53.064786 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057611 2567 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 10 13:14:53.064786 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057616 2567 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 10 13:14:53.064786 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057620 2567 flags.go:64] FLAG: --eviction-hard="" Jun 10 13:14:53.064786 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057627 2567 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 10 13:14:53.064786 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057632 2567 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 10 13:14:53.064786 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057636 2567 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 10 13:14:53.064786 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057641 2567 flags.go:64] FLAG: --eviction-soft="" Jun 10 13:14:53.064786 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057646 2567 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 10 13:14:53.064786 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057651 2567 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 10 13:14:53.064786 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057660 2567 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 10 13:14:53.064786 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057666 2567 flags.go:64] FLAG: --experimental-mounter-path="" Jun 10 13:14:53.064786 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057670 2567 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 10 13:14:53.065454 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057676 2567 flags.go:64] FLAG: --fail-swap-on="true" Jun 10 13:14:53.065454 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057681 2567 flags.go:64] FLAG: --feature-gates="" Jun 10 13:14:53.065454 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057687 2567 flags.go:64] FLAG: --file-check-frequency="20s" Jun 10 13:14:53.065454 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057694 2567 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 10 13:14:53.065454 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057700 2567 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 10 13:14:53.065454 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057705 2567 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 10 13:14:53.065454 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057710 2567 flags.go:64] FLAG: --healthz-port="10248" Jun 10 13:14:53.065454 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057715 2567 flags.go:64] FLAG: --help="false" Jun 10 13:14:53.065454 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057719 2567 flags.go:64] FLAG: --hostname-override="ip-10-0-136-19.ec2.internal" Jun 10 13:14:53.065454 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057725 2567 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 10 13:14:53.065454 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057729 2567 flags.go:64] FLAG: --http-check-frequency="20s" Jun 10 13:14:53.065454 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057733 2567 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 10 13:14:53.065454 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057739 2567 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 10 13:14:53.065454 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057744 2567 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 10 13:14:53.065454 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057748 2567 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 10 13:14:53.065454 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057752 2567 flags.go:64] FLAG: --image-service-endpoint="" Jun 10 13:14:53.065454 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057757 2567 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 10 13:14:53.065454 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057762 2567 flags.go:64] FLAG: --kube-api-burst="100" Jun 10 13:14:53.065454 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057767 2567 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 10 13:14:53.065454 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057772 2567 flags.go:64] FLAG: --kube-api-qps="50" Jun 10 13:14:53.065454 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057777 2567 flags.go:64] FLAG: --kube-reserved="" Jun 10 13:14:53.065454 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057781 2567 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 10 13:14:53.065454 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057786 2567 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 10 13:14:53.065454 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057791 2567 flags.go:64] FLAG: --kubelet-cgroups="" Jun 10 13:14:53.066189 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057795 2567 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 10 13:14:53.066189 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057800 2567 flags.go:64] FLAG: --lock-file="" Jun 10 13:14:53.066189 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057805 2567 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 10 13:14:53.066189 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057809 2567 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 10 13:14:53.066189 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057814 2567 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 10 13:14:53.066189 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057823 2567 flags.go:64] FLAG: --log-json-split-stream="false" Jun 10 13:14:53.066189 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057828 2567 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 10 13:14:53.066189 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057834 2567 flags.go:64] FLAG: --log-text-split-stream="false" Jun 10 13:14:53.066189 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057866 2567 flags.go:64] FLAG: --logging-format="text" Jun 10 13:14:53.066189 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057871 2567 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 10 13:14:53.066189 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057876 2567 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 10 13:14:53.066189 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057883 2567 flags.go:64] FLAG: --manifest-url="" Jun 10 13:14:53.066189 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057888 2567 flags.go:64] FLAG: --manifest-url-header="" Jun 10 13:14:53.066189 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057894 2567 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 10 13:14:53.066189 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057899 2567 flags.go:64] FLAG: --max-open-files="1000000" Jun 10 13:14:53.066189 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057905 2567 flags.go:64] FLAG: --max-pods="110" Jun 10 13:14:53.066189 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057910 2567 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 10 13:14:53.066189 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057914 2567 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 10 13:14:53.066189 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057919 2567 flags.go:64] FLAG: --memory-manager-policy="None" Jun 10 13:14:53.066189 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057924 2567 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 10 13:14:53.066189 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057929 2567 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 10 13:14:53.066189 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057934 2567 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 10 13:14:53.066189 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057939 2567 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 10 13:14:53.066189 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057950 2567 flags.go:64] FLAG: --node-status-max-images="50" Jun 10 13:14:53.066189 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057954 2567 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 10 13:14:53.066791 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057960 2567 flags.go:64] FLAG: --oom-score-adj="-999" Jun 10 13:14:53.066791 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057965 2567 flags.go:64] FLAG: --pod-cidr="" Jun 10 13:14:53.066791 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057969 2567 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 10 13:14:53.066791 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057977 2567 flags.go:64] FLAG: --pod-manifest-path="" Jun 10 13:14:53.066791 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057982 2567 flags.go:64] FLAG: --pod-max-pids="-1" Jun 10 13:14:53.066791 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057986 2567 flags.go:64] FLAG: --pods-per-core="0" Jun 10 13:14:53.066791 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057991 2567 flags.go:64] FLAG: --port="10250" Jun 10 13:14:53.066791 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.057996 2567 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 10 13:14:53.066791 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.058000 2567 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-01c6ee3ede58224d9" Jun 10 13:14:53.066791 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.058005 2567 flags.go:64] FLAG: --qos-reserved="" Jun 10 13:14:53.066791 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.058010 2567 flags.go:64] FLAG: --read-only-port="10255" Jun 10 13:14:53.066791 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.058015 2567 flags.go:64] FLAG: --register-node="true" Jun 10 13:14:53.066791 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.058020 2567 flags.go:64] FLAG: --register-with-taints="" Jun 10 13:14:53.066791 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.058025 2567 flags.go:64] FLAG: --registry-burst="10" Jun 10 13:14:53.066791 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.058031 2567 flags.go:64] FLAG: --registry-qps="5" Jun 10 13:14:53.066791 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.058038 2567 flags.go:64] FLAG: --reserved-cpus="" Jun 10 13:14:53.066791 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.058043 2567 flags.go:64] FLAG: --reserved-memory="" Jun 10 13:14:53.066791 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.058049 2567 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 10 13:14:53.066791 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.058054 2567 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 10 13:14:53.066791 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.058061 2567 flags.go:64] FLAG: --rotate-certificates="false" Jun 10 13:14:53.066791 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.058066 2567 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 10 13:14:53.066791 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.058070 2567 flags.go:64] FLAG: --runonce="false" Jun 10 13:14:53.066791 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.058075 2567 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 10 13:14:53.066791 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.058080 2567 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 10 13:14:53.066791 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.058085 2567 flags.go:64] FLAG: --seccomp-default="false" Jun 10 13:14:53.067431 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.058089 2567 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 10 13:14:53.067431 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.058094 2567 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 10 13:14:53.067431 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.058099 2567 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 10 13:14:53.067431 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.058104 2567 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 10 13:14:53.067431 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.058109 2567 flags.go:64] FLAG: --storage-driver-password="root" Jun 10 13:14:53.067431 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.058114 2567 flags.go:64] FLAG: --storage-driver-secure="false" Jun 10 13:14:53.067431 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.058118 2567 flags.go:64] FLAG: --storage-driver-table="stats" Jun 10 13:14:53.067431 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.058123 2567 flags.go:64] FLAG: --storage-driver-user="root" Jun 10 13:14:53.067431 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.058128 2567 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 10 13:14:53.067431 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.058133 2567 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 10 13:14:53.067431 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.058138 2567 flags.go:64] FLAG: --system-cgroups="" Jun 10 13:14:53.067431 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.058143 2567 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 10 13:14:53.067431 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.058151 2567 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 10 13:14:53.067431 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.058156 2567 flags.go:64] FLAG: --tls-cert-file="" Jun 10 13:14:53.067431 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.058160 2567 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 10 13:14:53.067431 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.058167 2567 flags.go:64] FLAG: --tls-min-version="" Jun 10 13:14:53.067431 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.058172 2567 flags.go:64] FLAG: --tls-private-key-file="" Jun 10 13:14:53.067431 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.058176 2567 flags.go:64] FLAG: --topology-manager-policy="none" Jun 10 13:14:53.067431 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.058181 2567 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 10 13:14:53.067431 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.058186 2567 flags.go:64] FLAG: --topology-manager-scope="container" Jun 10 13:14:53.067431 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.058190 2567 flags.go:64] FLAG: --v="2" Jun 10 13:14:53.067431 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.058197 2567 flags.go:64] FLAG: --version="false" Jun 10 13:14:53.067431 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.058209 2567 flags.go:64] FLAG: --vmodule="" Jun 10 13:14:53.067431 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.058221 2567 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 10 13:14:53.067431 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.058227 2567 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 10 13:14:53.068065 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058397 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 13:14:53.068065 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058405 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 13:14:53.068065 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058410 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 13:14:53.068065 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058415 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 13:14:53.068065 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058420 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 13:14:53.068065 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058424 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 13:14:53.068065 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058431 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 13:14:53.068065 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058437 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 10 13:14:53.068065 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058443 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 13:14:53.068065 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058448 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 13:14:53.068065 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058454 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 13:14:53.068065 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058458 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 13:14:53.068065 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058463 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 13:14:53.068065 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058467 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 13:14:53.068065 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058471 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 13:14:53.068065 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058476 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 13:14:53.068065 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058480 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 13:14:53.068065 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058484 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 13:14:53.068065 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058488 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 13:14:53.068548 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058493 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 13:14:53.068548 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058497 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 13:14:53.068548 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058501 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 13:14:53.068548 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058505 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 13:14:53.068548 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058510 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 13:14:53.068548 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058515 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 13:14:53.068548 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058519 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 13:14:53.068548 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058523 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 13:14:53.068548 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058527 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 13:14:53.068548 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058531 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 13:14:53.068548 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058537 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 13:14:53.068548 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058542 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 13:14:53.068548 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058547 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 13:14:53.068548 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058551 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 13:14:53.068548 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058556 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 13:14:53.068548 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058560 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 13:14:53.068548 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058565 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 13:14:53.068548 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058569 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 13:14:53.068548 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058573 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 13:14:53.068548 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058576 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 13:14:53.069063 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058580 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 13:14:53.069063 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058584 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 13:14:53.069063 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058588 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 13:14:53.069063 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058592 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 13:14:53.069063 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058597 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 13:14:53.069063 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058601 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 13:14:53.069063 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058605 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 13:14:53.069063 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058610 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 13:14:53.069063 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058614 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 13:14:53.069063 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058618 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 13:14:53.069063 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058622 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 13:14:53.069063 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058626 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 13:14:53.069063 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058630 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 13:14:53.069063 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058635 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 13:14:53.069063 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058639 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 13:14:53.069063 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058643 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 13:14:53.069063 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058647 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 13:14:53.069063 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058652 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 13:14:53.069063 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058656 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 13:14:53.069533 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058660 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 13:14:53.069533 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058664 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 13:14:53.069533 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058668 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 13:14:53.069533 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058674 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 13:14:53.069533 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058678 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 13:14:53.069533 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058683 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 13:14:53.069533 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058687 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 13:14:53.069533 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058693 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 13:14:53.069533 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058700 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 13:14:53.069533 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058705 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 13:14:53.069533 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058709 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 13:14:53.069533 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058713 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 13:14:53.069533 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058717 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 13:14:53.069533 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058722 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 13:14:53.069533 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058725 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 13:14:53.069533 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058730 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 13:14:53.069533 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058734 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 13:14:53.069533 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058738 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 13:14:53.069533 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058743 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 13:14:53.069533 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058747 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 13:14:53.070044 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058751 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 13:14:53.070044 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058755 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 13:14:53.070044 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058760 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 13:14:53.070044 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058764 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 13:14:53.070044 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058768 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 13:14:53.070044 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058772 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 13:14:53.070044 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058776 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 13:14:53.070044 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058781 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 13:14:53.070044 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058785 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 13:14:53.070044 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058789 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 13:14:53.070044 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058793 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 13:14:53.070044 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058797 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 13:14:53.070044 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058801 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 13:14:53.070044 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058805 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 13:14:53.070044 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058809 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 13:14:53.070044 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058815 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 13:14:53.070044 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058819 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 13:14:53.070044 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058823 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 13:14:53.070044 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058828 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 13:14:53.070044 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058852 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 13:14:53.070527 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.058857 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 13:14:53.070527 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.059674 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 13:14:53.070527 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.066649 2567 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 10 13:14:53.070527 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.066665 2567 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 10 13:14:53.070527 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.066678 2567 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 10 13:14:53.070527 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.066683 2567 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 10 13:14:53.070527 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.066733 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 13:14:53.070527 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.066738 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 13:14:53.070527 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.066741 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 13:14:53.070527 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.066744 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 13:14:53.070527 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.066747 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 13:14:53.070527 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.066750 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 13:14:53.070527 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.066753 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 13:14:53.070527 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.066755 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 13:14:53.070527 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.066758 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 13:14:53.071014 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.066761 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 13:14:53.071014 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.066763 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 13:14:53.071014 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.066766 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 13:14:53.071014 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.066769 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 13:14:53.071014 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.066772 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 13:14:53.071014 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.066774 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 13:14:53.071014 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.066777 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 13:14:53.071014 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.066780 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 10 13:14:53.071014 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.066783 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 13:14:53.071014 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.066787 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 13:14:53.071014 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.066790 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 13:14:53.071014 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.066793 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 13:14:53.071014 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.066797 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 13:14:53.071014 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.066799 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 13:14:53.071014 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.066802 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 13:14:53.071014 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.066806 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 13:14:53.071014 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.066809 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 13:14:53.071014 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.066813 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 13:14:53.071014 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.066815 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 13:14:53.071014 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.066817 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 13:14:53.071504 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.066821 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 13:14:53.071504 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.066823 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 13:14:53.071504 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.066827 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 13:14:53.071504 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.066829 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 13:14:53.071504 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.066832 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 13:14:53.071504 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.066850 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 13:14:53.071504 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.066853 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 13:14:53.071504 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.066856 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 13:14:53.071504 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.066858 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 13:14:53.071504 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.066861 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 13:14:53.071504 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.066864 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 13:14:53.071504 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.066866 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 13:14:53.071504 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.066869 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 13:14:53.071504 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.066872 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 13:14:53.071504 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.066874 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 13:14:53.071504 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.066877 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 13:14:53.071504 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.066880 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 13:14:53.071504 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.066882 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 13:14:53.071504 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.066885 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 13:14:53.071504 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.066888 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 13:14:53.072031 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.066890 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 13:14:53.072031 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.066893 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 13:14:53.072031 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.066896 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 13:14:53.072031 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.066898 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 13:14:53.072031 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.066901 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 13:14:53.072031 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.066903 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 13:14:53.072031 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.066906 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 13:14:53.072031 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.066908 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 13:14:53.072031 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.066911 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 13:14:53.072031 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.066914 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 13:14:53.072031 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.066917 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 13:14:53.072031 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.066921 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 13:14:53.072031 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.066925 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 13:14:53.072031 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.066928 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 13:14:53.072031 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.066931 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 13:14:53.072031 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.066933 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 13:14:53.072031 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.066936 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 13:14:53.072031 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.066938 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 13:14:53.072031 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.066941 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 13:14:53.072495 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.066944 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 13:14:53.072495 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.066946 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 13:14:53.072495 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.066950 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 13:14:53.072495 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.066954 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 13:14:53.072495 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.066957 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 13:14:53.072495 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.066959 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 13:14:53.072495 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.066962 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 13:14:53.072495 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.066964 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 13:14:53.072495 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.066967 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 13:14:53.072495 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.066970 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 13:14:53.072495 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.066972 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 13:14:53.072495 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.066975 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 13:14:53.072495 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.066978 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 13:14:53.072495 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.066980 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 13:14:53.072495 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.066983 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 13:14:53.072495 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.066985 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 13:14:53.072495 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.066988 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 13:14:53.072495 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.066990 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 13:14:53.072495 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.066993 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 13:14:53.072495 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.066995 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 13:14:53.073008 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.066998 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 13:14:53.073008 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067000 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 13:14:53.073008 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067003 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 13:14:53.073008 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067006 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 13:14:53.073008 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067009 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 13:14:53.073008 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067012 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 13:14:53.073008 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067015 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 13:14:53.073008 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067018 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 13:14:53.073008 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067020 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 13:14:53.073008 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067023 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 13:14:53.073008 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067025 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 13:14:53.073008 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.067030 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 13:14:53.073008 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067132 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 13:14:53.073008 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067137 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 13:14:53.073360 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067140 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 13:14:53.073360 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067142 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 13:14:53.073360 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067145 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 13:14:53.073360 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067148 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 13:14:53.073360 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067150 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 13:14:53.073360 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067153 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 13:14:53.073360 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067155 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 13:14:53.073360 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067158 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 13:14:53.073360 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067160 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 13:14:53.073360 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067163 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 13:14:53.073360 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067166 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 13:14:53.073360 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067168 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 13:14:53.073360 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067171 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 13:14:53.073360 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067173 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 13:14:53.073360 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067176 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 13:14:53.073360 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067178 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 13:14:53.073360 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067181 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 13:14:53.073360 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067185 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 13:14:53.073360 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067189 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 13:14:53.073846 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067192 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 13:14:53.073846 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067196 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 13:14:53.073846 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067200 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 13:14:53.073846 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067203 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 13:14:53.073846 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067206 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 13:14:53.073846 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067210 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 13:14:53.073846 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067213 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 13:14:53.073846 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067216 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 13:14:53.073846 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067218 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 13:14:53.073846 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067221 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 13:14:53.073846 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067223 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 13:14:53.073846 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067226 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 13:14:53.073846 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067228 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 13:14:53.073846 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067231 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 13:14:53.073846 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067233 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 13:14:53.073846 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067236 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 13:14:53.073846 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067239 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 13:14:53.073846 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067241 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 13:14:53.073846 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067244 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 13:14:53.074314 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067246 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 13:14:53.074314 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067249 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 13:14:53.074314 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067252 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 13:14:53.074314 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067254 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 13:14:53.074314 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067257 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 13:14:53.074314 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067260 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 13:14:53.074314 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067262 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 13:14:53.074314 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067265 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 13:14:53.074314 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067267 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 13:14:53.074314 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067270 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 13:14:53.074314 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067272 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 13:14:53.074314 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067275 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 13:14:53.074314 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067277 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 13:14:53.074314 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067280 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 13:14:53.074314 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067282 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 13:14:53.074314 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067285 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 13:14:53.074314 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067288 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 13:14:53.074314 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067291 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 13:14:53.074314 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067294 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 13:14:53.074314 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067296 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 13:14:53.074788 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067299 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 13:14:53.074788 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067302 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 13:14:53.074788 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067304 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 13:14:53.074788 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067307 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 13:14:53.074788 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067309 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 13:14:53.074788 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067312 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 13:14:53.074788 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067315 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 13:14:53.074788 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067318 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 13:14:53.074788 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067320 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 13:14:53.074788 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067323 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 13:14:53.074788 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067325 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 13:14:53.074788 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067327 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 13:14:53.074788 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067330 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 13:14:53.074788 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067332 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 13:14:53.074788 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067335 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 13:14:53.074788 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067337 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 13:14:53.074788 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067340 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 13:14:53.074788 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067342 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 13:14:53.074788 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067345 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 13:14:53.074788 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067347 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 13:14:53.075406 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067350 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 13:14:53.075406 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067353 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 13:14:53.075406 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067356 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 13:14:53.075406 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067359 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 13:14:53.075406 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067361 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 13:14:53.075406 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067364 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 13:14:53.075406 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067367 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 13:14:53.075406 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067370 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 10 13:14:53.075406 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067372 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 13:14:53.075406 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067375 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 13:14:53.075406 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067378 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 13:14:53.075406 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067381 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 13:14:53.075406 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067383 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 13:14:53.075406 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067386 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 13:14:53.075406 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067389 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 13:14:53.075406 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067391 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 13:14:53.075406 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067394 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 13:14:53.075406 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067396 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 13:14:53.075406 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:53.067399 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 13:14:53.075868 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.067404 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 13:14:53.075868 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.067493 2567 server.go:962] "Client rotation is on, will bootstrap in background" Jun 10 13:14:53.075868 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.069290 2567 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 10 13:14:53.075868 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.071027 2567 server.go:1019] "Starting client certificate rotation" Jun 10 13:14:53.075868 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.071132 2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 10 13:14:53.075868 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.072226 2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 10 13:14:53.075868 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.073832 2567 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 10 13:14:53.075868 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.075078 2567 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 10 13:14:53.091133 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.091111 2567 log.go:25] "Validated CRI v1 runtime API" Jun 10 13:14:53.093429 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.093414 2567 log.go:25] "Validated CRI v1 image API" Jun 10 13:14:53.094206 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.094191 2567 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 10 13:14:53.096560 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.096540 2567 fs.go:135] Filesystem UUIDs: map[6426d2c0-e742-479c-83a0-b89f5e3d7dfb:/dev/nvme0n1p4 768d3ee5-bd63-4723-8644-a8e45141c6b0:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jun 10 13:14:53.096640 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.096559 2567 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 10 13:14:53.102180 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.102163 2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 10 13:14:53.102805 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.102689 2567 manager.go:216] Machine: {Timestamp:2026-06-10 13:14:53.101134106 +0000 UTC m=+0.366384694 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100398 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d84cbd24a79fd81fbad8a51c6f774 SystemUUID:ec2d84cb-d24a-79fd-81fb-ad8a51c6f774 BootID:4083fb70-a535-4f54-bb7e-b339889bc899 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:97:b1:41:28:d1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:97:b1:41:28:d1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:da:06:e4:73:6a:3c Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 10 13:14:53.102805 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.102804 2567 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 10 13:14:53.102962 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.102925 2567 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 10 13:14:53.107540 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.107519 2567 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 10 13:14:53.107669 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.107543 2567 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-19.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 10 13:14:53.108199 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.108189 2567 topology_manager.go:138] "Creating topology manager with none policy" Jun 10 13:14:53.108236 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.108200 2567 container_manager_linux.go:309] "Creating device plugin manager" Jun 10 13:14:53.108236 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.108207 2567 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 10 13:14:53.109163 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.109152 2567 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 10 13:14:53.110418 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.110408 2567 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 10 13:14:53.113326 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.113314 2567 state_mem.go:36] "Initialized new in-memory state store" Jun 10 13:14:53.113491 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.113480 2567 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 10 13:14:53.113531 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.113511 2567 kubelet.go:486] "Attempting to sync node with API server" Jun 10 13:14:53.113531 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.113530 2567 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 10 13:14:53.113592 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.113544 2567 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 10 13:14:53.113592 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.113554 2567 kubelet.go:398] "Adding apiserver pod source" Jun 10 13:14:53.113592 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.113562 2567 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 10 13:14:53.113907 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.113896 2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 10 13:14:53.113945 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.113916 2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 10 13:14:53.116520 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.116500 2567 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 10 13:14:53.118025 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.118011 2567 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 10 13:14:53.118087 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.118040 2567 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 10 13:14:53.119286 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.119274 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 10 13:14:53.119340 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.119289 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 10 13:14:53.119340 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.119296 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 10 13:14:53.119340 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.119301 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 10 13:14:53.119340 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.119311 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 10 13:14:53.119340 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.119316 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 10 13:14:53.119340 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.119324 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 10 13:14:53.119340 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.119330 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 10 13:14:53.119340 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.119336 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 10 13:14:53.119340 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.119341 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 10 13:14:53.119564 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.119350 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 10 13:14:53.119564 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.119355 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 10 13:14:53.121390 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.121378 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 10 13:14:53.121390 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.121391 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 10 13:14:53.122501 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:14:53.122465 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 10 13:14:53.123416 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.123395 2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-w42qr" Jun 10 13:14:53.123989 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:14:53.123969 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-19.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 10 13:14:53.124948 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.124935 2567 server.go:1268] "Started kubelet" Jun 10 13:14:53.125034 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.125010 2567 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 10 13:14:53.125122 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.125075 2567 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 10 13:14:53.125172 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.125144 2567 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 10 13:14:53.128391 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.128373 2567 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 10 13:14:53.128452 ip-10-0-136-19 systemd[1]: Started Kubernetes Kubelet. Jun 10 13:14:53.131346 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.131328 2567 server.go:310] "Adding debug handlers to kubelet server" Jun 10 13:14:53.133221 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:14:53.133183 2567 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 10 13:14:53.134169 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.134153 2567 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-19.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 10 13:14:53.134965 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.134948 2567 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 10 13:14:53.134965 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.134960 2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 10 13:14:53.135087 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:14:53.135020 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-19.ec2.internal\" not found" Jun 10 13:14:53.135444 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:14:53.134134 2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-19.ec2.internal.18b7ba8d2b1ead00 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-19.ec2.internal,UID:ip-10-0-136-19.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-19.ec2.internal,},FirstTimestamp:2026-06-10 13:14:53.12490624 +0000 UTC m=+0.390156843,LastTimestamp:2026-06-10 13:14:53.12490624 +0000 UTC m=+0.390156843,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-19.ec2.internal,}" Jun 10 13:14:53.135619 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.135606 2567 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 10 13:14:53.135688 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.135672 2567 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 10 13:14:53.135688 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.135686 2567 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 10 13:14:53.135782 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.135701 2567 factory.go:55] Registering systemd factory Jun 10 13:14:53.135782 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.135717 2567 factory.go:223] Registration of the systemd container factory successfully Jun 10 13:14:53.135782 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.135780 2567 reconstruct.go:97] "Volume reconstruction finished" Jun 10 13:14:53.135926 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.135789 2567 reconciler.go:29] "Reconciler: start to sync state" Jun 10 13:14:53.135970 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.135944 2567 factory.go:153] Registering CRI-O factory Jun 10 13:14:53.135970 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.135954 2567 factory.go:223] Registration of the crio container factory successfully Jun 10 13:14:53.136075 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.135994 2567 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 10 13:14:53.136075 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.136017 2567 factory.go:103] Registering Raw factory Jun 10 13:14:53.136075 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.136034 2567 manager.go:1196] Started watching for new ooms in manager Jun 10 13:14:53.136473 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.136459 2567 manager.go:349] Starting recovery of all containers Jun 10 13:14:53.137852 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:14:53.137823 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 10 13:14:53.137957 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:14:53.137927 2567 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-19.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 10 13:14:53.138297 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.138277 2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-w42qr" Jun 10 13:14:53.147287 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.147273 2567 manager.go:354] Recovery completed Jun 10 13:14:53.148732 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:14:53.148705 2567 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jun 10 13:14:53.151709 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.151697 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 13:14:53.153401 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.153379 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-19.ec2.internal" event="NodeHasSufficientMemory" Jun 10 13:14:53.153470 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.153408 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-19.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 13:14:53.153470 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.153422 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-19.ec2.internal" event="NodeHasSufficientPID" Jun 10 13:14:53.154016 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.153958 2567 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 10 13:14:53.154016 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.153971 2567 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 10 13:14:53.154016 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.153974 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 13:14:53.154016 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.153988 2567 state_mem.go:36] "Initialized new in-memory state store" Jun 10 13:14:53.154662 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.154650 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-19.ec2.internal" event="NodeHasSufficientMemory" Jun 10 13:14:53.154717 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.154674 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-19.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 13:14:53.154717 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.154688 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-19.ec2.internal" event="NodeHasSufficientPID" Jun 10 13:14:53.155604 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.155593 2567 policy_none.go:49] "None policy: Start" Jun 10 13:14:53.155638 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.155609 2567 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 10 13:14:53.155638 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.155628 2567 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 10 13:14:53.156737 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.156644 2567 policy_none.go:47] "Start" Jun 10 13:14:53.190446 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.190430 2567 manager.go:337] "Starting Device Plugin manager" Jun 10 13:14:53.204110 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:14:53.190460 2567 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 10 13:14:53.204110 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.190472 2567 server.go:87] "Starting device plugin registration server" Jun 10 13:14:53.204110 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.190695 2567 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 10 13:14:53.204110 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.190706 2567 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 10 13:14:53.204110 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.190809 2567 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 10 13:14:53.204110 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.190905 2567 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 10 13:14:53.204110 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.190913 2567 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 10 13:14:53.204110 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:14:53.191395 2567 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 10 13:14:53.204110 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:14:53.191440 2567 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-19.ec2.internal\" not found" Jun 10 13:14:53.204110 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.200788 2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 10 13:14:53.204110 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.201815 2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 10 13:14:53.204110 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.201858 2567 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 10 13:14:53.204110 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.201877 2567 kubelet.go:2448] "Starting kubelet main sync loop" Jun 10 13:14:53.204110 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:14:53.201905 2567 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 10 13:14:53.204110 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.203798 2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 13:14:53.291570 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.291519 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 13:14:53.292525 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.292506 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-19.ec2.internal" event="NodeHasSufficientMemory" Jun 10 13:14:53.292637 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.292536 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-19.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 13:14:53.292637 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.292552 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-19.ec2.internal" event="NodeHasSufficientPID" Jun 10 13:14:53.292637 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.292579 2567 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-19.ec2.internal" Jun 10 13:14:53.298814 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.298769 2567 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-19.ec2.internal" Jun 10 13:14:53.298814 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:14:53.298793 2567 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-19.ec2.internal\": node \"ip-10-0-136-19.ec2.internal\" not found" Jun 10 13:14:53.302134 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.302112 2567 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-19.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-19.ec2.internal"] Jun 10 13:14:53.302243 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.302184 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 13:14:53.303570 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.303556 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-19.ec2.internal" event="NodeHasSufficientMemory" Jun 10 13:14:53.303656 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.303588 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-19.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 13:14:53.303656 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.303601 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-19.ec2.internal" event="NodeHasSufficientPID" Jun 10 13:14:53.304967 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.304951 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 13:14:53.305084 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.305069 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-19.ec2.internal" Jun 10 13:14:53.305128 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.305100 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 13:14:53.305635 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.305620 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-19.ec2.internal" event="NodeHasSufficientMemory" Jun 10 13:14:53.305726 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.305639 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-19.ec2.internal" event="NodeHasSufficientMemory" Jun 10 13:14:53.305726 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.305649 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-19.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 13:14:53.305726 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.305662 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-19.ec2.internal" event="NodeHasSufficientPID" Jun 10 13:14:53.305726 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.305662 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-19.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 13:14:53.305726 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.305674 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-19.ec2.internal" event="NodeHasSufficientPID" Jun 10 13:14:53.307152 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.307136 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-19.ec2.internal" Jun 10 13:14:53.307243 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.307159 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 13:14:53.307785 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.307769 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-19.ec2.internal" event="NodeHasSufficientMemory" Jun 10 13:14:53.307902 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.307797 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-19.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 13:14:53.307902 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.307813 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-19.ec2.internal" event="NodeHasSufficientPID" Jun 10 13:14:53.312693 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:14:53.312677 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-19.ec2.internal\" not found" Jun 10 13:14:53.321355 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:14:53.321334 2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-19.ec2.internal\" not found" node="ip-10-0-136-19.ec2.internal" Jun 10 13:14:53.324592 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:14:53.324575 2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-19.ec2.internal\" not found" node="ip-10-0-136-19.ec2.internal" Jun 10 13:14:53.337378 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.337359 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fa45664cf77ef7584d59a465af594f4b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-19.ec2.internal\" (UID: \"fa45664cf77ef7584d59a465af594f4b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-19.ec2.internal" Jun 10 13:14:53.337447 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.337382 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa45664cf77ef7584d59a465af594f4b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-19.ec2.internal\" (UID: \"fa45664cf77ef7584d59a465af594f4b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-19.ec2.internal" Jun 10 13:14:53.337447 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.337397 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/42d2d3b59dbeb7d6f92fb6b1848e3017-config\") pod \"kube-apiserver-proxy-ip-10-0-136-19.ec2.internal\" (UID: \"42d2d3b59dbeb7d6f92fb6b1848e3017\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-19.ec2.internal" Jun 10 13:14:53.413077 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:14:53.413051 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-19.ec2.internal\" not found" Jun 10 13:14:53.438305 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.438285 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fa45664cf77ef7584d59a465af594f4b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-19.ec2.internal\" (UID: \"fa45664cf77ef7584d59a465af594f4b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-19.ec2.internal" Jun 10 13:14:53.438367 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.438311 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa45664cf77ef7584d59a465af594f4b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-19.ec2.internal\" (UID: \"fa45664cf77ef7584d59a465af594f4b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-19.ec2.internal" Jun 10 13:14:53.438367 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.438328 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/42d2d3b59dbeb7d6f92fb6b1848e3017-config\") pod \"kube-apiserver-proxy-ip-10-0-136-19.ec2.internal\" (UID: \"42d2d3b59dbeb7d6f92fb6b1848e3017\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-19.ec2.internal" Jun 10 13:14:53.438367 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.438365 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/42d2d3b59dbeb7d6f92fb6b1848e3017-config\") pod \"kube-apiserver-proxy-ip-10-0-136-19.ec2.internal\" (UID: \"42d2d3b59dbeb7d6f92fb6b1848e3017\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-19.ec2.internal" Jun 10 13:14:53.438535 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.438403 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fa45664cf77ef7584d59a465af594f4b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-19.ec2.internal\" (UID: \"fa45664cf77ef7584d59a465af594f4b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-19.ec2.internal" Jun 10 13:14:53.438535 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.438416 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa45664cf77ef7584d59a465af594f4b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-19.ec2.internal\" (UID: \"fa45664cf77ef7584d59a465af594f4b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-19.ec2.internal" Jun 10 13:14:53.513884 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:14:53.513832 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-19.ec2.internal\" not found" Jun 10 13:14:53.614489 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:14:53.614420 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-19.ec2.internal\" not found" Jun 10 13:14:53.625580 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.625563 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-19.ec2.internal" Jun 10 13:14:53.628151 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:53.628135 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-19.ec2.internal" Jun 10 13:14:53.714852 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:14:53.714814 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-19.ec2.internal\" not found" Jun 10 13:14:53.815342 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:14:53.815313 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-19.ec2.internal\" not found" Jun 10 13:14:53.915968 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:14:53.915876 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-19.ec2.internal\" not found" Jun 10 13:14:54.016379 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:14:54.016348 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-19.ec2.internal\" not found" Jun 10 13:14:54.069913 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:54.069882 2567 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 10 13:14:54.070471 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:54.070059 2567 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 10 13:14:54.109085 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:54.109050 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42d2d3b59dbeb7d6f92fb6b1848e3017.slice/crio-f0000b475ace3faf442f0f5533eeb0ed5b5437fe44d3348d6094c752f3d1f110 WatchSource:0}: Error finding container f0000b475ace3faf442f0f5533eeb0ed5b5437fe44d3348d6094c752f3d1f110: Status 404 returned error can't find the container with id f0000b475ace3faf442f0f5533eeb0ed5b5437fe44d3348d6094c752f3d1f110 Jun 10 13:14:54.109573 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:54.109544 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa45664cf77ef7584d59a465af594f4b.slice/crio-c1e8a3ff9bf460aecbe33067a7b7ce217c75919162f885422d9aeeb0c9c1d820 WatchSource:0}: Error finding container c1e8a3ff9bf460aecbe33067a7b7ce217c75919162f885422d9aeeb0c9c1d820: Status 404 returned error can't find the container with id c1e8a3ff9bf460aecbe33067a7b7ce217c75919162f885422d9aeeb0c9c1d820 Jun 10 13:14:54.114921 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:54.114908 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 13:14:54.116880 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:14:54.116864 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-19.ec2.internal\" not found" Jun 10 13:14:54.141022 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:54.140992 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-09 13:09:53 +0000 UTC" deadline="2028-02-03 20:24:50.390175582 +0000 UTC" Jun 10 13:14:54.141022 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:54.141019 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14479h9m56.249159307s" Jun 10 13:14:54.167382 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:54.167326 2567 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 13:14:54.204825 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:54.204753 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-19.ec2.internal" event={"ID":"42d2d3b59dbeb7d6f92fb6b1848e3017","Type":"ContainerStarted","Data":"f0000b475ace3faf442f0f5533eeb0ed5b5437fe44d3348d6094c752f3d1f110"} Jun 10 13:14:54.205862 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:54.205824 2567 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 13:14:54.205862 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:54.205860 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-19.ec2.internal" event={"ID":"fa45664cf77ef7584d59a465af594f4b","Type":"ContainerStarted","Data":"c1e8a3ff9bf460aecbe33067a7b7ce217c75919162f885422d9aeeb0c9c1d820"} Jun 10 13:14:54.216941 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:14:54.216912 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-19.ec2.internal\" not found" Jun 10 13:14:54.308987 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:54.308961 2567 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 13:14:54.335377 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:54.335352 2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-19.ec2.internal" Jun 10 13:14:54.347819 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:54.347799 2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 10 13:14:54.349046 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:54.349027 2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-19.ec2.internal" Jun 10 13:14:54.357998 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:54.357982 2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 10 13:14:55.114034 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.114001 2567 apiserver.go:52] "Watching apiserver" Jun 10 13:14:55.122503 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.122435 2567 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 10 13:14:55.122815 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.122794 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-zp4l9","openshift-network-diagnostics/network-check-target-9f4rq","kube-system/kube-apiserver-proxy-ip-10-0-136-19.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d6glj","openshift-cluster-node-tuning-operator/tuned-k6vks","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-19.ec2.internal","openshift-multus/multus-additional-cni-plugins-bhrmz","openshift-multus/network-metrics-daemon-qn67p","openshift-network-operator/iptables-alerter-grjwr","openshift-ovn-kubernetes/ovnkube-node-htrsf","kube-system/global-pull-secret-syncer-qll8x","kube-system/konnectivity-agent-4hgwk","openshift-dns/node-resolver-vpqgr","openshift-image-registry/node-ca-j4s5b"] Jun 10 13:14:55.124302 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.124276 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bhrmz" Jun 10 13:14:55.125363 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.125341 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vpqgr" Jun 10 13:14:55.127084 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.126761 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-j4s5b" Jun 10 13:14:55.127084 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.126912 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 10 13:14:55.127230 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.127213 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 10 13:14:55.127288 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.127269 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 10 13:14:55.127429 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.127396 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 10 13:14:55.127429 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.127427 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 10 13:14:55.127652 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.127552 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-qkxj7\"" Jun 10 13:14:55.128190 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.128175 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d6glj" Jun 10 13:14:55.128506 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.128445 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 10 13:14:55.128506 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.128478 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5ndrk\"" Jun 10 13:14:55.128506 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.128501 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 10 13:14:55.129149 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.129131 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-k6vks" Jun 10 13:14:55.129304 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.129286 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 10 13:14:55.129806 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.129741 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 10 13:14:55.129806 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.129798 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 10 13:14:55.130013 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.129812 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-swls9\"" Jun 10 13:14:55.130185 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.130167 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qn67p" Jun 10 13:14:55.130272 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:14:55.130241 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qn67p" podUID="5458a9d3-baee-4c82-b5a5-9c0d1227c481" Jun 10 13:14:55.130580 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.130513 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-4bzn4\"" Jun 10 13:14:55.130789 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.130765 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 10 13:14:55.131143 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.131124 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 10 13:14:55.131284 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.131142 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 10 13:14:55.131547 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.131528 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 10 13:14:55.131817 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.131799 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-grjwr" Jun 10 13:14:55.132532 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.132513 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-tstvf\"" Jun 10 13:14:55.132615 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.132552 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 10 13:14:55.133531 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.133488 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zp4l9" Jun 10 13:14:55.134207 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.134167 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 10 13:14:55.134307 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.134268 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 10 13:14:55.134514 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.134496 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-52bst\"" Jun 10 13:14:55.134594 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.134510 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 10 13:14:55.134825 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.134722 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9f4rq" Jun 10 13:14:55.134825 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:14:55.134798 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9f4rq" podUID="70145ee6-ed6f-4fcb-9ac6-7bf4439ecf8c" Jun 10 13:14:55.135603 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.135586 2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 10 13:14:55.136127 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.136088 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-r6bh7\"" Jun 10 13:14:55.136127 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.136113 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-htrsf" Jun 10 13:14:55.136423 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.136394 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 10 13:14:55.137719 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.137703 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qll8x" Jun 10 13:14:55.137830 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:14:55.137805 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qll8x" podUID="e0f9bf9d-d15d-4d0a-9c5f-185a98848eaf" Jun 10 13:14:55.139226 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.139193 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 10 13:14:55.139311 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.139241 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 10 13:14:55.141079 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.139441 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 10 13:14:55.141079 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.139592 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4hgwk" Jun 10 13:14:55.141079 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.140269 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 10 13:14:55.141079 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.140641 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 10 13:14:55.141079 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.140922 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-qzwvr\"" Jun 10 13:14:55.141079 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.140967 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 10 13:14:55.143346 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.143329 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 10 13:14:55.143437 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.143367 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 10 13:14:55.144331 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.144315 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-4g82w\"" Jun 10 13:14:55.147610 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.147526 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/503ace6f-dfa4-41b8-8ade-5294ab66e7a7-host-run-netns\") pod \"ovnkube-node-htrsf\" (UID: \"503ace6f-dfa4-41b8-8ade-5294ab66e7a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-htrsf" Jun 10 13:14:55.147610 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.147563 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/89d6f8f3-2a0d-4b45-9701-697ae9dc3339-sys-fs\") pod \"aws-ebs-csi-driver-node-d6glj\" (UID: \"89d6f8f3-2a0d-4b45-9701-697ae9dc3339\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d6glj" Jun 10 13:14:55.147610 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.147603 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/503ace6f-dfa4-41b8-8ade-5294ab66e7a7-host-kubelet\") pod \"ovnkube-node-htrsf\" (UID: \"503ace6f-dfa4-41b8-8ade-5294ab66e7a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-htrsf" Jun 10 13:14:55.147895 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.147636 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/503ace6f-dfa4-41b8-8ade-5294ab66e7a7-host-cni-bin\") pod \"ovnkube-node-htrsf\" (UID: \"503ace6f-dfa4-41b8-8ade-5294ab66e7a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-htrsf" Jun 10 13:14:55.147895 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.147696 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/caeebc1e-0a5d-419c-a570-72986d79a4aa-etc-modprobe-d\") pod \"tuned-k6vks\" (UID: \"caeebc1e-0a5d-419c-a570-72986d79a4aa\") " pod="openshift-cluster-node-tuning-operator/tuned-k6vks" Jun 10 13:14:55.147895 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.147740 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/caeebc1e-0a5d-419c-a570-72986d79a4aa-sys\") pod \"tuned-k6vks\" (UID: \"caeebc1e-0a5d-419c-a570-72986d79a4aa\") " pod="openshift-cluster-node-tuning-operator/tuned-k6vks" Jun 10 13:14:55.147895 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.147774 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/caeebc1e-0a5d-419c-a570-72986d79a4aa-etc-tuned\") pod \"tuned-k6vks\" (UID: \"caeebc1e-0a5d-419c-a570-72986d79a4aa\") " pod="openshift-cluster-node-tuning-operator/tuned-k6vks" Jun 10 13:14:55.147895 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.147804 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/89d6f8f3-2a0d-4b45-9701-697ae9dc3339-etc-selinux\") pod \"aws-ebs-csi-driver-node-d6glj\" (UID: \"89d6f8f3-2a0d-4b45-9701-697ae9dc3339\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d6glj" Jun 10 13:14:55.147895 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.147827 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8cbd5836-7926-4ac1-99ed-7f98e161a0cc-multus-conf-dir\") pod \"multus-zp4l9\" (UID: \"8cbd5836-7926-4ac1-99ed-7f98e161a0cc\") " pod="openshift-multus/multus-zp4l9" Jun 10 13:14:55.148188 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.147879 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8cbd5836-7926-4ac1-99ed-7f98e161a0cc-multus-daemon-config\") pod \"multus-zp4l9\" (UID: \"8cbd5836-7926-4ac1-99ed-7f98e161a0cc\") " pod="openshift-multus/multus-zp4l9" Jun 10 13:14:55.148188 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.147936 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/503ace6f-dfa4-41b8-8ade-5294ab66e7a7-run-systemd\") pod \"ovnkube-node-htrsf\" (UID: \"503ace6f-dfa4-41b8-8ade-5294ab66e7a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-htrsf" Jun 10 13:14:55.148188 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.147961 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srdz2\" (UniqueName: \"kubernetes.io/projected/503ace6f-dfa4-41b8-8ade-5294ab66e7a7-kube-api-access-srdz2\") pod \"ovnkube-node-htrsf\" (UID: \"503ace6f-dfa4-41b8-8ade-5294ab66e7a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-htrsf" Jun 10 13:14:55.148188 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.147984 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/caeebc1e-0a5d-419c-a570-72986d79a4aa-etc-sysconfig\") pod \"tuned-k6vks\" (UID: \"caeebc1e-0a5d-419c-a570-72986d79a4aa\") " pod="openshift-cluster-node-tuning-operator/tuned-k6vks" Jun 10 13:14:55.148188 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.148007 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/caeebc1e-0a5d-419c-a570-72986d79a4aa-etc-kubernetes\") pod \"tuned-k6vks\" (UID: \"caeebc1e-0a5d-419c-a570-72986d79a4aa\") " pod="openshift-cluster-node-tuning-operator/tuned-k6vks" Jun 10 13:14:55.148188 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.148029 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8cbd5836-7926-4ac1-99ed-7f98e161a0cc-system-cni-dir\") pod \"multus-zp4l9\" (UID: \"8cbd5836-7926-4ac1-99ed-7f98e161a0cc\") " pod="openshift-multus/multus-zp4l9" Jun 10 13:14:55.148188 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.148053 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8cbd5836-7926-4ac1-99ed-7f98e161a0cc-os-release\") pod \"multus-zp4l9\" (UID: \"8cbd5836-7926-4ac1-99ed-7f98e161a0cc\") " pod="openshift-multus/multus-zp4l9" Jun 10 13:14:55.148188 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.148078 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/503ace6f-dfa4-41b8-8ade-5294ab66e7a7-log-socket\") pod \"ovnkube-node-htrsf\" (UID: \"503ace6f-dfa4-41b8-8ade-5294ab66e7a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-htrsf" Jun 10 13:14:55.148188 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.148104 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/503ace6f-dfa4-41b8-8ade-5294ab66e7a7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-htrsf\" (UID: \"503ace6f-dfa4-41b8-8ade-5294ab66e7a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-htrsf" Jun 10 13:14:55.148188 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.148130 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/503ace6f-dfa4-41b8-8ade-5294ab66e7a7-ovnkube-config\") pod \"ovnkube-node-htrsf\" (UID: \"503ace6f-dfa4-41b8-8ade-5294ab66e7a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-htrsf" Jun 10 13:14:55.148188 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.148168 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8cbd5836-7926-4ac1-99ed-7f98e161a0cc-multus-socket-dir-parent\") pod \"multus-zp4l9\" (UID: \"8cbd5836-7926-4ac1-99ed-7f98e161a0cc\") " pod="openshift-multus/multus-zp4l9" Jun 10 13:14:55.148664 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.148244 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/caeebc1e-0a5d-419c-a570-72986d79a4aa-etc-sysctl-d\") pod \"tuned-k6vks\" (UID: \"caeebc1e-0a5d-419c-a570-72986d79a4aa\") " pod="openshift-cluster-node-tuning-operator/tuned-k6vks" Jun 10 13:14:55.148664 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.148277 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/caeebc1e-0a5d-419c-a570-72986d79a4aa-lib-modules\") pod \"tuned-k6vks\" (UID: \"caeebc1e-0a5d-419c-a570-72986d79a4aa\") " pod="openshift-cluster-node-tuning-operator/tuned-k6vks" Jun 10 13:14:55.148664 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.148309 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/caeebc1e-0a5d-419c-a570-72986d79a4aa-tmp\") pod \"tuned-k6vks\" (UID: \"caeebc1e-0a5d-419c-a570-72986d79a4aa\") " pod="openshift-cluster-node-tuning-operator/tuned-k6vks" Jun 10 13:14:55.148664 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.148334 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/36afda7c-ce8b-419d-99f2-c854959a7f4b-host-slash\") pod \"iptables-alerter-grjwr\" (UID: \"36afda7c-ce8b-419d-99f2-c854959a7f4b\") " pod="openshift-network-operator/iptables-alerter-grjwr" Jun 10 13:14:55.148664 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.148357 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8cbd5836-7926-4ac1-99ed-7f98e161a0cc-host-run-netns\") pod \"multus-zp4l9\" (UID: \"8cbd5836-7926-4ac1-99ed-7f98e161a0cc\") " pod="openshift-multus/multus-zp4l9" Jun 10 13:14:55.148664 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.148389 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8cbd5836-7926-4ac1-99ed-7f98e161a0cc-host-run-multus-certs\") pod \"multus-zp4l9\" (UID: \"8cbd5836-7926-4ac1-99ed-7f98e161a0cc\") " pod="openshift-multus/multus-zp4l9" Jun 10 13:14:55.148664 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.148428 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7ca2b072-b2f4-49c1-b491-37d85bf247d2-cni-binary-copy\") pod \"multus-additional-cni-plugins-bhrmz\" (UID: \"7ca2b072-b2f4-49c1-b491-37d85bf247d2\") " pod="openshift-multus/multus-additional-cni-plugins-bhrmz" Jun 10 13:14:55.148664 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.148455 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/89d6f8f3-2a0d-4b45-9701-697ae9dc3339-kubelet-dir\") pod \"aws-ebs-csi-driver-node-d6glj\" (UID: \"89d6f8f3-2a0d-4b45-9701-697ae9dc3339\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d6glj" Jun 10 13:14:55.148664 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.148481 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/caeebc1e-0a5d-419c-a570-72986d79a4aa-etc-sysctl-conf\") pod \"tuned-k6vks\" (UID: \"caeebc1e-0a5d-419c-a570-72986d79a4aa\") " pod="openshift-cluster-node-tuning-operator/tuned-k6vks" Jun 10 13:14:55.148664 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.148504 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/503ace6f-dfa4-41b8-8ade-5294ab66e7a7-run-openvswitch\") pod \"ovnkube-node-htrsf\" (UID: \"503ace6f-dfa4-41b8-8ade-5294ab66e7a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-htrsf" Jun 10 13:14:55.148664 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.148525 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/503ace6f-dfa4-41b8-8ade-5294ab66e7a7-env-overrides\") pod \"ovnkube-node-htrsf\" (UID: \"503ace6f-dfa4-41b8-8ade-5294ab66e7a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-htrsf" Jun 10 13:14:55.148664 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.148546 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/89d6f8f3-2a0d-4b45-9701-697ae9dc3339-device-dir\") pod \"aws-ebs-csi-driver-node-d6glj\" (UID: \"89d6f8f3-2a0d-4b45-9701-697ae9dc3339\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d6glj" Jun 10 13:14:55.148664 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.148575 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/503ace6f-dfa4-41b8-8ade-5294ab66e7a7-var-lib-openvswitch\") pod \"ovnkube-node-htrsf\" (UID: \"503ace6f-dfa4-41b8-8ade-5294ab66e7a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-htrsf" Jun 10 13:14:55.148664 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.148602 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/503ace6f-dfa4-41b8-8ade-5294ab66e7a7-run-ovn\") pod \"ovnkube-node-htrsf\" (UID: \"503ace6f-dfa4-41b8-8ade-5294ab66e7a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-htrsf" Jun 10 13:14:55.148664 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.148625 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/503ace6f-dfa4-41b8-8ade-5294ab66e7a7-ovn-node-metrics-cert\") pod \"ovnkube-node-htrsf\" (UID: \"503ace6f-dfa4-41b8-8ade-5294ab66e7a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-htrsf" Jun 10 13:14:55.148664 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.148648 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5eb4a19d-1cf0-4a15-abe1-2cf06495af67-host\") pod \"node-ca-j4s5b\" (UID: \"5eb4a19d-1cf0-4a15-abe1-2cf06495af67\") " pod="openshift-image-registry/node-ca-j4s5b" Jun 10 13:14:55.149460 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.148677 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/caeebc1e-0a5d-419c-a570-72986d79a4aa-etc-systemd\") pod \"tuned-k6vks\" (UID: \"caeebc1e-0a5d-419c-a570-72986d79a4aa\") " pod="openshift-cluster-node-tuning-operator/tuned-k6vks" Jun 10 13:14:55.149460 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.148740 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68t29\" (UniqueName: \"kubernetes.io/projected/36afda7c-ce8b-419d-99f2-c854959a7f4b-kube-api-access-68t29\") pod \"iptables-alerter-grjwr\" (UID: \"36afda7c-ce8b-419d-99f2-c854959a7f4b\") " pod="openshift-network-operator/iptables-alerter-grjwr" Jun 10 13:14:55.149460 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.148763 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8cbd5836-7926-4ac1-99ed-7f98e161a0cc-host-var-lib-cni-multus\") pod \"multus-zp4l9\" (UID: \"8cbd5836-7926-4ac1-99ed-7f98e161a0cc\") " pod="openshift-multus/multus-zp4l9" Jun 10 13:14:55.149460 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.148777 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zjx6\" (UniqueName: \"kubernetes.io/projected/70145ee6-ed6f-4fcb-9ac6-7bf4439ecf8c-kube-api-access-2zjx6\") pod \"network-check-target-9f4rq\" (UID: \"70145ee6-ed6f-4fcb-9ac6-7bf4439ecf8c\") " pod="openshift-network-diagnostics/network-check-target-9f4rq" Jun 10 13:14:55.149460 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.148793 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7ca2b072-b2f4-49c1-b491-37d85bf247d2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bhrmz\" (UID: \"7ca2b072-b2f4-49c1-b491-37d85bf247d2\") " pod="openshift-multus/multus-additional-cni-plugins-bhrmz" Jun 10 13:14:55.149460 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.148819 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5eb4a19d-1cf0-4a15-abe1-2cf06495af67-serviceca\") pod \"node-ca-j4s5b\" (UID: \"5eb4a19d-1cf0-4a15-abe1-2cf06495af67\") " pod="openshift-image-registry/node-ca-j4s5b" Jun 10 13:14:55.149460 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.148855 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blhwn\" (UniqueName: \"kubernetes.io/projected/5eb4a19d-1cf0-4a15-abe1-2cf06495af67-kube-api-access-blhwn\") pod \"node-ca-j4s5b\" (UID: \"5eb4a19d-1cf0-4a15-abe1-2cf06495af67\") " pod="openshift-image-registry/node-ca-j4s5b" Jun 10 13:14:55.149460 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.148895 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8cbd5836-7926-4ac1-99ed-7f98e161a0cc-host-var-lib-cni-bin\") pod \"multus-zp4l9\" (UID: \"8cbd5836-7926-4ac1-99ed-7f98e161a0cc\") " pod="openshift-multus/multus-zp4l9" Jun 10 13:14:55.149460 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.148930 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8cbd5836-7926-4ac1-99ed-7f98e161a0cc-hostroot\") pod \"multus-zp4l9\" (UID: \"8cbd5836-7926-4ac1-99ed-7f98e161a0cc\") " pod="openshift-multus/multus-zp4l9" Jun 10 13:14:55.149460 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.148975 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8cbd5836-7926-4ac1-99ed-7f98e161a0cc-etc-kubernetes\") pod \"multus-zp4l9\" (UID: \"8cbd5836-7926-4ac1-99ed-7f98e161a0cc\") " pod="openshift-multus/multus-zp4l9" Jun 10 13:14:55.149460 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.149044 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4r2h\" (UniqueName: \"kubernetes.io/projected/7ca2b072-b2f4-49c1-b491-37d85bf247d2-kube-api-access-k4r2h\") pod \"multus-additional-cni-plugins-bhrmz\" (UID: \"7ca2b072-b2f4-49c1-b491-37d85bf247d2\") " pod="openshift-multus/multus-additional-cni-plugins-bhrmz" Jun 10 13:14:55.149460 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.149092 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4fad052f-bd79-43d6-8fe8-57ba27e1b911-hosts-file\") pod \"node-resolver-vpqgr\" (UID: \"4fad052f-bd79-43d6-8fe8-57ba27e1b911\") " pod="openshift-dns/node-resolver-vpqgr" Jun 10 13:14:55.149460 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.149118 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/89d6f8f3-2a0d-4b45-9701-697ae9dc3339-registration-dir\") pod \"aws-ebs-csi-driver-node-d6glj\" (UID: \"89d6f8f3-2a0d-4b45-9701-697ae9dc3339\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d6glj" Jun 10 13:14:55.149460 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.149141 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5458a9d3-baee-4c82-b5a5-9c0d1227c481-metrics-certs\") pod \"network-metrics-daemon-qn67p\" (UID: \"5458a9d3-baee-4c82-b5a5-9c0d1227c481\") " pod="openshift-multus/network-metrics-daemon-qn67p" Jun 10 13:14:55.149460 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.149164 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/503ace6f-dfa4-41b8-8ade-5294ab66e7a7-node-log\") pod \"ovnkube-node-htrsf\" (UID: \"503ace6f-dfa4-41b8-8ade-5294ab66e7a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-htrsf" Jun 10 13:14:55.149460 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.149187 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/503ace6f-dfa4-41b8-8ade-5294ab66e7a7-host-run-ovn-kubernetes\") pod \"ovnkube-node-htrsf\" (UID: \"503ace6f-dfa4-41b8-8ade-5294ab66e7a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-htrsf" Jun 10 13:14:55.150044 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.149210 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kspbb\" (UniqueName: \"kubernetes.io/projected/4fad052f-bd79-43d6-8fe8-57ba27e1b911-kube-api-access-kspbb\") pod \"node-resolver-vpqgr\" (UID: \"4fad052f-bd79-43d6-8fe8-57ba27e1b911\") " pod="openshift-dns/node-resolver-vpqgr" Jun 10 13:14:55.150044 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.149236 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/36afda7c-ce8b-419d-99f2-c854959a7f4b-iptables-alerter-script\") pod \"iptables-alerter-grjwr\" (UID: \"36afda7c-ce8b-419d-99f2-c854959a7f4b\") " pod="openshift-network-operator/iptables-alerter-grjwr" Jun 10 13:14:55.150044 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.149295 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8cbd5836-7926-4ac1-99ed-7f98e161a0cc-multus-cni-dir\") pod \"multus-zp4l9\" (UID: \"8cbd5836-7926-4ac1-99ed-7f98e161a0cc\") " pod="openshift-multus/multus-zp4l9" Jun 10 13:14:55.150044 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.149331 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/503ace6f-dfa4-41b8-8ade-5294ab66e7a7-etc-openvswitch\") pod \"ovnkube-node-htrsf\" (UID: \"503ace6f-dfa4-41b8-8ade-5294ab66e7a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-htrsf" Jun 10 13:14:55.150044 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.149354 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/caeebc1e-0a5d-419c-a570-72986d79a4aa-host\") pod \"tuned-k6vks\" (UID: \"caeebc1e-0a5d-419c-a570-72986d79a4aa\") " pod="openshift-cluster-node-tuning-operator/tuned-k6vks" Jun 10 13:14:55.150044 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.149379 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8cbd5836-7926-4ac1-99ed-7f98e161a0cc-cnibin\") pod \"multus-zp4l9\" (UID: \"8cbd5836-7926-4ac1-99ed-7f98e161a0cc\") " pod="openshift-multus/multus-zp4l9" Jun 10 13:14:55.150044 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.149402 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8cbd5836-7926-4ac1-99ed-7f98e161a0cc-host-run-k8s-cni-cncf-io\") pod \"multus-zp4l9\" (UID: \"8cbd5836-7926-4ac1-99ed-7f98e161a0cc\") " pod="openshift-multus/multus-zp4l9" Jun 10 13:14:55.150044 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.149425 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ftlb\" (UniqueName: \"kubernetes.io/projected/5458a9d3-baee-4c82-b5a5-9c0d1227c481-kube-api-access-2ftlb\") pod \"network-metrics-daemon-qn67p\" (UID: \"5458a9d3-baee-4c82-b5a5-9c0d1227c481\") " pod="openshift-multus/network-metrics-daemon-qn67p" Jun 10 13:14:55.150044 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.149458 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/503ace6f-dfa4-41b8-8ade-5294ab66e7a7-systemd-units\") pod \"ovnkube-node-htrsf\" (UID: \"503ace6f-dfa4-41b8-8ade-5294ab66e7a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-htrsf" Jun 10 13:14:55.150044 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.149501 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/503ace6f-dfa4-41b8-8ade-5294ab66e7a7-host-cni-netd\") pod \"ovnkube-node-htrsf\" (UID: \"503ace6f-dfa4-41b8-8ade-5294ab66e7a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-htrsf" Jun 10 13:14:55.150044 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.149561 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/caeebc1e-0a5d-419c-a570-72986d79a4aa-var-lib-kubelet\") pod \"tuned-k6vks\" (UID: \"caeebc1e-0a5d-419c-a570-72986d79a4aa\") " pod="openshift-cluster-node-tuning-operator/tuned-k6vks" Jun 10 13:14:55.150044 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.149602 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7ca2b072-b2f4-49c1-b491-37d85bf247d2-cnibin\") pod \"multus-additional-cni-plugins-bhrmz\" (UID: \"7ca2b072-b2f4-49c1-b491-37d85bf247d2\") " pod="openshift-multus/multus-additional-cni-plugins-bhrmz" Jun 10 13:14:55.150044 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.149629 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/89d6f8f3-2a0d-4b45-9701-697ae9dc3339-socket-dir\") pod \"aws-ebs-csi-driver-node-d6glj\" (UID: \"89d6f8f3-2a0d-4b45-9701-697ae9dc3339\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d6glj" Jun 10 13:14:55.150044 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.149653 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cfmm\" (UniqueName: \"kubernetes.io/projected/89d6f8f3-2a0d-4b45-9701-697ae9dc3339-kube-api-access-4cfmm\") pod \"aws-ebs-csi-driver-node-d6glj\" (UID: \"89d6f8f3-2a0d-4b45-9701-697ae9dc3339\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d6glj" Jun 10 13:14:55.150044 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.149680 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/503ace6f-dfa4-41b8-8ade-5294ab66e7a7-ovnkube-script-lib\") pod \"ovnkube-node-htrsf\" (UID: \"503ace6f-dfa4-41b8-8ade-5294ab66e7a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-htrsf" Jun 10 13:14:55.150044 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.149701 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/caeebc1e-0a5d-419c-a570-72986d79a4aa-run\") pod \"tuned-k6vks\" (UID: \"caeebc1e-0a5d-419c-a570-72986d79a4aa\") " pod="openshift-cluster-node-tuning-operator/tuned-k6vks" Jun 10 13:14:55.150807 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.149724 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nmsd\" (UniqueName: \"kubernetes.io/projected/caeebc1e-0a5d-419c-a570-72986d79a4aa-kube-api-access-6nmsd\") pod \"tuned-k6vks\" (UID: \"caeebc1e-0a5d-419c-a570-72986d79a4aa\") " pod="openshift-cluster-node-tuning-operator/tuned-k6vks" Jun 10 13:14:55.150807 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.149748 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7ca2b072-b2f4-49c1-b491-37d85bf247d2-os-release\") pod \"multus-additional-cni-plugins-bhrmz\" (UID: \"7ca2b072-b2f4-49c1-b491-37d85bf247d2\") " pod="openshift-multus/multus-additional-cni-plugins-bhrmz" Jun 10 13:14:55.150807 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.149769 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/503ace6f-dfa4-41b8-8ade-5294ab66e7a7-host-slash\") pod \"ovnkube-node-htrsf\" (UID: \"503ace6f-dfa4-41b8-8ade-5294ab66e7a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-htrsf" Jun 10 13:14:55.150807 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.149791 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4q2v9\" (UniqueName: \"kubernetes.io/projected/8cbd5836-7926-4ac1-99ed-7f98e161a0cc-kube-api-access-4q2v9\") pod \"multus-zp4l9\" (UID: \"8cbd5836-7926-4ac1-99ed-7f98e161a0cc\") " pod="openshift-multus/multus-zp4l9" Jun 10 13:14:55.150807 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.149814 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7ca2b072-b2f4-49c1-b491-37d85bf247d2-system-cni-dir\") pod \"multus-additional-cni-plugins-bhrmz\" (UID: \"7ca2b072-b2f4-49c1-b491-37d85bf247d2\") " pod="openshift-multus/multus-additional-cni-plugins-bhrmz" Jun 10 13:14:55.150807 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.149854 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7ca2b072-b2f4-49c1-b491-37d85bf247d2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bhrmz\" (UID: \"7ca2b072-b2f4-49c1-b491-37d85bf247d2\") " pod="openshift-multus/multus-additional-cni-plugins-bhrmz" Jun 10 13:14:55.150807 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.149879 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8cbd5836-7926-4ac1-99ed-7f98e161a0cc-cni-binary-copy\") pod \"multus-zp4l9\" (UID: \"8cbd5836-7926-4ac1-99ed-7f98e161a0cc\") " pod="openshift-multus/multus-zp4l9" Jun 10 13:14:55.150807 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.149903 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8cbd5836-7926-4ac1-99ed-7f98e161a0cc-host-var-lib-kubelet\") pod \"multus-zp4l9\" (UID: \"8cbd5836-7926-4ac1-99ed-7f98e161a0cc\") " pod="openshift-multus/multus-zp4l9" Jun 10 13:14:55.150807 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.149925 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7ca2b072-b2f4-49c1-b491-37d85bf247d2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bhrmz\" (UID: \"7ca2b072-b2f4-49c1-b491-37d85bf247d2\") " pod="openshift-multus/multus-additional-cni-plugins-bhrmz" Jun 10 13:14:55.150807 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.149950 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4fad052f-bd79-43d6-8fe8-57ba27e1b911-tmp-dir\") pod \"node-resolver-vpqgr\" (UID: \"4fad052f-bd79-43d6-8fe8-57ba27e1b911\") " pod="openshift-dns/node-resolver-vpqgr" Jun 10 13:14:55.154584 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.154564 2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 10 13:14:55.170774 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.170756 2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-bxghr" Jun 10 13:14:55.177446 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.177430 2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 13:14:55.178179 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.178165 2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-bxghr" Jun 10 13:14:55.236514 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.236492 2567 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 10 13:14:55.251048 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.251020 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7ca2b072-b2f4-49c1-b491-37d85bf247d2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bhrmz\" (UID: \"7ca2b072-b2f4-49c1-b491-37d85bf247d2\") " pod="openshift-multus/multus-additional-cni-plugins-bhrmz" Jun 10 13:14:55.251202 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.251066 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e0f9bf9d-d15d-4d0a-9c5f-185a98848eaf-kubelet-config\") pod \"global-pull-secret-syncer-qll8x\" (UID: \"e0f9bf9d-d15d-4d0a-9c5f-185a98848eaf\") " pod="kube-system/global-pull-secret-syncer-qll8x" Jun 10 13:14:55.251202 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.251092 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8cbd5836-7926-4ac1-99ed-7f98e161a0cc-cni-binary-copy\") pod \"multus-zp4l9\" (UID: \"8cbd5836-7926-4ac1-99ed-7f98e161a0cc\") " pod="openshift-multus/multus-zp4l9" Jun 10 13:14:55.251202 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.251116 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8cbd5836-7926-4ac1-99ed-7f98e161a0cc-host-var-lib-kubelet\") pod \"multus-zp4l9\" (UID: \"8cbd5836-7926-4ac1-99ed-7f98e161a0cc\") " pod="openshift-multus/multus-zp4l9" Jun 10 13:14:55.251202 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.251139 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7ca2b072-b2f4-49c1-b491-37d85bf247d2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bhrmz\" (UID: \"7ca2b072-b2f4-49c1-b491-37d85bf247d2\") " pod="openshift-multus/multus-additional-cni-plugins-bhrmz" Jun 10 13:14:55.251202 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.251172 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7ca2b072-b2f4-49c1-b491-37d85bf247d2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bhrmz\" (UID: \"7ca2b072-b2f4-49c1-b491-37d85bf247d2\") " pod="openshift-multus/multus-additional-cni-plugins-bhrmz" Jun 10 13:14:55.251451 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.251199 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8cbd5836-7926-4ac1-99ed-7f98e161a0cc-host-var-lib-kubelet\") pod \"multus-zp4l9\" (UID: \"8cbd5836-7926-4ac1-99ed-7f98e161a0cc\") " pod="openshift-multus/multus-zp4l9" Jun 10 13:14:55.251451 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.251241 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4fad052f-bd79-43d6-8fe8-57ba27e1b911-tmp-dir\") pod \"node-resolver-vpqgr\" (UID: \"4fad052f-bd79-43d6-8fe8-57ba27e1b911\") " pod="openshift-dns/node-resolver-vpqgr" Jun 10 13:14:55.251451 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.251268 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/503ace6f-dfa4-41b8-8ade-5294ab66e7a7-host-run-netns\") pod \"ovnkube-node-htrsf\" (UID: \"503ace6f-dfa4-41b8-8ade-5294ab66e7a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-htrsf" Jun 10 13:14:55.251451 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.251291 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/89d6f8f3-2a0d-4b45-9701-697ae9dc3339-sys-fs\") pod \"aws-ebs-csi-driver-node-d6glj\" (UID: \"89d6f8f3-2a0d-4b45-9701-697ae9dc3339\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d6glj" Jun 10 13:14:55.251451 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.251314 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/503ace6f-dfa4-41b8-8ade-5294ab66e7a7-host-kubelet\") pod \"ovnkube-node-htrsf\" (UID: \"503ace6f-dfa4-41b8-8ade-5294ab66e7a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-htrsf" Jun 10 13:14:55.251451 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.251349 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/503ace6f-dfa4-41b8-8ade-5294ab66e7a7-host-cni-bin\") pod \"ovnkube-node-htrsf\" (UID: \"503ace6f-dfa4-41b8-8ade-5294ab66e7a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-htrsf" Jun 10 13:14:55.251451 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.251362 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/caeebc1e-0a5d-419c-a570-72986d79a4aa-etc-modprobe-d\") pod \"tuned-k6vks\" (UID: \"caeebc1e-0a5d-419c-a570-72986d79a4aa\") " pod="openshift-cluster-node-tuning-operator/tuned-k6vks" Jun 10 13:14:55.251451 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.251379 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/caeebc1e-0a5d-419c-a570-72986d79a4aa-sys\") pod \"tuned-k6vks\" (UID: \"caeebc1e-0a5d-419c-a570-72986d79a4aa\") " pod="openshift-cluster-node-tuning-operator/tuned-k6vks" Jun 10 13:14:55.251451 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.251371 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/89d6f8f3-2a0d-4b45-9701-697ae9dc3339-sys-fs\") pod \"aws-ebs-csi-driver-node-d6glj\" (UID: \"89d6f8f3-2a0d-4b45-9701-697ae9dc3339\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d6glj" Jun 10 13:14:55.251451 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.251392 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/503ace6f-dfa4-41b8-8ade-5294ab66e7a7-host-kubelet\") pod \"ovnkube-node-htrsf\" (UID: \"503ace6f-dfa4-41b8-8ade-5294ab66e7a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-htrsf" Jun 10 13:14:55.251451 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.251397 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/caeebc1e-0a5d-419c-a570-72986d79a4aa-etc-tuned\") pod \"tuned-k6vks\" (UID: \"caeebc1e-0a5d-419c-a570-72986d79a4aa\") " pod="openshift-cluster-node-tuning-operator/tuned-k6vks" Jun 10 13:14:55.251451 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.251427 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/89d6f8f3-2a0d-4b45-9701-697ae9dc3339-etc-selinux\") pod \"aws-ebs-csi-driver-node-d6glj\" (UID: \"89d6f8f3-2a0d-4b45-9701-697ae9dc3339\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d6glj" Jun 10 13:14:55.251451 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.251448 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8cbd5836-7926-4ac1-99ed-7f98e161a0cc-multus-conf-dir\") pod \"multus-zp4l9\" (UID: \"8cbd5836-7926-4ac1-99ed-7f98e161a0cc\") " pod="openshift-multus/multus-zp4l9" Jun 10 13:14:55.252077 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.251470 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8cbd5836-7926-4ac1-99ed-7f98e161a0cc-multus-daemon-config\") pod \"multus-zp4l9\" (UID: \"8cbd5836-7926-4ac1-99ed-7f98e161a0cc\") " pod="openshift-multus/multus-zp4l9" Jun 10 13:14:55.252077 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.251498 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/503ace6f-dfa4-41b8-8ade-5294ab66e7a7-run-systemd\") pod \"ovnkube-node-htrsf\" (UID: \"503ace6f-dfa4-41b8-8ade-5294ab66e7a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-htrsf" Jun 10 13:14:55.252077 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.251505 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/caeebc1e-0a5d-419c-a570-72986d79a4aa-etc-modprobe-d\") pod \"tuned-k6vks\" (UID: \"caeebc1e-0a5d-419c-a570-72986d79a4aa\") " pod="openshift-cluster-node-tuning-operator/tuned-k6vks" Jun 10 13:14:55.252077 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.251529 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srdz2\" (UniqueName: \"kubernetes.io/projected/503ace6f-dfa4-41b8-8ade-5294ab66e7a7-kube-api-access-srdz2\") pod \"ovnkube-node-htrsf\" (UID: \"503ace6f-dfa4-41b8-8ade-5294ab66e7a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-htrsf" Jun 10 13:14:55.252077 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.251548 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8cbd5836-7926-4ac1-99ed-7f98e161a0cc-multus-conf-dir\") pod \"multus-zp4l9\" (UID: \"8cbd5836-7926-4ac1-99ed-7f98e161a0cc\") " pod="openshift-multus/multus-zp4l9" Jun 10 13:14:55.252077 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.251548 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4fad052f-bd79-43d6-8fe8-57ba27e1b911-tmp-dir\") pod \"node-resolver-vpqgr\" (UID: \"4fad052f-bd79-43d6-8fe8-57ba27e1b911\") " pod="openshift-dns/node-resolver-vpqgr" Jun 10 13:14:55.252077 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.251578 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/caeebc1e-0a5d-419c-a570-72986d79a4aa-etc-sysconfig\") pod \"tuned-k6vks\" (UID: \"caeebc1e-0a5d-419c-a570-72986d79a4aa\") " pod="openshift-cluster-node-tuning-operator/tuned-k6vks" Jun 10 13:14:55.252077 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.251602 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/caeebc1e-0a5d-419c-a570-72986d79a4aa-sys\") pod \"tuned-k6vks\" (UID: \"caeebc1e-0a5d-419c-a570-72986d79a4aa\") " pod="openshift-cluster-node-tuning-operator/tuned-k6vks" Jun 10 13:14:55.252077 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.251618 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/caeebc1e-0a5d-419c-a570-72986d79a4aa-etc-kubernetes\") pod \"tuned-k6vks\" (UID: \"caeebc1e-0a5d-419c-a570-72986d79a4aa\") " pod="openshift-cluster-node-tuning-operator/tuned-k6vks" Jun 10 13:14:55.252077 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.251622 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/89d6f8f3-2a0d-4b45-9701-697ae9dc3339-etc-selinux\") pod \"aws-ebs-csi-driver-node-d6glj\" (UID: \"89d6f8f3-2a0d-4b45-9701-697ae9dc3339\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d6glj" Jun 10 13:14:55.252077 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.251359 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/503ace6f-dfa4-41b8-8ade-5294ab66e7a7-host-run-netns\") pod \"ovnkube-node-htrsf\" (UID: \"503ace6f-dfa4-41b8-8ade-5294ab66e7a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-htrsf" Jun 10 13:14:55.252077 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.251642 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8cbd5836-7926-4ac1-99ed-7f98e161a0cc-system-cni-dir\") pod \"multus-zp4l9\" (UID: \"8cbd5836-7926-4ac1-99ed-7f98e161a0cc\") " pod="openshift-multus/multus-zp4l9" Jun 10 13:14:55.252077 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.251649 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/503ace6f-dfa4-41b8-8ade-5294ab66e7a7-run-systemd\") pod \"ovnkube-node-htrsf\" (UID: \"503ace6f-dfa4-41b8-8ade-5294ab66e7a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-htrsf" Jun 10 13:14:55.252077 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.251683 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/503ace6f-dfa4-41b8-8ade-5294ab66e7a7-host-cni-bin\") pod \"ovnkube-node-htrsf\" (UID: \"503ace6f-dfa4-41b8-8ade-5294ab66e7a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-htrsf" Jun 10 13:14:55.252077 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.251674 2567 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 10 13:14:55.252077 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.251720 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8cbd5836-7926-4ac1-99ed-7f98e161a0cc-os-release\") pod \"multus-zp4l9\" (UID: \"8cbd5836-7926-4ac1-99ed-7f98e161a0cc\") " pod="openshift-multus/multus-zp4l9" Jun 10 13:14:55.252077 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.251766 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/503ace6f-dfa4-41b8-8ade-5294ab66e7a7-log-socket\") pod \"ovnkube-node-htrsf\" (UID: \"503ace6f-dfa4-41b8-8ade-5294ab66e7a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-htrsf" Jun 10 13:14:55.252077 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.251775 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8cbd5836-7926-4ac1-99ed-7f98e161a0cc-system-cni-dir\") pod \"multus-zp4l9\" (UID: \"8cbd5836-7926-4ac1-99ed-7f98e161a0cc\") " pod="openshift-multus/multus-zp4l9" Jun 10 13:14:55.252739 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.251807 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8cbd5836-7926-4ac1-99ed-7f98e161a0cc-cni-binary-copy\") pod \"multus-zp4l9\" (UID: \"8cbd5836-7926-4ac1-99ed-7f98e161a0cc\") " pod="openshift-multus/multus-zp4l9" Jun 10 13:14:55.252739 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.251858 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8cbd5836-7926-4ac1-99ed-7f98e161a0cc-os-release\") pod \"multus-zp4l9\" (UID: \"8cbd5836-7926-4ac1-99ed-7f98e161a0cc\") " pod="openshift-multus/multus-zp4l9" Jun 10 13:14:55.252739 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.251887 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7ca2b072-b2f4-49c1-b491-37d85bf247d2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bhrmz\" (UID: \"7ca2b072-b2f4-49c1-b491-37d85bf247d2\") " pod="openshift-multus/multus-additional-cni-plugins-bhrmz" Jun 10 13:14:55.252739 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.251913 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/503ace6f-dfa4-41b8-8ade-5294ab66e7a7-log-socket\") pod \"ovnkube-node-htrsf\" (UID: \"503ace6f-dfa4-41b8-8ade-5294ab66e7a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-htrsf" Jun 10 13:14:55.252739 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.251918 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/caeebc1e-0a5d-419c-a570-72986d79a4aa-etc-sysconfig\") pod \"tuned-k6vks\" (UID: \"caeebc1e-0a5d-419c-a570-72986d79a4aa\") " pod="openshift-cluster-node-tuning-operator/tuned-k6vks" Jun 10 13:14:55.252739 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.251951 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/caeebc1e-0a5d-419c-a570-72986d79a4aa-etc-kubernetes\") pod \"tuned-k6vks\" (UID: \"caeebc1e-0a5d-419c-a570-72986d79a4aa\") " pod="openshift-cluster-node-tuning-operator/tuned-k6vks" Jun 10 13:14:55.252739 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.252049 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/503ace6f-dfa4-41b8-8ade-5294ab66e7a7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-htrsf\" (UID: \"503ace6f-dfa4-41b8-8ade-5294ab66e7a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-htrsf" Jun 10 13:14:55.252739 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.252138 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8cbd5836-7926-4ac1-99ed-7f98e161a0cc-multus-daemon-config\") pod \"multus-zp4l9\" (UID: \"8cbd5836-7926-4ac1-99ed-7f98e161a0cc\") " pod="openshift-multus/multus-zp4l9" Jun 10 13:14:55.252739 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.251792 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/503ace6f-dfa4-41b8-8ade-5294ab66e7a7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-htrsf\" (UID: \"503ace6f-dfa4-41b8-8ade-5294ab66e7a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-htrsf" Jun 10 13:14:55.252739 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.252328 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/503ace6f-dfa4-41b8-8ade-5294ab66e7a7-ovnkube-config\") pod \"ovnkube-node-htrsf\" (UID: \"503ace6f-dfa4-41b8-8ade-5294ab66e7a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-htrsf" Jun 10 13:14:55.252739 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.252355 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8cbd5836-7926-4ac1-99ed-7f98e161a0cc-multus-socket-dir-parent\") pod \"multus-zp4l9\" (UID: \"8cbd5836-7926-4ac1-99ed-7f98e161a0cc\") " pod="openshift-multus/multus-zp4l9" Jun 10 13:14:55.252739 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.252383 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e0f9bf9d-d15d-4d0a-9c5f-185a98848eaf-dbus\") pod \"global-pull-secret-syncer-qll8x\" (UID: \"e0f9bf9d-d15d-4d0a-9c5f-185a98848eaf\") " pod="kube-system/global-pull-secret-syncer-qll8x" Jun 10 13:14:55.252739 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.252406 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a53446ca-16a6-40de-a99d-f526b93ca2a4-agent-certs\") pod \"konnectivity-agent-4hgwk\" (UID: \"a53446ca-16a6-40de-a99d-f526b93ca2a4\") " pod="kube-system/konnectivity-agent-4hgwk" Jun 10 13:14:55.252739 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.252431 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/caeebc1e-0a5d-419c-a570-72986d79a4aa-etc-sysctl-d\") pod \"tuned-k6vks\" (UID: \"caeebc1e-0a5d-419c-a570-72986d79a4aa\") " pod="openshift-cluster-node-tuning-operator/tuned-k6vks" Jun 10 13:14:55.252739 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.252441 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8cbd5836-7926-4ac1-99ed-7f98e161a0cc-multus-socket-dir-parent\") pod \"multus-zp4l9\" (UID: \"8cbd5836-7926-4ac1-99ed-7f98e161a0cc\") " pod="openshift-multus/multus-zp4l9" Jun 10 13:14:55.252739 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.252458 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/caeebc1e-0a5d-419c-a570-72986d79a4aa-lib-modules\") pod \"tuned-k6vks\" (UID: \"caeebc1e-0a5d-419c-a570-72986d79a4aa\") " pod="openshift-cluster-node-tuning-operator/tuned-k6vks" Jun 10 13:14:55.252739 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.252482 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/caeebc1e-0a5d-419c-a570-72986d79a4aa-tmp\") pod \"tuned-k6vks\" (UID: \"caeebc1e-0a5d-419c-a570-72986d79a4aa\") " pod="openshift-cluster-node-tuning-operator/tuned-k6vks" Jun 10 13:14:55.253574 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.252505 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/36afda7c-ce8b-419d-99f2-c854959a7f4b-host-slash\") pod \"iptables-alerter-grjwr\" (UID: \"36afda7c-ce8b-419d-99f2-c854959a7f4b\") " pod="openshift-network-operator/iptables-alerter-grjwr" Jun 10 13:14:55.253574 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.252527 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8cbd5836-7926-4ac1-99ed-7f98e161a0cc-host-run-netns\") pod \"multus-zp4l9\" (UID: \"8cbd5836-7926-4ac1-99ed-7f98e161a0cc\") " pod="openshift-multus/multus-zp4l9" Jun 10 13:14:55.253574 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.252546 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8cbd5836-7926-4ac1-99ed-7f98e161a0cc-host-run-multus-certs\") pod \"multus-zp4l9\" (UID: \"8cbd5836-7926-4ac1-99ed-7f98e161a0cc\") " pod="openshift-multus/multus-zp4l9" Jun 10 13:14:55.253574 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.252564 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7ca2b072-b2f4-49c1-b491-37d85bf247d2-cni-binary-copy\") pod \"multus-additional-cni-plugins-bhrmz\" (UID: \"7ca2b072-b2f4-49c1-b491-37d85bf247d2\") " pod="openshift-multus/multus-additional-cni-plugins-bhrmz" Jun 10 13:14:55.253574 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.252557 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/caeebc1e-0a5d-419c-a570-72986d79a4aa-etc-sysctl-d\") pod \"tuned-k6vks\" (UID: \"caeebc1e-0a5d-419c-a570-72986d79a4aa\") " pod="openshift-cluster-node-tuning-operator/tuned-k6vks" Jun 10 13:14:55.253574 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.252631 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/36afda7c-ce8b-419d-99f2-c854959a7f4b-host-slash\") pod \"iptables-alerter-grjwr\" (UID: \"36afda7c-ce8b-419d-99f2-c854959a7f4b\") " pod="openshift-network-operator/iptables-alerter-grjwr" Jun 10 13:14:55.253574 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.252633 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/caeebc1e-0a5d-419c-a570-72986d79a4aa-lib-modules\") pod \"tuned-k6vks\" (UID: \"caeebc1e-0a5d-419c-a570-72986d79a4aa\") " pod="openshift-cluster-node-tuning-operator/tuned-k6vks" Jun 10 13:14:55.253574 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.252659 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/89d6f8f3-2a0d-4b45-9701-697ae9dc3339-kubelet-dir\") pod \"aws-ebs-csi-driver-node-d6glj\" (UID: \"89d6f8f3-2a0d-4b45-9701-697ae9dc3339\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d6glj" Jun 10 13:14:55.253574 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.252684 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8cbd5836-7926-4ac1-99ed-7f98e161a0cc-host-run-netns\") pod \"multus-zp4l9\" (UID: \"8cbd5836-7926-4ac1-99ed-7f98e161a0cc\") " pod="openshift-multus/multus-zp4l9" Jun 10 13:14:55.253574 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.252685 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/caeebc1e-0a5d-419c-a570-72986d79a4aa-etc-sysctl-conf\") pod \"tuned-k6vks\" (UID: \"caeebc1e-0a5d-419c-a570-72986d79a4aa\") " pod="openshift-cluster-node-tuning-operator/tuned-k6vks" Jun 10 13:14:55.253574 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.252799 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8cbd5836-7926-4ac1-99ed-7f98e161a0cc-host-run-multus-certs\") pod \"multus-zp4l9\" (UID: \"8cbd5836-7926-4ac1-99ed-7f98e161a0cc\") " pod="openshift-multus/multus-zp4l9" Jun 10 13:14:55.253574 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.252807 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/caeebc1e-0a5d-419c-a570-72986d79a4aa-etc-sysctl-conf\") pod \"tuned-k6vks\" (UID: \"caeebc1e-0a5d-419c-a570-72986d79a4aa\") " pod="openshift-cluster-node-tuning-operator/tuned-k6vks" Jun 10 13:14:55.253574 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.252856 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/503ace6f-dfa4-41b8-8ade-5294ab66e7a7-run-openvswitch\") pod \"ovnkube-node-htrsf\" (UID: \"503ace6f-dfa4-41b8-8ade-5294ab66e7a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-htrsf" Jun 10 13:14:55.253574 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.252875 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/89d6f8f3-2a0d-4b45-9701-697ae9dc3339-kubelet-dir\") pod \"aws-ebs-csi-driver-node-d6glj\" (UID: \"89d6f8f3-2a0d-4b45-9701-697ae9dc3339\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d6glj" Jun 10 13:14:55.253574 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.252900 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/503ace6f-dfa4-41b8-8ade-5294ab66e7a7-env-overrides\") pod \"ovnkube-node-htrsf\" (UID: \"503ace6f-dfa4-41b8-8ade-5294ab66e7a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-htrsf" Jun 10 13:14:55.253574 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.252902 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/503ace6f-dfa4-41b8-8ade-5294ab66e7a7-ovnkube-config\") pod \"ovnkube-node-htrsf\" (UID: \"503ace6f-dfa4-41b8-8ade-5294ab66e7a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-htrsf" Jun 10 13:14:55.253574 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.252916 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/503ace6f-dfa4-41b8-8ade-5294ab66e7a7-run-openvswitch\") pod \"ovnkube-node-htrsf\" (UID: \"503ace6f-dfa4-41b8-8ade-5294ab66e7a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-htrsf" Jun 10 13:14:55.254379 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.252924 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/89d6f8f3-2a0d-4b45-9701-697ae9dc3339-device-dir\") pod \"aws-ebs-csi-driver-node-d6glj\" (UID: \"89d6f8f3-2a0d-4b45-9701-697ae9dc3339\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d6glj" Jun 10 13:14:55.254379 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.252960 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a53446ca-16a6-40de-a99d-f526b93ca2a4-konnectivity-ca\") pod \"konnectivity-agent-4hgwk\" (UID: \"a53446ca-16a6-40de-a99d-f526b93ca2a4\") " pod="kube-system/konnectivity-agent-4hgwk" Jun 10 13:14:55.254379 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.252988 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/503ace6f-dfa4-41b8-8ade-5294ab66e7a7-var-lib-openvswitch\") pod \"ovnkube-node-htrsf\" (UID: \"503ace6f-dfa4-41b8-8ade-5294ab66e7a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-htrsf" Jun 10 13:14:55.254379 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.253004 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7ca2b072-b2f4-49c1-b491-37d85bf247d2-cni-binary-copy\") pod \"multus-additional-cni-plugins-bhrmz\" (UID: \"7ca2b072-b2f4-49c1-b491-37d85bf247d2\") " pod="openshift-multus/multus-additional-cni-plugins-bhrmz" Jun 10 13:14:55.254379 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.253012 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/503ace6f-dfa4-41b8-8ade-5294ab66e7a7-run-ovn\") pod \"ovnkube-node-htrsf\" (UID: \"503ace6f-dfa4-41b8-8ade-5294ab66e7a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-htrsf" Jun 10 13:14:55.254379 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.253040 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/503ace6f-dfa4-41b8-8ade-5294ab66e7a7-ovn-node-metrics-cert\") pod \"ovnkube-node-htrsf\" (UID: \"503ace6f-dfa4-41b8-8ade-5294ab66e7a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-htrsf" Jun 10 13:14:55.254379 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.253023 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/89d6f8f3-2a0d-4b45-9701-697ae9dc3339-device-dir\") pod \"aws-ebs-csi-driver-node-d6glj\" (UID: \"89d6f8f3-2a0d-4b45-9701-697ae9dc3339\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d6glj" Jun 10 13:14:55.254379 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.253063 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5eb4a19d-1cf0-4a15-abe1-2cf06495af67-host\") pod \"node-ca-j4s5b\" (UID: \"5eb4a19d-1cf0-4a15-abe1-2cf06495af67\") " pod="openshift-image-registry/node-ca-j4s5b" Jun 10 13:14:55.254379 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.253088 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/caeebc1e-0a5d-419c-a570-72986d79a4aa-etc-systemd\") pod \"tuned-k6vks\" (UID: \"caeebc1e-0a5d-419c-a570-72986d79a4aa\") " pod="openshift-cluster-node-tuning-operator/tuned-k6vks" Jun 10 13:14:55.254379 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.253096 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/503ace6f-dfa4-41b8-8ade-5294ab66e7a7-run-ovn\") pod \"ovnkube-node-htrsf\" (UID: \"503ace6f-dfa4-41b8-8ade-5294ab66e7a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-htrsf" Jun 10 13:14:55.254379 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.253063 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/503ace6f-dfa4-41b8-8ade-5294ab66e7a7-var-lib-openvswitch\") pod \"ovnkube-node-htrsf\" (UID: \"503ace6f-dfa4-41b8-8ade-5294ab66e7a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-htrsf" Jun 10 13:14:55.254379 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.253112 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68t29\" (UniqueName: \"kubernetes.io/projected/36afda7c-ce8b-419d-99f2-c854959a7f4b-kube-api-access-68t29\") pod \"iptables-alerter-grjwr\" (UID: \"36afda7c-ce8b-419d-99f2-c854959a7f4b\") " pod="openshift-network-operator/iptables-alerter-grjwr" Jun 10 13:14:55.254379 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.253122 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5eb4a19d-1cf0-4a15-abe1-2cf06495af67-host\") pod \"node-ca-j4s5b\" (UID: \"5eb4a19d-1cf0-4a15-abe1-2cf06495af67\") " pod="openshift-image-registry/node-ca-j4s5b" Jun 10 13:14:55.254379 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.253135 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8cbd5836-7926-4ac1-99ed-7f98e161a0cc-host-var-lib-cni-multus\") pod \"multus-zp4l9\" (UID: \"8cbd5836-7926-4ac1-99ed-7f98e161a0cc\") " pod="openshift-multus/multus-zp4l9" Jun 10 13:14:55.254379 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.253149 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/caeebc1e-0a5d-419c-a570-72986d79a4aa-etc-systemd\") pod \"tuned-k6vks\" (UID: \"caeebc1e-0a5d-419c-a570-72986d79a4aa\") " pod="openshift-cluster-node-tuning-operator/tuned-k6vks" Jun 10 13:14:55.254379 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.253158 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zjx6\" (UniqueName: \"kubernetes.io/projected/70145ee6-ed6f-4fcb-9ac6-7bf4439ecf8c-kube-api-access-2zjx6\") pod \"network-check-target-9f4rq\" (UID: \"70145ee6-ed6f-4fcb-9ac6-7bf4439ecf8c\") " pod="openshift-network-diagnostics/network-check-target-9f4rq" Jun 10 13:14:55.254379 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.253183 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7ca2b072-b2f4-49c1-b491-37d85bf247d2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bhrmz\" (UID: \"7ca2b072-b2f4-49c1-b491-37d85bf247d2\") " pod="openshift-multus/multus-additional-cni-plugins-bhrmz" Jun 10 13:14:55.255233 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.253187 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8cbd5836-7926-4ac1-99ed-7f98e161a0cc-host-var-lib-cni-multus\") pod \"multus-zp4l9\" (UID: \"8cbd5836-7926-4ac1-99ed-7f98e161a0cc\") " pod="openshift-multus/multus-zp4l9" Jun 10 13:14:55.255233 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.253208 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5eb4a19d-1cf0-4a15-abe1-2cf06495af67-serviceca\") pod \"node-ca-j4s5b\" (UID: \"5eb4a19d-1cf0-4a15-abe1-2cf06495af67\") " pod="openshift-image-registry/node-ca-j4s5b" Jun 10 13:14:55.255233 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.253236 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blhwn\" (UniqueName: \"kubernetes.io/projected/5eb4a19d-1cf0-4a15-abe1-2cf06495af67-kube-api-access-blhwn\") pod \"node-ca-j4s5b\" (UID: \"5eb4a19d-1cf0-4a15-abe1-2cf06495af67\") " pod="openshift-image-registry/node-ca-j4s5b" Jun 10 13:14:55.255233 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.253246 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/503ace6f-dfa4-41b8-8ade-5294ab66e7a7-env-overrides\") pod \"ovnkube-node-htrsf\" (UID: \"503ace6f-dfa4-41b8-8ade-5294ab66e7a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-htrsf" Jun 10 13:14:55.255233 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.253262 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8cbd5836-7926-4ac1-99ed-7f98e161a0cc-host-var-lib-cni-bin\") pod \"multus-zp4l9\" (UID: \"8cbd5836-7926-4ac1-99ed-7f98e161a0cc\") " pod="openshift-multus/multus-zp4l9" Jun 10 13:14:55.255233 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.253292 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8cbd5836-7926-4ac1-99ed-7f98e161a0cc-hostroot\") pod \"multus-zp4l9\" (UID: \"8cbd5836-7926-4ac1-99ed-7f98e161a0cc\") " pod="openshift-multus/multus-zp4l9" Jun 10 13:14:55.255233 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.253314 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8cbd5836-7926-4ac1-99ed-7f98e161a0cc-etc-kubernetes\") pod \"multus-zp4l9\" (UID: \"8cbd5836-7926-4ac1-99ed-7f98e161a0cc\") " pod="openshift-multus/multus-zp4l9" Jun 10 13:14:55.255233 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.253340 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4r2h\" (UniqueName: \"kubernetes.io/projected/7ca2b072-b2f4-49c1-b491-37d85bf247d2-kube-api-access-k4r2h\") pod \"multus-additional-cni-plugins-bhrmz\" (UID: \"7ca2b072-b2f4-49c1-b491-37d85bf247d2\") " pod="openshift-multus/multus-additional-cni-plugins-bhrmz" Jun 10 13:14:55.255233 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.253376 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4fad052f-bd79-43d6-8fe8-57ba27e1b911-hosts-file\") pod \"node-resolver-vpqgr\" (UID: \"4fad052f-bd79-43d6-8fe8-57ba27e1b911\") " pod="openshift-dns/node-resolver-vpqgr" Jun 10 13:14:55.255233 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.253422 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/89d6f8f3-2a0d-4b45-9701-697ae9dc3339-registration-dir\") pod \"aws-ebs-csi-driver-node-d6glj\" (UID: \"89d6f8f3-2a0d-4b45-9701-697ae9dc3339\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d6glj" Jun 10 13:14:55.255233 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.253431 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8cbd5836-7926-4ac1-99ed-7f98e161a0cc-hostroot\") pod \"multus-zp4l9\" (UID: \"8cbd5836-7926-4ac1-99ed-7f98e161a0cc\") " pod="openshift-multus/multus-zp4l9" Jun 10 13:14:55.255233 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.253448 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5458a9d3-baee-4c82-b5a5-9c0d1227c481-metrics-certs\") pod \"network-metrics-daemon-qn67p\" (UID: \"5458a9d3-baee-4c82-b5a5-9c0d1227c481\") " pod="openshift-multus/network-metrics-daemon-qn67p" Jun 10 13:14:55.255233 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.253476 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e0f9bf9d-d15d-4d0a-9c5f-185a98848eaf-original-pull-secret\") pod \"global-pull-secret-syncer-qll8x\" (UID: \"e0f9bf9d-d15d-4d0a-9c5f-185a98848eaf\") " pod="kube-system/global-pull-secret-syncer-qll8x" Jun 10 13:14:55.255233 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.253501 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/503ace6f-dfa4-41b8-8ade-5294ab66e7a7-node-log\") pod \"ovnkube-node-htrsf\" (UID: \"503ace6f-dfa4-41b8-8ade-5294ab66e7a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-htrsf" Jun 10 13:14:55.255233 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.253533 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/503ace6f-dfa4-41b8-8ade-5294ab66e7a7-host-run-ovn-kubernetes\") pod \"ovnkube-node-htrsf\" (UID: \"503ace6f-dfa4-41b8-8ade-5294ab66e7a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-htrsf" Jun 10 13:14:55.255233 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.253564 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kspbb\" (UniqueName: \"kubernetes.io/projected/4fad052f-bd79-43d6-8fe8-57ba27e1b911-kube-api-access-kspbb\") pod \"node-resolver-vpqgr\" (UID: \"4fad052f-bd79-43d6-8fe8-57ba27e1b911\") " pod="openshift-dns/node-resolver-vpqgr" Jun 10 13:14:55.255233 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.253592 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/36afda7c-ce8b-419d-99f2-c854959a7f4b-iptables-alerter-script\") pod \"iptables-alerter-grjwr\" (UID: \"36afda7c-ce8b-419d-99f2-c854959a7f4b\") " pod="openshift-network-operator/iptables-alerter-grjwr" Jun 10 13:14:55.255792 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.253595 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5eb4a19d-1cf0-4a15-abe1-2cf06495af67-serviceca\") pod \"node-ca-j4s5b\" (UID: \"5eb4a19d-1cf0-4a15-abe1-2cf06495af67\") " pod="openshift-image-registry/node-ca-j4s5b" Jun 10 13:14:55.255792 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.253634 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8cbd5836-7926-4ac1-99ed-7f98e161a0cc-multus-cni-dir\") pod \"multus-zp4l9\" (UID: \"8cbd5836-7926-4ac1-99ed-7f98e161a0cc\") " pod="openshift-multus/multus-zp4l9" Jun 10 13:14:55.255792 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.253669 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/503ace6f-dfa4-41b8-8ade-5294ab66e7a7-etc-openvswitch\") pod \"ovnkube-node-htrsf\" (UID: \"503ace6f-dfa4-41b8-8ade-5294ab66e7a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-htrsf" Jun 10 13:14:55.255792 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.253682 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/503ace6f-dfa4-41b8-8ade-5294ab66e7a7-node-log\") pod \"ovnkube-node-htrsf\" (UID: \"503ace6f-dfa4-41b8-8ade-5294ab66e7a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-htrsf" Jun 10 13:14:55.255792 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.253692 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/caeebc1e-0a5d-419c-a570-72986d79a4aa-host\") pod \"tuned-k6vks\" (UID: \"caeebc1e-0a5d-419c-a570-72986d79a4aa\") " pod="openshift-cluster-node-tuning-operator/tuned-k6vks" Jun 10 13:14:55.255792 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.253729 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8cbd5836-7926-4ac1-99ed-7f98e161a0cc-cnibin\") pod \"multus-zp4l9\" (UID: \"8cbd5836-7926-4ac1-99ed-7f98e161a0cc\") " pod="openshift-multus/multus-zp4l9" Jun 10 13:14:55.255792 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.253744 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8cbd5836-7926-4ac1-99ed-7f98e161a0cc-host-var-lib-cni-bin\") pod \"multus-zp4l9\" (UID: \"8cbd5836-7926-4ac1-99ed-7f98e161a0cc\") " pod="openshift-multus/multus-zp4l9" Jun 10 13:14:55.255792 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.253757 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8cbd5836-7926-4ac1-99ed-7f98e161a0cc-host-run-k8s-cni-cncf-io\") pod \"multus-zp4l9\" (UID: \"8cbd5836-7926-4ac1-99ed-7f98e161a0cc\") " pod="openshift-multus/multus-zp4l9" Jun 10 13:14:55.255792 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.253792 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8cbd5836-7926-4ac1-99ed-7f98e161a0cc-etc-kubernetes\") pod \"multus-zp4l9\" (UID: \"8cbd5836-7926-4ac1-99ed-7f98e161a0cc\") " pod="openshift-multus/multus-zp4l9" Jun 10 13:14:55.255792 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.253792 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ftlb\" (UniqueName: \"kubernetes.io/projected/5458a9d3-baee-4c82-b5a5-9c0d1227c481-kube-api-access-2ftlb\") pod \"network-metrics-daemon-qn67p\" (UID: \"5458a9d3-baee-4c82-b5a5-9c0d1227c481\") " pod="openshift-multus/network-metrics-daemon-qn67p" Jun 10 13:14:55.255792 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.253870 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/503ace6f-dfa4-41b8-8ade-5294ab66e7a7-systemd-units\") pod \"ovnkube-node-htrsf\" (UID: \"503ace6f-dfa4-41b8-8ade-5294ab66e7a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-htrsf" Jun 10 13:14:55.255792 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.253907 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/503ace6f-dfa4-41b8-8ade-5294ab66e7a7-host-cni-netd\") pod \"ovnkube-node-htrsf\" (UID: \"503ace6f-dfa4-41b8-8ade-5294ab66e7a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-htrsf" Jun 10 13:14:55.255792 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.253929 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/caeebc1e-0a5d-419c-a570-72986d79a4aa-var-lib-kubelet\") pod \"tuned-k6vks\" (UID: \"caeebc1e-0a5d-419c-a570-72986d79a4aa\") " pod="openshift-cluster-node-tuning-operator/tuned-k6vks" Jun 10 13:14:55.255792 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.253966 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7ca2b072-b2f4-49c1-b491-37d85bf247d2-cnibin\") pod \"multus-additional-cni-plugins-bhrmz\" (UID: \"7ca2b072-b2f4-49c1-b491-37d85bf247d2\") " pod="openshift-multus/multus-additional-cni-plugins-bhrmz" Jun 10 13:14:55.255792 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.253988 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8cbd5836-7926-4ac1-99ed-7f98e161a0cc-cnibin\") pod \"multus-zp4l9\" (UID: \"8cbd5836-7926-4ac1-99ed-7f98e161a0cc\") " pod="openshift-multus/multus-zp4l9" Jun 10 13:14:55.255792 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.254001 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/89d6f8f3-2a0d-4b45-9701-697ae9dc3339-socket-dir\") pod \"aws-ebs-csi-driver-node-d6glj\" (UID: \"89d6f8f3-2a0d-4b45-9701-697ae9dc3339\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d6glj" Jun 10 13:14:55.255792 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.254032 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8cbd5836-7926-4ac1-99ed-7f98e161a0cc-host-run-k8s-cni-cncf-io\") pod \"multus-zp4l9\" (UID: \"8cbd5836-7926-4ac1-99ed-7f98e161a0cc\") " pod="openshift-multus/multus-zp4l9" Jun 10 13:14:55.255792 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.254032 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4fad052f-bd79-43d6-8fe8-57ba27e1b911-hosts-file\") pod \"node-resolver-vpqgr\" (UID: \"4fad052f-bd79-43d6-8fe8-57ba27e1b911\") " pod="openshift-dns/node-resolver-vpqgr" Jun 10 13:14:55.256525 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.254026 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cfmm\" (UniqueName: \"kubernetes.io/projected/89d6f8f3-2a0d-4b45-9701-697ae9dc3339-kube-api-access-4cfmm\") pod \"aws-ebs-csi-driver-node-d6glj\" (UID: \"89d6f8f3-2a0d-4b45-9701-697ae9dc3339\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d6glj" Jun 10 13:14:55.256525 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.254078 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/89d6f8f3-2a0d-4b45-9701-697ae9dc3339-registration-dir\") pod \"aws-ebs-csi-driver-node-d6glj\" (UID: \"89d6f8f3-2a0d-4b45-9701-697ae9dc3339\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d6glj" Jun 10 13:14:55.256525 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.254091 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/503ace6f-dfa4-41b8-8ade-5294ab66e7a7-ovnkube-script-lib\") pod \"ovnkube-node-htrsf\" (UID: \"503ace6f-dfa4-41b8-8ade-5294ab66e7a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-htrsf" Jun 10 13:14:55.256525 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.254126 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/503ace6f-dfa4-41b8-8ade-5294ab66e7a7-etc-openvswitch\") pod \"ovnkube-node-htrsf\" (UID: \"503ace6f-dfa4-41b8-8ade-5294ab66e7a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-htrsf" Jun 10 13:14:55.256525 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.254128 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/caeebc1e-0a5d-419c-a570-72986d79a4aa-run\") pod \"tuned-k6vks\" (UID: \"caeebc1e-0a5d-419c-a570-72986d79a4aa\") " pod="openshift-cluster-node-tuning-operator/tuned-k6vks" Jun 10 13:14:55.256525 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.254161 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8cbd5836-7926-4ac1-99ed-7f98e161a0cc-multus-cni-dir\") pod \"multus-zp4l9\" (UID: \"8cbd5836-7926-4ac1-99ed-7f98e161a0cc\") " pod="openshift-multus/multus-zp4l9" Jun 10 13:14:55.256525 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.254168 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/caeebc1e-0a5d-419c-a570-72986d79a4aa-host\") pod \"tuned-k6vks\" (UID: \"caeebc1e-0a5d-419c-a570-72986d79a4aa\") " pod="openshift-cluster-node-tuning-operator/tuned-k6vks" Jun 10 13:14:55.256525 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.254127 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/36afda7c-ce8b-419d-99f2-c854959a7f4b-iptables-alerter-script\") pod \"iptables-alerter-grjwr\" (UID: \"36afda7c-ce8b-419d-99f2-c854959a7f4b\") " pod="openshift-network-operator/iptables-alerter-grjwr" Jun 10 13:14:55.256525 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.254173 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/503ace6f-dfa4-41b8-8ade-5294ab66e7a7-host-run-ovn-kubernetes\") pod \"ovnkube-node-htrsf\" (UID: \"503ace6f-dfa4-41b8-8ade-5294ab66e7a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-htrsf" Jun 10 13:14:55.256525 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.254167 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nmsd\" (UniqueName: \"kubernetes.io/projected/caeebc1e-0a5d-419c-a570-72986d79a4aa-kube-api-access-6nmsd\") pod \"tuned-k6vks\" (UID: \"caeebc1e-0a5d-419c-a570-72986d79a4aa\") " pod="openshift-cluster-node-tuning-operator/tuned-k6vks" Jun 10 13:14:55.256525 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.254209 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/503ace6f-dfa4-41b8-8ade-5294ab66e7a7-systemd-units\") pod \"ovnkube-node-htrsf\" (UID: \"503ace6f-dfa4-41b8-8ade-5294ab66e7a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-htrsf" Jun 10 13:14:55.256525 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.254223 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7ca2b072-b2f4-49c1-b491-37d85bf247d2-os-release\") pod \"multus-additional-cni-plugins-bhrmz\" (UID: \"7ca2b072-b2f4-49c1-b491-37d85bf247d2\") " pod="openshift-multus/multus-additional-cni-plugins-bhrmz" Jun 10 13:14:55.256525 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:14:55.254242 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 13:14:55.256525 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.254250 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/503ace6f-dfa4-41b8-8ade-5294ab66e7a7-host-slash\") pod \"ovnkube-node-htrsf\" (UID: \"503ace6f-dfa4-41b8-8ade-5294ab66e7a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-htrsf" Jun 10 13:14:55.256525 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.254279 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4q2v9\" (UniqueName: \"kubernetes.io/projected/8cbd5836-7926-4ac1-99ed-7f98e161a0cc-kube-api-access-4q2v9\") pod \"multus-zp4l9\" (UID: \"8cbd5836-7926-4ac1-99ed-7f98e161a0cc\") " pod="openshift-multus/multus-zp4l9" Jun 10 13:14:55.256525 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.254287 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/caeebc1e-0a5d-419c-a570-72986d79a4aa-var-lib-kubelet\") pod \"tuned-k6vks\" (UID: \"caeebc1e-0a5d-419c-a570-72986d79a4aa\") " pod="openshift-cluster-node-tuning-operator/tuned-k6vks" Jun 10 13:14:55.256525 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:14:55.254321 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5458a9d3-baee-4c82-b5a5-9c0d1227c481-metrics-certs podName:5458a9d3-baee-4c82-b5a5-9c0d1227c481 nodeName:}" failed. No retries permitted until 2026-06-10 13:14:55.75428604 +0000 UTC m=+3.019536630 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5458a9d3-baee-4c82-b5a5-9c0d1227c481-metrics-certs") pod "network-metrics-daemon-qn67p" (UID: "5458a9d3-baee-4c82-b5a5-9c0d1227c481") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 13:14:55.257320 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.254325 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7ca2b072-b2f4-49c1-b491-37d85bf247d2-cnibin\") pod \"multus-additional-cni-plugins-bhrmz\" (UID: \"7ca2b072-b2f4-49c1-b491-37d85bf247d2\") " pod="openshift-multus/multus-additional-cni-plugins-bhrmz" Jun 10 13:14:55.257320 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.254403 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/caeebc1e-0a5d-419c-a570-72986d79a4aa-run\") pod \"tuned-k6vks\" (UID: \"caeebc1e-0a5d-419c-a570-72986d79a4aa\") " pod="openshift-cluster-node-tuning-operator/tuned-k6vks" Jun 10 13:14:55.257320 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.254416 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/89d6f8f3-2a0d-4b45-9701-697ae9dc3339-socket-dir\") pod \"aws-ebs-csi-driver-node-d6glj\" (UID: \"89d6f8f3-2a0d-4b45-9701-697ae9dc3339\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d6glj" Jun 10 13:14:55.257320 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.254476 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7ca2b072-b2f4-49c1-b491-37d85bf247d2-system-cni-dir\") pod \"multus-additional-cni-plugins-bhrmz\" (UID: \"7ca2b072-b2f4-49c1-b491-37d85bf247d2\") " pod="openshift-multus/multus-additional-cni-plugins-bhrmz" Jun 10 13:14:55.257320 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.254547 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7ca2b072-b2f4-49c1-b491-37d85bf247d2-system-cni-dir\") pod \"multus-additional-cni-plugins-bhrmz\" (UID: \"7ca2b072-b2f4-49c1-b491-37d85bf247d2\") " pod="openshift-multus/multus-additional-cni-plugins-bhrmz" Jun 10 13:14:55.257320 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.254684 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7ca2b072-b2f4-49c1-b491-37d85bf247d2-os-release\") pod \"multus-additional-cni-plugins-bhrmz\" (UID: \"7ca2b072-b2f4-49c1-b491-37d85bf247d2\") " pod="openshift-multus/multus-additional-cni-plugins-bhrmz" Jun 10 13:14:55.257320 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.254724 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7ca2b072-b2f4-49c1-b491-37d85bf247d2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bhrmz\" (UID: \"7ca2b072-b2f4-49c1-b491-37d85bf247d2\") " pod="openshift-multus/multus-additional-cni-plugins-bhrmz" Jun 10 13:14:55.257320 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.254251 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/503ace6f-dfa4-41b8-8ade-5294ab66e7a7-host-cni-netd\") pod \"ovnkube-node-htrsf\" (UID: \"503ace6f-dfa4-41b8-8ade-5294ab66e7a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-htrsf" Jun 10 13:14:55.257320 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.254756 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/503ace6f-dfa4-41b8-8ade-5294ab66e7a7-host-slash\") pod \"ovnkube-node-htrsf\" (UID: \"503ace6f-dfa4-41b8-8ade-5294ab66e7a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-htrsf" Jun 10 13:14:55.257320 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.254951 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/503ace6f-dfa4-41b8-8ade-5294ab66e7a7-ovnkube-script-lib\") pod \"ovnkube-node-htrsf\" (UID: \"503ace6f-dfa4-41b8-8ade-5294ab66e7a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-htrsf" Jun 10 13:14:55.257320 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.255686 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/503ace6f-dfa4-41b8-8ade-5294ab66e7a7-ovn-node-metrics-cert\") pod \"ovnkube-node-htrsf\" (UID: \"503ace6f-dfa4-41b8-8ade-5294ab66e7a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-htrsf" Jun 10 13:14:55.257320 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.255925 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/caeebc1e-0a5d-419c-a570-72986d79a4aa-tmp\") pod \"tuned-k6vks\" (UID: \"caeebc1e-0a5d-419c-a570-72986d79a4aa\") " pod="openshift-cluster-node-tuning-operator/tuned-k6vks" Jun 10 13:14:55.257320 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.256284 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/caeebc1e-0a5d-419c-a570-72986d79a4aa-etc-tuned\") pod \"tuned-k6vks\" (UID: \"caeebc1e-0a5d-419c-a570-72986d79a4aa\") " pod="openshift-cluster-node-tuning-operator/tuned-k6vks" Jun 10 13:14:55.260616 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.260592 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-srdz2\" (UniqueName: \"kubernetes.io/projected/503ace6f-dfa4-41b8-8ade-5294ab66e7a7-kube-api-access-srdz2\") pod \"ovnkube-node-htrsf\" (UID: \"503ace6f-dfa4-41b8-8ade-5294ab66e7a7\") " pod="openshift-ovn-kubernetes/ovnkube-node-htrsf" Jun 10 13:14:55.264396 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:14:55.264376 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 13:14:55.264529 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:14:55.264400 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 13:14:55.264529 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:14:55.264414 2567 projected.go:196] Error preparing data for projected volume kube-api-access-2zjx6 for pod openshift-network-diagnostics/network-check-target-9f4rq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 13:14:55.264529 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:14:55.264472 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/70145ee6-ed6f-4fcb-9ac6-7bf4439ecf8c-kube-api-access-2zjx6 podName:70145ee6-ed6f-4fcb-9ac6-7bf4439ecf8c nodeName:}" failed. No retries permitted until 2026-06-10 13:14:55.764452927 +0000 UTC m=+3.029703534 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-2zjx6" (UniqueName: "kubernetes.io/projected/70145ee6-ed6f-4fcb-9ac6-7bf4439ecf8c-kube-api-access-2zjx6") pod "network-check-target-9f4rq" (UID: "70145ee6-ed6f-4fcb-9ac6-7bf4439ecf8c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 13:14:55.266964 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.266938 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4r2h\" (UniqueName: \"kubernetes.io/projected/7ca2b072-b2f4-49c1-b491-37d85bf247d2-kube-api-access-k4r2h\") pod \"multus-additional-cni-plugins-bhrmz\" (UID: \"7ca2b072-b2f4-49c1-b491-37d85bf247d2\") " pod="openshift-multus/multus-additional-cni-plugins-bhrmz" Jun 10 13:14:55.267377 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.267355 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4q2v9\" (UniqueName: \"kubernetes.io/projected/8cbd5836-7926-4ac1-99ed-7f98e161a0cc-kube-api-access-4q2v9\") pod \"multus-zp4l9\" (UID: \"8cbd5836-7926-4ac1-99ed-7f98e161a0cc\") " pod="openshift-multus/multus-zp4l9" Jun 10 13:14:55.267651 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.267606 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cfmm\" (UniqueName: \"kubernetes.io/projected/89d6f8f3-2a0d-4b45-9701-697ae9dc3339-kube-api-access-4cfmm\") pod \"aws-ebs-csi-driver-node-d6glj\" (UID: \"89d6f8f3-2a0d-4b45-9701-697ae9dc3339\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d6glj" Jun 10 13:14:55.268364 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.268061 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-blhwn\" (UniqueName: \"kubernetes.io/projected/5eb4a19d-1cf0-4a15-abe1-2cf06495af67-kube-api-access-blhwn\") pod \"node-ca-j4s5b\" (UID: \"5eb4a19d-1cf0-4a15-abe1-2cf06495af67\") " pod="openshift-image-registry/node-ca-j4s5b" Jun 10 13:14:55.268364 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.268336 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nmsd\" (UniqueName: \"kubernetes.io/projected/caeebc1e-0a5d-419c-a570-72986d79a4aa-kube-api-access-6nmsd\") pod \"tuned-k6vks\" (UID: \"caeebc1e-0a5d-419c-a570-72986d79a4aa\") " pod="openshift-cluster-node-tuning-operator/tuned-k6vks" Jun 10 13:14:55.268536 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.268416 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-68t29\" (UniqueName: \"kubernetes.io/projected/36afda7c-ce8b-419d-99f2-c854959a7f4b-kube-api-access-68t29\") pod \"iptables-alerter-grjwr\" (UID: \"36afda7c-ce8b-419d-99f2-c854959a7f4b\") " pod="openshift-network-operator/iptables-alerter-grjwr" Jun 10 13:14:55.270763 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.268610 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ftlb\" (UniqueName: \"kubernetes.io/projected/5458a9d3-baee-4c82-b5a5-9c0d1227c481-kube-api-access-2ftlb\") pod \"network-metrics-daemon-qn67p\" (UID: \"5458a9d3-baee-4c82-b5a5-9c0d1227c481\") " pod="openshift-multus/network-metrics-daemon-qn67p" Jun 10 13:14:55.271175 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.271158 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kspbb\" (UniqueName: \"kubernetes.io/projected/4fad052f-bd79-43d6-8fe8-57ba27e1b911-kube-api-access-kspbb\") pod \"node-resolver-vpqgr\" (UID: \"4fad052f-bd79-43d6-8fe8-57ba27e1b911\") " pod="openshift-dns/node-resolver-vpqgr" Jun 10 13:14:55.355110 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.355078 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a53446ca-16a6-40de-a99d-f526b93ca2a4-konnectivity-ca\") pod \"konnectivity-agent-4hgwk\" (UID: \"a53446ca-16a6-40de-a99d-f526b93ca2a4\") " pod="kube-system/konnectivity-agent-4hgwk" Jun 10 13:14:55.355275 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.355133 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e0f9bf9d-d15d-4d0a-9c5f-185a98848eaf-original-pull-secret\") pod \"global-pull-secret-syncer-qll8x\" (UID: \"e0f9bf9d-d15d-4d0a-9c5f-185a98848eaf\") " pod="kube-system/global-pull-secret-syncer-qll8x" Jun 10 13:14:55.355275 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.355160 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e0f9bf9d-d15d-4d0a-9c5f-185a98848eaf-kubelet-config\") pod \"global-pull-secret-syncer-qll8x\" (UID: \"e0f9bf9d-d15d-4d0a-9c5f-185a98848eaf\") " pod="kube-system/global-pull-secret-syncer-qll8x" Jun 10 13:14:55.355275 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.355193 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e0f9bf9d-d15d-4d0a-9c5f-185a98848eaf-dbus\") pod \"global-pull-secret-syncer-qll8x\" (UID: \"e0f9bf9d-d15d-4d0a-9c5f-185a98848eaf\") " pod="kube-system/global-pull-secret-syncer-qll8x" Jun 10 13:14:55.355275 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.355220 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a53446ca-16a6-40de-a99d-f526b93ca2a4-agent-certs\") pod \"konnectivity-agent-4hgwk\" (UID: \"a53446ca-16a6-40de-a99d-f526b93ca2a4\") " pod="kube-system/konnectivity-agent-4hgwk" Jun 10 13:14:55.355475 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.355294 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e0f9bf9d-d15d-4d0a-9c5f-185a98848eaf-kubelet-config\") pod \"global-pull-secret-syncer-qll8x\" (UID: \"e0f9bf9d-d15d-4d0a-9c5f-185a98848eaf\") " pod="kube-system/global-pull-secret-syncer-qll8x" Jun 10 13:14:55.355475 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:14:55.355318 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 13:14:55.355475 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.355370 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e0f9bf9d-d15d-4d0a-9c5f-185a98848eaf-dbus\") pod \"global-pull-secret-syncer-qll8x\" (UID: \"e0f9bf9d-d15d-4d0a-9c5f-185a98848eaf\") " pod="kube-system/global-pull-secret-syncer-qll8x" Jun 10 13:14:55.355475 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:14:55.355384 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0f9bf9d-d15d-4d0a-9c5f-185a98848eaf-original-pull-secret podName:e0f9bf9d-d15d-4d0a-9c5f-185a98848eaf nodeName:}" failed. No retries permitted until 2026-06-10 13:14:55.855363527 +0000 UTC m=+3.120614121 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e0f9bf9d-d15d-4d0a-9c5f-185a98848eaf-original-pull-secret") pod "global-pull-secret-syncer-qll8x" (UID: "e0f9bf9d-d15d-4d0a-9c5f-185a98848eaf") : object "kube-system"/"original-pull-secret" not registered Jun 10 13:14:55.355650 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.355617 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a53446ca-16a6-40de-a99d-f526b93ca2a4-konnectivity-ca\") pod \"konnectivity-agent-4hgwk\" (UID: \"a53446ca-16a6-40de-a99d-f526b93ca2a4\") " pod="kube-system/konnectivity-agent-4hgwk" Jun 10 13:14:55.357638 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.357617 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a53446ca-16a6-40de-a99d-f526b93ca2a4-agent-certs\") pod \"konnectivity-agent-4hgwk\" (UID: \"a53446ca-16a6-40de-a99d-f526b93ca2a4\") " pod="kube-system/konnectivity-agent-4hgwk" Jun 10 13:14:55.436190 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.436111 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bhrmz" Jun 10 13:14:55.445675 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.445651 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vpqgr" Jun 10 13:14:55.452425 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.452403 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-j4s5b" Jun 10 13:14:55.458268 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.458251 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d6glj" Jun 10 13:14:55.466187 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.466166 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-k6vks" Jun 10 13:14:55.473694 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.473672 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-grjwr" Jun 10 13:14:55.480306 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.480290 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zp4l9" Jun 10 13:14:55.487420 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.487401 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-htrsf" Jun 10 13:14:55.491234 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.491216 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4hgwk" Jun 10 13:14:55.758096 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.758000 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5458a9d3-baee-4c82-b5a5-9c0d1227c481-metrics-certs\") pod \"network-metrics-daemon-qn67p\" (UID: \"5458a9d3-baee-4c82-b5a5-9c0d1227c481\") " pod="openshift-multus/network-metrics-daemon-qn67p" Jun 10 13:14:55.758244 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:14:55.758164 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 13:14:55.758244 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:14:55.758230 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5458a9d3-baee-4c82-b5a5-9c0d1227c481-metrics-certs podName:5458a9d3-baee-4c82-b5a5-9c0d1227c481 nodeName:}" failed. No retries permitted until 2026-06-10 13:14:56.758214574 +0000 UTC m=+4.023465148 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5458a9d3-baee-4c82-b5a5-9c0d1227c481-metrics-certs") pod "network-metrics-daemon-qn67p" (UID: "5458a9d3-baee-4c82-b5a5-9c0d1227c481") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 13:14:55.858915 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.858883 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e0f9bf9d-d15d-4d0a-9c5f-185a98848eaf-original-pull-secret\") pod \"global-pull-secret-syncer-qll8x\" (UID: \"e0f9bf9d-d15d-4d0a-9c5f-185a98848eaf\") " pod="kube-system/global-pull-secret-syncer-qll8x" Jun 10 13:14:55.859063 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:55.858948 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zjx6\" (UniqueName: \"kubernetes.io/projected/70145ee6-ed6f-4fcb-9ac6-7bf4439ecf8c-kube-api-access-2zjx6\") pod \"network-check-target-9f4rq\" (UID: \"70145ee6-ed6f-4fcb-9ac6-7bf4439ecf8c\") " pod="openshift-network-diagnostics/network-check-target-9f4rq" Jun 10 13:14:55.859063 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:14:55.859049 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 13:14:55.859144 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:14:55.859113 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0f9bf9d-d15d-4d0a-9c5f-185a98848eaf-original-pull-secret podName:e0f9bf9d-d15d-4d0a-9c5f-185a98848eaf nodeName:}" failed. No retries permitted until 2026-06-10 13:14:56.859099319 +0000 UTC m=+4.124349894 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e0f9bf9d-d15d-4d0a-9c5f-185a98848eaf-original-pull-secret") pod "global-pull-secret-syncer-qll8x" (UID: "e0f9bf9d-d15d-4d0a-9c5f-185a98848eaf") : object "kube-system"/"original-pull-secret" not registered Jun 10 13:14:55.859144 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:14:55.859057 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 13:14:55.859229 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:14:55.859148 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 13:14:55.859229 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:14:55.859158 2567 projected.go:196] Error preparing data for projected volume kube-api-access-2zjx6 for pod openshift-network-diagnostics/network-check-target-9f4rq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 13:14:55.859229 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:14:55.859198 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/70145ee6-ed6f-4fcb-9ac6-7bf4439ecf8c-kube-api-access-2zjx6 podName:70145ee6-ed6f-4fcb-9ac6-7bf4439ecf8c nodeName:}" failed. No retries permitted until 2026-06-10 13:14:56.859187299 +0000 UTC m=+4.124437875 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-2zjx6" (UniqueName: "kubernetes.io/projected/70145ee6-ed6f-4fcb-9ac6-7bf4439ecf8c-kube-api-access-2zjx6") pod "network-check-target-9f4rq" (UID: "70145ee6-ed6f-4fcb-9ac6-7bf4439ecf8c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 13:14:55.891626 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:55.891576 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cbd5836_7926_4ac1_99ed_7f98e161a0cc.slice/crio-573287dc7f8c9896a95851be479f655db286965d3986cf9a7d58759a2b1b4f9e WatchSource:0}: Error finding container 573287dc7f8c9896a95851be479f655db286965d3986cf9a7d58759a2b1b4f9e: Status 404 returned error can't find the container with id 573287dc7f8c9896a95851be479f655db286965d3986cf9a7d58759a2b1b4f9e Jun 10 13:14:55.894560 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:55.894406 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcaeebc1e_0a5d_419c_a570_72986d79a4aa.slice/crio-637fcf91a40e13cc5de0fce01f4138f3e4c7a48ff4c6ed09cf0e0aac5f58efff WatchSource:0}: Error finding container 637fcf91a40e13cc5de0fce01f4138f3e4c7a48ff4c6ed09cf0e0aac5f58efff: Status 404 returned error can't find the container with id 637fcf91a40e13cc5de0fce01f4138f3e4c7a48ff4c6ed09cf0e0aac5f58efff Jun 10 13:14:55.894738 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:55.894712 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ca2b072_b2f4_49c1_b491_37d85bf247d2.slice/crio-f43464ac067f2f302303dd38a89361e7de75bcede8203d75f12159f4832a016e WatchSource:0}: Error finding container f43464ac067f2f302303dd38a89361e7de75bcede8203d75f12159f4832a016e: Status 404 returned error can't find the container with id f43464ac067f2f302303dd38a89361e7de75bcede8203d75f12159f4832a016e Jun 10 13:14:55.897486 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:55.897451 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fad052f_bd79_43d6_8fe8_57ba27e1b911.slice/crio-701fdf2ea09f986213fadfb04d69a7be906d71358bf606fcc091d84a16070eff WatchSource:0}: Error finding container 701fdf2ea09f986213fadfb04d69a7be906d71358bf606fcc091d84a16070eff: Status 404 returned error can't find the container with id 701fdf2ea09f986213fadfb04d69a7be906d71358bf606fcc091d84a16070eff Jun 10 13:14:55.898730 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:55.898710 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda53446ca_16a6_40de_a99d_f526b93ca2a4.slice/crio-685426d0856dfd510cf8156de4357584a9b08a8bee46c35f9e0efcc399573615 WatchSource:0}: Error finding container 685426d0856dfd510cf8156de4357584a9b08a8bee46c35f9e0efcc399573615: Status 404 returned error can't find the container with id 685426d0856dfd510cf8156de4357584a9b08a8bee46c35f9e0efcc399573615 Jun 10 13:14:55.900005 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:55.899985 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36afda7c_ce8b_419d_99f2_c854959a7f4b.slice/crio-445b5e0335786db48a0b5b6a3ee6c5a601fcbabd4eef540f0a68c6065385aa32 WatchSource:0}: Error finding container 445b5e0335786db48a0b5b6a3ee6c5a601fcbabd4eef540f0a68c6065385aa32: Status 404 returned error can't find the container with id 445b5e0335786db48a0b5b6a3ee6c5a601fcbabd4eef540f0a68c6065385aa32 Jun 10 13:14:55.902083 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:55.901621 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89d6f8f3_2a0d_4b45_9701_697ae9dc3339.slice/crio-9b9f879dc5cc7e6bf61e00ad19b4adb1b619525d19ea93ed8da5ea703db4016e WatchSource:0}: Error finding container 9b9f879dc5cc7e6bf61e00ad19b4adb1b619525d19ea93ed8da5ea703db4016e: Status 404 returned error can't find the container with id 9b9f879dc5cc7e6bf61e00ad19b4adb1b619525d19ea93ed8da5ea703db4016e Jun 10 13:14:55.902336 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:55.902310 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5eb4a19d_1cf0_4a15_abe1_2cf06495af67.slice/crio-f9b3b72283da1cd18949a04afe02c8893d29f9f7173092767d8ded89211bd20b WatchSource:0}: Error finding container f9b3b72283da1cd18949a04afe02c8893d29f9f7173092767d8ded89211bd20b: Status 404 returned error can't find the container with id f9b3b72283da1cd18949a04afe02c8893d29f9f7173092767d8ded89211bd20b Jun 10 13:14:55.903762 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:14:55.903739 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod503ace6f_dfa4_41b8_8ade_5294ab66e7a7.slice/crio-ee8ac389169e07b6ea7455892856c384e8a149e71a2ffbf40306e76c2f91c71e WatchSource:0}: Error finding container ee8ac389169e07b6ea7455892856c384e8a149e71a2ffbf40306e76c2f91c71e: Status 404 returned error can't find the container with id ee8ac389169e07b6ea7455892856c384e8a149e71a2ffbf40306e76c2f91c71e Jun 10 13:14:56.181075 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:56.180852 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-09 13:09:55 +0000 UTC" deadline="2027-11-18 12:13:23.526714489 +0000 UTC" Jun 10 13:14:56.181466 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:56.181082 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12622h58m27.345642019s" Jun 10 13:14:56.212615 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:56.212590 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zp4l9" event={"ID":"8cbd5836-7926-4ac1-99ed-7f98e161a0cc","Type":"ContainerStarted","Data":"573287dc7f8c9896a95851be479f655db286965d3986cf9a7d58759a2b1b4f9e"} Jun 10 13:14:56.213966 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:56.213927 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-htrsf" event={"ID":"503ace6f-dfa4-41b8-8ade-5294ab66e7a7","Type":"ContainerStarted","Data":"ee8ac389169e07b6ea7455892856c384e8a149e71a2ffbf40306e76c2f91c71e"} Jun 10 13:14:56.215077 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:56.215040 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-j4s5b" event={"ID":"5eb4a19d-1cf0-4a15-abe1-2cf06495af67","Type":"ContainerStarted","Data":"f9b3b72283da1cd18949a04afe02c8893d29f9f7173092767d8ded89211bd20b"} Jun 10 13:14:56.216135 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:56.216111 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-grjwr" event={"ID":"36afda7c-ce8b-419d-99f2-c854959a7f4b","Type":"ContainerStarted","Data":"445b5e0335786db48a0b5b6a3ee6c5a601fcbabd4eef540f0a68c6065385aa32"} Jun 10 13:14:56.220126 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:56.220100 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4hgwk" event={"ID":"a53446ca-16a6-40de-a99d-f526b93ca2a4","Type":"ContainerStarted","Data":"685426d0856dfd510cf8156de4357584a9b08a8bee46c35f9e0efcc399573615"} Jun 10 13:14:56.221294 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:56.221265 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-k6vks" event={"ID":"caeebc1e-0a5d-419c-a570-72986d79a4aa","Type":"ContainerStarted","Data":"637fcf91a40e13cc5de0fce01f4138f3e4c7a48ff4c6ed09cf0e0aac5f58efff"} Jun 10 13:14:56.223302 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:56.223277 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-19.ec2.internal" event={"ID":"42d2d3b59dbeb7d6f92fb6b1848e3017","Type":"ContainerStarted","Data":"ee8cef9cee5d323ad1fd8359a4c908c2c54e6b5fddb0359785d5671923d04bc4"} Jun 10 13:14:56.225017 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:56.224998 2567 generic.go:356] "Generic (PLEG): container finished" podID="fa45664cf77ef7584d59a465af594f4b" containerID="ddf390ff0f81223c64ed87f7ad77b1d0062ff5ecba7256c3eede18e9053ce5df" exitCode=0 Jun 10 13:14:56.225110 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:56.225075 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-19.ec2.internal" event={"ID":"fa45664cf77ef7584d59a465af594f4b","Type":"ContainerDied","Data":"ddf390ff0f81223c64ed87f7ad77b1d0062ff5ecba7256c3eede18e9053ce5df"} Jun 10 13:14:56.226374 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:56.226348 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d6glj" event={"ID":"89d6f8f3-2a0d-4b45-9701-697ae9dc3339","Type":"ContainerStarted","Data":"9b9f879dc5cc7e6bf61e00ad19b4adb1b619525d19ea93ed8da5ea703db4016e"} Jun 10 13:14:56.227460 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:56.227437 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bhrmz" event={"ID":"7ca2b072-b2f4-49c1-b491-37d85bf247d2","Type":"ContainerStarted","Data":"f43464ac067f2f302303dd38a89361e7de75bcede8203d75f12159f4832a016e"} Jun 10 13:14:56.228913 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:56.228894 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vpqgr" event={"ID":"4fad052f-bd79-43d6-8fe8-57ba27e1b911","Type":"ContainerStarted","Data":"701fdf2ea09f986213fadfb04d69a7be906d71358bf606fcc091d84a16070eff"} Jun 10 13:14:56.240022 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:56.239919 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-19.ec2.internal" podStartSLOduration=2.239902958 podStartE2EDuration="2.239902958s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 13:14:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:14:56.238917015 +0000 UTC m=+3.504167612" watchObservedRunningTime="2026-06-10 13:14:56.239902958 +0000 UTC m=+3.505153555" Jun 10 13:14:56.766741 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:56.766704 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5458a9d3-baee-4c82-b5a5-9c0d1227c481-metrics-certs\") pod \"network-metrics-daemon-qn67p\" (UID: \"5458a9d3-baee-4c82-b5a5-9c0d1227c481\") " pod="openshift-multus/network-metrics-daemon-qn67p" Jun 10 13:14:56.766941 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:14:56.766898 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 13:14:56.767017 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:14:56.766959 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5458a9d3-baee-4c82-b5a5-9c0d1227c481-metrics-certs podName:5458a9d3-baee-4c82-b5a5-9c0d1227c481 nodeName:}" failed. No retries permitted until 2026-06-10 13:14:58.766941169 +0000 UTC m=+6.032191748 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5458a9d3-baee-4c82-b5a5-9c0d1227c481-metrics-certs") pod "network-metrics-daemon-qn67p" (UID: "5458a9d3-baee-4c82-b5a5-9c0d1227c481") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 13:14:56.868550 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:56.867732 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zjx6\" (UniqueName: \"kubernetes.io/projected/70145ee6-ed6f-4fcb-9ac6-7bf4439ecf8c-kube-api-access-2zjx6\") pod \"network-check-target-9f4rq\" (UID: \"70145ee6-ed6f-4fcb-9ac6-7bf4439ecf8c\") " pod="openshift-network-diagnostics/network-check-target-9f4rq" Jun 10 13:14:56.868550 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:56.867800 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e0f9bf9d-d15d-4d0a-9c5f-185a98848eaf-original-pull-secret\") pod \"global-pull-secret-syncer-qll8x\" (UID: \"e0f9bf9d-d15d-4d0a-9c5f-185a98848eaf\") " pod="kube-system/global-pull-secret-syncer-qll8x" Jun 10 13:14:56.868550 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:14:56.867956 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 13:14:56.868550 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:14:56.868023 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0f9bf9d-d15d-4d0a-9c5f-185a98848eaf-original-pull-secret podName:e0f9bf9d-d15d-4d0a-9c5f-185a98848eaf nodeName:}" failed. No retries permitted until 2026-06-10 13:14:58.868003753 +0000 UTC m=+6.133254345 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e0f9bf9d-d15d-4d0a-9c5f-185a98848eaf-original-pull-secret") pod "global-pull-secret-syncer-qll8x" (UID: "e0f9bf9d-d15d-4d0a-9c5f-185a98848eaf") : object "kube-system"/"original-pull-secret" not registered Jun 10 13:14:56.868550 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:14:56.868426 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 13:14:56.868550 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:14:56.868450 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 13:14:56.868550 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:14:56.868463 2567 projected.go:196] Error preparing data for projected volume kube-api-access-2zjx6 for pod openshift-network-diagnostics/network-check-target-9f4rq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 13:14:56.868550 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:14:56.868510 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/70145ee6-ed6f-4fcb-9ac6-7bf4439ecf8c-kube-api-access-2zjx6 podName:70145ee6-ed6f-4fcb-9ac6-7bf4439ecf8c nodeName:}" failed. No retries permitted until 2026-06-10 13:14:58.868494954 +0000 UTC m=+6.133745531 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-2zjx6" (UniqueName: "kubernetes.io/projected/70145ee6-ed6f-4fcb-9ac6-7bf4439ecf8c-kube-api-access-2zjx6") pod "network-check-target-9f4rq" (UID: "70145ee6-ed6f-4fcb-9ac6-7bf4439ecf8c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 13:14:57.182135 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:57.181999 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-09 13:09:55 +0000 UTC" deadline="2027-11-20 08:26:51.574876734 +0000 UTC" Jun 10 13:14:57.182135 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:57.182060 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12667h11m54.392820689s" Jun 10 13:14:57.204549 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:57.204522 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9f4rq" Jun 10 13:14:57.204764 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:14:57.204644 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9f4rq" podUID="70145ee6-ed6f-4fcb-9ac6-7bf4439ecf8c" Jun 10 13:14:57.205068 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:57.205048 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qn67p" Jun 10 13:14:57.205191 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:14:57.205157 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qn67p" podUID="5458a9d3-baee-4c82-b5a5-9c0d1227c481" Jun 10 13:14:57.205253 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:57.205216 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qll8x" Jun 10 13:14:57.205322 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:14:57.205285 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qll8x" podUID="e0f9bf9d-d15d-4d0a-9c5f-185a98848eaf" Jun 10 13:14:57.258914 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:57.258878 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-19.ec2.internal" event={"ID":"fa45664cf77ef7584d59a465af594f4b","Type":"ContainerStarted","Data":"725286677f70118ce29c776399f3d52601d704028b8b57924e3c523c7e423b1e"} Jun 10 13:14:58.786022 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:58.785984 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5458a9d3-baee-4c82-b5a5-9c0d1227c481-metrics-certs\") pod \"network-metrics-daemon-qn67p\" (UID: \"5458a9d3-baee-4c82-b5a5-9c0d1227c481\") " pod="openshift-multus/network-metrics-daemon-qn67p" Jun 10 13:14:58.786679 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:14:58.786153 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 13:14:58.786679 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:14:58.786234 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5458a9d3-baee-4c82-b5a5-9c0d1227c481-metrics-certs podName:5458a9d3-baee-4c82-b5a5-9c0d1227c481 nodeName:}" failed. No retries permitted until 2026-06-10 13:15:02.786213912 +0000 UTC m=+10.051464502 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5458a9d3-baee-4c82-b5a5-9c0d1227c481-metrics-certs") pod "network-metrics-daemon-qn67p" (UID: "5458a9d3-baee-4c82-b5a5-9c0d1227c481") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 13:14:58.886968 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:58.886929 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zjx6\" (UniqueName: \"kubernetes.io/projected/70145ee6-ed6f-4fcb-9ac6-7bf4439ecf8c-kube-api-access-2zjx6\") pod \"network-check-target-9f4rq\" (UID: \"70145ee6-ed6f-4fcb-9ac6-7bf4439ecf8c\") " pod="openshift-network-diagnostics/network-check-target-9f4rq" Jun 10 13:14:58.887226 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:58.886998 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e0f9bf9d-d15d-4d0a-9c5f-185a98848eaf-original-pull-secret\") pod \"global-pull-secret-syncer-qll8x\" (UID: \"e0f9bf9d-d15d-4d0a-9c5f-185a98848eaf\") " pod="kube-system/global-pull-secret-syncer-qll8x" Jun 10 13:14:58.887226 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:14:58.887132 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 13:14:58.887226 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:14:58.887192 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0f9bf9d-d15d-4d0a-9c5f-185a98848eaf-original-pull-secret podName:e0f9bf9d-d15d-4d0a-9c5f-185a98848eaf nodeName:}" failed. No retries permitted until 2026-06-10 13:15:02.887173295 +0000 UTC m=+10.152423873 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e0f9bf9d-d15d-4d0a-9c5f-185a98848eaf-original-pull-secret") pod "global-pull-secret-syncer-qll8x" (UID: "e0f9bf9d-d15d-4d0a-9c5f-185a98848eaf") : object "kube-system"/"original-pull-secret" not registered Jun 10 13:14:58.887564 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:14:58.887545 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 13:14:58.887657 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:14:58.887570 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 13:14:58.887657 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:14:58.887582 2567 projected.go:196] Error preparing data for projected volume kube-api-access-2zjx6 for pod openshift-network-diagnostics/network-check-target-9f4rq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 13:14:58.887657 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:14:58.887630 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/70145ee6-ed6f-4fcb-9ac6-7bf4439ecf8c-kube-api-access-2zjx6 podName:70145ee6-ed6f-4fcb-9ac6-7bf4439ecf8c nodeName:}" failed. No retries permitted until 2026-06-10 13:15:02.887614667 +0000 UTC m=+10.152865257 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-2zjx6" (UniqueName: "kubernetes.io/projected/70145ee6-ed6f-4fcb-9ac6-7bf4439ecf8c-kube-api-access-2zjx6") pod "network-check-target-9f4rq" (UID: "70145ee6-ed6f-4fcb-9ac6-7bf4439ecf8c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 13:14:59.204953 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:59.203945 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qn67p" Jun 10 13:14:59.204953 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:14:59.204109 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qn67p" podUID="5458a9d3-baee-4c82-b5a5-9c0d1227c481" Jun 10 13:14:59.204953 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:59.204544 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9f4rq" Jun 10 13:14:59.204953 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:14:59.204661 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9f4rq" podUID="70145ee6-ed6f-4fcb-9ac6-7bf4439ecf8c" Jun 10 13:14:59.204953 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:14:59.204774 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qll8x" Jun 10 13:14:59.205508 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:14:59.205441 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qll8x" podUID="e0f9bf9d-d15d-4d0a-9c5f-185a98848eaf" Jun 10 13:15:01.203654 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:01.203608 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9f4rq" Jun 10 13:15:01.204108 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:15:01.203850 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9f4rq" podUID="70145ee6-ed6f-4fcb-9ac6-7bf4439ecf8c" Jun 10 13:15:01.204327 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:01.204282 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qn67p" Jun 10 13:15:01.204442 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:15:01.204413 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qn67p" podUID="5458a9d3-baee-4c82-b5a5-9c0d1227c481" Jun 10 13:15:01.204577 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:01.204561 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qll8x" Jun 10 13:15:01.204666 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:15:01.204646 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qll8x" podUID="e0f9bf9d-d15d-4d0a-9c5f-185a98848eaf" Jun 10 13:15:02.820361 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:02.820131 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5458a9d3-baee-4c82-b5a5-9c0d1227c481-metrics-certs\") pod \"network-metrics-daemon-qn67p\" (UID: \"5458a9d3-baee-4c82-b5a5-9c0d1227c481\") " pod="openshift-multus/network-metrics-daemon-qn67p" Jun 10 13:15:02.820361 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:15:02.820266 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 13:15:02.820361 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:15:02.820343 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5458a9d3-baee-4c82-b5a5-9c0d1227c481-metrics-certs podName:5458a9d3-baee-4c82-b5a5-9c0d1227c481 nodeName:}" failed. No retries permitted until 2026-06-10 13:15:10.820321262 +0000 UTC m=+18.085571842 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5458a9d3-baee-4c82-b5a5-9c0d1227c481-metrics-certs") pod "network-metrics-daemon-qn67p" (UID: "5458a9d3-baee-4c82-b5a5-9c0d1227c481") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 13:15:02.921059 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:02.921018 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zjx6\" (UniqueName: \"kubernetes.io/projected/70145ee6-ed6f-4fcb-9ac6-7bf4439ecf8c-kube-api-access-2zjx6\") pod \"network-check-target-9f4rq\" (UID: \"70145ee6-ed6f-4fcb-9ac6-7bf4439ecf8c\") " pod="openshift-network-diagnostics/network-check-target-9f4rq" Jun 10 13:15:02.921253 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:02.921086 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e0f9bf9d-d15d-4d0a-9c5f-185a98848eaf-original-pull-secret\") pod \"global-pull-secret-syncer-qll8x\" (UID: \"e0f9bf9d-d15d-4d0a-9c5f-185a98848eaf\") " pod="kube-system/global-pull-secret-syncer-qll8x" Jun 10 13:15:02.921253 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:15:02.921219 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 13:15:02.921253 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:15:02.921228 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 13:15:02.921421 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:15:02.921264 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 13:15:02.921421 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:15:02.921280 2567 projected.go:196] Error preparing data for projected volume kube-api-access-2zjx6 for pod openshift-network-diagnostics/network-check-target-9f4rq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 13:15:02.921421 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:15:02.921288 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0f9bf9d-d15d-4d0a-9c5f-185a98848eaf-original-pull-secret podName:e0f9bf9d-d15d-4d0a-9c5f-185a98848eaf nodeName:}" failed. No retries permitted until 2026-06-10 13:15:10.921268919 +0000 UTC m=+18.186519497 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e0f9bf9d-d15d-4d0a-9c5f-185a98848eaf-original-pull-secret") pod "global-pull-secret-syncer-qll8x" (UID: "e0f9bf9d-d15d-4d0a-9c5f-185a98848eaf") : object "kube-system"/"original-pull-secret" not registered Jun 10 13:15:02.921421 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:15:02.921342 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/70145ee6-ed6f-4fcb-9ac6-7bf4439ecf8c-kube-api-access-2zjx6 podName:70145ee6-ed6f-4fcb-9ac6-7bf4439ecf8c nodeName:}" failed. No retries permitted until 2026-06-10 13:15:10.921315529 +0000 UTC m=+18.186566108 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-2zjx6" (UniqueName: "kubernetes.io/projected/70145ee6-ed6f-4fcb-9ac6-7bf4439ecf8c-kube-api-access-2zjx6") pod "network-check-target-9f4rq" (UID: "70145ee6-ed6f-4fcb-9ac6-7bf4439ecf8c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 13:15:03.205625 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:03.204955 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qn67p" Jun 10 13:15:03.205625 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:15:03.205077 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qn67p" podUID="5458a9d3-baee-4c82-b5a5-9c0d1227c481" Jun 10 13:15:03.205625 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:03.205428 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qll8x" Jun 10 13:15:03.205625 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:15:03.205520 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qll8x" podUID="e0f9bf9d-d15d-4d0a-9c5f-185a98848eaf" Jun 10 13:15:03.206284 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:03.205987 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9f4rq" Jun 10 13:15:03.206284 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:15:03.206074 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9f4rq" podUID="70145ee6-ed6f-4fcb-9ac6-7bf4439ecf8c" Jun 10 13:15:05.202982 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:05.202944 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qll8x" Jun 10 13:15:05.203423 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:15:05.203086 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qll8x" podUID="e0f9bf9d-d15d-4d0a-9c5f-185a98848eaf" Jun 10 13:15:05.203423 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:05.203114 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qn67p" Jun 10 13:15:05.203423 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:05.203151 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9f4rq" Jun 10 13:15:05.203423 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:15:05.203294 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qn67p" podUID="5458a9d3-baee-4c82-b5a5-9c0d1227c481" Jun 10 13:15:05.203423 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:15:05.203357 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9f4rq" podUID="70145ee6-ed6f-4fcb-9ac6-7bf4439ecf8c" Jun 10 13:15:07.202911 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:07.202871 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qn67p" Jun 10 13:15:07.203320 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:07.202926 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qll8x" Jun 10 13:15:07.203320 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:07.202928 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9f4rq" Jun 10 13:15:07.203320 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:15:07.203033 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qll8x" podUID="e0f9bf9d-d15d-4d0a-9c5f-185a98848eaf" Jun 10 13:15:07.203320 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:15:07.203113 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9f4rq" podUID="70145ee6-ed6f-4fcb-9ac6-7bf4439ecf8c" Jun 10 13:15:07.203320 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:15:07.203240 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qn67p" podUID="5458a9d3-baee-4c82-b5a5-9c0d1227c481" Jun 10 13:15:09.202584 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:09.202551 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qll8x" Jun 10 13:15:09.203112 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:09.202551 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9f4rq" Jun 10 13:15:09.203112 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:15:09.202648 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qll8x" podUID="e0f9bf9d-d15d-4d0a-9c5f-185a98848eaf" Jun 10 13:15:09.203112 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:09.202561 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qn67p" Jun 10 13:15:09.203112 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:15:09.202752 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9f4rq" podUID="70145ee6-ed6f-4fcb-9ac6-7bf4439ecf8c" Jun 10 13:15:09.203112 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:15:09.202878 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qn67p" podUID="5458a9d3-baee-4c82-b5a5-9c0d1227c481" Jun 10 13:15:10.885365 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:10.885328 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5458a9d3-baee-4c82-b5a5-9c0d1227c481-metrics-certs\") pod \"network-metrics-daemon-qn67p\" (UID: \"5458a9d3-baee-4c82-b5a5-9c0d1227c481\") " pod="openshift-multus/network-metrics-daemon-qn67p" Jun 10 13:15:10.885791 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:15:10.885467 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 13:15:10.885791 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:15:10.885550 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5458a9d3-baee-4c82-b5a5-9c0d1227c481-metrics-certs podName:5458a9d3-baee-4c82-b5a5-9c0d1227c481 nodeName:}" failed. No retries permitted until 2026-06-10 13:15:26.885528239 +0000 UTC m=+34.150778817 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5458a9d3-baee-4c82-b5a5-9c0d1227c481-metrics-certs") pod "network-metrics-daemon-qn67p" (UID: "5458a9d3-baee-4c82-b5a5-9c0d1227c481") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 13:15:10.985753 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:10.985722 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zjx6\" (UniqueName: \"kubernetes.io/projected/70145ee6-ed6f-4fcb-9ac6-7bf4439ecf8c-kube-api-access-2zjx6\") pod \"network-check-target-9f4rq\" (UID: \"70145ee6-ed6f-4fcb-9ac6-7bf4439ecf8c\") " pod="openshift-network-diagnostics/network-check-target-9f4rq" Jun 10 13:15:10.985933 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:10.985781 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e0f9bf9d-d15d-4d0a-9c5f-185a98848eaf-original-pull-secret\") pod \"global-pull-secret-syncer-qll8x\" (UID: \"e0f9bf9d-d15d-4d0a-9c5f-185a98848eaf\") " pod="kube-system/global-pull-secret-syncer-qll8x" Jun 10 13:15:10.985933 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:15:10.985913 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 13:15:10.985933 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:15:10.985921 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 13:15:10.986084 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:15:10.985946 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 13:15:10.986084 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:15:10.985958 2567 projected.go:196] Error preparing data for projected volume kube-api-access-2zjx6 for pod openshift-network-diagnostics/network-check-target-9f4rq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 13:15:10.986084 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:15:10.985979 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0f9bf9d-d15d-4d0a-9c5f-185a98848eaf-original-pull-secret podName:e0f9bf9d-d15d-4d0a-9c5f-185a98848eaf nodeName:}" failed. No retries permitted until 2026-06-10 13:15:26.985959056 +0000 UTC m=+34.251209646 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e0f9bf9d-d15d-4d0a-9c5f-185a98848eaf-original-pull-secret") pod "global-pull-secret-syncer-qll8x" (UID: "e0f9bf9d-d15d-4d0a-9c5f-185a98848eaf") : object "kube-system"/"original-pull-secret" not registered Jun 10 13:15:10.986084 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:15:10.986007 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/70145ee6-ed6f-4fcb-9ac6-7bf4439ecf8c-kube-api-access-2zjx6 podName:70145ee6-ed6f-4fcb-9ac6-7bf4439ecf8c nodeName:}" failed. No retries permitted until 2026-06-10 13:15:26.985989526 +0000 UTC m=+34.251240119 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-2zjx6" (UniqueName: "kubernetes.io/projected/70145ee6-ed6f-4fcb-9ac6-7bf4439ecf8c-kube-api-access-2zjx6") pod "network-check-target-9f4rq" (UID: "70145ee6-ed6f-4fcb-9ac6-7bf4439ecf8c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 13:15:11.202874 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:11.202784 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9f4rq" Jun 10 13:15:11.202874 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:11.202799 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qll8x" Jun 10 13:15:11.202874 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:11.202792 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qn67p" Jun 10 13:15:11.203114 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:15:11.202911 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9f4rq" podUID="70145ee6-ed6f-4fcb-9ac6-7bf4439ecf8c" Jun 10 13:15:11.203114 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:15:11.202996 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qn67p" podUID="5458a9d3-baee-4c82-b5a5-9c0d1227c481" Jun 10 13:15:11.203114 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:15:11.203083 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qll8x" podUID="e0f9bf9d-d15d-4d0a-9c5f-185a98848eaf" Jun 10 13:15:13.203593 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:13.203496 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qn67p" Jun 10 13:15:13.204060 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:15:13.203616 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qn67p" podUID="5458a9d3-baee-4c82-b5a5-9c0d1227c481" Jun 10 13:15:13.204060 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:13.204000 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9f4rq" Jun 10 13:15:13.204166 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:15:13.204093 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9f4rq" podUID="70145ee6-ed6f-4fcb-9ac6-7bf4439ecf8c" Jun 10 13:15:13.204166 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:13.204147 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qll8x" Jun 10 13:15:13.204279 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:15:13.204219 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qll8x" podUID="e0f9bf9d-d15d-4d0a-9c5f-185a98848eaf" Jun 10 13:15:15.202681 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:15.202375 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qn67p" Jun 10 13:15:15.203296 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:15.202377 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qll8x" Jun 10 13:15:15.203296 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:15:15.202764 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qn67p" podUID="5458a9d3-baee-4c82-b5a5-9c0d1227c481" Jun 10 13:15:15.203296 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:15.202382 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9f4rq" Jun 10 13:15:15.203296 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:15:15.202866 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qll8x" podUID="e0f9bf9d-d15d-4d0a-9c5f-185a98848eaf" Jun 10 13:15:15.203296 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:15:15.202976 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9f4rq" podUID="70145ee6-ed6f-4fcb-9ac6-7bf4439ecf8c" Jun 10 13:15:15.298547 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:15.298517 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zp4l9" event={"ID":"8cbd5836-7926-4ac1-99ed-7f98e161a0cc","Type":"ContainerStarted","Data":"417bfcd74e24816eb5a1cc79cfe05a66dc0aafcf18aa71ac30631218ed04530f"} Jun 10 13:15:15.301860 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:15.301819 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-htrsf_503ace6f-dfa4-41b8-8ade-5294ab66e7a7/ovn-acl-logging/0.log" Jun 10 13:15:15.302234 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:15.302178 2567 generic.go:356] "Generic (PLEG): container finished" podID="503ace6f-dfa4-41b8-8ade-5294ab66e7a7" containerID="c73c26219bf368ce13dbc3fd2258da215d420374f77cc57f8a167c7ca7f81d65" exitCode=1 Jun 10 13:15:15.302364 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:15.302254 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-htrsf" event={"ID":"503ace6f-dfa4-41b8-8ade-5294ab66e7a7","Type":"ContainerStarted","Data":"b486e07955e684c8163d0a2e7aa4b7cd61c15d452c0b84797a6bab838fc04734"} Jun 10 13:15:15.302364 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:15.302325 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-htrsf" event={"ID":"503ace6f-dfa4-41b8-8ade-5294ab66e7a7","Type":"ContainerStarted","Data":"b87230958aaf7cd07076b4549fbd14171d90174933df9de77f5d7d19a80e35ed"} Jun 10 13:15:15.302484 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:15.302376 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-htrsf" event={"ID":"503ace6f-dfa4-41b8-8ade-5294ab66e7a7","Type":"ContainerStarted","Data":"d96a837bf92765503e9e83facc2d98058b272a310165a6d2e96c7fdbc53097ac"} Jun 10 13:15:15.302484 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:15.302426 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-htrsf" event={"ID":"503ace6f-dfa4-41b8-8ade-5294ab66e7a7","Type":"ContainerStarted","Data":"15f04e02ac48315b98248fff65f23214f4fc61bf7a4a4784797e84599e162f59"} Jun 10 13:15:15.302484 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:15.302477 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-htrsf" event={"ID":"503ace6f-dfa4-41b8-8ade-5294ab66e7a7","Type":"ContainerDied","Data":"c73c26219bf368ce13dbc3fd2258da215d420374f77cc57f8a167c7ca7f81d65"} Jun 10 13:15:15.302635 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:15.302527 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-htrsf" event={"ID":"503ace6f-dfa4-41b8-8ade-5294ab66e7a7","Type":"ContainerStarted","Data":"70352d8ec7be4cf985a9dd639aa5b464b84a3ece0924dc1f35e3f329e315b0d3"} Jun 10 13:15:15.304417 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:15.304358 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-j4s5b" event={"ID":"5eb4a19d-1cf0-4a15-abe1-2cf06495af67","Type":"ContainerStarted","Data":"60788b477bc579d6f3c6ca9bb3a467e029edda7b4bdea64f8192c8217d499178"} Jun 10 13:15:15.306113 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:15.306083 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4hgwk" event={"ID":"a53446ca-16a6-40de-a99d-f526b93ca2a4","Type":"ContainerStarted","Data":"086c8cce4440148a84cd8b73bf7f99100d0e80784f07906d3126fa0145fa7c32"} Jun 10 13:15:15.307786 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:15.307763 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-k6vks" event={"ID":"caeebc1e-0a5d-419c-a570-72986d79a4aa","Type":"ContainerStarted","Data":"92d397c3c9622f9e111a60c73e6e7535e61758b5b58b68292a9e20cd6c5b0f93"} Jun 10 13:15:15.309280 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:15.309253 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d6glj" event={"ID":"89d6f8f3-2a0d-4b45-9701-697ae9dc3339","Type":"ContainerStarted","Data":"3c623ccc2e0288b88d0a919313c375b73d5b14d6fc0337e8ea37c69c95b28435"} Jun 10 13:15:15.311305 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:15.311277 2567 generic.go:356] "Generic (PLEG): container finished" podID="7ca2b072-b2f4-49c1-b491-37d85bf247d2" containerID="9f304bfa7ff0009af225472a0932c6740ae3f52e2d4497faac83268f8b467460" exitCode=0 Jun 10 13:15:15.311410 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:15.311310 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bhrmz" event={"ID":"7ca2b072-b2f4-49c1-b491-37d85bf247d2","Type":"ContainerDied","Data":"9f304bfa7ff0009af225472a0932c6740ae3f52e2d4497faac83268f8b467460"} Jun 10 13:15:15.313996 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:15.313695 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vpqgr" event={"ID":"4fad052f-bd79-43d6-8fe8-57ba27e1b911","Type":"ContainerStarted","Data":"7c1f0535c73630ad0112839a20a4cfee9b27944b512486d547c6bc1843cac149"} Jun 10 13:15:15.318175 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:15.318134 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-19.ec2.internal" podStartSLOduration=21.318121605 podStartE2EDuration="21.318121605s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 13:14:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:14:57.276699204 +0000 UTC m=+4.541949802" watchObservedRunningTime="2026-06-10 13:15:15.318121605 +0000 UTC m=+22.583372201" Jun 10 13:15:15.318651 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:15.318618 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-zp4l9" podStartSLOduration=3.688573398 podStartE2EDuration="22.31860689s" totalImagesPullingTime="18.630033492s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 13:14:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:15:15.317941895 +0000 UTC m=+22.583192493" watchObservedRunningTime="2026-06-10 13:15:15.31860689 +0000 UTC m=+22.583857489" Jun 10 13:15:15.356038 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:15.355995 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-vpqgr" podStartSLOduration=3.77015384 podStartE2EDuration="22.355980408s" totalImagesPullingTime="18.585826568s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 13:14:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:15:15.355829174 +0000 UTC m=+22.621079771" watchObservedRunningTime="2026-06-10 13:15:15.355980408 +0000 UTC m=+22.621231005" Jun 10 13:15:15.372066 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:15.372025 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-j4s5b" podStartSLOduration=3.818861341 podStartE2EDuration="22.372012233s" totalImagesPullingTime="18.553150892s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 13:14:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:15:15.371317216 +0000 UTC m=+22.636567822" watchObservedRunningTime="2026-06-10 13:15:15.372012233 +0000 UTC m=+22.637262832" Jun 10 13:15:15.412488 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:15.412446 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-k6vks" podStartSLOduration=3.850764967 podStartE2EDuration="22.412433359s" totalImagesPullingTime="18.561668392s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 13:14:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:15:15.397731738 +0000 UTC m=+22.662982334" watchObservedRunningTime="2026-06-10 13:15:15.412433359 +0000 UTC m=+22.677683956" Jun 10 13:15:15.412800 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:15.412781 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-4hgwk" podStartSLOduration=3.855276991 podStartE2EDuration="22.412773839s" totalImagesPullingTime="18.557496848s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:14:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:15:15.41239995 +0000 UTC m=+22.677650547" watchObservedRunningTime="2026-06-10 13:15:15.412773839 +0000 UTC m=+22.678024474" Jun 10 13:15:16.054625 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:16.054597 2567 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 10 13:15:16.201832 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:16.201699 2567 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-10T13:15:16.054617254Z","UUID":"86ecb4ad-da50-48e6-b056-a1d632f3c1f9","Handler":null,"Name":"","Endpoint":""} Jun 10 13:15:16.203377 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:16.203351 2567 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 10 13:15:16.203805 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:16.203394 2567 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 10 13:15:16.318325 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:16.318286 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d6glj" event={"ID":"89d6f8f3-2a0d-4b45-9701-697ae9dc3339","Type":"ContainerStarted","Data":"f2c4789671c4ff853cf182e86404e620d661d6962910f30039b4e3e2cd397a2f"} Jun 10 13:15:16.319942 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:16.319916 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-grjwr" event={"ID":"36afda7c-ce8b-419d-99f2-c854959a7f4b","Type":"ContainerStarted","Data":"dd8b06a7e0a549ed0a7ded3b2741cbdb6ca37fcc1e82afd0689ee739e7f1859f"} Jun 10 13:15:16.338759 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:16.338715 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-grjwr" podStartSLOduration=4.757414996 podStartE2EDuration="23.338701206s" totalImagesPullingTime="18.58128621s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 13:14:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:15:16.338042699 +0000 UTC m=+23.603293295" watchObservedRunningTime="2026-06-10 13:15:16.338701206 +0000 UTC m=+23.603951805" Jun 10 13:15:17.203169 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:17.203103 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qn67p" Jun 10 13:15:17.203324 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:17.203104 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qll8x" Jun 10 13:15:17.203324 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:15:17.203226 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qn67p" podUID="5458a9d3-baee-4c82-b5a5-9c0d1227c481" Jun 10 13:15:17.203324 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:17.203111 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9f4rq" Jun 10 13:15:17.203324 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:15:17.203300 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qll8x" podUID="e0f9bf9d-d15d-4d0a-9c5f-185a98848eaf" Jun 10 13:15:17.203737 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:15:17.203351 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9f4rq" podUID="70145ee6-ed6f-4fcb-9ac6-7bf4439ecf8c" Jun 10 13:15:17.324717 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:17.324686 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d6glj" event={"ID":"89d6f8f3-2a0d-4b45-9701-697ae9dc3339","Type":"ContainerStarted","Data":"c51a181f8dbe2a5033e09fb1d5cdf3cbb8c4fb7ffc4af77367e32411229798f2"} Jun 10 13:15:17.346659 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:17.346614 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d6glj" podStartSLOduration=3.758946628 podStartE2EDuration="24.346598328s" totalImagesPullingTime="20.5876517s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 13:14:53 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:15:17.34548327 +0000 UTC m=+24.610733868" watchObservedRunningTime="2026-06-10 13:15:17.346598328 +0000 UTC m=+24.611848924" Jun 10 13:15:18.333742 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:18.333714 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-htrsf_503ace6f-dfa4-41b8-8ade-5294ab66e7a7/ovn-acl-logging/0.log" Jun 10 13:15:18.334220 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:18.334194 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-htrsf" event={"ID":"503ace6f-dfa4-41b8-8ade-5294ab66e7a7","Type":"ContainerStarted","Data":"0be1ab92a14b3b993b87bcbfc767f3866f66d0899e02c4c50a933214ba4daa7d"} Jun 10 13:15:19.202802 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:19.202603 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qll8x" Jun 10 13:15:19.203001 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:19.202603 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qn67p" Jun 10 13:15:19.203001 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:15:19.202911 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qll8x" podUID="e0f9bf9d-d15d-4d0a-9c5f-185a98848eaf" Jun 10 13:15:19.203001 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:19.202659 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9f4rq" Jun 10 13:15:19.203001 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:15:19.202986 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qn67p" podUID="5458a9d3-baee-4c82-b5a5-9c0d1227c481" Jun 10 13:15:19.203153 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:15:19.203031 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9f4rq" podUID="70145ee6-ed6f-4fcb-9ac6-7bf4439ecf8c" Jun 10 13:15:19.662071 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:19.662032 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-4hgwk" Jun 10 13:15:19.662861 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:19.662688 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-4hgwk" Jun 10 13:15:19.667423 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:19.667408 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-4hgwk" Jun 10 13:15:19.667727 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:19.667712 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-4hgwk" Jun 10 13:15:20.339228 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:20.339050 2567 generic.go:356] "Generic (PLEG): container finished" podID="7ca2b072-b2f4-49c1-b491-37d85bf247d2" containerID="1614341c0cb1e12ab2ab085a0d38e351bd842c6738bbcbf5b7e4199d8753cc02" exitCode=0 Jun 10 13:15:20.339389 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:20.339125 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bhrmz" event={"ID":"7ca2b072-b2f4-49c1-b491-37d85bf247d2","Type":"ContainerDied","Data":"1614341c0cb1e12ab2ab085a0d38e351bd842c6738bbcbf5b7e4199d8753cc02"} Jun 10 13:15:20.342595 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:20.342575 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-htrsf_503ace6f-dfa4-41b8-8ade-5294ab66e7a7/ovn-acl-logging/0.log" Jun 10 13:15:20.342977 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:20.342955 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-htrsf" event={"ID":"503ace6f-dfa4-41b8-8ade-5294ab66e7a7","Type":"ContainerStarted","Data":"b981263577133c94cfa1728e43516cbd8912770843a8fe318d5317e921f4f9ba"} Jun 10 13:15:20.343246 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:20.343229 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-htrsf" Jun 10 13:15:20.343375 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:20.343360 2567 scope.go:117] "RemoveContainer" containerID="c73c26219bf368ce13dbc3fd2258da215d420374f77cc57f8a167c7ca7f81d65" Jun 10 13:15:20.359444 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:20.359401 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-htrsf" Jun 10 13:15:21.202286 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:21.202255 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9f4rq" Jun 10 13:15:21.202681 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:21.202262 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qn67p" Jun 10 13:15:21.202681 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:15:21.202386 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9f4rq" podUID="70145ee6-ed6f-4fcb-9ac6-7bf4439ecf8c" Jun 10 13:15:21.202681 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:21.202264 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qll8x" Jun 10 13:15:21.202681 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:15:21.202438 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qn67p" podUID="5458a9d3-baee-4c82-b5a5-9c0d1227c481" Jun 10 13:15:21.202681 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:15:21.202510 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qll8x" podUID="e0f9bf9d-d15d-4d0a-9c5f-185a98848eaf" Jun 10 13:15:21.347187 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:21.347103 2567 generic.go:356] "Generic (PLEG): container finished" podID="7ca2b072-b2f4-49c1-b491-37d85bf247d2" containerID="15836be8cdcc3f89f83082a213c1cfaa74b38f9b9b6859cc26006920ad10497a" exitCode=0 Jun 10 13:15:21.347332 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:21.347180 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bhrmz" event={"ID":"7ca2b072-b2f4-49c1-b491-37d85bf247d2","Type":"ContainerDied","Data":"15836be8cdcc3f89f83082a213c1cfaa74b38f9b9b6859cc26006920ad10497a"} Jun 10 13:15:21.351112 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:21.351096 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-htrsf_503ace6f-dfa4-41b8-8ade-5294ab66e7a7/ovn-acl-logging/0.log" Jun 10 13:15:21.351442 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:21.351420 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-htrsf" event={"ID":"503ace6f-dfa4-41b8-8ade-5294ab66e7a7","Type":"ContainerStarted","Data":"cb63b2539e3dca299508148067747a1bfdbba4d4737e490918175e37223c5c46"} Jun 10 13:15:21.351625 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:21.351611 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-htrsf" Jun 10 13:15:21.351700 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:21.351669 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-htrsf" Jun 10 13:15:21.369504 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:21.369473 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-htrsf" Jun 10 13:15:21.374518 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:21.374495 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qll8x"] Jun 10 13:15:21.374638 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:21.374580 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qll8x" Jun 10 13:15:21.374684 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:15:21.374667 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qll8x" podUID="e0f9bf9d-d15d-4d0a-9c5f-185a98848eaf" Jun 10 13:15:21.377771 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:21.377749 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9f4rq"] Jun 10 13:15:21.377934 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:21.377834 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9f4rq" Jun 10 13:15:21.378030 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:15:21.377940 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9f4rq" podUID="70145ee6-ed6f-4fcb-9ac6-7bf4439ecf8c" Jun 10 13:15:21.378377 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:21.378355 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qn67p"] Jun 10 13:15:21.378441 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:21.378432 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qn67p" Jun 10 13:15:21.378539 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:15:21.378523 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qn67p" podUID="5458a9d3-baee-4c82-b5a5-9c0d1227c481" Jun 10 13:15:21.402061 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:21.402016 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-htrsf" podStartSLOduration=9.802988836 podStartE2EDuration="28.402001693s" totalImagesPullingTime="18.599012857s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 13:14:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:15:21.400601392 +0000 UTC m=+28.665852010" watchObservedRunningTime="2026-06-10 13:15:21.402001693 +0000 UTC m=+28.667252300" Jun 10 13:15:22.355712 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:22.355634 2567 generic.go:356] "Generic (PLEG): container finished" podID="7ca2b072-b2f4-49c1-b491-37d85bf247d2" containerID="80a35d5624f7d02aaba0d415f42e5e48a55c446a568b24e1c512f858103c5725" exitCode=0 Jun 10 13:15:22.356097 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:22.355719 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bhrmz" event={"ID":"7ca2b072-b2f4-49c1-b491-37d85bf247d2","Type":"ContainerDied","Data":"80a35d5624f7d02aaba0d415f42e5e48a55c446a568b24e1c512f858103c5725"} Jun 10 13:15:23.203791 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:23.203754 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qn67p" Jun 10 13:15:23.203977 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:23.203900 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qll8x" Jun 10 13:15:23.203977 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:23.203945 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9f4rq" Jun 10 13:15:23.203977 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:15:23.203939 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qn67p" podUID="5458a9d3-baee-4c82-b5a5-9c0d1227c481" Jun 10 13:15:23.204147 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:15:23.204082 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9f4rq" podUID="70145ee6-ed6f-4fcb-9ac6-7bf4439ecf8c" Jun 10 13:15:23.204220 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:15:23.204193 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qll8x" podUID="e0f9bf9d-d15d-4d0a-9c5f-185a98848eaf" Jun 10 13:15:24.811235 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:24.811028 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:15:24.902197 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:24.902161 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:15:25.202872 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:25.202797 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qll8x" Jun 10 13:15:25.202872 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:25.202810 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qn67p" Jun 10 13:15:25.202872 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:25.202819 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9f4rq" Jun 10 13:15:25.203143 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:15:25.202999 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qll8x" podUID="e0f9bf9d-d15d-4d0a-9c5f-185a98848eaf" Jun 10 13:15:25.205864 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:15:25.203464 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qn67p" podUID="5458a9d3-baee-4c82-b5a5-9c0d1227c481" Jun 10 13:15:25.205864 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:15:25.203593 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9f4rq" podUID="70145ee6-ed6f-4fcb-9ac6-7bf4439ecf8c" Jun 10 13:15:26.692079 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:26.692012 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:15:26.792453 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:26.792402 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:15:26.908679 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:26.908626 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5458a9d3-baee-4c82-b5a5-9c0d1227c481-metrics-certs\") pod \"network-metrics-daemon-qn67p\" (UID: \"5458a9d3-baee-4c82-b5a5-9c0d1227c481\") " pod="openshift-multus/network-metrics-daemon-qn67p" Jun 10 13:15:26.908823 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:15:26.908789 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 13:15:26.908881 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:15:26.908873 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5458a9d3-baee-4c82-b5a5-9c0d1227c481-metrics-certs podName:5458a9d3-baee-4c82-b5a5-9c0d1227c481 nodeName:}" failed. No retries permitted until 2026-06-10 13:15:58.908852016 +0000 UTC m=+66.174102604 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5458a9d3-baee-4c82-b5a5-9c0d1227c481-metrics-certs") pod "network-metrics-daemon-qn67p" (UID: "5458a9d3-baee-4c82-b5a5-9c0d1227c481") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 13:15:27.009177 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:27.009151 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zjx6\" (UniqueName: \"kubernetes.io/projected/70145ee6-ed6f-4fcb-9ac6-7bf4439ecf8c-kube-api-access-2zjx6\") pod \"network-check-target-9f4rq\" (UID: \"70145ee6-ed6f-4fcb-9ac6-7bf4439ecf8c\") " pod="openshift-network-diagnostics/network-check-target-9f4rq" Jun 10 13:15:27.009359 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:27.009196 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e0f9bf9d-d15d-4d0a-9c5f-185a98848eaf-original-pull-secret\") pod \"global-pull-secret-syncer-qll8x\" (UID: \"e0f9bf9d-d15d-4d0a-9c5f-185a98848eaf\") " pod="kube-system/global-pull-secret-syncer-qll8x" Jun 10 13:15:27.009359 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:15:27.009285 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 13:15:27.009359 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:15:27.009323 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 13:15:27.009359 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:15:27.009338 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0f9bf9d-d15d-4d0a-9c5f-185a98848eaf-original-pull-secret podName:e0f9bf9d-d15d-4d0a-9c5f-185a98848eaf nodeName:}" failed. No retries permitted until 2026-06-10 13:15:59.009325314 +0000 UTC m=+66.274575893 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e0f9bf9d-d15d-4d0a-9c5f-185a98848eaf-original-pull-secret") pod "global-pull-secret-syncer-qll8x" (UID: "e0f9bf9d-d15d-4d0a-9c5f-185a98848eaf") : object "kube-system"/"original-pull-secret" not registered Jun 10 13:15:27.009359 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:15:27.009344 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 13:15:27.009359 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:15:27.009357 2567 projected.go:196] Error preparing data for projected volume kube-api-access-2zjx6 for pod openshift-network-diagnostics/network-check-target-9f4rq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 13:15:27.009666 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:15:27.009425 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/70145ee6-ed6f-4fcb-9ac6-7bf4439ecf8c-kube-api-access-2zjx6 podName:70145ee6-ed6f-4fcb-9ac6-7bf4439ecf8c nodeName:}" failed. No retries permitted until 2026-06-10 13:15:59.009408213 +0000 UTC m=+66.274658807 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-2zjx6" (UniqueName: "kubernetes.io/projected/70145ee6-ed6f-4fcb-9ac6-7bf4439ecf8c-kube-api-access-2zjx6") pod "network-check-target-9f4rq" (UID: "70145ee6-ed6f-4fcb-9ac6-7bf4439ecf8c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 13:15:27.202341 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:27.202274 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9f4rq" Jun 10 13:15:27.202470 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:27.202285 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qn67p" Jun 10 13:15:27.202470 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:27.202397 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qll8x" Jun 10 13:15:27.202576 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:15:27.202372 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9f4rq" podUID="70145ee6-ed6f-4fcb-9ac6-7bf4439ecf8c" Jun 10 13:15:27.202576 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:15:27.202524 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qn67p" podUID="5458a9d3-baee-4c82-b5a5-9c0d1227c481" Jun 10 13:15:27.202651 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:15:27.202610 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qll8x" podUID="e0f9bf9d-d15d-4d0a-9c5f-185a98848eaf" Jun 10 13:15:27.368090 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:27.368060 2567 generic.go:356] "Generic (PLEG): container finished" podID="7ca2b072-b2f4-49c1-b491-37d85bf247d2" containerID="b2233f70d92c1056cec2b36a17bcb557ed2c22c7692570a1a0806890f5b370fd" exitCode=0 Jun 10 13:15:27.368283 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:27.368100 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bhrmz" event={"ID":"7ca2b072-b2f4-49c1-b491-37d85bf247d2","Type":"ContainerDied","Data":"b2233f70d92c1056cec2b36a17bcb557ed2c22c7692570a1a0806890f5b370fd"} Jun 10 13:15:27.524909 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:27.524888 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-19.ec2.internal" event="NodeReady" Jun 10 13:15:27.525168 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:27.525002 2567 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 10 13:15:27.566942 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:27.566909 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-kdht2"] Jun 10 13:15:27.582118 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:27.581790 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-x7jkx"] Jun 10 13:15:27.582118 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:27.582019 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kdht2" Jun 10 13:15:27.585794 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:27.585697 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 10 13:15:27.585794 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:27.585720 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bhqqk\"" Jun 10 13:15:27.588244 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:27.586128 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 10 13:15:27.597579 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:27.597558 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kdht2"] Jun 10 13:15:27.597657 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:27.597590 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-x7jkx"] Jun 10 13:15:27.597657 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:27.597655 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-x7jkx" Jun 10 13:15:27.600360 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:27.600342 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 10 13:15:27.600454 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:27.600377 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 10 13:15:27.600454 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:27.600393 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9d6kv\"" Jun 10 13:15:27.600454 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:27.600406 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 10 13:15:27.714339 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:27.714274 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6h7nh\" (UniqueName: \"kubernetes.io/projected/3efa946b-70cc-4855-add1-c73d1082de77-kube-api-access-6h7nh\") pod \"ingress-canary-x7jkx\" (UID: \"3efa946b-70cc-4855-add1-c73d1082de77\") " pod="openshift-ingress-canary/ingress-canary-x7jkx" Jun 10 13:15:27.714339 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:27.714310 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e26e7f8-4434-431c-8543-b57b5edde1e6-metrics-tls\") pod \"dns-default-kdht2\" (UID: \"4e26e7f8-4434-431c-8543-b57b5edde1e6\") " pod="openshift-dns/dns-default-kdht2" Jun 10 13:15:27.714339 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:27.714332 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4e26e7f8-4434-431c-8543-b57b5edde1e6-config-volume\") pod \"dns-default-kdht2\" (UID: \"4e26e7f8-4434-431c-8543-b57b5edde1e6\") " pod="openshift-dns/dns-default-kdht2" Jun 10 13:15:27.714928 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:27.714354 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7gdz\" (UniqueName: \"kubernetes.io/projected/4e26e7f8-4434-431c-8543-b57b5edde1e6-kube-api-access-w7gdz\") pod \"dns-default-kdht2\" (UID: \"4e26e7f8-4434-431c-8543-b57b5edde1e6\") " pod="openshift-dns/dns-default-kdht2" Jun 10 13:15:27.714928 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:27.714482 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e26e7f8-4434-431c-8543-b57b5edde1e6-tmp-dir\") pod \"dns-default-kdht2\" (UID: \"4e26e7f8-4434-431c-8543-b57b5edde1e6\") " pod="openshift-dns/dns-default-kdht2" Jun 10 13:15:27.714928 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:27.714503 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3efa946b-70cc-4855-add1-c73d1082de77-cert\") pod \"ingress-canary-x7jkx\" (UID: \"3efa946b-70cc-4855-add1-c73d1082de77\") " pod="openshift-ingress-canary/ingress-canary-x7jkx" Jun 10 13:15:27.815639 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:27.815611 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e26e7f8-4434-431c-8543-b57b5edde1e6-tmp-dir\") pod \"dns-default-kdht2\" (UID: \"4e26e7f8-4434-431c-8543-b57b5edde1e6\") " pod="openshift-dns/dns-default-kdht2" Jun 10 13:15:27.815639 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:27.815640 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3efa946b-70cc-4855-add1-c73d1082de77-cert\") pod \"ingress-canary-x7jkx\" (UID: \"3efa946b-70cc-4855-add1-c73d1082de77\") " pod="openshift-ingress-canary/ingress-canary-x7jkx" Jun 10 13:15:27.815805 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:27.815662 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6h7nh\" (UniqueName: \"kubernetes.io/projected/3efa946b-70cc-4855-add1-c73d1082de77-kube-api-access-6h7nh\") pod \"ingress-canary-x7jkx\" (UID: \"3efa946b-70cc-4855-add1-c73d1082de77\") " pod="openshift-ingress-canary/ingress-canary-x7jkx" Jun 10 13:15:27.815893 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:27.815874 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e26e7f8-4434-431c-8543-b57b5edde1e6-metrics-tls\") pod \"dns-default-kdht2\" (UID: \"4e26e7f8-4434-431c-8543-b57b5edde1e6\") " pod="openshift-dns/dns-default-kdht2" Jun 10 13:15:27.815945 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:27.815908 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4e26e7f8-4434-431c-8543-b57b5edde1e6-config-volume\") pod \"dns-default-kdht2\" (UID: \"4e26e7f8-4434-431c-8543-b57b5edde1e6\") " pod="openshift-dns/dns-default-kdht2" Jun 10 13:15:27.815945 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:27.815924 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7gdz\" (UniqueName: \"kubernetes.io/projected/4e26e7f8-4434-431c-8543-b57b5edde1e6-kube-api-access-w7gdz\") pod \"dns-default-kdht2\" (UID: \"4e26e7f8-4434-431c-8543-b57b5edde1e6\") " pod="openshift-dns/dns-default-kdht2" Jun 10 13:15:27.816020 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:15:27.816004 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 13:15:27.816082 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:15:27.816071 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e26e7f8-4434-431c-8543-b57b5edde1e6-metrics-tls podName:4e26e7f8-4434-431c-8543-b57b5edde1e6 nodeName:}" failed. No retries permitted until 2026-06-10 13:15:28.316052335 +0000 UTC m=+35.581302910 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4e26e7f8-4434-431c-8543-b57b5edde1e6-metrics-tls") pod "dns-default-kdht2" (UID: "4e26e7f8-4434-431c-8543-b57b5edde1e6") : secret "dns-default-metrics-tls" not found Jun 10 13:15:27.819885 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:27.819866 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3efa946b-70cc-4855-add1-c73d1082de77-cert\") pod \"ingress-canary-x7jkx\" (UID: \"3efa946b-70cc-4855-add1-c73d1082de77\") " pod="openshift-ingress-canary/ingress-canary-x7jkx" Jun 10 13:15:27.822635 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:27.822608 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e26e7f8-4434-431c-8543-b57b5edde1e6-tmp-dir\") pod \"dns-default-kdht2\" (UID: \"4e26e7f8-4434-431c-8543-b57b5edde1e6\") " pod="openshift-dns/dns-default-kdht2" Jun 10 13:15:27.823046 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:27.822998 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4e26e7f8-4434-431c-8543-b57b5edde1e6-config-volume\") pod \"dns-default-kdht2\" (UID: \"4e26e7f8-4434-431c-8543-b57b5edde1e6\") " pod="openshift-dns/dns-default-kdht2" Jun 10 13:15:27.824495 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:27.824474 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6h7nh\" (UniqueName: \"kubernetes.io/projected/3efa946b-70cc-4855-add1-c73d1082de77-kube-api-access-6h7nh\") pod \"ingress-canary-x7jkx\" (UID: \"3efa946b-70cc-4855-add1-c73d1082de77\") " pod="openshift-ingress-canary/ingress-canary-x7jkx" Jun 10 13:15:27.824753 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:27.824736 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7gdz\" (UniqueName: \"kubernetes.io/projected/4e26e7f8-4434-431c-8543-b57b5edde1e6-kube-api-access-w7gdz\") pod \"dns-default-kdht2\" (UID: \"4e26e7f8-4434-431c-8543-b57b5edde1e6\") " pod="openshift-dns/dns-default-kdht2" Jun 10 13:15:27.919427 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:27.919405 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-x7jkx" Jun 10 13:15:27.987398 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:27.987303 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:15:28.068769 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:28.068587 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-x7jkx"] Jun 10 13:15:28.071552 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:15:28.071528 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3efa946b_70cc_4855_add1_c73d1082de77.slice/crio-d3e16cfa5a3ebf0c86d4f22b3d6ff5efbac19e4c2663960916480c0a7220c245 WatchSource:0}: Error finding container d3e16cfa5a3ebf0c86d4f22b3d6ff5efbac19e4c2663960916480c0a7220c245: Status 404 returned error can't find the container with id d3e16cfa5a3ebf0c86d4f22b3d6ff5efbac19e4c2663960916480c0a7220c245 Jun 10 13:15:28.319363 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:28.319257 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e26e7f8-4434-431c-8543-b57b5edde1e6-metrics-tls\") pod \"dns-default-kdht2\" (UID: \"4e26e7f8-4434-431c-8543-b57b5edde1e6\") " pod="openshift-dns/dns-default-kdht2" Jun 10 13:15:28.319581 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:15:28.319375 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 13:15:28.319581 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:15:28.319428 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e26e7f8-4434-431c-8543-b57b5edde1e6-metrics-tls podName:4e26e7f8-4434-431c-8543-b57b5edde1e6 nodeName:}" failed. No retries permitted until 2026-06-10 13:15:29.319413292 +0000 UTC m=+36.584663867 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4e26e7f8-4434-431c-8543-b57b5edde1e6-metrics-tls") pod "dns-default-kdht2" (UID: "4e26e7f8-4434-431c-8543-b57b5edde1e6") : secret "dns-default-metrics-tls" not found Jun 10 13:15:28.373257 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:28.373229 2567 generic.go:356] "Generic (PLEG): container finished" podID="7ca2b072-b2f4-49c1-b491-37d85bf247d2" containerID="d9885db3c521dde9ea486dc9f011e56ce994f9bb6dd3ccb79fa3d223d150125d" exitCode=0 Jun 10 13:15:28.373405 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:28.373305 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bhrmz" event={"ID":"7ca2b072-b2f4-49c1-b491-37d85bf247d2","Type":"ContainerDied","Data":"d9885db3c521dde9ea486dc9f011e56ce994f9bb6dd3ccb79fa3d223d150125d"} Jun 10 13:15:28.374374 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:28.374351 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-x7jkx" event={"ID":"3efa946b-70cc-4855-add1-c73d1082de77","Type":"ContainerStarted","Data":"d3e16cfa5a3ebf0c86d4f22b3d6ff5efbac19e4c2663960916480c0a7220c245"} Jun 10 13:15:28.581276 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:28.581139 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:15:28.643320 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:28.643254 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:15:29.202949 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:29.202916 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qn67p" Jun 10 13:15:29.202949 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:29.202937 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9f4rq" Jun 10 13:15:29.203678 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:29.202916 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qll8x" Jun 10 13:15:29.206178 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:29.206157 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 10 13:15:29.207334 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:29.207317 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 10 13:15:29.207334 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:29.207318 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 10 13:15:29.207500 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:29.207327 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-r5jns\"" Jun 10 13:15:29.207500 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:29.207400 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 10 13:15:29.207500 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:29.207443 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cp4w7\"" Jun 10 13:15:29.328801 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:29.328760 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e26e7f8-4434-431c-8543-b57b5edde1e6-metrics-tls\") pod \"dns-default-kdht2\" (UID: \"4e26e7f8-4434-431c-8543-b57b5edde1e6\") " pod="openshift-dns/dns-default-kdht2" Jun 10 13:15:29.328994 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:15:29.328949 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 13:15:29.329054 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:15:29.329024 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e26e7f8-4434-431c-8543-b57b5edde1e6-metrics-tls podName:4e26e7f8-4434-431c-8543-b57b5edde1e6 nodeName:}" failed. No retries permitted until 2026-06-10 13:15:31.32900422 +0000 UTC m=+38.594254798 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4e26e7f8-4434-431c-8543-b57b5edde1e6-metrics-tls") pod "dns-default-kdht2" (UID: "4e26e7f8-4434-431c-8543-b57b5edde1e6") : secret "dns-default-metrics-tls" not found Jun 10 13:15:29.381379 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:29.381347 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bhrmz" event={"ID":"7ca2b072-b2f4-49c1-b491-37d85bf247d2","Type":"ContainerStarted","Data":"5a26a52f8395e7452e897fe69c03b51b8ccc3ba07bb190c9b7a0f3da59a13046"} Jun 10 13:15:29.404374 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:29.404324 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-bhrmz" podStartSLOduration=8.17783454 podStartE2EDuration="36.404307117s" totalImagesPullingTime="28.226472577s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 13:14:53 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:15:29.402991524 +0000 UTC m=+36.668242120" watchObservedRunningTime="2026-06-10 13:15:29.404307117 +0000 UTC m=+36.669557715" Jun 10 13:15:29.527157 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:29.527059 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:15:29.626093 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:29.626058 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:15:30.385319 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:30.385285 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-x7jkx" event={"ID":"3efa946b-70cc-4855-add1-c73d1082de77","Type":"ContainerStarted","Data":"33fba3daa992a2adec2526f38ec1edd4aa23d3731dfe0ee8ee7f4cd8280ac7ad"} Jun 10 13:15:30.401797 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:30.401756 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-x7jkx" podStartSLOduration=1.4229075500000001 podStartE2EDuration="3.401742328s" totalImagesPullingTime="1.978834778s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:15:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:15:30.401053349 +0000 UTC m=+37.666303946" watchObservedRunningTime="2026-06-10 13:15:30.401742328 +0000 UTC m=+37.666992966" Jun 10 13:15:31.319096 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:31.319016 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:15:31.342168 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:31.342137 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e26e7f8-4434-431c-8543-b57b5edde1e6-metrics-tls\") pod \"dns-default-kdht2\" (UID: \"4e26e7f8-4434-431c-8543-b57b5edde1e6\") " pod="openshift-dns/dns-default-kdht2" Jun 10 13:15:31.342303 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:15:31.342281 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 13:15:31.342349 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:15:31.342342 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e26e7f8-4434-431c-8543-b57b5edde1e6-metrics-tls podName:4e26e7f8-4434-431c-8543-b57b5edde1e6 nodeName:}" failed. No retries permitted until 2026-06-10 13:15:35.342326073 +0000 UTC m=+42.607576649 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4e26e7f8-4434-431c-8543-b57b5edde1e6-metrics-tls") pod "dns-default-kdht2" (UID: "4e26e7f8-4434-431c-8543-b57b5edde1e6") : secret "dns-default-metrics-tls" not found Jun 10 13:15:32.253034 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:32.253005 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58c7d8489d-22gt9"] Jun 10 13:15:32.287834 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:32.287810 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58c7d8489d-22gt9"] Jun 10 13:15:32.287975 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:32.287876 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58c7d8489d-22gt9" Jun 10 13:15:32.291831 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:32.291807 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 10 13:15:32.291977 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:32.291809 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 10 13:15:32.291977 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:32.291809 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-45cxv\"" Jun 10 13:15:32.291977 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:32.291879 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 10 13:15:32.291977 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:32.291811 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 10 13:15:32.450610 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:32.450575 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1c48c468-836f-4e9d-babe-d628242353b9-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-58c7d8489d-22gt9\" (UID: \"1c48c468-836f-4e9d-babe-d628242353b9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58c7d8489d-22gt9" Jun 10 13:15:32.450610 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:32.450613 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nv9qw\" (UniqueName: \"kubernetes.io/projected/1c48c468-836f-4e9d-babe-d628242353b9-kube-api-access-nv9qw\") pod \"managed-serviceaccount-addon-agent-58c7d8489d-22gt9\" (UID: \"1c48c468-836f-4e9d-babe-d628242353b9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58c7d8489d-22gt9" Jun 10 13:15:32.551765 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:32.551709 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nv9qw\" (UniqueName: \"kubernetes.io/projected/1c48c468-836f-4e9d-babe-d628242353b9-kube-api-access-nv9qw\") pod \"managed-serviceaccount-addon-agent-58c7d8489d-22gt9\" (UID: \"1c48c468-836f-4e9d-babe-d628242353b9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58c7d8489d-22gt9" Jun 10 13:15:32.551855 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:32.551792 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1c48c468-836f-4e9d-babe-d628242353b9-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-58c7d8489d-22gt9\" (UID: \"1c48c468-836f-4e9d-babe-d628242353b9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58c7d8489d-22gt9" Jun 10 13:15:32.555918 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:32.555892 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1c48c468-836f-4e9d-babe-d628242353b9-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-58c7d8489d-22gt9\" (UID: \"1c48c468-836f-4e9d-babe-d628242353b9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58c7d8489d-22gt9" Jun 10 13:15:32.559737 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:32.559711 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nv9qw\" (UniqueName: \"kubernetes.io/projected/1c48c468-836f-4e9d-babe-d628242353b9-kube-api-access-nv9qw\") pod \"managed-serviceaccount-addon-agent-58c7d8489d-22gt9\" (UID: \"1c48c468-836f-4e9d-babe-d628242353b9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58c7d8489d-22gt9" Jun 10 13:15:32.607544 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:32.607517 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58c7d8489d-22gt9" Jun 10 13:15:32.741266 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:32.741097 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58c7d8489d-22gt9"] Jun 10 13:15:32.744260 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:15:32.744236 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1c48c468_836f_4e9d_babe_d628242353b9.slice/crio-ca08b67786ee7acc60b1b9db60084e566cbfada353849894041417efbb01a203 WatchSource:0}: Error finding container ca08b67786ee7acc60b1b9db60084e566cbfada353849894041417efbb01a203: Status 404 returned error can't find the container with id ca08b67786ee7acc60b1b9db60084e566cbfada353849894041417efbb01a203 Jun 10 13:15:32.915726 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:32.915693 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:15:33.392543 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:33.392510 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58c7d8489d-22gt9" event={"ID":"1c48c468-836f-4e9d-babe-d628242353b9","Type":"ContainerStarted","Data":"ca08b67786ee7acc60b1b9db60084e566cbfada353849894041417efbb01a203"} Jun 10 13:15:35.371700 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:35.371656 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e26e7f8-4434-431c-8543-b57b5edde1e6-metrics-tls\") pod \"dns-default-kdht2\" (UID: \"4e26e7f8-4434-431c-8543-b57b5edde1e6\") " pod="openshift-dns/dns-default-kdht2" Jun 10 13:15:35.372150 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:15:35.371824 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 13:15:35.372150 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:15:35.371913 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e26e7f8-4434-431c-8543-b57b5edde1e6-metrics-tls podName:4e26e7f8-4434-431c-8543-b57b5edde1e6 nodeName:}" failed. No retries permitted until 2026-06-10 13:15:43.371894826 +0000 UTC m=+50.637145403 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4e26e7f8-4434-431c-8543-b57b5edde1e6-metrics-tls") pod "dns-default-kdht2" (UID: "4e26e7f8-4434-431c-8543-b57b5edde1e6") : secret "dns-default-metrics-tls" not found Jun 10 13:15:36.400688 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:36.400655 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58c7d8489d-22gt9" event={"ID":"1c48c468-836f-4e9d-babe-d628242353b9","Type":"ContainerStarted","Data":"c688a76392c0cc67c4cd5c2d6a8c3dfdf68182d906674e9ad0597c038e51c350"} Jun 10 13:15:36.418127 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:36.418074 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58c7d8489d-22gt9" podStartSLOduration=1.429472146 podStartE2EDuration="4.418058518s" totalImagesPullingTime="2.988586372s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:15:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:15:36.417003737 +0000 UTC m=+43.682254357" watchObservedRunningTime="2026-06-10 13:15:36.418058518 +0000 UTC m=+43.683309114" Jun 10 13:15:39.796400 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:39.796353 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:15:39.855218 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:39.855192 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:15:43.429696 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:43.429660 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e26e7f8-4434-431c-8543-b57b5edde1e6-metrics-tls\") pod \"dns-default-kdht2\" (UID: \"4e26e7f8-4434-431c-8543-b57b5edde1e6\") " pod="openshift-dns/dns-default-kdht2" Jun 10 13:15:43.430156 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:15:43.429812 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 13:15:43.430156 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:15:43.429896 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e26e7f8-4434-431c-8543-b57b5edde1e6-metrics-tls podName:4e26e7f8-4434-431c-8543-b57b5edde1e6 nodeName:}" failed. No retries permitted until 2026-06-10 13:15:59.429877904 +0000 UTC m=+66.695128480 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4e26e7f8-4434-431c-8543-b57b5edde1e6-metrics-tls") pod "dns-default-kdht2" (UID: "4e26e7f8-4434-431c-8543-b57b5edde1e6") : secret "dns-default-metrics-tls" not found Jun 10 13:15:50.552671 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:50.552628 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:15:50.653249 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:50.653212 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:15:50.753322 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:50.753272 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:15:50.853996 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:50.853916 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:15:52.670786 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:52.670752 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:15:53.367922 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:53.367897 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-htrsf" Jun 10 13:15:53.489637 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:53.489609 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:15:53.587169 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:53.587137 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:15:58.935817 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:58.935774 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5458a9d3-baee-4c82-b5a5-9c0d1227c481-metrics-certs\") pod \"network-metrics-daemon-qn67p\" (UID: \"5458a9d3-baee-4c82-b5a5-9c0d1227c481\") " pod="openshift-multus/network-metrics-daemon-qn67p" Jun 10 13:15:58.938414 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:58.938387 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 10 13:15:58.946444 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:15:58.946424 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 10 13:15:58.946550 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:15:58.946501 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5458a9d3-baee-4c82-b5a5-9c0d1227c481-metrics-certs podName:5458a9d3-baee-4c82-b5a5-9c0d1227c481 nodeName:}" failed. No retries permitted until 2026-06-10 13:17:02.94648142 +0000 UTC m=+130.211732001 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5458a9d3-baee-4c82-b5a5-9c0d1227c481-metrics-certs") pod "network-metrics-daemon-qn67p" (UID: "5458a9d3-baee-4c82-b5a5-9c0d1227c481") : secret "metrics-daemon-secret" not found Jun 10 13:15:59.036112 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:59.036078 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zjx6\" (UniqueName: \"kubernetes.io/projected/70145ee6-ed6f-4fcb-9ac6-7bf4439ecf8c-kube-api-access-2zjx6\") pod \"network-check-target-9f4rq\" (UID: \"70145ee6-ed6f-4fcb-9ac6-7bf4439ecf8c\") " pod="openshift-network-diagnostics/network-check-target-9f4rq" Jun 10 13:15:59.036253 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:59.036135 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e0f9bf9d-d15d-4d0a-9c5f-185a98848eaf-original-pull-secret\") pod \"global-pull-secret-syncer-qll8x\" (UID: \"e0f9bf9d-d15d-4d0a-9c5f-185a98848eaf\") " pod="kube-system/global-pull-secret-syncer-qll8x" Jun 10 13:15:59.038993 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:59.038977 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 10 13:15:59.039071 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:59.038977 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 10 13:15:59.048674 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:59.048654 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 10 13:15:59.048788 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:59.048718 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e0f9bf9d-d15d-4d0a-9c5f-185a98848eaf-original-pull-secret\") pod \"global-pull-secret-syncer-qll8x\" (UID: \"e0f9bf9d-d15d-4d0a-9c5f-185a98848eaf\") " pod="kube-system/global-pull-secret-syncer-qll8x" Jun 10 13:15:59.058849 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:59.058812 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zjx6\" (UniqueName: \"kubernetes.io/projected/70145ee6-ed6f-4fcb-9ac6-7bf4439ecf8c-kube-api-access-2zjx6\") pod \"network-check-target-9f4rq\" (UID: \"70145ee6-ed6f-4fcb-9ac6-7bf4439ecf8c\") " pod="openshift-network-diagnostics/network-check-target-9f4rq" Jun 10 13:15:59.221072 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:59.220987 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qll8x" Jun 10 13:15:59.229344 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:59.229325 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cp4w7\"" Jun 10 13:15:59.237614 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:59.237588 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9f4rq" Jun 10 13:15:59.355739 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:59.355710 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qll8x"] Jun 10 13:15:59.359756 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:15:59.359722 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0f9bf9d_d15d_4d0a_9c5f_185a98848eaf.slice/crio-dfbfcb16bcd01ed7da137bc125dd53301e6b7cf67b7db82369ff8843a0810030 WatchSource:0}: Error finding container dfbfcb16bcd01ed7da137bc125dd53301e6b7cf67b7db82369ff8843a0810030: Status 404 returned error can't find the container with id dfbfcb16bcd01ed7da137bc125dd53301e6b7cf67b7db82369ff8843a0810030 Jun 10 13:15:59.372855 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:59.372815 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9f4rq"] Jun 10 13:15:59.375772 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:15:59.375746 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70145ee6_ed6f_4fcb_9ac6_7bf4439ecf8c.slice/crio-e60abde793f3546b6bfcff4520ceb55dba926ef35c88c2ff41b4a925362aa640 WatchSource:0}: Error finding container e60abde793f3546b6bfcff4520ceb55dba926ef35c88c2ff41b4a925362aa640: Status 404 returned error can't find the container with id e60abde793f3546b6bfcff4520ceb55dba926ef35c88c2ff41b4a925362aa640 Jun 10 13:15:59.439536 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:59.439502 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e26e7f8-4434-431c-8543-b57b5edde1e6-metrics-tls\") pod \"dns-default-kdht2\" (UID: \"4e26e7f8-4434-431c-8543-b57b5edde1e6\") " pod="openshift-dns/dns-default-kdht2" Jun 10 13:15:59.439717 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:15:59.439624 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 13:15:59.439717 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:15:59.439676 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e26e7f8-4434-431c-8543-b57b5edde1e6-metrics-tls podName:4e26e7f8-4434-431c-8543-b57b5edde1e6 nodeName:}" failed. No retries permitted until 2026-06-10 13:16:31.439663043 +0000 UTC m=+98.704913619 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4e26e7f8-4434-431c-8543-b57b5edde1e6-metrics-tls") pod "dns-default-kdht2" (UID: "4e26e7f8-4434-431c-8543-b57b5edde1e6") : secret "dns-default-metrics-tls" not found Jun 10 13:15:59.453351 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:59.453321 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qll8x" event={"ID":"e0f9bf9d-d15d-4d0a-9c5f-185a98848eaf","Type":"ContainerStarted","Data":"dfbfcb16bcd01ed7da137bc125dd53301e6b7cf67b7db82369ff8843a0810030"} Jun 10 13:15:59.457529 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:15:59.457499 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9f4rq" event={"ID":"70145ee6-ed6f-4fcb-9ac6-7bf4439ecf8c","Type":"ContainerStarted","Data":"e60abde793f3546b6bfcff4520ceb55dba926ef35c88c2ff41b4a925362aa640"} Jun 10 13:16:04.472258 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:16:04.472218 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qll8x" event={"ID":"e0f9bf9d-d15d-4d0a-9c5f-185a98848eaf","Type":"ContainerStarted","Data":"f635d168fb795fe0cb6efa2dd9dd9e8caac3a248da58343a45d872676f15f88b"} Jun 10 13:16:04.473681 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:16:04.473656 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9f4rq" event={"ID":"70145ee6-ed6f-4fcb-9ac6-7bf4439ecf8c","Type":"ContainerStarted","Data":"79eebdb2e0c9f7aeb50a85f1972aa0de4e590c2abb2b341912d6cd75a320d148"} Jun 10 13:16:04.473803 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:16:04.473782 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-9f4rq" Jun 10 13:16:04.489024 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:16:04.488977 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-qll8x" podStartSLOduration=67.012714225 podStartE2EDuration="1m11.488963534s" totalImagesPullingTime="4.476249309s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 13:14:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:16:04.488581115 +0000 UTC m=+71.753831712" watchObservedRunningTime="2026-06-10 13:16:04.488963534 +0000 UTC m=+71.754214142" Jun 10 13:16:04.505582 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:16:04.505533 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-9f4rq" podStartSLOduration=67.047561457 podStartE2EDuration="1m11.505519464s" totalImagesPullingTime="4.457958007s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:14:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:16:04.504828661 +0000 UTC m=+71.770079258" watchObservedRunningTime="2026-06-10 13:16:04.505519464 +0000 UTC m=+71.770770061" Jun 10 13:16:04.814819 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:16:04.814736 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:16:31.451530 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:16:31.451493 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e26e7f8-4434-431c-8543-b57b5edde1e6-metrics-tls\") pod \"dns-default-kdht2\" (UID: \"4e26e7f8-4434-431c-8543-b57b5edde1e6\") " pod="openshift-dns/dns-default-kdht2" Jun 10 13:16:31.451970 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:16:31.451628 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 13:16:31.451970 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:16:31.451694 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e26e7f8-4434-431c-8543-b57b5edde1e6-metrics-tls podName:4e26e7f8-4434-431c-8543-b57b5edde1e6 nodeName:}" failed. No retries permitted until 2026-06-10 13:17:35.451678769 +0000 UTC m=+162.716929345 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4e26e7f8-4434-431c-8543-b57b5edde1e6-metrics-tls") pod "dns-default-kdht2" (UID: "4e26e7f8-4434-431c-8543-b57b5edde1e6") : secret "dns-default-metrics-tls" not found Jun 10 13:16:35.478405 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:16:35.478374 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-9f4rq" Jun 10 13:17:02.955369 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:17:02.955314 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5458a9d3-baee-4c82-b5a5-9c0d1227c481-metrics-certs\") pod \"network-metrics-daemon-qn67p\" (UID: \"5458a9d3-baee-4c82-b5a5-9c0d1227c481\") " pod="openshift-multus/network-metrics-daemon-qn67p" Jun 10 13:17:02.955821 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:17:02.955471 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 10 13:17:02.956120 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:17:02.956094 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5458a9d3-baee-4c82-b5a5-9c0d1227c481-metrics-certs podName:5458a9d3-baee-4c82-b5a5-9c0d1227c481 nodeName:}" failed. No retries permitted until 2026-06-10 13:19:04.95606766 +0000 UTC m=+252.221318252 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5458a9d3-baee-4c82-b5a5-9c0d1227c481-metrics-certs") pod "network-metrics-daemon-qn67p" (UID: "5458a9d3-baee-4c82-b5a5-9c0d1227c481") : secret "metrics-daemon-secret" not found Jun 10 13:17:30.614520 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:17:30.614470 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-kdht2" podUID="4e26e7f8-4434-431c-8543-b57b5edde1e6" Jun 10 13:17:30.681601 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:17:30.681570 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kdht2" Jun 10 13:17:32.214317 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:17:32.214278 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-qn67p" podUID="5458a9d3-baee-4c82-b5a5-9c0d1227c481" Jun 10 13:17:35.469349 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:17:35.469301 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e26e7f8-4434-431c-8543-b57b5edde1e6-metrics-tls\") pod \"dns-default-kdht2\" (UID: \"4e26e7f8-4434-431c-8543-b57b5edde1e6\") " pod="openshift-dns/dns-default-kdht2" Jun 10 13:17:35.469883 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:17:35.469472 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 13:17:35.469883 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:17:35.469547 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e26e7f8-4434-431c-8543-b57b5edde1e6-metrics-tls podName:4e26e7f8-4434-431c-8543-b57b5edde1e6 nodeName:}" failed. No retries permitted until 2026-06-10 13:19:37.469527611 +0000 UTC m=+284.734778203 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4e26e7f8-4434-431c-8543-b57b5edde1e6-metrics-tls") pod "dns-default-kdht2" (UID: "4e26e7f8-4434-431c-8543-b57b5edde1e6") : secret "dns-default-metrics-tls" not found Jun 10 13:17:36.697273 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:17:36.697236 2567 generic.go:356] "Generic (PLEG): container finished" podID="1c48c468-836f-4e9d-babe-d628242353b9" containerID="c688a76392c0cc67c4cd5c2d6a8c3dfdf68182d906674e9ad0597c038e51c350" exitCode=255 Jun 10 13:17:36.697675 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:17:36.697287 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58c7d8489d-22gt9" event={"ID":"1c48c468-836f-4e9d-babe-d628242353b9","Type":"ContainerDied","Data":"c688a76392c0cc67c4cd5c2d6a8c3dfdf68182d906674e9ad0597c038e51c350"} Jun 10 13:17:36.702818 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:17:36.702803 2567 scope.go:117] "RemoveContainer" containerID="c688a76392c0cc67c4cd5c2d6a8c3dfdf68182d906674e9ad0597c038e51c350" Jun 10 13:17:37.705321 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:17:37.705287 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58c7d8489d-22gt9" event={"ID":"1c48c468-836f-4e9d-babe-d628242353b9","Type":"ContainerStarted","Data":"6f7c6f6a4b7e3ca95dd02b349815daccca44d31b47acc67c88fe73706371071b"} Jun 10 13:17:45.202432 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:17:45.202399 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qn67p" Jun 10 13:18:29.933674 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:29.933638 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:18:38.092898 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.092866 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-kcfnz"] Jun 10 13:18:38.095547 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.095530 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-kcfnz" Jun 10 13:18:38.098403 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.098377 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-8m9jt\"" Jun 10 13:18:38.103264 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.103246 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-896549976-xk8dj"] Jun 10 13:18:38.105170 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.105156 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-7nph4"] Jun 10 13:18:38.105276 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.105261 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-xk8dj" Jun 10 13:18:38.107035 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.107017 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6577858866-9fbjb"] Jun 10 13:18:38.107125 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.107110 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-7nph4" Jun 10 13:18:38.108726 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.108699 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 10 13:18:38.108820 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.108739 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6577858866-9fbjb" Jun 10 13:18:38.108820 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.108798 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 10 13:18:38.109714 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.109698 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 10 13:18:38.110556 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.110539 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 10 13:18:38.112656 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.112637 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-kcfnz"] Jun 10 13:18:38.115966 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.115940 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 10 13:18:38.119087 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.119070 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-hz7l5\"" Jun 10 13:18:38.121924 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.121904 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 10 13:18:38.122022 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.121975 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 10 13:18:38.122085 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.122036 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 10 13:18:38.122264 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.122250 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-57ln9\"" Jun 10 13:18:38.124563 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.124547 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-dccsb\"" Jun 10 13:18:38.124652 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.124627 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 10 13:18:38.128382 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.128365 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 10 13:18:38.129137 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.129124 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 10 13:18:38.130489 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.130474 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 10 13:18:38.132803 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.132787 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 10 13:18:38.138784 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.138765 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-7nph4"] Jun 10 13:18:38.145027 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.145008 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-xk8dj"] Jun 10 13:18:38.152380 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.152354 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6577858866-9fbjb"] Jun 10 13:18:38.194109 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.194083 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e402e555-ddd8-4a81-82df-815b5237540f-config\") pod \"service-ca-operator-6bc5ff68f5-7nph4\" (UID: \"e402e555-ddd8-4a81-82df-815b5237540f\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-7nph4" Jun 10 13:18:38.194238 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.194119 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/87c0c6d8-6455-44f3-a9ad-18852f44c96c-tmp\") pod \"insights-operator-896549976-xk8dj\" (UID: \"87c0c6d8-6455-44f3-a9ad-18852f44c96c\") " pod="openshift-insights/insights-operator-896549976-xk8dj" Jun 10 13:18:38.194238 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.194137 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/87c0c6d8-6455-44f3-a9ad-18852f44c96c-service-ca-bundle\") pod \"insights-operator-896549976-xk8dj\" (UID: \"87c0c6d8-6455-44f3-a9ad-18852f44c96c\") " pod="openshift-insights/insights-operator-896549976-xk8dj" Jun 10 13:18:38.194238 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.194152 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzph7\" (UniqueName: \"kubernetes.io/projected/87c0c6d8-6455-44f3-a9ad-18852f44c96c-kube-api-access-nzph7\") pod \"insights-operator-896549976-xk8dj\" (UID: \"87c0c6d8-6455-44f3-a9ad-18852f44c96c\") " pod="openshift-insights/insights-operator-896549976-xk8dj" Jun 10 13:18:38.194238 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.194172 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c0af5812-3297-4e07-abdb-f54190eed2b4-image-registry-private-configuration\") pod \"image-registry-6577858866-9fbjb\" (UID: \"c0af5812-3297-4e07-abdb-f54190eed2b4\") " pod="openshift-image-registry/image-registry-6577858866-9fbjb" Jun 10 13:18:38.194414 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.194247 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxkmz\" (UniqueName: \"kubernetes.io/projected/95e01909-21ea-4f57-b507-cc9170aa3bd1-kube-api-access-qxkmz\") pod \"network-check-source-dbd9cf844-kcfnz\" (UID: \"95e01909-21ea-4f57-b507-cc9170aa3bd1\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-kcfnz" Jun 10 13:18:38.194414 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.194295 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c0af5812-3297-4e07-abdb-f54190eed2b4-registry-tls\") pod \"image-registry-6577858866-9fbjb\" (UID: \"c0af5812-3297-4e07-abdb-f54190eed2b4\") " pod="openshift-image-registry/image-registry-6577858866-9fbjb" Jun 10 13:18:38.194414 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.194317 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c0af5812-3297-4e07-abdb-f54190eed2b4-bound-sa-token\") pod \"image-registry-6577858866-9fbjb\" (UID: \"c0af5812-3297-4e07-abdb-f54190eed2b4\") " pod="openshift-image-registry/image-registry-6577858866-9fbjb" Jun 10 13:18:38.194414 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.194344 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e402e555-ddd8-4a81-82df-815b5237540f-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-7nph4\" (UID: \"e402e555-ddd8-4a81-82df-815b5237540f\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-7nph4" Jun 10 13:18:38.194414 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.194373 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/87c0c6d8-6455-44f3-a9ad-18852f44c96c-serving-cert\") pod \"insights-operator-896549976-xk8dj\" (UID: \"87c0c6d8-6455-44f3-a9ad-18852f44c96c\") " pod="openshift-insights/insights-operator-896549976-xk8dj" Jun 10 13:18:38.194414 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.194394 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c0af5812-3297-4e07-abdb-f54190eed2b4-registry-certificates\") pod \"image-registry-6577858866-9fbjb\" (UID: \"c0af5812-3297-4e07-abdb-f54190eed2b4\") " pod="openshift-image-registry/image-registry-6577858866-9fbjb" Jun 10 13:18:38.194674 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.194419 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/87c0c6d8-6455-44f3-a9ad-18852f44c96c-trusted-ca-bundle\") pod \"insights-operator-896549976-xk8dj\" (UID: \"87c0c6d8-6455-44f3-a9ad-18852f44c96c\") " pod="openshift-insights/insights-operator-896549976-xk8dj" Jun 10 13:18:38.194674 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.194439 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/87c0c6d8-6455-44f3-a9ad-18852f44c96c-snapshots\") pod \"insights-operator-896549976-xk8dj\" (UID: \"87c0c6d8-6455-44f3-a9ad-18852f44c96c\") " pod="openshift-insights/insights-operator-896549976-xk8dj" Jun 10 13:18:38.194674 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.194462 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c0af5812-3297-4e07-abdb-f54190eed2b4-trusted-ca\") pod \"image-registry-6577858866-9fbjb\" (UID: \"c0af5812-3297-4e07-abdb-f54190eed2b4\") " pod="openshift-image-registry/image-registry-6577858866-9fbjb" Jun 10 13:18:38.194674 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.194532 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c0af5812-3297-4e07-abdb-f54190eed2b4-ca-trust-extracted\") pod \"image-registry-6577858866-9fbjb\" (UID: \"c0af5812-3297-4e07-abdb-f54190eed2b4\") " pod="openshift-image-registry/image-registry-6577858866-9fbjb" Jun 10 13:18:38.194674 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.194564 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c0af5812-3297-4e07-abdb-f54190eed2b4-installation-pull-secrets\") pod \"image-registry-6577858866-9fbjb\" (UID: \"c0af5812-3297-4e07-abdb-f54190eed2b4\") " pod="openshift-image-registry/image-registry-6577858866-9fbjb" Jun 10 13:18:38.194674 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.194591 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gz89\" (UniqueName: \"kubernetes.io/projected/c0af5812-3297-4e07-abdb-f54190eed2b4-kube-api-access-6gz89\") pod \"image-registry-6577858866-9fbjb\" (UID: \"c0af5812-3297-4e07-abdb-f54190eed2b4\") " pod="openshift-image-registry/image-registry-6577858866-9fbjb" Jun 10 13:18:38.194674 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.194620 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nhwr\" (UniqueName: \"kubernetes.io/projected/e402e555-ddd8-4a81-82df-815b5237540f-kube-api-access-9nhwr\") pod \"service-ca-operator-6bc5ff68f5-7nph4\" (UID: \"e402e555-ddd8-4a81-82df-815b5237540f\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-7nph4" Jun 10 13:18:38.198240 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.198209 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-95mdv"] Jun 10 13:18:38.199967 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.199952 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-9xwd9"] Jun 10 13:18:38.200092 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.200077 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-95mdv" Jun 10 13:18:38.201728 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.201711 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-9xwd9" Jun 10 13:18:38.204164 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.204135 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-9blvr\"" Jun 10 13:18:38.204263 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.204220 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 10 13:18:38.204327 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.204295 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 10 13:18:38.205913 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.205894 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-zsq5n\"" Jun 10 13:18:38.208962 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.208943 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 10 13:18:38.209133 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.209116 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 10 13:18:38.210043 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.210022 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 10 13:18:38.210138 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.210104 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 10 13:18:38.219059 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.219034 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 10 13:18:38.219389 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.219368 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-9xwd9"] Jun 10 13:18:38.222644 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.222618 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-95mdv"] Jun 10 13:18:38.295446 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.295415 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6sbmz\" (UniqueName: \"kubernetes.io/projected/c0921084-7852-4e0a-972a-7366b89c7736-kube-api-access-6sbmz\") pod \"console-operator-668fdbf85c-9xwd9\" (UID: \"c0921084-7852-4e0a-972a-7366b89c7736\") " pod="openshift-console-operator/console-operator-668fdbf85c-9xwd9" Jun 10 13:18:38.295605 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.295457 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gz89\" (UniqueName: \"kubernetes.io/projected/c0af5812-3297-4e07-abdb-f54190eed2b4-kube-api-access-6gz89\") pod \"image-registry-6577858866-9fbjb\" (UID: \"c0af5812-3297-4e07-abdb-f54190eed2b4\") " pod="openshift-image-registry/image-registry-6577858866-9fbjb" Jun 10 13:18:38.295605 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.295485 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nhwr\" (UniqueName: \"kubernetes.io/projected/e402e555-ddd8-4a81-82df-815b5237540f-kube-api-access-9nhwr\") pod \"service-ca-operator-6bc5ff68f5-7nph4\" (UID: \"e402e555-ddd8-4a81-82df-815b5237540f\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-7nph4" Jun 10 13:18:38.295605 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.295532 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/87c0c6d8-6455-44f3-a9ad-18852f44c96c-tmp\") pod \"insights-operator-896549976-xk8dj\" (UID: \"87c0c6d8-6455-44f3-a9ad-18852f44c96c\") " pod="openshift-insights/insights-operator-896549976-xk8dj" Jun 10 13:18:38.295605 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.295562 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzph7\" (UniqueName: \"kubernetes.io/projected/87c0c6d8-6455-44f3-a9ad-18852f44c96c-kube-api-access-nzph7\") pod \"insights-operator-896549976-xk8dj\" (UID: \"87c0c6d8-6455-44f3-a9ad-18852f44c96c\") " pod="openshift-insights/insights-operator-896549976-xk8dj" Jun 10 13:18:38.295605 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.295585 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c0af5812-3297-4e07-abdb-f54190eed2b4-image-registry-private-configuration\") pod \"image-registry-6577858866-9fbjb\" (UID: \"c0af5812-3297-4e07-abdb-f54190eed2b4\") " pod="openshift-image-registry/image-registry-6577858866-9fbjb" Jun 10 13:18:38.295877 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.295616 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/87c0c6d8-6455-44f3-a9ad-18852f44c96c-service-ca-bundle\") pod \"insights-operator-896549976-xk8dj\" (UID: \"87c0c6d8-6455-44f3-a9ad-18852f44c96c\") " pod="openshift-insights/insights-operator-896549976-xk8dj" Jun 10 13:18:38.295877 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.295661 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c0921084-7852-4e0a-972a-7366b89c7736-trusted-ca\") pod \"console-operator-668fdbf85c-9xwd9\" (UID: \"c0921084-7852-4e0a-972a-7366b89c7736\") " pod="openshift-console-operator/console-operator-668fdbf85c-9xwd9" Jun 10 13:18:38.295877 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.295687 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c0af5812-3297-4e07-abdb-f54190eed2b4-registry-tls\") pod \"image-registry-6577858866-9fbjb\" (UID: \"c0af5812-3297-4e07-abdb-f54190eed2b4\") " pod="openshift-image-registry/image-registry-6577858866-9fbjb" Jun 10 13:18:38.295877 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.295715 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/87c0c6d8-6455-44f3-a9ad-18852f44c96c-serving-cert\") pod \"insights-operator-896549976-xk8dj\" (UID: \"87c0c6d8-6455-44f3-a9ad-18852f44c96c\") " pod="openshift-insights/insights-operator-896549976-xk8dj" Jun 10 13:18:38.295877 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.295738 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c0af5812-3297-4e07-abdb-f54190eed2b4-registry-certificates\") pod \"image-registry-6577858866-9fbjb\" (UID: \"c0af5812-3297-4e07-abdb-f54190eed2b4\") " pod="openshift-image-registry/image-registry-6577858866-9fbjb" Jun 10 13:18:38.295877 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.295761 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c0921084-7852-4e0a-972a-7366b89c7736-serving-cert\") pod \"console-operator-668fdbf85c-9xwd9\" (UID: \"c0921084-7852-4e0a-972a-7366b89c7736\") " pod="openshift-console-operator/console-operator-668fdbf85c-9xwd9" Jun 10 13:18:38.295877 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.295788 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/87c0c6d8-6455-44f3-a9ad-18852f44c96c-trusted-ca-bundle\") pod \"insights-operator-896549976-xk8dj\" (UID: \"87c0c6d8-6455-44f3-a9ad-18852f44c96c\") " pod="openshift-insights/insights-operator-896549976-xk8dj" Jun 10 13:18:38.296199 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.295923 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c0af5812-3297-4e07-abdb-f54190eed2b4-trusted-ca\") pod \"image-registry-6577858866-9fbjb\" (UID: \"c0af5812-3297-4e07-abdb-f54190eed2b4\") " pod="openshift-image-registry/image-registry-6577858866-9fbjb" Jun 10 13:18:38.296199 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:18:38.295940 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 13:18:38.296199 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:18:38.295960 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6577858866-9fbjb: secret "image-registry-tls" not found Jun 10 13:18:38.296199 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.295980 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/87c0c6d8-6455-44f3-a9ad-18852f44c96c-tmp\") pod \"insights-operator-896549976-xk8dj\" (UID: \"87c0c6d8-6455-44f3-a9ad-18852f44c96c\") " pod="openshift-insights/insights-operator-896549976-xk8dj" Jun 10 13:18:38.296199 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.295994 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c0921084-7852-4e0a-972a-7366b89c7736-config\") pod \"console-operator-668fdbf85c-9xwd9\" (UID: \"c0921084-7852-4e0a-972a-7366b89c7736\") " pod="openshift-console-operator/console-operator-668fdbf85c-9xwd9" Jun 10 13:18:38.296199 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:18:38.296018 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c0af5812-3297-4e07-abdb-f54190eed2b4-registry-tls podName:c0af5812-3297-4e07-abdb-f54190eed2b4 nodeName:}" failed. No retries permitted until 2026-06-10 13:18:38.795997766 +0000 UTC m=+226.061248341 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c0af5812-3297-4e07-abdb-f54190eed2b4-registry-tls") pod "image-registry-6577858866-9fbjb" (UID: "c0af5812-3297-4e07-abdb-f54190eed2b4") : secret "image-registry-tls" not found Jun 10 13:18:38.296199 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.296077 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c0af5812-3297-4e07-abdb-f54190eed2b4-installation-pull-secrets\") pod \"image-registry-6577858866-9fbjb\" (UID: \"c0af5812-3297-4e07-abdb-f54190eed2b4\") " pod="openshift-image-registry/image-registry-6577858866-9fbjb" Jun 10 13:18:38.296199 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.296097 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c0af5812-3297-4e07-abdb-f54190eed2b4-ca-trust-extracted\") pod \"image-registry-6577858866-9fbjb\" (UID: \"c0af5812-3297-4e07-abdb-f54190eed2b4\") " pod="openshift-image-registry/image-registry-6577858866-9fbjb" Jun 10 13:18:38.296199 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.296117 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrwxk\" (UniqueName: \"kubernetes.io/projected/f03a035e-e2c3-484c-9e09-9c0d6aa282fd-kube-api-access-rrwxk\") pod \"volume-data-source-validator-78dd696465-95mdv\" (UID: \"f03a035e-e2c3-484c-9e09-9c0d6aa282fd\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-95mdv" Jun 10 13:18:38.296199 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.296136 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e402e555-ddd8-4a81-82df-815b5237540f-config\") pod \"service-ca-operator-6bc5ff68f5-7nph4\" (UID: \"e402e555-ddd8-4a81-82df-815b5237540f\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-7nph4" Jun 10 13:18:38.296199 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.296157 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e402e555-ddd8-4a81-82df-815b5237540f-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-7nph4\" (UID: \"e402e555-ddd8-4a81-82df-815b5237540f\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-7nph4" Jun 10 13:18:38.296199 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.296186 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxkmz\" (UniqueName: \"kubernetes.io/projected/95e01909-21ea-4f57-b507-cc9170aa3bd1-kube-api-access-qxkmz\") pod \"network-check-source-dbd9cf844-kcfnz\" (UID: \"95e01909-21ea-4f57-b507-cc9170aa3bd1\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-kcfnz" Jun 10 13:18:38.296711 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.296213 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c0af5812-3297-4e07-abdb-f54190eed2b4-bound-sa-token\") pod \"image-registry-6577858866-9fbjb\" (UID: \"c0af5812-3297-4e07-abdb-f54190eed2b4\") " pod="openshift-image-registry/image-registry-6577858866-9fbjb" Jun 10 13:18:38.296711 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.296253 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/87c0c6d8-6455-44f3-a9ad-18852f44c96c-snapshots\") pod \"insights-operator-896549976-xk8dj\" (UID: \"87c0c6d8-6455-44f3-a9ad-18852f44c96c\") " pod="openshift-insights/insights-operator-896549976-xk8dj" Jun 10 13:18:38.296711 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.296448 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c0af5812-3297-4e07-abdb-f54190eed2b4-registry-certificates\") pod \"image-registry-6577858866-9fbjb\" (UID: \"c0af5812-3297-4e07-abdb-f54190eed2b4\") " pod="openshift-image-registry/image-registry-6577858866-9fbjb" Jun 10 13:18:38.296711 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.296449 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c0af5812-3297-4e07-abdb-f54190eed2b4-ca-trust-extracted\") pod \"image-registry-6577858866-9fbjb\" (UID: \"c0af5812-3297-4e07-abdb-f54190eed2b4\") " pod="openshift-image-registry/image-registry-6577858866-9fbjb" Jun 10 13:18:38.297015 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.296985 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/87c0c6d8-6455-44f3-a9ad-18852f44c96c-service-ca-bundle\") pod \"insights-operator-896549976-xk8dj\" (UID: \"87c0c6d8-6455-44f3-a9ad-18852f44c96c\") " pod="openshift-insights/insights-operator-896549976-xk8dj" Jun 10 13:18:38.297274 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.297244 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/87c0c6d8-6455-44f3-a9ad-18852f44c96c-snapshots\") pod \"insights-operator-896549976-xk8dj\" (UID: \"87c0c6d8-6455-44f3-a9ad-18852f44c96c\") " pod="openshift-insights/insights-operator-896549976-xk8dj" Jun 10 13:18:38.297393 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.297290 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e402e555-ddd8-4a81-82df-815b5237540f-config\") pod \"service-ca-operator-6bc5ff68f5-7nph4\" (UID: \"e402e555-ddd8-4a81-82df-815b5237540f\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-7nph4" Jun 10 13:18:38.297482 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.297433 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c0af5812-3297-4e07-abdb-f54190eed2b4-trusted-ca\") pod \"image-registry-6577858866-9fbjb\" (UID: \"c0af5812-3297-4e07-abdb-f54190eed2b4\") " pod="openshift-image-registry/image-registry-6577858866-9fbjb" Jun 10 13:18:38.297545 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.297483 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/87c0c6d8-6455-44f3-a9ad-18852f44c96c-trusted-ca-bundle\") pod \"insights-operator-896549976-xk8dj\" (UID: \"87c0c6d8-6455-44f3-a9ad-18852f44c96c\") " pod="openshift-insights/insights-operator-896549976-xk8dj" Jun 10 13:18:38.298580 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.298552 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c0af5812-3297-4e07-abdb-f54190eed2b4-installation-pull-secrets\") pod \"image-registry-6577858866-9fbjb\" (UID: \"c0af5812-3297-4e07-abdb-f54190eed2b4\") " pod="openshift-image-registry/image-registry-6577858866-9fbjb" Jun 10 13:18:38.298816 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.298796 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c0af5812-3297-4e07-abdb-f54190eed2b4-image-registry-private-configuration\") pod \"image-registry-6577858866-9fbjb\" (UID: \"c0af5812-3297-4e07-abdb-f54190eed2b4\") " pod="openshift-image-registry/image-registry-6577858866-9fbjb" Jun 10 13:18:38.298918 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.298872 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/87c0c6d8-6455-44f3-a9ad-18852f44c96c-serving-cert\") pod \"insights-operator-896549976-xk8dj\" (UID: \"87c0c6d8-6455-44f3-a9ad-18852f44c96c\") " pod="openshift-insights/insights-operator-896549976-xk8dj" Jun 10 13:18:38.299104 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.299089 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e402e555-ddd8-4a81-82df-815b5237540f-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-7nph4\" (UID: \"e402e555-ddd8-4a81-82df-815b5237540f\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-7nph4" Jun 10 13:18:38.314405 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.314380 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxkmz\" (UniqueName: \"kubernetes.io/projected/95e01909-21ea-4f57-b507-cc9170aa3bd1-kube-api-access-qxkmz\") pod \"network-check-source-dbd9cf844-kcfnz\" (UID: \"95e01909-21ea-4f57-b507-cc9170aa3bd1\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-kcfnz" Jun 10 13:18:38.316137 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.316121 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzph7\" (UniqueName: \"kubernetes.io/projected/87c0c6d8-6455-44f3-a9ad-18852f44c96c-kube-api-access-nzph7\") pod \"insights-operator-896549976-xk8dj\" (UID: \"87c0c6d8-6455-44f3-a9ad-18852f44c96c\") " pod="openshift-insights/insights-operator-896549976-xk8dj" Jun 10 13:18:38.318807 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.318788 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gz89\" (UniqueName: \"kubernetes.io/projected/c0af5812-3297-4e07-abdb-f54190eed2b4-kube-api-access-6gz89\") pod \"image-registry-6577858866-9fbjb\" (UID: \"c0af5812-3297-4e07-abdb-f54190eed2b4\") " pod="openshift-image-registry/image-registry-6577858866-9fbjb" Jun 10 13:18:38.324953 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.324934 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c0af5812-3297-4e07-abdb-f54190eed2b4-bound-sa-token\") pod \"image-registry-6577858866-9fbjb\" (UID: \"c0af5812-3297-4e07-abdb-f54190eed2b4\") " pod="openshift-image-registry/image-registry-6577858866-9fbjb" Jun 10 13:18:38.334373 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.334353 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nhwr\" (UniqueName: \"kubernetes.io/projected/e402e555-ddd8-4a81-82df-815b5237540f-kube-api-access-9nhwr\") pod \"service-ca-operator-6bc5ff68f5-7nph4\" (UID: \"e402e555-ddd8-4a81-82df-815b5237540f\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-7nph4" Jun 10 13:18:38.396516 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.396495 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c0921084-7852-4e0a-972a-7366b89c7736-config\") pod \"console-operator-668fdbf85c-9xwd9\" (UID: \"c0921084-7852-4e0a-972a-7366b89c7736\") " pod="openshift-console-operator/console-operator-668fdbf85c-9xwd9" Jun 10 13:18:38.396637 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.396551 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrwxk\" (UniqueName: \"kubernetes.io/projected/f03a035e-e2c3-484c-9e09-9c0d6aa282fd-kube-api-access-rrwxk\") pod \"volume-data-source-validator-78dd696465-95mdv\" (UID: \"f03a035e-e2c3-484c-9e09-9c0d6aa282fd\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-95mdv" Jun 10 13:18:38.396637 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.396604 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6sbmz\" (UniqueName: \"kubernetes.io/projected/c0921084-7852-4e0a-972a-7366b89c7736-kube-api-access-6sbmz\") pod \"console-operator-668fdbf85c-9xwd9\" (UID: \"c0921084-7852-4e0a-972a-7366b89c7736\") " pod="openshift-console-operator/console-operator-668fdbf85c-9xwd9" Jun 10 13:18:38.396743 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.396658 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c0921084-7852-4e0a-972a-7366b89c7736-trusted-ca\") pod \"console-operator-668fdbf85c-9xwd9\" (UID: \"c0921084-7852-4e0a-972a-7366b89c7736\") " pod="openshift-console-operator/console-operator-668fdbf85c-9xwd9" Jun 10 13:18:38.396743 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.396701 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c0921084-7852-4e0a-972a-7366b89c7736-serving-cert\") pod \"console-operator-668fdbf85c-9xwd9\" (UID: \"c0921084-7852-4e0a-972a-7366b89c7736\") " pod="openshift-console-operator/console-operator-668fdbf85c-9xwd9" Jun 10 13:18:38.397109 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.397088 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c0921084-7852-4e0a-972a-7366b89c7736-config\") pod \"console-operator-668fdbf85c-9xwd9\" (UID: \"c0921084-7852-4e0a-972a-7366b89c7736\") " pod="openshift-console-operator/console-operator-668fdbf85c-9xwd9" Jun 10 13:18:38.397387 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.397371 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c0921084-7852-4e0a-972a-7366b89c7736-trusted-ca\") pod \"console-operator-668fdbf85c-9xwd9\" (UID: \"c0921084-7852-4e0a-972a-7366b89c7736\") " pod="openshift-console-operator/console-operator-668fdbf85c-9xwd9" Jun 10 13:18:38.398608 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.398588 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c0921084-7852-4e0a-972a-7366b89c7736-serving-cert\") pod \"console-operator-668fdbf85c-9xwd9\" (UID: \"c0921084-7852-4e0a-972a-7366b89c7736\") " pod="openshift-console-operator/console-operator-668fdbf85c-9xwd9" Jun 10 13:18:38.404553 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.404538 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-kcfnz" Jun 10 13:18:38.407951 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.407929 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrwxk\" (UniqueName: \"kubernetes.io/projected/f03a035e-e2c3-484c-9e09-9c0d6aa282fd-kube-api-access-rrwxk\") pod \"volume-data-source-validator-78dd696465-95mdv\" (UID: \"f03a035e-e2c3-484c-9e09-9c0d6aa282fd\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-95mdv" Jun 10 13:18:38.408623 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.408600 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6sbmz\" (UniqueName: \"kubernetes.io/projected/c0921084-7852-4e0a-972a-7366b89c7736-kube-api-access-6sbmz\") pod \"console-operator-668fdbf85c-9xwd9\" (UID: \"c0921084-7852-4e0a-972a-7366b89c7736\") " pod="openshift-console-operator/console-operator-668fdbf85c-9xwd9" Jun 10 13:18:38.415268 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.415248 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-xk8dj" Jun 10 13:18:38.421170 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.421155 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-7nph4" Jun 10 13:18:38.475237 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.475209 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:18:38.510915 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.510822 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-95mdv" Jun 10 13:18:38.518789 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.518765 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-9xwd9" Jun 10 13:18:38.549119 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.549037 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-kcfnz"] Jun 10 13:18:38.553172 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.552259 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:18:38.555271 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:18:38.555249 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95e01909_21ea_4f57_b507_cc9170aa3bd1.slice/crio-7ac8659b0b5836a8bf6fa06f66425ad1ed17dc57f7edc1395aec5d51f25e0fde WatchSource:0}: Error finding container 7ac8659b0b5836a8bf6fa06f66425ad1ed17dc57f7edc1395aec5d51f25e0fde: Status 404 returned error can't find the container with id 7ac8659b0b5836a8bf6fa06f66425ad1ed17dc57f7edc1395aec5d51f25e0fde Jun 10 13:18:38.571171 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.570620 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-xk8dj"] Jun 10 13:18:38.593373 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.593342 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-7nph4"] Jun 10 13:18:38.604267 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:18:38.604015 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode402e555_ddd8_4a81_82df_815b5237540f.slice/crio-6e42d9c48295780ed7645a44b3590738b7f0d7a1779b52dbc0a7a4604e990a5c WatchSource:0}: Error finding container 6e42d9c48295780ed7645a44b3590738b7f0d7a1779b52dbc0a7a4604e990a5c: Status 404 returned error can't find the container with id 6e42d9c48295780ed7645a44b3590738b7f0d7a1779b52dbc0a7a4604e990a5c Jun 10 13:18:38.661986 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.661920 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-95mdv"] Jun 10 13:18:38.665094 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:18:38.665067 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf03a035e_e2c3_484c_9e09_9c0d6aa282fd.slice/crio-84573500d09a1d2d0955ff32e2e00dba9757126c1a65f5853f5d8aad1f05a911 WatchSource:0}: Error finding container 84573500d09a1d2d0955ff32e2e00dba9757126c1a65f5853f5d8aad1f05a911: Status 404 returned error can't find the container with id 84573500d09a1d2d0955ff32e2e00dba9757126c1a65f5853f5d8aad1f05a911 Jun 10 13:18:38.676547 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.676506 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-9xwd9"] Jun 10 13:18:38.680100 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:18:38.680066 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0921084_7852_4e0a_972a_7366b89c7736.slice/crio-1d27902539b352162e03c91e858b7c53709c07d202f8507bc5a9b9b7a8d5e632 WatchSource:0}: Error finding container 1d27902539b352162e03c91e858b7c53709c07d202f8507bc5a9b9b7a8d5e632: Status 404 returned error can't find the container with id 1d27902539b352162e03c91e858b7c53709c07d202f8507bc5a9b9b7a8d5e632 Jun 10 13:18:38.800550 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.800517 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c0af5812-3297-4e07-abdb-f54190eed2b4-registry-tls\") pod \"image-registry-6577858866-9fbjb\" (UID: \"c0af5812-3297-4e07-abdb-f54190eed2b4\") " pod="openshift-image-registry/image-registry-6577858866-9fbjb" Jun 10 13:18:38.800691 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:18:38.800652 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 13:18:38.800691 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:18:38.800664 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6577858866-9fbjb: secret "image-registry-tls" not found Jun 10 13:18:38.800760 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:18:38.800710 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c0af5812-3297-4e07-abdb-f54190eed2b4-registry-tls podName:c0af5812-3297-4e07-abdb-f54190eed2b4 nodeName:}" failed. No retries permitted until 2026-06-10 13:18:39.800697248 +0000 UTC m=+227.065947824 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c0af5812-3297-4e07-abdb-f54190eed2b4-registry-tls") pod "image-registry-6577858866-9fbjb" (UID: "c0af5812-3297-4e07-abdb-f54190eed2b4") : secret "image-registry-tls" not found Jun 10 13:18:38.873397 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.873367 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-9xwd9" event={"ID":"c0921084-7852-4e0a-972a-7366b89c7736","Type":"ContainerStarted","Data":"1d27902539b352162e03c91e858b7c53709c07d202f8507bc5a9b9b7a8d5e632"} Jun 10 13:18:38.874917 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.874887 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-kcfnz" event={"ID":"95e01909-21ea-4f57-b507-cc9170aa3bd1","Type":"ContainerStarted","Data":"4ddcbd544f8469a6a7bcacffebcfa4120e6f856dee21f1e0d0b4c96fb82f14e8"} Jun 10 13:18:38.875046 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.874933 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-kcfnz" event={"ID":"95e01909-21ea-4f57-b507-cc9170aa3bd1","Type":"ContainerStarted","Data":"7ac8659b0b5836a8bf6fa06f66425ad1ed17dc57f7edc1395aec5d51f25e0fde"} Jun 10 13:18:38.875982 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.875958 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-7nph4" event={"ID":"e402e555-ddd8-4a81-82df-815b5237540f","Type":"ContainerStarted","Data":"6e42d9c48295780ed7645a44b3590738b7f0d7a1779b52dbc0a7a4604e990a5c"} Jun 10 13:18:38.877104 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.877081 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-95mdv" event={"ID":"f03a035e-e2c3-484c-9e09-9c0d6aa282fd","Type":"ContainerStarted","Data":"84573500d09a1d2d0955ff32e2e00dba9757126c1a65f5853f5d8aad1f05a911"} Jun 10 13:18:38.878083 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.878064 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-xk8dj" event={"ID":"87c0c6d8-6455-44f3-a9ad-18852f44c96c","Type":"ContainerStarted","Data":"3bf70971ebd46332897fd0b69d8eecb6a9ab8b4b54c642054f14569f9e6eeeea"} Jun 10 13:18:38.894271 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:38.894232 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-kcfnz" podStartSLOduration=0.894218899 podStartE2EDuration="894.218899ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:18:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:18:38.893708259 +0000 UTC m=+226.158958855" watchObservedRunningTime="2026-06-10 13:18:38.894218899 +0000 UTC m=+226.159469523" Jun 10 13:18:39.809725 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:39.809686 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c0af5812-3297-4e07-abdb-f54190eed2b4-registry-tls\") pod \"image-registry-6577858866-9fbjb\" (UID: \"c0af5812-3297-4e07-abdb-f54190eed2b4\") " pod="openshift-image-registry/image-registry-6577858866-9fbjb" Jun 10 13:18:39.810423 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:18:39.809899 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 13:18:39.810423 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:18:39.809915 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6577858866-9fbjb: secret "image-registry-tls" not found Jun 10 13:18:39.810423 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:18:39.809971 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c0af5812-3297-4e07-abdb-f54190eed2b4-registry-tls podName:c0af5812-3297-4e07-abdb-f54190eed2b4 nodeName:}" failed. No retries permitted until 2026-06-10 13:18:41.809954094 +0000 UTC m=+229.075204671 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c0af5812-3297-4e07-abdb-f54190eed2b4-registry-tls") pod "image-registry-6577858866-9fbjb" (UID: "c0af5812-3297-4e07-abdb-f54190eed2b4") : secret "image-registry-tls" not found Jun 10 13:18:40.890044 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:40.890006 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-95mdv" event={"ID":"f03a035e-e2c3-484c-9e09-9c0d6aa282fd","Type":"ContainerStarted","Data":"52386d0eec462871549e51b31fb04ccfa49792ae3fba16856b18364ecadc7d98"} Jun 10 13:18:40.907450 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:40.907393 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-95mdv" podStartSLOduration=1.47289123 podStartE2EDuration="2.907375692s" totalImagesPullingTime="1.434484462s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:18:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:18:40.906964035 +0000 UTC m=+228.172214719" watchObservedRunningTime="2026-06-10 13:18:40.907375692 +0000 UTC m=+228.172626315" Jun 10 13:18:41.000441 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:41.000394 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:18:41.102280 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:41.102240 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:18:41.826526 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:41.826505 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c0af5812-3297-4e07-abdb-f54190eed2b4-registry-tls\") pod \"image-registry-6577858866-9fbjb\" (UID: \"c0af5812-3297-4e07-abdb-f54190eed2b4\") " pod="openshift-image-registry/image-registry-6577858866-9fbjb" Jun 10 13:18:41.826666 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:18:41.826648 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 13:18:41.826709 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:18:41.826669 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6577858866-9fbjb: secret "image-registry-tls" not found Jun 10 13:18:41.826739 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:18:41.826716 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c0af5812-3297-4e07-abdb-f54190eed2b4-registry-tls podName:c0af5812-3297-4e07-abdb-f54190eed2b4 nodeName:}" failed. No retries permitted until 2026-06-10 13:18:45.826701806 +0000 UTC m=+233.091952385 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c0af5812-3297-4e07-abdb-f54190eed2b4-registry-tls") pod "image-registry-6577858866-9fbjb" (UID: "c0af5812-3297-4e07-abdb-f54190eed2b4") : secret "image-registry-tls" not found Jun 10 13:18:41.894874 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:41.894815 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-7nph4" event={"ID":"e402e555-ddd8-4a81-82df-815b5237540f","Type":"ContainerStarted","Data":"e299aabc4a479deda74e89a1e4c1673ec104e3a67a41eba79a2faf2faadc22db"} Jun 10 13:18:41.896721 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:41.896659 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-xk8dj" event={"ID":"87c0c6d8-6455-44f3-a9ad-18852f44c96c","Type":"ContainerStarted","Data":"be3955fa081d3f8e5334b062776cc4f3a186d5652a0759eedea13146a88e209d"} Jun 10 13:18:41.898728 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:41.898700 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-9xwd9" event={"ID":"c0921084-7852-4e0a-972a-7366b89c7736","Type":"ContainerStarted","Data":"afb264f2950137e2b0ffa65829ac95b85c8a2fb549a7e2785e8352ddcb4750d4"} Jun 10 13:18:41.898945 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:41.898928 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-9xwd9" Jun 10 13:18:41.900324 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:41.900292 2567 patch_prober.go:28] interesting pod/console-operator-668fdbf85c-9xwd9 container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.134.0.14:8443/readyz\": dial tcp 10.134.0.14:8443: connect: connection refused" start-of-body= Jun 10 13:18:41.900464 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:41.900341 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-668fdbf85c-9xwd9" podUID="c0921084-7852-4e0a-972a-7366b89c7736" containerName="console-operator" probeResult="failure" output="Get \"https://10.134.0.14:8443/readyz\": dial tcp 10.134.0.14:8443: connect: connection refused" Jun 10 13:18:41.933944 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:41.933881 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-7nph4" podStartSLOduration=0.738137238 podStartE2EDuration="3.933861123s" totalImagesPullingTime="3.195723885s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:18:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:18:41.913206897 +0000 UTC m=+229.178457494" watchObservedRunningTime="2026-06-10 13:18:41.933861123 +0000 UTC m=+229.199111717" Jun 10 13:18:41.935113 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:41.935071 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-896549976-xk8dj" podStartSLOduration=0.71859894 podStartE2EDuration="3.935059836s" totalImagesPullingTime="3.216460896s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:18:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:18:41.93331236 +0000 UTC m=+229.198562957" watchObservedRunningTime="2026-06-10 13:18:41.935059836 +0000 UTC m=+229.200310434" Jun 10 13:18:41.951472 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:41.951428 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-668fdbf85c-9xwd9" podStartSLOduration=0.833494883 podStartE2EDuration="3.95141232s" totalImagesPullingTime="3.117917437s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:18:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:18:41.950399014 +0000 UTC m=+229.215649612" watchObservedRunningTime="2026-06-10 13:18:41.95141232 +0000 UTC m=+229.216662916" Jun 10 13:18:42.380810 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:42.380773 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:18:42.470133 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:42.470102 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:18:42.534934 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:42.534895 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:18:42.904605 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:42.904578 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-9xwd9_c0921084-7852-4e0a-972a-7366b89c7736/console-operator/0.log" Jun 10 13:18:42.905053 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:42.904616 2567 generic.go:356] "Generic (PLEG): container finished" podID="c0921084-7852-4e0a-972a-7366b89c7736" containerID="afb264f2950137e2b0ffa65829ac95b85c8a2fb549a7e2785e8352ddcb4750d4" exitCode=255 Jun 10 13:18:42.905053 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:42.904699 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-9xwd9" event={"ID":"c0921084-7852-4e0a-972a-7366b89c7736","Type":"ContainerDied","Data":"afb264f2950137e2b0ffa65829ac95b85c8a2fb549a7e2785e8352ddcb4750d4"} Jun 10 13:18:42.905053 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:42.904960 2567 scope.go:117] "RemoveContainer" containerID="afb264f2950137e2b0ffa65829ac95b85c8a2fb549a7e2785e8352ddcb4750d4" Jun 10 13:18:42.937592 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:42.937566 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:18:43.039634 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:43.039609 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:18:43.524817 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:43.524777 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:18:43.624930 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:43.624898 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:18:43.724281 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:43.724245 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:18:43.909125 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:43.909101 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-9xwd9_c0921084-7852-4e0a-972a-7366b89c7736/console-operator/1.log" Jun 10 13:18:43.909507 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:43.909474 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-9xwd9_c0921084-7852-4e0a-972a-7366b89c7736/console-operator/0.log" Jun 10 13:18:43.909551 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:43.909504 2567 generic.go:356] "Generic (PLEG): container finished" podID="c0921084-7852-4e0a-972a-7366b89c7736" containerID="99ed06ce8bc66a72b7e9b18be759d6aece4fa18b0bab70f913e9787b2b63c319" exitCode=255 Jun 10 13:18:43.909551 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:43.909535 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-9xwd9" event={"ID":"c0921084-7852-4e0a-972a-7366b89c7736","Type":"ContainerDied","Data":"99ed06ce8bc66a72b7e9b18be759d6aece4fa18b0bab70f913e9787b2b63c319"} Jun 10 13:18:43.909623 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:43.909603 2567 scope.go:117] "RemoveContainer" containerID="afb264f2950137e2b0ffa65829ac95b85c8a2fb549a7e2785e8352ddcb4750d4" Jun 10 13:18:43.909800 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:43.909775 2567 scope.go:117] "RemoveContainer" containerID="99ed06ce8bc66a72b7e9b18be759d6aece4fa18b0bab70f913e9787b2b63c319" Jun 10 13:18:43.910005 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:18:43.909986 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-9xwd9_openshift-console-operator(c0921084-7852-4e0a-972a-7366b89c7736)\"" pod="openshift-console-operator/console-operator-668fdbf85c-9xwd9" podUID="c0921084-7852-4e0a-972a-7366b89c7736" Jun 10 13:18:44.150190 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:44.150153 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:18:44.247290 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:44.247200 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:18:44.913781 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:44.913751 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-9xwd9_c0921084-7852-4e0a-972a-7366b89c7736/console-operator/1.log" Jun 10 13:18:44.914170 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:44.914054 2567 scope.go:117] "RemoveContainer" containerID="99ed06ce8bc66a72b7e9b18be759d6aece4fa18b0bab70f913e9787b2b63c319" Jun 10 13:18:44.914215 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:18:44.914190 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-9xwd9_openshift-console-operator(c0921084-7852-4e0a-972a-7366b89c7736)\"" pod="openshift-console-operator/console-operator-668fdbf85c-9xwd9" podUID="c0921084-7852-4e0a-972a-7366b89c7736" Jun 10 13:18:45.256098 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:45.256031 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-r2dvw"] Jun 10 13:18:45.258857 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:45.258828 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-r2dvw" Jun 10 13:18:45.261622 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:45.261600 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 10 13:18:45.262029 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:45.262014 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 10 13:18:45.262139 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:45.262060 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 10 13:18:45.262204 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:45.262162 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-5q527\"" Jun 10 13:18:45.263270 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:45.263250 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 10 13:18:45.267577 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:45.267556 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-r2dvw"] Jun 10 13:18:45.295168 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:45.295143 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:18:45.354053 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:45.354033 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/5ee03cbb-57d3-4ccb-9277-dbde0caaa743-signing-key\") pod \"service-ca-7d74d578b8-r2dvw\" (UID: \"5ee03cbb-57d3-4ccb-9277-dbde0caaa743\") " pod="openshift-service-ca/service-ca-7d74d578b8-r2dvw" Jun 10 13:18:45.354127 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:45.354057 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpz7q\" (UniqueName: \"kubernetes.io/projected/5ee03cbb-57d3-4ccb-9277-dbde0caaa743-kube-api-access-hpz7q\") pod \"service-ca-7d74d578b8-r2dvw\" (UID: \"5ee03cbb-57d3-4ccb-9277-dbde0caaa743\") " pod="openshift-service-ca/service-ca-7d74d578b8-r2dvw" Jun 10 13:18:45.354127 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:45.354075 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/5ee03cbb-57d3-4ccb-9277-dbde0caaa743-signing-cabundle\") pod \"service-ca-7d74d578b8-r2dvw\" (UID: \"5ee03cbb-57d3-4ccb-9277-dbde0caaa743\") " pod="openshift-service-ca/service-ca-7d74d578b8-r2dvw" Jun 10 13:18:45.359727 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:45.359704 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:18:45.454785 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:45.454756 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/5ee03cbb-57d3-4ccb-9277-dbde0caaa743-signing-key\") pod \"service-ca-7d74d578b8-r2dvw\" (UID: \"5ee03cbb-57d3-4ccb-9277-dbde0caaa743\") " pod="openshift-service-ca/service-ca-7d74d578b8-r2dvw" Jun 10 13:18:45.454785 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:45.454784 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpz7q\" (UniqueName: \"kubernetes.io/projected/5ee03cbb-57d3-4ccb-9277-dbde0caaa743-kube-api-access-hpz7q\") pod \"service-ca-7d74d578b8-r2dvw\" (UID: \"5ee03cbb-57d3-4ccb-9277-dbde0caaa743\") " pod="openshift-service-ca/service-ca-7d74d578b8-r2dvw" Jun 10 13:18:45.454959 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:45.454804 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/5ee03cbb-57d3-4ccb-9277-dbde0caaa743-signing-cabundle\") pod \"service-ca-7d74d578b8-r2dvw\" (UID: \"5ee03cbb-57d3-4ccb-9277-dbde0caaa743\") " pod="openshift-service-ca/service-ca-7d74d578b8-r2dvw" Jun 10 13:18:45.455361 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:45.455343 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/5ee03cbb-57d3-4ccb-9277-dbde0caaa743-signing-cabundle\") pod \"service-ca-7d74d578b8-r2dvw\" (UID: \"5ee03cbb-57d3-4ccb-9277-dbde0caaa743\") " pod="openshift-service-ca/service-ca-7d74d578b8-r2dvw" Jun 10 13:18:45.457236 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:45.457212 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/5ee03cbb-57d3-4ccb-9277-dbde0caaa743-signing-key\") pod \"service-ca-7d74d578b8-r2dvw\" (UID: \"5ee03cbb-57d3-4ccb-9277-dbde0caaa743\") " pod="openshift-service-ca/service-ca-7d74d578b8-r2dvw" Jun 10 13:18:45.463739 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:45.463721 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpz7q\" (UniqueName: \"kubernetes.io/projected/5ee03cbb-57d3-4ccb-9277-dbde0caaa743-kube-api-access-hpz7q\") pod \"service-ca-7d74d578b8-r2dvw\" (UID: \"5ee03cbb-57d3-4ccb-9277-dbde0caaa743\") " pod="openshift-service-ca/service-ca-7d74d578b8-r2dvw" Jun 10 13:18:45.568078 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:45.568024 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-r2dvw" Jun 10 13:18:45.685002 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:45.684970 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-r2dvw"] Jun 10 13:18:45.688337 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:18:45.688313 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ee03cbb_57d3_4ccb_9277_dbde0caaa743.slice/crio-ae0cbbcbaa036c0ff70e05176be6f705d7899c4df6460f15988e8971a801eb49 WatchSource:0}: Error finding container ae0cbbcbaa036c0ff70e05176be6f705d7899c4df6460f15988e8971a801eb49: Status 404 returned error can't find the container with id ae0cbbcbaa036c0ff70e05176be6f705d7899c4df6460f15988e8971a801eb49 Jun 10 13:18:45.857989 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:45.857903 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c0af5812-3297-4e07-abdb-f54190eed2b4-registry-tls\") pod \"image-registry-6577858866-9fbjb\" (UID: \"c0af5812-3297-4e07-abdb-f54190eed2b4\") " pod="openshift-image-registry/image-registry-6577858866-9fbjb" Jun 10 13:18:45.858122 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:18:45.858057 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 13:18:45.858122 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:18:45.858075 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6577858866-9fbjb: secret "image-registry-tls" not found Jun 10 13:18:45.858199 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:18:45.858127 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c0af5812-3297-4e07-abdb-f54190eed2b4-registry-tls podName:c0af5812-3297-4e07-abdb-f54190eed2b4 nodeName:}" failed. No retries permitted until 2026-06-10 13:18:53.858111008 +0000 UTC m=+241.123361583 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c0af5812-3297-4e07-abdb-f54190eed2b4-registry-tls") pod "image-registry-6577858866-9fbjb" (UID: "c0af5812-3297-4e07-abdb-f54190eed2b4") : secret "image-registry-tls" not found Jun 10 13:18:45.918727 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:45.918696 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-r2dvw" event={"ID":"5ee03cbb-57d3-4ccb-9277-dbde0caaa743","Type":"ContainerStarted","Data":"25abbcbcafd4216b3df132f87a11be4ca3669a7ffa45952adbf56b91c40ed416"} Jun 10 13:18:45.919093 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:45.918743 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-r2dvw" event={"ID":"5ee03cbb-57d3-4ccb-9277-dbde0caaa743","Type":"ContainerStarted","Data":"ae0cbbcbaa036c0ff70e05176be6f705d7899c4df6460f15988e8971a801eb49"} Jun 10 13:18:45.958728 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:45.958686 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7d74d578b8-r2dvw" podStartSLOduration=0.958671711 podStartE2EDuration="958.671711ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:18:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:18:45.953127783 +0000 UTC m=+233.218378380" watchObservedRunningTime="2026-06-10 13:18:45.958671711 +0000 UTC m=+233.223922307" Jun 10 13:18:46.437831 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:46.437808 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vpqgr_4fad052f-bd79-43d6-8fe8-57ba27e1b911/dns-node-resolver/0.log" Jun 10 13:18:46.621261 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:46.621218 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:18:47.002534 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:47.002483 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:18:47.238636 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:47.238606 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-j4s5b_5eb4a19d-1cf0-4a15-abe1-2cf06495af67/node-ca/0.log" Jun 10 13:18:47.294248 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:47.294138 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:18:47.395876 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:47.395811 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:18:47.496047 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:47.496018 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:18:47.611625 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:47.611535 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:18:47.709696 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:47.709664 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:18:47.770130 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:47.770093 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:18:48.239111 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:48.239081 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-x7jkx_3efa946b-70cc-4855-add1-c73d1082de77/serve-healthcheck-canary/0.log" Jun 10 13:18:48.289427 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:48.289399 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:18:48.519115 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:48.519077 2567 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-9xwd9" Jun 10 13:18:48.519525 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:48.519510 2567 scope.go:117] "RemoveContainer" containerID="99ed06ce8bc66a72b7e9b18be759d6aece4fa18b0bab70f913e9787b2b63c319" Jun 10 13:18:48.519708 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:18:48.519688 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-9xwd9_openshift-console-operator(c0921084-7852-4e0a-972a-7366b89c7736)\"" pod="openshift-console-operator/console-operator-668fdbf85c-9xwd9" podUID="c0921084-7852-4e0a-972a-7366b89c7736" Jun 10 13:18:48.896498 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:48.896463 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:18:49.090414 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:49.090378 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:18:49.487876 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:49.487814 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:18:49.591536 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:49.591493 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:18:50.291550 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:50.291511 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:18:50.490669 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:50.490630 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:18:50.878380 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:50.878346 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:18:50.935674 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:50.935643 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:18:50.994110 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:50.994079 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:18:51.094190 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:51.094160 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:18:51.489826 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:51.489787 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:18:51.893910 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:51.893882 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:18:51.899691 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:51.899669 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-9xwd9" Jun 10 13:18:51.900116 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:51.900103 2567 scope.go:117] "RemoveContainer" containerID="99ed06ce8bc66a72b7e9b18be759d6aece4fa18b0bab70f913e9787b2b63c319" Jun 10 13:18:51.900311 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:18:51.900291 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-9xwd9_openshift-console-operator(c0921084-7852-4e0a-972a-7366b89c7736)\"" pod="openshift-console-operator/console-operator-668fdbf85c-9xwd9" podUID="c0921084-7852-4e0a-972a-7366b89c7736" Jun 10 13:18:52.737629 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:52.737600 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:18:52.910626 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:52.910587 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:18:53.105230 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:53.105149 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:18:53.530866 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:53.530822 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:18:53.651164 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:53.651133 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:18:53.923372 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:53.923328 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c0af5812-3297-4e07-abdb-f54190eed2b4-registry-tls\") pod \"image-registry-6577858866-9fbjb\" (UID: \"c0af5812-3297-4e07-abdb-f54190eed2b4\") " pod="openshift-image-registry/image-registry-6577858866-9fbjb" Jun 10 13:18:53.925762 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:53.925738 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c0af5812-3297-4e07-abdb-f54190eed2b4-registry-tls\") pod \"image-registry-6577858866-9fbjb\" (UID: \"c0af5812-3297-4e07-abdb-f54190eed2b4\") " pod="openshift-image-registry/image-registry-6577858866-9fbjb" Jun 10 13:18:54.029933 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:54.029904 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-dccsb\"" Jun 10 13:18:54.037459 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:54.037440 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6577858866-9fbjb" Jun 10 13:18:54.115342 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:54.115270 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:18:54.170867 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:54.170821 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6577858866-9fbjb"] Jun 10 13:18:54.173795 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:18:54.173736 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0af5812_3297_4e07_abdb_f54190eed2b4.slice/crio-bcc47a8ecccb030c59f3921a69284ddb7b7a2be4263f52f157901b20f0f14956 WatchSource:0}: Error finding container bcc47a8ecccb030c59f3921a69284ddb7b7a2be4263f52f157901b20f0f14956: Status 404 returned error can't find the container with id bcc47a8ecccb030c59f3921a69284ddb7b7a2be4263f52f157901b20f0f14956 Jun 10 13:18:54.707492 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:54.707460 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:18:54.905830 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:54.905788 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:18:54.948221 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:54.948189 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6577858866-9fbjb" event={"ID":"c0af5812-3297-4e07-abdb-f54190eed2b4","Type":"ContainerStarted","Data":"fb18f1d77c089b1241e28fef9521c659dbf79d1b36e1bb344b2e0a8f871d5ea9"} Jun 10 13:18:54.948569 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:54.948241 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6577858866-9fbjb" event={"ID":"c0af5812-3297-4e07-abdb-f54190eed2b4","Type":"ContainerStarted","Data":"bcc47a8ecccb030c59f3921a69284ddb7b7a2be4263f52f157901b20f0f14956"} Jun 10 13:18:54.948569 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:54.948323 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6577858866-9fbjb" Jun 10 13:18:54.977200 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:54.977104 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6577858866-9fbjb" podStartSLOduration=16.977087381 podStartE2EDuration="16.977087381s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:18:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:18:54.977045915 +0000 UTC m=+242.242296513" watchObservedRunningTime="2026-06-10 13:18:54.977087381 +0000 UTC m=+242.242337979" Jun 10 13:18:55.297370 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:55.297283 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:18:55.444220 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:55.444184 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:18:55.543933 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:55.543905 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:18:55.697726 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:55.697692 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:18:56.261479 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:56.261447 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:18:56.360602 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:56.360574 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:18:56.459179 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:56.459139 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:18:56.891765 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:56.891730 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:18:57.121797 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:57.121763 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:18:57.290135 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:57.290050 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:18:57.490558 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:57.490526 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:18:57.687081 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:57.687049 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:18:58.038467 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:58.038384 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:18:58.139015 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:18:58.138979 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:19:05.005234 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:05.005199 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5458a9d3-baee-4c82-b5a5-9c0d1227c481-metrics-certs\") pod \"network-metrics-daemon-qn67p\" (UID: \"5458a9d3-baee-4c82-b5a5-9c0d1227c481\") " pod="openshift-multus/network-metrics-daemon-qn67p" Jun 10 13:19:05.007518 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:05.007493 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5458a9d3-baee-4c82-b5a5-9c0d1227c481-metrics-certs\") pod \"network-metrics-daemon-qn67p\" (UID: \"5458a9d3-baee-4c82-b5a5-9c0d1227c481\") " pod="openshift-multus/network-metrics-daemon-qn67p" Jun 10 13:19:05.306972 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:05.306891 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-r5jns\"" Jun 10 13:19:05.314582 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:05.314557 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qn67p" Jun 10 13:19:05.440329 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:05.440302 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qn67p"] Jun 10 13:19:05.443045 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:19:05.443020 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5458a9d3_baee_4c82_b5a5_9c0d1227c481.slice/crio-7b2f6a30db8dc4b1b4fedbe986204c11c70f219d0f4c5f2ebb44e33a7ccd25f2 WatchSource:0}: Error finding container 7b2f6a30db8dc4b1b4fedbe986204c11c70f219d0f4c5f2ebb44e33a7ccd25f2: Status 404 returned error can't find the container with id 7b2f6a30db8dc4b1b4fedbe986204c11c70f219d0f4c5f2ebb44e33a7ccd25f2 Jun 10 13:19:05.739219 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:05.739187 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6577858866-9fbjb"] Jun 10 13:19:05.813723 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:05.813694 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-h9h9q"] Jun 10 13:19:05.816466 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:05.816446 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-h9h9q" Jun 10 13:19:05.819550 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:05.819529 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 10 13:19:05.819787 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:05.819767 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-4d7rk\"" Jun 10 13:19:05.819919 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:05.819768 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 10 13:19:05.828006 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:05.827984 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-h9h9q"] Jun 10 13:19:05.880641 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:05.880613 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:19:05.911623 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:05.911597 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/589791b7-a193-4099-919b-5a8222a1e0ba-data-volume\") pod \"insights-runtime-extractor-h9h9q\" (UID: \"589791b7-a193-4099-919b-5a8222a1e0ba\") " pod="openshift-insights/insights-runtime-extractor-h9h9q" Jun 10 13:19:05.911726 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:05.911672 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/589791b7-a193-4099-919b-5a8222a1e0ba-crio-socket\") pod \"insights-runtime-extractor-h9h9q\" (UID: \"589791b7-a193-4099-919b-5a8222a1e0ba\") " pod="openshift-insights/insights-runtime-extractor-h9h9q" Jun 10 13:19:05.911726 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:05.911695 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/589791b7-a193-4099-919b-5a8222a1e0ba-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h9h9q\" (UID: \"589791b7-a193-4099-919b-5a8222a1e0ba\") " pod="openshift-insights/insights-runtime-extractor-h9h9q" Jun 10 13:19:05.911726 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:05.911711 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8fjg\" (UniqueName: \"kubernetes.io/projected/589791b7-a193-4099-919b-5a8222a1e0ba-kube-api-access-v8fjg\") pod \"insights-runtime-extractor-h9h9q\" (UID: \"589791b7-a193-4099-919b-5a8222a1e0ba\") " pod="openshift-insights/insights-runtime-extractor-h9h9q" Jun 10 13:19:05.911883 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:05.911737 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/589791b7-a193-4099-919b-5a8222a1e0ba-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h9h9q\" (UID: \"589791b7-a193-4099-919b-5a8222a1e0ba\") " pod="openshift-insights/insights-runtime-extractor-h9h9q" Jun 10 13:19:05.984659 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:05.984632 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qn67p" event={"ID":"5458a9d3-baee-4c82-b5a5-9c0d1227c481","Type":"ContainerStarted","Data":"7b2f6a30db8dc4b1b4fedbe986204c11c70f219d0f4c5f2ebb44e33a7ccd25f2"} Jun 10 13:19:06.013048 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:06.012970 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/589791b7-a193-4099-919b-5a8222a1e0ba-crio-socket\") pod \"insights-runtime-extractor-h9h9q\" (UID: \"589791b7-a193-4099-919b-5a8222a1e0ba\") " pod="openshift-insights/insights-runtime-extractor-h9h9q" Jun 10 13:19:06.013048 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:06.013009 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/589791b7-a193-4099-919b-5a8222a1e0ba-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h9h9q\" (UID: \"589791b7-a193-4099-919b-5a8222a1e0ba\") " pod="openshift-insights/insights-runtime-extractor-h9h9q" Jun 10 13:19:06.013048 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:06.013026 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8fjg\" (UniqueName: \"kubernetes.io/projected/589791b7-a193-4099-919b-5a8222a1e0ba-kube-api-access-v8fjg\") pod \"insights-runtime-extractor-h9h9q\" (UID: \"589791b7-a193-4099-919b-5a8222a1e0ba\") " pod="openshift-insights/insights-runtime-extractor-h9h9q" Jun 10 13:19:06.013548 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:06.013055 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/589791b7-a193-4099-919b-5a8222a1e0ba-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h9h9q\" (UID: \"589791b7-a193-4099-919b-5a8222a1e0ba\") " pod="openshift-insights/insights-runtime-extractor-h9h9q" Jun 10 13:19:06.013548 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:06.013084 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/589791b7-a193-4099-919b-5a8222a1e0ba-data-volume\") pod \"insights-runtime-extractor-h9h9q\" (UID: \"589791b7-a193-4099-919b-5a8222a1e0ba\") " pod="openshift-insights/insights-runtime-extractor-h9h9q" Jun 10 13:19:06.013548 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:06.013103 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/589791b7-a193-4099-919b-5a8222a1e0ba-crio-socket\") pod \"insights-runtime-extractor-h9h9q\" (UID: \"589791b7-a193-4099-919b-5a8222a1e0ba\") " pod="openshift-insights/insights-runtime-extractor-h9h9q" Jun 10 13:19:06.013548 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:06.013425 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/589791b7-a193-4099-919b-5a8222a1e0ba-data-volume\") pod \"insights-runtime-extractor-h9h9q\" (UID: \"589791b7-a193-4099-919b-5a8222a1e0ba\") " pod="openshift-insights/insights-runtime-extractor-h9h9q" Jun 10 13:19:06.013714 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:06.013601 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/589791b7-a193-4099-919b-5a8222a1e0ba-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h9h9q\" (UID: \"589791b7-a193-4099-919b-5a8222a1e0ba\") " pod="openshift-insights/insights-runtime-extractor-h9h9q" Jun 10 13:19:06.015925 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:06.015900 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/589791b7-a193-4099-919b-5a8222a1e0ba-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h9h9q\" (UID: \"589791b7-a193-4099-919b-5a8222a1e0ba\") " pod="openshift-insights/insights-runtime-extractor-h9h9q" Jun 10 13:19:06.022028 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:06.022005 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8fjg\" (UniqueName: \"kubernetes.io/projected/589791b7-a193-4099-919b-5a8222a1e0ba-kube-api-access-v8fjg\") pod \"insights-runtime-extractor-h9h9q\" (UID: \"589791b7-a193-4099-919b-5a8222a1e0ba\") " pod="openshift-insights/insights-runtime-extractor-h9h9q" Jun 10 13:19:06.125810 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:06.125781 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-h9h9q" Jun 10 13:19:06.272771 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:06.272684 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-h9h9q"] Jun 10 13:19:06.275937 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:19:06.275901 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod589791b7_a193_4099_919b_5a8222a1e0ba.slice/crio-5cdda62b49225ec48b0c21880a598e2dd4df1823558a40ba9101f1a60121dedd WatchSource:0}: Error finding container 5cdda62b49225ec48b0c21880a598e2dd4df1823558a40ba9101f1a60121dedd: Status 404 returned error can't find the container with id 5cdda62b49225ec48b0c21880a598e2dd4df1823558a40ba9101f1a60121dedd Jun 10 13:19:06.911383 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:06.911344 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:19:06.990214 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:06.990180 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h9h9q" event={"ID":"589791b7-a193-4099-919b-5a8222a1e0ba","Type":"ContainerStarted","Data":"d3b1af37087f86612ae0aa5a9c174978a612c122c807c67749dfc498c0c0ad2a"} Jun 10 13:19:06.990379 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:06.990272 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h9h9q" event={"ID":"589791b7-a193-4099-919b-5a8222a1e0ba","Type":"ContainerStarted","Data":"5cdda62b49225ec48b0c21880a598e2dd4df1823558a40ba9101f1a60121dedd"} Jun 10 13:19:07.202404 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:07.202383 2567 scope.go:117] "RemoveContainer" containerID="99ed06ce8bc66a72b7e9b18be759d6aece4fa18b0bab70f913e9787b2b63c319" Jun 10 13:19:07.995934 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:07.995897 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qn67p" event={"ID":"5458a9d3-baee-4c82-b5a5-9c0d1227c481","Type":"ContainerStarted","Data":"253399c7fc387f1fd460a7bfa62b41d8fe59e3f5b431161c2d1943ab78f84cc7"} Jun 10 13:19:07.996099 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:07.995961 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qn67p" event={"ID":"5458a9d3-baee-4c82-b5a5-9c0d1227c481","Type":"ContainerStarted","Data":"c76e49d6f46d42def3f524b5bfab43ead50a8e351cad173d2860bab159dfde6c"} Jun 10 13:19:07.997939 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:07.997910 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h9h9q" event={"ID":"589791b7-a193-4099-919b-5a8222a1e0ba","Type":"ContainerStarted","Data":"030062e9a31aed34167fb85dc8705b68a08dd9588bb60d50ae8bca0bee8f9116"} Jun 10 13:19:07.999746 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:07.999724 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-9xwd9_c0921084-7852-4e0a-972a-7366b89c7736/console-operator/1.log" Jun 10 13:19:07.999894 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:07.999791 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-9xwd9" event={"ID":"c0921084-7852-4e0a-972a-7366b89c7736","Type":"ContainerStarted","Data":"66945c28fc74e7718e3a9c3d6c740fc3bc74402fa5a8c442cbcf6b92ff9303e2"} Jun 10 13:19:08.000084 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:08.000060 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-9xwd9" Jun 10 13:19:08.013358 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:08.013305 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-qn67p" podStartSLOduration=253.33460158 podStartE2EDuration="4m15.013288209s" totalImagesPullingTime="1.678686629s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:14:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:19:08.011038501 +0000 UTC m=+255.276289098" watchObservedRunningTime="2026-06-10 13:19:08.013288209 +0000 UTC m=+255.278538808" Jun 10 13:19:08.039898 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:08.039867 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-668fdbf85c-9xwd9" Jun 10 13:19:08.116701 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:08.116610 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:19:08.178365 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:08.178262 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:19:08.225857 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:08.225804 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6657875f97-cgclb"] Jun 10 13:19:08.229283 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:08.229261 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-cgclb" Jun 10 13:19:08.232025 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:08.231908 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 10 13:19:08.232157 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:08.232030 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 10 13:19:08.232276 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:08.232255 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-llc48\"" Jun 10 13:19:08.239417 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:08.239390 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-cgclb"] Jun 10 13:19:08.255483 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:08.255400 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:19:08.334624 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:08.334586 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zw2j5\" (UniqueName: \"kubernetes.io/projected/4c7bab36-48ac-4a20-b147-80ca0165b212-kube-api-access-zw2j5\") pod \"downloads-6657875f97-cgclb\" (UID: \"4c7bab36-48ac-4a20-b147-80ca0165b212\") " pod="openshift-console/downloads-6657875f97-cgclb" Jun 10 13:19:08.357330 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:08.357296 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:19:08.435671 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:08.435627 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zw2j5\" (UniqueName: \"kubernetes.io/projected/4c7bab36-48ac-4a20-b147-80ca0165b212-kube-api-access-zw2j5\") pod \"downloads-6657875f97-cgclb\" (UID: \"4c7bab36-48ac-4a20-b147-80ca0165b212\") " pod="openshift-console/downloads-6657875f97-cgclb" Jun 10 13:19:08.447248 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:08.447216 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zw2j5\" (UniqueName: \"kubernetes.io/projected/4c7bab36-48ac-4a20-b147-80ca0165b212-kube-api-access-zw2j5\") pod \"downloads-6657875f97-cgclb\" (UID: \"4c7bab36-48ac-4a20-b147-80ca0165b212\") " pod="openshift-console/downloads-6657875f97-cgclb" Jun 10 13:19:08.527453 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:08.527352 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:19:08.540564 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:08.540529 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-cgclb" Jun 10 13:19:08.693049 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:08.693020 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-cgclb"] Jun 10 13:19:08.697043 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:19:08.697020 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c7bab36_48ac_4a20_b147_80ca0165b212.slice/crio-32e7546c6e0a74318e6b44e61022794255499c7f7523578da73f5f39ee2a5ccc WatchSource:0}: Error finding container 32e7546c6e0a74318e6b44e61022794255499c7f7523578da73f5f39ee2a5ccc: Status 404 returned error can't find the container with id 32e7546c6e0a74318e6b44e61022794255499c7f7523578da73f5f39ee2a5ccc Jun 10 13:19:08.905218 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:08.905189 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:19:08.967334 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:08.967303 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:19:09.006159 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:09.006129 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h9h9q" event={"ID":"589791b7-a193-4099-919b-5a8222a1e0ba","Type":"ContainerStarted","Data":"556023034fb29198873c8e5c400dfd2f17943c08af1950df3952eefc1662a394"} Jun 10 13:19:09.007245 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:09.007218 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-cgclb" event={"ID":"4c7bab36-48ac-4a20-b147-80ca0165b212","Type":"ContainerStarted","Data":"32e7546c6e0a74318e6b44e61022794255499c7f7523578da73f5f39ee2a5ccc"} Jun 10 13:19:09.329296 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:09.329215 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:19:09.437854 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:09.437811 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:19:09.578887 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:09.578829 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:19:09.648902 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:09.648867 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:19:09.752143 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:09.752101 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:19:09.854217 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:09.854180 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:19:09.936654 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:09.936568 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:19:10.131029 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:10.130996 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:19:10.235282 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:10.235195 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:19:11.405650 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:11.405616 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:19:12.282629 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:12.282594 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:19:12.337517 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:12.337475 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:19:13.580776 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:13.580717 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:19:13.756494 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:13.756436 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:19:13.818028 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:13.817599 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-h9h9q" podStartSLOduration=6.596179891 podStartE2EDuration="8.8175772s" totalImagesPullingTime="2.221397309s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 13:19:05 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:19:09.024651112 +0000 UTC m=+256.289901721" watchObservedRunningTime="2026-06-10 13:19:13.8175772 +0000 UTC m=+261.082827800" Jun 10 13:19:13.819070 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:13.819013 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-7bmb7"] Jun 10 13:19:13.822424 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:13.822376 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-7bmb7" Jun 10 13:19:13.825179 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:13.825149 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 10 13:19:13.825390 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:13.825375 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 10 13:19:13.825477 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:13.825464 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-687qz\"" Jun 10 13:19:13.825592 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:13.825577 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 10 13:19:13.826308 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:13.826293 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 10 13:19:13.826834 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:13.826426 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 10 13:19:13.834044 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:13.833981 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-7bmb7"] Jun 10 13:19:13.849335 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:13.849308 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-9vsj4"] Jun 10 13:19:13.852814 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:13.852797 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9vsj4" Jun 10 13:19:13.855492 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:13.855456 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 10 13:19:13.855601 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:13.855529 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 10 13:19:13.855601 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:13.855548 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-wgh8m\"" Jun 10 13:19:13.855793 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:13.855769 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 10 13:19:13.863947 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:13.863925 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:19:13.955524 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:13.955492 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:19:13.983442 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:13.983413 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8a160a64-5bda-47b2-bf35-212c7f14af15-node-exporter-textfile\") pod \"node-exporter-9vsj4\" (UID: \"8a160a64-5bda-47b2-bf35-212c7f14af15\") " pod="openshift-monitoring/node-exporter-9vsj4" Jun 10 13:19:13.983593 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:13.983454 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8a160a64-5bda-47b2-bf35-212c7f14af15-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9vsj4\" (UID: \"8a160a64-5bda-47b2-bf35-212c7f14af15\") " pod="openshift-monitoring/node-exporter-9vsj4" Jun 10 13:19:13.983593 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:13.983479 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8a160a64-5bda-47b2-bf35-212c7f14af15-node-exporter-accelerators-collector-config\") pod \"node-exporter-9vsj4\" (UID: \"8a160a64-5bda-47b2-bf35-212c7f14af15\") " pod="openshift-monitoring/node-exporter-9vsj4" Jun 10 13:19:13.983593 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:13.983533 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cbb82431-5edc-4098-ad62-3171858a62c8-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-7bmb7\" (UID: \"cbb82431-5edc-4098-ad62-3171858a62c8\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-7bmb7" Jun 10 13:19:13.983593 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:13.983575 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8a160a64-5bda-47b2-bf35-212c7f14af15-sys\") pod \"node-exporter-9vsj4\" (UID: \"8a160a64-5bda-47b2-bf35-212c7f14af15\") " pod="openshift-monitoring/node-exporter-9vsj4" Jun 10 13:19:13.983805 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:13.983595 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vn98\" (UniqueName: \"kubernetes.io/projected/8a160a64-5bda-47b2-bf35-212c7f14af15-kube-api-access-6vn98\") pod \"node-exporter-9vsj4\" (UID: \"8a160a64-5bda-47b2-bf35-212c7f14af15\") " pod="openshift-monitoring/node-exporter-9vsj4" Jun 10 13:19:13.983805 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:13.983629 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8a160a64-5bda-47b2-bf35-212c7f14af15-node-exporter-tls\") pod \"node-exporter-9vsj4\" (UID: \"8a160a64-5bda-47b2-bf35-212c7f14af15\") " pod="openshift-monitoring/node-exporter-9vsj4" Jun 10 13:19:13.983805 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:13.983699 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wccrg\" (UniqueName: \"kubernetes.io/projected/cbb82431-5edc-4098-ad62-3171858a62c8-kube-api-access-wccrg\") pod \"openshift-state-metrics-65f78d5c66-7bmb7\" (UID: \"cbb82431-5edc-4098-ad62-3171858a62c8\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-7bmb7" Jun 10 13:19:13.983805 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:13.983775 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8a160a64-5bda-47b2-bf35-212c7f14af15-root\") pod \"node-exporter-9vsj4\" (UID: \"8a160a64-5bda-47b2-bf35-212c7f14af15\") " pod="openshift-monitoring/node-exporter-9vsj4" Jun 10 13:19:13.984014 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:13.983808 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cbb82431-5edc-4098-ad62-3171858a62c8-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-7bmb7\" (UID: \"cbb82431-5edc-4098-ad62-3171858a62c8\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-7bmb7" Jun 10 13:19:13.984014 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:13.983919 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cbb82431-5edc-4098-ad62-3171858a62c8-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-7bmb7\" (UID: \"cbb82431-5edc-4098-ad62-3171858a62c8\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-7bmb7" Jun 10 13:19:13.984014 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:13.983949 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8a160a64-5bda-47b2-bf35-212c7f14af15-node-exporter-wtmp\") pod \"node-exporter-9vsj4\" (UID: \"8a160a64-5bda-47b2-bf35-212c7f14af15\") " pod="openshift-monitoring/node-exporter-9vsj4" Jun 10 13:19:13.984014 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:13.983977 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8a160a64-5bda-47b2-bf35-212c7f14af15-metrics-client-ca\") pod \"node-exporter-9vsj4\" (UID: \"8a160a64-5bda-47b2-bf35-212c7f14af15\") " pod="openshift-monitoring/node-exporter-9vsj4" Jun 10 13:19:14.085101 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:14.084889 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cbb82431-5edc-4098-ad62-3171858a62c8-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-7bmb7\" (UID: \"cbb82431-5edc-4098-ad62-3171858a62c8\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-7bmb7" Jun 10 13:19:14.085101 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:14.084959 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8a160a64-5bda-47b2-bf35-212c7f14af15-sys\") pod \"node-exporter-9vsj4\" (UID: \"8a160a64-5bda-47b2-bf35-212c7f14af15\") " pod="openshift-monitoring/node-exporter-9vsj4" Jun 10 13:19:14.085101 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:14.084984 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vn98\" (UniqueName: \"kubernetes.io/projected/8a160a64-5bda-47b2-bf35-212c7f14af15-kube-api-access-6vn98\") pod \"node-exporter-9vsj4\" (UID: \"8a160a64-5bda-47b2-bf35-212c7f14af15\") " pod="openshift-monitoring/node-exporter-9vsj4" Jun 10 13:19:14.085101 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:14.085014 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8a160a64-5bda-47b2-bf35-212c7f14af15-node-exporter-tls\") pod \"node-exporter-9vsj4\" (UID: \"8a160a64-5bda-47b2-bf35-212c7f14af15\") " pod="openshift-monitoring/node-exporter-9vsj4" Jun 10 13:19:14.085101 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:19:14.085032 2567 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jun 10 13:19:14.085101 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:14.085042 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wccrg\" (UniqueName: \"kubernetes.io/projected/cbb82431-5edc-4098-ad62-3171858a62c8-kube-api-access-wccrg\") pod \"openshift-state-metrics-65f78d5c66-7bmb7\" (UID: \"cbb82431-5edc-4098-ad62-3171858a62c8\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-7bmb7" Jun 10 13:19:14.085101 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:14.085069 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8a160a64-5bda-47b2-bf35-212c7f14af15-root\") pod \"node-exporter-9vsj4\" (UID: \"8a160a64-5bda-47b2-bf35-212c7f14af15\") " pod="openshift-monitoring/node-exporter-9vsj4" Jun 10 13:19:14.085101 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:14.085071 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8a160a64-5bda-47b2-bf35-212c7f14af15-sys\") pod \"node-exporter-9vsj4\" (UID: \"8a160a64-5bda-47b2-bf35-212c7f14af15\") " pod="openshift-monitoring/node-exporter-9vsj4" Jun 10 13:19:14.085101 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:19:14.085104 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbb82431-5edc-4098-ad62-3171858a62c8-openshift-state-metrics-tls podName:cbb82431-5edc-4098-ad62-3171858a62c8 nodeName:}" failed. No retries permitted until 2026-06-10 13:19:14.585083743 +0000 UTC m=+261.850334335 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/cbb82431-5edc-4098-ad62-3171858a62c8-openshift-state-metrics-tls") pod "openshift-state-metrics-65f78d5c66-7bmb7" (UID: "cbb82431-5edc-4098-ad62-3171858a62c8") : secret "openshift-state-metrics-tls" not found Jun 10 13:19:14.085671 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:14.085118 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8a160a64-5bda-47b2-bf35-212c7f14af15-root\") pod \"node-exporter-9vsj4\" (UID: \"8a160a64-5bda-47b2-bf35-212c7f14af15\") " pod="openshift-monitoring/node-exporter-9vsj4" Jun 10 13:19:14.085671 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:14.085127 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cbb82431-5edc-4098-ad62-3171858a62c8-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-7bmb7\" (UID: \"cbb82431-5edc-4098-ad62-3171858a62c8\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-7bmb7" Jun 10 13:19:14.085671 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:19:14.085171 2567 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 10 13:19:14.085671 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:14.085189 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cbb82431-5edc-4098-ad62-3171858a62c8-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-7bmb7\" (UID: \"cbb82431-5edc-4098-ad62-3171858a62c8\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-7bmb7" Jun 10 13:19:14.085671 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:19:14.085215 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a160a64-5bda-47b2-bf35-212c7f14af15-node-exporter-tls podName:8a160a64-5bda-47b2-bf35-212c7f14af15 nodeName:}" failed. No retries permitted until 2026-06-10 13:19:14.585201309 +0000 UTC m=+261.850451897 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/8a160a64-5bda-47b2-bf35-212c7f14af15-node-exporter-tls") pod "node-exporter-9vsj4" (UID: "8a160a64-5bda-47b2-bf35-212c7f14af15") : secret "node-exporter-tls" not found Jun 10 13:19:14.085671 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:14.085242 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8a160a64-5bda-47b2-bf35-212c7f14af15-node-exporter-wtmp\") pod \"node-exporter-9vsj4\" (UID: \"8a160a64-5bda-47b2-bf35-212c7f14af15\") " pod="openshift-monitoring/node-exporter-9vsj4" Jun 10 13:19:14.085671 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:14.085299 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8a160a64-5bda-47b2-bf35-212c7f14af15-metrics-client-ca\") pod \"node-exporter-9vsj4\" (UID: \"8a160a64-5bda-47b2-bf35-212c7f14af15\") " pod="openshift-monitoring/node-exporter-9vsj4" Jun 10 13:19:14.085671 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:14.085330 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8a160a64-5bda-47b2-bf35-212c7f14af15-node-exporter-textfile\") pod \"node-exporter-9vsj4\" (UID: \"8a160a64-5bda-47b2-bf35-212c7f14af15\") " pod="openshift-monitoring/node-exporter-9vsj4" Jun 10 13:19:14.085671 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:14.085368 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8a160a64-5bda-47b2-bf35-212c7f14af15-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9vsj4\" (UID: \"8a160a64-5bda-47b2-bf35-212c7f14af15\") " pod="openshift-monitoring/node-exporter-9vsj4" Jun 10 13:19:14.085671 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:14.085395 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8a160a64-5bda-47b2-bf35-212c7f14af15-node-exporter-accelerators-collector-config\") pod \"node-exporter-9vsj4\" (UID: \"8a160a64-5bda-47b2-bf35-212c7f14af15\") " pod="openshift-monitoring/node-exporter-9vsj4" Jun 10 13:19:14.086168 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:14.085782 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8a160a64-5bda-47b2-bf35-212c7f14af15-node-exporter-wtmp\") pod \"node-exporter-9vsj4\" (UID: \"8a160a64-5bda-47b2-bf35-212c7f14af15\") " pod="openshift-monitoring/node-exporter-9vsj4" Jun 10 13:19:14.086168 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:14.085899 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cbb82431-5edc-4098-ad62-3171858a62c8-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-7bmb7\" (UID: \"cbb82431-5edc-4098-ad62-3171858a62c8\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-7bmb7" Jun 10 13:19:14.086168 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:14.086001 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8a160a64-5bda-47b2-bf35-212c7f14af15-node-exporter-accelerators-collector-config\") pod \"node-exporter-9vsj4\" (UID: \"8a160a64-5bda-47b2-bf35-212c7f14af15\") " pod="openshift-monitoring/node-exporter-9vsj4" Jun 10 13:19:14.086168 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:14.086019 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8a160a64-5bda-47b2-bf35-212c7f14af15-node-exporter-textfile\") pod \"node-exporter-9vsj4\" (UID: \"8a160a64-5bda-47b2-bf35-212c7f14af15\") " pod="openshift-monitoring/node-exporter-9vsj4" Jun 10 13:19:14.086446 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:14.086420 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8a160a64-5bda-47b2-bf35-212c7f14af15-metrics-client-ca\") pod \"node-exporter-9vsj4\" (UID: \"8a160a64-5bda-47b2-bf35-212c7f14af15\") " pod="openshift-monitoring/node-exporter-9vsj4" Jun 10 13:19:14.088548 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:14.088520 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cbb82431-5edc-4098-ad62-3171858a62c8-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-7bmb7\" (UID: \"cbb82431-5edc-4098-ad62-3171858a62c8\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-7bmb7" Jun 10 13:19:14.088689 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:14.088646 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8a160a64-5bda-47b2-bf35-212c7f14af15-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9vsj4\" (UID: \"8a160a64-5bda-47b2-bf35-212c7f14af15\") " pod="openshift-monitoring/node-exporter-9vsj4" Jun 10 13:19:14.090952 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:14.090924 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:19:14.093719 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:14.093695 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vn98\" (UniqueName: \"kubernetes.io/projected/8a160a64-5bda-47b2-bf35-212c7f14af15-kube-api-access-6vn98\") pod \"node-exporter-9vsj4\" (UID: \"8a160a64-5bda-47b2-bf35-212c7f14af15\") " pod="openshift-monitoring/node-exporter-9vsj4" Jun 10 13:19:14.095194 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:14.095172 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wccrg\" (UniqueName: \"kubernetes.io/projected/cbb82431-5edc-4098-ad62-3171858a62c8-kube-api-access-wccrg\") pod \"openshift-state-metrics-65f78d5c66-7bmb7\" (UID: \"cbb82431-5edc-4098-ad62-3171858a62c8\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-7bmb7" Jun 10 13:19:14.190489 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:14.190458 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:19:14.337285 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:14.337182 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:19:14.436596 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:14.436557 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:19:14.590595 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:14.590520 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cbb82431-5edc-4098-ad62-3171858a62c8-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-7bmb7\" (UID: \"cbb82431-5edc-4098-ad62-3171858a62c8\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-7bmb7" Jun 10 13:19:14.590595 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:14.590564 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8a160a64-5bda-47b2-bf35-212c7f14af15-node-exporter-tls\") pod \"node-exporter-9vsj4\" (UID: \"8a160a64-5bda-47b2-bf35-212c7f14af15\") " pod="openshift-monitoring/node-exporter-9vsj4" Jun 10 13:19:14.592874 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:14.592832 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8a160a64-5bda-47b2-bf35-212c7f14af15-node-exporter-tls\") pod \"node-exporter-9vsj4\" (UID: \"8a160a64-5bda-47b2-bf35-212c7f14af15\") " pod="openshift-monitoring/node-exporter-9vsj4" Jun 10 13:19:14.592988 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:14.592889 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cbb82431-5edc-4098-ad62-3171858a62c8-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-7bmb7\" (UID: \"cbb82431-5edc-4098-ad62-3171858a62c8\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-7bmb7" Jun 10 13:19:14.734681 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:14.734652 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-7bmb7" Jun 10 13:19:14.764235 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:14.764156 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9vsj4" Jun 10 13:19:14.778963 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:19:14.778919 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a160a64_5bda_47b2_bf35_212c7f14af15.slice/crio-c08c13feb5dfda20972d1132052532e565cd360dbc5f0568e04a0bff6c508a60 WatchSource:0}: Error finding container c08c13feb5dfda20972d1132052532e565cd360dbc5f0568e04a0bff6c508a60: Status 404 returned error can't find the container with id c08c13feb5dfda20972d1132052532e565cd360dbc5f0568e04a0bff6c508a60 Jun 10 13:19:14.800235 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:14.800147 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:19:14.877210 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:14.877134 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:19:14.895833 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:14.895805 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-7bmb7"] Jun 10 13:19:14.898931 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:19:14.898895 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbb82431_5edc_4098_ad62_3171858a62c8.slice/crio-994a21f9a0cacdcffc26e9c9fb30a006b06be0a602a7f56b2525766d5fe9e954 WatchSource:0}: Error finding container 994a21f9a0cacdcffc26e9c9fb30a006b06be0a602a7f56b2525766d5fe9e954: Status 404 returned error can't find the container with id 994a21f9a0cacdcffc26e9c9fb30a006b06be0a602a7f56b2525766d5fe9e954 Jun 10 13:19:15.032382 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:15.032352 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9vsj4" event={"ID":"8a160a64-5bda-47b2-bf35-212c7f14af15","Type":"ContainerStarted","Data":"c08c13feb5dfda20972d1132052532e565cd360dbc5f0568e04a0bff6c508a60"} Jun 10 13:19:15.034386 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:15.034362 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-7bmb7" event={"ID":"cbb82431-5edc-4098-ad62-3171858a62c8","Type":"ContainerStarted","Data":"152daee8dc8173145b6bf82a60cd6eb956d77de36683e09b64b2ab788c4b418f"} Jun 10 13:19:15.034483 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:15.034416 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-7bmb7" event={"ID":"cbb82431-5edc-4098-ad62-3171858a62c8","Type":"ContainerStarted","Data":"8d7370707ba8ddfe3cc7afe5180992eaff45560cac9c5fce6e97795e4b97b55b"} Jun 10 13:19:15.034483 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:15.034440 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-7bmb7" event={"ID":"cbb82431-5edc-4098-ad62-3171858a62c8","Type":"ContainerStarted","Data":"994a21f9a0cacdcffc26e9c9fb30a006b06be0a602a7f56b2525766d5fe9e954"} Jun 10 13:19:15.135970 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:15.135823 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:19:15.746461 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:15.746424 2567 patch_prober.go:28] interesting pod/image-registry-6577858866-9fbjb container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 10 13:19:15.746874 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:15.746488 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6577858866-9fbjb" podUID="c0af5812-3297-4e07-abdb-f54190eed2b4" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 13:19:15.825340 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:15.825306 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7dc786cb68-jvwpz"] Jun 10 13:19:15.828973 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:15.828950 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7dc786cb68-jvwpz" Jun 10 13:19:15.832248 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:15.832223 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-fveb0u6ub6ni4\"" Jun 10 13:19:15.832369 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:15.832294 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 10 13:19:15.832369 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:15.832347 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 10 13:19:15.832492 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:15.832228 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 10 13:19:15.832492 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:15.832221 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 10 13:19:15.832492 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:15.832354 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-dhwmh\"" Jun 10 13:19:15.833027 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:15.833005 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 10 13:19:15.843565 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:15.843542 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7dc786cb68-jvwpz"] Jun 10 13:19:16.002343 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:16.002274 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/92d022a2-0fda-4abe-880b-2c62ec9d4a34-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7dc786cb68-jvwpz\" (UID: \"92d022a2-0fda-4abe-880b-2c62ec9d4a34\") " pod="openshift-monitoring/thanos-querier-7dc786cb68-jvwpz" Jun 10 13:19:16.002343 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:16.002321 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/92d022a2-0fda-4abe-880b-2c62ec9d4a34-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7dc786cb68-jvwpz\" (UID: \"92d022a2-0fda-4abe-880b-2c62ec9d4a34\") " pod="openshift-monitoring/thanos-querier-7dc786cb68-jvwpz" Jun 10 13:19:16.002343 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:16.002345 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92d022a2-0fda-4abe-880b-2c62ec9d4a34-metrics-client-ca\") pod \"thanos-querier-7dc786cb68-jvwpz\" (UID: \"92d022a2-0fda-4abe-880b-2c62ec9d4a34\") " pod="openshift-monitoring/thanos-querier-7dc786cb68-jvwpz" Jun 10 13:19:16.002610 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:16.002364 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/92d022a2-0fda-4abe-880b-2c62ec9d4a34-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7dc786cb68-jvwpz\" (UID: \"92d022a2-0fda-4abe-880b-2c62ec9d4a34\") " pod="openshift-monitoring/thanos-querier-7dc786cb68-jvwpz" Jun 10 13:19:16.002610 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:16.002388 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/92d022a2-0fda-4abe-880b-2c62ec9d4a34-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7dc786cb68-jvwpz\" (UID: \"92d022a2-0fda-4abe-880b-2c62ec9d4a34\") " pod="openshift-monitoring/thanos-querier-7dc786cb68-jvwpz" Jun 10 13:19:16.002610 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:16.002409 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/92d022a2-0fda-4abe-880b-2c62ec9d4a34-secret-thanos-querier-tls\") pod \"thanos-querier-7dc786cb68-jvwpz\" (UID: \"92d022a2-0fda-4abe-880b-2c62ec9d4a34\") " pod="openshift-monitoring/thanos-querier-7dc786cb68-jvwpz" Jun 10 13:19:16.002610 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:16.002427 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/92d022a2-0fda-4abe-880b-2c62ec9d4a34-secret-grpc-tls\") pod \"thanos-querier-7dc786cb68-jvwpz\" (UID: \"92d022a2-0fda-4abe-880b-2c62ec9d4a34\") " pod="openshift-monitoring/thanos-querier-7dc786cb68-jvwpz" Jun 10 13:19:16.002610 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:16.002481 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4bdb\" (UniqueName: \"kubernetes.io/projected/92d022a2-0fda-4abe-880b-2c62ec9d4a34-kube-api-access-x4bdb\") pod \"thanos-querier-7dc786cb68-jvwpz\" (UID: \"92d022a2-0fda-4abe-880b-2c62ec9d4a34\") " pod="openshift-monitoring/thanos-querier-7dc786cb68-jvwpz" Jun 10 13:19:16.039475 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:16.039442 2567 generic.go:356] "Generic (PLEG): container finished" podID="8a160a64-5bda-47b2-bf35-212c7f14af15" containerID="2408e9525af51ff29b7037c8c6e0e201b4617c5b16dfee787e02228bda4f573e" exitCode=0 Jun 10 13:19:16.039634 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:16.039530 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9vsj4" event={"ID":"8a160a64-5bda-47b2-bf35-212c7f14af15","Type":"ContainerDied","Data":"2408e9525af51ff29b7037c8c6e0e201b4617c5b16dfee787e02228bda4f573e"} Jun 10 13:19:16.103515 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:16.103111 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/92d022a2-0fda-4abe-880b-2c62ec9d4a34-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7dc786cb68-jvwpz\" (UID: \"92d022a2-0fda-4abe-880b-2c62ec9d4a34\") " pod="openshift-monitoring/thanos-querier-7dc786cb68-jvwpz" Jun 10 13:19:16.103515 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:16.103172 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/92d022a2-0fda-4abe-880b-2c62ec9d4a34-secret-thanos-querier-tls\") pod \"thanos-querier-7dc786cb68-jvwpz\" (UID: \"92d022a2-0fda-4abe-880b-2c62ec9d4a34\") " pod="openshift-monitoring/thanos-querier-7dc786cb68-jvwpz" Jun 10 13:19:16.103515 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:16.103200 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/92d022a2-0fda-4abe-880b-2c62ec9d4a34-secret-grpc-tls\") pod \"thanos-querier-7dc786cb68-jvwpz\" (UID: \"92d022a2-0fda-4abe-880b-2c62ec9d4a34\") " pod="openshift-monitoring/thanos-querier-7dc786cb68-jvwpz" Jun 10 13:19:16.103515 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:16.103229 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4bdb\" (UniqueName: \"kubernetes.io/projected/92d022a2-0fda-4abe-880b-2c62ec9d4a34-kube-api-access-x4bdb\") pod \"thanos-querier-7dc786cb68-jvwpz\" (UID: \"92d022a2-0fda-4abe-880b-2c62ec9d4a34\") " pod="openshift-monitoring/thanos-querier-7dc786cb68-jvwpz" Jun 10 13:19:16.103515 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:16.103305 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/92d022a2-0fda-4abe-880b-2c62ec9d4a34-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7dc786cb68-jvwpz\" (UID: \"92d022a2-0fda-4abe-880b-2c62ec9d4a34\") " pod="openshift-monitoring/thanos-querier-7dc786cb68-jvwpz" Jun 10 13:19:16.103515 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:16.103355 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/92d022a2-0fda-4abe-880b-2c62ec9d4a34-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7dc786cb68-jvwpz\" (UID: \"92d022a2-0fda-4abe-880b-2c62ec9d4a34\") " pod="openshift-monitoring/thanos-querier-7dc786cb68-jvwpz" Jun 10 13:19:16.103515 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:16.103398 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92d022a2-0fda-4abe-880b-2c62ec9d4a34-metrics-client-ca\") pod \"thanos-querier-7dc786cb68-jvwpz\" (UID: \"92d022a2-0fda-4abe-880b-2c62ec9d4a34\") " pod="openshift-monitoring/thanos-querier-7dc786cb68-jvwpz" Jun 10 13:19:16.103515 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:16.103423 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/92d022a2-0fda-4abe-880b-2c62ec9d4a34-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7dc786cb68-jvwpz\" (UID: \"92d022a2-0fda-4abe-880b-2c62ec9d4a34\") " pod="openshift-monitoring/thanos-querier-7dc786cb68-jvwpz" Jun 10 13:19:16.104381 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:16.104354 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92d022a2-0fda-4abe-880b-2c62ec9d4a34-metrics-client-ca\") pod \"thanos-querier-7dc786cb68-jvwpz\" (UID: \"92d022a2-0fda-4abe-880b-2c62ec9d4a34\") " pod="openshift-monitoring/thanos-querier-7dc786cb68-jvwpz" Jun 10 13:19:16.107274 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:16.107247 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/92d022a2-0fda-4abe-880b-2c62ec9d4a34-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7dc786cb68-jvwpz\" (UID: \"92d022a2-0fda-4abe-880b-2c62ec9d4a34\") " pod="openshift-monitoring/thanos-querier-7dc786cb68-jvwpz" Jun 10 13:19:16.107372 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:16.107281 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/92d022a2-0fda-4abe-880b-2c62ec9d4a34-secret-thanos-querier-tls\") pod \"thanos-querier-7dc786cb68-jvwpz\" (UID: \"92d022a2-0fda-4abe-880b-2c62ec9d4a34\") " pod="openshift-monitoring/thanos-querier-7dc786cb68-jvwpz" Jun 10 13:19:16.107414 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:16.107389 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/92d022a2-0fda-4abe-880b-2c62ec9d4a34-secret-grpc-tls\") pod \"thanos-querier-7dc786cb68-jvwpz\" (UID: \"92d022a2-0fda-4abe-880b-2c62ec9d4a34\") " pod="openshift-monitoring/thanos-querier-7dc786cb68-jvwpz" Jun 10 13:19:16.107638 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:16.107616 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/92d022a2-0fda-4abe-880b-2c62ec9d4a34-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7dc786cb68-jvwpz\" (UID: \"92d022a2-0fda-4abe-880b-2c62ec9d4a34\") " pod="openshift-monitoring/thanos-querier-7dc786cb68-jvwpz" Jun 10 13:19:16.108541 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:16.108387 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/92d022a2-0fda-4abe-880b-2c62ec9d4a34-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7dc786cb68-jvwpz\" (UID: \"92d022a2-0fda-4abe-880b-2c62ec9d4a34\") " pod="openshift-monitoring/thanos-querier-7dc786cb68-jvwpz" Jun 10 13:19:16.108904 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:16.108879 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/92d022a2-0fda-4abe-880b-2c62ec9d4a34-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7dc786cb68-jvwpz\" (UID: \"92d022a2-0fda-4abe-880b-2c62ec9d4a34\") " pod="openshift-monitoring/thanos-querier-7dc786cb68-jvwpz" Jun 10 13:19:16.111993 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:16.111952 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4bdb\" (UniqueName: \"kubernetes.io/projected/92d022a2-0fda-4abe-880b-2c62ec9d4a34-kube-api-access-x4bdb\") pod \"thanos-querier-7dc786cb68-jvwpz\" (UID: \"92d022a2-0fda-4abe-880b-2c62ec9d4a34\") " pod="openshift-monitoring/thanos-querier-7dc786cb68-jvwpz" Jun 10 13:19:16.149942 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:16.149880 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7dc786cb68-jvwpz" Jun 10 13:19:16.404081 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:16.403762 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7dc786cb68-jvwpz"] Jun 10 13:19:16.407869 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:19:16.407810 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92d022a2_0fda_4abe_880b_2c62ec9d4a34.slice/crio-bc34418ff071a7629d6fd6882850b19b45215e3d0888015058ac6693b449d851 WatchSource:0}: Error finding container bc34418ff071a7629d6fd6882850b19b45215e3d0888015058ac6693b449d851: Status 404 returned error can't find the container with id bc34418ff071a7629d6fd6882850b19b45215e3d0888015058ac6693b449d851 Jun 10 13:19:16.768685 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:16.768650 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:19:16.870128 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:16.870083 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:19:17.026399 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:17.026310 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:19:17.045770 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:17.045739 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9vsj4" event={"ID":"8a160a64-5bda-47b2-bf35-212c7f14af15","Type":"ContainerStarted","Data":"aaf80d4c6a8d6ee235ce1899cdfcb481fa3d38e6108b95ea498200e07c9ab992"} Jun 10 13:19:17.045945 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:17.045802 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9vsj4" event={"ID":"8a160a64-5bda-47b2-bf35-212c7f14af15","Type":"ContainerStarted","Data":"2073954f1e2bd47a39de106fb6ab54edf8d0f09bce095ed38bc5b5af8c6a5a3f"} Jun 10 13:19:17.048157 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:17.048128 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-7bmb7" event={"ID":"cbb82431-5edc-4098-ad62-3171858a62c8","Type":"ContainerStarted","Data":"f23130341f0567e2acc5d5d7f87017b2cce967bfcb946a2b90be6c6b1be0bb17"} Jun 10 13:19:17.049360 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:17.049339 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7dc786cb68-jvwpz" event={"ID":"92d022a2-0fda-4abe-880b-2c62ec9d4a34","Type":"ContainerStarted","Data":"bc34418ff071a7629d6fd6882850b19b45215e3d0888015058ac6693b449d851"} Jun 10 13:19:17.069715 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:17.069672 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-9vsj4" podStartSLOduration=3.145160517 podStartE2EDuration="4.069659585s" totalImagesPullingTime="854.962043ms" totalInitContainerRuntime="69.537025ms" isStatefulPod=true podCreationTimestamp="2026-06-10 13:19:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:19:17.068422904 +0000 UTC m=+264.333673514" watchObservedRunningTime="2026-06-10 13:19:17.069659585 +0000 UTC m=+264.334910182" Jun 10 13:19:17.091934 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:17.091883 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-7bmb7" podStartSLOduration=2.8224757289999998 podStartE2EDuration="4.091864483s" totalImagesPullingTime="1.269388754s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:19:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:19:17.091101464 +0000 UTC m=+264.356352062" watchObservedRunningTime="2026-06-10 13:19:17.091864483 +0000 UTC m=+264.357115078" Jun 10 13:19:17.150091 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:17.150053 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:19:18.163985 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:18.163946 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7d7568c4f4-9rl7r"] Jun 10 13:19:18.167671 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:18.167646 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7d7568c4f4-9rl7r" Jun 10 13:19:18.171609 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:18.171402 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 10 13:19:18.171609 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:18.171500 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 10 13:19:18.171609 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:18.171592 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 10 13:19:18.171951 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:18.171924 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-zvnm2\"" Jun 10 13:19:18.172033 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:18.171970 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-2ji3295f4ks39\"" Jun 10 13:19:18.172115 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:18.171978 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 10 13:19:18.177279 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:18.177252 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7d7568c4f4-9rl7r"] Jun 10 13:19:18.323619 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:18.323577 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c75b9349-95dc-42f7-bab2-fe0cde8c1101-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7d7568c4f4-9rl7r\" (UID: \"c75b9349-95dc-42f7-bab2-fe0cde8c1101\") " pod="openshift-monitoring/metrics-server-7d7568c4f4-9rl7r" Jun 10 13:19:18.323788 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:18.323653 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4nbv\" (UniqueName: \"kubernetes.io/projected/c75b9349-95dc-42f7-bab2-fe0cde8c1101-kube-api-access-v4nbv\") pod \"metrics-server-7d7568c4f4-9rl7r\" (UID: \"c75b9349-95dc-42f7-bab2-fe0cde8c1101\") " pod="openshift-monitoring/metrics-server-7d7568c4f4-9rl7r" Jun 10 13:19:18.323788 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:18.323683 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c75b9349-95dc-42f7-bab2-fe0cde8c1101-secret-metrics-server-client-certs\") pod \"metrics-server-7d7568c4f4-9rl7r\" (UID: \"c75b9349-95dc-42f7-bab2-fe0cde8c1101\") " pod="openshift-monitoring/metrics-server-7d7568c4f4-9rl7r" Jun 10 13:19:18.323788 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:18.323701 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c75b9349-95dc-42f7-bab2-fe0cde8c1101-client-ca-bundle\") pod \"metrics-server-7d7568c4f4-9rl7r\" (UID: \"c75b9349-95dc-42f7-bab2-fe0cde8c1101\") " pod="openshift-monitoring/metrics-server-7d7568c4f4-9rl7r" Jun 10 13:19:18.323788 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:18.323769 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c75b9349-95dc-42f7-bab2-fe0cde8c1101-metrics-server-audit-profiles\") pod \"metrics-server-7d7568c4f4-9rl7r\" (UID: \"c75b9349-95dc-42f7-bab2-fe0cde8c1101\") " pod="openshift-monitoring/metrics-server-7d7568c4f4-9rl7r" Jun 10 13:19:18.324026 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:18.323820 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c75b9349-95dc-42f7-bab2-fe0cde8c1101-secret-metrics-server-tls\") pod \"metrics-server-7d7568c4f4-9rl7r\" (UID: \"c75b9349-95dc-42f7-bab2-fe0cde8c1101\") " pod="openshift-monitoring/metrics-server-7d7568c4f4-9rl7r" Jun 10 13:19:18.324026 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:18.323878 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c75b9349-95dc-42f7-bab2-fe0cde8c1101-audit-log\") pod \"metrics-server-7d7568c4f4-9rl7r\" (UID: \"c75b9349-95dc-42f7-bab2-fe0cde8c1101\") " pod="openshift-monitoring/metrics-server-7d7568c4f4-9rl7r" Jun 10 13:19:18.424895 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:18.424787 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c75b9349-95dc-42f7-bab2-fe0cde8c1101-audit-log\") pod \"metrics-server-7d7568c4f4-9rl7r\" (UID: \"c75b9349-95dc-42f7-bab2-fe0cde8c1101\") " pod="openshift-monitoring/metrics-server-7d7568c4f4-9rl7r" Jun 10 13:19:18.425058 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:18.424893 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c75b9349-95dc-42f7-bab2-fe0cde8c1101-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7d7568c4f4-9rl7r\" (UID: \"c75b9349-95dc-42f7-bab2-fe0cde8c1101\") " pod="openshift-monitoring/metrics-server-7d7568c4f4-9rl7r" Jun 10 13:19:18.425058 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:18.424962 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4nbv\" (UniqueName: \"kubernetes.io/projected/c75b9349-95dc-42f7-bab2-fe0cde8c1101-kube-api-access-v4nbv\") pod \"metrics-server-7d7568c4f4-9rl7r\" (UID: \"c75b9349-95dc-42f7-bab2-fe0cde8c1101\") " pod="openshift-monitoring/metrics-server-7d7568c4f4-9rl7r" Jun 10 13:19:18.425058 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:18.425002 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c75b9349-95dc-42f7-bab2-fe0cde8c1101-secret-metrics-server-client-certs\") pod \"metrics-server-7d7568c4f4-9rl7r\" (UID: \"c75b9349-95dc-42f7-bab2-fe0cde8c1101\") " pod="openshift-monitoring/metrics-server-7d7568c4f4-9rl7r" Jun 10 13:19:18.425058 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:18.425029 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c75b9349-95dc-42f7-bab2-fe0cde8c1101-client-ca-bundle\") pod \"metrics-server-7d7568c4f4-9rl7r\" (UID: \"c75b9349-95dc-42f7-bab2-fe0cde8c1101\") " pod="openshift-monitoring/metrics-server-7d7568c4f4-9rl7r" Jun 10 13:19:18.425269 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:18.425058 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c75b9349-95dc-42f7-bab2-fe0cde8c1101-metrics-server-audit-profiles\") pod \"metrics-server-7d7568c4f4-9rl7r\" (UID: \"c75b9349-95dc-42f7-bab2-fe0cde8c1101\") " pod="openshift-monitoring/metrics-server-7d7568c4f4-9rl7r" Jun 10 13:19:18.425269 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:18.425090 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c75b9349-95dc-42f7-bab2-fe0cde8c1101-secret-metrics-server-tls\") pod \"metrics-server-7d7568c4f4-9rl7r\" (UID: \"c75b9349-95dc-42f7-bab2-fe0cde8c1101\") " pod="openshift-monitoring/metrics-server-7d7568c4f4-9rl7r" Jun 10 13:19:18.425269 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:18.425223 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c75b9349-95dc-42f7-bab2-fe0cde8c1101-audit-log\") pod \"metrics-server-7d7568c4f4-9rl7r\" (UID: \"c75b9349-95dc-42f7-bab2-fe0cde8c1101\") " pod="openshift-monitoring/metrics-server-7d7568c4f4-9rl7r" Jun 10 13:19:18.425706 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:18.425680 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c75b9349-95dc-42f7-bab2-fe0cde8c1101-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7d7568c4f4-9rl7r\" (UID: \"c75b9349-95dc-42f7-bab2-fe0cde8c1101\") " pod="openshift-monitoring/metrics-server-7d7568c4f4-9rl7r" Jun 10 13:19:18.426158 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:18.426131 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c75b9349-95dc-42f7-bab2-fe0cde8c1101-metrics-server-audit-profiles\") pod \"metrics-server-7d7568c4f4-9rl7r\" (UID: \"c75b9349-95dc-42f7-bab2-fe0cde8c1101\") " pod="openshift-monitoring/metrics-server-7d7568c4f4-9rl7r" Jun 10 13:19:18.428069 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:18.428045 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c75b9349-95dc-42f7-bab2-fe0cde8c1101-secret-metrics-server-tls\") pod \"metrics-server-7d7568c4f4-9rl7r\" (UID: \"c75b9349-95dc-42f7-bab2-fe0cde8c1101\") " pod="openshift-monitoring/metrics-server-7d7568c4f4-9rl7r" Jun 10 13:19:18.428281 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:18.428259 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c75b9349-95dc-42f7-bab2-fe0cde8c1101-client-ca-bundle\") pod \"metrics-server-7d7568c4f4-9rl7r\" (UID: \"c75b9349-95dc-42f7-bab2-fe0cde8c1101\") " pod="openshift-monitoring/metrics-server-7d7568c4f4-9rl7r" Jun 10 13:19:18.428744 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:18.428705 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c75b9349-95dc-42f7-bab2-fe0cde8c1101-secret-metrics-server-client-certs\") pod \"metrics-server-7d7568c4f4-9rl7r\" (UID: \"c75b9349-95dc-42f7-bab2-fe0cde8c1101\") " pod="openshift-monitoring/metrics-server-7d7568c4f4-9rl7r" Jun 10 13:19:18.436002 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:18.435977 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4nbv\" (UniqueName: \"kubernetes.io/projected/c75b9349-95dc-42f7-bab2-fe0cde8c1101-kube-api-access-v4nbv\") pod \"metrics-server-7d7568c4f4-9rl7r\" (UID: \"c75b9349-95dc-42f7-bab2-fe0cde8c1101\") " pod="openshift-monitoring/metrics-server-7d7568c4f4-9rl7r" Jun 10 13:19:18.480526 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:18.480484 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7d7568c4f4-9rl7r" Jun 10 13:19:18.609551 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:18.609493 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:19:18.641761 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:18.641688 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7d7568c4f4-9rl7r"] Jun 10 13:19:18.645448 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:19:18.645420 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc75b9349_95dc_42f7_bab2_fe0cde8c1101.slice/crio-f33141d7ed068c42a747af6854beb9ded1d654d02f6428c8ac8736e2e027404a WatchSource:0}: Error finding container f33141d7ed068c42a747af6854beb9ded1d654d02f6428c8ac8736e2e027404a: Status 404 returned error can't find the container with id f33141d7ed068c42a747af6854beb9ded1d654d02f6428c8ac8736e2e027404a Jun 10 13:19:18.709144 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:18.709116 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:19:18.810280 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:18.810245 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:19:19.059065 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:19.058981 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7d7568c4f4-9rl7r" event={"ID":"c75b9349-95dc-42f7-bab2-fe0cde8c1101","Type":"ContainerStarted","Data":"f33141d7ed068c42a747af6854beb9ded1d654d02f6428c8ac8736e2e027404a"} Jun 10 13:19:19.060724 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:19.060700 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7dc786cb68-jvwpz" event={"ID":"92d022a2-0fda-4abe-880b-2c62ec9d4a34","Type":"ContainerStarted","Data":"fbaab1ec981debe7a51d3dc66a4f711f29f0590fb3d4659519c483b0a325a994"} Jun 10 13:19:19.060865 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:19.060754 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7dc786cb68-jvwpz" event={"ID":"92d022a2-0fda-4abe-880b-2c62ec9d4a34","Type":"ContainerStarted","Data":"406c94e833c311b655c2416c06b986e08b69868bb700346ffd3559129820da05"} Jun 10 13:19:19.060865 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:19.060788 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7dc786cb68-jvwpz" event={"ID":"92d022a2-0fda-4abe-880b-2c62ec9d4a34","Type":"ContainerStarted","Data":"9730cb9354899c9a8a10f9ec25606e9ce05e9dca0c48780dc1b0122263637122"} Jun 10 13:19:20.056003 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:20.055807 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 13:19:20.058223 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:20.058125 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:19:20.060317 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:20.060294 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:19:20.063512 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:20.063488 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 10 13:19:20.064334 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:20.064299 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 10 13:19:20.065869 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:20.065824 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 10 13:19:20.066362 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:20.066054 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 10 13:19:20.066362 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:20.066067 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 10 13:19:20.066362 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:20.066112 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 10 13:19:20.066362 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:20.066116 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 10 13:19:20.066362 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:20.066069 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 10 13:19:20.066665 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:20.066387 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 10 13:19:20.066665 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:20.066593 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 10 13:19:20.067045 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:20.066869 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 10 13:19:20.067699 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:20.067340 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-72c6c\"" Jun 10 13:19:20.067699 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:20.067392 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 10 13:19:20.067699 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:20.067601 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 10 13:19:20.067699 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:20.067698 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-14gsidmlvjhjk\"" Jun 10 13:19:20.071226 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:20.071192 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7dc786cb68-jvwpz" event={"ID":"92d022a2-0fda-4abe-880b-2c62ec9d4a34","Type":"ContainerStarted","Data":"b9b1f1762a519fd175429aa68cd75ba32369767fff56dcc09db9dfc9c3c610dc"} Jun 10 13:19:20.071313 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:20.071265 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7dc786cb68-jvwpz" event={"ID":"92d022a2-0fda-4abe-880b-2c62ec9d4a34","Type":"ContainerStarted","Data":"7c91c580378732f3a6a5c6a1a415542378414706a8516443190ea41922cbc0e7"} Jun 10 13:19:20.072473 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:20.072073 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 10 13:19:20.080617 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:20.080583 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 13:19:20.142234 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:20.142197 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b685abf-906b-4eb7-8b19-24bc0e65adc6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:19:20.142419 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:20.142244 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2b685abf-906b-4eb7-8b19-24bc0e65adc6-config-out\") pod \"prometheus-k8s-0\" (UID: \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:19:20.142419 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:20.142277 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b685abf-906b-4eb7-8b19-24bc0e65adc6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:19:20.142419 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:20.142303 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2b685abf-906b-4eb7-8b19-24bc0e65adc6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:19:20.142419 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:20.142331 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2b685abf-906b-4eb7-8b19-24bc0e65adc6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:19:20.142419 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:20.142406 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2b685abf-906b-4eb7-8b19-24bc0e65adc6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:19:20.142688 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:20.142433 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2b685abf-906b-4eb7-8b19-24bc0e65adc6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:19:20.142688 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:20.142472 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2b685abf-906b-4eb7-8b19-24bc0e65adc6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:19:20.142688 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:20.142507 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2b685abf-906b-4eb7-8b19-24bc0e65adc6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:19:20.142688 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:20.142529 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2b685abf-906b-4eb7-8b19-24bc0e65adc6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:19:20.142688 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:20.142552 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2b685abf-906b-4eb7-8b19-24bc0e65adc6-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:19:20.142688 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:20.142573 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b685abf-906b-4eb7-8b19-24bc0e65adc6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:19:20.142688 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:20.142610 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2b685abf-906b-4eb7-8b19-24bc0e65adc6-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:19:20.142688 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:20.142636 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2b685abf-906b-4eb7-8b19-24bc0e65adc6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:19:20.143056 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:20.142701 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2b685abf-906b-4eb7-8b19-24bc0e65adc6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:19:20.143056 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:20.142728 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2b685abf-906b-4eb7-8b19-24bc0e65adc6-config\") pod \"prometheus-k8s-0\" (UID: \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:19:20.143056 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:20.142757 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tx8lj\" (UniqueName: \"kubernetes.io/projected/2b685abf-906b-4eb7-8b19-24bc0e65adc6-kube-api-access-tx8lj\") pod \"prometheus-k8s-0\" (UID: \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:19:20.143056 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:20.142850 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2b685abf-906b-4eb7-8b19-24bc0e65adc6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:19:20.143056 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:20.142898 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2b685abf-906b-4eb7-8b19-24bc0e65adc6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:19:20.143056 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:20.142933 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2b685abf-906b-4eb7-8b19-24bc0e65adc6-web-config\") pod \"prometheus-k8s-0\" (UID: \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:19:20.243308 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:20.243268 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2b685abf-906b-4eb7-8b19-24bc0e65adc6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:19:20.243492 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:20.243327 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2b685abf-906b-4eb7-8b19-24bc0e65adc6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:19:20.243492 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:20.243358 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2b685abf-906b-4eb7-8b19-24bc0e65adc6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:19:20.243492 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:20.243387 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2b685abf-906b-4eb7-8b19-24bc0e65adc6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:19:20.243492 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:20.243414 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2b685abf-906b-4eb7-8b19-24bc0e65adc6-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:19:20.243492 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:20.243440 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b685abf-906b-4eb7-8b19-24bc0e65adc6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:19:20.243492 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:20.243465 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2b685abf-906b-4eb7-8b19-24bc0e65adc6-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:19:20.243492 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:20.243488 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2b685abf-906b-4eb7-8b19-24bc0e65adc6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:19:20.243861 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:20.243520 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2b685abf-906b-4eb7-8b19-24bc0e65adc6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:19:20.243861 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:20.243545 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2b685abf-906b-4eb7-8b19-24bc0e65adc6-config\") pod \"prometheus-k8s-0\" (UID: \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:19:20.243861 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:20.243575 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tx8lj\" (UniqueName: \"kubernetes.io/projected/2b685abf-906b-4eb7-8b19-24bc0e65adc6-kube-api-access-tx8lj\") pod \"prometheus-k8s-0\" (UID: \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:19:20.243861 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:20.243615 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2b685abf-906b-4eb7-8b19-24bc0e65adc6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:19:20.243861 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:20.243648 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2b685abf-906b-4eb7-8b19-24bc0e65adc6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:19:20.243861 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:20.243681 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2b685abf-906b-4eb7-8b19-24bc0e65adc6-web-config\") pod \"prometheus-k8s-0\" (UID: \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:19:20.243861 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:20.243716 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b685abf-906b-4eb7-8b19-24bc0e65adc6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:19:20.243861 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:20.243741 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2b685abf-906b-4eb7-8b19-24bc0e65adc6-config-out\") pod \"prometheus-k8s-0\" (UID: \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:19:20.243861 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:20.243770 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b685abf-906b-4eb7-8b19-24bc0e65adc6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:19:20.243861 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:20.243793 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2b685abf-906b-4eb7-8b19-24bc0e65adc6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:19:20.243861 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:20.243828 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2b685abf-906b-4eb7-8b19-24bc0e65adc6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:19:20.244371 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:20.243900 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2b685abf-906b-4eb7-8b19-24bc0e65adc6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:19:20.245336 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:20.245305 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2b685abf-906b-4eb7-8b19-24bc0e65adc6-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:19:20.245600 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:20.245493 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2b685abf-906b-4eb7-8b19-24bc0e65adc6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:19:20.246267 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:20.246060 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b685abf-906b-4eb7-8b19-24bc0e65adc6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:19:20.247371 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:20.247345 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2b685abf-906b-4eb7-8b19-24bc0e65adc6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:19:20.247710 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:20.247687 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2b685abf-906b-4eb7-8b19-24bc0e65adc6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:19:20.248560 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:20.248485 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2b685abf-906b-4eb7-8b19-24bc0e65adc6-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:19:20.248707 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:20.248662 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b685abf-906b-4eb7-8b19-24bc0e65adc6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:19:20.248707 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:20.248693 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2b685abf-906b-4eb7-8b19-24bc0e65adc6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:19:20.248911 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:20.248886 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2b685abf-906b-4eb7-8b19-24bc0e65adc6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:19:20.249610 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:20.249583 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2b685abf-906b-4eb7-8b19-24bc0e65adc6-web-config\") pod \"prometheus-k8s-0\" (UID: \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:19:20.249978 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:20.249953 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b685abf-906b-4eb7-8b19-24bc0e65adc6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:19:20.250527 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:20.250500 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2b685abf-906b-4eb7-8b19-24bc0e65adc6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:19:20.252117 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:20.251615 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2b685abf-906b-4eb7-8b19-24bc0e65adc6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:19:20.252117 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:20.252080 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2b685abf-906b-4eb7-8b19-24bc0e65adc6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:19:20.252264 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:20.252124 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2b685abf-906b-4eb7-8b19-24bc0e65adc6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:19:20.253680 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:20.253658 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/2b685abf-906b-4eb7-8b19-24bc0e65adc6-config\") pod \"prometheus-k8s-0\" (UID: \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:19:20.254666 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:20.254069 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2b685abf-906b-4eb7-8b19-24bc0e65adc6-config-out\") pod \"prometheus-k8s-0\" (UID: \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:19:20.254666 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:20.254630 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tx8lj\" (UniqueName: \"kubernetes.io/projected/2b685abf-906b-4eb7-8b19-24bc0e65adc6-kube-api-access-tx8lj\") pod \"prometheus-k8s-0\" (UID: \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:19:20.255318 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:20.255271 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2b685abf-906b-4eb7-8b19-24bc0e65adc6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:19:20.255717 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:20.255689 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2b685abf-906b-4eb7-8b19-24bc0e65adc6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:19:20.374148 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:20.373967 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:19:20.532448 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:20.532367 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 13:19:20.536289 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:19:20.536253 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b685abf_906b_4eb7_8b19_24bc0e65adc6.slice/crio-e01886322a6d55746344c5c45a8c5eaf8ef3e3c6e977a22753ae689b43ddf262 WatchSource:0}: Error finding container e01886322a6d55746344c5c45a8c5eaf8ef3e3c6e977a22753ae689b43ddf262: Status 404 returned error can't find the container with id e01886322a6d55746344c5c45a8c5eaf8ef3e3c6e977a22753ae689b43ddf262 Jun 10 13:19:21.077459 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:21.077418 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2b685abf-906b-4eb7-8b19-24bc0e65adc6","Type":"ContainerStarted","Data":"e01886322a6d55746344c5c45a8c5eaf8ef3e3c6e977a22753ae689b43ddf262"} Jun 10 13:19:21.081832 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:21.081405 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7dc786cb68-jvwpz" event={"ID":"92d022a2-0fda-4abe-880b-2c62ec9d4a34","Type":"ContainerStarted","Data":"d28407d37e62b39a2d384dcdc622acd57df6edc4a38c04ecb7e9712fa987f550"} Jun 10 13:19:21.081832 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:21.081761 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7dc786cb68-jvwpz" Jun 10 13:19:21.084570 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:21.084519 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7d7568c4f4-9rl7r" event={"ID":"c75b9349-95dc-42f7-bab2-fe0cde8c1101","Type":"ContainerStarted","Data":"6d4670dc41e8ad129890d0d5e2e921119efa9b27d2a0135b8e1d1a8dae632cc8"} Jun 10 13:19:21.113526 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:21.113389 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7dc786cb68-jvwpz" podStartSLOduration=3.068523258 podStartE2EDuration="6.113367367s" totalImagesPullingTime="3.044844109s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:19:15 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:19:21.107204113 +0000 UTC m=+268.372454711" watchObservedRunningTime="2026-06-10 13:19:21.113367367 +0000 UTC m=+268.378617965" Jun 10 13:19:21.132902 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:21.132704 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7d7568c4f4-9rl7r" podStartSLOduration=1.456326751 podStartE2EDuration="3.132684376s" totalImagesPullingTime="1.676357625s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:19:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:19:21.130688555 +0000 UTC m=+268.395939151" watchObservedRunningTime="2026-06-10 13:19:21.132684376 +0000 UTC m=+268.397934974" Jun 10 13:19:21.156317 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:21.156201 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:19:21.215482 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:21.215446 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:19:22.090523 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:22.090482 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2b685abf-906b-4eb7-8b19-24bc0e65adc6","Type":"ContainerStarted","Data":"b3da5c638920a42d707e75be6ac6c1f5d2595b3ba197e77a8e41bb2576c5bb80"} Jun 10 13:19:24.344892 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:24.344832 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:19:25.744211 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:25.744172 2567 patch_prober.go:28] interesting pod/image-registry-6577858866-9fbjb container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 10 13:19:25.744579 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:25.744236 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6577858866-9fbjb" podUID="c0af5812-3297-4e07-abdb-f54190eed2b4" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 13:19:26.143034 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:26.142994 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:19:26.244680 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:26.244642 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:19:27.098774 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:27.098743 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7dc786cb68-jvwpz" Jun 10 13:19:29.124876 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:29.124815 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-cgclb" event={"ID":"4c7bab36-48ac-4a20-b147-80ca0165b212","Type":"ContainerStarted","Data":"9490bf63dfc022bb39f092c03ebe4649050e588c388b49f7fd31d52454ae6794"} Jun 10 13:19:29.125362 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:29.124905 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6657875f97-cgclb" Jun 10 13:19:29.127119 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:29.127096 2567 generic.go:356] "Generic (PLEG): container finished" podID="2b685abf-906b-4eb7-8b19-24bc0e65adc6" containerID="b3da5c638920a42d707e75be6ac6c1f5d2595b3ba197e77a8e41bb2576c5bb80" exitCode=0 Jun 10 13:19:29.127231 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:29.127170 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2b685abf-906b-4eb7-8b19-24bc0e65adc6","Type":"ContainerDied","Data":"b3da5c638920a42d707e75be6ac6c1f5d2595b3ba197e77a8e41bb2576c5bb80"} Jun 10 13:19:29.135948 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:29.135919 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6657875f97-cgclb" Jun 10 13:19:29.167916 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:29.167865 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6657875f97-cgclb" podStartSLOduration=1.248899183 podStartE2EDuration="21.167830125s" totalImagesPullingTime="19.918930942s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:19:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:19:29.146055948 +0000 UTC m=+276.411306544" watchObservedRunningTime="2026-06-10 13:19:29.167830125 +0000 UTC m=+276.433080728" Jun 10 13:19:30.758713 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:30.758666 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6577858866-9fbjb" podUID="c0af5812-3297-4e07-abdb-f54190eed2b4" containerName="registry" containerID="cri-o://fb18f1d77c089b1241e28fef9521c659dbf79d1b36e1bb344b2e0a8f871d5ea9" gracePeriod=30 Jun 10 13:19:31.078265 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:31.078221 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6577858866-9fbjb" Jun 10 13:19:31.139921 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:31.139887 2567 generic.go:356] "Generic (PLEG): container finished" podID="c0af5812-3297-4e07-abdb-f54190eed2b4" containerID="fb18f1d77c089b1241e28fef9521c659dbf79d1b36e1bb344b2e0a8f871d5ea9" exitCode=0 Jun 10 13:19:31.140094 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:31.139972 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6577858866-9fbjb" event={"ID":"c0af5812-3297-4e07-abdb-f54190eed2b4","Type":"ContainerDied","Data":"fb18f1d77c089b1241e28fef9521c659dbf79d1b36e1bb344b2e0a8f871d5ea9"} Jun 10 13:19:31.140094 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:31.139995 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6577858866-9fbjb" Jun 10 13:19:31.140094 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:31.140033 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6577858866-9fbjb" event={"ID":"c0af5812-3297-4e07-abdb-f54190eed2b4","Type":"ContainerDied","Data":"bcc47a8ecccb030c59f3921a69284ddb7b7a2be4263f52f157901b20f0f14956"} Jun 10 13:19:31.140094 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:31.140060 2567 scope.go:117] "RemoveContainer" containerID="fb18f1d77c089b1241e28fef9521c659dbf79d1b36e1bb344b2e0a8f871d5ea9" Jun 10 13:19:31.150798 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:31.150784 2567 scope.go:117] "RemoveContainer" containerID="fb18f1d77c089b1241e28fef9521c659dbf79d1b36e1bb344b2e0a8f871d5ea9" Jun 10 13:19:31.151168 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:19:31.151137 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb18f1d77c089b1241e28fef9521c659dbf79d1b36e1bb344b2e0a8f871d5ea9\": container with ID starting with fb18f1d77c089b1241e28fef9521c659dbf79d1b36e1bb344b2e0a8f871d5ea9 not found: ID does not exist" containerID="fb18f1d77c089b1241e28fef9521c659dbf79d1b36e1bb344b2e0a8f871d5ea9" Jun 10 13:19:31.151261 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:31.151178 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb18f1d77c089b1241e28fef9521c659dbf79d1b36e1bb344b2e0a8f871d5ea9"} err="failed to get container status \"fb18f1d77c089b1241e28fef9521c659dbf79d1b36e1bb344b2e0a8f871d5ea9\": rpc error: code = NotFound desc = could not find container \"fb18f1d77c089b1241e28fef9521c659dbf79d1b36e1bb344b2e0a8f871d5ea9\": container with ID starting with fb18f1d77c089b1241e28fef9521c659dbf79d1b36e1bb344b2e0a8f871d5ea9 not found: ID does not exist" Jun 10 13:19:31.155564 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:31.155536 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c0af5812-3297-4e07-abdb-f54190eed2b4-bound-sa-token\") pod \"c0af5812-3297-4e07-abdb-f54190eed2b4\" (UID: \"c0af5812-3297-4e07-abdb-f54190eed2b4\") " Jun 10 13:19:31.155668 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:31.155580 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c0af5812-3297-4e07-abdb-f54190eed2b4-registry-tls\") pod \"c0af5812-3297-4e07-abdb-f54190eed2b4\" (UID: \"c0af5812-3297-4e07-abdb-f54190eed2b4\") " Jun 10 13:19:31.155668 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:31.155615 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c0af5812-3297-4e07-abdb-f54190eed2b4-registry-certificates\") pod \"c0af5812-3297-4e07-abdb-f54190eed2b4\" (UID: \"c0af5812-3297-4e07-abdb-f54190eed2b4\") " Jun 10 13:19:31.155668 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:31.155657 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c0af5812-3297-4e07-abdb-f54190eed2b4-trusted-ca\") pod \"c0af5812-3297-4e07-abdb-f54190eed2b4\" (UID: \"c0af5812-3297-4e07-abdb-f54190eed2b4\") " Jun 10 13:19:31.155832 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:31.155698 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c0af5812-3297-4e07-abdb-f54190eed2b4-ca-trust-extracted\") pod \"c0af5812-3297-4e07-abdb-f54190eed2b4\" (UID: \"c0af5812-3297-4e07-abdb-f54190eed2b4\") " Jun 10 13:19:31.155832 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:31.155766 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6gz89\" (UniqueName: \"kubernetes.io/projected/c0af5812-3297-4e07-abdb-f54190eed2b4-kube-api-access-6gz89\") pod \"c0af5812-3297-4e07-abdb-f54190eed2b4\" (UID: \"c0af5812-3297-4e07-abdb-f54190eed2b4\") " Jun 10 13:19:31.155959 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:31.155828 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c0af5812-3297-4e07-abdb-f54190eed2b4-installation-pull-secrets\") pod \"c0af5812-3297-4e07-abdb-f54190eed2b4\" (UID: \"c0af5812-3297-4e07-abdb-f54190eed2b4\") " Jun 10 13:19:31.156018 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:31.155972 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c0af5812-3297-4e07-abdb-f54190eed2b4-image-registry-private-configuration\") pod \"c0af5812-3297-4e07-abdb-f54190eed2b4\" (UID: \"c0af5812-3297-4e07-abdb-f54190eed2b4\") " Jun 10 13:19:31.156480 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:31.156454 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0af5812-3297-4e07-abdb-f54190eed2b4-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "c0af5812-3297-4e07-abdb-f54190eed2b4" (UID: "c0af5812-3297-4e07-abdb-f54190eed2b4"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 13:19:31.159139 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:31.159111 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0af5812-3297-4e07-abdb-f54190eed2b4-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "c0af5812-3297-4e07-abdb-f54190eed2b4" (UID: "c0af5812-3297-4e07-abdb-f54190eed2b4"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 13:19:31.160272 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:31.160239 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0af5812-3297-4e07-abdb-f54190eed2b4-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "c0af5812-3297-4e07-abdb-f54190eed2b4" (UID: "c0af5812-3297-4e07-abdb-f54190eed2b4"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 13:19:31.160990 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:31.160951 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0af5812-3297-4e07-abdb-f54190eed2b4-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "c0af5812-3297-4e07-abdb-f54190eed2b4" (UID: "c0af5812-3297-4e07-abdb-f54190eed2b4"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 13:19:31.161197 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:31.161169 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0af5812-3297-4e07-abdb-f54190eed2b4-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "c0af5812-3297-4e07-abdb-f54190eed2b4" (UID: "c0af5812-3297-4e07-abdb-f54190eed2b4"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 13:19:31.163965 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:31.163926 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0af5812-3297-4e07-abdb-f54190eed2b4-kube-api-access-6gz89" (OuterVolumeSpecName: "kube-api-access-6gz89") pod "c0af5812-3297-4e07-abdb-f54190eed2b4" (UID: "c0af5812-3297-4e07-abdb-f54190eed2b4"). InnerVolumeSpecName "kube-api-access-6gz89". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 13:19:31.165686 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:31.165511 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0af5812-3297-4e07-abdb-f54190eed2b4-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "c0af5812-3297-4e07-abdb-f54190eed2b4" (UID: "c0af5812-3297-4e07-abdb-f54190eed2b4"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 13:19:31.170724 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:31.170697 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0af5812-3297-4e07-abdb-f54190eed2b4-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "c0af5812-3297-4e07-abdb-f54190eed2b4" (UID: "c0af5812-3297-4e07-abdb-f54190eed2b4"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 13:19:31.257285 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:31.257240 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6gz89\" (UniqueName: \"kubernetes.io/projected/c0af5812-3297-4e07-abdb-f54190eed2b4-kube-api-access-6gz89\") on node \"ip-10-0-136-19.ec2.internal\" DevicePath \"\"" Jun 10 13:19:31.257285 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:31.257274 2567 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c0af5812-3297-4e07-abdb-f54190eed2b4-installation-pull-secrets\") on node \"ip-10-0-136-19.ec2.internal\" DevicePath \"\"" Jun 10 13:19:31.257285 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:31.257290 2567 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c0af5812-3297-4e07-abdb-f54190eed2b4-image-registry-private-configuration\") on node \"ip-10-0-136-19.ec2.internal\" DevicePath \"\"" Jun 10 13:19:31.257706 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:31.257305 2567 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c0af5812-3297-4e07-abdb-f54190eed2b4-bound-sa-token\") on node \"ip-10-0-136-19.ec2.internal\" DevicePath \"\"" Jun 10 13:19:31.257706 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:31.257319 2567 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c0af5812-3297-4e07-abdb-f54190eed2b4-registry-tls\") on node \"ip-10-0-136-19.ec2.internal\" DevicePath \"\"" Jun 10 13:19:31.257706 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:31.257331 2567 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c0af5812-3297-4e07-abdb-f54190eed2b4-registry-certificates\") on node \"ip-10-0-136-19.ec2.internal\" DevicePath \"\"" Jun 10 13:19:31.257706 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:31.257343 2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c0af5812-3297-4e07-abdb-f54190eed2b4-trusted-ca\") on node \"ip-10-0-136-19.ec2.internal\" DevicePath \"\"" Jun 10 13:19:31.257706 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:31.257356 2567 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c0af5812-3297-4e07-abdb-f54190eed2b4-ca-trust-extracted\") on node \"ip-10-0-136-19.ec2.internal\" DevicePath \"\"" Jun 10 13:19:31.348572 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:31.348489 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:19:31.459539 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:31.459505 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6577858866-9fbjb"] Jun 10 13:19:31.463566 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:31.463538 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6577858866-9fbjb"] Jun 10 13:19:33.208633 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:33.208600 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c0af5812-3297-4e07-abdb-f54190eed2b4" path="/var/lib/kubelet/pods/c0af5812-3297-4e07-abdb-f54190eed2b4/volumes" Jun 10 13:19:33.682287 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:19:33.682195 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-kdht2" podUID="4e26e7f8-4434-431c-8543-b57b5edde1e6" Jun 10 13:19:34.160351 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:34.160311 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2b685abf-906b-4eb7-8b19-24bc0e65adc6","Type":"ContainerStarted","Data":"0fd8659660d72a69006840f04e243b5f3c71bde98459f03e67154fecd0927372"} Jun 10 13:19:34.160588 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:34.160382 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2b685abf-906b-4eb7-8b19-24bc0e65adc6","Type":"ContainerStarted","Data":"2d4ed9288b04b5efe1410b724ef6ea2aa1204e72fc1fb58c61d8b24400185862"} Jun 10 13:19:34.160588 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:34.160332 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kdht2" Jun 10 13:19:34.160588 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:34.160423 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2b685abf-906b-4eb7-8b19-24bc0e65adc6","Type":"ContainerStarted","Data":"9d55d24f29f775138c4f71407602f0ab4f791184931ce29e3e73685ecede9ae5"} Jun 10 13:19:34.160588 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:34.160462 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2b685abf-906b-4eb7-8b19-24bc0e65adc6","Type":"ContainerStarted","Data":"da1cdc289bc7d847bcb3d9eacfd52671016673e1e01fc98dec094d6687dcd90a"} Jun 10 13:19:34.160588 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:34.160508 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2b685abf-906b-4eb7-8b19-24bc0e65adc6","Type":"ContainerStarted","Data":"21c8aae443bea0083bbdb2645ad30f7c563d6eb7ed469de648bec86869dac21c"} Jun 10 13:19:34.160588 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:34.160543 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2b685abf-906b-4eb7-8b19-24bc0e65adc6","Type":"ContainerStarted","Data":"eb92b63632c5568b1d199dd20a6de6df1667c6a2b7aef4a3ec1f1e7146039583"} Jun 10 13:19:34.199585 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:34.199528 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=9.078057718 podStartE2EDuration="14.199507078s" totalImagesPullingTime="5.097285657s" totalInitContainerRuntime="24.163703ms" isStatefulPod=false podCreationTimestamp="2026-06-10 13:19:20 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:19:34.198011527 +0000 UTC m=+281.463262150" watchObservedRunningTime="2026-06-10 13:19:34.199507078 +0000 UTC m=+281.464757675" Jun 10 13:19:35.374876 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:35.374816 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:19:35.641318 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:35.641216 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:19:35.701055 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:35.701016 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:19:37.181236 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:37.181202 2567 generic.go:356] "Generic (PLEG): container finished" podID="1c48c468-836f-4e9d-babe-d628242353b9" containerID="6f7c6f6a4b7e3ca95dd02b349815daccca44d31b47acc67c88fe73706371071b" exitCode=255 Jun 10 13:19:37.181682 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:37.181260 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58c7d8489d-22gt9" event={"ID":"1c48c468-836f-4e9d-babe-d628242353b9","Type":"ContainerDied","Data":"6f7c6f6a4b7e3ca95dd02b349815daccca44d31b47acc67c88fe73706371071b"} Jun 10 13:19:37.181682 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:37.181324 2567 scope.go:117] "RemoveContainer" containerID="c688a76392c0cc67c4cd5c2d6a8c3dfdf68182d906674e9ad0597c038e51c350" Jun 10 13:19:37.189065 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:37.189044 2567 scope.go:117] "RemoveContainer" containerID="6f7c6f6a4b7e3ca95dd02b349815daccca44d31b47acc67c88fe73706371071b" Jun 10 13:19:37.189252 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:19:37.189233 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-58c7d8489d-22gt9_open-cluster-management-agent-addon(1c48c468-836f-4e9d-babe-d628242353b9)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58c7d8489d-22gt9" podUID="1c48c468-836f-4e9d-babe-d628242353b9" Jun 10 13:19:37.519369 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:37.519286 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e26e7f8-4434-431c-8543-b57b5edde1e6-metrics-tls\") pod \"dns-default-kdht2\" (UID: \"4e26e7f8-4434-431c-8543-b57b5edde1e6\") " pod="openshift-dns/dns-default-kdht2" Jun 10 13:19:37.521753 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:37.521722 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e26e7f8-4434-431c-8543-b57b5edde1e6-metrics-tls\") pod \"dns-default-kdht2\" (UID: \"4e26e7f8-4434-431c-8543-b57b5edde1e6\") " pod="openshift-dns/dns-default-kdht2" Jun 10 13:19:37.764782 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:37.764748 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bhqqk\"" Jun 10 13:19:37.772303 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:37.772251 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kdht2" Jun 10 13:19:37.930924 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:37.930902 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kdht2"] Jun 10 13:19:37.932830 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:19:37.932805 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e26e7f8_4434_431c_8543_b57b5edde1e6.slice/crio-7d032096a78a86ab5e07dd1f618bfc7b41de352e1099c31678d05540885d25f5 WatchSource:0}: Error finding container 7d032096a78a86ab5e07dd1f618bfc7b41de352e1099c31678d05540885d25f5: Status 404 returned error can't find the container with id 7d032096a78a86ab5e07dd1f618bfc7b41de352e1099c31678d05540885d25f5 Jun 10 13:19:38.186457 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:38.186418 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kdht2" event={"ID":"4e26e7f8-4434-431c-8543-b57b5edde1e6","Type":"ContainerStarted","Data":"7d032096a78a86ab5e07dd1f618bfc7b41de352e1099c31678d05540885d25f5"} Jun 10 13:19:38.481032 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:38.480950 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7d7568c4f4-9rl7r" Jun 10 13:19:38.481032 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:38.481021 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7d7568c4f4-9rl7r" Jun 10 13:19:41.200945 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:41.200907 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kdht2" event={"ID":"4e26e7f8-4434-431c-8543-b57b5edde1e6","Type":"ContainerStarted","Data":"e39f6925985d4c84e7386ea8a3691551a9338286064213aec5237177249125d9"} Jun 10 13:19:41.201340 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:41.200995 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kdht2" event={"ID":"4e26e7f8-4434-431c-8543-b57b5edde1e6","Type":"ContainerStarted","Data":"f28dc5c3857bdedc417dbe2756fdebd93e535849e5d90c5cd8d15f98350b87fa"} Jun 10 13:19:41.201340 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:41.201025 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-kdht2" Jun 10 13:19:41.222471 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:41.222424 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-kdht2" podStartSLOduration=251.923790784 podStartE2EDuration="4m14.222411331s" totalImagesPullingTime="2.298620547s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:15:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:19:41.221075691 +0000 UTC m=+288.486326289" watchObservedRunningTime="2026-06-10 13:19:41.222411331 +0000 UTC m=+288.487661927" Jun 10 13:19:42.607821 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:42.607784 2567 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58c7d8489d-22gt9" Jun 10 13:19:42.608208 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:42.608168 2567 scope.go:117] "RemoveContainer" containerID="6f7c6f6a4b7e3ca95dd02b349815daccca44d31b47acc67c88fe73706371071b" Jun 10 13:19:42.608342 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:19:42.608323 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-58c7d8489d-22gt9_open-cluster-management-agent-addon(1c48c468-836f-4e9d-babe-d628242353b9)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58c7d8489d-22gt9" podUID="1c48c468-836f-4e9d-babe-d628242353b9" Jun 10 13:19:45.303409 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:45.303373 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:19:45.364067 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:45.364024 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:19:48.229085 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:48.229052 2567 generic.go:356] "Generic (PLEG): container finished" podID="e402e555-ddd8-4a81-82df-815b5237540f" containerID="e299aabc4a479deda74e89a1e4c1673ec104e3a67a41eba79a2faf2faadc22db" exitCode=0 Jun 10 13:19:48.229463 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:48.229127 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-7nph4" event={"ID":"e402e555-ddd8-4a81-82df-815b5237540f","Type":"ContainerDied","Data":"e299aabc4a479deda74e89a1e4c1673ec104e3a67a41eba79a2faf2faadc22db"} Jun 10 13:19:48.229463 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:48.229439 2567 scope.go:117] "RemoveContainer" containerID="e299aabc4a479deda74e89a1e4c1673ec104e3a67a41eba79a2faf2faadc22db" Jun 10 13:19:49.235670 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:49.235634 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-7nph4" event={"ID":"e402e555-ddd8-4a81-82df-815b5237540f","Type":"ContainerStarted","Data":"8d477dcba3fce3dc99f422523758b455d9bb3880d5060f26fdf6de7f2fed35c7"} Jun 10 13:19:51.208710 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:51.208684 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-kdht2" Jun 10 13:19:53.151487 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:53.151458 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-9xwd9_c0921084-7852-4e0a-972a-7366b89c7736/console-operator/1.log" Jun 10 13:19:53.151984 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:53.151562 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-9xwd9_c0921084-7852-4e0a-972a-7366b89c7736/console-operator/1.log" Jun 10 13:19:53.157188 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:53.157172 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-htrsf_503ace6f-dfa4-41b8-8ade-5294ab66e7a7/ovn-acl-logging/0.log" Jun 10 13:19:53.157359 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:53.157346 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-htrsf_503ace6f-dfa4-41b8-8ade-5294ab66e7a7/ovn-acl-logging/0.log" Jun 10 13:19:53.164465 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:53.164449 2567 kubelet.go:1648] "Image garbage collection succeeded" Jun 10 13:19:54.219411 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:54.219377 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:19:54.319508 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:54.319474 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:19:54.420106 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:54.420071 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:19:54.797521 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:54.797485 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:19:54.900125 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:54.900092 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:19:54.998468 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:54.998436 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:19:56.208502 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:56.208473 2567 scope.go:117] "RemoveContainer" containerID="6f7c6f6a4b7e3ca95dd02b349815daccca44d31b47acc67c88fe73706371071b" Jun 10 13:19:56.261680 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:56.261657 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58c7d8489d-22gt9" event={"ID":"1c48c468-836f-4e9d-babe-d628242353b9","Type":"ContainerStarted","Data":"2c2e302aada33d5b9bd09c8ba9108763678963741d6eaa39cc5d0ff78d823f93"} Jun 10 13:19:56.306067 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:56.306029 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:19:56.406178 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:56.406149 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:19:56.507552 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:56.507456 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:19:56.607803 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:56.607770 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:19:58.270423 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:58.270334 2567 generic.go:356] "Generic (PLEG): container finished" podID="87c0c6d8-6455-44f3-a9ad-18852f44c96c" containerID="be3955fa081d3f8e5334b062776cc4f3a186d5652a0759eedea13146a88e209d" exitCode=0 Jun 10 13:19:58.270423 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:58.270408 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-xk8dj" event={"ID":"87c0c6d8-6455-44f3-a9ad-18852f44c96c","Type":"ContainerDied","Data":"be3955fa081d3f8e5334b062776cc4f3a186d5652a0759eedea13146a88e209d"} Jun 10 13:19:58.270818 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:58.270766 2567 scope.go:117] "RemoveContainer" containerID="be3955fa081d3f8e5334b062776cc4f3a186d5652a0759eedea13146a88e209d" Jun 10 13:19:58.487727 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:58.487700 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7d7568c4f4-9rl7r" Jun 10 13:19:58.492904 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:58.492881 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7d7568c4f4-9rl7r" Jun 10 13:19:59.278505 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:59.278459 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-xk8dj" event={"ID":"87c0c6d8-6455-44f3-a9ad-18852f44c96c","Type":"ContainerStarted","Data":"4d96e22e0580bd5585ee0277b85a58a0a596e2912e716ab04ae55e691d6c2208"} Jun 10 13:19:59.488131 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:59.488088 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:19:59.588453 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:19:59.588369 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:20:05.347131 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:05.347093 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:20:05.448140 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:05.448103 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:20:06.323766 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:06.323736 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:20:06.423565 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:06.423530 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:20:08.518979 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:08.518949 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:20:08.620347 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:08.620318 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:20:09.803127 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:09.803071 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:20:09.904147 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:09.904105 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:20:13.461076 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:13.461028 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:20:13.516287 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:13.516256 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:20:16.505511 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:16.505472 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:20:16.605851 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:16.605812 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:20:16.676824 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:16.676775 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:20:20.375264 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:20.375233 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:20:20.396040 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:20.396010 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:20:21.378897 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:21.378857 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:20:33.031085 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:33.031045 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:20:33.428556 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:33.428518 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:20:34.628142 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:34.628105 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:20:34.685865 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:34.685829 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:20:38.431315 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:38.431219 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 13:20:38.431766 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:38.431637 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2b685abf-906b-4eb7-8b19-24bc0e65adc6" containerName="thanos-sidecar" containerID="cri-o://da1cdc289bc7d847bcb3d9eacfd52671016673e1e01fc98dec094d6687dcd90a" gracePeriod=600 Jun 10 13:20:38.431766 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:38.431656 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2b685abf-906b-4eb7-8b19-24bc0e65adc6" containerName="kube-rbac-proxy-thanos" containerID="cri-o://0fd8659660d72a69006840f04e243b5f3c71bde98459f03e67154fecd0927372" gracePeriod=600 Jun 10 13:20:38.431766 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:38.431701 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2b685abf-906b-4eb7-8b19-24bc0e65adc6" containerName="kube-rbac-proxy" containerID="cri-o://2d4ed9288b04b5efe1410b724ef6ea2aa1204e72fc1fb58c61d8b24400185862" gracePeriod=600 Jun 10 13:20:38.431766 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:38.431710 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2b685abf-906b-4eb7-8b19-24bc0e65adc6" containerName="config-reloader" containerID="cri-o://21c8aae443bea0083bbdb2645ad30f7c563d6eb7ed469de648bec86869dac21c" gracePeriod=600 Jun 10 13:20:38.431969 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:38.431656 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2b685abf-906b-4eb7-8b19-24bc0e65adc6" containerName="kube-rbac-proxy-web" containerID="cri-o://9d55d24f29f775138c4f71407602f0ab4f791184931ce29e3e73685ecede9ae5" gracePeriod=600 Jun 10 13:20:38.431969 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:38.431637 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2b685abf-906b-4eb7-8b19-24bc0e65adc6" containerName="prometheus" containerID="cri-o://eb92b63632c5568b1d199dd20a6de6df1667c6a2b7aef4a3ec1f1e7146039583" gracePeriod=600 Jun 10 13:20:38.663150 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:38.663127 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:20:38.740149 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:38.740078 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2b685abf-906b-4eb7-8b19-24bc0e65adc6-prometheus-k8s-rulefiles-1\") pod \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\" (UID: \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\") " Jun 10 13:20:38.740149 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:38.740117 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2b685abf-906b-4eb7-8b19-24bc0e65adc6-web-config\") pod \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\" (UID: \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\") " Jun 10 13:20:38.740149 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:38.740143 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2b685abf-906b-4eb7-8b19-24bc0e65adc6-secret-kube-rbac-proxy\") pod \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\" (UID: \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\") " Jun 10 13:20:38.740388 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:38.740162 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tx8lj\" (UniqueName: \"kubernetes.io/projected/2b685abf-906b-4eb7-8b19-24bc0e65adc6-kube-api-access-tx8lj\") pod \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\" (UID: \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\") " Jun 10 13:20:38.740388 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:38.740197 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2b685abf-906b-4eb7-8b19-24bc0e65adc6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\" (UID: \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\") " Jun 10 13:20:38.740388 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:38.740221 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2b685abf-906b-4eb7-8b19-24bc0e65adc6-prometheus-k8s-rulefiles-2\") pod \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\" (UID: \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\") " Jun 10 13:20:38.740388 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:38.740242 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2b685abf-906b-4eb7-8b19-24bc0e65adc6-prometheus-k8s-rulefiles-0\") pod \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\" (UID: \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\") " Jun 10 13:20:38.740388 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:38.740268 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b685abf-906b-4eb7-8b19-24bc0e65adc6-configmap-kubelet-serving-ca-bundle\") pod \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\" (UID: \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\") " Jun 10 13:20:38.740388 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:38.740296 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2b685abf-906b-4eb7-8b19-24bc0e65adc6-config\") pod \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\" (UID: \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\") " Jun 10 13:20:38.740388 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:38.740321 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2b685abf-906b-4eb7-8b19-24bc0e65adc6-config-out\") pod \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\" (UID: \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\") " Jun 10 13:20:38.740388 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:38.740346 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2b685abf-906b-4eb7-8b19-24bc0e65adc6-configmap-metrics-client-ca\") pod \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\" (UID: \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\") " Jun 10 13:20:38.740388 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:38.740380 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b685abf-906b-4eb7-8b19-24bc0e65adc6-configmap-serving-certs-ca-bundle\") pod \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\" (UID: \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\") " Jun 10 13:20:38.740857 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:38.740414 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2b685abf-906b-4eb7-8b19-24bc0e65adc6-secret-metrics-client-certs\") pod \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\" (UID: \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\") " Jun 10 13:20:38.740857 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:38.740447 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2b685abf-906b-4eb7-8b19-24bc0e65adc6-secret-prometheus-k8s-tls\") pod \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\" (UID: \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\") " Jun 10 13:20:38.740857 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:38.740470 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2b685abf-906b-4eb7-8b19-24bc0e65adc6-tls-assets\") pod \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\" (UID: \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\") " Jun 10 13:20:38.740857 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:38.740502 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b685abf-906b-4eb7-8b19-24bc0e65adc6-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "2b685abf-906b-4eb7-8b19-24bc0e65adc6" (UID: "2b685abf-906b-4eb7-8b19-24bc0e65adc6"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 13:20:38.740857 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:38.740515 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2b685abf-906b-4eb7-8b19-24bc0e65adc6-thanos-prometheus-http-client-file\") pod \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\" (UID: \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\") " Jun 10 13:20:38.740857 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:38.740542 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b685abf-906b-4eb7-8b19-24bc0e65adc6-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "2b685abf-906b-4eb7-8b19-24bc0e65adc6" (UID: "2b685abf-906b-4eb7-8b19-24bc0e65adc6"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 13:20:38.740857 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:38.740583 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2b685abf-906b-4eb7-8b19-24bc0e65adc6-prometheus-k8s-db\") pod \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\" (UID: \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\") " Jun 10 13:20:38.740857 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:38.740613 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2b685abf-906b-4eb7-8b19-24bc0e65adc6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\" (UID: \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\") " Jun 10 13:20:38.740857 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:38.740640 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b685abf-906b-4eb7-8b19-24bc0e65adc6-prometheus-trusted-ca-bundle\") pod \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\" (UID: \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\") " Jun 10 13:20:38.740857 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:38.740679 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2b685abf-906b-4eb7-8b19-24bc0e65adc6-secret-grpc-tls\") pod \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\" (UID: \"2b685abf-906b-4eb7-8b19-24bc0e65adc6\") " Jun 10 13:20:38.741341 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:38.740876 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b685abf-906b-4eb7-8b19-24bc0e65adc6-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "2b685abf-906b-4eb7-8b19-24bc0e65adc6" (UID: "2b685abf-906b-4eb7-8b19-24bc0e65adc6"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 13:20:38.741341 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:38.741044 2567 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2b685abf-906b-4eb7-8b19-24bc0e65adc6-configmap-metrics-client-ca\") on node \"ip-10-0-136-19.ec2.internal\" DevicePath \"\"" Jun 10 13:20:38.741341 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:38.741063 2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2b685abf-906b-4eb7-8b19-24bc0e65adc6-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-136-19.ec2.internal\" DevicePath \"\"" Jun 10 13:20:38.741341 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:38.741078 2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2b685abf-906b-4eb7-8b19-24bc0e65adc6-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-136-19.ec2.internal\" DevicePath \"\"" Jun 10 13:20:38.742506 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:38.742023 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b685abf-906b-4eb7-8b19-24bc0e65adc6-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "2b685abf-906b-4eb7-8b19-24bc0e65adc6" (UID: "2b685abf-906b-4eb7-8b19-24bc0e65adc6"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 13:20:38.742506 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:38.742283 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b685abf-906b-4eb7-8b19-24bc0e65adc6-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "2b685abf-906b-4eb7-8b19-24bc0e65adc6" (UID: "2b685abf-906b-4eb7-8b19-24bc0e65adc6"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 13:20:38.742910 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:38.742808 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b685abf-906b-4eb7-8b19-24bc0e65adc6-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "2b685abf-906b-4eb7-8b19-24bc0e65adc6" (UID: "2b685abf-906b-4eb7-8b19-24bc0e65adc6"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 13:20:38.744856 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:38.743672 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b685abf-906b-4eb7-8b19-24bc0e65adc6-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "2b685abf-906b-4eb7-8b19-24bc0e65adc6" (UID: "2b685abf-906b-4eb7-8b19-24bc0e65adc6"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 13:20:38.744856 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:38.744042 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b685abf-906b-4eb7-8b19-24bc0e65adc6-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "2b685abf-906b-4eb7-8b19-24bc0e65adc6" (UID: "2b685abf-906b-4eb7-8b19-24bc0e65adc6"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 13:20:38.744856 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:38.744103 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b685abf-906b-4eb7-8b19-24bc0e65adc6-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "2b685abf-906b-4eb7-8b19-24bc0e65adc6" (UID: "2b685abf-906b-4eb7-8b19-24bc0e65adc6"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 13:20:38.744856 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:38.744118 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b685abf-906b-4eb7-8b19-24bc0e65adc6-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "2b685abf-906b-4eb7-8b19-24bc0e65adc6" (UID: "2b685abf-906b-4eb7-8b19-24bc0e65adc6"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 13:20:38.744856 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:38.744735 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b685abf-906b-4eb7-8b19-24bc0e65adc6-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "2b685abf-906b-4eb7-8b19-24bc0e65adc6" (UID: "2b685abf-906b-4eb7-8b19-24bc0e65adc6"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 13:20:38.744856 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:38.744794 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b685abf-906b-4eb7-8b19-24bc0e65adc6-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "2b685abf-906b-4eb7-8b19-24bc0e65adc6" (UID: "2b685abf-906b-4eb7-8b19-24bc0e65adc6"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 13:20:38.745229 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:38.744883 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b685abf-906b-4eb7-8b19-24bc0e65adc6-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "2b685abf-906b-4eb7-8b19-24bc0e65adc6" (UID: "2b685abf-906b-4eb7-8b19-24bc0e65adc6"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 13:20:38.745229 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:38.744959 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b685abf-906b-4eb7-8b19-24bc0e65adc6-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "2b685abf-906b-4eb7-8b19-24bc0e65adc6" (UID: "2b685abf-906b-4eb7-8b19-24bc0e65adc6"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 13:20:38.745229 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:38.745038 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b685abf-906b-4eb7-8b19-24bc0e65adc6-config" (OuterVolumeSpecName: "config") pod "2b685abf-906b-4eb7-8b19-24bc0e65adc6" (UID: "2b685abf-906b-4eb7-8b19-24bc0e65adc6"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 13:20:38.746198 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:38.746167 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b685abf-906b-4eb7-8b19-24bc0e65adc6-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "2b685abf-906b-4eb7-8b19-24bc0e65adc6" (UID: "2b685abf-906b-4eb7-8b19-24bc0e65adc6"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 13:20:38.746309 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:38.746285 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b685abf-906b-4eb7-8b19-24bc0e65adc6-config-out" (OuterVolumeSpecName: "config-out") pod "2b685abf-906b-4eb7-8b19-24bc0e65adc6" (UID: "2b685abf-906b-4eb7-8b19-24bc0e65adc6"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 13:20:38.746605 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:38.746581 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b685abf-906b-4eb7-8b19-24bc0e65adc6-kube-api-access-tx8lj" (OuterVolumeSpecName: "kube-api-access-tx8lj") pod "2b685abf-906b-4eb7-8b19-24bc0e65adc6" (UID: "2b685abf-906b-4eb7-8b19-24bc0e65adc6"). InnerVolumeSpecName "kube-api-access-tx8lj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 13:20:38.747201 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:38.747178 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b685abf-906b-4eb7-8b19-24bc0e65adc6-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "2b685abf-906b-4eb7-8b19-24bc0e65adc6" (UID: "2b685abf-906b-4eb7-8b19-24bc0e65adc6"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 13:20:38.754163 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:38.754144 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b685abf-906b-4eb7-8b19-24bc0e65adc6-web-config" (OuterVolumeSpecName: "web-config") pod "2b685abf-906b-4eb7-8b19-24bc0e65adc6" (UID: "2b685abf-906b-4eb7-8b19-24bc0e65adc6"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 13:20:38.841716 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:38.841677 2567 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2b685abf-906b-4eb7-8b19-24bc0e65adc6-thanos-prometheus-http-client-file\") on node \"ip-10-0-136-19.ec2.internal\" DevicePath \"\"" Jun 10 13:20:38.841716 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:38.841716 2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2b685abf-906b-4eb7-8b19-24bc0e65adc6-prometheus-k8s-db\") on node \"ip-10-0-136-19.ec2.internal\" DevicePath \"\"" Jun 10 13:20:38.841716 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:38.841727 2567 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2b685abf-906b-4eb7-8b19-24bc0e65adc6-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-136-19.ec2.internal\" DevicePath \"\"" Jun 10 13:20:38.841948 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:38.841737 2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b685abf-906b-4eb7-8b19-24bc0e65adc6-prometheus-trusted-ca-bundle\") on node \"ip-10-0-136-19.ec2.internal\" DevicePath \"\"" Jun 10 13:20:38.841948 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:38.841746 2567 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2b685abf-906b-4eb7-8b19-24bc0e65adc6-secret-grpc-tls\") on node \"ip-10-0-136-19.ec2.internal\" DevicePath \"\"" Jun 10 13:20:38.841948 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:38.841772 2567 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2b685abf-906b-4eb7-8b19-24bc0e65adc6-web-config\") on node \"ip-10-0-136-19.ec2.internal\" DevicePath \"\"" Jun 10 13:20:38.841948 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:38.841780 2567 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2b685abf-906b-4eb7-8b19-24bc0e65adc6-secret-kube-rbac-proxy\") on node \"ip-10-0-136-19.ec2.internal\" DevicePath \"\"" Jun 10 13:20:38.841948 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:38.841788 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tx8lj\" (UniqueName: \"kubernetes.io/projected/2b685abf-906b-4eb7-8b19-24bc0e65adc6-kube-api-access-tx8lj\") on node \"ip-10-0-136-19.ec2.internal\" DevicePath \"\"" Jun 10 13:20:38.841948 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:38.841796 2567 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2b685abf-906b-4eb7-8b19-24bc0e65adc6-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-136-19.ec2.internal\" DevicePath \"\"" Jun 10 13:20:38.841948 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:38.841804 2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2b685abf-906b-4eb7-8b19-24bc0e65adc6-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-136-19.ec2.internal\" DevicePath \"\"" Jun 10 13:20:38.841948 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:38.841812 2567 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b685abf-906b-4eb7-8b19-24bc0e65adc6-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-136-19.ec2.internal\" DevicePath \"\"" Jun 10 13:20:38.841948 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:38.841820 2567 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/2b685abf-906b-4eb7-8b19-24bc0e65adc6-config\") on node \"ip-10-0-136-19.ec2.internal\" DevicePath \"\"" Jun 10 13:20:38.841948 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:38.841828 2567 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2b685abf-906b-4eb7-8b19-24bc0e65adc6-config-out\") on node \"ip-10-0-136-19.ec2.internal\" DevicePath \"\"" Jun 10 13:20:38.841948 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:38.841856 2567 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b685abf-906b-4eb7-8b19-24bc0e65adc6-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-136-19.ec2.internal\" DevicePath \"\"" Jun 10 13:20:38.841948 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:38.841865 2567 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2b685abf-906b-4eb7-8b19-24bc0e65adc6-secret-metrics-client-certs\") on node \"ip-10-0-136-19.ec2.internal\" DevicePath \"\"" Jun 10 13:20:38.841948 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:38.841874 2567 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2b685abf-906b-4eb7-8b19-24bc0e65adc6-secret-prometheus-k8s-tls\") on node \"ip-10-0-136-19.ec2.internal\" DevicePath \"\"" Jun 10 13:20:38.841948 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:38.841883 2567 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2b685abf-906b-4eb7-8b19-24bc0e65adc6-tls-assets\") on node \"ip-10-0-136-19.ec2.internal\" DevicePath \"\"" Jun 10 13:20:39.436973 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.436942 2567 generic.go:356] "Generic (PLEG): container finished" podID="2b685abf-906b-4eb7-8b19-24bc0e65adc6" containerID="0fd8659660d72a69006840f04e243b5f3c71bde98459f03e67154fecd0927372" exitCode=0 Jun 10 13:20:39.436973 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.436968 2567 generic.go:356] "Generic (PLEG): container finished" podID="2b685abf-906b-4eb7-8b19-24bc0e65adc6" containerID="2d4ed9288b04b5efe1410b724ef6ea2aa1204e72fc1fb58c61d8b24400185862" exitCode=0 Jun 10 13:20:39.437390 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.436982 2567 generic.go:356] "Generic (PLEG): container finished" podID="2b685abf-906b-4eb7-8b19-24bc0e65adc6" containerID="9d55d24f29f775138c4f71407602f0ab4f791184931ce29e3e73685ecede9ae5" exitCode=0 Jun 10 13:20:39.437390 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.436994 2567 generic.go:356] "Generic (PLEG): container finished" podID="2b685abf-906b-4eb7-8b19-24bc0e65adc6" containerID="da1cdc289bc7d847bcb3d9eacfd52671016673e1e01fc98dec094d6687dcd90a" exitCode=0 Jun 10 13:20:39.437390 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.437000 2567 generic.go:356] "Generic (PLEG): container finished" podID="2b685abf-906b-4eb7-8b19-24bc0e65adc6" containerID="21c8aae443bea0083bbdb2645ad30f7c563d6eb7ed469de648bec86869dac21c" exitCode=0 Jun 10 13:20:39.437390 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.437006 2567 generic.go:356] "Generic (PLEG): container finished" podID="2b685abf-906b-4eb7-8b19-24bc0e65adc6" containerID="eb92b63632c5568b1d199dd20a6de6df1667c6a2b7aef4a3ec1f1e7146039583" exitCode=0 Jun 10 13:20:39.437390 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.437005 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2b685abf-906b-4eb7-8b19-24bc0e65adc6","Type":"ContainerDied","Data":"0fd8659660d72a69006840f04e243b5f3c71bde98459f03e67154fecd0927372"} Jun 10 13:20:39.437390 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.437070 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2b685abf-906b-4eb7-8b19-24bc0e65adc6","Type":"ContainerDied","Data":"2d4ed9288b04b5efe1410b724ef6ea2aa1204e72fc1fb58c61d8b24400185862"} Jun 10 13:20:39.437390 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.437016 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:20:39.437390 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.437101 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2b685abf-906b-4eb7-8b19-24bc0e65adc6","Type":"ContainerDied","Data":"9d55d24f29f775138c4f71407602f0ab4f791184931ce29e3e73685ecede9ae5"} Jun 10 13:20:39.437390 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.437126 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2b685abf-906b-4eb7-8b19-24bc0e65adc6","Type":"ContainerDied","Data":"da1cdc289bc7d847bcb3d9eacfd52671016673e1e01fc98dec094d6687dcd90a"} Jun 10 13:20:39.437390 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.437152 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2b685abf-906b-4eb7-8b19-24bc0e65adc6","Type":"ContainerDied","Data":"21c8aae443bea0083bbdb2645ad30f7c563d6eb7ed469de648bec86869dac21c"} Jun 10 13:20:39.437390 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.437177 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2b685abf-906b-4eb7-8b19-24bc0e65adc6","Type":"ContainerDied","Data":"eb92b63632c5568b1d199dd20a6de6df1667c6a2b7aef4a3ec1f1e7146039583"} Jun 10 13:20:39.437390 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.437188 2567 scope.go:117] "RemoveContainer" containerID="0fd8659660d72a69006840f04e243b5f3c71bde98459f03e67154fecd0927372" Jun 10 13:20:39.437390 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.437201 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2b685abf-906b-4eb7-8b19-24bc0e65adc6","Type":"ContainerDied","Data":"e01886322a6d55746344c5c45a8c5eaf8ef3e3c6e977a22753ae689b43ddf262"} Jun 10 13:20:39.458650 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.458628 2567 scope.go:117] "RemoveContainer" containerID="2d4ed9288b04b5efe1410b724ef6ea2aa1204e72fc1fb58c61d8b24400185862" Jun 10 13:20:39.465674 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.465656 2567 scope.go:117] "RemoveContainer" containerID="9d55d24f29f775138c4f71407602f0ab4f791184931ce29e3e73685ecede9ae5" Jun 10 13:20:39.472133 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.472117 2567 scope.go:117] "RemoveContainer" containerID="da1cdc289bc7d847bcb3d9eacfd52671016673e1e01fc98dec094d6687dcd90a" Jun 10 13:20:39.478568 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.478552 2567 scope.go:117] "RemoveContainer" containerID="21c8aae443bea0083bbdb2645ad30f7c563d6eb7ed469de648bec86869dac21c" Jun 10 13:20:39.481218 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.481197 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 13:20:39.485965 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.485933 2567 scope.go:117] "RemoveContainer" containerID="eb92b63632c5568b1d199dd20a6de6df1667c6a2b7aef4a3ec1f1e7146039583" Jun 10 13:20:39.492959 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.492938 2567 scope.go:117] "RemoveContainer" containerID="b3da5c638920a42d707e75be6ac6c1f5d2595b3ba197e77a8e41bb2576c5bb80" Jun 10 13:20:39.497675 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.497649 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 13:20:39.500041 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.500020 2567 scope.go:117] "RemoveContainer" containerID="0fd8659660d72a69006840f04e243b5f3c71bde98459f03e67154fecd0927372" Jun 10 13:20:39.500281 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:20:39.500262 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0fd8659660d72a69006840f04e243b5f3c71bde98459f03e67154fecd0927372\": container with ID starting with 0fd8659660d72a69006840f04e243b5f3c71bde98459f03e67154fecd0927372 not found: ID does not exist" containerID="0fd8659660d72a69006840f04e243b5f3c71bde98459f03e67154fecd0927372" Jun 10 13:20:39.500323 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.500292 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fd8659660d72a69006840f04e243b5f3c71bde98459f03e67154fecd0927372"} err="failed to get container status \"0fd8659660d72a69006840f04e243b5f3c71bde98459f03e67154fecd0927372\": rpc error: code = NotFound desc = could not find container \"0fd8659660d72a69006840f04e243b5f3c71bde98459f03e67154fecd0927372\": container with ID starting with 0fd8659660d72a69006840f04e243b5f3c71bde98459f03e67154fecd0927372 not found: ID does not exist" Jun 10 13:20:39.500323 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.500314 2567 scope.go:117] "RemoveContainer" containerID="2d4ed9288b04b5efe1410b724ef6ea2aa1204e72fc1fb58c61d8b24400185862" Jun 10 13:20:39.500535 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:20:39.500516 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d4ed9288b04b5efe1410b724ef6ea2aa1204e72fc1fb58c61d8b24400185862\": container with ID starting with 2d4ed9288b04b5efe1410b724ef6ea2aa1204e72fc1fb58c61d8b24400185862 not found: ID does not exist" containerID="2d4ed9288b04b5efe1410b724ef6ea2aa1204e72fc1fb58c61d8b24400185862" Jun 10 13:20:39.500576 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.500541 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d4ed9288b04b5efe1410b724ef6ea2aa1204e72fc1fb58c61d8b24400185862"} err="failed to get container status \"2d4ed9288b04b5efe1410b724ef6ea2aa1204e72fc1fb58c61d8b24400185862\": rpc error: code = NotFound desc = could not find container \"2d4ed9288b04b5efe1410b724ef6ea2aa1204e72fc1fb58c61d8b24400185862\": container with ID starting with 2d4ed9288b04b5efe1410b724ef6ea2aa1204e72fc1fb58c61d8b24400185862 not found: ID does not exist" Jun 10 13:20:39.500576 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.500557 2567 scope.go:117] "RemoveContainer" containerID="9d55d24f29f775138c4f71407602f0ab4f791184931ce29e3e73685ecede9ae5" Jun 10 13:20:39.500776 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:20:39.500763 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d55d24f29f775138c4f71407602f0ab4f791184931ce29e3e73685ecede9ae5\": container with ID starting with 9d55d24f29f775138c4f71407602f0ab4f791184931ce29e3e73685ecede9ae5 not found: ID does not exist" containerID="9d55d24f29f775138c4f71407602f0ab4f791184931ce29e3e73685ecede9ae5" Jun 10 13:20:39.500828 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.500780 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d55d24f29f775138c4f71407602f0ab4f791184931ce29e3e73685ecede9ae5"} err="failed to get container status \"9d55d24f29f775138c4f71407602f0ab4f791184931ce29e3e73685ecede9ae5\": rpc error: code = NotFound desc = could not find container \"9d55d24f29f775138c4f71407602f0ab4f791184931ce29e3e73685ecede9ae5\": container with ID starting with 9d55d24f29f775138c4f71407602f0ab4f791184931ce29e3e73685ecede9ae5 not found: ID does not exist" Jun 10 13:20:39.500828 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.500804 2567 scope.go:117] "RemoveContainer" containerID="da1cdc289bc7d847bcb3d9eacfd52671016673e1e01fc98dec094d6687dcd90a" Jun 10 13:20:39.501069 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:20:39.501054 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da1cdc289bc7d847bcb3d9eacfd52671016673e1e01fc98dec094d6687dcd90a\": container with ID starting with da1cdc289bc7d847bcb3d9eacfd52671016673e1e01fc98dec094d6687dcd90a not found: ID does not exist" containerID="da1cdc289bc7d847bcb3d9eacfd52671016673e1e01fc98dec094d6687dcd90a" Jun 10 13:20:39.501120 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.501072 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da1cdc289bc7d847bcb3d9eacfd52671016673e1e01fc98dec094d6687dcd90a"} err="failed to get container status \"da1cdc289bc7d847bcb3d9eacfd52671016673e1e01fc98dec094d6687dcd90a\": rpc error: code = NotFound desc = could not find container \"da1cdc289bc7d847bcb3d9eacfd52671016673e1e01fc98dec094d6687dcd90a\": container with ID starting with da1cdc289bc7d847bcb3d9eacfd52671016673e1e01fc98dec094d6687dcd90a not found: ID does not exist" Jun 10 13:20:39.501120 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.501083 2567 scope.go:117] "RemoveContainer" containerID="21c8aae443bea0083bbdb2645ad30f7c563d6eb7ed469de648bec86869dac21c" Jun 10 13:20:39.501339 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:20:39.501324 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21c8aae443bea0083bbdb2645ad30f7c563d6eb7ed469de648bec86869dac21c\": container with ID starting with 21c8aae443bea0083bbdb2645ad30f7c563d6eb7ed469de648bec86869dac21c not found: ID does not exist" containerID="21c8aae443bea0083bbdb2645ad30f7c563d6eb7ed469de648bec86869dac21c" Jun 10 13:20:39.501383 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.501340 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21c8aae443bea0083bbdb2645ad30f7c563d6eb7ed469de648bec86869dac21c"} err="failed to get container status \"21c8aae443bea0083bbdb2645ad30f7c563d6eb7ed469de648bec86869dac21c\": rpc error: code = NotFound desc = could not find container \"21c8aae443bea0083bbdb2645ad30f7c563d6eb7ed469de648bec86869dac21c\": container with ID starting with 21c8aae443bea0083bbdb2645ad30f7c563d6eb7ed469de648bec86869dac21c not found: ID does not exist" Jun 10 13:20:39.501383 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.501362 2567 scope.go:117] "RemoveContainer" containerID="eb92b63632c5568b1d199dd20a6de6df1667c6a2b7aef4a3ec1f1e7146039583" Jun 10 13:20:39.501549 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:20:39.501532 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb92b63632c5568b1d199dd20a6de6df1667c6a2b7aef4a3ec1f1e7146039583\": container with ID starting with eb92b63632c5568b1d199dd20a6de6df1667c6a2b7aef4a3ec1f1e7146039583 not found: ID does not exist" containerID="eb92b63632c5568b1d199dd20a6de6df1667c6a2b7aef4a3ec1f1e7146039583" Jun 10 13:20:39.501591 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.501550 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb92b63632c5568b1d199dd20a6de6df1667c6a2b7aef4a3ec1f1e7146039583"} err="failed to get container status \"eb92b63632c5568b1d199dd20a6de6df1667c6a2b7aef4a3ec1f1e7146039583\": rpc error: code = NotFound desc = could not find container \"eb92b63632c5568b1d199dd20a6de6df1667c6a2b7aef4a3ec1f1e7146039583\": container with ID starting with eb92b63632c5568b1d199dd20a6de6df1667c6a2b7aef4a3ec1f1e7146039583 not found: ID does not exist" Jun 10 13:20:39.501591 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.501562 2567 scope.go:117] "RemoveContainer" containerID="b3da5c638920a42d707e75be6ac6c1f5d2595b3ba197e77a8e41bb2576c5bb80" Jun 10 13:20:39.501780 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:20:39.501763 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3da5c638920a42d707e75be6ac6c1f5d2595b3ba197e77a8e41bb2576c5bb80\": container with ID starting with b3da5c638920a42d707e75be6ac6c1f5d2595b3ba197e77a8e41bb2576c5bb80 not found: ID does not exist" containerID="b3da5c638920a42d707e75be6ac6c1f5d2595b3ba197e77a8e41bb2576c5bb80" Jun 10 13:20:39.501824 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.501783 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3da5c638920a42d707e75be6ac6c1f5d2595b3ba197e77a8e41bb2576c5bb80"} err="failed to get container status \"b3da5c638920a42d707e75be6ac6c1f5d2595b3ba197e77a8e41bb2576c5bb80\": rpc error: code = NotFound desc = could not find container \"b3da5c638920a42d707e75be6ac6c1f5d2595b3ba197e77a8e41bb2576c5bb80\": container with ID starting with b3da5c638920a42d707e75be6ac6c1f5d2595b3ba197e77a8e41bb2576c5bb80 not found: ID does not exist" Jun 10 13:20:39.501824 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.501797 2567 scope.go:117] "RemoveContainer" containerID="0fd8659660d72a69006840f04e243b5f3c71bde98459f03e67154fecd0927372" Jun 10 13:20:39.502045 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.502029 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fd8659660d72a69006840f04e243b5f3c71bde98459f03e67154fecd0927372"} err="failed to get container status \"0fd8659660d72a69006840f04e243b5f3c71bde98459f03e67154fecd0927372\": rpc error: code = NotFound desc = could not find container \"0fd8659660d72a69006840f04e243b5f3c71bde98459f03e67154fecd0927372\": container with ID starting with 0fd8659660d72a69006840f04e243b5f3c71bde98459f03e67154fecd0927372 not found: ID does not exist" Jun 10 13:20:39.502096 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.502044 2567 scope.go:117] "RemoveContainer" containerID="2d4ed9288b04b5efe1410b724ef6ea2aa1204e72fc1fb58c61d8b24400185862" Jun 10 13:20:39.502248 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.502231 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d4ed9288b04b5efe1410b724ef6ea2aa1204e72fc1fb58c61d8b24400185862"} err="failed to get container status \"2d4ed9288b04b5efe1410b724ef6ea2aa1204e72fc1fb58c61d8b24400185862\": rpc error: code = NotFound desc = could not find container \"2d4ed9288b04b5efe1410b724ef6ea2aa1204e72fc1fb58c61d8b24400185862\": container with ID starting with 2d4ed9288b04b5efe1410b724ef6ea2aa1204e72fc1fb58c61d8b24400185862 not found: ID does not exist" Jun 10 13:20:39.502294 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.502250 2567 scope.go:117] "RemoveContainer" containerID="9d55d24f29f775138c4f71407602f0ab4f791184931ce29e3e73685ecede9ae5" Jun 10 13:20:39.502437 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.502422 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d55d24f29f775138c4f71407602f0ab4f791184931ce29e3e73685ecede9ae5"} err="failed to get container status \"9d55d24f29f775138c4f71407602f0ab4f791184931ce29e3e73685ecede9ae5\": rpc error: code = NotFound desc = could not find container \"9d55d24f29f775138c4f71407602f0ab4f791184931ce29e3e73685ecede9ae5\": container with ID starting with 9d55d24f29f775138c4f71407602f0ab4f791184931ce29e3e73685ecede9ae5 not found: ID does not exist" Jun 10 13:20:39.502437 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.502436 2567 scope.go:117] "RemoveContainer" containerID="da1cdc289bc7d847bcb3d9eacfd52671016673e1e01fc98dec094d6687dcd90a" Jun 10 13:20:39.502649 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.502632 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da1cdc289bc7d847bcb3d9eacfd52671016673e1e01fc98dec094d6687dcd90a"} err="failed to get container status \"da1cdc289bc7d847bcb3d9eacfd52671016673e1e01fc98dec094d6687dcd90a\": rpc error: code = NotFound desc = could not find container \"da1cdc289bc7d847bcb3d9eacfd52671016673e1e01fc98dec094d6687dcd90a\": container with ID starting with da1cdc289bc7d847bcb3d9eacfd52671016673e1e01fc98dec094d6687dcd90a not found: ID does not exist" Jun 10 13:20:39.502700 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.502649 2567 scope.go:117] "RemoveContainer" containerID="21c8aae443bea0083bbdb2645ad30f7c563d6eb7ed469de648bec86869dac21c" Jun 10 13:20:39.502857 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.502827 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21c8aae443bea0083bbdb2645ad30f7c563d6eb7ed469de648bec86869dac21c"} err="failed to get container status \"21c8aae443bea0083bbdb2645ad30f7c563d6eb7ed469de648bec86869dac21c\": rpc error: code = NotFound desc = could not find container \"21c8aae443bea0083bbdb2645ad30f7c563d6eb7ed469de648bec86869dac21c\": container with ID starting with 21c8aae443bea0083bbdb2645ad30f7c563d6eb7ed469de648bec86869dac21c not found: ID does not exist" Jun 10 13:20:39.502917 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.502858 2567 scope.go:117] "RemoveContainer" containerID="eb92b63632c5568b1d199dd20a6de6df1667c6a2b7aef4a3ec1f1e7146039583" Jun 10 13:20:39.503055 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.503039 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb92b63632c5568b1d199dd20a6de6df1667c6a2b7aef4a3ec1f1e7146039583"} err="failed to get container status \"eb92b63632c5568b1d199dd20a6de6df1667c6a2b7aef4a3ec1f1e7146039583\": rpc error: code = NotFound desc = could not find container \"eb92b63632c5568b1d199dd20a6de6df1667c6a2b7aef4a3ec1f1e7146039583\": container with ID starting with eb92b63632c5568b1d199dd20a6de6df1667c6a2b7aef4a3ec1f1e7146039583 not found: ID does not exist" Jun 10 13:20:39.503098 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.503054 2567 scope.go:117] "RemoveContainer" containerID="b3da5c638920a42d707e75be6ac6c1f5d2595b3ba197e77a8e41bb2576c5bb80" Jun 10 13:20:39.503224 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.503209 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3da5c638920a42d707e75be6ac6c1f5d2595b3ba197e77a8e41bb2576c5bb80"} err="failed to get container status \"b3da5c638920a42d707e75be6ac6c1f5d2595b3ba197e77a8e41bb2576c5bb80\": rpc error: code = NotFound desc = could not find container \"b3da5c638920a42d707e75be6ac6c1f5d2595b3ba197e77a8e41bb2576c5bb80\": container with ID starting with b3da5c638920a42d707e75be6ac6c1f5d2595b3ba197e77a8e41bb2576c5bb80 not found: ID does not exist" Jun 10 13:20:39.503266 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.503224 2567 scope.go:117] "RemoveContainer" containerID="0fd8659660d72a69006840f04e243b5f3c71bde98459f03e67154fecd0927372" Jun 10 13:20:39.503431 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.503414 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fd8659660d72a69006840f04e243b5f3c71bde98459f03e67154fecd0927372"} err="failed to get container status \"0fd8659660d72a69006840f04e243b5f3c71bde98459f03e67154fecd0927372\": rpc error: code = NotFound desc = could not find container \"0fd8659660d72a69006840f04e243b5f3c71bde98459f03e67154fecd0927372\": container with ID starting with 0fd8659660d72a69006840f04e243b5f3c71bde98459f03e67154fecd0927372 not found: ID does not exist" Jun 10 13:20:39.503475 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.503431 2567 scope.go:117] "RemoveContainer" containerID="2d4ed9288b04b5efe1410b724ef6ea2aa1204e72fc1fb58c61d8b24400185862" Jun 10 13:20:39.503609 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.503594 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d4ed9288b04b5efe1410b724ef6ea2aa1204e72fc1fb58c61d8b24400185862"} err="failed to get container status \"2d4ed9288b04b5efe1410b724ef6ea2aa1204e72fc1fb58c61d8b24400185862\": rpc error: code = NotFound desc = could not find container \"2d4ed9288b04b5efe1410b724ef6ea2aa1204e72fc1fb58c61d8b24400185862\": container with ID starting with 2d4ed9288b04b5efe1410b724ef6ea2aa1204e72fc1fb58c61d8b24400185862 not found: ID does not exist" Jun 10 13:20:39.503652 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.503609 2567 scope.go:117] "RemoveContainer" containerID="9d55d24f29f775138c4f71407602f0ab4f791184931ce29e3e73685ecede9ae5" Jun 10 13:20:39.503797 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.503782 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d55d24f29f775138c4f71407602f0ab4f791184931ce29e3e73685ecede9ae5"} err="failed to get container status \"9d55d24f29f775138c4f71407602f0ab4f791184931ce29e3e73685ecede9ae5\": rpc error: code = NotFound desc = could not find container \"9d55d24f29f775138c4f71407602f0ab4f791184931ce29e3e73685ecede9ae5\": container with ID starting with 9d55d24f29f775138c4f71407602f0ab4f791184931ce29e3e73685ecede9ae5 not found: ID does not exist" Jun 10 13:20:39.503857 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.503797 2567 scope.go:117] "RemoveContainer" containerID="da1cdc289bc7d847bcb3d9eacfd52671016673e1e01fc98dec094d6687dcd90a" Jun 10 13:20:39.504039 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.504021 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da1cdc289bc7d847bcb3d9eacfd52671016673e1e01fc98dec094d6687dcd90a"} err="failed to get container status \"da1cdc289bc7d847bcb3d9eacfd52671016673e1e01fc98dec094d6687dcd90a\": rpc error: code = NotFound desc = could not find container \"da1cdc289bc7d847bcb3d9eacfd52671016673e1e01fc98dec094d6687dcd90a\": container with ID starting with da1cdc289bc7d847bcb3d9eacfd52671016673e1e01fc98dec094d6687dcd90a not found: ID does not exist" Jun 10 13:20:39.504096 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.504039 2567 scope.go:117] "RemoveContainer" containerID="21c8aae443bea0083bbdb2645ad30f7c563d6eb7ed469de648bec86869dac21c" Jun 10 13:20:39.504259 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.504242 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21c8aae443bea0083bbdb2645ad30f7c563d6eb7ed469de648bec86869dac21c"} err="failed to get container status \"21c8aae443bea0083bbdb2645ad30f7c563d6eb7ed469de648bec86869dac21c\": rpc error: code = NotFound desc = could not find container \"21c8aae443bea0083bbdb2645ad30f7c563d6eb7ed469de648bec86869dac21c\": container with ID starting with 21c8aae443bea0083bbdb2645ad30f7c563d6eb7ed469de648bec86869dac21c not found: ID does not exist" Jun 10 13:20:39.504305 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.504260 2567 scope.go:117] "RemoveContainer" containerID="eb92b63632c5568b1d199dd20a6de6df1667c6a2b7aef4a3ec1f1e7146039583" Jun 10 13:20:39.504436 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.504421 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb92b63632c5568b1d199dd20a6de6df1667c6a2b7aef4a3ec1f1e7146039583"} err="failed to get container status \"eb92b63632c5568b1d199dd20a6de6df1667c6a2b7aef4a3ec1f1e7146039583\": rpc error: code = NotFound desc = could not find container \"eb92b63632c5568b1d199dd20a6de6df1667c6a2b7aef4a3ec1f1e7146039583\": container with ID starting with eb92b63632c5568b1d199dd20a6de6df1667c6a2b7aef4a3ec1f1e7146039583 not found: ID does not exist" Jun 10 13:20:39.504481 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.504436 2567 scope.go:117] "RemoveContainer" containerID="b3da5c638920a42d707e75be6ac6c1f5d2595b3ba197e77a8e41bb2576c5bb80" Jun 10 13:20:39.504618 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.504602 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3da5c638920a42d707e75be6ac6c1f5d2595b3ba197e77a8e41bb2576c5bb80"} err="failed to get container status \"b3da5c638920a42d707e75be6ac6c1f5d2595b3ba197e77a8e41bb2576c5bb80\": rpc error: code = NotFound desc = could not find container \"b3da5c638920a42d707e75be6ac6c1f5d2595b3ba197e77a8e41bb2576c5bb80\": container with ID starting with b3da5c638920a42d707e75be6ac6c1f5d2595b3ba197e77a8e41bb2576c5bb80 not found: ID does not exist" Jun 10 13:20:39.504658 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.504617 2567 scope.go:117] "RemoveContainer" containerID="0fd8659660d72a69006840f04e243b5f3c71bde98459f03e67154fecd0927372" Jun 10 13:20:39.504774 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.504760 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fd8659660d72a69006840f04e243b5f3c71bde98459f03e67154fecd0927372"} err="failed to get container status \"0fd8659660d72a69006840f04e243b5f3c71bde98459f03e67154fecd0927372\": rpc error: code = NotFound desc = could not find container \"0fd8659660d72a69006840f04e243b5f3c71bde98459f03e67154fecd0927372\": container with ID starting with 0fd8659660d72a69006840f04e243b5f3c71bde98459f03e67154fecd0927372 not found: ID does not exist" Jun 10 13:20:39.504826 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.504775 2567 scope.go:117] "RemoveContainer" containerID="2d4ed9288b04b5efe1410b724ef6ea2aa1204e72fc1fb58c61d8b24400185862" Jun 10 13:20:39.505044 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.505027 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d4ed9288b04b5efe1410b724ef6ea2aa1204e72fc1fb58c61d8b24400185862"} err="failed to get container status \"2d4ed9288b04b5efe1410b724ef6ea2aa1204e72fc1fb58c61d8b24400185862\": rpc error: code = NotFound desc = could not find container \"2d4ed9288b04b5efe1410b724ef6ea2aa1204e72fc1fb58c61d8b24400185862\": container with ID starting with 2d4ed9288b04b5efe1410b724ef6ea2aa1204e72fc1fb58c61d8b24400185862 not found: ID does not exist" Jun 10 13:20:39.505089 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.505044 2567 scope.go:117] "RemoveContainer" containerID="9d55d24f29f775138c4f71407602f0ab4f791184931ce29e3e73685ecede9ae5" Jun 10 13:20:39.505225 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.505209 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d55d24f29f775138c4f71407602f0ab4f791184931ce29e3e73685ecede9ae5"} err="failed to get container status \"9d55d24f29f775138c4f71407602f0ab4f791184931ce29e3e73685ecede9ae5\": rpc error: code = NotFound desc = could not find container \"9d55d24f29f775138c4f71407602f0ab4f791184931ce29e3e73685ecede9ae5\": container with ID starting with 9d55d24f29f775138c4f71407602f0ab4f791184931ce29e3e73685ecede9ae5 not found: ID does not exist" Jun 10 13:20:39.505270 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.505225 2567 scope.go:117] "RemoveContainer" containerID="da1cdc289bc7d847bcb3d9eacfd52671016673e1e01fc98dec094d6687dcd90a" Jun 10 13:20:39.505424 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.505408 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da1cdc289bc7d847bcb3d9eacfd52671016673e1e01fc98dec094d6687dcd90a"} err="failed to get container status \"da1cdc289bc7d847bcb3d9eacfd52671016673e1e01fc98dec094d6687dcd90a\": rpc error: code = NotFound desc = could not find container \"da1cdc289bc7d847bcb3d9eacfd52671016673e1e01fc98dec094d6687dcd90a\": container with ID starting with da1cdc289bc7d847bcb3d9eacfd52671016673e1e01fc98dec094d6687dcd90a not found: ID does not exist" Jun 10 13:20:39.505468 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.505425 2567 scope.go:117] "RemoveContainer" containerID="21c8aae443bea0083bbdb2645ad30f7c563d6eb7ed469de648bec86869dac21c" Jun 10 13:20:39.505658 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.505641 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21c8aae443bea0083bbdb2645ad30f7c563d6eb7ed469de648bec86869dac21c"} err="failed to get container status \"21c8aae443bea0083bbdb2645ad30f7c563d6eb7ed469de648bec86869dac21c\": rpc error: code = NotFound desc = could not find container \"21c8aae443bea0083bbdb2645ad30f7c563d6eb7ed469de648bec86869dac21c\": container with ID starting with 21c8aae443bea0083bbdb2645ad30f7c563d6eb7ed469de648bec86869dac21c not found: ID does not exist" Jun 10 13:20:39.505697 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.505659 2567 scope.go:117] "RemoveContainer" containerID="eb92b63632c5568b1d199dd20a6de6df1667c6a2b7aef4a3ec1f1e7146039583" Jun 10 13:20:39.505882 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.505860 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb92b63632c5568b1d199dd20a6de6df1667c6a2b7aef4a3ec1f1e7146039583"} err="failed to get container status \"eb92b63632c5568b1d199dd20a6de6df1667c6a2b7aef4a3ec1f1e7146039583\": rpc error: code = NotFound desc = could not find container \"eb92b63632c5568b1d199dd20a6de6df1667c6a2b7aef4a3ec1f1e7146039583\": container with ID starting with eb92b63632c5568b1d199dd20a6de6df1667c6a2b7aef4a3ec1f1e7146039583 not found: ID does not exist" Jun 10 13:20:39.505928 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.505883 2567 scope.go:117] "RemoveContainer" containerID="b3da5c638920a42d707e75be6ac6c1f5d2595b3ba197e77a8e41bb2576c5bb80" Jun 10 13:20:39.506071 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.506054 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3da5c638920a42d707e75be6ac6c1f5d2595b3ba197e77a8e41bb2576c5bb80"} err="failed to get container status \"b3da5c638920a42d707e75be6ac6c1f5d2595b3ba197e77a8e41bb2576c5bb80\": rpc error: code = NotFound desc = could not find container \"b3da5c638920a42d707e75be6ac6c1f5d2595b3ba197e77a8e41bb2576c5bb80\": container with ID starting with b3da5c638920a42d707e75be6ac6c1f5d2595b3ba197e77a8e41bb2576c5bb80 not found: ID does not exist" Jun 10 13:20:39.506116 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.506071 2567 scope.go:117] "RemoveContainer" containerID="0fd8659660d72a69006840f04e243b5f3c71bde98459f03e67154fecd0927372" Jun 10 13:20:39.506252 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.506234 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fd8659660d72a69006840f04e243b5f3c71bde98459f03e67154fecd0927372"} err="failed to get container status \"0fd8659660d72a69006840f04e243b5f3c71bde98459f03e67154fecd0927372\": rpc error: code = NotFound desc = could not find container \"0fd8659660d72a69006840f04e243b5f3c71bde98459f03e67154fecd0927372\": container with ID starting with 0fd8659660d72a69006840f04e243b5f3c71bde98459f03e67154fecd0927372 not found: ID does not exist" Jun 10 13:20:39.506293 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.506252 2567 scope.go:117] "RemoveContainer" containerID="2d4ed9288b04b5efe1410b724ef6ea2aa1204e72fc1fb58c61d8b24400185862" Jun 10 13:20:39.506440 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.506424 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d4ed9288b04b5efe1410b724ef6ea2aa1204e72fc1fb58c61d8b24400185862"} err="failed to get container status \"2d4ed9288b04b5efe1410b724ef6ea2aa1204e72fc1fb58c61d8b24400185862\": rpc error: code = NotFound desc = could not find container \"2d4ed9288b04b5efe1410b724ef6ea2aa1204e72fc1fb58c61d8b24400185862\": container with ID starting with 2d4ed9288b04b5efe1410b724ef6ea2aa1204e72fc1fb58c61d8b24400185862 not found: ID does not exist" Jun 10 13:20:39.506475 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.506440 2567 scope.go:117] "RemoveContainer" containerID="9d55d24f29f775138c4f71407602f0ab4f791184931ce29e3e73685ecede9ae5" Jun 10 13:20:39.506611 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.506595 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d55d24f29f775138c4f71407602f0ab4f791184931ce29e3e73685ecede9ae5"} err="failed to get container status \"9d55d24f29f775138c4f71407602f0ab4f791184931ce29e3e73685ecede9ae5\": rpc error: code = NotFound desc = could not find container \"9d55d24f29f775138c4f71407602f0ab4f791184931ce29e3e73685ecede9ae5\": container with ID starting with 9d55d24f29f775138c4f71407602f0ab4f791184931ce29e3e73685ecede9ae5 not found: ID does not exist" Jun 10 13:20:39.506655 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.506611 2567 scope.go:117] "RemoveContainer" containerID="da1cdc289bc7d847bcb3d9eacfd52671016673e1e01fc98dec094d6687dcd90a" Jun 10 13:20:39.506792 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.506778 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da1cdc289bc7d847bcb3d9eacfd52671016673e1e01fc98dec094d6687dcd90a"} err="failed to get container status \"da1cdc289bc7d847bcb3d9eacfd52671016673e1e01fc98dec094d6687dcd90a\": rpc error: code = NotFound desc = could not find container \"da1cdc289bc7d847bcb3d9eacfd52671016673e1e01fc98dec094d6687dcd90a\": container with ID starting with da1cdc289bc7d847bcb3d9eacfd52671016673e1e01fc98dec094d6687dcd90a not found: ID does not exist" Jun 10 13:20:39.506833 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.506793 2567 scope.go:117] "RemoveContainer" containerID="21c8aae443bea0083bbdb2645ad30f7c563d6eb7ed469de648bec86869dac21c" Jun 10 13:20:39.507002 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.506985 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21c8aae443bea0083bbdb2645ad30f7c563d6eb7ed469de648bec86869dac21c"} err="failed to get container status \"21c8aae443bea0083bbdb2645ad30f7c563d6eb7ed469de648bec86869dac21c\": rpc error: code = NotFound desc = could not find container \"21c8aae443bea0083bbdb2645ad30f7c563d6eb7ed469de648bec86869dac21c\": container with ID starting with 21c8aae443bea0083bbdb2645ad30f7c563d6eb7ed469de648bec86869dac21c not found: ID does not exist" Jun 10 13:20:39.507101 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.507003 2567 scope.go:117] "RemoveContainer" containerID="eb92b63632c5568b1d199dd20a6de6df1667c6a2b7aef4a3ec1f1e7146039583" Jun 10 13:20:39.507176 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.507161 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb92b63632c5568b1d199dd20a6de6df1667c6a2b7aef4a3ec1f1e7146039583"} err="failed to get container status \"eb92b63632c5568b1d199dd20a6de6df1667c6a2b7aef4a3ec1f1e7146039583\": rpc error: code = NotFound desc = could not find container \"eb92b63632c5568b1d199dd20a6de6df1667c6a2b7aef4a3ec1f1e7146039583\": container with ID starting with eb92b63632c5568b1d199dd20a6de6df1667c6a2b7aef4a3ec1f1e7146039583 not found: ID does not exist" Jun 10 13:20:39.507221 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.507176 2567 scope.go:117] "RemoveContainer" containerID="b3da5c638920a42d707e75be6ac6c1f5d2595b3ba197e77a8e41bb2576c5bb80" Jun 10 13:20:39.507366 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.507352 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3da5c638920a42d707e75be6ac6c1f5d2595b3ba197e77a8e41bb2576c5bb80"} err="failed to get container status \"b3da5c638920a42d707e75be6ac6c1f5d2595b3ba197e77a8e41bb2576c5bb80\": rpc error: code = NotFound desc = could not find container \"b3da5c638920a42d707e75be6ac6c1f5d2595b3ba197e77a8e41bb2576c5bb80\": container with ID starting with b3da5c638920a42d707e75be6ac6c1f5d2595b3ba197e77a8e41bb2576c5bb80 not found: ID does not exist" Jun 10 13:20:39.507366 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.507365 2567 scope.go:117] "RemoveContainer" containerID="0fd8659660d72a69006840f04e243b5f3c71bde98459f03e67154fecd0927372" Jun 10 13:20:39.507545 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.507531 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fd8659660d72a69006840f04e243b5f3c71bde98459f03e67154fecd0927372"} err="failed to get container status \"0fd8659660d72a69006840f04e243b5f3c71bde98459f03e67154fecd0927372\": rpc error: code = NotFound desc = could not find container \"0fd8659660d72a69006840f04e243b5f3c71bde98459f03e67154fecd0927372\": container with ID starting with 0fd8659660d72a69006840f04e243b5f3c71bde98459f03e67154fecd0927372 not found: ID does not exist" Jun 10 13:20:39.507545 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.507544 2567 scope.go:117] "RemoveContainer" containerID="2d4ed9288b04b5efe1410b724ef6ea2aa1204e72fc1fb58c61d8b24400185862" Jun 10 13:20:39.507682 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.507668 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d4ed9288b04b5efe1410b724ef6ea2aa1204e72fc1fb58c61d8b24400185862"} err="failed to get container status \"2d4ed9288b04b5efe1410b724ef6ea2aa1204e72fc1fb58c61d8b24400185862\": rpc error: code = NotFound desc = could not find container \"2d4ed9288b04b5efe1410b724ef6ea2aa1204e72fc1fb58c61d8b24400185862\": container with ID starting with 2d4ed9288b04b5efe1410b724ef6ea2aa1204e72fc1fb58c61d8b24400185862 not found: ID does not exist" Jun 10 13:20:39.507682 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.507681 2567 scope.go:117] "RemoveContainer" containerID="9d55d24f29f775138c4f71407602f0ab4f791184931ce29e3e73685ecede9ae5" Jun 10 13:20:39.507831 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.507817 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d55d24f29f775138c4f71407602f0ab4f791184931ce29e3e73685ecede9ae5"} err="failed to get container status \"9d55d24f29f775138c4f71407602f0ab4f791184931ce29e3e73685ecede9ae5\": rpc error: code = NotFound desc = could not find container \"9d55d24f29f775138c4f71407602f0ab4f791184931ce29e3e73685ecede9ae5\": container with ID starting with 9d55d24f29f775138c4f71407602f0ab4f791184931ce29e3e73685ecede9ae5 not found: ID does not exist" Jun 10 13:20:39.507831 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.507830 2567 scope.go:117] "RemoveContainer" containerID="da1cdc289bc7d847bcb3d9eacfd52671016673e1e01fc98dec094d6687dcd90a" Jun 10 13:20:39.508035 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.508016 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da1cdc289bc7d847bcb3d9eacfd52671016673e1e01fc98dec094d6687dcd90a"} err="failed to get container status \"da1cdc289bc7d847bcb3d9eacfd52671016673e1e01fc98dec094d6687dcd90a\": rpc error: code = NotFound desc = could not find container \"da1cdc289bc7d847bcb3d9eacfd52671016673e1e01fc98dec094d6687dcd90a\": container with ID starting with da1cdc289bc7d847bcb3d9eacfd52671016673e1e01fc98dec094d6687dcd90a not found: ID does not exist" Jun 10 13:20:39.508100 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.508037 2567 scope.go:117] "RemoveContainer" containerID="21c8aae443bea0083bbdb2645ad30f7c563d6eb7ed469de648bec86869dac21c" Jun 10 13:20:39.508250 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.508232 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21c8aae443bea0083bbdb2645ad30f7c563d6eb7ed469de648bec86869dac21c"} err="failed to get container status \"21c8aae443bea0083bbdb2645ad30f7c563d6eb7ed469de648bec86869dac21c\": rpc error: code = NotFound desc = could not find container \"21c8aae443bea0083bbdb2645ad30f7c563d6eb7ed469de648bec86869dac21c\": container with ID starting with 21c8aae443bea0083bbdb2645ad30f7c563d6eb7ed469de648bec86869dac21c not found: ID does not exist" Jun 10 13:20:39.508288 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.508252 2567 scope.go:117] "RemoveContainer" containerID="eb92b63632c5568b1d199dd20a6de6df1667c6a2b7aef4a3ec1f1e7146039583" Jun 10 13:20:39.508433 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.508415 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb92b63632c5568b1d199dd20a6de6df1667c6a2b7aef4a3ec1f1e7146039583"} err="failed to get container status \"eb92b63632c5568b1d199dd20a6de6df1667c6a2b7aef4a3ec1f1e7146039583\": rpc error: code = NotFound desc = could not find container \"eb92b63632c5568b1d199dd20a6de6df1667c6a2b7aef4a3ec1f1e7146039583\": container with ID starting with eb92b63632c5568b1d199dd20a6de6df1667c6a2b7aef4a3ec1f1e7146039583 not found: ID does not exist" Jun 10 13:20:39.508497 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.508435 2567 scope.go:117] "RemoveContainer" containerID="b3da5c638920a42d707e75be6ac6c1f5d2595b3ba197e77a8e41bb2576c5bb80" Jun 10 13:20:39.508621 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.508606 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3da5c638920a42d707e75be6ac6c1f5d2595b3ba197e77a8e41bb2576c5bb80"} err="failed to get container status \"b3da5c638920a42d707e75be6ac6c1f5d2595b3ba197e77a8e41bb2576c5bb80\": rpc error: code = NotFound desc = could not find container \"b3da5c638920a42d707e75be6ac6c1f5d2595b3ba197e77a8e41bb2576c5bb80\": container with ID starting with b3da5c638920a42d707e75be6ac6c1f5d2595b3ba197e77a8e41bb2576c5bb80 not found: ID does not exist" Jun 10 13:20:39.526260 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.526235 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 13:20:39.526502 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.526491 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b685abf-906b-4eb7-8b19-24bc0e65adc6" containerName="kube-rbac-proxy-thanos" Jun 10 13:20:39.526544 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.526504 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b685abf-906b-4eb7-8b19-24bc0e65adc6" containerName="kube-rbac-proxy-thanos" Jun 10 13:20:39.526544 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.526514 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b685abf-906b-4eb7-8b19-24bc0e65adc6" containerName="init-config-reloader" Jun 10 13:20:39.526544 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.526519 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b685abf-906b-4eb7-8b19-24bc0e65adc6" containerName="init-config-reloader" Jun 10 13:20:39.526544 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.526526 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b685abf-906b-4eb7-8b19-24bc0e65adc6" containerName="kube-rbac-proxy" Jun 10 13:20:39.526544 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.526531 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b685abf-906b-4eb7-8b19-24bc0e65adc6" containerName="kube-rbac-proxy" Jun 10 13:20:39.526544 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.526540 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b685abf-906b-4eb7-8b19-24bc0e65adc6" containerName="config-reloader" Jun 10 13:20:39.526544 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.526546 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b685abf-906b-4eb7-8b19-24bc0e65adc6" containerName="config-reloader" Jun 10 13:20:39.526743 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.526551 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b685abf-906b-4eb7-8b19-24bc0e65adc6" containerName="kube-rbac-proxy-web" Jun 10 13:20:39.526743 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.526557 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b685abf-906b-4eb7-8b19-24bc0e65adc6" containerName="kube-rbac-proxy-web" Jun 10 13:20:39.526743 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.526568 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b685abf-906b-4eb7-8b19-24bc0e65adc6" containerName="thanos-sidecar" Jun 10 13:20:39.526743 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.526573 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b685abf-906b-4eb7-8b19-24bc0e65adc6" containerName="thanos-sidecar" Jun 10 13:20:39.526743 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.526580 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b685abf-906b-4eb7-8b19-24bc0e65adc6" containerName="prometheus" Jun 10 13:20:39.526743 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.526585 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b685abf-906b-4eb7-8b19-24bc0e65adc6" containerName="prometheus" Jun 10 13:20:39.526743 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.526595 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0af5812-3297-4e07-abdb-f54190eed2b4" containerName="registry" Jun 10 13:20:39.526743 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.526599 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0af5812-3297-4e07-abdb-f54190eed2b4" containerName="registry" Jun 10 13:20:39.526743 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.526643 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b685abf-906b-4eb7-8b19-24bc0e65adc6" containerName="thanos-sidecar" Jun 10 13:20:39.526743 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.526650 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0af5812-3297-4e07-abdb-f54190eed2b4" containerName="registry" Jun 10 13:20:39.526743 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.526657 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b685abf-906b-4eb7-8b19-24bc0e65adc6" containerName="kube-rbac-proxy-thanos" Jun 10 13:20:39.526743 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.526662 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b685abf-906b-4eb7-8b19-24bc0e65adc6" containerName="prometheus" Jun 10 13:20:39.526743 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.526668 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b685abf-906b-4eb7-8b19-24bc0e65adc6" containerName="config-reloader" Jun 10 13:20:39.526743 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.526672 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b685abf-906b-4eb7-8b19-24bc0e65adc6" containerName="kube-rbac-proxy" Jun 10 13:20:39.526743 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.526678 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b685abf-906b-4eb7-8b19-24bc0e65adc6" containerName="kube-rbac-proxy-web" Jun 10 13:20:39.530676 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.530660 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:20:39.535035 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.535014 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 10 13:20:39.535242 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.535227 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 10 13:20:39.535293 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.535241 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 10 13:20:39.535293 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.535265 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 10 13:20:39.535569 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.535551 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 10 13:20:39.535713 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.535581 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 10 13:20:39.536062 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.535928 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 10 13:20:39.536062 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.535939 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 10 13:20:39.536062 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.535950 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-14gsidmlvjhjk\"" Jun 10 13:20:39.536248 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.536077 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 10 13:20:39.536416 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.536398 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 10 13:20:39.536568 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.536524 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-72c6c\"" Jun 10 13:20:39.536754 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.536739 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 10 13:20:39.536909 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.536888 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 10 13:20:39.538902 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.538886 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 10 13:20:39.540773 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.540758 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 10 13:20:39.546940 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.546916 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 13:20:39.648496 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.648457 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4a7f737d-d213-45f9-8c62-cf2fe0e9459f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4a7f737d-d213-45f9-8c62-cf2fe0e9459f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:20:39.648496 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.648497 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4a7f737d-d213-45f9-8c62-cf2fe0e9459f-config-out\") pod \"prometheus-k8s-0\" (UID: \"4a7f737d-d213-45f9-8c62-cf2fe0e9459f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:20:39.648697 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.648517 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4a7f737d-d213-45f9-8c62-cf2fe0e9459f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4a7f737d-d213-45f9-8c62-cf2fe0e9459f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:20:39.648697 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.648535 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4a7f737d-d213-45f9-8c62-cf2fe0e9459f-config\") pod \"prometheus-k8s-0\" (UID: \"4a7f737d-d213-45f9-8c62-cf2fe0e9459f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:20:39.648697 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.648579 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4a7f737d-d213-45f9-8c62-cf2fe0e9459f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4a7f737d-d213-45f9-8c62-cf2fe0e9459f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:20:39.648697 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.648669 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4a7f737d-d213-45f9-8c62-cf2fe0e9459f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4a7f737d-d213-45f9-8c62-cf2fe0e9459f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:20:39.648830 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.648724 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4a7f737d-d213-45f9-8c62-cf2fe0e9459f-web-config\") pod \"prometheus-k8s-0\" (UID: \"4a7f737d-d213-45f9-8c62-cf2fe0e9459f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:20:39.648830 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.648749 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a7f737d-d213-45f9-8c62-cf2fe0e9459f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4a7f737d-d213-45f9-8c62-cf2fe0e9459f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:20:39.648830 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.648803 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4a7f737d-d213-45f9-8c62-cf2fe0e9459f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4a7f737d-d213-45f9-8c62-cf2fe0e9459f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:20:39.648830 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.648822 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a7f737d-d213-45f9-8c62-cf2fe0e9459f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4a7f737d-d213-45f9-8c62-cf2fe0e9459f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:20:39.648978 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.648865 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxwrd\" (UniqueName: \"kubernetes.io/projected/4a7f737d-d213-45f9-8c62-cf2fe0e9459f-kube-api-access-mxwrd\") pod \"prometheus-k8s-0\" (UID: \"4a7f737d-d213-45f9-8c62-cf2fe0e9459f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:20:39.648978 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.648883 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4a7f737d-d213-45f9-8c62-cf2fe0e9459f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4a7f737d-d213-45f9-8c62-cf2fe0e9459f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:20:39.648978 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.648904 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4a7f737d-d213-45f9-8c62-cf2fe0e9459f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4a7f737d-d213-45f9-8c62-cf2fe0e9459f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:20:39.648978 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.648935 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4a7f737d-d213-45f9-8c62-cf2fe0e9459f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4a7f737d-d213-45f9-8c62-cf2fe0e9459f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:20:39.648978 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.648954 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4a7f737d-d213-45f9-8c62-cf2fe0e9459f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4a7f737d-d213-45f9-8c62-cf2fe0e9459f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:20:39.648978 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.648975 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4a7f737d-d213-45f9-8c62-cf2fe0e9459f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4a7f737d-d213-45f9-8c62-cf2fe0e9459f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:20:39.649151 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.648991 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4a7f737d-d213-45f9-8c62-cf2fe0e9459f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4a7f737d-d213-45f9-8c62-cf2fe0e9459f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:20:39.649151 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.649012 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4a7f737d-d213-45f9-8c62-cf2fe0e9459f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4a7f737d-d213-45f9-8c62-cf2fe0e9459f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:20:39.649151 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.649034 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4a7f737d-d213-45f9-8c62-cf2fe0e9459f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4a7f737d-d213-45f9-8c62-cf2fe0e9459f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:20:39.649151 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.649064 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a7f737d-d213-45f9-8c62-cf2fe0e9459f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4a7f737d-d213-45f9-8c62-cf2fe0e9459f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:20:39.749438 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.749369 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4a7f737d-d213-45f9-8c62-cf2fe0e9459f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4a7f737d-d213-45f9-8c62-cf2fe0e9459f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:20:39.749438 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.749407 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a7f737d-d213-45f9-8c62-cf2fe0e9459f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4a7f737d-d213-45f9-8c62-cf2fe0e9459f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:20:39.749438 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.749422 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxwrd\" (UniqueName: \"kubernetes.io/projected/4a7f737d-d213-45f9-8c62-cf2fe0e9459f-kube-api-access-mxwrd\") pod \"prometheus-k8s-0\" (UID: \"4a7f737d-d213-45f9-8c62-cf2fe0e9459f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:20:39.749635 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.749443 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4a7f737d-d213-45f9-8c62-cf2fe0e9459f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4a7f737d-d213-45f9-8c62-cf2fe0e9459f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:20:39.749635 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.749462 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4a7f737d-d213-45f9-8c62-cf2fe0e9459f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4a7f737d-d213-45f9-8c62-cf2fe0e9459f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:20:39.749635 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.749494 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4a7f737d-d213-45f9-8c62-cf2fe0e9459f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4a7f737d-d213-45f9-8c62-cf2fe0e9459f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:20:39.749635 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.749610 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4a7f737d-d213-45f9-8c62-cf2fe0e9459f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4a7f737d-d213-45f9-8c62-cf2fe0e9459f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:20:39.749810 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.749658 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4a7f737d-d213-45f9-8c62-cf2fe0e9459f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4a7f737d-d213-45f9-8c62-cf2fe0e9459f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:20:39.749810 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.749689 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4a7f737d-d213-45f9-8c62-cf2fe0e9459f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4a7f737d-d213-45f9-8c62-cf2fe0e9459f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:20:39.749810 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.749715 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4a7f737d-d213-45f9-8c62-cf2fe0e9459f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4a7f737d-d213-45f9-8c62-cf2fe0e9459f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:20:39.749810 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.749744 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4a7f737d-d213-45f9-8c62-cf2fe0e9459f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4a7f737d-d213-45f9-8c62-cf2fe0e9459f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:20:39.750026 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.749872 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4a7f737d-d213-45f9-8c62-cf2fe0e9459f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4a7f737d-d213-45f9-8c62-cf2fe0e9459f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:20:39.750330 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.750291 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a7f737d-d213-45f9-8c62-cf2fe0e9459f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4a7f737d-d213-45f9-8c62-cf2fe0e9459f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:20:39.750460 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.750401 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4a7f737d-d213-45f9-8c62-cf2fe0e9459f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4a7f737d-d213-45f9-8c62-cf2fe0e9459f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:20:39.750460 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.750442 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a7f737d-d213-45f9-8c62-cf2fe0e9459f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4a7f737d-d213-45f9-8c62-cf2fe0e9459f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:20:39.750562 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.750479 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4a7f737d-d213-45f9-8c62-cf2fe0e9459f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4a7f737d-d213-45f9-8c62-cf2fe0e9459f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:20:39.750562 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.750518 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4a7f737d-d213-45f9-8c62-cf2fe0e9459f-config-out\") pod \"prometheus-k8s-0\" (UID: \"4a7f737d-d213-45f9-8c62-cf2fe0e9459f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:20:39.750562 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.750554 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4a7f737d-d213-45f9-8c62-cf2fe0e9459f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4a7f737d-d213-45f9-8c62-cf2fe0e9459f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:20:39.750710 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.750584 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4a7f737d-d213-45f9-8c62-cf2fe0e9459f-config\") pod \"prometheus-k8s-0\" (UID: \"4a7f737d-d213-45f9-8c62-cf2fe0e9459f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:20:39.750710 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.750635 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4a7f737d-d213-45f9-8c62-cf2fe0e9459f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4a7f737d-d213-45f9-8c62-cf2fe0e9459f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:20:39.750710 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.750666 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4a7f737d-d213-45f9-8c62-cf2fe0e9459f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4a7f737d-d213-45f9-8c62-cf2fe0e9459f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:20:39.750710 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.750697 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4a7f737d-d213-45f9-8c62-cf2fe0e9459f-web-config\") pod \"prometheus-k8s-0\" (UID: \"4a7f737d-d213-45f9-8c62-cf2fe0e9459f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:20:39.750942 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.750729 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a7f737d-d213-45f9-8c62-cf2fe0e9459f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4a7f737d-d213-45f9-8c62-cf2fe0e9459f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:20:39.752705 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.751421 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a7f737d-d213-45f9-8c62-cf2fe0e9459f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4a7f737d-d213-45f9-8c62-cf2fe0e9459f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:20:39.752705 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.752287 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a7f737d-d213-45f9-8c62-cf2fe0e9459f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4a7f737d-d213-45f9-8c62-cf2fe0e9459f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:20:39.752900 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.752827 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4a7f737d-d213-45f9-8c62-cf2fe0e9459f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4a7f737d-d213-45f9-8c62-cf2fe0e9459f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:20:39.752900 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.752829 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4a7f737d-d213-45f9-8c62-cf2fe0e9459f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4a7f737d-d213-45f9-8c62-cf2fe0e9459f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:20:39.752900 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.752873 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4a7f737d-d213-45f9-8c62-cf2fe0e9459f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4a7f737d-d213-45f9-8c62-cf2fe0e9459f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:20:39.752900 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.752883 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4a7f737d-d213-45f9-8c62-cf2fe0e9459f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4a7f737d-d213-45f9-8c62-cf2fe0e9459f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:20:39.753110 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.753068 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4a7f737d-d213-45f9-8c62-cf2fe0e9459f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4a7f737d-d213-45f9-8c62-cf2fe0e9459f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:20:39.753421 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.753395 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4a7f737d-d213-45f9-8c62-cf2fe0e9459f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4a7f737d-d213-45f9-8c62-cf2fe0e9459f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:20:39.753891 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.753867 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4a7f737d-d213-45f9-8c62-cf2fe0e9459f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4a7f737d-d213-45f9-8c62-cf2fe0e9459f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:20:39.754416 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.754364 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4a7f737d-d213-45f9-8c62-cf2fe0e9459f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4a7f737d-d213-45f9-8c62-cf2fe0e9459f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:20:39.754584 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.754562 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4a7f737d-d213-45f9-8c62-cf2fe0e9459f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4a7f737d-d213-45f9-8c62-cf2fe0e9459f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:20:39.754684 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.754670 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4a7f737d-d213-45f9-8c62-cf2fe0e9459f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4a7f737d-d213-45f9-8c62-cf2fe0e9459f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:20:39.755190 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.755166 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4a7f737d-d213-45f9-8c62-cf2fe0e9459f-config-out\") pod \"prometheus-k8s-0\" (UID: \"4a7f737d-d213-45f9-8c62-cf2fe0e9459f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:20:39.755330 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.755311 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/4a7f737d-d213-45f9-8c62-cf2fe0e9459f-config\") pod \"prometheus-k8s-0\" (UID: \"4a7f737d-d213-45f9-8c62-cf2fe0e9459f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:20:39.755472 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.755451 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4a7f737d-d213-45f9-8c62-cf2fe0e9459f-web-config\") pod \"prometheus-k8s-0\" (UID: \"4a7f737d-d213-45f9-8c62-cf2fe0e9459f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:20:39.756541 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.756520 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4a7f737d-d213-45f9-8c62-cf2fe0e9459f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4a7f737d-d213-45f9-8c62-cf2fe0e9459f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:20:39.760137 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.760115 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxwrd\" (UniqueName: \"kubernetes.io/projected/4a7f737d-d213-45f9-8c62-cf2fe0e9459f-kube-api-access-mxwrd\") pod \"prometheus-k8s-0\" (UID: \"4a7f737d-d213-45f9-8c62-cf2fe0e9459f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:20:39.802133 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.802106 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:20:39.841205 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.841179 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:20:39.903234 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.903198 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:20:39.982054 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:39.982033 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 13:20:39.983976 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:20:39.983953 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a7f737d_d213_45f9_8c62_cf2fe0e9459f.slice/crio-08a8b3d6216f128f3a92fc8bb869647ea3059fd995a22e74d35827faad3d61e0 WatchSource:0}: Error finding container 08a8b3d6216f128f3a92fc8bb869647ea3059fd995a22e74d35827faad3d61e0: Status 404 returned error can't find the container with id 08a8b3d6216f128f3a92fc8bb869647ea3059fd995a22e74d35827faad3d61e0 Jun 10 13:20:40.444156 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:40.444121 2567 generic.go:356] "Generic (PLEG): container finished" podID="4a7f737d-d213-45f9-8c62-cf2fe0e9459f" containerID="60ebaaa462902dbeb1715ada8778a067769ab2223abfb191d877ed6af50a1250" exitCode=0 Jun 10 13:20:40.444605 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:40.444217 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4a7f737d-d213-45f9-8c62-cf2fe0e9459f","Type":"ContainerDied","Data":"60ebaaa462902dbeb1715ada8778a067769ab2223abfb191d877ed6af50a1250"} Jun 10 13:20:40.444605 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:40.444317 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4a7f737d-d213-45f9-8c62-cf2fe0e9459f","Type":"ContainerStarted","Data":"08a8b3d6216f128f3a92fc8bb869647ea3059fd995a22e74d35827faad3d61e0"} Jun 10 13:20:41.165339 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:41.165300 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:20:41.207879 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:41.207826 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b685abf-906b-4eb7-8b19-24bc0e65adc6" path="/var/lib/kubelet/pods/2b685abf-906b-4eb7-8b19-24bc0e65adc6/volumes" Jun 10 13:20:41.381815 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:41.381777 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:20:41.446796 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:41.446701 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:20:41.452891 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:41.452859 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4a7f737d-d213-45f9-8c62-cf2fe0e9459f","Type":"ContainerStarted","Data":"8dc5a4bae3429020c7899e19f9287e4a6e7bd8d4b7c4a25a9f54564c9a3f2154"} Jun 10 13:20:41.453043 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:41.452934 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4a7f737d-d213-45f9-8c62-cf2fe0e9459f","Type":"ContainerStarted","Data":"5e893869d5668f292ce1fd789c6bdbeb7da9c5da62870a45a179064d8673012e"} Jun 10 13:20:41.453043 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:41.452978 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4a7f737d-d213-45f9-8c62-cf2fe0e9459f","Type":"ContainerStarted","Data":"b5720595d228050705a615a7490169f6d6e759fd92e700b323162e5369c9d8d7"} Jun 10 13:20:41.453043 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:41.453014 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4a7f737d-d213-45f9-8c62-cf2fe0e9459f","Type":"ContainerStarted","Data":"57ec155e6990e312c380c206f10f84783041a1d72b2481f7b6ea7595f995e33f"} Jun 10 13:20:41.453204 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:41.453052 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4a7f737d-d213-45f9-8c62-cf2fe0e9459f","Type":"ContainerStarted","Data":"7dcfc1dd2ca8f231d9ac7c4b96d84865eef3c523d557a51fb1bb55fb3ebabdd1"} Jun 10 13:20:41.453204 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:41.453092 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4a7f737d-d213-45f9-8c62-cf2fe0e9459f","Type":"ContainerStarted","Data":"4cc585c7092418760e32f97ce0fbef1ae5390c04aed920bc0bbbd875573c9714"} Jun 10 13:20:41.484742 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:41.484674 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.462364712 podStartE2EDuration="2.484650232s" totalImagesPullingTime="0s" totalInitContainerRuntime="22.28552ms" isStatefulPod=false podCreationTimestamp="2026-06-10 13:20:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:20:41.482476227 +0000 UTC m=+348.747726863" watchObservedRunningTime="2026-06-10 13:20:41.484650232 +0000 UTC m=+348.749900830" Jun 10 13:20:41.898362 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:41.898327 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:20:41.953334 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:41.953288 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:20:44.841806 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:44.841769 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:20:51.605348 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:51.605309 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:20:51.668379 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:51.668345 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:20:51.725558 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:51.725524 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:20:54.808197 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:54.808165 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:20:54.883318 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:20:54.883286 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:21:09.300810 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:21:09.300765 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:21:39.842344 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:21:39.842308 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:21:39.857790 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:21:39.857767 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:21:40.700616 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:21:40.700588 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 13:21:48.299136 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:21:48.299090 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:21:48.400645 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:21:48.400613 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:21:49.683582 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:21:49.683551 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:21:49.743046 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:21:49.743013 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:21:49.821531 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:21:49.821494 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:21:49.884339 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:21:49.884298 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:21:50.422309 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:21:50.422276 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:21:50.482297 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:21:50.482260 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:22:00.207385 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:22:00.207346 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:22:00.277460 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:22:00.277429 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:22:00.869164 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:22:00.869125 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:22:00.937440 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:22:00.937405 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:22:01.028819 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:22:01.028780 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:22:09.811573 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:22:09.811538 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:22:09.913076 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:22:09.913043 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:22:10.259663 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:22:10.259634 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:22:30.550441 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:22:30.550402 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:22:50.619586 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:22:50.619544 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:22:50.714205 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:22:50.714170 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:23:12.156329 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:23:12.156289 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:23:13.052284 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:23:13.052249 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:23:15.965955 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:23:15.965911 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:23:16.036350 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:23:16.036313 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:23:17.401556 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:23:17.401524 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:23:17.509977 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:23:17.509939 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:23:17.638060 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:23:17.638025 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:23:20.905638 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:23:20.905601 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:23:21.276381 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:23:21.276287 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:23:22.990921 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:23:22.990881 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:23:23.077970 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:23:23.077932 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:23:25.339963 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:23:25.339933 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:23:25.513564 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:23:25.513529 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:23:29.074239 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:23:29.074189 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:23:29.750112 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:23:29.750074 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:23:30.554960 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:23:30.554925 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-r82cz"] Jun 10 13:23:30.557303 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:23:30.557286 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-r82cz" Jun 10 13:23:30.562685 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:23:30.562656 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-fnztq\"" Jun 10 13:23:30.562799 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:23:30.562711 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 10 13:23:30.563881 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:23:30.563863 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 10 13:23:30.574418 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:23:30.574393 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-r82cz"] Jun 10 13:23:30.601167 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:23:30.601136 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8v4jc\" (UniqueName: \"kubernetes.io/projected/0b4299d3-8d4c-4237-b215-2279462c5c0b-kube-api-access-8v4jc\") pod \"cert-manager-59c77684cc-r82cz\" (UID: \"0b4299d3-8d4c-4237-b215-2279462c5c0b\") " pod="cert-manager/cert-manager-59c77684cc-r82cz" Jun 10 13:23:30.601285 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:23:30.601201 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0b4299d3-8d4c-4237-b215-2279462c5c0b-bound-sa-token\") pod \"cert-manager-59c77684cc-r82cz\" (UID: \"0b4299d3-8d4c-4237-b215-2279462c5c0b\") " pod="cert-manager/cert-manager-59c77684cc-r82cz" Jun 10 13:23:30.701653 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:23:30.701623 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8v4jc\" (UniqueName: \"kubernetes.io/projected/0b4299d3-8d4c-4237-b215-2279462c5c0b-kube-api-access-8v4jc\") pod \"cert-manager-59c77684cc-r82cz\" (UID: \"0b4299d3-8d4c-4237-b215-2279462c5c0b\") " pod="cert-manager/cert-manager-59c77684cc-r82cz" Jun 10 13:23:30.701801 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:23:30.701662 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0b4299d3-8d4c-4237-b215-2279462c5c0b-bound-sa-token\") pod \"cert-manager-59c77684cc-r82cz\" (UID: \"0b4299d3-8d4c-4237-b215-2279462c5c0b\") " pod="cert-manager/cert-manager-59c77684cc-r82cz" Jun 10 13:23:30.710548 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:23:30.710517 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0b4299d3-8d4c-4237-b215-2279462c5c0b-bound-sa-token\") pod \"cert-manager-59c77684cc-r82cz\" (UID: \"0b4299d3-8d4c-4237-b215-2279462c5c0b\") " pod="cert-manager/cert-manager-59c77684cc-r82cz" Jun 10 13:23:30.710655 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:23:30.710585 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8v4jc\" (UniqueName: \"kubernetes.io/projected/0b4299d3-8d4c-4237-b215-2279462c5c0b-kube-api-access-8v4jc\") pod \"cert-manager-59c77684cc-r82cz\" (UID: \"0b4299d3-8d4c-4237-b215-2279462c5c0b\") " pod="cert-manager/cert-manager-59c77684cc-r82cz" Jun 10 13:23:30.866510 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:23:30.866431 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-r82cz" Jun 10 13:23:30.991014 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:23:30.990989 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-r82cz"] Jun 10 13:23:30.993753 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:23:30.993729 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0b4299d3_8d4c_4237_b215_2279462c5c0b.slice/crio-aeeccf9202e69a13ea82e3da70b0fb3838d99d91c9bd016b2fe739add975318b WatchSource:0}: Error finding container aeeccf9202e69a13ea82e3da70b0fb3838d99d91c9bd016b2fe739add975318b: Status 404 returned error can't find the container with id aeeccf9202e69a13ea82e3da70b0fb3838d99d91c9bd016b2fe739add975318b Jun 10 13:23:30.996085 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:23:30.996066 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 13:23:31.109337 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:23:31.109304 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-r82cz" event={"ID":"0b4299d3-8d4c-4237-b215-2279462c5c0b","Type":"ContainerStarted","Data":"aeeccf9202e69a13ea82e3da70b0fb3838d99d91c9bd016b2fe739add975318b"} Jun 10 13:23:34.124342 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:23:34.124306 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-r82cz" event={"ID":"0b4299d3-8d4c-4237-b215-2279462c5c0b","Type":"ContainerStarted","Data":"de843dec509b25e727d73ec05919f05e46a64a0abc25f206102c7fe774f6ffd8"} Jun 10 13:23:34.150197 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:23:34.150146 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-r82cz" podStartSLOduration=1.5570752730000001 podStartE2EDuration="4.150131251s" totalImagesPullingTime="2.593055978s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:23:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:23:34.148862699 +0000 UTC m=+521.414113297" watchObservedRunningTime="2026-06-10 13:23:34.150131251 +0000 UTC m=+521.415381848" Jun 10 13:23:35.930467 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:23:35.930426 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:23:36.046225 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:23:36.046191 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:23:37.268850 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:23:37.268815 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ztsr9"] Jun 10 13:23:37.271337 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:23:37.271319 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ztsr9" Jun 10 13:23:37.274108 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:23:37.274089 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 10 13:23:37.274223 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:23:37.274203 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-t6mmj\"" Jun 10 13:23:37.275485 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:23:37.275470 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 10 13:23:37.287615 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:23:37.287594 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ztsr9"] Jun 10 13:23:37.358236 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:23:37.358204 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2p9v\" (UniqueName: \"kubernetes.io/projected/11e37311-283e-48f7-b2d5-0f500a1608e3-kube-api-access-h2p9v\") pod \"openshift-lws-operator-fd8ccff4c-ztsr9\" (UID: \"11e37311-283e-48f7-b2d5-0f500a1608e3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ztsr9" Jun 10 13:23:37.358377 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:23:37.358270 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/11e37311-283e-48f7-b2d5-0f500a1608e3-tmp\") pod \"openshift-lws-operator-fd8ccff4c-ztsr9\" (UID: \"11e37311-283e-48f7-b2d5-0f500a1608e3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ztsr9" Jun 10 13:23:37.459558 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:23:37.459519 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2p9v\" (UniqueName: \"kubernetes.io/projected/11e37311-283e-48f7-b2d5-0f500a1608e3-kube-api-access-h2p9v\") pod \"openshift-lws-operator-fd8ccff4c-ztsr9\" (UID: \"11e37311-283e-48f7-b2d5-0f500a1608e3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ztsr9" Jun 10 13:23:37.459714 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:23:37.459595 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/11e37311-283e-48f7-b2d5-0f500a1608e3-tmp\") pod \"openshift-lws-operator-fd8ccff4c-ztsr9\" (UID: \"11e37311-283e-48f7-b2d5-0f500a1608e3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ztsr9" Jun 10 13:23:37.460000 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:23:37.459982 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/11e37311-283e-48f7-b2d5-0f500a1608e3-tmp\") pod \"openshift-lws-operator-fd8ccff4c-ztsr9\" (UID: \"11e37311-283e-48f7-b2d5-0f500a1608e3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ztsr9" Jun 10 13:23:37.470069 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:23:37.470044 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2p9v\" (UniqueName: \"kubernetes.io/projected/11e37311-283e-48f7-b2d5-0f500a1608e3-kube-api-access-h2p9v\") pod \"openshift-lws-operator-fd8ccff4c-ztsr9\" (UID: \"11e37311-283e-48f7-b2d5-0f500a1608e3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ztsr9" Jun 10 13:23:37.580257 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:23:37.580179 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ztsr9" Jun 10 13:23:37.725521 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:23:37.725442 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ztsr9"] Jun 10 13:23:37.728107 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:23:37.728074 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod11e37311_283e_48f7_b2d5_0f500a1608e3.slice/crio-7713e676bfb753fcec796b9defe58cdca2839ab1abc4b1deb8be78596d6e5314 WatchSource:0}: Error finding container 7713e676bfb753fcec796b9defe58cdca2839ab1abc4b1deb8be78596d6e5314: Status 404 returned error can't find the container with id 7713e676bfb753fcec796b9defe58cdca2839ab1abc4b1deb8be78596d6e5314 Jun 10 13:23:38.144345 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:23:38.144270 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ztsr9" event={"ID":"11e37311-283e-48f7-b2d5-0f500a1608e3","Type":"ContainerStarted","Data":"7713e676bfb753fcec796b9defe58cdca2839ab1abc4b1deb8be78596d6e5314"} Jun 10 13:23:42.164344 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:23:42.164310 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ztsr9" event={"ID":"11e37311-283e-48f7-b2d5-0f500a1608e3","Type":"ContainerStarted","Data":"6338d976a40fed33a63a241dcd485421b7df7caabefa684ca6507467a403d21d"} Jun 10 13:23:42.208266 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:23:42.208215 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ztsr9" podStartSLOduration=1.3707433359999999 podStartE2EDuration="5.208198672s" totalImagesPullingTime="3.837455336s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:23:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:23:42.205764699 +0000 UTC m=+529.471015296" watchObservedRunningTime="2026-06-10 13:23:42.208198672 +0000 UTC m=+529.473449268" Jun 10 13:23:43.090512 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:23:43.090478 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:23:43.261919 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:23:43.261883 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:23:44.749160 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:23:44.749128 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:23:55.025440 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:23:55.025408 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:23:55.175471 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:23:55.175443 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:24:03.754296 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:03.754256 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:24:04.401798 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:04.401765 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:24:04.652272 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:04.652183 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:24:04.769079 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:04.769046 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8d74f49dd-88b87"] Jun 10 13:24:04.771522 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:04.771504 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-8d74f49dd-88b87" Jun 10 13:24:04.775139 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:04.775113 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 10 13:24:04.775266 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:04.775154 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 10 13:24:04.775266 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:04.775197 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-zzz2l\"" Jun 10 13:24:04.776332 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:04.776312 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 10 13:24:04.776529 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:04.776516 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 10 13:24:04.800386 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:04.800358 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5eb8305d-4f8d-4ab3-8ecb-460da6640830-manifests\") pod \"opendatahub-operator-controller-manager-8d74f49dd-88b87\" (UID: \"5eb8305d-4f8d-4ab3-8ecb-460da6640830\") " pod="opendatahub/opendatahub-operator-controller-manager-8d74f49dd-88b87" Jun 10 13:24:04.800620 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:04.800404 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5eb8305d-4f8d-4ab3-8ecb-460da6640830-webhook-cert\") pod \"opendatahub-operator-controller-manager-8d74f49dd-88b87\" (UID: \"5eb8305d-4f8d-4ab3-8ecb-460da6640830\") " pod="opendatahub/opendatahub-operator-controller-manager-8d74f49dd-88b87" Jun 10 13:24:04.800620 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:04.800467 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5eb8305d-4f8d-4ab3-8ecb-460da6640830-tmp\") pod \"opendatahub-operator-controller-manager-8d74f49dd-88b87\" (UID: \"5eb8305d-4f8d-4ab3-8ecb-460da6640830\") " pod="opendatahub/opendatahub-operator-controller-manager-8d74f49dd-88b87" Jun 10 13:24:04.800620 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:04.800508 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lj6wd\" (UniqueName: \"kubernetes.io/projected/5eb8305d-4f8d-4ab3-8ecb-460da6640830-kube-api-access-lj6wd\") pod \"opendatahub-operator-controller-manager-8d74f49dd-88b87\" (UID: \"5eb8305d-4f8d-4ab3-8ecb-460da6640830\") " pod="opendatahub/opendatahub-operator-controller-manager-8d74f49dd-88b87" Jun 10 13:24:04.800620 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:04.800539 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5eb8305d-4f8d-4ab3-8ecb-460da6640830-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8d74f49dd-88b87\" (UID: \"5eb8305d-4f8d-4ab3-8ecb-460da6640830\") " pod="opendatahub/opendatahub-operator-controller-manager-8d74f49dd-88b87" Jun 10 13:24:04.803552 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:04.803525 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8d74f49dd-88b87"] Jun 10 13:24:04.901137 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:04.901103 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5eb8305d-4f8d-4ab3-8ecb-460da6640830-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8d74f49dd-88b87\" (UID: \"5eb8305d-4f8d-4ab3-8ecb-460da6640830\") " pod="opendatahub/opendatahub-operator-controller-manager-8d74f49dd-88b87" Jun 10 13:24:04.901307 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:04.901164 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5eb8305d-4f8d-4ab3-8ecb-460da6640830-manifests\") pod \"opendatahub-operator-controller-manager-8d74f49dd-88b87\" (UID: \"5eb8305d-4f8d-4ab3-8ecb-460da6640830\") " pod="opendatahub/opendatahub-operator-controller-manager-8d74f49dd-88b87" Jun 10 13:24:04.901307 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:04.901196 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5eb8305d-4f8d-4ab3-8ecb-460da6640830-webhook-cert\") pod \"opendatahub-operator-controller-manager-8d74f49dd-88b87\" (UID: \"5eb8305d-4f8d-4ab3-8ecb-460da6640830\") " pod="opendatahub/opendatahub-operator-controller-manager-8d74f49dd-88b87" Jun 10 13:24:04.901307 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:04.901217 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5eb8305d-4f8d-4ab3-8ecb-460da6640830-tmp\") pod \"opendatahub-operator-controller-manager-8d74f49dd-88b87\" (UID: \"5eb8305d-4f8d-4ab3-8ecb-460da6640830\") " pod="opendatahub/opendatahub-operator-controller-manager-8d74f49dd-88b87" Jun 10 13:24:04.901307 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:04.901260 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lj6wd\" (UniqueName: \"kubernetes.io/projected/5eb8305d-4f8d-4ab3-8ecb-460da6640830-kube-api-access-lj6wd\") pod \"opendatahub-operator-controller-manager-8d74f49dd-88b87\" (UID: \"5eb8305d-4f8d-4ab3-8ecb-460da6640830\") " pod="opendatahub/opendatahub-operator-controller-manager-8d74f49dd-88b87" Jun 10 13:24:04.901620 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:04.901601 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5eb8305d-4f8d-4ab3-8ecb-460da6640830-manifests\") pod \"opendatahub-operator-controller-manager-8d74f49dd-88b87\" (UID: \"5eb8305d-4f8d-4ab3-8ecb-460da6640830\") " pod="opendatahub/opendatahub-operator-controller-manager-8d74f49dd-88b87" Jun 10 13:24:04.903431 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:04.903372 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5eb8305d-4f8d-4ab3-8ecb-460da6640830-tmp\") pod \"opendatahub-operator-controller-manager-8d74f49dd-88b87\" (UID: \"5eb8305d-4f8d-4ab3-8ecb-460da6640830\") " pod="opendatahub/opendatahub-operator-controller-manager-8d74f49dd-88b87" Jun 10 13:24:04.903605 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:04.903584 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5eb8305d-4f8d-4ab3-8ecb-460da6640830-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8d74f49dd-88b87\" (UID: \"5eb8305d-4f8d-4ab3-8ecb-460da6640830\") " pod="opendatahub/opendatahub-operator-controller-manager-8d74f49dd-88b87" Jun 10 13:24:04.903646 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:04.903619 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5eb8305d-4f8d-4ab3-8ecb-460da6640830-webhook-cert\") pod \"opendatahub-operator-controller-manager-8d74f49dd-88b87\" (UID: \"5eb8305d-4f8d-4ab3-8ecb-460da6640830\") " pod="opendatahub/opendatahub-operator-controller-manager-8d74f49dd-88b87" Jun 10 13:24:04.909999 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:04.909976 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lj6wd\" (UniqueName: \"kubernetes.io/projected/5eb8305d-4f8d-4ab3-8ecb-460da6640830-kube-api-access-lj6wd\") pod \"opendatahub-operator-controller-manager-8d74f49dd-88b87\" (UID: \"5eb8305d-4f8d-4ab3-8ecb-460da6640830\") " pod="opendatahub/opendatahub-operator-controller-manager-8d74f49dd-88b87" Jun 10 13:24:04.916980 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:04.916952 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:24:05.019857 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:05.019812 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:24:05.082004 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:05.081960 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-8d74f49dd-88b87" Jun 10 13:24:05.117244 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:05.117205 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:24:05.223035 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:05.223006 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8d74f49dd-88b87"] Jun 10 13:24:05.225585 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:24:05.225563 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5eb8305d_4f8d_4ab3_8ecb_460da6640830.slice/crio-35a3d21dfa83be6312c2fad49d287fa980ce11d5fcc0a78e8d3b0e4fd081a846 WatchSource:0}: Error finding container 35a3d21dfa83be6312c2fad49d287fa980ce11d5fcc0a78e8d3b0e4fd081a846: Status 404 returned error can't find the container with id 35a3d21dfa83be6312c2fad49d287fa980ce11d5fcc0a78e8d3b0e4fd081a846 Jun 10 13:24:05.227751 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:05.227724 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:24:05.255107 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:05.255077 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8d74f49dd-88b87" event={"ID":"5eb8305d-4f8d-4ab3-8ecb-460da6640830","Type":"ContainerStarted","Data":"35a3d21dfa83be6312c2fad49d287fa980ce11d5fcc0a78e8d3b0e4fd081a846"} Jun 10 13:24:05.320559 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:05.320525 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:24:05.426747 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:05.426659 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:24:07.782418 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:07.782367 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:24:08.270643 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:08.270612 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8d74f49dd-88b87" event={"ID":"5eb8305d-4f8d-4ab3-8ecb-460da6640830","Type":"ContainerStarted","Data":"8ca83582e1f3f831f9e9df2f34b3898e2f0aa0fb579d395c482f5ff4b537b667"} Jun 10 13:24:08.969457 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:08.969423 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:24:10.280272 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:10.280236 2567 generic.go:356] "Generic (PLEG): container finished" podID="5eb8305d-4f8d-4ab3-8ecb-460da6640830" containerID="8ca83582e1f3f831f9e9df2f34b3898e2f0aa0fb579d395c482f5ff4b537b667" exitCode=0 Jun 10 13:24:10.280723 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:10.280313 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8d74f49dd-88b87" event={"ID":"5eb8305d-4f8d-4ab3-8ecb-460da6640830","Type":"ContainerDied","Data":"8ca83582e1f3f831f9e9df2f34b3898e2f0aa0fb579d395c482f5ff4b537b667"} Jun 10 13:24:11.286396 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:11.286365 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8d74f49dd-88b87" event={"ID":"5eb8305d-4f8d-4ab3-8ecb-460da6640830","Type":"ContainerStarted","Data":"45eba4b398ee82b20815cc775460e083bf4b9dbe305305a9c643f95da6628fc0"} Jun 10 13:24:11.286783 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:11.286581 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-8d74f49dd-88b87" Jun 10 13:24:13.608377 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:13.608342 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:24:22.292944 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:22.292913 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-8d74f49dd-88b87" Jun 10 13:24:22.326401 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:22.326349 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-8d74f49dd-88b87" podStartSLOduration=14.01825946 podStartE2EDuration="18.326335031s" totalImagesPullingTime="3.227002032s" totalInitContainerRuntime="1.081073539s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:24:04 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:24:11.327433795 +0000 UTC m=+558.592684392" watchObservedRunningTime="2026-06-10 13:24:22.326335031 +0000 UTC m=+569.591585628" Jun 10 13:24:24.332380 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:24.332337 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:24:24.542108 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:24.542073 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:24:24.828919 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:24.828873 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:24:25.023825 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:25.023789 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5d56c4765b-gqkxs"] Jun 10 13:24:25.033892 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:25.033870 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5d56c4765b-gqkxs" Jun 10 13:24:25.039462 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:24:25.039436 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"kube-auth-proxy-dockercfg-gnbqk\" is forbidden: User \"system:node:ip-10-0-136-19.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-136-19.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-gnbqk\"" type="*v1.Secret" Jun 10 13:24:25.039462 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:24:25.039439 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kube-auth-proxy-5d56c4765b-gqkxs\" is forbidden: User \"system:node:ip-10-0-136-19.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-136-19.ec2.internal' and this object" podUID="da37b35a-87a1-48c1-b6c9-4dbe8cb597d7" pod="openshift-ingress/kube-auth-proxy-5d56c4765b-gqkxs" Jun 10 13:24:25.067415 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:24:25.067385 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"kube-auth-proxy-tls\" is forbidden: User \"system:node:ip-10-0-136-19.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-136-19.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" type="*v1.Secret" Jun 10 13:24:25.070427 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:24:25.070402 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-136-19.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-136-19.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" Jun 10 13:24:25.070668 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:24:25.070650 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-136-19.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-136-19.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" Jun 10 13:24:25.070713 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:24:25.070647 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"kube-auth-proxy-creds\" is forbidden: User \"system:node:ip-10-0-136-19.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-136-19.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" type="*v1.Secret" Jun 10 13:24:25.078329 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:25.078307 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da37b35a-87a1-48c1-b6c9-4dbe8cb597d7-tls-certs\") pod \"kube-auth-proxy-5d56c4765b-gqkxs\" (UID: \"da37b35a-87a1-48c1-b6c9-4dbe8cb597d7\") " pod="openshift-ingress/kube-auth-proxy-5d56c4765b-gqkxs" Jun 10 13:24:25.078416 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:25.078335 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/da37b35a-87a1-48c1-b6c9-4dbe8cb597d7-tmp\") pod \"kube-auth-proxy-5d56c4765b-gqkxs\" (UID: \"da37b35a-87a1-48c1-b6c9-4dbe8cb597d7\") " pod="openshift-ingress/kube-auth-proxy-5d56c4765b-gqkxs" Jun 10 13:24:25.078416 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:25.078369 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p84h7\" (UniqueName: \"kubernetes.io/projected/da37b35a-87a1-48c1-b6c9-4dbe8cb597d7-kube-api-access-p84h7\") pod \"kube-auth-proxy-5d56c4765b-gqkxs\" (UID: \"da37b35a-87a1-48c1-b6c9-4dbe8cb597d7\") " pod="openshift-ingress/kube-auth-proxy-5d56c4765b-gqkxs" Jun 10 13:24:25.111515 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:25.111455 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:24:25.179132 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:25.179099 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da37b35a-87a1-48c1-b6c9-4dbe8cb597d7-tls-certs\") pod \"kube-auth-proxy-5d56c4765b-gqkxs\" (UID: \"da37b35a-87a1-48c1-b6c9-4dbe8cb597d7\") " pod="openshift-ingress/kube-auth-proxy-5d56c4765b-gqkxs" Jun 10 13:24:25.179132 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:25.179141 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/da37b35a-87a1-48c1-b6c9-4dbe8cb597d7-tmp\") pod \"kube-auth-proxy-5d56c4765b-gqkxs\" (UID: \"da37b35a-87a1-48c1-b6c9-4dbe8cb597d7\") " pod="openshift-ingress/kube-auth-proxy-5d56c4765b-gqkxs" Jun 10 13:24:25.179346 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:25.179207 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p84h7\" (UniqueName: \"kubernetes.io/projected/da37b35a-87a1-48c1-b6c9-4dbe8cb597d7-kube-api-access-p84h7\") pod \"kube-auth-proxy-5d56c4765b-gqkxs\" (UID: \"da37b35a-87a1-48c1-b6c9-4dbe8cb597d7\") " pod="openshift-ingress/kube-auth-proxy-5d56c4765b-gqkxs" Jun 10 13:24:25.180658 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:25.180633 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5d56c4765b-gqkxs"] Jun 10 13:24:25.181609 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:25.181580 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/da37b35a-87a1-48c1-b6c9-4dbe8cb597d7-tmp\") pod \"kube-auth-proxy-5d56c4765b-gqkxs\" (UID: \"da37b35a-87a1-48c1-b6c9-4dbe8cb597d7\") " pod="openshift-ingress/kube-auth-proxy-5d56c4765b-gqkxs" Jun 10 13:24:25.452581 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:25.452549 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:24:25.576414 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:25.576382 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-hl6td"] Jun 10 13:24:25.579730 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:25.579715 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-hl6td" Jun 10 13:24:25.582980 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:24:25.582952 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"odh-model-controller-6dc94f689f-hl6td\" is forbidden: User \"system:node:ip-10-0-136-19.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-19.ec2.internal' and this object" podUID="6876de3c-7afb-4006-9bb3-b2e3ea28e618" pod="opendatahub/odh-model-controller-6dc94f689f-hl6td" Jun 10 13:24:25.583227 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:24:25.583205 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"odh-model-controller-webhook-cert\" is forbidden: User \"system:node:ip-10-0-136-19.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-19.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" type="*v1.Secret" Jun 10 13:24:25.583227 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:24:25.583212 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"odh-model-controller-dockercfg-xc8mr\" is forbidden: User \"system:node:ip-10-0-136-19.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-19.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-xc8mr\"" type="*v1.Secret" Jun 10 13:24:25.624957 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:25.624927 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-hl6td"] Jun 10 13:24:25.682553 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:25.682522 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgsgx\" (UniqueName: \"kubernetes.io/projected/6876de3c-7afb-4006-9bb3-b2e3ea28e618-kube-api-access-qgsgx\") pod \"odh-model-controller-6dc94f689f-hl6td\" (UID: \"6876de3c-7afb-4006-9bb3-b2e3ea28e618\") " pod="opendatahub/odh-model-controller-6dc94f689f-hl6td" Jun 10 13:24:25.682698 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:25.682560 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6876de3c-7afb-4006-9bb3-b2e3ea28e618-cert\") pod \"odh-model-controller-6dc94f689f-hl6td\" (UID: \"6876de3c-7afb-4006-9bb3-b2e3ea28e618\") " pod="opendatahub/odh-model-controller-6dc94f689f-hl6td" Jun 10 13:24:25.703523 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:25.703445 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:24:25.783607 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:25.783552 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgsgx\" (UniqueName: \"kubernetes.io/projected/6876de3c-7afb-4006-9bb3-b2e3ea28e618-kube-api-access-qgsgx\") pod \"odh-model-controller-6dc94f689f-hl6td\" (UID: \"6876de3c-7afb-4006-9bb3-b2e3ea28e618\") " pod="opendatahub/odh-model-controller-6dc94f689f-hl6td" Jun 10 13:24:25.783783 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:25.783615 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6876de3c-7afb-4006-9bb3-b2e3ea28e618-cert\") pod \"odh-model-controller-6dc94f689f-hl6td\" (UID: \"6876de3c-7afb-4006-9bb3-b2e3ea28e618\") " pod="opendatahub/odh-model-controller-6dc94f689f-hl6td" Jun 10 13:24:25.828386 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:25.828348 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgsgx\" (UniqueName: \"kubernetes.io/projected/6876de3c-7afb-4006-9bb3-b2e3ea28e618-kube-api-access-qgsgx\") pod \"odh-model-controller-6dc94f689f-hl6td\" (UID: \"6876de3c-7afb-4006-9bb3-b2e3ea28e618\") " pod="opendatahub/odh-model-controller-6dc94f689f-hl6td" Jun 10 13:24:25.920990 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:25.920963 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 10 13:24:25.937680 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:25.937646 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:24:25.943802 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:25.943783 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 10 13:24:25.955259 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:25.955199 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p84h7\" (UniqueName: \"kubernetes.io/projected/da37b35a-87a1-48c1-b6c9-4dbe8cb597d7-kube-api-access-p84h7\") pod \"kube-auth-proxy-5d56c4765b-gqkxs\" (UID: \"da37b35a-87a1-48c1-b6c9-4dbe8cb597d7\") " pod="openshift-ingress/kube-auth-proxy-5d56c4765b-gqkxs" Jun 10 13:24:26.129413 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:26.129382 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:24:26.179888 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:24:26.179865 2567 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: failed to sync secret cache: timed out waiting for the condition Jun 10 13:24:26.180041 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:24:26.179949 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da37b35a-87a1-48c1-b6c9-4dbe8cb597d7-tls-certs podName:da37b35a-87a1-48c1-b6c9-4dbe8cb597d7 nodeName:}" failed. No retries permitted until 2026-06-10 13:24:26.67992605 +0000 UTC m=+573.945176630 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/da37b35a-87a1-48c1-b6c9-4dbe8cb597d7-tls-certs") pod "kube-auth-proxy-5d56c4765b-gqkxs" (UID: "da37b35a-87a1-48c1-b6c9-4dbe8cb597d7") : failed to sync secret cache: timed out waiting for the condition Jun 10 13:24:26.342152 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:26.342065 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 10 13:24:26.439227 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:26.439197 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-gnbqk\"" Jun 10 13:24:26.483388 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:26.483363 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 10 13:24:26.693184 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:26.693150 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da37b35a-87a1-48c1-b6c9-4dbe8cb597d7-tls-certs\") pod \"kube-auth-proxy-5d56c4765b-gqkxs\" (UID: \"da37b35a-87a1-48c1-b6c9-4dbe8cb597d7\") " pod="openshift-ingress/kube-auth-proxy-5d56c4765b-gqkxs" Jun 10 13:24:26.695539 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:26.695520 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da37b35a-87a1-48c1-b6c9-4dbe8cb597d7-tls-certs\") pod \"kube-auth-proxy-5d56c4765b-gqkxs\" (UID: \"da37b35a-87a1-48c1-b6c9-4dbe8cb597d7\") " pod="openshift-ingress/kube-auth-proxy-5d56c4765b-gqkxs" Jun 10 13:24:26.784223 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:24:26.784192 2567 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: failed to sync secret cache: timed out waiting for the condition Jun 10 13:24:26.784374 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:24:26.784286 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6876de3c-7afb-4006-9bb3-b2e3ea28e618-cert podName:6876de3c-7afb-4006-9bb3-b2e3ea28e618 nodeName:}" failed. No retries permitted until 2026-06-10 13:24:27.284270081 +0000 UTC m=+574.549520656 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/6876de3c-7afb-4006-9bb3-b2e3ea28e618-cert") pod "odh-model-controller-6dc94f689f-hl6td" (UID: "6876de3c-7afb-4006-9bb3-b2e3ea28e618") : failed to sync secret cache: timed out waiting for the condition Jun 10 13:24:26.843119 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:26.843087 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5d56c4765b-gqkxs" Jun 10 13:24:26.983894 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:26.983808 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 10 13:24:26.998792 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:26.998765 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5d56c4765b-gqkxs"] Jun 10 13:24:27.002229 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:24:27.002200 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda37b35a_87a1_48c1_b6c9_4dbe8cb597d7.slice/crio-a515e4937b1d0c5e0b62cde082343eddd6e40e56447f9c82b456ef01c2940a87 WatchSource:0}: Error finding container a515e4937b1d0c5e0b62cde082343eddd6e40e56447f9c82b456ef01c2940a87: Status 404 returned error can't find the container with id a515e4937b1d0c5e0b62cde082343eddd6e40e56447f9c82b456ef01c2940a87 Jun 10 13:24:27.156211 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:27.156187 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-xc8mr\"" Jun 10 13:24:27.298914 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:27.298782 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6876de3c-7afb-4006-9bb3-b2e3ea28e618-cert\") pod \"odh-model-controller-6dc94f689f-hl6td\" (UID: \"6876de3c-7afb-4006-9bb3-b2e3ea28e618\") " pod="opendatahub/odh-model-controller-6dc94f689f-hl6td" Jun 10 13:24:27.301148 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:27.301129 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6876de3c-7afb-4006-9bb3-b2e3ea28e618-cert\") pod \"odh-model-controller-6dc94f689f-hl6td\" (UID: \"6876de3c-7afb-4006-9bb3-b2e3ea28e618\") " pod="opendatahub/odh-model-controller-6dc94f689f-hl6td" Jun 10 13:24:27.359639 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:27.359605 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5d56c4765b-gqkxs" event={"ID":"da37b35a-87a1-48c1-b6c9-4dbe8cb597d7","Type":"ContainerStarted","Data":"a515e4937b1d0c5e0b62cde082343eddd6e40e56447f9c82b456ef01c2940a87"} Jun 10 13:24:27.389760 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:27.389729 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-hl6td" Jun 10 13:24:27.393702 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:27.393677 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-cvs5w"] Jun 10 13:24:27.397158 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:27.397135 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-cvs5w" Jun 10 13:24:27.400370 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:27.400349 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 10 13:24:27.421399 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:27.421371 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-cvs5w"] Jun 10 13:24:27.431925 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:27.431672 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:24:27.500479 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:27.500442 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/62335bfd-f63f-4175-8453-db01b5b258dd-tls-certs\") pod \"model-serving-api-5dd488fc48-cvs5w\" (UID: \"62335bfd-f63f-4175-8453-db01b5b258dd\") " pod="opendatahub/model-serving-api-5dd488fc48-cvs5w" Jun 10 13:24:27.501074 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:27.500507 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xscs8\" (UniqueName: \"kubernetes.io/projected/62335bfd-f63f-4175-8453-db01b5b258dd-kube-api-access-xscs8\") pod \"model-serving-api-5dd488fc48-cvs5w\" (UID: \"62335bfd-f63f-4175-8453-db01b5b258dd\") " pod="opendatahub/model-serving-api-5dd488fc48-cvs5w" Jun 10 13:24:27.564005 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:27.563922 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-hl6td"] Jun 10 13:24:27.568037 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:24:27.567998 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6876de3c_7afb_4006_9bb3_b2e3ea28e618.slice/crio-c870f8b7709623edba3ddfb31bdb6a91e43c39699e21d7d46829652d99120f11 WatchSource:0}: Error finding container c870f8b7709623edba3ddfb31bdb6a91e43c39699e21d7d46829652d99120f11: Status 404 returned error can't find the container with id c870f8b7709623edba3ddfb31bdb6a91e43c39699e21d7d46829652d99120f11 Jun 10 13:24:27.601535 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:27.601459 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/62335bfd-f63f-4175-8453-db01b5b258dd-tls-certs\") pod \"model-serving-api-5dd488fc48-cvs5w\" (UID: \"62335bfd-f63f-4175-8453-db01b5b258dd\") " pod="opendatahub/model-serving-api-5dd488fc48-cvs5w" Jun 10 13:24:27.601535 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:27.601521 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xscs8\" (UniqueName: \"kubernetes.io/projected/62335bfd-f63f-4175-8453-db01b5b258dd-kube-api-access-xscs8\") pod \"model-serving-api-5dd488fc48-cvs5w\" (UID: \"62335bfd-f63f-4175-8453-db01b5b258dd\") " pod="opendatahub/model-serving-api-5dd488fc48-cvs5w" Jun 10 13:24:27.604500 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:27.604451 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/62335bfd-f63f-4175-8453-db01b5b258dd-tls-certs\") pod \"model-serving-api-5dd488fc48-cvs5w\" (UID: \"62335bfd-f63f-4175-8453-db01b5b258dd\") " pod="opendatahub/model-serving-api-5dd488fc48-cvs5w" Jun 10 13:24:27.637449 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:27.637421 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xscs8\" (UniqueName: \"kubernetes.io/projected/62335bfd-f63f-4175-8453-db01b5b258dd-kube-api-access-xscs8\") pod \"model-serving-api-5dd488fc48-cvs5w\" (UID: \"62335bfd-f63f-4175-8453-db01b5b258dd\") " pod="opendatahub/model-serving-api-5dd488fc48-cvs5w" Jun 10 13:24:27.655391 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:27.655361 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:24:27.711341 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:27.711106 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-cvs5w" Jun 10 13:24:27.893337 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:27.893262 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-cvs5w"] Jun 10 13:24:27.895099 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:24:27.895069 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62335bfd_f63f_4175_8453_db01b5b258dd.slice/crio-a9a2c89c3017e84f1f494c68e694df61197118b19585f25105a6d14da3a383c6 WatchSource:0}: Error finding container a9a2c89c3017e84f1f494c68e694df61197118b19585f25105a6d14da3a383c6: Status 404 returned error can't find the container with id a9a2c89c3017e84f1f494c68e694df61197118b19585f25105a6d14da3a383c6 Jun 10 13:24:28.368601 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:28.368468 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-hl6td" event={"ID":"6876de3c-7afb-4006-9bb3-b2e3ea28e618","Type":"ContainerStarted","Data":"c870f8b7709623edba3ddfb31bdb6a91e43c39699e21d7d46829652d99120f11"} Jun 10 13:24:28.370692 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:28.370657 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-cvs5w" event={"ID":"62335bfd-f63f-4175-8453-db01b5b258dd","Type":"ContainerStarted","Data":"a9a2c89c3017e84f1f494c68e694df61197118b19585f25105a6d14da3a383c6"} Jun 10 13:24:32.398355 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:32.398325 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-hl6td" event={"ID":"6876de3c-7afb-4006-9bb3-b2e3ea28e618","Type":"ContainerStarted","Data":"238635f160827ccc8ebb3e7b59dc9f9b9a96b052e7d641a93d65725f2ae728cc"} Jun 10 13:24:32.398790 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:32.398414 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-hl6td" Jun 10 13:24:32.399938 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:32.399907 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-cvs5w" event={"ID":"62335bfd-f63f-4175-8453-db01b5b258dd","Type":"ContainerStarted","Data":"61a20b5f339b1cc6ba60efa1cb8c12069225e2712641a2898dea4a194ea216e3"} Jun 10 13:24:32.400038 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:32.399963 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-cvs5w" Jun 10 13:24:32.401153 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:32.401131 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5d56c4765b-gqkxs" event={"ID":"da37b35a-87a1-48c1-b6c9-4dbe8cb597d7","Type":"ContainerStarted","Data":"3ee200b48f88ee3d52fdf36413406e91c3b0d778296bc4131310a1c6a25def3d"} Jun 10 13:24:32.460130 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:32.460085 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-hl6td" podStartSLOduration=3.582052632 podStartE2EDuration="7.460069659s" totalImagesPullingTime="3.878017027s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:24:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:24:32.458233479 +0000 UTC m=+579.723484076" watchObservedRunningTime="2026-06-10 13:24:32.460069659 +0000 UTC m=+579.725320256" Jun 10 13:24:32.503283 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:32.503238 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-cvs5w" podStartSLOduration=1.954814001 podStartE2EDuration="5.503218924s" totalImagesPullingTime="3.548404923s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:24:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:24:32.502049764 +0000 UTC m=+579.767300362" watchObservedRunningTime="2026-06-10 13:24:32.503218924 +0000 UTC m=+579.768469522" Jun 10 13:24:32.542100 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:32.542048 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5d56c4765b-gqkxs" podStartSLOduration=4.107875546 podStartE2EDuration="8.542030422s" totalImagesPullingTime="4.434154876s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:24:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:24:32.541470911 +0000 UTC m=+579.806721531" watchObservedRunningTime="2026-06-10 13:24:32.542030422 +0000 UTC m=+579.807281060" Jun 10 13:24:38.494147 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:38.494105 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:24:38.650319 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:38.650282 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-97ppl"] Jun 10 13:24:38.654381 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:38.654364 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-97ppl" Jun 10 13:24:38.659584 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:38.659559 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-sjcjr\"" Jun 10 13:24:38.664525 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:38.664506 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 10 13:24:38.701666 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:38.701635 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-97ppl"] Jun 10 13:24:38.736734 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:38.736667 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-kxdct"] Jun 10 13:24:38.741747 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:38.741722 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-kxdct" Jun 10 13:24:38.745115 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:38.745052 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 10 13:24:38.745115 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:38.745088 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-xrdvm\"" Jun 10 13:24:38.764530 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:38.764504 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-kxdct"] Jun 10 13:24:38.808262 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:38.808229 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/abc6ce51-f171-4896-b474-7df5441b770f-cert\") pod \"kserve-controller-manager-69fc866d76-97ppl\" (UID: \"abc6ce51-f171-4896-b474-7df5441b770f\") " pod="opendatahub/kserve-controller-manager-69fc866d76-97ppl" Jun 10 13:24:38.808440 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:38.808285 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8sln\" (UniqueName: \"kubernetes.io/projected/abc6ce51-f171-4896-b474-7df5441b770f-kube-api-access-c8sln\") pod \"kserve-controller-manager-69fc866d76-97ppl\" (UID: \"abc6ce51-f171-4896-b474-7df5441b770f\") " pod="opendatahub/kserve-controller-manager-69fc866d76-97ppl" Jun 10 13:24:38.816468 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:38.816438 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:24:38.909116 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:38.909082 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/abc6ce51-f171-4896-b474-7df5441b770f-cert\") pod \"kserve-controller-manager-69fc866d76-97ppl\" (UID: \"abc6ce51-f171-4896-b474-7df5441b770f\") " pod="opendatahub/kserve-controller-manager-69fc866d76-97ppl" Jun 10 13:24:38.909280 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:38.909166 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bc223ffa-3cbe-42ca-85ea-639dd9570746-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-kxdct\" (UID: \"bc223ffa-3cbe-42ca-85ea-639dd9570746\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-kxdct" Jun 10 13:24:38.909280 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:38.909202 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8sln\" (UniqueName: \"kubernetes.io/projected/abc6ce51-f171-4896-b474-7df5441b770f-kube-api-access-c8sln\") pod \"kserve-controller-manager-69fc866d76-97ppl\" (UID: \"abc6ce51-f171-4896-b474-7df5441b770f\") " pod="opendatahub/kserve-controller-manager-69fc866d76-97ppl" Jun 10 13:24:38.909280 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:38.909234 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbxjj\" (UniqueName: \"kubernetes.io/projected/bc223ffa-3cbe-42ca-85ea-639dd9570746-kube-api-access-bbxjj\") pod \"llmisvc-controller-manager-864bfd7bc9-kxdct\" (UID: \"bc223ffa-3cbe-42ca-85ea-639dd9570746\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-kxdct" Jun 10 13:24:38.911650 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:38.911625 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/abc6ce51-f171-4896-b474-7df5441b770f-cert\") pod \"kserve-controller-manager-69fc866d76-97ppl\" (UID: \"abc6ce51-f171-4896-b474-7df5441b770f\") " pod="opendatahub/kserve-controller-manager-69fc866d76-97ppl" Jun 10 13:24:38.921621 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:38.921596 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8sln\" (UniqueName: \"kubernetes.io/projected/abc6ce51-f171-4896-b474-7df5441b770f-kube-api-access-c8sln\") pod \"kserve-controller-manager-69fc866d76-97ppl\" (UID: \"abc6ce51-f171-4896-b474-7df5441b770f\") " pod="opendatahub/kserve-controller-manager-69fc866d76-97ppl" Jun 10 13:24:38.964603 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:38.964572 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-97ppl" Jun 10 13:24:39.010626 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:39.010536 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bc223ffa-3cbe-42ca-85ea-639dd9570746-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-kxdct\" (UID: \"bc223ffa-3cbe-42ca-85ea-639dd9570746\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-kxdct" Jun 10 13:24:39.010626 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:39.010607 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbxjj\" (UniqueName: \"kubernetes.io/projected/bc223ffa-3cbe-42ca-85ea-639dd9570746-kube-api-access-bbxjj\") pod \"llmisvc-controller-manager-864bfd7bc9-kxdct\" (UID: \"bc223ffa-3cbe-42ca-85ea-639dd9570746\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-kxdct" Jun 10 13:24:39.010860 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:24:39.010765 2567 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jun 10 13:24:39.010923 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:24:39.010869 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc223ffa-3cbe-42ca-85ea-639dd9570746-cert podName:bc223ffa-3cbe-42ca-85ea-639dd9570746 nodeName:}" failed. No retries permitted until 2026-06-10 13:24:39.510825517 +0000 UTC m=+586.776076098 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/bc223ffa-3cbe-42ca-85ea-639dd9570746-cert") pod "llmisvc-controller-manager-864bfd7bc9-kxdct" (UID: "bc223ffa-3cbe-42ca-85ea-639dd9570746") : secret "llmisvc-webhook-server-cert" not found Jun 10 13:24:39.025381 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:39.025152 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbxjj\" (UniqueName: \"kubernetes.io/projected/bc223ffa-3cbe-42ca-85ea-639dd9570746-kube-api-access-bbxjj\") pod \"llmisvc-controller-manager-864bfd7bc9-kxdct\" (UID: \"bc223ffa-3cbe-42ca-85ea-639dd9570746\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-kxdct" Jun 10 13:24:39.185215 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:39.185138 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-97ppl"] Jun 10 13:24:39.187498 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:24:39.187473 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabc6ce51_f171_4896_b474_7df5441b770f.slice/crio-1d39da497b03a683501783aa2a409d04d7695197689a087d7eb1c41d006f20ea WatchSource:0}: Error finding container 1d39da497b03a683501783aa2a409d04d7695197689a087d7eb1c41d006f20ea: Status 404 returned error can't find the container with id 1d39da497b03a683501783aa2a409d04d7695197689a087d7eb1c41d006f20ea Jun 10 13:24:39.435981 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:39.435949 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-97ppl" event={"ID":"abc6ce51-f171-4896-b474-7df5441b770f","Type":"ContainerStarted","Data":"1d39da497b03a683501783aa2a409d04d7695197689a087d7eb1c41d006f20ea"} Jun 10 13:24:39.514704 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:39.514673 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bc223ffa-3cbe-42ca-85ea-639dd9570746-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-kxdct\" (UID: \"bc223ffa-3cbe-42ca-85ea-639dd9570746\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-kxdct" Jun 10 13:24:39.517100 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:39.517070 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bc223ffa-3cbe-42ca-85ea-639dd9570746-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-kxdct\" (UID: \"bc223ffa-3cbe-42ca-85ea-639dd9570746\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-kxdct" Jun 10 13:24:39.651936 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:39.651902 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-kxdct" Jun 10 13:24:39.660046 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:39.659985 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:24:39.825073 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:39.824789 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-kxdct"] Jun 10 13:24:39.827605 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:24:39.827574 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podbc223ffa_3cbe_42ca_85ea_639dd9570746.slice/crio-856edf6a15028573e3f52d2f2e90c467ef0bfd3991252a73825c8c444c6f6ea2 WatchSource:0}: Error finding container 856edf6a15028573e3f52d2f2e90c467ef0bfd3991252a73825c8c444c6f6ea2: Status 404 returned error can't find the container with id 856edf6a15028573e3f52d2f2e90c467ef0bfd3991252a73825c8c444c6f6ea2 Jun 10 13:24:40.021331 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:40.021235 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:24:40.281273 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:40.281187 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:24:40.441773 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:40.441734 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-kxdct" event={"ID":"bc223ffa-3cbe-42ca-85ea-639dd9570746","Type":"ContainerStarted","Data":"856edf6a15028573e3f52d2f2e90c467ef0bfd3991252a73825c8c444c6f6ea2"} Jun 10 13:24:41.002115 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:41.002074 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:24:41.228525 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:41.228462 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:24:42.455284 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:42.455242 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-97ppl" event={"ID":"abc6ce51-f171-4896-b474-7df5441b770f","Type":"ContainerStarted","Data":"206efc87707da4fefd5bbc2d54e575d742e6e99f39592ed951e7b6ed08680a9b"} Jun 10 13:24:42.455742 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:42.455427 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-97ppl" Jun 10 13:24:42.673885 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:42.673808 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-97ppl" podStartSLOduration=2.156356278 podStartE2EDuration="4.673793241s" totalImagesPullingTime="2.517436963s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:24:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:24:42.671300093 +0000 UTC m=+589.936550692" watchObservedRunningTime="2026-06-10 13:24:42.673793241 +0000 UTC m=+589.939043838" Jun 10 13:24:42.837461 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:42.837346 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:24:43.086540 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:43.086499 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:24:43.356831 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:43.356795 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:24:43.407502 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:43.407474 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-hl6td" Jun 10 13:24:43.409424 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:43.409401 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-cvs5w" Jun 10 13:24:43.461443 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:43.461407 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-kxdct" event={"ID":"bc223ffa-3cbe-42ca-85ea-639dd9570746","Type":"ContainerStarted","Data":"1e573750f781af9243c30d3bbc964ff054e94cfc757fc38addf9491e9c16f223"} Jun 10 13:24:43.695488 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:43.695429 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-kxdct" podStartSLOduration=2.61060427 podStartE2EDuration="5.695406812s" totalImagesPullingTime="3.084802542s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:24:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:24:43.693795775 +0000 UTC m=+590.959046372" watchObservedRunningTime="2026-06-10 13:24:43.695406812 +0000 UTC m=+590.960657410" Jun 10 13:24:43.752487 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:43.752452 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:24:44.024134 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:44.024045 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:24:44.466432 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:44.466403 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-kxdct" Jun 10 13:24:46.229279 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:46.229238 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-7ngfn"] Jun 10 13:24:46.233313 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:46.233295 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-7ngfn" Jun 10 13:24:46.238714 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:46.238691 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-rjxst\"" Jun 10 13:24:46.241041 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:46.241021 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 10 13:24:46.241172 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:46.241147 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 10 13:24:46.278179 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:46.278150 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-7ngfn"] Jun 10 13:24:46.379475 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:46.379442 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/363dd030-a86a-41c1-a69c-d303917d2d9e-operator-config\") pod \"servicemesh-operator3-57f65f65fb-7ngfn\" (UID: \"363dd030-a86a-41c1-a69c-d303917d2d9e\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-7ngfn" Jun 10 13:24:46.379660 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:46.379515 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldrnj\" (UniqueName: \"kubernetes.io/projected/363dd030-a86a-41c1-a69c-d303917d2d9e-kube-api-access-ldrnj\") pod \"servicemesh-operator3-57f65f65fb-7ngfn\" (UID: \"363dd030-a86a-41c1-a69c-d303917d2d9e\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-7ngfn" Jun 10 13:24:46.480088 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:46.480004 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/363dd030-a86a-41c1-a69c-d303917d2d9e-operator-config\") pod \"servicemesh-operator3-57f65f65fb-7ngfn\" (UID: \"363dd030-a86a-41c1-a69c-d303917d2d9e\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-7ngfn" Jun 10 13:24:46.480088 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:46.480055 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldrnj\" (UniqueName: \"kubernetes.io/projected/363dd030-a86a-41c1-a69c-d303917d2d9e-kube-api-access-ldrnj\") pod \"servicemesh-operator3-57f65f65fb-7ngfn\" (UID: \"363dd030-a86a-41c1-a69c-d303917d2d9e\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-7ngfn" Jun 10 13:24:46.482513 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:46.482486 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/363dd030-a86a-41c1-a69c-d303917d2d9e-operator-config\") pod \"servicemesh-operator3-57f65f65fb-7ngfn\" (UID: \"363dd030-a86a-41c1-a69c-d303917d2d9e\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-7ngfn" Jun 10 13:24:46.499344 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:46.499318 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldrnj\" (UniqueName: \"kubernetes.io/projected/363dd030-a86a-41c1-a69c-d303917d2d9e-kube-api-access-ldrnj\") pod \"servicemesh-operator3-57f65f65fb-7ngfn\" (UID: \"363dd030-a86a-41c1-a69c-d303917d2d9e\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-7ngfn" Jun 10 13:24:46.542419 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:46.542398 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-7ngfn" Jun 10 13:24:46.714019 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:46.713995 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-7ngfn"] Jun 10 13:24:46.715938 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:24:46.715912 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod363dd030_a86a_41c1_a69c_d303917d2d9e.slice/crio-1820df0813599be6ed716047ad5ba74a6fb63f5e40e8587707948f1be9a78694 WatchSource:0}: Error finding container 1820df0813599be6ed716047ad5ba74a6fb63f5e40e8587707948f1be9a78694: Status 404 returned error can't find the container with id 1820df0813599be6ed716047ad5ba74a6fb63f5e40e8587707948f1be9a78694 Jun 10 13:24:47.483155 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:47.483122 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-7ngfn" event={"ID":"363dd030-a86a-41c1-a69c-d303917d2d9e","Type":"ContainerStarted","Data":"1820df0813599be6ed716047ad5ba74a6fb63f5e40e8587707948f1be9a78694"} Jun 10 13:24:50.499617 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:50.499569 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-7ngfn" event={"ID":"363dd030-a86a-41c1-a69c-d303917d2d9e","Type":"ContainerStarted","Data":"9635dea848d2a0c67f732ce3dea11db4b14bd646463f5cba9b0769bb533a37e6"} Jun 10 13:24:50.500020 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:50.499712 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-7ngfn" Jun 10 13:24:50.538705 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:50.538661 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-7ngfn" podStartSLOduration=1.8097249949999998 podStartE2EDuration="4.53864794s" totalImagesPullingTime="2.728922945s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:24:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:24:50.538242696 +0000 UTC m=+597.803493295" watchObservedRunningTime="2026-06-10 13:24:50.53864794 +0000 UTC m=+597.803898541" Jun 10 13:24:53.187040 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:53.187017 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-9xwd9_c0921084-7852-4e0a-972a-7366b89c7736/console-operator/1.log" Jun 10 13:24:53.187755 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:53.187726 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-9xwd9_c0921084-7852-4e0a-972a-7366b89c7736/console-operator/1.log" Jun 10 13:24:53.195217 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:53.195194 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-htrsf_503ace6f-dfa4-41b8-8ade-5294ab66e7a7/ovn-acl-logging/0.log" Jun 10 13:24:53.196065 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:53.196047 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-htrsf_503ace6f-dfa4-41b8-8ade-5294ab66e7a7/ovn-acl-logging/0.log" Jun 10 13:24:54.164172 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:54.164125 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:24:54.327313 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:24:54.327200 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:25:00.974538 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:00.974506 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-7cc85495b4-h9b55"] Jun 10 13:25:00.978027 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:00.978010 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-7cc85495b4-h9b55" Jun 10 13:25:00.981990 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:00.981968 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 10 13:25:00.982608 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:00.982593 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-tzr6h\"" Jun 10 13:25:01.000221 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:01.000189 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-7cc85495b4-h9b55"] Jun 10 13:25:01.006782 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:01.006760 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qblls\" (UniqueName: \"kubernetes.io/projected/120dff7e-dec7-4d5f-b633-f20c672e836d-kube-api-access-qblls\") pod \"dashboard-redirect-7cc85495b4-h9b55\" (UID: \"120dff7e-dec7-4d5f-b633-f20c672e836d\") " pod="opendatahub/dashboard-redirect-7cc85495b4-h9b55" Jun 10 13:25:01.006916 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:01.006833 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/120dff7e-dec7-4d5f-b633-f20c672e836d-redirect-config\") pod \"dashboard-redirect-7cc85495b4-h9b55\" (UID: \"120dff7e-dec7-4d5f-b633-f20c672e836d\") " pod="opendatahub/dashboard-redirect-7cc85495b4-h9b55" Jun 10 13:25:01.107877 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:01.107823 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/120dff7e-dec7-4d5f-b633-f20c672e836d-redirect-config\") pod \"dashboard-redirect-7cc85495b4-h9b55\" (UID: \"120dff7e-dec7-4d5f-b633-f20c672e836d\") " pod="opendatahub/dashboard-redirect-7cc85495b4-h9b55" Jun 10 13:25:01.108032 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:01.107920 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qblls\" (UniqueName: \"kubernetes.io/projected/120dff7e-dec7-4d5f-b633-f20c672e836d-kube-api-access-qblls\") pod \"dashboard-redirect-7cc85495b4-h9b55\" (UID: \"120dff7e-dec7-4d5f-b633-f20c672e836d\") " pod="opendatahub/dashboard-redirect-7cc85495b4-h9b55" Jun 10 13:25:01.108597 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:01.108578 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/120dff7e-dec7-4d5f-b633-f20c672e836d-redirect-config\") pod \"dashboard-redirect-7cc85495b4-h9b55\" (UID: \"120dff7e-dec7-4d5f-b633-f20c672e836d\") " pod="opendatahub/dashboard-redirect-7cc85495b4-h9b55" Jun 10 13:25:01.117579 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:01.117548 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:25:01.129193 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:01.129175 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qblls\" (UniqueName: \"kubernetes.io/projected/120dff7e-dec7-4d5f-b633-f20c672e836d-kube-api-access-qblls\") pod \"dashboard-redirect-7cc85495b4-h9b55\" (UID: \"120dff7e-dec7-4d5f-b633-f20c672e836d\") " pod="opendatahub/dashboard-redirect-7cc85495b4-h9b55" Jun 10 13:25:01.288311 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:01.288242 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-7cc85495b4-h9b55" Jun 10 13:25:01.424945 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:01.424818 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-7cc85495b4-h9b55"] Jun 10 13:25:01.427876 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:25:01.427847 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod120dff7e_dec7_4d5f_b633_f20c672e836d.slice/crio-cedf9e4591a4b1122bbb62a103c78011a28bf6b2f25813dc707707b13c78a6d0 WatchSource:0}: Error finding container cedf9e4591a4b1122bbb62a103c78011a28bf6b2f25813dc707707b13c78a6d0: Status 404 returned error can't find the container with id cedf9e4591a4b1122bbb62a103c78011a28bf6b2f25813dc707707b13c78a6d0 Jun 10 13:25:01.506712 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:01.506687 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-7ngfn" Jun 10 13:25:01.550958 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:01.550877 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-7cc85495b4-h9b55" event={"ID":"120dff7e-dec7-4d5f-b633-f20c672e836d","Type":"ContainerStarted","Data":"cedf9e4591a4b1122bbb62a103c78011a28bf6b2f25813dc707707b13c78a6d0"} Jun 10 13:25:07.585287 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:07.585247 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-7cc85495b4-h9b55" event={"ID":"120dff7e-dec7-4d5f-b633-f20c672e836d","Type":"ContainerStarted","Data":"3e022961d51b8b6bc8b66c78db0245ddd3aeac54df7a35642f088b5e6dab8257"} Jun 10 13:25:07.615439 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:07.615378 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-7cc85495b4-h9b55" podStartSLOduration=2.3142110750000002 podStartE2EDuration="7.61536121s" totalImagesPullingTime="5.301150135s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:25:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:25:07.608055624 +0000 UTC m=+614.873306223" watchObservedRunningTime="2026-06-10 13:25:07.61536121 +0000 UTC m=+614.880611809" Jun 10 13:25:13.466538 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:13.466509 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-97ppl" Jun 10 13:25:13.693149 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:13.693107 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:25:13.783033 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:13.782953 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:25:14.267309 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:14.267267 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:25:15.473418 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:15.473386 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-kxdct" Jun 10 13:25:17.314322 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:17.314287 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:25:17.375662 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:17.375619 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:25:17.576024 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:17.575956 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sdpgf"] Jun 10 13:25:17.581539 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:17.581519 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sdpgf" Jun 10 13:25:17.584312 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:17.584286 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 10 13:25:17.584430 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:17.584391 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-h86gc\"" Jun 10 13:25:17.592968 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:17.592949 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sdpgf"] Jun 10 13:25:17.614726 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:17.614694 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:25:17.658605 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:17.658572 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6fec796-d7ce-4381-8342-25c3a350a720-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795sdpgf\" (UID: \"e6fec796-d7ce-4381-8342-25c3a350a720\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sdpgf" Jun 10 13:25:17.658738 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:17.658618 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6fec796-d7ce-4381-8342-25c3a350a720-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795sdpgf\" (UID: \"e6fec796-d7ce-4381-8342-25c3a350a720\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sdpgf" Jun 10 13:25:17.658738 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:17.658655 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6fec796-d7ce-4381-8342-25c3a350a720-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795sdpgf\" (UID: \"e6fec796-d7ce-4381-8342-25c3a350a720\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sdpgf" Jun 10 13:25:17.658738 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:17.658713 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6fec796-d7ce-4381-8342-25c3a350a720-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795sdpgf\" (UID: \"e6fec796-d7ce-4381-8342-25c3a350a720\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sdpgf" Jun 10 13:25:17.658854 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:17.658746 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sp2gn\" (UniqueName: \"kubernetes.io/projected/e6fec796-d7ce-4381-8342-25c3a350a720-kube-api-access-sp2gn\") pod \"data-science-gateway-data-science-gateway-class-74759f9795sdpgf\" (UID: \"e6fec796-d7ce-4381-8342-25c3a350a720\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sdpgf" Jun 10 13:25:17.658854 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:17.658777 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6fec796-d7ce-4381-8342-25c3a350a720-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795sdpgf\" (UID: \"e6fec796-d7ce-4381-8342-25c3a350a720\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sdpgf" Jun 10 13:25:17.658854 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:17.658816 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6fec796-d7ce-4381-8342-25c3a350a720-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795sdpgf\" (UID: \"e6fec796-d7ce-4381-8342-25c3a350a720\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sdpgf" Jun 10 13:25:17.658973 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:17.658853 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6fec796-d7ce-4381-8342-25c3a350a720-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795sdpgf\" (UID: \"e6fec796-d7ce-4381-8342-25c3a350a720\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sdpgf" Jun 10 13:25:17.658973 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:17.658899 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6fec796-d7ce-4381-8342-25c3a350a720-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795sdpgf\" (UID: \"e6fec796-d7ce-4381-8342-25c3a350a720\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sdpgf" Jun 10 13:25:17.760138 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:17.760104 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6fec796-d7ce-4381-8342-25c3a350a720-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795sdpgf\" (UID: \"e6fec796-d7ce-4381-8342-25c3a350a720\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sdpgf" Jun 10 13:25:17.760297 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:17.760149 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6fec796-d7ce-4381-8342-25c3a350a720-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795sdpgf\" (UID: \"e6fec796-d7ce-4381-8342-25c3a350a720\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sdpgf" Jun 10 13:25:17.760297 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:17.760173 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6fec796-d7ce-4381-8342-25c3a350a720-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795sdpgf\" (UID: \"e6fec796-d7ce-4381-8342-25c3a350a720\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sdpgf" Jun 10 13:25:17.760297 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:17.760220 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6fec796-d7ce-4381-8342-25c3a350a720-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795sdpgf\" (UID: \"e6fec796-d7ce-4381-8342-25c3a350a720\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sdpgf" Jun 10 13:25:17.760419 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:17.760301 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6fec796-d7ce-4381-8342-25c3a350a720-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795sdpgf\" (UID: \"e6fec796-d7ce-4381-8342-25c3a350a720\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sdpgf" Jun 10 13:25:17.760419 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:17.760340 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sp2gn\" (UniqueName: \"kubernetes.io/projected/e6fec796-d7ce-4381-8342-25c3a350a720-kube-api-access-sp2gn\") pod \"data-science-gateway-data-science-gateway-class-74759f9795sdpgf\" (UID: \"e6fec796-d7ce-4381-8342-25c3a350a720\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sdpgf" Jun 10 13:25:17.760419 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:17.760373 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6fec796-d7ce-4381-8342-25c3a350a720-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795sdpgf\" (UID: \"e6fec796-d7ce-4381-8342-25c3a350a720\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sdpgf" Jun 10 13:25:17.760574 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:17.760419 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6fec796-d7ce-4381-8342-25c3a350a720-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795sdpgf\" (UID: \"e6fec796-d7ce-4381-8342-25c3a350a720\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sdpgf" Jun 10 13:25:17.760574 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:17.760529 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6fec796-d7ce-4381-8342-25c3a350a720-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795sdpgf\" (UID: \"e6fec796-d7ce-4381-8342-25c3a350a720\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sdpgf" Jun 10 13:25:17.760752 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:17.760575 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6fec796-d7ce-4381-8342-25c3a350a720-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795sdpgf\" (UID: \"e6fec796-d7ce-4381-8342-25c3a350a720\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sdpgf" Jun 10 13:25:17.760752 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:17.760618 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6fec796-d7ce-4381-8342-25c3a350a720-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795sdpgf\" (UID: \"e6fec796-d7ce-4381-8342-25c3a350a720\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sdpgf" Jun 10 13:25:17.760928 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:17.760897 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6fec796-d7ce-4381-8342-25c3a350a720-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795sdpgf\" (UID: \"e6fec796-d7ce-4381-8342-25c3a350a720\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sdpgf" Jun 10 13:25:17.760928 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:17.760919 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6fec796-d7ce-4381-8342-25c3a350a720-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795sdpgf\" (UID: \"e6fec796-d7ce-4381-8342-25c3a350a720\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sdpgf" Jun 10 13:25:17.761214 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:17.761192 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6fec796-d7ce-4381-8342-25c3a350a720-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795sdpgf\" (UID: \"e6fec796-d7ce-4381-8342-25c3a350a720\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sdpgf" Jun 10 13:25:17.762684 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:17.762657 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6fec796-d7ce-4381-8342-25c3a350a720-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795sdpgf\" (UID: \"e6fec796-d7ce-4381-8342-25c3a350a720\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sdpgf" Jun 10 13:25:17.763069 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:17.763053 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6fec796-d7ce-4381-8342-25c3a350a720-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795sdpgf\" (UID: \"e6fec796-d7ce-4381-8342-25c3a350a720\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sdpgf" Jun 10 13:25:17.768863 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:17.768820 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6fec796-d7ce-4381-8342-25c3a350a720-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795sdpgf\" (UID: \"e6fec796-d7ce-4381-8342-25c3a350a720\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sdpgf" Jun 10 13:25:17.769790 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:17.769765 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sp2gn\" (UniqueName: \"kubernetes.io/projected/e6fec796-d7ce-4381-8342-25c3a350a720-kube-api-access-sp2gn\") pod \"data-science-gateway-data-science-gateway-class-74759f9795sdpgf\" (UID: \"e6fec796-d7ce-4381-8342-25c3a350a720\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sdpgf" Jun 10 13:25:17.837749 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:17.837674 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:25:17.892916 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:17.892883 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sdpgf" Jun 10 13:25:17.955700 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:17.955662 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:25:18.040149 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:18.040118 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sdpgf"] Jun 10 13:25:18.042567 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:25:18.042509 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6fec796_d7ce_4381_8342_25c3a350a720.slice/crio-6d4c52943169db06bb33032cbe147c69af96aedd63982f9f86c054a5972aae69 WatchSource:0}: Error finding container 6d4c52943169db06bb33032cbe147c69af96aedd63982f9f86c054a5972aae69: Status 404 returned error can't find the container with id 6d4c52943169db06bb33032cbe147c69af96aedd63982f9f86c054a5972aae69 Jun 10 13:25:18.638564 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:18.638533 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sdpgf" event={"ID":"e6fec796-d7ce-4381-8342-25c3a350a720","Type":"ContainerStarted","Data":"6d4c52943169db06bb33032cbe147c69af96aedd63982f9f86c054a5972aae69"} Jun 10 13:25:19.493685 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:19.493643 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:25:22.157367 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:22.157322 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 10 13:25:22.157622 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:22.157403 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 10 13:25:22.157622 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:22.157436 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 10 13:25:22.659746 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:22.659711 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sdpgf" event={"ID":"e6fec796-d7ce-4381-8342-25c3a350a720","Type":"ContainerStarted","Data":"ba65ddf6698985181698e3767587d9d72632a40c9b4e043c5f9bb595552340a3"} Jun 10 13:25:22.684026 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:22.683976 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sdpgf" podStartSLOduration=1.571709807 podStartE2EDuration="5.683957274s" totalImagesPullingTime="4.112247467s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:25:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:25:22.683928146 +0000 UTC m=+629.949178744" watchObservedRunningTime="2026-06-10 13:25:22.683957274 +0000 UTC m=+629.949207872" Jun 10 13:25:22.893813 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:22.893781 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sdpgf" Jun 10 13:25:23.898079 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:23.898047 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sdpgf" Jun 10 13:25:24.364278 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:24.364196 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:25:24.668765 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:24.668732 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sdpgf" Jun 10 13:25:24.669826 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:24.669808 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sdpgf" Jun 10 13:25:25.814754 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:25.814713 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:25:25.975217 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:25.975177 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:25:26.036955 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:26.036918 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sd2jv"] Jun 10 13:25:26.039588 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:26.039562 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-sd2jv" Jun 10 13:25:26.042374 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:26.042350 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 10 13:25:26.042505 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:26.042465 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 10 13:25:26.043605 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:26.043575 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-dv6gf\"" Jun 10 13:25:26.050894 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:26.050872 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sd2jv"] Jun 10 13:25:26.090109 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:26.090021 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:25:26.144900 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:26.144829 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6785k\" (UniqueName: \"kubernetes.io/projected/418f68b0-f2c5-49bc-bcd7-f1dd966db2ff-kube-api-access-6785k\") pod \"kuadrant-operator-catalog-sd2jv\" (UID: \"418f68b0-f2c5-49bc-bcd7-f1dd966db2ff\") " pod="kuadrant-system/kuadrant-operator-catalog-sd2jv" Jun 10 13:25:26.246429 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:26.246385 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6785k\" (UniqueName: \"kubernetes.io/projected/418f68b0-f2c5-49bc-bcd7-f1dd966db2ff-kube-api-access-6785k\") pod \"kuadrant-operator-catalog-sd2jv\" (UID: \"418f68b0-f2c5-49bc-bcd7-f1dd966db2ff\") " pod="kuadrant-system/kuadrant-operator-catalog-sd2jv" Jun 10 13:25:26.257773 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:26.257744 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6785k\" (UniqueName: \"kubernetes.io/projected/418f68b0-f2c5-49bc-bcd7-f1dd966db2ff-kube-api-access-6785k\") pod \"kuadrant-operator-catalog-sd2jv\" (UID: \"418f68b0-f2c5-49bc-bcd7-f1dd966db2ff\") " pod="kuadrant-system/kuadrant-operator-catalog-sd2jv" Jun 10 13:25:26.350153 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:26.350069 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-sd2jv" Jun 10 13:25:26.490284 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:26.490260 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sd2jv"] Jun 10 13:25:26.492522 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:25:26.492491 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod418f68b0_f2c5_49bc_bcd7_f1dd966db2ff.slice/crio-cdbdf5dc2e71705e9e587a79123e90ac7a8f9bacfd9f73783311a7b151f32760 WatchSource:0}: Error finding container cdbdf5dc2e71705e9e587a79123e90ac7a8f9bacfd9f73783311a7b151f32760: Status 404 returned error can't find the container with id cdbdf5dc2e71705e9e587a79123e90ac7a8f9bacfd9f73783311a7b151f32760 Jun 10 13:25:26.679069 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:26.679026 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-sd2jv" event={"ID":"418f68b0-f2c5-49bc-bcd7-f1dd966db2ff","Type":"ContainerStarted","Data":"cdbdf5dc2e71705e9e587a79123e90ac7a8f9bacfd9f73783311a7b151f32760"} Jun 10 13:25:28.692356 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:28.692264 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-sd2jv" event={"ID":"418f68b0-f2c5-49bc-bcd7-f1dd966db2ff","Type":"ContainerStarted","Data":"d443811e30d9b188b14868c35e51a0fee25ba5de55b134058e98ec3c74e8dc16"} Jun 10 13:25:28.714622 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:28.714578 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-sd2jv" podStartSLOduration=0.797374167 podStartE2EDuration="2.714564228s" totalImagesPullingTime="1.917190061s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:25:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:25:28.713313379 +0000 UTC m=+635.978563976" watchObservedRunningTime="2026-06-10 13:25:28.714564228 +0000 UTC m=+635.979814825" Jun 10 13:25:36.350610 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:36.350569 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-sd2jv" Jun 10 13:25:36.351066 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:36.350648 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-sd2jv" Jun 10 13:25:36.373020 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:36.372995 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-sd2jv" Jun 10 13:25:36.751412 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:36.751385 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-sd2jv" Jun 10 13:25:44.577290 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:44.577250 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:25:44.658233 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:44.658202 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:25:44.909468 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:44.909435 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:25:48.478740 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:48.478697 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:25:50.700809 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:50.700776 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k7mcw"] Jun 10 13:25:50.703429 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:50.703413 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k7mcw" Jun 10 13:25:50.706046 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:50.706027 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-gcj5s\"" Jun 10 13:25:50.715471 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:50.715451 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k7mcw"] Jun 10 13:25:50.765929 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:50.765892 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5hsx\" (UniqueName: \"kubernetes.io/projected/92f6ab69-8a3c-42bb-8042-060774bc98f4-kube-api-access-s5hsx\") pod \"limitador-operator-controller-manager-859d7b78bd-k7mcw\" (UID: \"92f6ab69-8a3c-42bb-8042-060774bc98f4\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k7mcw" Jun 10 13:25:50.866525 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:50.866495 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5hsx\" (UniqueName: \"kubernetes.io/projected/92f6ab69-8a3c-42bb-8042-060774bc98f4-kube-api-access-s5hsx\") pod \"limitador-operator-controller-manager-859d7b78bd-k7mcw\" (UID: \"92f6ab69-8a3c-42bb-8042-060774bc98f4\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k7mcw" Jun 10 13:25:50.876245 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:50.876211 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5hsx\" (UniqueName: \"kubernetes.io/projected/92f6ab69-8a3c-42bb-8042-060774bc98f4-kube-api-access-s5hsx\") pod \"limitador-operator-controller-manager-859d7b78bd-k7mcw\" (UID: \"92f6ab69-8a3c-42bb-8042-060774bc98f4\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k7mcw" Jun 10 13:25:51.013541 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:51.013451 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k7mcw" Jun 10 13:25:51.154776 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:51.154750 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k7mcw"] Jun 10 13:25:51.156220 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:25:51.156191 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92f6ab69_8a3c_42bb_8042_060774bc98f4.slice/crio-d97d09ac87375bea7a41213247b7cacae974c826d238e5fdef89189fbfb1c9dc WatchSource:0}: Error finding container d97d09ac87375bea7a41213247b7cacae974c826d238e5fdef89189fbfb1c9dc: Status 404 returned error can't find the container with id d97d09ac87375bea7a41213247b7cacae974c826d238e5fdef89189fbfb1c9dc Jun 10 13:25:51.667710 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:51.667673 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:25:51.800066 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:51.800032 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k7mcw" event={"ID":"92f6ab69-8a3c-42bb-8042-060774bc98f4","Type":"ContainerStarted","Data":"d97d09ac87375bea7a41213247b7cacae974c826d238e5fdef89189fbfb1c9dc"} Jun 10 13:25:53.812132 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:53.812091 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k7mcw" event={"ID":"92f6ab69-8a3c-42bb-8042-060774bc98f4","Type":"ContainerStarted","Data":"231b8a94e20a90309dd654b757c44fd7439c8f58430244b6bb364f40f75bdda3"} Jun 10 13:25:53.812502 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:53.812187 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k7mcw" Jun 10 13:25:53.830649 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:53.830606 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k7mcw" podStartSLOduration=2.218280824 podStartE2EDuration="3.830590896s" totalImagesPullingTime="1.612310072s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:25:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:25:53.8301975 +0000 UTC m=+661.095448098" watchObservedRunningTime="2026-06-10 13:25:53.830590896 +0000 UTC m=+661.095841493" Jun 10 13:25:56.305739 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:56.305709 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fmjd6"] Jun 10 13:25:56.311527 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:56.311505 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fmjd6" Jun 10 13:25:56.314459 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:56.314436 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-5xdxq\"" Jun 10 13:25:56.327936 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:56.327913 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fmjd6"] Jun 10 13:25:56.412322 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:56.412289 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/34247982-5ef4-49b1-87de-e1d227d64637-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-fmjd6\" (UID: \"34247982-5ef4-49b1-87de-e1d227d64637\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fmjd6" Jun 10 13:25:56.412511 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:56.412332 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8mb2\" (UniqueName: \"kubernetes.io/projected/34247982-5ef4-49b1-87de-e1d227d64637-kube-api-access-r8mb2\") pod \"kuadrant-operator-controller-manager-8684c9ff49-fmjd6\" (UID: \"34247982-5ef4-49b1-87de-e1d227d64637\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fmjd6" Jun 10 13:25:56.513349 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:56.513314 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8mb2\" (UniqueName: \"kubernetes.io/projected/34247982-5ef4-49b1-87de-e1d227d64637-kube-api-access-r8mb2\") pod \"kuadrant-operator-controller-manager-8684c9ff49-fmjd6\" (UID: \"34247982-5ef4-49b1-87de-e1d227d64637\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fmjd6" Jun 10 13:25:56.513518 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:56.513411 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/34247982-5ef4-49b1-87de-e1d227d64637-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-fmjd6\" (UID: \"34247982-5ef4-49b1-87de-e1d227d64637\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fmjd6" Jun 10 13:25:56.513788 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:56.513732 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/34247982-5ef4-49b1-87de-e1d227d64637-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-fmjd6\" (UID: \"34247982-5ef4-49b1-87de-e1d227d64637\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fmjd6" Jun 10 13:25:56.526558 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:56.526530 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8mb2\" (UniqueName: \"kubernetes.io/projected/34247982-5ef4-49b1-87de-e1d227d64637-kube-api-access-r8mb2\") pod \"kuadrant-operator-controller-manager-8684c9ff49-fmjd6\" (UID: \"34247982-5ef4-49b1-87de-e1d227d64637\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fmjd6" Jun 10 13:25:56.621705 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:56.621630 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fmjd6" Jun 10 13:25:56.668489 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:56.668454 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:25:56.763648 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:56.763626 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fmjd6"] Jun 10 13:25:56.766428 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:25:56.766395 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34247982_5ef4_49b1_87de_e1d227d64637.slice/crio-f907734fbcc374b681ffad1cc0443f7dd204077bb733accd9b054bcdd11fa52e WatchSource:0}: Error finding container f907734fbcc374b681ffad1cc0443f7dd204077bb733accd9b054bcdd11fa52e: Status 404 returned error can't find the container with id f907734fbcc374b681ffad1cc0443f7dd204077bb733accd9b054bcdd11fa52e Jun 10 13:25:56.827920 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:56.827880 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fmjd6" event={"ID":"34247982-5ef4-49b1-87de-e1d227d64637","Type":"ContainerStarted","Data":"f907734fbcc374b681ffad1cc0443f7dd204077bb733accd9b054bcdd11fa52e"} Jun 10 13:25:57.148530 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:57.148482 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:25:57.270021 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:25:57.269979 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:26:00.071414 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:00.071378 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-vcsfg"] Jun 10 13:26:00.073991 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:00.073975 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-vcsfg" Jun 10 13:26:00.077698 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:00.077675 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-p2wqj\"" Jun 10 13:26:00.090688 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:00.090666 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-vcsfg"] Jun 10 13:26:00.147309 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:00.147277 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxcgb\" (UniqueName: \"kubernetes.io/projected/e3ae0727-fe67-42c4-a180-91d125784597-kube-api-access-fxcgb\") pod \"authorino-operator-75cc8d5cb7-vcsfg\" (UID: \"e3ae0727-fe67-42c4-a180-91d125784597\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-vcsfg" Jun 10 13:26:00.247817 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:00.247778 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxcgb\" (UniqueName: \"kubernetes.io/projected/e3ae0727-fe67-42c4-a180-91d125784597-kube-api-access-fxcgb\") pod \"authorino-operator-75cc8d5cb7-vcsfg\" (UID: \"e3ae0727-fe67-42c4-a180-91d125784597\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-vcsfg" Jun 10 13:26:00.259181 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:00.259157 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxcgb\" (UniqueName: \"kubernetes.io/projected/e3ae0727-fe67-42c4-a180-91d125784597-kube-api-access-fxcgb\") pod \"authorino-operator-75cc8d5cb7-vcsfg\" (UID: \"e3ae0727-fe67-42c4-a180-91d125784597\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-vcsfg" Jun 10 13:26:00.384656 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:00.384615 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-vcsfg" Jun 10 13:26:00.522137 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:00.522106 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-vcsfg"] Jun 10 13:26:00.526409 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:26:00.526373 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3ae0727_fe67_42c4_a180_91d125784597.slice/crio-0e6b2308d24b33ef76ba31aac30811f96cb75817071463b1db10b9f391be14df WatchSource:0}: Error finding container 0e6b2308d24b33ef76ba31aac30811f96cb75817071463b1db10b9f391be14df: Status 404 returned error can't find the container with id 0e6b2308d24b33ef76ba31aac30811f96cb75817071463b1db10b9f391be14df Jun 10 13:26:00.851114 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:00.851015 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-vcsfg" event={"ID":"e3ae0727-fe67-42c4-a180-91d125784597","Type":"ContainerStarted","Data":"0e6b2308d24b33ef76ba31aac30811f96cb75817071463b1db10b9f391be14df"} Jun 10 13:26:01.092635 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:01.092538 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:26:01.685622 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:01.685572 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:26:03.513293 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:03.513248 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:26:04.819297 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:04.819268 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k7mcw" Jun 10 13:26:04.876170 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:04.876131 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-vcsfg" event={"ID":"e3ae0727-fe67-42c4-a180-91d125784597","Type":"ContainerStarted","Data":"6ea1edbdb866087edb2cb09272ca7dc66a269a0461b346f0ddc3239e99215871"} Jun 10 13:26:04.876341 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:04.876205 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-vcsfg" Jun 10 13:26:04.877910 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:04.877887 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fmjd6" event={"ID":"34247982-5ef4-49b1-87de-e1d227d64637","Type":"ContainerStarted","Data":"2dbcfe830dc6070767a510a95ad65127bda4f51586e7e9f2bda4fb351c29c91e"} Jun 10 13:26:04.878033 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:04.878007 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fmjd6" Jun 10 13:26:04.896824 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:04.896775 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-vcsfg" podStartSLOduration=1.2684310970000001 podStartE2EDuration="4.896763261s" totalImagesPullingTime="3.628332164s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:26:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:26:04.894874913 +0000 UTC m=+672.160125510" watchObservedRunningTime="2026-06-10 13:26:04.896763261 +0000 UTC m=+672.162013854" Jun 10 13:26:04.917500 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:04.917460 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fmjd6" podStartSLOduration=1.523831033 podStartE2EDuration="8.917447183s" totalImagesPullingTime="7.39361615s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:25:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:26:04.9159653 +0000 UTC m=+672.181215910" watchObservedRunningTime="2026-06-10 13:26:04.917447183 +0000 UTC m=+672.182697779" Jun 10 13:26:06.115575 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:06.115540 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:26:07.107986 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:07.107953 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:26:07.640773 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:07.640738 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:26:08.244701 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:08.244665 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:26:08.343092 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:08.343055 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:26:09.681412 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:09.681377 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:26:09.747226 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:09.747188 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:26:15.885366 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:15.885336 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fmjd6" Jun 10 13:26:15.885775 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:15.885404 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-vcsfg" Jun 10 13:26:17.575406 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:17.575373 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fmjd6"] Jun 10 13:26:17.575878 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:17.575545 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fmjd6" podUID="34247982-5ef4-49b1-87de-e1d227d64637" containerName="manager" containerID="cri-o://2dbcfe830dc6070767a510a95ad65127bda4f51586e7e9f2bda4fb351c29c91e" gracePeriod=2 Jun 10 13:26:17.581775 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:17.581748 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fmjd6"] Jun 10 13:26:17.593957 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:17.593930 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k7mcw"] Jun 10 13:26:17.594220 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:17.594169 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k7mcw" podUID="92f6ab69-8a3c-42bb-8042-060774bc98f4" containerName="manager" containerID="cri-o://231b8a94e20a90309dd654b757c44fd7439c8f58430244b6bb364f40f75bdda3" gracePeriod=2 Jun 10 13:26:17.596478 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:26:17.596444 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-fmjd6\" is forbidden: User \"system:node:ip-10-0-136-19.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-19.ec2.internal' and this object" podUID="34247982-5ef4-49b1-87de-e1d227d64637" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fmjd6" Jun 10 13:26:17.596730 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:17.596712 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h4rxp"] Jun 10 13:26:17.597196 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:17.597165 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34247982-5ef4-49b1-87de-e1d227d64637" containerName="manager" Jun 10 13:26:17.597196 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:17.597183 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="34247982-5ef4-49b1-87de-e1d227d64637" containerName="manager" Jun 10 13:26:17.597364 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:17.597296 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="34247982-5ef4-49b1-87de-e1d227d64637" containerName="manager" Jun 10 13:26:17.600571 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:17.600553 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h4rxp" Jun 10 13:26:17.606973 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:17.606944 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k7mcw"] Jun 10 13:26:17.614592 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:26:17.614556 2567 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"92f6ab69-8a3c-42bb-8042-060774bc98f4\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-k7mcw\": pods \"limitador-operator-controller-manager-859d7b78bd-k7mcw\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k7mcw" Jun 10 13:26:17.617021 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:17.616994 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvd25\" (UniqueName: \"kubernetes.io/projected/4f0307b3-b8ab-43b3-b418-b26b57483104-kube-api-access-tvd25\") pod \"kuadrant-operator-controller-manager-8684c9ff49-h4rxp\" (UID: \"4f0307b3-b8ab-43b3-b418-b26b57483104\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h4rxp" Jun 10 13:26:17.617145 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:17.617131 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4f0307b3-b8ab-43b3-b418-b26b57483104-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-h4rxp\" (UID: \"4f0307b3-b8ab-43b3-b418-b26b57483104\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h4rxp" Jun 10 13:26:17.618004 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:17.617983 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h4rxp"] Jun 10 13:26:17.618688 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:26:17.618666 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-k7mcw\" is forbidden: User \"system:node:ip-10-0-136-19.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-19.ec2.internal' and this object" podUID="92f6ab69-8a3c-42bb-8042-060774bc98f4" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k7mcw" Jun 10 13:26:17.621986 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:26:17.621956 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-fmjd6\" is forbidden: User \"system:node:ip-10-0-136-19.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-19.ec2.internal' and this object" podUID="34247982-5ef4-49b1-87de-e1d227d64637" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fmjd6" Jun 10 13:26:17.623833 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:17.623809 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fjfb4"] Jun 10 13:26:17.624218 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:17.624203 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92f6ab69-8a3c-42bb-8042-060774bc98f4" containerName="manager" Jun 10 13:26:17.624218 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:17.624217 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="92f6ab69-8a3c-42bb-8042-060774bc98f4" containerName="manager" Jun 10 13:26:17.624411 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:17.624292 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="92f6ab69-8a3c-42bb-8042-060774bc98f4" containerName="manager" Jun 10 13:26:17.627800 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:17.627782 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fjfb4" Jun 10 13:26:17.643234 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:17.643209 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fjfb4"] Jun 10 13:26:17.649875 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:26:17.649831 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-fmjd6\" is forbidden: User \"system:node:ip-10-0-136-19.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-19.ec2.internal' and this object" podUID="34247982-5ef4-49b1-87de-e1d227d64637" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fmjd6" Jun 10 13:26:17.669205 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:26:17.669177 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-k7mcw\" is forbidden: User \"system:node:ip-10-0-136-19.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-19.ec2.internal' and this object" podUID="92f6ab69-8a3c-42bb-8042-060774bc98f4" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k7mcw" Jun 10 13:26:17.717783 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:17.717752 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4j6k\" (UniqueName: \"kubernetes.io/projected/6bab3dc0-fc0b-4792-a478-1ec3cfd20464-kube-api-access-j4j6k\") pod \"limitador-operator-controller-manager-859d7b78bd-fjfb4\" (UID: \"6bab3dc0-fc0b-4792-a478-1ec3cfd20464\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fjfb4" Jun 10 13:26:17.717965 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:17.717800 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvd25\" (UniqueName: \"kubernetes.io/projected/4f0307b3-b8ab-43b3-b418-b26b57483104-kube-api-access-tvd25\") pod \"kuadrant-operator-controller-manager-8684c9ff49-h4rxp\" (UID: \"4f0307b3-b8ab-43b3-b418-b26b57483104\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h4rxp" Jun 10 13:26:17.718343 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:17.718220 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4f0307b3-b8ab-43b3-b418-b26b57483104-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-h4rxp\" (UID: \"4f0307b3-b8ab-43b3-b418-b26b57483104\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h4rxp" Jun 10 13:26:17.718661 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:17.718639 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4f0307b3-b8ab-43b3-b418-b26b57483104-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-h4rxp\" (UID: \"4f0307b3-b8ab-43b3-b418-b26b57483104\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h4rxp" Jun 10 13:26:17.726638 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:17.726612 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvd25\" (UniqueName: \"kubernetes.io/projected/4f0307b3-b8ab-43b3-b418-b26b57483104-kube-api-access-tvd25\") pod \"kuadrant-operator-controller-manager-8684c9ff49-h4rxp\" (UID: \"4f0307b3-b8ab-43b3-b418-b26b57483104\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h4rxp" Jun 10 13:26:17.819050 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:17.819025 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4j6k\" (UniqueName: \"kubernetes.io/projected/6bab3dc0-fc0b-4792-a478-1ec3cfd20464-kube-api-access-j4j6k\") pod \"limitador-operator-controller-manager-859d7b78bd-fjfb4\" (UID: \"6bab3dc0-fc0b-4792-a478-1ec3cfd20464\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fjfb4" Jun 10 13:26:17.835903 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:17.835872 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-szn2h"] Jun 10 13:26:17.836921 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:17.836900 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4j6k\" (UniqueName: \"kubernetes.io/projected/6bab3dc0-fc0b-4792-a478-1ec3cfd20464-kube-api-access-j4j6k\") pod \"limitador-operator-controller-manager-859d7b78bd-fjfb4\" (UID: \"6bab3dc0-fc0b-4792-a478-1ec3cfd20464\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fjfb4" Jun 10 13:26:17.839487 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:17.839471 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-szn2h" Jun 10 13:26:17.843616 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:17.843595 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k7mcw" Jun 10 13:26:17.844170 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:26:17.844147 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-fmjd6\" is forbidden: User \"system:node:ip-10-0-136-19.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-19.ec2.internal' and this object" podUID="34247982-5ef4-49b1-87de-e1d227d64637" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fmjd6" Jun 10 13:26:17.847056 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:17.847038 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fmjd6" Jun 10 13:26:17.852883 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:17.852830 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-szn2h"] Jun 10 13:26:17.879999 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:26:17.879968 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-k7mcw\" is forbidden: User \"system:node:ip-10-0-136-19.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-19.ec2.internal' and this object" podUID="92f6ab69-8a3c-42bb-8042-060774bc98f4" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k7mcw" Jun 10 13:26:17.882488 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:26:17.882467 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-fmjd6\" is forbidden: User \"system:node:ip-10-0-136-19.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-19.ec2.internal' and this object" podUID="34247982-5ef4-49b1-87de-e1d227d64637" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fmjd6" Jun 10 13:26:17.884761 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:26:17.884745 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-k7mcw\" is forbidden: User \"system:node:ip-10-0-136-19.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-19.ec2.internal' and this object" podUID="92f6ab69-8a3c-42bb-8042-060774bc98f4" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k7mcw" Jun 10 13:26:17.920082 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:17.920053 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r8mb2\" (UniqueName: \"kubernetes.io/projected/34247982-5ef4-49b1-87de-e1d227d64637-kube-api-access-r8mb2\") pod \"34247982-5ef4-49b1-87de-e1d227d64637\" (UID: \"34247982-5ef4-49b1-87de-e1d227d64637\") " Jun 10 13:26:17.920219 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:17.920115 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s5hsx\" (UniqueName: \"kubernetes.io/projected/92f6ab69-8a3c-42bb-8042-060774bc98f4-kube-api-access-s5hsx\") pod \"92f6ab69-8a3c-42bb-8042-060774bc98f4\" (UID: \"92f6ab69-8a3c-42bb-8042-060774bc98f4\") " Jun 10 13:26:17.920219 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:17.920161 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/34247982-5ef4-49b1-87de-e1d227d64637-extensions-socket-volume\") pod \"34247982-5ef4-49b1-87de-e1d227d64637\" (UID: \"34247982-5ef4-49b1-87de-e1d227d64637\") " Jun 10 13:26:17.920502 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:17.920476 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b8997274-6815-4174-85ed-b5cae9129807-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-szn2h\" (UID: \"b8997274-6815-4174-85ed-b5cae9129807\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-szn2h" Jun 10 13:26:17.920567 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:17.920514 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zstjr\" (UniqueName: \"kubernetes.io/projected/b8997274-6815-4174-85ed-b5cae9129807-kube-api-access-zstjr\") pod \"kuadrant-operator-controller-manager-86878c769f-szn2h\" (UID: \"b8997274-6815-4174-85ed-b5cae9129807\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-szn2h" Jun 10 13:26:17.920643 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:17.920624 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34247982-5ef4-49b1-87de-e1d227d64637-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "34247982-5ef4-49b1-87de-e1d227d64637" (UID: "34247982-5ef4-49b1-87de-e1d227d64637"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 13:26:17.922256 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:17.922227 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34247982-5ef4-49b1-87de-e1d227d64637-kube-api-access-r8mb2" (OuterVolumeSpecName: "kube-api-access-r8mb2") pod "34247982-5ef4-49b1-87de-e1d227d64637" (UID: "34247982-5ef4-49b1-87de-e1d227d64637"). InnerVolumeSpecName "kube-api-access-r8mb2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 13:26:17.922256 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:17.922248 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92f6ab69-8a3c-42bb-8042-060774bc98f4-kube-api-access-s5hsx" (OuterVolumeSpecName: "kube-api-access-s5hsx") pod "92f6ab69-8a3c-42bb-8042-060774bc98f4" (UID: "92f6ab69-8a3c-42bb-8042-060774bc98f4"). InnerVolumeSpecName "kube-api-access-s5hsx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 13:26:17.946653 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:17.946620 2567 generic.go:356] "Generic (PLEG): container finished" podID="34247982-5ef4-49b1-87de-e1d227d64637" containerID="2dbcfe830dc6070767a510a95ad65127bda4f51586e7e9f2bda4fb351c29c91e" exitCode=0 Jun 10 13:26:17.946765 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:17.946672 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fmjd6" Jun 10 13:26:17.946765 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:17.946729 2567 scope.go:117] "RemoveContainer" containerID="2dbcfe830dc6070767a510a95ad65127bda4f51586e7e9f2bda4fb351c29c91e" Jun 10 13:26:17.948004 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:17.947983 2567 generic.go:356] "Generic (PLEG): container finished" podID="92f6ab69-8a3c-42bb-8042-060774bc98f4" containerID="231b8a94e20a90309dd654b757c44fd7439c8f58430244b6bb364f40f75bdda3" exitCode=0 Jun 10 13:26:17.948108 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:17.948032 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k7mcw" Jun 10 13:26:17.949511 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:26:17.949489 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-k7mcw\" is forbidden: User \"system:node:ip-10-0-136-19.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-19.ec2.internal' and this object" podUID="92f6ab69-8a3c-42bb-8042-060774bc98f4" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k7mcw" Jun 10 13:26:17.952040 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:26:17.952015 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-fmjd6\" is forbidden: User \"system:node:ip-10-0-136-19.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-19.ec2.internal' and this object" podUID="34247982-5ef4-49b1-87de-e1d227d64637" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fmjd6" Jun 10 13:26:17.956193 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:17.956169 2567 scope.go:117] "RemoveContainer" containerID="2dbcfe830dc6070767a510a95ad65127bda4f51586e7e9f2bda4fb351c29c91e" Jun 10 13:26:17.956498 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:26:17.956477 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2dbcfe830dc6070767a510a95ad65127bda4f51586e7e9f2bda4fb351c29c91e\": container with ID starting with 2dbcfe830dc6070767a510a95ad65127bda4f51586e7e9f2bda4fb351c29c91e not found: ID does not exist" containerID="2dbcfe830dc6070767a510a95ad65127bda4f51586e7e9f2bda4fb351c29c91e" Jun 10 13:26:17.956498 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:17.956510 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2dbcfe830dc6070767a510a95ad65127bda4f51586e7e9f2bda4fb351c29c91e"} err="failed to get container status \"2dbcfe830dc6070767a510a95ad65127bda4f51586e7e9f2bda4fb351c29c91e\": rpc error: code = NotFound desc = could not find container \"2dbcfe830dc6070767a510a95ad65127bda4f51586e7e9f2bda4fb351c29c91e\": container with ID starting with 2dbcfe830dc6070767a510a95ad65127bda4f51586e7e9f2bda4fb351c29c91e not found: ID does not exist" Jun 10 13:26:17.956670 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:17.956533 2567 scope.go:117] "RemoveContainer" containerID="231b8a94e20a90309dd654b757c44fd7439c8f58430244b6bb364f40f75bdda3" Jun 10 13:26:17.958610 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:26:17.958587 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-fmjd6\" is forbidden: User \"system:node:ip-10-0-136-19.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-19.ec2.internal' and this object" podUID="34247982-5ef4-49b1-87de-e1d227d64637" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fmjd6" Jun 10 13:26:17.961536 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:26:17.961515 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-k7mcw\" is forbidden: User \"system:node:ip-10-0-136-19.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-19.ec2.internal' and this object" podUID="92f6ab69-8a3c-42bb-8042-060774bc98f4" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k7mcw" Jun 10 13:26:17.964501 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:26:17.964477 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-fmjd6\" is forbidden: User \"system:node:ip-10-0-136-19.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-19.ec2.internal' and this object" podUID="34247982-5ef4-49b1-87de-e1d227d64637" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fmjd6" Jun 10 13:26:17.965263 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:17.965249 2567 scope.go:117] "RemoveContainer" containerID="231b8a94e20a90309dd654b757c44fd7439c8f58430244b6bb364f40f75bdda3" Jun 10 13:26:17.965512 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:26:17.965496 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"231b8a94e20a90309dd654b757c44fd7439c8f58430244b6bb364f40f75bdda3\": container with ID starting with 231b8a94e20a90309dd654b757c44fd7439c8f58430244b6bb364f40f75bdda3 not found: ID does not exist" containerID="231b8a94e20a90309dd654b757c44fd7439c8f58430244b6bb364f40f75bdda3" Jun 10 13:26:17.965570 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:17.965518 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"231b8a94e20a90309dd654b757c44fd7439c8f58430244b6bb364f40f75bdda3"} err="failed to get container status \"231b8a94e20a90309dd654b757c44fd7439c8f58430244b6bb364f40f75bdda3\": rpc error: code = NotFound desc = could not find container \"231b8a94e20a90309dd654b757c44fd7439c8f58430244b6bb364f40f75bdda3\": container with ID starting with 231b8a94e20a90309dd654b757c44fd7439c8f58430244b6bb364f40f75bdda3 not found: ID does not exist" Jun 10 13:26:17.967530 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:26:17.967508 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-k7mcw\" is forbidden: User \"system:node:ip-10-0-136-19.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-19.ec2.internal' and this object" podUID="92f6ab69-8a3c-42bb-8042-060774bc98f4" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k7mcw" Jun 10 13:26:18.014717 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:18.014685 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h4rxp" Jun 10 13:26:18.021099 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:18.021070 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b8997274-6815-4174-85ed-b5cae9129807-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-szn2h\" (UID: \"b8997274-6815-4174-85ed-b5cae9129807\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-szn2h" Jun 10 13:26:18.021168 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:18.021120 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zstjr\" (UniqueName: \"kubernetes.io/projected/b8997274-6815-4174-85ed-b5cae9129807-kube-api-access-zstjr\") pod \"kuadrant-operator-controller-manager-86878c769f-szn2h\" (UID: \"b8997274-6815-4174-85ed-b5cae9129807\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-szn2h" Jun 10 13:26:18.021231 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:18.021217 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r8mb2\" (UniqueName: \"kubernetes.io/projected/34247982-5ef4-49b1-87de-e1d227d64637-kube-api-access-r8mb2\") on node \"ip-10-0-136-19.ec2.internal\" DevicePath \"\"" Jun 10 13:26:18.021290 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:18.021237 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s5hsx\" (UniqueName: \"kubernetes.io/projected/92f6ab69-8a3c-42bb-8042-060774bc98f4-kube-api-access-s5hsx\") on node \"ip-10-0-136-19.ec2.internal\" DevicePath \"\"" Jun 10 13:26:18.021290 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:18.021255 2567 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/34247982-5ef4-49b1-87de-e1d227d64637-extensions-socket-volume\") on node \"ip-10-0-136-19.ec2.internal\" DevicePath \"\"" Jun 10 13:26:18.021541 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:18.021518 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b8997274-6815-4174-85ed-b5cae9129807-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-szn2h\" (UID: \"b8997274-6815-4174-85ed-b5cae9129807\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-szn2h" Jun 10 13:26:18.023808 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:18.023781 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fjfb4" Jun 10 13:26:18.039737 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:18.039710 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zstjr\" (UniqueName: \"kubernetes.io/projected/b8997274-6815-4174-85ed-b5cae9129807-kube-api-access-zstjr\") pod \"kuadrant-operator-controller-manager-86878c769f-szn2h\" (UID: \"b8997274-6815-4174-85ed-b5cae9129807\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-szn2h" Jun 10 13:26:18.154222 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:18.154129 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-szn2h" Jun 10 13:26:18.176872 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:18.176822 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h4rxp"] Jun 10 13:26:18.178331 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:26:18.178297 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f0307b3_b8ab_43b3_b418_b26b57483104.slice/crio-1f7f8f4d25149cc807a29939e0bea251e2be1a1ac31c3e64a34f305545e0773c WatchSource:0}: Error finding container 1f7f8f4d25149cc807a29939e0bea251e2be1a1ac31c3e64a34f305545e0773c: Status 404 returned error can't find the container with id 1f7f8f4d25149cc807a29939e0bea251e2be1a1ac31c3e64a34f305545e0773c Jun 10 13:26:18.191340 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:18.191313 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fjfb4"] Jun 10 13:26:18.197639 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:26:18.197599 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bab3dc0_fc0b_4792_a478_1ec3cfd20464.slice/crio-6a1811e75b409d14d6bda6fdfce2e4e54d94b5d9cb10880d47a9186b561e2593 WatchSource:0}: Error finding container 6a1811e75b409d14d6bda6fdfce2e4e54d94b5d9cb10880d47a9186b561e2593: Status 404 returned error can't find the container with id 6a1811e75b409d14d6bda6fdfce2e4e54d94b5d9cb10880d47a9186b561e2593 Jun 10 13:26:18.318652 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:18.318628 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-szn2h"] Jun 10 13:26:18.320606 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:26:18.320580 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8997274_6815_4174_85ed_b5cae9129807.slice/crio-cecee5b287317e44238d55d0b944097f1fa44190d3911d0034225391d95d0d77 WatchSource:0}: Error finding container cecee5b287317e44238d55d0b944097f1fa44190d3911d0034225391d95d0d77: Status 404 returned error can't find the container with id cecee5b287317e44238d55d0b944097f1fa44190d3911d0034225391d95d0d77 Jun 10 13:26:18.904680 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:18.904649 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:26:18.954491 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:18.954459 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h4rxp" event={"ID":"4f0307b3-b8ab-43b3-b418-b26b57483104","Type":"ContainerStarted","Data":"b6ea75343b00de5215ed3b182cf6d1c9781faf0e2fb4746fc95fe46f2323cc2b"} Jun 10 13:26:18.954674 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:18.954515 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h4rxp" event={"ID":"4f0307b3-b8ab-43b3-b418-b26b57483104","Type":"ContainerStarted","Data":"1f7f8f4d25149cc807a29939e0bea251e2be1a1ac31c3e64a34f305545e0773c"} Jun 10 13:26:18.954674 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:18.954540 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h4rxp" Jun 10 13:26:18.957775 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:18.957750 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fjfb4" event={"ID":"6bab3dc0-fc0b-4792-a478-1ec3cfd20464","Type":"ContainerStarted","Data":"d6c2b6faa8182d4ab6d4b1bcbdcb63bce3c0c7f5f3941826eac0be1295034b72"} Jun 10 13:26:18.957930 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:18.957795 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fjfb4" event={"ID":"6bab3dc0-fc0b-4792-a478-1ec3cfd20464","Type":"ContainerStarted","Data":"6a1811e75b409d14d6bda6fdfce2e4e54d94b5d9cb10880d47a9186b561e2593"} Jun 10 13:26:18.957930 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:18.957864 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fjfb4" Jun 10 13:26:18.957930 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:26:18.957914 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-fmjd6\" is forbidden: User \"system:node:ip-10-0-136-19.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-19.ec2.internal' and this object" podUID="34247982-5ef4-49b1-87de-e1d227d64637" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fmjd6" Jun 10 13:26:18.959240 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:18.959215 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-szn2h" event={"ID":"b8997274-6815-4174-85ed-b5cae9129807","Type":"ContainerStarted","Data":"6482fbb0b28da9d1f0b5af392575824ec0278aaddb35836bbadc1a001142cfdc"} Jun 10 13:26:18.959353 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:18.959258 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-szn2h" event={"ID":"b8997274-6815-4174-85ed-b5cae9129807","Type":"ContainerStarted","Data":"cecee5b287317e44238d55d0b944097f1fa44190d3911d0034225391d95d0d77"} Jun 10 13:26:18.959353 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:18.959299 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-szn2h" Jun 10 13:26:18.995215 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:26:18.995191 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-k7mcw\" is forbidden: User \"system:node:ip-10-0-136-19.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-19.ec2.internal' and this object" podUID="92f6ab69-8a3c-42bb-8042-060774bc98f4" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k7mcw" Jun 10 13:26:18.999858 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:18.999816 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:26:19.016650 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:19.016607 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h4rxp" podStartSLOduration=2.016591196 podStartE2EDuration="2.016591196s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:26:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:26:18.993080329 +0000 UTC m=+686.258330926" watchObservedRunningTime="2026-06-10 13:26:19.016591196 +0000 UTC m=+686.281841789" Jun 10 13:26:19.017646 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:19.017617 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-szn2h" podStartSLOduration=2.017608153 podStartE2EDuration="2.017608153s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:26:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:26:19.015531788 +0000 UTC m=+686.280782386" watchObservedRunningTime="2026-06-10 13:26:19.017608153 +0000 UTC m=+686.282858749" Jun 10 13:26:19.017879 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:26:19.017831 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-k7mcw\" is forbidden: User \"system:node:ip-10-0-136-19.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-19.ec2.internal' and this object" podUID="92f6ab69-8a3c-42bb-8042-060774bc98f4" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k7mcw" Jun 10 13:26:19.019926 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:26:19.019908 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-fmjd6\" is forbidden: User \"system:node:ip-10-0-136-19.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-19.ec2.internal' and this object" podUID="34247982-5ef4-49b1-87de-e1d227d64637" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fmjd6" Jun 10 13:26:19.040118 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:19.040076 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fjfb4" podStartSLOduration=2.040061971 podStartE2EDuration="2.040061971s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:26:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:26:19.03912047 +0000 UTC m=+686.304371068" watchObservedRunningTime="2026-06-10 13:26:19.040061971 +0000 UTC m=+686.305312567" Jun 10 13:26:19.208684 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:19.208593 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="34247982-5ef4-49b1-87de-e1d227d64637" path="/var/lib/kubelet/pods/34247982-5ef4-49b1-87de-e1d227d64637/volumes" Jun 10 13:26:19.209037 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:19.209017 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92f6ab69-8a3c-42bb-8042-060774bc98f4" path="/var/lib/kubelet/pods/92f6ab69-8a3c-42bb-8042-060774bc98f4/volumes" Jun 10 13:26:21.439123 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:21.439084 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:26:21.539068 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:21.539038 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:26:25.614079 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:25.614040 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:26:25.715586 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:25.715548 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:26:27.888820 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:27.888744 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:26:27.986907 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:27.986875 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:26:29.966692 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:29.966665 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h4rxp" Jun 10 13:26:29.967110 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:29.966767 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fjfb4" Jun 10 13:26:29.967110 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:29.967094 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-szn2h" Jun 10 13:26:30.089038 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:30.089004 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h4rxp"] Jun 10 13:26:30.089213 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:30.089173 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h4rxp" podUID="4f0307b3-b8ab-43b3-b418-b26b57483104" containerName="manager" containerID="cri-o://b6ea75343b00de5215ed3b182cf6d1c9781faf0e2fb4746fc95fe46f2323cc2b" gracePeriod=10 Jun 10 13:26:30.340088 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:30.340067 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h4rxp" Jun 10 13:26:30.434166 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:30.434141 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tvd25\" (UniqueName: \"kubernetes.io/projected/4f0307b3-b8ab-43b3-b418-b26b57483104-kube-api-access-tvd25\") pod \"4f0307b3-b8ab-43b3-b418-b26b57483104\" (UID: \"4f0307b3-b8ab-43b3-b418-b26b57483104\") " Jun 10 13:26:30.434320 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:30.434195 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4f0307b3-b8ab-43b3-b418-b26b57483104-extensions-socket-volume\") pod \"4f0307b3-b8ab-43b3-b418-b26b57483104\" (UID: \"4f0307b3-b8ab-43b3-b418-b26b57483104\") " Jun 10 13:26:30.434567 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:30.434547 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f0307b3-b8ab-43b3-b418-b26b57483104-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "4f0307b3-b8ab-43b3-b418-b26b57483104" (UID: "4f0307b3-b8ab-43b3-b418-b26b57483104"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 13:26:30.436045 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:30.436010 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f0307b3-b8ab-43b3-b418-b26b57483104-kube-api-access-tvd25" (OuterVolumeSpecName: "kube-api-access-tvd25") pod "4f0307b3-b8ab-43b3-b418-b26b57483104" (UID: "4f0307b3-b8ab-43b3-b418-b26b57483104"). InnerVolumeSpecName "kube-api-access-tvd25". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 13:26:30.535737 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:30.535661 2567 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4f0307b3-b8ab-43b3-b418-b26b57483104-extensions-socket-volume\") on node \"ip-10-0-136-19.ec2.internal\" DevicePath \"\"" Jun 10 13:26:30.535737 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:30.535686 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tvd25\" (UniqueName: \"kubernetes.io/projected/4f0307b3-b8ab-43b3-b418-b26b57483104-kube-api-access-tvd25\") on node \"ip-10-0-136-19.ec2.internal\" DevicePath \"\"" Jun 10 13:26:31.025879 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:31.025822 2567 generic.go:356] "Generic (PLEG): container finished" podID="4f0307b3-b8ab-43b3-b418-b26b57483104" containerID="b6ea75343b00de5215ed3b182cf6d1c9781faf0e2fb4746fc95fe46f2323cc2b" exitCode=0 Jun 10 13:26:31.025879 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:31.025878 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h4rxp" Jun 10 13:26:31.026408 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:31.025911 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h4rxp" event={"ID":"4f0307b3-b8ab-43b3-b418-b26b57483104","Type":"ContainerDied","Data":"b6ea75343b00de5215ed3b182cf6d1c9781faf0e2fb4746fc95fe46f2323cc2b"} Jun 10 13:26:31.026408 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:31.025971 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h4rxp" event={"ID":"4f0307b3-b8ab-43b3-b418-b26b57483104","Type":"ContainerDied","Data":"1f7f8f4d25149cc807a29939e0bea251e2be1a1ac31c3e64a34f305545e0773c"} Jun 10 13:26:31.026408 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:31.026004 2567 scope.go:117] "RemoveContainer" containerID="b6ea75343b00de5215ed3b182cf6d1c9781faf0e2fb4746fc95fe46f2323cc2b" Jun 10 13:26:31.035308 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:31.035293 2567 scope.go:117] "RemoveContainer" containerID="b6ea75343b00de5215ed3b182cf6d1c9781faf0e2fb4746fc95fe46f2323cc2b" Jun 10 13:26:31.035565 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:26:31.035548 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6ea75343b00de5215ed3b182cf6d1c9781faf0e2fb4746fc95fe46f2323cc2b\": container with ID starting with b6ea75343b00de5215ed3b182cf6d1c9781faf0e2fb4746fc95fe46f2323cc2b not found: ID does not exist" containerID="b6ea75343b00de5215ed3b182cf6d1c9781faf0e2fb4746fc95fe46f2323cc2b" Jun 10 13:26:31.035632 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:31.035572 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6ea75343b00de5215ed3b182cf6d1c9781faf0e2fb4746fc95fe46f2323cc2b"} err="failed to get container status \"b6ea75343b00de5215ed3b182cf6d1c9781faf0e2fb4746fc95fe46f2323cc2b\": rpc error: code = NotFound desc = could not find container \"b6ea75343b00de5215ed3b182cf6d1c9781faf0e2fb4746fc95fe46f2323cc2b\": container with ID starting with b6ea75343b00de5215ed3b182cf6d1c9781faf0e2fb4746fc95fe46f2323cc2b not found: ID does not exist" Jun 10 13:26:31.053738 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:31.053715 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h4rxp"] Jun 10 13:26:31.069176 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:31.065901 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h4rxp"] Jun 10 13:26:31.208329 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:31.208296 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f0307b3-b8ab-43b3-b418-b26b57483104" path="/var/lib/kubelet/pods/4f0307b3-b8ab-43b3-b418-b26b57483104/volumes" Jun 10 13:26:36.618024 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:36.617964 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:26:36.717743 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:36.717711 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:26:39.077264 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:39.077166 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:26:39.177098 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:39.177051 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:26:43.425256 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:43.425221 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:26:43.525589 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:43.525553 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:26:46.330452 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:46.330421 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8dvvf"] Jun 10 13:26:46.331162 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:46.331133 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f0307b3-b8ab-43b3-b418-b26b57483104" containerName="manager" Jun 10 13:26:46.331245 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:46.331164 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f0307b3-b8ab-43b3-b418-b26b57483104" containerName="manager" Jun 10 13:26:46.331318 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:46.331300 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f0307b3-b8ab-43b3-b418-b26b57483104" containerName="manager" Jun 10 13:26:46.333481 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:46.333459 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8dvvf" Jun 10 13:26:46.336264 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:46.336237 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-ttwpv\"" Jun 10 13:26:46.347363 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:46.346824 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8dvvf"] Jun 10 13:26:46.372469 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:46.372439 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:26:46.449229 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:46.449188 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:26:46.475346 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:46.475310 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c61fc96-27a9-461a-8253-b5ca4b1fbb11-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-8dvvf\" (UID: \"2c61fc96-27a9-461a-8253-b5ca4b1fbb11\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8dvvf" Jun 10 13:26:46.475346 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:46.475349 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c61fc96-27a9-461a-8253-b5ca4b1fbb11-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-8dvvf\" (UID: \"2c61fc96-27a9-461a-8253-b5ca4b1fbb11\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8dvvf" Jun 10 13:26:46.475633 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:46.475375 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c61fc96-27a9-461a-8253-b5ca4b1fbb11-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-8dvvf\" (UID: \"2c61fc96-27a9-461a-8253-b5ca4b1fbb11\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8dvvf" Jun 10 13:26:46.475633 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:46.475458 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c61fc96-27a9-461a-8253-b5ca4b1fbb11-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-8dvvf\" (UID: \"2c61fc96-27a9-461a-8253-b5ca4b1fbb11\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8dvvf" Jun 10 13:26:46.475633 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:46.475486 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ggkc\" (UniqueName: \"kubernetes.io/projected/2c61fc96-27a9-461a-8253-b5ca4b1fbb11-kube-api-access-6ggkc\") pod \"maas-default-gateway-openshift-default-687ff6996-8dvvf\" (UID: \"2c61fc96-27a9-461a-8253-b5ca4b1fbb11\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8dvvf" Jun 10 13:26:46.475633 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:46.475574 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c61fc96-27a9-461a-8253-b5ca4b1fbb11-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-8dvvf\" (UID: \"2c61fc96-27a9-461a-8253-b5ca4b1fbb11\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8dvvf" Jun 10 13:26:46.475633 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:46.475596 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c61fc96-27a9-461a-8253-b5ca4b1fbb11-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-8dvvf\" (UID: \"2c61fc96-27a9-461a-8253-b5ca4b1fbb11\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8dvvf" Jun 10 13:26:46.475633 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:46.475623 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c61fc96-27a9-461a-8253-b5ca4b1fbb11-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-8dvvf\" (UID: \"2c61fc96-27a9-461a-8253-b5ca4b1fbb11\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8dvvf" Jun 10 13:26:46.475993 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:46.475677 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c61fc96-27a9-461a-8253-b5ca4b1fbb11-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-8dvvf\" (UID: \"2c61fc96-27a9-461a-8253-b5ca4b1fbb11\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8dvvf" Jun 10 13:26:46.547906 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:46.547869 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:26:46.577136 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:46.577105 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c61fc96-27a9-461a-8253-b5ca4b1fbb11-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-8dvvf\" (UID: \"2c61fc96-27a9-461a-8253-b5ca4b1fbb11\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8dvvf" Jun 10 13:26:46.577136 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:46.577138 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c61fc96-27a9-461a-8253-b5ca4b1fbb11-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-8dvvf\" (UID: \"2c61fc96-27a9-461a-8253-b5ca4b1fbb11\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8dvvf" Jun 10 13:26:46.577387 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:46.577165 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c61fc96-27a9-461a-8253-b5ca4b1fbb11-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-8dvvf\" (UID: \"2c61fc96-27a9-461a-8253-b5ca4b1fbb11\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8dvvf" Jun 10 13:26:46.577387 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:46.577199 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c61fc96-27a9-461a-8253-b5ca4b1fbb11-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-8dvvf\" (UID: \"2c61fc96-27a9-461a-8253-b5ca4b1fbb11\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8dvvf" Jun 10 13:26:46.577387 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:46.577222 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c61fc96-27a9-461a-8253-b5ca4b1fbb11-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-8dvvf\" (UID: \"2c61fc96-27a9-461a-8253-b5ca4b1fbb11\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8dvvf" Jun 10 13:26:46.577387 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:46.577240 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c61fc96-27a9-461a-8253-b5ca4b1fbb11-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-8dvvf\" (UID: \"2c61fc96-27a9-461a-8253-b5ca4b1fbb11\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8dvvf" Jun 10 13:26:46.577387 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:46.577262 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c61fc96-27a9-461a-8253-b5ca4b1fbb11-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-8dvvf\" (UID: \"2c61fc96-27a9-461a-8253-b5ca4b1fbb11\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8dvvf" Jun 10 13:26:46.577387 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:46.577292 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c61fc96-27a9-461a-8253-b5ca4b1fbb11-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-8dvvf\" (UID: \"2c61fc96-27a9-461a-8253-b5ca4b1fbb11\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8dvvf" Jun 10 13:26:46.577387 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:46.577315 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ggkc\" (UniqueName: \"kubernetes.io/projected/2c61fc96-27a9-461a-8253-b5ca4b1fbb11-kube-api-access-6ggkc\") pod \"maas-default-gateway-openshift-default-687ff6996-8dvvf\" (UID: \"2c61fc96-27a9-461a-8253-b5ca4b1fbb11\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8dvvf" Jun 10 13:26:46.577730 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:46.577578 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c61fc96-27a9-461a-8253-b5ca4b1fbb11-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-8dvvf\" (UID: \"2c61fc96-27a9-461a-8253-b5ca4b1fbb11\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8dvvf" Jun 10 13:26:46.577730 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:46.577661 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c61fc96-27a9-461a-8253-b5ca4b1fbb11-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-8dvvf\" (UID: \"2c61fc96-27a9-461a-8253-b5ca4b1fbb11\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8dvvf" Jun 10 13:26:46.577730 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:46.577702 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c61fc96-27a9-461a-8253-b5ca4b1fbb11-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-8dvvf\" (UID: \"2c61fc96-27a9-461a-8253-b5ca4b1fbb11\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8dvvf" Jun 10 13:26:46.577873 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:46.577726 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c61fc96-27a9-461a-8253-b5ca4b1fbb11-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-8dvvf\" (UID: \"2c61fc96-27a9-461a-8253-b5ca4b1fbb11\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8dvvf" Jun 10 13:26:46.578188 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:46.578170 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c61fc96-27a9-461a-8253-b5ca4b1fbb11-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-8dvvf\" (UID: \"2c61fc96-27a9-461a-8253-b5ca4b1fbb11\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8dvvf" Jun 10 13:26:46.579542 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:46.579521 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c61fc96-27a9-461a-8253-b5ca4b1fbb11-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-8dvvf\" (UID: \"2c61fc96-27a9-461a-8253-b5ca4b1fbb11\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8dvvf" Jun 10 13:26:46.579711 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:46.579693 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c61fc96-27a9-461a-8253-b5ca4b1fbb11-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-8dvvf\" (UID: \"2c61fc96-27a9-461a-8253-b5ca4b1fbb11\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8dvvf" Jun 10 13:26:46.586297 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:46.586244 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ggkc\" (UniqueName: \"kubernetes.io/projected/2c61fc96-27a9-461a-8253-b5ca4b1fbb11-kube-api-access-6ggkc\") pod \"maas-default-gateway-openshift-default-687ff6996-8dvvf\" (UID: \"2c61fc96-27a9-461a-8253-b5ca4b1fbb11\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8dvvf" Jun 10 13:26:46.586297 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:46.586249 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c61fc96-27a9-461a-8253-b5ca4b1fbb11-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-8dvvf\" (UID: \"2c61fc96-27a9-461a-8253-b5ca4b1fbb11\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8dvvf" Jun 10 13:26:46.649693 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:46.649669 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8dvvf" Jun 10 13:26:46.804574 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:46.804549 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8dvvf"] Jun 10 13:26:46.806925 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:26:46.806896 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c61fc96_27a9_461a_8253_b5ca4b1fbb11.slice/crio-efce53cd929bb03b55fcafc28cab2ef1a10e9ef792a2b9e85b84a0425566a83b WatchSource:0}: Error finding container efce53cd929bb03b55fcafc28cab2ef1a10e9ef792a2b9e85b84a0425566a83b: Status 404 returned error can't find the container with id efce53cd929bb03b55fcafc28cab2ef1a10e9ef792a2b9e85b84a0425566a83b Jun 10 13:26:46.809034 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:46.808995 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 10 13:26:46.809123 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:46.809080 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 10 13:26:46.809165 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:46.809121 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 10 13:26:47.116910 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:47.116787 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8dvvf" event={"ID":"2c61fc96-27a9-461a-8253-b5ca4b1fbb11","Type":"ContainerStarted","Data":"a44f11156366457919a0e10d949fe8a9372a2aa2aeae6ea95fbcc00a675fc449"} Jun 10 13:26:47.116910 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:47.116883 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8dvvf" event={"ID":"2c61fc96-27a9-461a-8253-b5ca4b1fbb11","Type":"ContainerStarted","Data":"efce53cd929bb03b55fcafc28cab2ef1a10e9ef792a2b9e85b84a0425566a83b"} Jun 10 13:26:47.151364 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:47.151311 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8dvvf" podStartSLOduration=1.151296093 podStartE2EDuration="1.151296093s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:26:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:26:47.148949676 +0000 UTC m=+714.414200276" watchObservedRunningTime="2026-06-10 13:26:47.151296093 +0000 UTC m=+714.416546778" Jun 10 13:26:47.650668 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:47.650636 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8dvvf" Jun 10 13:26:47.655802 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:47.655780 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8dvvf" Jun 10 13:26:48.122556 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:48.122526 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8dvvf" Jun 10 13:26:48.123594 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:48.123570 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8dvvf" Jun 10 13:26:50.322164 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:50.322123 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:26:50.675859 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:50.675787 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:26:50.818660 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:50.818625 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:26:50.915710 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:50.915673 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:26:51.564723 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:51.564681 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:26:51.638551 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:51.638502 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:26:51.643213 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:51.643189 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-vq66k"] Jun 10 13:26:51.646754 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:51.646734 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-vq66k" Jun 10 13:26:51.649433 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:51.649415 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-gmmt2\"" Jun 10 13:26:51.654993 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:51.654975 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-vq66k"] Jun 10 13:26:51.823753 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:51.823671 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9tw4\" (UniqueName: \"kubernetes.io/projected/4e314324-753a-4ac0-a003-4620905b0be3-kube-api-access-g9tw4\") pod \"authorino-75d556bd77-vq66k\" (UID: \"4e314324-753a-4ac0-a003-4620905b0be3\") " pod="kuadrant-system/authorino-75d556bd77-vq66k" Jun 10 13:26:51.924327 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:51.924297 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9tw4\" (UniqueName: \"kubernetes.io/projected/4e314324-753a-4ac0-a003-4620905b0be3-kube-api-access-g9tw4\") pod \"authorino-75d556bd77-vq66k\" (UID: \"4e314324-753a-4ac0-a003-4620905b0be3\") " pod="kuadrant-system/authorino-75d556bd77-vq66k" Jun 10 13:26:51.933119 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:51.933097 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9tw4\" (UniqueName: \"kubernetes.io/projected/4e314324-753a-4ac0-a003-4620905b0be3-kube-api-access-g9tw4\") pod \"authorino-75d556bd77-vq66k\" (UID: \"4e314324-753a-4ac0-a003-4620905b0be3\") " pod="kuadrant-system/authorino-75d556bd77-vq66k" Jun 10 13:26:51.956978 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:51.956955 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-vq66k" Jun 10 13:26:52.087096 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:52.087069 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-vq66k"] Jun 10 13:26:52.088971 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:26:52.088944 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4e314324_753a_4ac0_a003_4620905b0be3.slice/crio-0e07ce9b9ebdcc8a635d3275f324aa96ff45aa1021203336d73042532580b5ed WatchSource:0}: Error finding container 0e07ce9b9ebdcc8a635d3275f324aa96ff45aa1021203336d73042532580b5ed: Status 404 returned error can't find the container with id 0e07ce9b9ebdcc8a635d3275f324aa96ff45aa1021203336d73042532580b5ed Jun 10 13:26:52.146596 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:52.146561 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-vq66k" event={"ID":"4e314324-753a-4ac0-a003-4620905b0be3","Type":"ContainerStarted","Data":"0e07ce9b9ebdcc8a635d3275f324aa96ff45aa1021203336d73042532580b5ed"} Jun 10 13:26:56.013211 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:56.013155 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:26:56.127865 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:56.127800 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:26:56.173924 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:56.173895 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-vq66k" event={"ID":"4e314324-753a-4ac0-a003-4620905b0be3","Type":"ContainerStarted","Data":"19d60ff9108aef937dec3dd33f1bd12063ae4e003402e51bd28ac80ef0746b91"} Jun 10 13:26:56.202587 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:56.202537 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-vq66k" podStartSLOduration=2.086615213 podStartE2EDuration="5.202522367s" totalImagesPullingTime="3.115907154s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:26:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:26:56.200821539 +0000 UTC m=+723.466072137" watchObservedRunningTime="2026-06-10 13:26:56.202522367 +0000 UTC m=+723.467772963" Jun 10 13:26:56.276891 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:56.276767 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:26:56.375574 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:56.375544 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:26:58.089024 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:58.088986 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:26:58.186917 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:58.186881 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:26:59.882708 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:26:59.882673 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:27:11.915475 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:27:11.915439 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:27:16.673092 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:27:16.673056 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:27:16.742965 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:27:16.742834 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:27:25.697144 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:27:25.697104 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:27:25.789732 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:27:25.789694 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:27:25.932632 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:27:25.932571 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:27:51.267167 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:27:51.267131 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:27:51.368626 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:27:51.368594 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:27:51.673100 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:27:51.673065 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 13:27:51.675753 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:27:51.675738 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 13:27:51.678497 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:27:51.678475 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 10 13:27:51.678632 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:27:51.678524 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 10 13:27:51.678632 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:27:51.678527 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-qrmvv\"" Jun 10 13:27:51.679489 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:27:51.679475 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 10 13:27:51.690408 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:27:51.690386 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 13:27:51.768942 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:27:51.768902 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzwk9\" (UniqueName: \"kubernetes.io/projected/b9243ce5-acf5-4d2b-8993-c277037f0a4b-kube-api-access-mzwk9\") pod \"maas-keycloak-0\" (UID: \"b9243ce5-acf5-4d2b-8993-c277037f0a4b\") " pod="keycloak-system/maas-keycloak-0" Jun 10 13:27:51.870247 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:27:51.870210 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzwk9\" (UniqueName: \"kubernetes.io/projected/b9243ce5-acf5-4d2b-8993-c277037f0a4b-kube-api-access-mzwk9\") pod \"maas-keycloak-0\" (UID: \"b9243ce5-acf5-4d2b-8993-c277037f0a4b\") " pod="keycloak-system/maas-keycloak-0" Jun 10 13:27:51.879346 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:27:51.879324 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzwk9\" (UniqueName: \"kubernetes.io/projected/b9243ce5-acf5-4d2b-8993-c277037f0a4b-kube-api-access-mzwk9\") pod \"maas-keycloak-0\" (UID: \"b9243ce5-acf5-4d2b-8993-c277037f0a4b\") " pod="keycloak-system/maas-keycloak-0" Jun 10 13:27:51.985654 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:27:51.985568 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 13:27:52.121958 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:27:52.121936 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 13:27:52.123940 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:27:52.123902 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9243ce5_acf5_4d2b_8993_c277037f0a4b.slice/crio-7de67c0619db2eebb858794192e028010d509c3d66b8088cfb38ae2cc63f4315 WatchSource:0}: Error finding container 7de67c0619db2eebb858794192e028010d509c3d66b8088cfb38ae2cc63f4315: Status 404 returned error can't find the container with id 7de67c0619db2eebb858794192e028010d509c3d66b8088cfb38ae2cc63f4315 Jun 10 13:27:52.475062 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:27:52.475030 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"b9243ce5-acf5-4d2b-8993-c277037f0a4b","Type":"ContainerStarted","Data":"7de67c0619db2eebb858794192e028010d509c3d66b8088cfb38ae2cc63f4315"} Jun 10 13:27:56.645899 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:27:56.645877 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 10 13:27:57.511645 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:27:57.511605 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"b9243ce5-acf5-4d2b-8993-c277037f0a4b","Type":"ContainerStarted","Data":"6003b93c30267f2ab8ba2e6a3ad829a9bdf2cd1349ea9f83d5882909028335dd"} Jun 10 13:27:57.533463 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:27:57.533409 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=2.015947219 podStartE2EDuration="6.53339262s" totalImagesPullingTime="4.517445401s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:27:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:27:57.532687685 +0000 UTC m=+784.797938279" watchObservedRunningTime="2026-06-10 13:27:57.53339262 +0000 UTC m=+784.798643217" Jun 10 13:27:57.986282 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:27:57.986243 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 10 13:27:57.988248 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:27:57.988211 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b9243ce5-acf5-4d2b-8993-c277037f0a4b" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.43:9000/health/started\": dial tcp 10.134.0.43:9000: connect: connection refused" Jun 10 13:27:58.986376 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:27:58.986321 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b9243ce5-acf5-4d2b-8993-c277037f0a4b" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.43:9000/health/started\": dial tcp 10.134.0.43:9000: connect: connection refused" Jun 10 13:27:59.987002 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:27:59.986952 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b9243ce5-acf5-4d2b-8993-c277037f0a4b" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.43:9000/health/started\": dial tcp 10.134.0.43:9000: connect: connection refused" Jun 10 13:28:00.986579 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:28:00.986535 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b9243ce5-acf5-4d2b-8993-c277037f0a4b" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.43:9000/health/started\": dial tcp 10.134.0.43:9000: connect: connection refused" Jun 10 13:28:01.986701 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:28:01.986645 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b9243ce5-acf5-4d2b-8993-c277037f0a4b" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.43:9000/health/started\": dial tcp 10.134.0.43:9000: connect: connection refused" Jun 10 13:28:01.987255 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:28:01.987206 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 10 13:28:02.986466 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:28:02.986418 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b9243ce5-acf5-4d2b-8993-c277037f0a4b" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.43:9000/health/started\": dial tcp 10.134.0.43:9000: connect: connection refused" Jun 10 13:28:03.986761 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:28:03.986705 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b9243ce5-acf5-4d2b-8993-c277037f0a4b" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.43:9000/health/started\": dial tcp 10.134.0.43:9000: connect: connection refused" Jun 10 13:28:04.986433 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:28:04.986381 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b9243ce5-acf5-4d2b-8993-c277037f0a4b" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.43:9000/health/started\": dial tcp 10.134.0.43:9000: connect: connection refused" Jun 10 13:28:05.987126 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:28:05.987078 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b9243ce5-acf5-4d2b-8993-c277037f0a4b" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.43:9000/health/started\": dial tcp 10.134.0.43:9000: connect: connection refused" Jun 10 13:28:06.986218 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:28:06.986168 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b9243ce5-acf5-4d2b-8993-c277037f0a4b" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.43:9000/health/started\": dial tcp 10.134.0.43:9000: connect: connection refused" Jun 10 13:28:07.986791 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:28:07.986741 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b9243ce5-acf5-4d2b-8993-c277037f0a4b" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.43:9000/health/started\": dial tcp 10.134.0.43:9000: connect: connection refused" Jun 10 13:28:08.986348 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:28:08.986306 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b9243ce5-acf5-4d2b-8993-c277037f0a4b" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.43:9000/health/started\": dial tcp 10.134.0.43:9000: connect: connection refused" Jun 10 13:28:10.093254 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:28:10.093204 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 10 13:28:10.109442 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:28:10.109402 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="b9243ce5-acf5-4d2b-8993-c277037f0a4b" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 13:28:20.099888 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:28:20.099826 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 10 13:28:20.757150 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:28:20.757110 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:28:20.906131 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:28:20.906095 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:28:23.335276 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:28:23.335245 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-vq66k"] Jun 10 13:28:23.335796 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:28:23.335432 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-vq66k" podUID="4e314324-753a-4ac0-a003-4620905b0be3" containerName="authorino" containerID="cri-o://19d60ff9108aef937dec3dd33f1bd12063ae4e003402e51bd28ac80ef0746b91" gracePeriod=30 Jun 10 13:28:23.595334 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:28:23.595279 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-vq66k" Jun 10 13:28:23.693818 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:28:23.693790 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g9tw4\" (UniqueName: \"kubernetes.io/projected/4e314324-753a-4ac0-a003-4620905b0be3-kube-api-access-g9tw4\") pod \"4e314324-753a-4ac0-a003-4620905b0be3\" (UID: \"4e314324-753a-4ac0-a003-4620905b0be3\") " Jun 10 13:28:23.695788 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:28:23.695758 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e314324-753a-4ac0-a003-4620905b0be3-kube-api-access-g9tw4" (OuterVolumeSpecName: "kube-api-access-g9tw4") pod "4e314324-753a-4ac0-a003-4620905b0be3" (UID: "4e314324-753a-4ac0-a003-4620905b0be3"). InnerVolumeSpecName "kube-api-access-g9tw4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 13:28:23.705919 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:28:23.705897 2567 generic.go:356] "Generic (PLEG): container finished" podID="4e314324-753a-4ac0-a003-4620905b0be3" containerID="19d60ff9108aef937dec3dd33f1bd12063ae4e003402e51bd28ac80ef0746b91" exitCode=0 Jun 10 13:28:23.706009 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:28:23.705938 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-vq66k" Jun 10 13:28:23.706009 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:28:23.705956 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-vq66k" event={"ID":"4e314324-753a-4ac0-a003-4620905b0be3","Type":"ContainerDied","Data":"19d60ff9108aef937dec3dd33f1bd12063ae4e003402e51bd28ac80ef0746b91"} Jun 10 13:28:23.706009 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:28:23.705988 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-vq66k" event={"ID":"4e314324-753a-4ac0-a003-4620905b0be3","Type":"ContainerDied","Data":"0e07ce9b9ebdcc8a635d3275f324aa96ff45aa1021203336d73042532580b5ed"} Jun 10 13:28:23.706009 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:28:23.706004 2567 scope.go:117] "RemoveContainer" containerID="19d60ff9108aef937dec3dd33f1bd12063ae4e003402e51bd28ac80ef0746b91" Jun 10 13:28:23.715227 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:28:23.715205 2567 scope.go:117] "RemoveContainer" containerID="19d60ff9108aef937dec3dd33f1bd12063ae4e003402e51bd28ac80ef0746b91" Jun 10 13:28:23.715455 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:28:23.715434 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19d60ff9108aef937dec3dd33f1bd12063ae4e003402e51bd28ac80ef0746b91\": container with ID starting with 19d60ff9108aef937dec3dd33f1bd12063ae4e003402e51bd28ac80ef0746b91 not found: ID does not exist" containerID="19d60ff9108aef937dec3dd33f1bd12063ae4e003402e51bd28ac80ef0746b91" Jun 10 13:28:23.715527 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:28:23.715461 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19d60ff9108aef937dec3dd33f1bd12063ae4e003402e51bd28ac80ef0746b91"} err="failed to get container status \"19d60ff9108aef937dec3dd33f1bd12063ae4e003402e51bd28ac80ef0746b91\": rpc error: code = NotFound desc = could not find container \"19d60ff9108aef937dec3dd33f1bd12063ae4e003402e51bd28ac80ef0746b91\": container with ID starting with 19d60ff9108aef937dec3dd33f1bd12063ae4e003402e51bd28ac80ef0746b91 not found: ID does not exist" Jun 10 13:28:23.734118 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:28:23.734091 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-vq66k"] Jun 10 13:28:23.736470 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:28:23.736447 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-vq66k"] Jun 10 13:28:23.794339 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:28:23.794316 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g9tw4\" (UniqueName: \"kubernetes.io/projected/4e314324-753a-4ac0-a003-4620905b0be3-kube-api-access-g9tw4\") on node \"ip-10-0-136-19.ec2.internal\" DevicePath \"\"" Jun 10 13:28:25.208372 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:28:25.208343 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e314324-753a-4ac0-a003-4620905b0be3" path="/var/lib/kubelet/pods/4e314324-753a-4ac0-a003-4620905b0be3/volumes" Jun 10 13:28:26.781898 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:28:26.781855 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:28:26.794635 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:28:26.794608 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7bb888f699-w9zsz"] Jun 10 13:28:26.795087 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:28:26.795074 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e314324-753a-4ac0-a003-4620905b0be3" containerName="authorino" Jun 10 13:28:26.795136 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:28:26.795090 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e314324-753a-4ac0-a003-4620905b0be3" containerName="authorino" Jun 10 13:28:26.795176 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:28:26.795168 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e314324-753a-4ac0-a003-4620905b0be3" containerName="authorino" Jun 10 13:28:26.797693 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:28:26.797677 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bb888f699-w9zsz" Jun 10 13:28:26.800930 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:28:26.800909 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 10 13:28:26.801222 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:28:26.801207 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 10 13:28:26.802081 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:28:26.802063 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-hc4c5\"" Jun 10 13:28:26.808722 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:28:26.808701 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7bb888f699-w9zsz"] Jun 10 13:28:26.815169 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:28:26.815149 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3abf4089-e7af-4c08-9109-2d71dd5e5e98-webhook-cert\") pod \"maas-controller-7bb888f699-w9zsz\" (UID: \"3abf4089-e7af-4c08-9109-2d71dd5e5e98\") " pod="opendatahub/maas-controller-7bb888f699-w9zsz" Jun 10 13:28:26.815275 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:28:26.815184 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5q9t\" (UniqueName: \"kubernetes.io/projected/3abf4089-e7af-4c08-9109-2d71dd5e5e98-kube-api-access-z5q9t\") pod \"maas-controller-7bb888f699-w9zsz\" (UID: \"3abf4089-e7af-4c08-9109-2d71dd5e5e98\") " pod="opendatahub/maas-controller-7bb888f699-w9zsz" Jun 10 13:28:26.880300 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:28:26.880267 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:28:26.915688 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:28:26.915659 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3abf4089-e7af-4c08-9109-2d71dd5e5e98-webhook-cert\") pod \"maas-controller-7bb888f699-w9zsz\" (UID: \"3abf4089-e7af-4c08-9109-2d71dd5e5e98\") " pod="opendatahub/maas-controller-7bb888f699-w9zsz" Jun 10 13:28:26.915829 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:28:26.915700 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5q9t\" (UniqueName: \"kubernetes.io/projected/3abf4089-e7af-4c08-9109-2d71dd5e5e98-kube-api-access-z5q9t\") pod \"maas-controller-7bb888f699-w9zsz\" (UID: \"3abf4089-e7af-4c08-9109-2d71dd5e5e98\") " pod="opendatahub/maas-controller-7bb888f699-w9zsz" Jun 10 13:28:26.915917 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:28:26.915824 2567 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jun 10 13:28:26.915957 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:28:26.915923 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3abf4089-e7af-4c08-9109-2d71dd5e5e98-webhook-cert podName:3abf4089-e7af-4c08-9109-2d71dd5e5e98 nodeName:}" failed. No retries permitted until 2026-06-10 13:28:27.415901553 +0000 UTC m=+814.681152142 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/3abf4089-e7af-4c08-9109-2d71dd5e5e98-webhook-cert") pod "maas-controller-7bb888f699-w9zsz" (UID: "3abf4089-e7af-4c08-9109-2d71dd5e5e98") : secret "maas-controller-webhook-cert" not found Jun 10 13:28:26.925889 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:28:26.925857 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5q9t\" (UniqueName: \"kubernetes.io/projected/3abf4089-e7af-4c08-9109-2d71dd5e5e98-kube-api-access-z5q9t\") pod \"maas-controller-7bb888f699-w9zsz\" (UID: \"3abf4089-e7af-4c08-9109-2d71dd5e5e98\") " pod="opendatahub/maas-controller-7bb888f699-w9zsz" Jun 10 13:28:26.967104 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:28:26.967079 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:28:26.976157 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:28:26.976138 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7964794679-4dzbs"] Jun 10 13:28:26.978611 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:28:26.978597 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7964794679-4dzbs" Jun 10 13:28:26.994327 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:28:26.994306 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7964794679-4dzbs"] Jun 10 13:28:27.016515 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:28:27.016492 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d3a76d1c-c965-4b62-af05-5508c85631ac-webhook-cert\") pod \"maas-controller-7964794679-4dzbs\" (UID: \"d3a76d1c-c965-4b62-af05-5508c85631ac\") " pod="opendatahub/maas-controller-7964794679-4dzbs" Jun 10 13:28:27.016673 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:28:27.016655 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56nmc\" (UniqueName: \"kubernetes.io/projected/d3a76d1c-c965-4b62-af05-5508c85631ac-kube-api-access-56nmc\") pod \"maas-controller-7964794679-4dzbs\" (UID: \"d3a76d1c-c965-4b62-af05-5508c85631ac\") " pod="opendatahub/maas-controller-7964794679-4dzbs" Jun 10 13:28:27.117130 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:28:27.117048 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56nmc\" (UniqueName: \"kubernetes.io/projected/d3a76d1c-c965-4b62-af05-5508c85631ac-kube-api-access-56nmc\") pod \"maas-controller-7964794679-4dzbs\" (UID: \"d3a76d1c-c965-4b62-af05-5508c85631ac\") " pod="opendatahub/maas-controller-7964794679-4dzbs" Jun 10 13:28:27.117130 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:28:27.117087 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d3a76d1c-c965-4b62-af05-5508c85631ac-webhook-cert\") pod \"maas-controller-7964794679-4dzbs\" (UID: \"d3a76d1c-c965-4b62-af05-5508c85631ac\") " pod="opendatahub/maas-controller-7964794679-4dzbs" Jun 10 13:28:27.117323 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:28:27.117252 2567 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jun 10 13:28:27.117382 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:28:27.117325 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3a76d1c-c965-4b62-af05-5508c85631ac-webhook-cert podName:d3a76d1c-c965-4b62-af05-5508c85631ac nodeName:}" failed. No retries permitted until 2026-06-10 13:28:27.617309443 +0000 UTC m=+814.882560036 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/d3a76d1c-c965-4b62-af05-5508c85631ac-webhook-cert") pod "maas-controller-7964794679-4dzbs" (UID: "d3a76d1c-c965-4b62-af05-5508c85631ac") : secret "maas-controller-webhook-cert" not found Jun 10 13:28:27.125950 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:28:27.125924 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-56nmc\" (UniqueName: \"kubernetes.io/projected/d3a76d1c-c965-4b62-af05-5508c85631ac-kube-api-access-56nmc\") pod \"maas-controller-7964794679-4dzbs\" (UID: \"d3a76d1c-c965-4b62-af05-5508c85631ac\") " pod="opendatahub/maas-controller-7964794679-4dzbs" Jun 10 13:28:27.230296 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:28:27.230264 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:28:27.420620 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:28:27.420589 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3abf4089-e7af-4c08-9109-2d71dd5e5e98-webhook-cert\") pod \"maas-controller-7bb888f699-w9zsz\" (UID: \"3abf4089-e7af-4c08-9109-2d71dd5e5e98\") " pod="opendatahub/maas-controller-7bb888f699-w9zsz" Jun 10 13:28:27.422877 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:28:27.422857 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3abf4089-e7af-4c08-9109-2d71dd5e5e98-webhook-cert\") pod \"maas-controller-7bb888f699-w9zsz\" (UID: \"3abf4089-e7af-4c08-9109-2d71dd5e5e98\") " pod="opendatahub/maas-controller-7bb888f699-w9zsz" Jun 10 13:28:27.622203 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:28:27.622170 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d3a76d1c-c965-4b62-af05-5508c85631ac-webhook-cert\") pod \"maas-controller-7964794679-4dzbs\" (UID: \"d3a76d1c-c965-4b62-af05-5508c85631ac\") " pod="opendatahub/maas-controller-7964794679-4dzbs" Jun 10 13:28:27.624519 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:28:27.624489 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d3a76d1c-c965-4b62-af05-5508c85631ac-webhook-cert\") pod \"maas-controller-7964794679-4dzbs\" (UID: \"d3a76d1c-c965-4b62-af05-5508c85631ac\") " pod="opendatahub/maas-controller-7964794679-4dzbs" Jun 10 13:28:27.709820 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:28:27.709742 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bb888f699-w9zsz" Jun 10 13:28:27.848101 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:28:27.848070 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7bb888f699-w9zsz"] Jun 10 13:28:27.850032 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:28:27.850009 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3abf4089_e7af_4c08_9109_2d71dd5e5e98.slice/crio-1cd51c74a17dcd4c98d934eeafb2f388c9d2eaf6e09d658577b5b7a43f09abaf WatchSource:0}: Error finding container 1cd51c74a17dcd4c98d934eeafb2f388c9d2eaf6e09d658577b5b7a43f09abaf: Status 404 returned error can't find the container with id 1cd51c74a17dcd4c98d934eeafb2f388c9d2eaf6e09d658577b5b7a43f09abaf Jun 10 13:28:27.889448 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:28:27.889422 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7964794679-4dzbs" Jun 10 13:28:28.025822 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:28:28.025795 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7964794679-4dzbs"] Jun 10 13:28:28.025974 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:28:28.025954 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3a76d1c_c965_4b62_af05_5508c85631ac.slice/crio-3d572cb6ed6f944e5b1a2013a269c0eebe900bbee70aef4fc2e38e9cbfa33565 WatchSource:0}: Error finding container 3d572cb6ed6f944e5b1a2013a269c0eebe900bbee70aef4fc2e38e9cbfa33565: Status 404 returned error can't find the container with id 3d572cb6ed6f944e5b1a2013a269c0eebe900bbee70aef4fc2e38e9cbfa33565 Jun 10 13:28:28.745820 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:28:28.745746 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7964794679-4dzbs" event={"ID":"d3a76d1c-c965-4b62-af05-5508c85631ac","Type":"ContainerStarted","Data":"3d572cb6ed6f944e5b1a2013a269c0eebe900bbee70aef4fc2e38e9cbfa33565"} Jun 10 13:28:28.747451 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:28:28.747418 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bb888f699-w9zsz" event={"ID":"3abf4089-e7af-4c08-9109-2d71dd5e5e98","Type":"ContainerStarted","Data":"1cd51c74a17dcd4c98d934eeafb2f388c9d2eaf6e09d658577b5b7a43f09abaf"} Jun 10 13:28:30.749316 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:28:30.749207 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:28:30.761172 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:28:30.761145 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7964794679-4dzbs" event={"ID":"d3a76d1c-c965-4b62-af05-5508c85631ac","Type":"ContainerStarted","Data":"f880feb62c9ea2512ce8f773ec12a2be97df176a767962a87b093e38dabb322d"} Jun 10 13:28:30.761341 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:28:30.761262 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7964794679-4dzbs" Jun 10 13:28:30.762700 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:28:30.762681 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bb888f699-w9zsz" event={"ID":"3abf4089-e7af-4c08-9109-2d71dd5e5e98","Type":"ContainerStarted","Data":"cd0ad2b52cb9ee9430b2bcdefe96c84981caf72d26cf950b01440faf59466547"} Jun 10 13:28:30.762808 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:28:30.762737 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7bb888f699-w9zsz" Jun 10 13:28:30.783473 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:28:30.783428 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7964794679-4dzbs" podStartSLOduration=2.313682239 podStartE2EDuration="4.783416221s" totalImagesPullingTime="2.469733982s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:28:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:28:30.781662208 +0000 UTC m=+818.046912807" watchObservedRunningTime="2026-06-10 13:28:30.783416221 +0000 UTC m=+818.048666818" Jun 10 13:28:30.822702 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:28:30.822639 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7bb888f699-w9zsz" podStartSLOduration=2.172209054 podStartE2EDuration="4.822616112s" totalImagesPullingTime="2.650407058s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:28:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:28:30.820204054 +0000 UTC m=+818.085454661" watchObservedRunningTime="2026-06-10 13:28:30.822616112 +0000 UTC m=+818.087866712" Jun 10 13:28:30.841742 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:28:30.841706 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:28:41.775135 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:28:41.775105 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7964794679-4dzbs" Jun 10 13:28:41.775555 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:28:41.775406 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7bb888f699-w9zsz" Jun 10 13:28:41.840202 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:28:41.840166 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7bb888f699-w9zsz"] Jun 10 13:28:41.840404 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:28:41.840380 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-7bb888f699-w9zsz" podUID="3abf4089-e7af-4c08-9109-2d71dd5e5e98" containerName="manager" containerID="cri-o://cd0ad2b52cb9ee9430b2bcdefe96c84981caf72d26cf950b01440faf59466547" gracePeriod=30 Jun 10 13:28:42.095259 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:28:42.095237 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bb888f699-w9zsz" Jun 10 13:28:42.149747 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:28:42.149718 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3abf4089-e7af-4c08-9109-2d71dd5e5e98-webhook-cert\") pod \"3abf4089-e7af-4c08-9109-2d71dd5e5e98\" (UID: \"3abf4089-e7af-4c08-9109-2d71dd5e5e98\") " Jun 10 13:28:42.149933 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:28:42.149775 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z5q9t\" (UniqueName: \"kubernetes.io/projected/3abf4089-e7af-4c08-9109-2d71dd5e5e98-kube-api-access-z5q9t\") pod \"3abf4089-e7af-4c08-9109-2d71dd5e5e98\" (UID: \"3abf4089-e7af-4c08-9109-2d71dd5e5e98\") " Jun 10 13:28:42.151806 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:28:42.151780 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3abf4089-e7af-4c08-9109-2d71dd5e5e98-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "3abf4089-e7af-4c08-9109-2d71dd5e5e98" (UID: "3abf4089-e7af-4c08-9109-2d71dd5e5e98"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 13:28:42.151806 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:28:42.151787 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3abf4089-e7af-4c08-9109-2d71dd5e5e98-kube-api-access-z5q9t" (OuterVolumeSpecName: "kube-api-access-z5q9t") pod "3abf4089-e7af-4c08-9109-2d71dd5e5e98" (UID: "3abf4089-e7af-4c08-9109-2d71dd5e5e98"). InnerVolumeSpecName "kube-api-access-z5q9t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 13:28:42.251494 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:28:42.251464 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z5q9t\" (UniqueName: \"kubernetes.io/projected/3abf4089-e7af-4c08-9109-2d71dd5e5e98-kube-api-access-z5q9t\") on node \"ip-10-0-136-19.ec2.internal\" DevicePath \"\"" Jun 10 13:28:42.251494 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:28:42.251488 2567 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3abf4089-e7af-4c08-9109-2d71dd5e5e98-webhook-cert\") on node \"ip-10-0-136-19.ec2.internal\" DevicePath \"\"" Jun 10 13:28:42.832411 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:28:42.832380 2567 generic.go:356] "Generic (PLEG): container finished" podID="3abf4089-e7af-4c08-9109-2d71dd5e5e98" containerID="cd0ad2b52cb9ee9430b2bcdefe96c84981caf72d26cf950b01440faf59466547" exitCode=0 Jun 10 13:28:42.832795 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:28:42.832426 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bb888f699-w9zsz" Jun 10 13:28:42.832795 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:28:42.832462 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bb888f699-w9zsz" event={"ID":"3abf4089-e7af-4c08-9109-2d71dd5e5e98","Type":"ContainerDied","Data":"cd0ad2b52cb9ee9430b2bcdefe96c84981caf72d26cf950b01440faf59466547"} Jun 10 13:28:42.832795 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:28:42.832518 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bb888f699-w9zsz" event={"ID":"3abf4089-e7af-4c08-9109-2d71dd5e5e98","Type":"ContainerDied","Data":"1cd51c74a17dcd4c98d934eeafb2f388c9d2eaf6e09d658577b5b7a43f09abaf"} Jun 10 13:28:42.832795 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:28:42.832539 2567 scope.go:117] "RemoveContainer" containerID="cd0ad2b52cb9ee9430b2bcdefe96c84981caf72d26cf950b01440faf59466547" Jun 10 13:28:42.842264 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:28:42.842053 2567 scope.go:117] "RemoveContainer" containerID="cd0ad2b52cb9ee9430b2bcdefe96c84981caf72d26cf950b01440faf59466547" Jun 10 13:28:42.842337 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:28:42.842319 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd0ad2b52cb9ee9430b2bcdefe96c84981caf72d26cf950b01440faf59466547\": container with ID starting with cd0ad2b52cb9ee9430b2bcdefe96c84981caf72d26cf950b01440faf59466547 not found: ID does not exist" containerID="cd0ad2b52cb9ee9430b2bcdefe96c84981caf72d26cf950b01440faf59466547" Jun 10 13:28:42.842377 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:28:42.842345 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd0ad2b52cb9ee9430b2bcdefe96c84981caf72d26cf950b01440faf59466547"} err="failed to get container status \"cd0ad2b52cb9ee9430b2bcdefe96c84981caf72d26cf950b01440faf59466547\": rpc error: code = NotFound desc = could not find container \"cd0ad2b52cb9ee9430b2bcdefe96c84981caf72d26cf950b01440faf59466547\": container with ID starting with cd0ad2b52cb9ee9430b2bcdefe96c84981caf72d26cf950b01440faf59466547 not found: ID does not exist" Jun 10 13:28:42.855237 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:28:42.855216 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7bb888f699-w9zsz"] Jun 10 13:28:42.860528 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:28:42.860508 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7bb888f699-w9zsz"] Jun 10 13:28:43.215446 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:28:43.215416 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3abf4089-e7af-4c08-9109-2d71dd5e5e98" path="/var/lib/kubelet/pods/3abf4089-e7af-4c08-9109-2d71dd5e5e98/volumes" Jun 10 13:29:00.415060 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:00.415026 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:29:00.467016 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:00.466986 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-cffdd8b79-h6vmt"] Jun 10 13:29:00.467404 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:00.467392 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3abf4089-e7af-4c08-9109-2d71dd5e5e98" containerName="manager" Jun 10 13:29:00.467448 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:00.467406 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="3abf4089-e7af-4c08-9109-2d71dd5e5e98" containerName="manager" Jun 10 13:29:00.467483 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:00.467479 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="3abf4089-e7af-4c08-9109-2d71dd5e5e98" containerName="manager" Jun 10 13:29:00.472664 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:00.472646 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-cffdd8b79-h6vmt" Jun 10 13:29:00.476891 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:00.476873 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 10 13:29:00.476995 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:00.476876 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-cs2tw\"" Jun 10 13:29:00.484215 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:00.484196 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-cffdd8b79-h6vmt"] Jun 10 13:29:00.511545 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:00.511521 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:29:00.618107 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:00.618071 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef835fb6-b43e-4bfd-b6b6-c7f6cacbb703-maas-api-tls\") pod \"maas-api-cffdd8b79-h6vmt\" (UID: \"ef835fb6-b43e-4bfd-b6b6-c7f6cacbb703\") " pod="opendatahub/maas-api-cffdd8b79-h6vmt" Jun 10 13:29:00.618267 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:00.618118 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnq5v\" (UniqueName: \"kubernetes.io/projected/ef835fb6-b43e-4bfd-b6b6-c7f6cacbb703-kube-api-access-mnq5v\") pod \"maas-api-cffdd8b79-h6vmt\" (UID: \"ef835fb6-b43e-4bfd-b6b6-c7f6cacbb703\") " pod="opendatahub/maas-api-cffdd8b79-h6vmt" Jun 10 13:29:00.719315 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:00.719231 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef835fb6-b43e-4bfd-b6b6-c7f6cacbb703-maas-api-tls\") pod \"maas-api-cffdd8b79-h6vmt\" (UID: \"ef835fb6-b43e-4bfd-b6b6-c7f6cacbb703\") " pod="opendatahub/maas-api-cffdd8b79-h6vmt" Jun 10 13:29:00.719315 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:00.719279 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mnq5v\" (UniqueName: \"kubernetes.io/projected/ef835fb6-b43e-4bfd-b6b6-c7f6cacbb703-kube-api-access-mnq5v\") pod \"maas-api-cffdd8b79-h6vmt\" (UID: \"ef835fb6-b43e-4bfd-b6b6-c7f6cacbb703\") " pod="opendatahub/maas-api-cffdd8b79-h6vmt" Jun 10 13:29:00.721787 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:00.721761 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ef835fb6-b43e-4bfd-b6b6-c7f6cacbb703-maas-api-tls\") pod \"maas-api-cffdd8b79-h6vmt\" (UID: \"ef835fb6-b43e-4bfd-b6b6-c7f6cacbb703\") " pod="opendatahub/maas-api-cffdd8b79-h6vmt" Jun 10 13:29:00.730335 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:00.730311 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnq5v\" (UniqueName: \"kubernetes.io/projected/ef835fb6-b43e-4bfd-b6b6-c7f6cacbb703-kube-api-access-mnq5v\") pod \"maas-api-cffdd8b79-h6vmt\" (UID: \"ef835fb6-b43e-4bfd-b6b6-c7f6cacbb703\") " pod="opendatahub/maas-api-cffdd8b79-h6vmt" Jun 10 13:29:00.784315 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:00.784283 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-cffdd8b79-h6vmt" Jun 10 13:29:00.931858 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:00.931812 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-cffdd8b79-h6vmt"] Jun 10 13:29:00.936414 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:29:00.936386 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef835fb6_b43e_4bfd_b6b6_c7f6cacbb703.slice/crio-5e7f67e4f2d408484ce9a7cb7caa799287ad653531f98a12c73cebe184e90543 WatchSource:0}: Error finding container 5e7f67e4f2d408484ce9a7cb7caa799287ad653531f98a12c73cebe184e90543: Status 404 returned error can't find the container with id 5e7f67e4f2d408484ce9a7cb7caa799287ad653531f98a12c73cebe184e90543 Jun 10 13:29:00.938113 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:00.938092 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 13:29:01.008939 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:01.008818 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:29:01.148483 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:01.148443 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:29:01.233777 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:01.233746 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-jsttc"] Jun 10 13:29:01.236856 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:01.236819 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-jsttc" Jun 10 13:29:01.240589 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:01.240568 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 10 13:29:01.240698 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:01.240590 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-dpndc\"" Jun 10 13:29:01.259419 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:01.259353 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-jsttc"] Jun 10 13:29:01.323378 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:01.323346 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlkbt\" (UniqueName: \"kubernetes.io/projected/73454d91-ff29-4885-9c81-625fe9740af1-kube-api-access-qlkbt\") pod \"payload-pre-processing-579785bc64-jsttc\" (UID: \"73454d91-ff29-4885-9c81-625fe9740af1\") " pod="openshift-ingress/payload-pre-processing-579785bc64-jsttc" Jun 10 13:29:01.325336 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:01.325308 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-7w2xp"] Jun 10 13:29:01.328220 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:01.328200 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-7w2xp" Jun 10 13:29:01.342673 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:01.342653 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-7w2xp"] Jun 10 13:29:01.424708 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:01.424673 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlkbt\" (UniqueName: \"kubernetes.io/projected/73454d91-ff29-4885-9c81-625fe9740af1-kube-api-access-qlkbt\") pod \"payload-pre-processing-579785bc64-jsttc\" (UID: \"73454d91-ff29-4885-9c81-625fe9740af1\") " pod="openshift-ingress/payload-pre-processing-579785bc64-jsttc" Jun 10 13:29:01.424708 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:01.424713 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fc9t4\" (UniqueName: \"kubernetes.io/projected/c5aa8af0-2966-45f5-84dc-99e902d9902a-kube-api-access-fc9t4\") pod \"payload-processing-699b6cd6c-7w2xp\" (UID: \"c5aa8af0-2966-45f5-84dc-99e902d9902a\") " pod="openshift-ingress/payload-processing-699b6cd6c-7w2xp" Jun 10 13:29:01.437368 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:01.437336 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlkbt\" (UniqueName: \"kubernetes.io/projected/73454d91-ff29-4885-9c81-625fe9740af1-kube-api-access-qlkbt\") pod \"payload-pre-processing-579785bc64-jsttc\" (UID: \"73454d91-ff29-4885-9c81-625fe9740af1\") " pod="openshift-ingress/payload-pre-processing-579785bc64-jsttc" Jun 10 13:29:01.526105 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:01.526020 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fc9t4\" (UniqueName: \"kubernetes.io/projected/c5aa8af0-2966-45f5-84dc-99e902d9902a-kube-api-access-fc9t4\") pod \"payload-processing-699b6cd6c-7w2xp\" (UID: \"c5aa8af0-2966-45f5-84dc-99e902d9902a\") " pod="openshift-ingress/payload-processing-699b6cd6c-7w2xp" Jun 10 13:29:01.537815 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:01.537787 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fc9t4\" (UniqueName: \"kubernetes.io/projected/c5aa8af0-2966-45f5-84dc-99e902d9902a-kube-api-access-fc9t4\") pod \"payload-processing-699b6cd6c-7w2xp\" (UID: \"c5aa8af0-2966-45f5-84dc-99e902d9902a\") " pod="openshift-ingress/payload-processing-699b6cd6c-7w2xp" Jun 10 13:29:01.548595 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:01.548574 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-jsttc" Jun 10 13:29:01.640517 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:01.640421 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-7w2xp" Jun 10 13:29:01.719618 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:01.719459 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-jsttc"] Jun 10 13:29:01.874382 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:01.874351 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-7w2xp"] Jun 10 13:29:01.876584 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:29:01.876555 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5aa8af0_2966_45f5_84dc_99e902d9902a.slice/crio-15783e0fed842fd174bf0ef339c1c5ba9100091f1df7d6104f5d9136b4375fb0 WatchSource:0}: Error finding container 15783e0fed842fd174bf0ef339c1c5ba9100091f1df7d6104f5d9136b4375fb0: Status 404 returned error can't find the container with id 15783e0fed842fd174bf0ef339c1c5ba9100091f1df7d6104f5d9136b4375fb0 Jun 10 13:29:01.955715 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:01.955676 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-jsttc" event={"ID":"73454d91-ff29-4885-9c81-625fe9740af1","Type":"ContainerStarted","Data":"00f664ae3409d758016f50894a85629edb434fc80f0745074b44cc9a47c3dde3"} Jun 10 13:29:01.957139 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:01.957110 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-7w2xp" event={"ID":"c5aa8af0-2966-45f5-84dc-99e902d9902a","Type":"ContainerStarted","Data":"15783e0fed842fd174bf0ef339c1c5ba9100091f1df7d6104f5d9136b4375fb0"} Jun 10 13:29:01.958222 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:01.958197 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-cffdd8b79-h6vmt" event={"ID":"ef835fb6-b43e-4bfd-b6b6-c7f6cacbb703","Type":"ContainerStarted","Data":"5e7f67e4f2d408484ce9a7cb7caa799287ad653531f98a12c73cebe184e90543"} Jun 10 13:29:03.976223 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:03.976185 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-cffdd8b79-h6vmt" event={"ID":"ef835fb6-b43e-4bfd-b6b6-c7f6cacbb703","Type":"ContainerStarted","Data":"276b4d177931cbd73ec5fe456a90b822138ee4946249decc1809a310ba844b15"} Jun 10 13:29:03.976793 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:03.976470 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-cffdd8b79-h6vmt" Jun 10 13:29:03.996956 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:03.996854 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-cffdd8b79-h6vmt" podStartSLOduration=2.038702243 podStartE2EDuration="3.996814692s" totalImagesPullingTime="1.958112449s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:29:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:29:03.994823936 +0000 UTC m=+851.260074544" watchObservedRunningTime="2026-06-10 13:29:03.996814692 +0000 UTC m=+851.262065290" Jun 10 13:29:04.846862 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:04.846494 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:29:04.951355 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:04.951312 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:29:05.989191 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:05.989154 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-jsttc" event={"ID":"73454d91-ff29-4885-9c81-625fe9740af1","Type":"ContainerStarted","Data":"1d695b04363cb3e30e5765a8f909b103ddbb3eef7fe98ccb63dd49ddec499e3d"} Jun 10 13:29:05.989621 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:05.989226 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-579785bc64-jsttc" Jun 10 13:29:05.990682 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:05.990645 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-7w2xp" event={"ID":"c5aa8af0-2966-45f5-84dc-99e902d9902a","Type":"ContainerStarted","Data":"4b9929e39d657532d2f12442f393338c0173a9ca7a0e7afa72f974fd213668c8"} Jun 10 13:29:05.990794 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:05.990705 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-699b6cd6c-7w2xp" Jun 10 13:29:06.009683 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:06.009637 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-579785bc64-jsttc" podStartSLOduration=1.766492987 podStartE2EDuration="5.009621616s" totalImagesPullingTime="3.243128629s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:29:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:29:06.008854961 +0000 UTC m=+853.274105552" watchObservedRunningTime="2026-06-10 13:29:06.009621616 +0000 UTC m=+853.274872217" Jun 10 13:29:06.027531 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:06.027484 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-699b6cd6c-7w2xp" podStartSLOduration=1.9230108160000001 podStartE2EDuration="5.027466529s" totalImagesPullingTime="3.104455713s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:29:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:29:06.025110691 +0000 UTC m=+853.290361290" watchObservedRunningTime="2026-06-10 13:29:06.027466529 +0000 UTC m=+853.292717129" Jun 10 13:29:09.012557 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:09.012454 2567 generic.go:356] "Generic (PLEG): container finished" podID="2c61fc96-27a9-461a-8253-b5ca4b1fbb11" containerID="a44f11156366457919a0e10d949fe8a9372a2aa2aeae6ea95fbcc00a675fc449" exitCode=0 Jun 10 13:29:09.012557 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:09.012530 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8dvvf" event={"ID":"2c61fc96-27a9-461a-8253-b5ca4b1fbb11","Type":"ContainerDied","Data":"a44f11156366457919a0e10d949fe8a9372a2aa2aeae6ea95fbcc00a675fc449"} Jun 10 13:29:09.013198 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:09.013114 2567 scope.go:117] "RemoveContainer" containerID="a44f11156366457919a0e10d949fe8a9372a2aa2aeae6ea95fbcc00a675fc449" Jun 10 13:29:09.014163 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:09.014123 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 10 13:29:09.014285 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:09.014217 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 10 13:29:09.014285 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:09.014263 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 10 13:29:09.988503 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:09.988476 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-cffdd8b79-h6vmt" Jun 10 13:29:10.021202 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:10.021167 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8dvvf" event={"ID":"2c61fc96-27a9-461a-8253-b5ca4b1fbb11","Type":"ContainerStarted","Data":"f47b3c7ac033e00f864cb101f1838b7d3b9c41e21aa12664da45ff712a81e8ca"} Jun 10 13:29:10.650566 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:10.650520 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8dvvf" Jun 10 13:29:10.650952 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:10.650922 2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-8dvvf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body= Jun 10 13:29:10.651030 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:10.650993 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8dvvf" podUID="2c61fc96-27a9-461a-8253-b5ca4b1fbb11" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" Jun 10 13:29:11.651864 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:11.651195 2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-8dvvf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body= Jun 10 13:29:11.651864 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:11.651274 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8dvvf" podUID="2c61fc96-27a9-461a-8253-b5ca4b1fbb11" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" Jun 10 13:29:11.777561 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:11.777525 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 13:29:11.777755 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:11.777708 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="b9243ce5-acf5-4d2b-8993-c277037f0a4b" containerName="keycloak" containerID="cri-o://6003b93c30267f2ab8ba2e6a3ad829a9bdf2cd1349ea9f83d5882909028335dd" gracePeriod=30 Jun 10 13:29:12.650888 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:12.650703 2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-8dvvf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body= Jun 10 13:29:12.650888 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:12.650773 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8dvvf" podUID="2c61fc96-27a9-461a-8253-b5ca4b1fbb11" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" Jun 10 13:29:13.481267 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:13.481202 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 13:29:13.565809 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:13.565778 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mzwk9\" (UniqueName: \"kubernetes.io/projected/b9243ce5-acf5-4d2b-8993-c277037f0a4b-kube-api-access-mzwk9\") pod \"b9243ce5-acf5-4d2b-8993-c277037f0a4b\" (UID: \"b9243ce5-acf5-4d2b-8993-c277037f0a4b\") " Jun 10 13:29:13.568081 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:13.568051 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9243ce5-acf5-4d2b-8993-c277037f0a4b-kube-api-access-mzwk9" (OuterVolumeSpecName: "kube-api-access-mzwk9") pod "b9243ce5-acf5-4d2b-8993-c277037f0a4b" (UID: "b9243ce5-acf5-4d2b-8993-c277037f0a4b"). InnerVolumeSpecName "kube-api-access-mzwk9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 13:29:13.650371 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:13.650328 2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-8dvvf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body= Jun 10 13:29:13.650673 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:13.650640 2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8dvvf" podUID="2c61fc96-27a9-461a-8253-b5ca4b1fbb11" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" Jun 10 13:29:13.666782 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:13.666758 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mzwk9\" (UniqueName: \"kubernetes.io/projected/b9243ce5-acf5-4d2b-8993-c277037f0a4b-kube-api-access-mzwk9\") on node \"ip-10-0-136-19.ec2.internal\" DevicePath \"\"" Jun 10 13:29:14.051743 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:14.051709 2567 generic.go:356] "Generic (PLEG): container finished" podID="b9243ce5-acf5-4d2b-8993-c277037f0a4b" containerID="6003b93c30267f2ab8ba2e6a3ad829a9bdf2cd1349ea9f83d5882909028335dd" exitCode=143 Jun 10 13:29:14.051946 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:14.051758 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 13:29:14.051946 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:14.051776 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"b9243ce5-acf5-4d2b-8993-c277037f0a4b","Type":"ContainerDied","Data":"6003b93c30267f2ab8ba2e6a3ad829a9bdf2cd1349ea9f83d5882909028335dd"} Jun 10 13:29:14.051946 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:14.051864 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"b9243ce5-acf5-4d2b-8993-c277037f0a4b","Type":"ContainerDied","Data":"7de67c0619db2eebb858794192e028010d509c3d66b8088cfb38ae2cc63f4315"} Jun 10 13:29:14.051946 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:14.051885 2567 scope.go:117] "RemoveContainer" containerID="6003b93c30267f2ab8ba2e6a3ad829a9bdf2cd1349ea9f83d5882909028335dd" Jun 10 13:29:14.061961 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:14.061942 2567 scope.go:117] "RemoveContainer" containerID="6003b93c30267f2ab8ba2e6a3ad829a9bdf2cd1349ea9f83d5882909028335dd" Jun 10 13:29:14.062217 ip-10-0-136-19 kubenswrapper[2567]: E0610 13:29:14.062197 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6003b93c30267f2ab8ba2e6a3ad829a9bdf2cd1349ea9f83d5882909028335dd\": container with ID starting with 6003b93c30267f2ab8ba2e6a3ad829a9bdf2cd1349ea9f83d5882909028335dd not found: ID does not exist" containerID="6003b93c30267f2ab8ba2e6a3ad829a9bdf2cd1349ea9f83d5882909028335dd" Jun 10 13:29:14.062283 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:14.062230 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6003b93c30267f2ab8ba2e6a3ad829a9bdf2cd1349ea9f83d5882909028335dd"} err="failed to get container status \"6003b93c30267f2ab8ba2e6a3ad829a9bdf2cd1349ea9f83d5882909028335dd\": rpc error: code = NotFound desc = could not find container \"6003b93c30267f2ab8ba2e6a3ad829a9bdf2cd1349ea9f83d5882909028335dd\": container with ID starting with 6003b93c30267f2ab8ba2e6a3ad829a9bdf2cd1349ea9f83d5882909028335dd not found: ID does not exist" Jun 10 13:29:14.075416 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:14.075389 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 13:29:14.079044 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:14.079018 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 13:29:14.103014 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:14.102984 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 13:29:14.103425 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:14.103412 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9243ce5-acf5-4d2b-8993-c277037f0a4b" containerName="keycloak" Jun 10 13:29:14.103471 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:14.103427 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9243ce5-acf5-4d2b-8993-c277037f0a4b" containerName="keycloak" Jun 10 13:29:14.103506 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:14.103497 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9243ce5-acf5-4d2b-8993-c277037f0a4b" containerName="keycloak" Jun 10 13:29:14.106966 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:14.106947 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 13:29:14.109661 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:14.109636 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 10 13:29:14.109785 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:14.109686 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 10 13:29:14.109785 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:14.109768 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-qrmvv\"" Jun 10 13:29:14.110059 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:14.110041 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 10 13:29:14.110127 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:14.110044 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 10 13:29:14.117894 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:14.117872 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 13:29:14.171327 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:14.171299 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtcgf\" (UniqueName: \"kubernetes.io/projected/b41a43d7-f3f1-4913-a178-23142fbf1842-kube-api-access-mtcgf\") pod \"maas-keycloak-0\" (UID: \"b41a43d7-f3f1-4913-a178-23142fbf1842\") " pod="keycloak-system/maas-keycloak-0" Jun 10 13:29:14.171474 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:14.171419 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/b41a43d7-f3f1-4913-a178-23142fbf1842-test-realms\") pod \"maas-keycloak-0\" (UID: \"b41a43d7-f3f1-4913-a178-23142fbf1842\") " pod="keycloak-system/maas-keycloak-0" Jun 10 13:29:14.187803 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:14.187772 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:29:14.272798 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:14.272766 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/b41a43d7-f3f1-4913-a178-23142fbf1842-test-realms\") pod \"maas-keycloak-0\" (UID: \"b41a43d7-f3f1-4913-a178-23142fbf1842\") " pod="keycloak-system/maas-keycloak-0" Jun 10 13:29:14.273019 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:14.272824 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtcgf\" (UniqueName: \"kubernetes.io/projected/b41a43d7-f3f1-4913-a178-23142fbf1842-kube-api-access-mtcgf\") pod \"maas-keycloak-0\" (UID: \"b41a43d7-f3f1-4913-a178-23142fbf1842\") " pod="keycloak-system/maas-keycloak-0" Jun 10 13:29:14.273508 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:14.273483 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/b41a43d7-f3f1-4913-a178-23142fbf1842-test-realms\") pod \"maas-keycloak-0\" (UID: \"b41a43d7-f3f1-4913-a178-23142fbf1842\") " pod="keycloak-system/maas-keycloak-0" Jun 10 13:29:14.282275 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:14.282249 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtcgf\" (UniqueName: \"kubernetes.io/projected/b41a43d7-f3f1-4913-a178-23142fbf1842-kube-api-access-mtcgf\") pod \"maas-keycloak-0\" (UID: \"b41a43d7-f3f1-4913-a178-23142fbf1842\") " pod="keycloak-system/maas-keycloak-0" Jun 10 13:29:14.417538 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:14.417500 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 13:29:14.552396 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:14.552365 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 13:29:14.554105 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:29:14.554076 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb41a43d7_f3f1_4913_a178_23142fbf1842.slice/crio-67bc69cacd30dbfeceb9aed154cf1b479f5714b8016e36b00670ad413f420c72 WatchSource:0}: Error finding container 67bc69cacd30dbfeceb9aed154cf1b479f5714b8016e36b00670ad413f420c72: Status 404 returned error can't find the container with id 67bc69cacd30dbfeceb9aed154cf1b479f5714b8016e36b00670ad413f420c72 Jun 10 13:29:14.654309 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:14.654281 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8dvvf" Jun 10 13:29:14.654715 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:14.654690 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8dvvf" Jun 10 13:29:14.655499 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:14.655483 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-8dvvf" Jun 10 13:29:15.059168 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:15.059081 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"b41a43d7-f3f1-4913-a178-23142fbf1842","Type":"ContainerStarted","Data":"8d4a9998cb85f9bb283fe9d5d8a3fca8745e2d67a1f8c57a236e40707d2055c8"} Jun 10 13:29:15.059168 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:15.059140 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"b41a43d7-f3f1-4913-a178-23142fbf1842","Type":"ContainerStarted","Data":"67bc69cacd30dbfeceb9aed154cf1b479f5714b8016e36b00670ad413f420c72"} Jun 10 13:29:15.082793 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:15.082512 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=0.766732106 podStartE2EDuration="1.08249075s" totalImagesPullingTime="315.758644ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:29:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:29:15.082075184 +0000 UTC m=+862.347325792" watchObservedRunningTime="2026-06-10 13:29:15.08249075 +0000 UTC m=+862.347741348" Jun 10 13:29:15.209827 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:15.209794 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9243ce5-acf5-4d2b-8993-c277037f0a4b" path="/var/lib/kubelet/pods/b9243ce5-acf5-4d2b-8993-c277037f0a4b/volumes" Jun 10 13:29:15.418561 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:15.418520 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 10 13:29:15.420415 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:15.420384 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b41a43d7-f3f1-4913-a178-23142fbf1842" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.49:9000/health/started\": dial tcp 10.134.0.49:9000: connect: connection refused" Jun 10 13:29:16.427867 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:16.426963 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b41a43d7-f3f1-4913-a178-23142fbf1842" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.49:9000/health/started\": dial tcp 10.134.0.49:9000: connect: connection refused" Jun 10 13:29:16.999329 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:16.999295 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-579785bc64-jsttc" Jun 10 13:29:16.999509 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:16.999374 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-699b6cd6c-7w2xp" Jun 10 13:29:17.418253 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:17.418207 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b41a43d7-f3f1-4913-a178-23142fbf1842" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.49:9000/health/started\": dial tcp 10.134.0.49:9000: connect: connection refused" Jun 10 13:29:18.418988 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:18.418934 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b41a43d7-f3f1-4913-a178-23142fbf1842" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.49:9000/health/started\": dial tcp 10.134.0.49:9000: connect: connection refused" Jun 10 13:29:19.418637 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:19.418577 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b41a43d7-f3f1-4913-a178-23142fbf1842" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.49:9000/health/started\": dial tcp 10.134.0.49:9000: connect: connection refused" Jun 10 13:29:20.418903 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:20.418435 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b41a43d7-f3f1-4913-a178-23142fbf1842" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.49:9000/health/started\": dial tcp 10.134.0.49:9000: connect: connection refused" Jun 10 13:29:21.418735 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:21.418683 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b41a43d7-f3f1-4913-a178-23142fbf1842" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.49:9000/health/started\": dial tcp 10.134.0.49:9000: connect: connection refused" Jun 10 13:29:22.418265 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:22.418201 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b41a43d7-f3f1-4913-a178-23142fbf1842" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.49:9000/health/started\": dial tcp 10.134.0.49:9000: connect: connection refused" Jun 10 13:29:23.418114 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:23.417976 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b41a43d7-f3f1-4913-a178-23142fbf1842" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.49:9000/health/started\": dial tcp 10.134.0.49:9000: connect: connection refused" Jun 10 13:29:24.418129 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:24.418091 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 10 13:29:24.418614 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:24.418341 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b41a43d7-f3f1-4913-a178-23142fbf1842" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.49:9000/health/started\": dial tcp 10.134.0.49:9000: connect: connection refused" Jun 10 13:29:25.418754 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:25.418708 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b41a43d7-f3f1-4913-a178-23142fbf1842" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.49:9000/health/started\": dial tcp 10.134.0.49:9000: connect: connection refused" Jun 10 13:29:26.418290 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:26.418238 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b41a43d7-f3f1-4913-a178-23142fbf1842" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.49:9000/health/started\": dial tcp 10.134.0.49:9000: connect: connection refused" Jun 10 13:29:27.418141 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:27.418099 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b41a43d7-f3f1-4913-a178-23142fbf1842" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.49:9000/health/started\": dial tcp 10.134.0.49:9000: connect: connection refused" Jun 10 13:29:28.525973 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:28.525942 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 10 13:29:28.544309 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:28.544253 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="b41a43d7-f3f1-4913-a178-23142fbf1842" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 13:29:38.530716 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:38.530623 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="b41a43d7-f3f1-4913-a178-23142fbf1842" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 13:29:48.531960 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:48.531916 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 10 13:29:53.223573 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:53.223543 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-9xwd9_c0921084-7852-4e0a-972a-7366b89c7736/console-operator/1.log" Jun 10 13:29:53.226161 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:53.226138 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-9xwd9_c0921084-7852-4e0a-972a-7366b89c7736/console-operator/1.log" Jun 10 13:29:53.228412 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:53.228392 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-htrsf_503ace6f-dfa4-41b8-8ade-5294ab66e7a7/ovn-acl-logging/0.log" Jun 10 13:29:53.230663 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:29:53.230644 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-htrsf_503ace6f-dfa4-41b8-8ade-5294ab66e7a7/ovn-acl-logging/0.log" Jun 10 13:30:01.160237 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:30:01.160199 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:30:01.251345 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:30:01.251300 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:30:04.797671 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:30:04.797623 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:30:04.879720 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:30:04.879670 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:30:24.091273 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:30:24.091238 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-g675j"] Jun 10 13:30:24.095262 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:30:24.095240 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-g675j" Jun 10 13:30:24.097988 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:30:24.097961 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 10 13:30:24.099089 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:30:24.099067 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 10 13:30:24.099186 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:30:24.099077 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-fgp7m\"" Jun 10 13:30:24.099186 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:30:24.099111 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 10 13:30:24.106759 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:30:24.106737 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-g675j"] Jun 10 13:30:24.141037 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:30:24.141002 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:30:24.253082 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:30:24.253043 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xtzv\" (UniqueName: \"kubernetes.io/projected/1c4885ae-de1a-43ad-b947-b690c4ee43ec-kube-api-access-6xtzv\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-g675j\" (UID: \"1c4885ae-de1a-43ad-b947-b690c4ee43ec\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-g675j" Jun 10 13:30:24.253271 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:30:24.253092 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1c4885ae-de1a-43ad-b947-b690c4ee43ec-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-g675j\" (UID: \"1c4885ae-de1a-43ad-b947-b690c4ee43ec\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-g675j" Jun 10 13:30:24.253271 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:30:24.253115 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1c4885ae-de1a-43ad-b947-b690c4ee43ec-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-g675j\" (UID: \"1c4885ae-de1a-43ad-b947-b690c4ee43ec\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-g675j" Jun 10 13:30:24.253364 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:30:24.253320 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1c4885ae-de1a-43ad-b947-b690c4ee43ec-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-g675j\" (UID: \"1c4885ae-de1a-43ad-b947-b690c4ee43ec\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-g675j" Jun 10 13:30:24.253412 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:30:24.253398 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1c4885ae-de1a-43ad-b947-b690c4ee43ec-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-g675j\" (UID: \"1c4885ae-de1a-43ad-b947-b690c4ee43ec\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-g675j" Jun 10 13:30:24.253502 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:30:24.253482 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1c4885ae-de1a-43ad-b947-b690c4ee43ec-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-g675j\" (UID: \"1c4885ae-de1a-43ad-b947-b690c4ee43ec\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-g675j" Jun 10 13:30:24.355009 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:30:24.354928 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1c4885ae-de1a-43ad-b947-b690c4ee43ec-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-g675j\" (UID: \"1c4885ae-de1a-43ad-b947-b690c4ee43ec\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-g675j" Jun 10 13:30:24.355009 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:30:24.354976 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1c4885ae-de1a-43ad-b947-b690c4ee43ec-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-g675j\" (UID: \"1c4885ae-de1a-43ad-b947-b690c4ee43ec\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-g675j" Jun 10 13:30:24.355413 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:30:24.355386 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1c4885ae-de1a-43ad-b947-b690c4ee43ec-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-g675j\" (UID: \"1c4885ae-de1a-43ad-b947-b690c4ee43ec\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-g675j" Jun 10 13:30:24.355581 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:30:24.355489 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xtzv\" (UniqueName: \"kubernetes.io/projected/1c4885ae-de1a-43ad-b947-b690c4ee43ec-kube-api-access-6xtzv\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-g675j\" (UID: \"1c4885ae-de1a-43ad-b947-b690c4ee43ec\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-g675j" Jun 10 13:30:24.355782 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:30:24.355744 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1c4885ae-de1a-43ad-b947-b690c4ee43ec-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-g675j\" (UID: \"1c4885ae-de1a-43ad-b947-b690c4ee43ec\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-g675j" Jun 10 13:30:24.355924 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:30:24.355792 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1c4885ae-de1a-43ad-b947-b690c4ee43ec-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-g675j\" (UID: \"1c4885ae-de1a-43ad-b947-b690c4ee43ec\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-g675j" Jun 10 13:30:24.355924 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:30:24.355900 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1c4885ae-de1a-43ad-b947-b690c4ee43ec-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-g675j\" (UID: \"1c4885ae-de1a-43ad-b947-b690c4ee43ec\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-g675j" Jun 10 13:30:24.356144 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:30:24.356117 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1c4885ae-de1a-43ad-b947-b690c4ee43ec-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-g675j\" (UID: \"1c4885ae-de1a-43ad-b947-b690c4ee43ec\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-g675j" Jun 10 13:30:24.356317 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:30:24.356157 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1c4885ae-de1a-43ad-b947-b690c4ee43ec-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-g675j\" (UID: \"1c4885ae-de1a-43ad-b947-b690c4ee43ec\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-g675j" Jun 10 13:30:24.357457 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:30:24.357434 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1c4885ae-de1a-43ad-b947-b690c4ee43ec-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-g675j\" (UID: \"1c4885ae-de1a-43ad-b947-b690c4ee43ec\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-g675j" Jun 10 13:30:24.358308 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:30:24.358291 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1c4885ae-de1a-43ad-b947-b690c4ee43ec-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-g675j\" (UID: \"1c4885ae-de1a-43ad-b947-b690c4ee43ec\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-g675j" Jun 10 13:30:24.364019 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:30:24.364000 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xtzv\" (UniqueName: \"kubernetes.io/projected/1c4885ae-de1a-43ad-b947-b690c4ee43ec-kube-api-access-6xtzv\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-g675j\" (UID: \"1c4885ae-de1a-43ad-b947-b690c4ee43ec\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-g675j" Jun 10 13:30:24.407129 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:30:24.407102 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-g675j" Jun 10 13:30:24.553826 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:30:24.553801 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-g675j"] Jun 10 13:30:24.556388 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:30:24.556357 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c4885ae_de1a_43ad_b947_b690c4ee43ec.slice/crio-4c72364231122d72ec346fc17642effbf2d3551ea506daaa673469365cea987f WatchSource:0}: Error finding container 4c72364231122d72ec346fc17642effbf2d3551ea506daaa673469365cea987f: Status 404 returned error can't find the container with id 4c72364231122d72ec346fc17642effbf2d3551ea506daaa673469365cea987f Jun 10 13:30:25.490231 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:30:25.490190 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-g675j" event={"ID":"1c4885ae-de1a-43ad-b947-b690c4ee43ec","Type":"ContainerStarted","Data":"4c72364231122d72ec346fc17642effbf2d3551ea506daaa673469365cea987f"} Jun 10 13:30:29.518015 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:30:29.517980 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-g675j" event={"ID":"1c4885ae-de1a-43ad-b947-b690c4ee43ec","Type":"ContainerStarted","Data":"a611a5a6a1771afb4498dd6c5e2c855a297ef2957bbd73808ae2588f52363d85"} Jun 10 13:30:42.903927 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:30:42.903893 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-9c2fj"] Jun 10 13:30:42.907375 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:30:42.907358 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9c2fj" Jun 10 13:30:42.910041 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:30:42.910022 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 10 13:30:42.921794 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:30:42.921769 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-9c2fj"] Jun 10 13:30:42.998343 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:30:42.998311 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:30:43.032620 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:30:43.032585 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2eb09bbd-ae48-4f9d-a75f-492acfa866d2-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9c2fj\" (UID: \"2eb09bbd-ae48-4f9d-a75f-492acfa866d2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9c2fj" Jun 10 13:30:43.032810 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:30:43.032637 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2eb09bbd-ae48-4f9d-a75f-492acfa866d2-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9c2fj\" (UID: \"2eb09bbd-ae48-4f9d-a75f-492acfa866d2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9c2fj" Jun 10 13:30:43.032810 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:30:43.032725 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2eb09bbd-ae48-4f9d-a75f-492acfa866d2-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9c2fj\" (UID: \"2eb09bbd-ae48-4f9d-a75f-492acfa866d2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9c2fj" Jun 10 13:30:43.032810 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:30:43.032762 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2eb09bbd-ae48-4f9d-a75f-492acfa866d2-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9c2fj\" (UID: \"2eb09bbd-ae48-4f9d-a75f-492acfa866d2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9c2fj" Jun 10 13:30:43.032810 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:30:43.032789 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2eb09bbd-ae48-4f9d-a75f-492acfa866d2-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9c2fj\" (UID: \"2eb09bbd-ae48-4f9d-a75f-492acfa866d2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9c2fj" Jun 10 13:30:43.033020 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:30:43.032933 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkrjx\" (UniqueName: \"kubernetes.io/projected/2eb09bbd-ae48-4f9d-a75f-492acfa866d2-kube-api-access-mkrjx\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9c2fj\" (UID: \"2eb09bbd-ae48-4f9d-a75f-492acfa866d2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9c2fj" Jun 10 13:30:43.133450 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:30:43.133409 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2eb09bbd-ae48-4f9d-a75f-492acfa866d2-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9c2fj\" (UID: \"2eb09bbd-ae48-4f9d-a75f-492acfa866d2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9c2fj" Jun 10 13:30:43.133652 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:30:43.133468 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2eb09bbd-ae48-4f9d-a75f-492acfa866d2-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9c2fj\" (UID: \"2eb09bbd-ae48-4f9d-a75f-492acfa866d2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9c2fj" Jun 10 13:30:43.133652 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:30:43.133549 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkrjx\" (UniqueName: \"kubernetes.io/projected/2eb09bbd-ae48-4f9d-a75f-492acfa866d2-kube-api-access-mkrjx\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9c2fj\" (UID: \"2eb09bbd-ae48-4f9d-a75f-492acfa866d2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9c2fj" Jun 10 13:30:43.133652 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:30:43.133579 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2eb09bbd-ae48-4f9d-a75f-492acfa866d2-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9c2fj\" (UID: \"2eb09bbd-ae48-4f9d-a75f-492acfa866d2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9c2fj" Jun 10 13:30:43.133652 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:30:43.133622 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2eb09bbd-ae48-4f9d-a75f-492acfa866d2-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9c2fj\" (UID: \"2eb09bbd-ae48-4f9d-a75f-492acfa866d2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9c2fj" Jun 10 13:30:43.133897 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:30:43.133673 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2eb09bbd-ae48-4f9d-a75f-492acfa866d2-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9c2fj\" (UID: \"2eb09bbd-ae48-4f9d-a75f-492acfa866d2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9c2fj" Jun 10 13:30:43.133995 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:30:43.133970 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2eb09bbd-ae48-4f9d-a75f-492acfa866d2-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9c2fj\" (UID: \"2eb09bbd-ae48-4f9d-a75f-492acfa866d2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9c2fj" Jun 10 13:30:43.134067 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:30:43.134044 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2eb09bbd-ae48-4f9d-a75f-492acfa866d2-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9c2fj\" (UID: \"2eb09bbd-ae48-4f9d-a75f-492acfa866d2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9c2fj" Jun 10 13:30:43.134123 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:30:43.134080 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2eb09bbd-ae48-4f9d-a75f-492acfa866d2-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9c2fj\" (UID: \"2eb09bbd-ae48-4f9d-a75f-492acfa866d2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9c2fj" Jun 10 13:30:43.135770 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:30:43.135752 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2eb09bbd-ae48-4f9d-a75f-492acfa866d2-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9c2fj\" (UID: \"2eb09bbd-ae48-4f9d-a75f-492acfa866d2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9c2fj" Jun 10 13:30:43.136149 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:30:43.136131 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2eb09bbd-ae48-4f9d-a75f-492acfa866d2-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9c2fj\" (UID: \"2eb09bbd-ae48-4f9d-a75f-492acfa866d2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9c2fj" Jun 10 13:30:43.141893 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:30:43.141866 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkrjx\" (UniqueName: \"kubernetes.io/projected/2eb09bbd-ae48-4f9d-a75f-492acfa866d2-kube-api-access-mkrjx\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-9c2fj\" (UID: \"2eb09bbd-ae48-4f9d-a75f-492acfa866d2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9c2fj" Jun 10 13:30:43.225133 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:30:43.225055 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9c2fj" Jun 10 13:30:43.371615 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:30:43.371586 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-9c2fj"] Jun 10 13:30:43.373225 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:30:43.373198 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2eb09bbd_ae48_4f9d_a75f_492acfa866d2.slice/crio-2ddab58da3ef48158fbe85659ee924e508248543c01f5ad7885fd2a4a267f205 WatchSource:0}: Error finding container 2ddab58da3ef48158fbe85659ee924e508248543c01f5ad7885fd2a4a267f205: Status 404 returned error can't find the container with id 2ddab58da3ef48158fbe85659ee924e508248543c01f5ad7885fd2a4a267f205 Jun 10 13:30:43.598660 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:30:43.598561 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9c2fj" event={"ID":"2eb09bbd-ae48-4f9d-a75f-492acfa866d2","Type":"ContainerStarted","Data":"20acff2be6a6649998053fc71b115ca5bc43d6610dd0d1c2d4b6d4458c0613a6"} Jun 10 13:30:43.598660 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:30:43.598631 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9c2fj" event={"ID":"2eb09bbd-ae48-4f9d-a75f-492acfa866d2","Type":"ContainerStarted","Data":"2ddab58da3ef48158fbe85659ee924e508248543c01f5ad7885fd2a4a267f205"} Jun 10 13:30:50.005944 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:30:50.005903 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ww6p7"] Jun 10 13:30:50.022780 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:30:50.022757 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ww6p7" Jun 10 13:30:50.025616 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:30:50.025588 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ww6p7"] Jun 10 13:30:50.027216 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:30:50.027193 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 10 13:30:50.098110 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:30:50.098078 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/96183fdd-295c-40f4-95eb-2e2e980a9442-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-ww6p7\" (UID: \"96183fdd-295c-40f4-95eb-2e2e980a9442\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ww6p7" Jun 10 13:30:50.098252 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:30:50.098123 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/96183fdd-295c-40f4-95eb-2e2e980a9442-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-ww6p7\" (UID: \"96183fdd-295c-40f4-95eb-2e2e980a9442\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ww6p7" Jun 10 13:30:50.098308 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:30:50.098255 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/96183fdd-295c-40f4-95eb-2e2e980a9442-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-ww6p7\" (UID: \"96183fdd-295c-40f4-95eb-2e2e980a9442\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ww6p7" Jun 10 13:30:50.098308 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:30:50.098291 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4jx4\" (UniqueName: \"kubernetes.io/projected/96183fdd-295c-40f4-95eb-2e2e980a9442-kube-api-access-j4jx4\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-ww6p7\" (UID: \"96183fdd-295c-40f4-95eb-2e2e980a9442\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ww6p7" Jun 10 13:30:50.098372 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:30:50.098313 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/96183fdd-295c-40f4-95eb-2e2e980a9442-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-ww6p7\" (UID: \"96183fdd-295c-40f4-95eb-2e2e980a9442\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ww6p7" Jun 10 13:30:50.098372 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:30:50.098359 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/96183fdd-295c-40f4-95eb-2e2e980a9442-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-ww6p7\" (UID: \"96183fdd-295c-40f4-95eb-2e2e980a9442\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ww6p7" Jun 10 13:30:50.125943 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:30:50.125899 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:30:50.199251 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:30:50.199223 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/96183fdd-295c-40f4-95eb-2e2e980a9442-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-ww6p7\" (UID: \"96183fdd-295c-40f4-95eb-2e2e980a9442\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ww6p7" Jun 10 13:30:50.199378 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:30:50.199258 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4jx4\" (UniqueName: \"kubernetes.io/projected/96183fdd-295c-40f4-95eb-2e2e980a9442-kube-api-access-j4jx4\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-ww6p7\" (UID: \"96183fdd-295c-40f4-95eb-2e2e980a9442\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ww6p7" Jun 10 13:30:50.199378 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:30:50.199277 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/96183fdd-295c-40f4-95eb-2e2e980a9442-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-ww6p7\" (UID: \"96183fdd-295c-40f4-95eb-2e2e980a9442\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ww6p7" Jun 10 13:30:50.199378 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:30:50.199301 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/96183fdd-295c-40f4-95eb-2e2e980a9442-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-ww6p7\" (UID: \"96183fdd-295c-40f4-95eb-2e2e980a9442\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ww6p7" Jun 10 13:30:50.199378 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:30:50.199354 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/96183fdd-295c-40f4-95eb-2e2e980a9442-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-ww6p7\" (UID: \"96183fdd-295c-40f4-95eb-2e2e980a9442\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ww6p7" Jun 10 13:30:50.199591 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:30:50.199392 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/96183fdd-295c-40f4-95eb-2e2e980a9442-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-ww6p7\" (UID: \"96183fdd-295c-40f4-95eb-2e2e980a9442\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ww6p7" Jun 10 13:30:50.199681 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:30:50.199662 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/96183fdd-295c-40f4-95eb-2e2e980a9442-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-ww6p7\" (UID: \"96183fdd-295c-40f4-95eb-2e2e980a9442\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ww6p7" Jun 10 13:30:50.199731 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:30:50.199707 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/96183fdd-295c-40f4-95eb-2e2e980a9442-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-ww6p7\" (UID: \"96183fdd-295c-40f4-95eb-2e2e980a9442\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ww6p7" Jun 10 13:30:50.199773 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:30:50.199729 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/96183fdd-295c-40f4-95eb-2e2e980a9442-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-ww6p7\" (UID: \"96183fdd-295c-40f4-95eb-2e2e980a9442\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ww6p7" Jun 10 13:30:50.201833 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:30:50.201800 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/96183fdd-295c-40f4-95eb-2e2e980a9442-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-ww6p7\" (UID: \"96183fdd-295c-40f4-95eb-2e2e980a9442\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ww6p7" Jun 10 13:30:50.201987 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:30:50.201864 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/96183fdd-295c-40f4-95eb-2e2e980a9442-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-ww6p7\" (UID: \"96183fdd-295c-40f4-95eb-2e2e980a9442\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ww6p7" Jun 10 13:30:50.207570 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:30:50.207548 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4jx4\" (UniqueName: \"kubernetes.io/projected/96183fdd-295c-40f4-95eb-2e2e980a9442-kube-api-access-j4jx4\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-ww6p7\" (UID: \"96183fdd-295c-40f4-95eb-2e2e980a9442\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ww6p7" Jun 10 13:30:50.335345 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:30:50.335264 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ww6p7" Jun 10 13:30:50.481118 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:30:50.481096 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ww6p7"] Jun 10 13:30:50.483261 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:30:50.483233 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96183fdd_295c_40f4_95eb_2e2e980a9442.slice/crio-b5a93f8be85de66599ac9a3586e1008fd6f9f5e609ceee22a867c1df51b8882e WatchSource:0}: Error finding container b5a93f8be85de66599ac9a3586e1008fd6f9f5e609ceee22a867c1df51b8882e: Status 404 returned error can't find the container with id b5a93f8be85de66599ac9a3586e1008fd6f9f5e609ceee22a867c1df51b8882e Jun 10 13:30:50.639831 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:30:50.639795 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ww6p7" event={"ID":"96183fdd-295c-40f4-95eb-2e2e980a9442","Type":"ContainerStarted","Data":"69738bcc0f5b97fe003722ec725b46f0b4bef55dd72ab211a4992bab18768abd"} Jun 10 13:30:50.640034 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:30:50.639861 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ww6p7" event={"ID":"96183fdd-295c-40f4-95eb-2e2e980a9442","Type":"ContainerStarted","Data":"b5a93f8be85de66599ac9a3586e1008fd6f9f5e609ceee22a867c1df51b8882e"} Jun 10 13:30:54.322977 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:30:54.322937 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:30:58.011752 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:30:58.011714 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:30:58.112962 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:30:58.112931 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:31:00.745773 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:31:00.745735 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:31:16.248631 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:31:16.248591 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:31:22.827900 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:31:22.827862 2567 generic.go:356] "Generic (PLEG): container finished" podID="1c4885ae-de1a-43ad-b947-b690c4ee43ec" containerID="a611a5a6a1771afb4498dd6c5e2c855a297ef2957bbd73808ae2588f52363d85" exitCode=0 Jun 10 13:31:22.828363 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:31:22.827926 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-g675j" event={"ID":"1c4885ae-de1a-43ad-b947-b690c4ee43ec","Type":"ContainerDied","Data":"a611a5a6a1771afb4498dd6c5e2c855a297ef2957bbd73808ae2588f52363d85"} Jun 10 13:31:24.844208 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:31:24.844166 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-g675j" event={"ID":"1c4885ae-de1a-43ad-b947-b690c4ee43ec","Type":"ContainerStarted","Data":"fa80e64b100228d7cde92df98b0cc460eb0d42bcb6f4eca50f246feb6a55aeb8"} Jun 10 13:31:24.867508 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:31:24.867455 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-g675j" podStartSLOduration=2.293994293 podStartE2EDuration="1m0.867439645s" totalImagesPullingTime="5.518330956s" totalInitContainerRuntime="53.055114396s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:30:24 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:31:24.864323803 +0000 UTC m=+992.129574400" watchObservedRunningTime="2026-06-10 13:31:24.867439645 +0000 UTC m=+992.132690242" Jun 10 13:31:34.408166 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:31:34.408130 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-g675j" Jun 10 13:31:34.408654 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:31:34.408199 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-g675j" Jun 10 13:31:34.420767 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:31:34.420738 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-g675j" Jun 10 13:31:34.909434 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:31:34.909409 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-g675j" Jun 10 13:31:36.909650 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:31:36.909614 2567 generic.go:356] "Generic (PLEG): container finished" podID="2eb09bbd-ae48-4f9d-a75f-492acfa866d2" containerID="20acff2be6a6649998053fc71b115ca5bc43d6610dd0d1c2d4b6d4458c0613a6" exitCode=0 Jun 10 13:31:36.910059 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:31:36.909664 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9c2fj" event={"ID":"2eb09bbd-ae48-4f9d-a75f-492acfa866d2","Type":"ContainerDied","Data":"20acff2be6a6649998053fc71b115ca5bc43d6610dd0d1c2d4b6d4458c0613a6"} Jun 10 13:31:37.917144 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:31:37.917108 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9c2fj" event={"ID":"2eb09bbd-ae48-4f9d-a75f-492acfa866d2","Type":"ContainerStarted","Data":"7b4090cb7b2e48ad33b42917c3f3d6aa2b9df42c8d4fd93bd3db104da68985c1"} Jun 10 13:31:37.952312 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:31:37.952262 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9c2fj" podStartSLOduration=3.114708196 podStartE2EDuration="55.952246009s" totalImagesPullingTime="277.615992ms" totalInitContainerRuntime="52.559921821s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:30:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:31:37.94914649 +0000 UTC m=+1005.214397101" watchObservedRunningTime="2026-06-10 13:31:37.952246009 +0000 UTC m=+1005.217496605" Jun 10 13:31:43.226108 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:31:43.226077 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9c2fj" Jun 10 13:31:43.226524 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:31:43.226232 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9c2fj" Jun 10 13:31:43.238721 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:31:43.238703 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9c2fj" Jun 10 13:31:43.961456 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:31:43.961430 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-9c2fj" Jun 10 13:31:58.950211 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:31:58.950174 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:31:59.011172 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:31:59.011139 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:32:11.696882 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:32:11.696829 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:34:41.368757 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:34:41.368718 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:34:53.260510 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:34:53.260481 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-9xwd9_c0921084-7852-4e0a-972a-7366b89c7736/console-operator/1.log" Jun 10 13:34:53.265260 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:34:53.265237 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-9xwd9_c0921084-7852-4e0a-972a-7366b89c7736/console-operator/1.log" Jun 10 13:34:53.272356 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:34:53.265904 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-htrsf_503ace6f-dfa4-41b8-8ade-5294ab66e7a7/ovn-acl-logging/0.log" Jun 10 13:34:53.277676 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:34:53.277648 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-htrsf_503ace6f-dfa4-41b8-8ade-5294ab66e7a7/ovn-acl-logging/0.log" Jun 10 13:35:10.117433 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:10.117390 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-7cc85495b4-h9b55_120dff7e-dec7-4d5f-b633-f20c672e836d/nginx/0.log" Jun 10 13:35:10.231976 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:10.231945 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-97ppl_abc6ce51-f171-4896-b474-7df5441b770f/manager/0.log" Jun 10 13:35:10.359774 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:10.359743 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-kxdct_bc223ffa-3cbe-42ca-85ea-639dd9570746/manager/0.log" Jun 10 13:35:10.489382 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:10.489334 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-cffdd8b79-h6vmt_ef835fb6-b43e-4bfd-b6b6-c7f6cacbb703/maas-api/0.log" Jun 10 13:35:10.734335 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:10.734301 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7964794679-4dzbs_d3a76d1c-c965-4b62-af05-5508c85631ac/manager/0.log" Jun 10 13:35:10.856998 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:10.856914 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-cvs5w_62335bfd-f63f-4175-8453-db01b5b258dd/server/0.log" Jun 10 13:35:10.976500 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:10.976465 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-hl6td_6876de3c-7afb-4006-9bb3-b2e3ea28e618/manager/0.log" Jun 10 13:35:11.224372 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:11.224343 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8d74f49dd-88b87_5eb8305d-4f8d-4ab3-8ecb-460da6640830/copy-manifests/0.log" Jun 10 13:35:11.233249 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:11.233221 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8d74f49dd-88b87_5eb8305d-4f8d-4ab3-8ecb-460da6640830/manager/0.log" Jun 10 13:35:13.044948 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:13.044920 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-vcsfg_e3ae0727-fe67-42c4-a180-91d125784597/manager/0.log" Jun 10 13:35:13.404111 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:13.404079 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-sd2jv_418f68b0-f2c5-49bc-bcd7-f1dd966db2ff/registry-server/0.log" Jun 10 13:35:13.540880 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:13.540821 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-szn2h_b8997274-6815-4174-85ed-b5cae9129807/manager/0.log" Jun 10 13:35:13.801481 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:13.801408 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-fjfb4_6bab3dc0-fc0b-4792-a478-1ec3cfd20464/manager/0.log" Jun 10 13:35:14.146642 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:14.146605 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795sdpgf_e6fec796-d7ce-4381-8342-25c3a350a720/istio-proxy/0.log" Jun 10 13:35:14.515554 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:14.515466 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5d56c4765b-gqkxs_da37b35a-87a1-48c1-b6c9-4dbe8cb597d7/kube-auth-proxy/0.log" Jun 10 13:35:14.628093 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:14.628059 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-8dvvf_2c61fc96-27a9-461a-8253-b5ca4b1fbb11/istio-proxy/1.log" Jun 10 13:35:14.748274 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:14.748247 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-jsttc_73454d91-ff29-4885-9c81-625fe9740af1/payload-pre-processing/0.log" Jun 10 13:35:14.866808 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:14.866734 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-7w2xp_c5aa8af0-2966-45f5-84dc-99e902d9902a/payload-processing/0.log" Jun 10 13:35:15.317526 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:15.317495 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-g675j_1c4885ae-de1a-43ad-b947-b690c4ee43ec/storage-initializer/0.log" Jun 10 13:35:15.326739 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:15.326720 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-g675j_1c4885ae-de1a-43ad-b947-b690c4ee43ec/main/0.log" Jun 10 13:35:15.438523 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:15.438487 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-9c2fj_2eb09bbd-ae48-4f9d-a75f-492acfa866d2/storage-initializer/0.log" Jun 10 13:35:15.447092 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:15.447066 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-9c2fj_2eb09bbd-ae48-4f9d-a75f-492acfa866d2/main/0.log" Jun 10 13:35:20.553765 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:20.553726 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:35:20.673626 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:20.673594 2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" limit=1024 Jun 10 13:35:23.562531 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:23.562505 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-qll8x_e0f9bf9d-d15d-4d0a-9c5f-185a98848eaf/global-pull-secret-syncer/0.log" Jun 10 13:35:23.664146 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:23.664107 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-4hgwk_a53446ca-16a6-40de-a99d-f526b93ca2a4/konnectivity-agent/0.log" Jun 10 13:35:23.766874 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:23.766827 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-19.ec2.internal_42d2d3b59dbeb7d6f92fb6b1848e3017/haproxy/0.log" Jun 10 13:35:27.576135 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:27.576107 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-7ngfn_363dd030-a86a-41c1-a69c-d303917d2d9e/sail-operator/0.log" Jun 10 13:35:28.785588 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:28.785558 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-vcsfg_e3ae0727-fe67-42c4-a180-91d125784597/manager/0.log" Jun 10 13:35:28.907614 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:28.907583 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-sd2jv_418f68b0-f2c5-49bc-bcd7-f1dd966db2ff/registry-server/0.log" Jun 10 13:35:28.955561 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:28.955532 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-szn2h_b8997274-6815-4174-85ed-b5cae9129807/manager/0.log" Jun 10 13:35:29.040904 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:29.040806 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-fjfb4_6bab3dc0-fc0b-4792-a478-1ec3cfd20464/manager/0.log" Jun 10 13:35:31.166689 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:31.166609 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7d7568c4f4-9rl7r_c75b9349-95dc-42f7-bab2-fe0cde8c1101/metrics-server/0.log" Jun 10 13:35:31.250226 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:31.250202 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9vsj4_8a160a64-5bda-47b2-bf35-212c7f14af15/node-exporter/0.log" Jun 10 13:35:31.290019 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:31.289992 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9vsj4_8a160a64-5bda-47b2-bf35-212c7f14af15/kube-rbac-proxy/0.log" Jun 10 13:35:31.327496 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:31.327469 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9vsj4_8a160a64-5bda-47b2-bf35-212c7f14af15/init-textfile/0.log" Jun 10 13:35:31.723199 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:31.723167 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-7bmb7_cbb82431-5edc-4098-ad62-3171858a62c8/kube-rbac-proxy-main/0.log" Jun 10 13:35:31.755326 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:31.755301 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-7bmb7_cbb82431-5edc-4098-ad62-3171858a62c8/kube-rbac-proxy-self/0.log" Jun 10 13:35:31.803420 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:31.803327 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-7bmb7_cbb82431-5edc-4098-ad62-3171858a62c8/openshift-state-metrics/0.log" Jun 10 13:35:31.859170 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:31.859120 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4a7f737d-d213-45f9-8c62-cf2fe0e9459f/prometheus/0.log" Jun 10 13:35:31.907583 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:31.907553 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4a7f737d-d213-45f9-8c62-cf2fe0e9459f/config-reloader/0.log" Jun 10 13:35:31.943368 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:31.943343 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4a7f737d-d213-45f9-8c62-cf2fe0e9459f/thanos-sidecar/0.log" Jun 10 13:35:31.989144 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:31.989116 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4a7f737d-d213-45f9-8c62-cf2fe0e9459f/kube-rbac-proxy-web/0.log" Jun 10 13:35:32.023272 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:32.023245 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4a7f737d-d213-45f9-8c62-cf2fe0e9459f/kube-rbac-proxy/0.log" Jun 10 13:35:32.063969 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:32.063898 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4a7f737d-d213-45f9-8c62-cf2fe0e9459f/kube-rbac-proxy-thanos/0.log" Jun 10 13:35:32.099903 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:32.099857 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4a7f737d-d213-45f9-8c62-cf2fe0e9459f/init-config-reloader/0.log" Jun 10 13:35:32.353810 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:32.353725 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7dc786cb68-jvwpz_92d022a2-0fda-4abe-880b-2c62ec9d4a34/thanos-query/0.log" Jun 10 13:35:32.401043 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:32.401017 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7dc786cb68-jvwpz_92d022a2-0fda-4abe-880b-2c62ec9d4a34/kube-rbac-proxy-web/0.log" Jun 10 13:35:32.443058 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:32.443030 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7dc786cb68-jvwpz_92d022a2-0fda-4abe-880b-2c62ec9d4a34/kube-rbac-proxy/0.log" Jun 10 13:35:32.498516 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:32.498488 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7dc786cb68-jvwpz_92d022a2-0fda-4abe-880b-2c62ec9d4a34/prom-label-proxy/0.log" Jun 10 13:35:32.548461 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:32.548425 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7dc786cb68-jvwpz_92d022a2-0fda-4abe-880b-2c62ec9d4a34/kube-rbac-proxy-rules/0.log" Jun 10 13:35:32.577738 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:32.577696 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7dc786cb68-jvwpz_92d022a2-0fda-4abe-880b-2c62ec9d4a34/kube-rbac-proxy-metrics/0.log" Jun 10 13:35:33.545647 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:33.545612 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4gxr4/perf-node-gather-daemonset-57dqf"] Jun 10 13:35:33.549754 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:33.549733 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4gxr4/perf-node-gather-daemonset-57dqf" Jun 10 13:35:33.552990 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:33.552965 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4gxr4\"/\"kube-root-ca.crt\"" Jun 10 13:35:33.553996 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:33.553980 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4gxr4\"/\"openshift-service-ca.crt\"" Jun 10 13:35:33.554052 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:33.553984 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-4gxr4\"/\"default-dockercfg-b6xhh\"" Jun 10 13:35:33.560335 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:33.560312 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4gxr4/perf-node-gather-daemonset-57dqf"] Jun 10 13:35:33.571395 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:33.571369 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/300662cd-a96c-4f63-9e73-d612c72ed635-proc\") pod \"perf-node-gather-daemonset-57dqf\" (UID: \"300662cd-a96c-4f63-9e73-d612c72ed635\") " pod="openshift-must-gather-4gxr4/perf-node-gather-daemonset-57dqf" Jun 10 13:35:33.571518 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:33.571420 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/300662cd-a96c-4f63-9e73-d612c72ed635-lib-modules\") pod \"perf-node-gather-daemonset-57dqf\" (UID: \"300662cd-a96c-4f63-9e73-d612c72ed635\") " pod="openshift-must-gather-4gxr4/perf-node-gather-daemonset-57dqf" Jun 10 13:35:33.571518 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:33.571481 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mthjz\" (UniqueName: \"kubernetes.io/projected/300662cd-a96c-4f63-9e73-d612c72ed635-kube-api-access-mthjz\") pod \"perf-node-gather-daemonset-57dqf\" (UID: \"300662cd-a96c-4f63-9e73-d612c72ed635\") " pod="openshift-must-gather-4gxr4/perf-node-gather-daemonset-57dqf" Jun 10 13:35:33.571603 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:33.571535 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/300662cd-a96c-4f63-9e73-d612c72ed635-sys\") pod \"perf-node-gather-daemonset-57dqf\" (UID: \"300662cd-a96c-4f63-9e73-d612c72ed635\") " pod="openshift-must-gather-4gxr4/perf-node-gather-daemonset-57dqf" Jun 10 13:35:33.571647 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:33.571603 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/300662cd-a96c-4f63-9e73-d612c72ed635-podres\") pod \"perf-node-gather-daemonset-57dqf\" (UID: \"300662cd-a96c-4f63-9e73-d612c72ed635\") " pod="openshift-must-gather-4gxr4/perf-node-gather-daemonset-57dqf" Jun 10 13:35:33.672472 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:33.672445 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mthjz\" (UniqueName: \"kubernetes.io/projected/300662cd-a96c-4f63-9e73-d612c72ed635-kube-api-access-mthjz\") pod \"perf-node-gather-daemonset-57dqf\" (UID: \"300662cd-a96c-4f63-9e73-d612c72ed635\") " pod="openshift-must-gather-4gxr4/perf-node-gather-daemonset-57dqf" Jun 10 13:35:33.672632 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:33.672484 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/300662cd-a96c-4f63-9e73-d612c72ed635-sys\") pod \"perf-node-gather-daemonset-57dqf\" (UID: \"300662cd-a96c-4f63-9e73-d612c72ed635\") " pod="openshift-must-gather-4gxr4/perf-node-gather-daemonset-57dqf" Jun 10 13:35:33.672632 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:33.672516 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/300662cd-a96c-4f63-9e73-d612c72ed635-podres\") pod \"perf-node-gather-daemonset-57dqf\" (UID: \"300662cd-a96c-4f63-9e73-d612c72ed635\") " pod="openshift-must-gather-4gxr4/perf-node-gather-daemonset-57dqf" Jun 10 13:35:33.672632 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:33.672580 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/300662cd-a96c-4f63-9e73-d612c72ed635-proc\") pod \"perf-node-gather-daemonset-57dqf\" (UID: \"300662cd-a96c-4f63-9e73-d612c72ed635\") " pod="openshift-must-gather-4gxr4/perf-node-gather-daemonset-57dqf" Jun 10 13:35:33.672632 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:33.672584 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/300662cd-a96c-4f63-9e73-d612c72ed635-sys\") pod \"perf-node-gather-daemonset-57dqf\" (UID: \"300662cd-a96c-4f63-9e73-d612c72ed635\") " pod="openshift-must-gather-4gxr4/perf-node-gather-daemonset-57dqf" Jun 10 13:35:33.672632 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:33.672604 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/300662cd-a96c-4f63-9e73-d612c72ed635-lib-modules\") pod \"perf-node-gather-daemonset-57dqf\" (UID: \"300662cd-a96c-4f63-9e73-d612c72ed635\") " pod="openshift-must-gather-4gxr4/perf-node-gather-daemonset-57dqf" Jun 10 13:35:33.672816 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:33.672652 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/300662cd-a96c-4f63-9e73-d612c72ed635-proc\") pod \"perf-node-gather-daemonset-57dqf\" (UID: \"300662cd-a96c-4f63-9e73-d612c72ed635\") " pod="openshift-must-gather-4gxr4/perf-node-gather-daemonset-57dqf" Jun 10 13:35:33.672816 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:33.672711 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/300662cd-a96c-4f63-9e73-d612c72ed635-podres\") pod \"perf-node-gather-daemonset-57dqf\" (UID: \"300662cd-a96c-4f63-9e73-d612c72ed635\") " pod="openshift-must-gather-4gxr4/perf-node-gather-daemonset-57dqf" Jun 10 13:35:33.672816 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:33.672739 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/300662cd-a96c-4f63-9e73-d612c72ed635-lib-modules\") pod \"perf-node-gather-daemonset-57dqf\" (UID: \"300662cd-a96c-4f63-9e73-d612c72ed635\") " pod="openshift-must-gather-4gxr4/perf-node-gather-daemonset-57dqf" Jun 10 13:35:33.682921 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:33.682891 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mthjz\" (UniqueName: \"kubernetes.io/projected/300662cd-a96c-4f63-9e73-d612c72ed635-kube-api-access-mthjz\") pod \"perf-node-gather-daemonset-57dqf\" (UID: \"300662cd-a96c-4f63-9e73-d612c72ed635\") " pod="openshift-must-gather-4gxr4/perf-node-gather-daemonset-57dqf" Jun 10 13:35:33.861001 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:33.860921 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4gxr4/perf-node-gather-daemonset-57dqf" Jun 10 13:35:34.008752 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:34.008716 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4gxr4/perf-node-gather-daemonset-57dqf"] Jun 10 13:35:34.013523 ip-10-0-136-19 kubenswrapper[2567]: W0610 13:35:34.013497 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod300662cd_a96c_4f63_9e73_d612c72ed635.slice/crio-5c68059e782dad605cee9647d79e145ee2128e462ce7ea2e837350600dd18d18 WatchSource:0}: Error finding container 5c68059e782dad605cee9647d79e145ee2128e462ce7ea2e837350600dd18d18: Status 404 returned error can't find the container with id 5c68059e782dad605cee9647d79e145ee2128e462ce7ea2e837350600dd18d18 Jun 10 13:35:34.260917 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:34.260878 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4gxr4/perf-node-gather-daemonset-57dqf" event={"ID":"300662cd-a96c-4f63-9e73-d612c72ed635","Type":"ContainerStarted","Data":"c30a9eaa835b41e3128b2962d7d3473521acebe1ebddd16365ccaec113cb9fef"} Jun 10 13:35:34.261116 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:34.260972 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4gxr4/perf-node-gather-daemonset-57dqf" event={"ID":"300662cd-a96c-4f63-9e73-d612c72ed635","Type":"ContainerStarted","Data":"5c68059e782dad605cee9647d79e145ee2128e462ce7ea2e837350600dd18d18"} Jun 10 13:35:34.261116 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:34.261003 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-4gxr4/perf-node-gather-daemonset-57dqf" Jun 10 13:35:34.298162 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:34.298112 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-4gxr4/perf-node-gather-daemonset-57dqf" podStartSLOduration=1.2980986159999999 podStartE2EDuration="1.298098616s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 13:35:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:35:34.294684588 +0000 UTC m=+1241.559935182" watchObservedRunningTime="2026-06-10 13:35:34.298098616 +0000 UTC m=+1241.563349249" Jun 10 13:35:34.598523 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:34.598437 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-9xwd9_c0921084-7852-4e0a-972a-7366b89c7736/console-operator/1.log" Jun 10 13:35:34.609777 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:34.609739 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-9xwd9_c0921084-7852-4e0a-972a-7366b89c7736/console-operator/2.log" Jun 10 13:35:35.322785 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:35.322756 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-cgclb_4c7bab36-48ac-4a20-b147-80ca0165b212/download-server/0.log" Jun 10 13:35:36.034493 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:36.034459 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78dd696465-95mdv_f03a035e-e2c3-484c-9e09-9c0d6aa282fd/volume-data-source-validator/0.log" Jun 10 13:35:37.426003 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:37.425980 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kdht2_4e26e7f8-4434-431c-8543-b57b5edde1e6/dns/0.log" Jun 10 13:35:37.477346 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:37.477320 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kdht2_4e26e7f8-4434-431c-8543-b57b5edde1e6/kube-rbac-proxy/0.log" Jun 10 13:35:37.787699 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:37.787628 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vpqgr_4fad052f-bd79-43d6-8fe8-57ba27e1b911/dns-node-resolver/0.log" Jun 10 13:35:38.556193 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:38.556162 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-j4s5b_5eb4a19d-1cf0-4a15-abe1-2cf06495af67/node-ca/0.log" Jun 10 13:35:40.023254 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:40.023224 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795sdpgf_e6fec796-d7ce-4381-8342-25c3a350a720/istio-proxy/0.log" Jun 10 13:35:40.273731 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:40.273649 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5d56c4765b-gqkxs_da37b35a-87a1-48c1-b6c9-4dbe8cb597d7/kube-auth-proxy/0.log" Jun 10 13:35:40.276232 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:40.276210 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-4gxr4/perf-node-gather-daemonset-57dqf" Jun 10 13:35:40.333933 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:40.333893 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-8dvvf_2c61fc96-27a9-461a-8253-b5ca4b1fbb11/istio-proxy/1.log" Jun 10 13:35:40.334536 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:40.334515 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-8dvvf_2c61fc96-27a9-461a-8253-b5ca4b1fbb11/istio-proxy/0.log" Jun 10 13:35:40.402205 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:40.402175 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-jsttc_73454d91-ff29-4885-9c81-625fe9740af1/payload-pre-processing/0.log" Jun 10 13:35:40.614621 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:40.614531 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-7w2xp_c5aa8af0-2966-45f5-84dc-99e902d9902a/payload-processing/0.log" Jun 10 13:35:41.729857 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:41.729799 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-x7jkx_3efa946b-70cc-4855-add1-c73d1082de77/serve-healthcheck-canary/0.log" Jun 10 13:35:42.520572 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:42.520540 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-xk8dj_87c0c6d8-6455-44f3-a9ad-18852f44c96c/insights-operator/1.log" Jun 10 13:35:42.530753 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:42.530724 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-xk8dj_87c0c6d8-6455-44f3-a9ad-18852f44c96c/insights-operator/0.log" Jun 10 13:35:42.633321 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:42.633287 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h9h9q_589791b7-a193-4099-919b-5a8222a1e0ba/kube-rbac-proxy/0.log" Jun 10 13:35:42.690248 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:42.690164 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h9h9q_589791b7-a193-4099-919b-5a8222a1e0ba/exporter/0.log" Jun 10 13:35:42.742809 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:42.742774 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h9h9q_589791b7-a193-4099-919b-5a8222a1e0ba/extractor/0.log" Jun 10 13:35:46.045654 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:46.045611 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-7cc85495b4-h9b55_120dff7e-dec7-4d5f-b633-f20c672e836d/nginx/0.log" Jun 10 13:35:46.095707 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:46.095677 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-97ppl_abc6ce51-f171-4896-b474-7df5441b770f/manager/0.log" Jun 10 13:35:46.172284 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:46.172194 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-kxdct_bc223ffa-3cbe-42ca-85ea-639dd9570746/manager/0.log" Jun 10 13:35:46.220352 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:46.220323 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-cffdd8b79-h6vmt_ef835fb6-b43e-4bfd-b6b6-c7f6cacbb703/maas-api/0.log" Jun 10 13:35:46.319919 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:46.319892 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7964794679-4dzbs_d3a76d1c-c965-4b62-af05-5508c85631ac/manager/0.log" Jun 10 13:35:46.382993 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:46.382958 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-cvs5w_62335bfd-f63f-4175-8453-db01b5b258dd/server/0.log" Jun 10 13:35:46.483117 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:46.483008 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-hl6td_6876de3c-7afb-4006-9bb3-b2e3ea28e618/manager/0.log" Jun 10 13:35:46.673032 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:46.673002 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8d74f49dd-88b87_5eb8305d-4f8d-4ab3-8ecb-460da6640830/manager/0.log" Jun 10 13:35:46.702803 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:46.702777 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8d74f49dd-88b87_5eb8305d-4f8d-4ab3-8ecb-460da6640830/copy-manifests/0.log" Jun 10 13:35:47.452792 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:47.452766 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795sdpgf_e6fec796-d7ce-4381-8342-25c3a350a720/istio-proxy/0.log" Jun 10 13:35:47.595087 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:47.595058 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5d56c4765b-gqkxs_da37b35a-87a1-48c1-b6c9-4dbe8cb597d7/kube-auth-proxy/0.log" Jun 10 13:35:47.625593 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:47.625560 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-8dvvf_2c61fc96-27a9-461a-8253-b5ca4b1fbb11/istio-proxy/1.log" Jun 10 13:35:47.625898 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:47.625876 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-8dvvf_2c61fc96-27a9-461a-8253-b5ca4b1fbb11/istio-proxy/0.log" Jun 10 13:35:47.666996 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:47.666966 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-jsttc_73454d91-ff29-4885-9c81-625fe9740af1/payload-pre-processing/0.log" Jun 10 13:35:47.702574 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:47.702548 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-7w2xp_c5aa8af0-2966-45f5-84dc-99e902d9902a/payload-processing/0.log" Jun 10 13:35:48.597286 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:48.597256 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-ztsr9_11e37311-283e-48f7-b2d5-0f500a1608e3/openshift-lws-operator/0.log" Jun 10 13:35:48.882432 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:48.882408 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795sdpgf_e6fec796-d7ce-4381-8342-25c3a350a720/istio-proxy/0.log" Jun 10 13:35:48.981847 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:48.981818 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5d56c4765b-gqkxs_da37b35a-87a1-48c1-b6c9-4dbe8cb597d7/kube-auth-proxy/0.log" Jun 10 13:35:49.021520 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:49.021491 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-8dvvf_2c61fc96-27a9-461a-8253-b5ca4b1fbb11/istio-proxy/1.log" Jun 10 13:35:49.022777 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:49.022738 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-8dvvf_2c61fc96-27a9-461a-8253-b5ca4b1fbb11/istio-proxy/0.log" Jun 10 13:35:49.038527 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:49.038491 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-jsttc_73454d91-ff29-4885-9c81-625fe9740af1/payload-pre-processing/0.log" Jun 10 13:35:49.060737 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:49.060715 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-7w2xp_c5aa8af0-2966-45f5-84dc-99e902d9902a/payload-processing/0.log" Jun 10 13:35:50.759234 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:50.759206 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795sdpgf_e6fec796-d7ce-4381-8342-25c3a350a720/istio-proxy/0.log" Jun 10 13:35:50.823129 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:50.823104 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5d56c4765b-gqkxs_da37b35a-87a1-48c1-b6c9-4dbe8cb597d7/kube-auth-proxy/0.log" Jun 10 13:35:50.846903 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:50.846874 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-8dvvf_2c61fc96-27a9-461a-8253-b5ca4b1fbb11/istio-proxy/1.log" Jun 10 13:35:50.847151 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:50.847132 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-8dvvf_2c61fc96-27a9-461a-8253-b5ca4b1fbb11/istio-proxy/0.log" Jun 10 13:35:50.858889 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:50.858868 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-jsttc_73454d91-ff29-4885-9c81-625fe9740af1/payload-pre-processing/0.log" Jun 10 13:35:50.883752 ip-10-0-136-19 kubenswrapper[2567]: I0610 13:35:50.883726 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-7w2xp_c5aa8af0-2966-45f5-84dc-99e902d9902a/payload-processing/0.log"