Sep 09 23:03:49.374029 ip-10-0-142-217 systemd[1]: Starting Kubernetes Kubelet... Sep 09 23:03:49.755871 ip-10-0-142-217 kubenswrapper[2552]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 09 23:03:49.755871 ip-10-0-142-217 kubenswrapper[2552]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 09 23:03:49.755871 ip-10-0-142-217 kubenswrapper[2552]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 09 23:03:49.755871 ip-10-0-142-217 kubenswrapper[2552]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 09 23:03:49.755871 ip-10-0-142-217 kubenswrapper[2552]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 09 23:03:49.756859 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.756765 2552 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 09 23:03:49.762588 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.762560 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 23:03:49.762588 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.762583 2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 23:03:49.762588 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.762588 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 23:03:49.762588 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.762592 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 23:03:49.762588 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.762596 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 23:03:49.762588 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.762600 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 23:03:49.762977 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.762604 2552 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 23:03:49.762977 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.762608 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 23:03:49.762977 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.762612 2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 23:03:49.762977 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.762616 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 23:03:49.762977 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.762619 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 23:03:49.762977 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.762623 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 23:03:49.762977 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.762627 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 23:03:49.762977 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.762631 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 23:03:49.762977 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.762635 2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 23:03:49.762977 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.762638 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 23:03:49.762977 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.762642 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 23:03:49.762977 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.762646 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 23:03:49.762977 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.762650 2552 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 23:03:49.762977 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.762654 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 23:03:49.762977 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.762658 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 23:03:49.762977 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.762661 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 23:03:49.762977 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.762665 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 23:03:49.762977 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.762685 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 23:03:49.762977 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.762690 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 23:03:49.762977 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.762694 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 23:03:49.763801 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.762697 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 23:03:49.763801 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.762701 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 23:03:49.763801 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.762704 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 23:03:49.763801 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.762708 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 23:03:49.763801 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.762712 2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 23:03:49.763801 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.762716 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 23:03:49.763801 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.762720 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 23:03:49.763801 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.762724 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 23:03:49.763801 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.762727 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 23:03:49.763801 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.762740 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 23:03:49.763801 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.762744 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 23:03:49.763801 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.762747 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 23:03:49.763801 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.762752 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 23:03:49.763801 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.762757 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 23:03:49.763801 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.762761 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 23:03:49.763801 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.762765 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 23:03:49.763801 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.762769 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 23:03:49.763801 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.762772 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 23:03:49.763801 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.762776 2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 23:03:49.764607 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.762781 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 23:03:49.764607 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.762785 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 23:03:49.764607 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.762789 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 23:03:49.764607 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.762793 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 23:03:49.764607 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.762797 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 23:03:49.764607 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.762803 2552 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 23:03:49.764607 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.762808 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 23:03:49.764607 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.762812 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 23:03:49.764607 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.762816 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 23:03:49.764607 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.762820 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 23:03:49.764607 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.762824 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 23:03:49.764607 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.762829 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 23:03:49.764607 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.762833 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 23:03:49.764607 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.762842 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 23:03:49.764607 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.762850 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 23:03:49.764607 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.762855 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 23:03:49.764607 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.762859 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 23:03:49.764607 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.762864 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 23:03:49.764607 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.762868 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 23:03:49.765397 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.762872 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 23:03:49.765397 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.762876 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 23:03:49.765397 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.762880 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 23:03:49.765397 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.762885 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 23:03:49.765397 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.762889 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 23:03:49.765397 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.762893 2552 feature_gate.go:328] unrecognized feature gate: Example Sep 09 23:03:49.765397 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.762898 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 23:03:49.765397 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.762905 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 23:03:49.765397 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.762912 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 23:03:49.765397 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.762918 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 23:03:49.765397 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.762925 2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 23:03:49.765397 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.762930 2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 23:03:49.765397 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.762936 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 23:03:49.765397 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.762941 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 23:03:49.765397 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.762948 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 23:03:49.765397 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.762954 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 23:03:49.765397 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.762958 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 23:03:49.765397 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.762963 2552 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 23:03:49.765397 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.762968 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 23:03:49.766347 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.762974 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 23:03:49.766347 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.762978 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 23:03:49.766347 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.762982 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 23:03:49.766347 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.762986 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 23:03:49.766347 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.762990 2552 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 23:03:49.766347 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.762994 2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 23:03:49.766347 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.762998 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 23:03:49.766347 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.763002 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 23:03:49.766347 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.763006 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 23:03:49.766347 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.763011 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 23:03:49.766347 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.763015 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 23:03:49.766347 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.763020 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 23:03:49.766347 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.763024 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 23:03:49.766347 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.763028 2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 23:03:49.766347 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.763032 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 23:03:49.766347 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.763036 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 23:03:49.766347 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764230 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 23:03:49.766347 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764242 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 23:03:49.766347 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764248 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 23:03:49.766347 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764254 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 23:03:49.767219 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764258 2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 23:03:49.767219 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764262 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 23:03:49.767219 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764267 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 23:03:49.767219 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764271 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 23:03:49.767219 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764275 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 23:03:49.767219 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764280 2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 23:03:49.767219 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764284 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 23:03:49.767219 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764288 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 23:03:49.767219 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764293 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 23:03:49.767219 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764297 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 23:03:49.767219 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764301 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 23:03:49.767219 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764306 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 23:03:49.767219 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764311 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 23:03:49.767219 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764316 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 23:03:49.767219 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764320 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 23:03:49.767219 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764328 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 23:03:49.767219 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764333 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 23:03:49.767219 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764338 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 23:03:49.767219 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764343 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 23:03:49.767867 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764348 2552 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 23:03:49.767867 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764352 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 23:03:49.767867 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764357 2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 23:03:49.767867 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764362 2552 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 23:03:49.767867 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764367 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 23:03:49.767867 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764372 2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 23:03:49.767867 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764376 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 23:03:49.767867 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764381 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 23:03:49.767867 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764385 2552 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 23:03:49.767867 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764390 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 23:03:49.767867 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764394 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 23:03:49.767867 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764398 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 23:03:49.767867 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764403 2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 23:03:49.767867 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764407 2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 23:03:49.767867 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764414 2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 23:03:49.767867 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764420 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 23:03:49.767867 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764425 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 23:03:49.767867 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764431 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 23:03:49.767867 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764436 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 23:03:49.768438 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764441 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 23:03:49.768438 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764446 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 23:03:49.768438 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764451 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 23:03:49.768438 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764456 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 23:03:49.768438 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764460 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 23:03:49.768438 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764465 2552 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 23:03:49.768438 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764470 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 23:03:49.768438 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764474 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 23:03:49.768438 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764480 2552 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 23:03:49.768438 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764484 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 23:03:49.768438 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764488 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 23:03:49.768438 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764493 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 23:03:49.768438 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764498 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 23:03:49.768438 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764504 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 23:03:49.768438 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764510 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 23:03:49.768438 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764515 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 23:03:49.768438 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764520 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 23:03:49.768438 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764524 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 23:03:49.768438 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764528 2552 feature_gate.go:328] unrecognized feature gate: Example Sep 09 23:03:49.768438 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764533 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 23:03:49.768982 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764537 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 23:03:49.768982 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764541 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 23:03:49.768982 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764546 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 23:03:49.768982 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764551 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 23:03:49.768982 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764555 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 23:03:49.768982 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764563 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 23:03:49.768982 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764569 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 23:03:49.768982 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764574 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 23:03:49.768982 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764578 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 23:03:49.768982 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764583 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 23:03:49.768982 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764587 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 23:03:49.768982 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764591 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 23:03:49.768982 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764595 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 23:03:49.768982 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764599 2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 23:03:49.768982 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764603 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 23:03:49.768982 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764607 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 23:03:49.768982 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764611 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 23:03:49.768982 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764615 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 23:03:49.768982 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764619 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 23:03:49.769458 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764623 2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 23:03:49.769458 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764627 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 23:03:49.769458 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764632 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 23:03:49.769458 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764637 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 23:03:49.769458 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764641 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 23:03:49.769458 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764645 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 23:03:49.769458 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764649 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 23:03:49.769458 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764654 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 23:03:49.769458 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764658 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 23:03:49.769458 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764662 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 23:03:49.769458 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764666 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 23:03:49.769458 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764687 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 23:03:49.769458 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764691 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 23:03:49.769458 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764696 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 23:03:49.769458 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764700 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 23:03:49.769458 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764704 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 23:03:49.769458 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764709 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 23:03:49.769458 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.764714 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 23:03:49.769458 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765379 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 23:03:49.769458 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765387 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 23:03:49.770115 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765391 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 23:03:49.770115 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765396 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 23:03:49.770115 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765400 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 23:03:49.770115 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765404 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 23:03:49.770115 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765408 2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 23:03:49.770115 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765414 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 23:03:49.770115 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765419 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 23:03:49.770115 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765423 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 23:03:49.770115 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765428 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 23:03:49.770115 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765433 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 23:03:49.770115 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765437 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 23:03:49.770115 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765441 2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 23:03:49.770115 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765446 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 23:03:49.770115 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765453 2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 23:03:49.770115 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765460 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 23:03:49.770115 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765465 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 23:03:49.770115 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765469 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 23:03:49.770115 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765474 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 23:03:49.770115 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765478 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 23:03:49.770713 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765482 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 23:03:49.770713 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765486 2552 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 23:03:49.770713 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765491 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 23:03:49.770713 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765495 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 23:03:49.770713 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765499 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 23:03:49.770713 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765503 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 23:03:49.770713 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765507 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 23:03:49.770713 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765512 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 23:03:49.770713 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765516 2552 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 23:03:49.770713 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765520 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 23:03:49.770713 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765525 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 23:03:49.770713 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765532 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 23:03:49.770713 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765536 2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 23:03:49.770713 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765542 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 23:03:49.770713 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765548 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 23:03:49.770713 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765552 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 23:03:49.770713 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765557 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 23:03:49.770713 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765561 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 23:03:49.770713 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765566 2552 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 23:03:49.771190 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765571 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 23:03:49.771190 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765575 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 23:03:49.771190 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765580 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 23:03:49.771190 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765584 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 23:03:49.771190 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765588 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 23:03:49.771190 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765592 2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 23:03:49.771190 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765596 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 23:03:49.771190 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765601 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 23:03:49.771190 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765605 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 23:03:49.771190 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765610 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 23:03:49.771190 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765614 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 23:03:49.771190 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765618 2552 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 23:03:49.771190 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765623 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 23:03:49.771190 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765628 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 23:03:49.771190 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765632 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 23:03:49.771190 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765636 2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 23:03:49.771190 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765640 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 23:03:49.771190 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765644 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 23:03:49.771190 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765649 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 23:03:49.771190 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765653 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 23:03:49.771855 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765658 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 23:03:49.771855 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765662 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 23:03:49.771855 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765666 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 23:03:49.771855 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765689 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 23:03:49.771855 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765694 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 23:03:49.771855 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765698 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 23:03:49.771855 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765702 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 23:03:49.771855 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765707 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 23:03:49.771855 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765711 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 23:03:49.771855 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765715 2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 23:03:49.771855 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765719 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 23:03:49.771855 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765724 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 23:03:49.771855 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765728 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 23:03:49.771855 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765733 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 23:03:49.771855 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765737 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 23:03:49.771855 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765741 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 23:03:49.771855 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765745 2552 feature_gate.go:328] unrecognized feature gate: Example Sep 09 23:03:49.771855 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765750 2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 23:03:49.771855 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765756 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 23:03:49.771855 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765760 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 23:03:49.772340 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765764 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 23:03:49.772340 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765768 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 23:03:49.772340 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765774 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 23:03:49.772340 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765778 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 23:03:49.772340 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765783 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 23:03:49.772340 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765787 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 23:03:49.772340 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765791 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 23:03:49.772340 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765795 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 23:03:49.772340 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765800 2552 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 23:03:49.772340 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765804 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 23:03:49.772340 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765808 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 23:03:49.772340 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765813 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 23:03:49.772340 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765817 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 23:03:49.772340 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765822 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 23:03:49.772340 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765826 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 23:03:49.772340 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765830 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 23:03:49.772340 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765836 2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 23:03:49.772340 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765840 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 23:03:49.772340 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.765844 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 23:03:49.772340 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.765954 2552 flags.go:64] FLAG: --address="0.0.0.0" Sep 09 23:03:49.772896 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766010 2552 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 09 23:03:49.772896 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766022 2552 flags.go:64] FLAG: --anonymous-auth="true" Sep 09 23:03:49.772896 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766029 2552 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 09 23:03:49.772896 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766035 2552 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 09 23:03:49.772896 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766041 2552 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 09 23:03:49.772896 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766047 2552 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 09 23:03:49.772896 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766057 2552 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 09 23:03:49.772896 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766063 2552 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 09 23:03:49.772896 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766068 2552 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 09 23:03:49.772896 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766073 2552 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 09 23:03:49.772896 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766079 2552 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 09 23:03:49.772896 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766084 2552 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 09 23:03:49.772896 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766089 2552 flags.go:64] FLAG: --cgroup-root="" Sep 09 23:03:49.772896 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766094 2552 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 09 23:03:49.772896 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766098 2552 flags.go:64] FLAG: --client-ca-file="" Sep 09 23:03:49.772896 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766104 2552 flags.go:64] FLAG: --cloud-provider="external" Sep 09 23:03:49.772896 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766109 2552 flags.go:64] FLAG: --cluster-dns="[]" Sep 09 23:03:49.772896 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766115 2552 flags.go:64] FLAG: --cluster-domain="" Sep 09 23:03:49.772896 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766120 2552 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 09 23:03:49.772896 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766125 2552 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 09 23:03:49.772896 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766130 2552 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 09 23:03:49.772896 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766136 2552 flags.go:64] FLAG: --container-log-max-files="5" Sep 09 23:03:49.772896 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766142 2552 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 09 23:03:49.772896 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766147 2552 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 09 23:03:49.773485 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766155 2552 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 09 23:03:49.773485 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766161 2552 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 09 23:03:49.773485 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766166 2552 flags.go:64] FLAG: --contention-profiling="false" Sep 09 23:03:49.773485 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766171 2552 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 09 23:03:49.773485 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766177 2552 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 09 23:03:49.773485 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766182 2552 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 09 23:03:49.773485 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766187 2552 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 09 23:03:49.773485 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766194 2552 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 09 23:03:49.773485 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766198 2552 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 09 23:03:49.773485 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766203 2552 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 09 23:03:49.773485 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766208 2552 flags.go:64] FLAG: --enable-load-reader="false" Sep 09 23:03:49.773485 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766212 2552 flags.go:64] FLAG: --enable-server="true" Sep 09 23:03:49.773485 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766217 2552 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 09 23:03:49.773485 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766225 2552 flags.go:64] FLAG: --event-burst="100" Sep 09 23:03:49.773485 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766230 2552 flags.go:64] FLAG: --event-qps="50" Sep 09 23:03:49.773485 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766234 2552 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 09 23:03:49.773485 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766239 2552 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 09 23:03:49.773485 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766244 2552 flags.go:64] FLAG: --eviction-hard="" Sep 09 23:03:49.773485 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766250 2552 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 09 23:03:49.773485 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766255 2552 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 09 23:03:49.773485 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766260 2552 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 09 23:03:49.773485 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766265 2552 flags.go:64] FLAG: --eviction-soft="" Sep 09 23:03:49.773485 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766270 2552 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 09 23:03:49.773485 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766275 2552 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 09 23:03:49.773485 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766280 2552 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 09 23:03:49.774183 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766285 2552 flags.go:64] FLAG: --experimental-mounter-path="" Sep 09 23:03:49.774183 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766290 2552 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 09 23:03:49.774183 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766295 2552 flags.go:64] FLAG: --fail-swap-on="true" Sep 09 23:03:49.774183 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766299 2552 flags.go:64] FLAG: --feature-gates="" Sep 09 23:03:49.774183 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766305 2552 flags.go:64] FLAG: --file-check-frequency="20s" Sep 09 23:03:49.774183 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766310 2552 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 09 23:03:49.774183 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766315 2552 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 09 23:03:49.774183 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766322 2552 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 09 23:03:49.774183 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766327 2552 flags.go:64] FLAG: --healthz-port="10248" Sep 09 23:03:49.774183 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766332 2552 flags.go:64] FLAG: --help="false" Sep 09 23:03:49.774183 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766337 2552 flags.go:64] FLAG: --hostname-override="ip-10-0-142-217.ec2.internal" Sep 09 23:03:49.774183 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766344 2552 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 09 23:03:49.774183 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766348 2552 flags.go:64] FLAG: --http-check-frequency="20s" Sep 09 23:03:49.774183 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766353 2552 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 09 23:03:49.774183 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766358 2552 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 09 23:03:49.774183 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766364 2552 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 09 23:03:49.774183 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766368 2552 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 09 23:03:49.774183 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766373 2552 flags.go:64] FLAG: --image-service-endpoint="" Sep 09 23:03:49.774183 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766377 2552 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 09 23:03:49.774183 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766382 2552 flags.go:64] FLAG: --kube-api-burst="100" Sep 09 23:03:49.774183 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766387 2552 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 09 23:03:49.774183 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766392 2552 flags.go:64] FLAG: --kube-api-qps="50" Sep 09 23:03:49.774183 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766397 2552 flags.go:64] FLAG: --kube-reserved="" Sep 09 23:03:49.774183 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766402 2552 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 09 23:03:49.774883 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766406 2552 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 09 23:03:49.774883 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766412 2552 flags.go:64] FLAG: --kubelet-cgroups="" Sep 09 23:03:49.774883 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766416 2552 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 09 23:03:49.774883 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766421 2552 flags.go:64] FLAG: --lock-file="" Sep 09 23:03:49.774883 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766426 2552 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 09 23:03:49.774883 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766431 2552 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 09 23:03:49.774883 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766436 2552 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 09 23:03:49.774883 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766444 2552 flags.go:64] FLAG: --log-json-split-stream="false" Sep 09 23:03:49.774883 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766450 2552 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 09 23:03:49.774883 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766455 2552 flags.go:64] FLAG: --log-text-split-stream="false" Sep 09 23:03:49.774883 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766460 2552 flags.go:64] FLAG: --logging-format="text" Sep 09 23:03:49.774883 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766464 2552 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 09 23:03:49.774883 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766470 2552 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 09 23:03:49.774883 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766475 2552 flags.go:64] FLAG: --manifest-url="" Sep 09 23:03:49.774883 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766480 2552 flags.go:64] FLAG: --manifest-url-header="" Sep 09 23:03:49.774883 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766489 2552 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 09 23:03:49.774883 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766494 2552 flags.go:64] FLAG: --max-open-files="1000000" Sep 09 23:03:49.774883 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766500 2552 flags.go:64] FLAG: --max-pods="110" Sep 09 23:03:49.774883 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766505 2552 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 09 23:03:49.774883 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766511 2552 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 09 23:03:49.774883 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766515 2552 flags.go:64] FLAG: --memory-manager-policy="None" Sep 09 23:03:49.774883 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766521 2552 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 09 23:03:49.774883 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766526 2552 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 09 23:03:49.774883 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766531 2552 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 09 23:03:49.774883 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766536 2552 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 09 23:03:49.775501 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766548 2552 flags.go:64] FLAG: --node-status-max-images="50" Sep 09 23:03:49.775501 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766553 2552 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 09 23:03:49.775501 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766558 2552 flags.go:64] FLAG: --oom-score-adj="-999" Sep 09 23:03:49.775501 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766563 2552 flags.go:64] FLAG: --pod-cidr="" Sep 09 23:03:49.775501 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766568 2552 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1" Sep 09 23:03:49.775501 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766576 2552 flags.go:64] FLAG: --pod-manifest-path="" Sep 09 23:03:49.775501 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766580 2552 flags.go:64] FLAG: --pod-max-pids="-1" Sep 09 23:03:49.775501 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766585 2552 flags.go:64] FLAG: --pods-per-core="0" Sep 09 23:03:49.775501 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766590 2552 flags.go:64] FLAG: --port="10250" Sep 09 23:03:49.775501 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766595 2552 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 09 23:03:49.775501 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766600 2552 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-05c94f49aca379216" Sep 09 23:03:49.775501 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766605 2552 flags.go:64] FLAG: --qos-reserved="" Sep 09 23:03:49.775501 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766610 2552 flags.go:64] FLAG: --read-only-port="10255" Sep 09 23:03:49.775501 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766615 2552 flags.go:64] FLAG: --register-node="true" Sep 09 23:03:49.775501 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766620 2552 flags.go:64] FLAG: --register-with-taints="" Sep 09 23:03:49.775501 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766625 2552 flags.go:64] FLAG: --registry-burst="10" Sep 09 23:03:49.775501 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766631 2552 flags.go:64] FLAG: --registry-qps="5" Sep 09 23:03:49.775501 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766636 2552 flags.go:64] FLAG: --reserved-cpus="" Sep 09 23:03:49.775501 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766640 2552 flags.go:64] FLAG: --reserved-memory="" Sep 09 23:03:49.775501 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766646 2552 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 09 23:03:49.775501 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766651 2552 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 09 23:03:49.775501 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766656 2552 flags.go:64] FLAG: --rotate-certificates="false" Sep 09 23:03:49.775501 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766662 2552 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 09 23:03:49.775501 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766686 2552 flags.go:64] FLAG: --runonce="false" Sep 09 23:03:49.775501 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766693 2552 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 09 23:03:49.776121 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766698 2552 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 09 23:03:49.776121 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766703 2552 flags.go:64] FLAG: --seccomp-default="false" Sep 09 23:03:49.776121 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766708 2552 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 09 23:03:49.776121 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766712 2552 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 09 23:03:49.776121 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766717 2552 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 09 23:03:49.776121 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766722 2552 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 09 23:03:49.776121 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766727 2552 flags.go:64] FLAG: --storage-driver-password="root" Sep 09 23:03:49.776121 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766740 2552 flags.go:64] FLAG: --storage-driver-secure="false" Sep 09 23:03:49.776121 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766745 2552 flags.go:64] FLAG: --storage-driver-table="stats" Sep 09 23:03:49.776121 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766750 2552 flags.go:64] FLAG: --storage-driver-user="root" Sep 09 23:03:49.776121 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766755 2552 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 09 23:03:49.776121 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766760 2552 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 09 23:03:49.776121 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766765 2552 flags.go:64] FLAG: --system-cgroups="" Sep 09 23:03:49.776121 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766769 2552 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 09 23:03:49.776121 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766778 2552 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 09 23:03:49.776121 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766783 2552 flags.go:64] FLAG: --tls-cert-file="" Sep 09 23:03:49.776121 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766787 2552 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 09 23:03:49.776121 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766797 2552 flags.go:64] FLAG: --tls-min-version="" Sep 09 23:03:49.776121 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766801 2552 flags.go:64] FLAG: --tls-private-key-file="" Sep 09 23:03:49.776121 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766806 2552 flags.go:64] FLAG: --topology-manager-policy="none" Sep 09 23:03:49.776121 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766811 2552 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 09 23:03:49.776121 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766816 2552 flags.go:64] FLAG: --topology-manager-scope="container" Sep 09 23:03:49.776121 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766820 2552 flags.go:64] FLAG: --v="2" Sep 09 23:03:49.776121 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766835 2552 flags.go:64] FLAG: --version="false" Sep 09 23:03:49.776121 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766843 2552 flags.go:64] FLAG: --vmodule="" Sep 09 23:03:49.776794 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766849 2552 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 09 23:03:49.776794 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.766855 2552 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 09 23:03:49.776794 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767048 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 23:03:49.776794 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767054 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 23:03:49.776794 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767062 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 23:03:49.776794 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767068 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 23:03:49.776794 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767073 2552 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 23:03:49.776794 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767077 2552 feature_gate.go:328] unrecognized feature gate: Example Sep 09 23:03:49.776794 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767081 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 23:03:49.776794 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767086 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 23:03:49.776794 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767090 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 23:03:49.776794 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767094 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 23:03:49.776794 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767098 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 23:03:49.776794 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767102 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 23:03:49.776794 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767107 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 23:03:49.776794 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767111 2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 23:03:49.776794 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767117 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 23:03:49.776794 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767121 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 23:03:49.776794 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767125 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 23:03:49.776794 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767129 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 23:03:49.777292 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767134 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 23:03:49.777292 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767138 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 23:03:49.777292 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767142 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 23:03:49.777292 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767146 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 23:03:49.777292 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767150 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 23:03:49.777292 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767155 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 23:03:49.777292 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767159 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 23:03:49.777292 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767164 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 23:03:49.777292 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767168 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 23:03:49.777292 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767172 2552 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 23:03:49.777292 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767176 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 23:03:49.777292 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767180 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 23:03:49.777292 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767185 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 23:03:49.777292 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767189 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 23:03:49.777292 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767193 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 23:03:49.777292 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767197 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 23:03:49.777292 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767204 2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 23:03:49.777292 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767208 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 23:03:49.777292 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767212 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 23:03:49.777292 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767216 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 23:03:49.777811 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767220 2552 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 23:03:49.777811 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767226 2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 23:03:49.777811 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767232 2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 23:03:49.777811 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767238 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 23:03:49.777811 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767243 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 23:03:49.777811 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767247 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 23:03:49.777811 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767252 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 23:03:49.777811 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767257 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 23:03:49.777811 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767262 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 23:03:49.777811 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767266 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 23:03:49.777811 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767271 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 23:03:49.777811 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767275 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 23:03:49.777811 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767279 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 23:03:49.777811 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767283 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 23:03:49.777811 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767289 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 23:03:49.777811 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767295 2552 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 23:03:49.777811 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767299 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 23:03:49.777811 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767303 2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 23:03:49.777811 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767308 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 23:03:49.778279 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767312 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 23:03:49.778279 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767316 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 23:03:49.778279 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767320 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 23:03:49.778279 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767324 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 23:03:49.778279 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767329 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 23:03:49.778279 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767333 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 23:03:49.778279 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767337 2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 23:03:49.778279 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767342 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 23:03:49.778279 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767346 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 23:03:49.778279 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767353 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 23:03:49.778279 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767357 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 23:03:49.778279 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767361 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 23:03:49.778279 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767365 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 23:03:49.778279 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767371 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 23:03:49.778279 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767375 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 23:03:49.778279 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767379 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 23:03:49.778279 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767383 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 23:03:49.778279 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767387 2552 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 23:03:49.778279 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767392 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 23:03:49.778279 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767396 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 23:03:49.778898 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767400 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 23:03:49.778898 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767404 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 23:03:49.778898 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767408 2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 23:03:49.778898 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767412 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 23:03:49.778898 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767416 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 23:03:49.778898 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767420 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 23:03:49.778898 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767424 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 23:03:49.778898 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767428 2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 23:03:49.778898 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767433 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 23:03:49.778898 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767437 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 23:03:49.778898 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767441 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 23:03:49.778898 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767447 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 23:03:49.778898 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767453 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 23:03:49.778898 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767458 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 23:03:49.778898 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767462 2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 23:03:49.778898 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767467 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 23:03:49.778898 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767472 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 23:03:49.778898 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767477 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 23:03:49.778898 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767481 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 23:03:49.779368 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767486 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 23:03:49.779368 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767491 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 23:03:49.779368 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.767497 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 23:03:49.779368 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.768005 2552 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 09 23:03:49.779368 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.776069 2552 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 09 23:03:49.779368 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.776089 2552 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 09 23:03:49.779368 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.776113 2552 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 09 23:03:49.779368 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.776120 2552 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 09 23:03:49.779368 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776178 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 23:03:49.779368 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776183 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 23:03:49.779368 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776187 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 23:03:49.779368 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776190 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 23:03:49.779368 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776192 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 23:03:49.779368 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776195 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 23:03:49.779368 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776198 2552 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 23:03:49.779765 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776201 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 23:03:49.779765 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776204 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 23:03:49.779765 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776207 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 23:03:49.779765 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776209 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 23:03:49.779765 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776213 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 23:03:49.779765 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776218 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 23:03:49.779765 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776221 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 23:03:49.779765 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776223 2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 23:03:49.779765 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776226 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 23:03:49.779765 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776228 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 23:03:49.779765 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776231 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 23:03:49.779765 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776234 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 23:03:49.779765 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776238 2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 23:03:49.779765 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776243 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 23:03:49.779765 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776246 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 23:03:49.779765 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776249 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 23:03:49.779765 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776252 2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 23:03:49.779765 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776256 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 23:03:49.779765 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776259 2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 23:03:49.780263 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776261 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 23:03:49.780263 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776264 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 23:03:49.780263 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776267 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 23:03:49.780263 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776270 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 23:03:49.780263 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776272 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 23:03:49.780263 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776275 2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 23:03:49.780263 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776278 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 23:03:49.780263 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776280 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 23:03:49.780263 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776283 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 23:03:49.780263 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776286 2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 23:03:49.780263 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776288 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 23:03:49.780263 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776291 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 23:03:49.780263 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776294 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 23:03:49.780263 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776297 2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 23:03:49.780263 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776300 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 23:03:49.780263 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776303 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 23:03:49.780263 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776305 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 23:03:49.780263 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776309 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 23:03:49.780263 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776313 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 23:03:49.780744 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776316 2552 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 23:03:49.780744 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776319 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 23:03:49.780744 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776322 2552 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 23:03:49.780744 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776325 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 23:03:49.780744 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776328 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 23:03:49.780744 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776331 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 23:03:49.780744 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776334 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 23:03:49.780744 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776338 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 23:03:49.780744 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776340 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 23:03:49.780744 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776344 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 23:03:49.780744 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776346 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 23:03:49.780744 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776349 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 23:03:49.780744 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776352 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 23:03:49.780744 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776355 2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 23:03:49.780744 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776358 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 23:03:49.780744 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776361 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 23:03:49.780744 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776364 2552 feature_gate.go:328] unrecognized feature gate: Example Sep 09 23:03:49.780744 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776366 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 23:03:49.780744 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776369 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 23:03:49.781216 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776372 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 23:03:49.781216 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776374 2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 23:03:49.781216 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776377 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 23:03:49.781216 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776380 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 23:03:49.781216 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776382 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 23:03:49.781216 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776385 2552 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 23:03:49.781216 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776388 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 23:03:49.781216 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776390 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 23:03:49.781216 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776392 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 23:03:49.781216 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776395 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 23:03:49.781216 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776397 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 23:03:49.781216 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776400 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 23:03:49.781216 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776403 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 23:03:49.781216 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776405 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 23:03:49.781216 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776408 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 23:03:49.781216 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776411 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 23:03:49.781216 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776414 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 23:03:49.781216 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776416 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 23:03:49.781216 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776419 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 23:03:49.781216 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776421 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 23:03:49.781888 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776424 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 23:03:49.781888 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776427 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 23:03:49.781888 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776430 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 23:03:49.781888 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776432 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 23:03:49.781888 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776435 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 23:03:49.781888 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776437 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 23:03:49.781888 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776444 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 23:03:49.781888 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776447 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 23:03:49.781888 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776449 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 23:03:49.781888 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776453 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 23:03:49.781888 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776456 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 23:03:49.781888 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776458 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 23:03:49.781888 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776461 2552 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 23:03:49.781888 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776464 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 23:03:49.781888 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776466 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 23:03:49.782258 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.776472 2552 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 09 23:03:49.782258 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776589 2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 23:03:49.782258 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776593 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 23:03:49.782258 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776597 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 23:03:49.782258 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776601 2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 23:03:49.782258 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776605 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 23:03:49.782258 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776609 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 23:03:49.782258 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776611 2552 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 23:03:49.782258 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776614 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 23:03:49.782258 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776617 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 23:03:49.782258 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776619 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 23:03:49.782258 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776622 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 23:03:49.782258 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776625 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 23:03:49.782258 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776628 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 23:03:49.782617 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776630 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 23:03:49.782617 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776632 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 23:03:49.782617 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776635 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 23:03:49.782617 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776638 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 23:03:49.782617 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776641 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 23:03:49.782617 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776644 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 23:03:49.782617 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776646 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 23:03:49.782617 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776649 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 23:03:49.782617 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776652 2552 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 23:03:49.782617 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776654 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 23:03:49.782617 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776658 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 23:03:49.782617 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776660 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 23:03:49.782617 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776663 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 23:03:49.782617 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776666 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 23:03:49.782617 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776683 2552 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 23:03:49.782617 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776687 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 23:03:49.782617 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776691 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 23:03:49.782617 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776695 2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 23:03:49.782617 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776700 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 23:03:49.782617 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776703 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 23:03:49.783142 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776706 2552 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 23:03:49.783142 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776709 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 23:03:49.783142 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776711 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 23:03:49.783142 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776714 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 23:03:49.783142 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776717 2552 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 23:03:49.783142 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776719 2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 23:03:49.783142 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776722 2552 feature_gate.go:328] unrecognized feature gate: Example Sep 09 23:03:49.783142 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776725 2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 23:03:49.783142 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776727 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 23:03:49.783142 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776730 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 23:03:49.783142 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776732 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 23:03:49.783142 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776735 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 23:03:49.783142 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776738 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 23:03:49.783142 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776742 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 23:03:49.783142 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776746 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 23:03:49.783142 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776749 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 23:03:49.783142 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776752 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 23:03:49.783142 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776754 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 23:03:49.783142 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776757 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 23:03:49.783142 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776760 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 23:03:49.783636 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776763 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 23:03:49.783636 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776766 2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 23:03:49.783636 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776768 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 23:03:49.783636 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776772 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 23:03:49.783636 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776774 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 23:03:49.783636 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776777 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 23:03:49.783636 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776780 2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 23:03:49.783636 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776782 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 23:03:49.783636 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776785 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 23:03:49.783636 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776788 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 23:03:49.783636 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776790 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 23:03:49.783636 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776793 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 23:03:49.783636 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776795 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 23:03:49.783636 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776798 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 23:03:49.783636 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776801 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 23:03:49.783636 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776804 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 23:03:49.783636 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776806 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 23:03:49.783636 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776809 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 23:03:49.783636 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776812 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 23:03:49.784153 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776814 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 23:03:49.784153 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776817 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 23:03:49.784153 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776820 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 23:03:49.784153 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776822 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 23:03:49.784153 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776826 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 23:03:49.784153 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776829 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 23:03:49.784153 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776831 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 23:03:49.784153 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776834 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 23:03:49.784153 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776837 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 23:03:49.784153 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776839 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 23:03:49.784153 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776842 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 23:03:49.784153 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776844 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 23:03:49.784153 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776847 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 23:03:49.784153 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776850 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 23:03:49.784153 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776852 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 23:03:49.784153 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776854 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 23:03:49.784153 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776857 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 23:03:49.784153 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776860 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 23:03:49.784153 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776863 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 23:03:49.784153 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776866 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 23:03:49.784632 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776869 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 23:03:49.784632 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776871 2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 23:03:49.784632 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776874 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 23:03:49.784632 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776876 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 23:03:49.784632 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776879 2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 23:03:49.784632 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776881 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 23:03:49.784632 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:49.776884 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 23:03:49.784632 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.776890 2552 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 09 23:03:49.784632 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.777024 2552 server.go:962] "Client rotation is on, will bootstrap in background" Sep 09 23:03:49.784632 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.779589 2552 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 09 23:03:49.784632 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.780463 2552 server.go:1019] "Starting client certificate rotation" Sep 09 23:03:49.784632 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.780563 2552 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 09 23:03:49.784632 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.780597 2552 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 09 23:03:49.784981 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.783035 2552 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 09 23:03:49.785505 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.785485 2552 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 09 23:03:49.797461 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.797433 2552 log.go:25] "Validated CRI v1 runtime API" Sep 09 23:03:49.800397 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.800376 2552 log.go:25] "Validated CRI v1 image API" Sep 09 23:03:49.801255 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.801237 2552 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 09 23:03:49.804352 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.804319 2552 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 7b492f44-8e67-4262-9d00-199c3b402914:/dev/nvme0n1p3 bd559a2f-e1ce-40e7-9896-0e72356a4277:/dev/nvme0n1p4] Sep 09 23:03:49.804418 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.804348 2552 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 09 23:03:49.808710 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.808688 2552 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 09 23:03:49.811034 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.810868 2552 manager.go:216] Machine: {Timestamp:2026-09-09 23:03:49.808033231 +0000 UTC m=+0.323764052 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3096761 MemoryCapacity:33164476416 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2fa876eca136c6f6670a0a9ee6930f SystemUUID:ec2fa876-eca1-36c6-f667-0a0a9ee6930f BootID:6beca01b-17c1-40ab-aaca-5cff0bd3fe33 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:1b:a0:8e:7d:3d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:1b:a0:8e:7d:3d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:e2:7c:31:03:a7:6e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164476416 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 09 23:03:49.811034 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.811025 2552 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 09 23:03:49.811172 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.811122 2552 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 09 23:03:49.814068 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.814040 2552 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 09 23:03:49.814220 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.814072 2552 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-217.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 09 23:03:49.814921 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.814909 2552 topology_manager.go:138] "Creating topology manager with none policy" Sep 09 23:03:49.814963 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.814923 2552 container_manager_linux.go:309] "Creating device plugin manager" Sep 09 23:03:49.814963 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.814932 2552 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 09 23:03:49.815726 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.815714 2552 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 09 23:03:49.816863 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.816851 2552 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 09 23:03:49.819576 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.819561 2552 state_mem.go:36] "Initialized new in-memory state store" Sep 09 23:03:49.819735 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.819724 2552 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 09 23:03:49.819775 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.819758 2552 kubelet.go:486] "Attempting to sync node with API server" Sep 09 23:03:49.819775 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.819768 2552 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 09 23:03:49.819847 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.819783 2552 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 09 23:03:49.819847 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.819793 2552 kubelet.go:398] "Adding apiserver pod source" Sep 09 23:03:49.819847 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.819803 2552 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 09 23:03:49.820255 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.820240 2552 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 09 23:03:49.820312 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.820263 2552 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 09 23:03:49.822654 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.822626 2552 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 09 23:03:49.824758 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.824742 2552 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 09 23:03:49.824871 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.824773 2552 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 09 23:03:49.824971 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.824958 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 09 23:03:49.825002 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.824977 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 09 23:03:49.825002 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.824983 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 09 23:03:49.825002 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.824990 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 09 23:03:49.825002 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.825001 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 09 23:03:49.825102 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.825009 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 09 23:03:49.825951 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.825940 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 09 23:03:49.825951 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.825951 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 09 23:03:49.826042 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.825959 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 09 23:03:49.826042 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.825965 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 09 23:03:49.826042 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.825980 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 09 23:03:49.826042 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.825987 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 09 23:03:49.826887 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.826874 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 09 23:03:49.826887 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.826885 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 09 23:03:49.829192 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.829157 2552 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-217.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 09 23:03:49.829856 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:03:49.829828 2552 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 09 23:03:49.829856 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:03:49.829828 2552 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-217.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 09 23:03:49.830905 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.830889 2552 server.go:1268] "Started kubelet" Sep 09 23:03:49.830979 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.830937 2552 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 09 23:03:49.831129 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.831059 2552 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 09 23:03:49.831291 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.831277 2552 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 09 23:03:49.831938 ip-10-0-142-217 systemd[1]: Started Kubernetes Kubelet. Sep 09 23:03:49.834800 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.834775 2552 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 09 23:03:49.836037 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.836008 2552 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-67hsg" Sep 09 23:03:49.836589 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:03:49.836564 2552 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 09 23:03:49.837243 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.837221 2552 server.go:310] "Adding debug handlers to kubelet server" Sep 09 23:03:49.841029 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.841008 2552 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 09 23:03:49.841565 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:03:49.840533 2552 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-217.ec2.internal.18d3c9804a01ef2a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-217.ec2.internal,UID:ip-10-0-142-217.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-217.ec2.internal,},FirstTimestamp:2026-09-09 23:03:49.83085649 +0000 UTC m=+0.346587375,LastTimestamp:2026-09-09 23:03:49.83085649 +0000 UTC m=+0.346587375,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-217.ec2.internal,}" Sep 09 23:03:49.841694 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.841621 2552 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 09 23:03:49.841862 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:03:49.841836 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-217.ec2.internal\" not found" Sep 09 23:03:49.842266 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.842246 2552 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 09 23:03:49.842355 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.842270 2552 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 09 23:03:49.842355 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.842338 2552 reconstruct.go:97] "Volume reconstruction finished" Sep 09 23:03:49.842355 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.842349 2552 reconciler.go:29] "Reconciler: start to sync state" Sep 09 23:03:49.847183 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.842578 2552 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 09 23:03:49.847183 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.842685 2552 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 09 23:03:49.847183 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.842697 2552 factory.go:55] Registering systemd factory Sep 09 23:03:49.847183 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.842703 2552 factory.go:223] Registration of the systemd container factory successfully Sep 09 23:03:49.847183 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.842801 2552 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-67hsg" Sep 09 23:03:49.847183 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.842985 2552 factory.go:153] Registering CRI-O factory Sep 09 23:03:49.847183 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.842999 2552 factory.go:223] Registration of the crio container factory successfully Sep 09 23:03:49.847183 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.843016 2552 factory.go:103] Registering Raw factory Sep 09 23:03:49.847183 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.843030 2552 manager.go:1196] Started watching for new ooms in manager Sep 09 23:03:49.847183 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.843816 2552 manager.go:349] Starting recovery of all containers Sep 09 23:03:49.849729 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:03:49.849509 2552 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-217.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 09 23:03:49.849729 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:03:49.849517 2552 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 09 23:03:49.855730 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.855687 2552 manager.go:354] Recovery completed Sep 09 23:03:49.861636 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.861615 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 23:03:49.863629 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.863612 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-217.ec2.internal" event="NodeHasSufficientMemory" Sep 09 23:03:49.863749 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.863643 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-217.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 23:03:49.863749 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.863654 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-217.ec2.internal" event="NodeHasSufficientPID" Sep 09 23:03:49.864347 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.864331 2552 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 09 23:03:49.864347 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.864345 2552 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 09 23:03:49.864347 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.864348 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 23:03:49.864496 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.864364 2552 state_mem.go:36] "Initialized new in-memory state store" Sep 09 23:03:49.865077 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.865063 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-217.ec2.internal" event="NodeHasSufficientMemory" Sep 09 23:03:49.865146 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.865093 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-217.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 23:03:49.865146 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.865103 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-217.ec2.internal" event="NodeHasSufficientPID" Sep 09 23:03:49.865529 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.865516 2552 policy_none.go:49] "None policy: Start" Sep 09 23:03:49.865561 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.865535 2552 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 09 23:03:49.865561 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.865548 2552 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 09 23:03:49.866809 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.866798 2552 policy_none.go:47] "Start" Sep 09 23:03:49.909413 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.909394 2552 manager.go:337] "Starting Device Plugin manager" Sep 09 23:03:49.909548 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:03:49.909443 2552 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 09 23:03:49.909548 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.909458 2552 server.go:87] "Starting device plugin registration server" Sep 09 23:03:49.909908 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.909894 2552 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 09 23:03:49.909989 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.909909 2552 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 09 23:03:49.910068 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.910051 2552 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 09 23:03:49.910166 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.910155 2552 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 09 23:03:49.910166 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.910165 2552 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 09 23:03:49.910659 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:03:49.910612 2552 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 09 23:03:49.910659 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:03:49.910661 2552 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-217.ec2.internal\" not found" Sep 09 23:03:49.930920 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.930877 2552 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 09 23:03:49.932117 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.932100 2552 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 09 23:03:49.932193 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.932149 2552 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 09 23:03:49.932193 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.932176 2552 kubelet.go:2448] "Starting kubelet main sync loop" Sep 09 23:03:49.932301 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:03:49.932286 2552 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 09 23:03:49.934235 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:49.934208 2552 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 23:03:50.010436 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:50.010330 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 23:03:50.011488 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:50.011470 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-217.ec2.internal" event="NodeHasSufficientMemory" Sep 09 23:03:50.011587 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:50.011501 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-217.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 23:03:50.011587 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:50.011511 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-217.ec2.internal" event="NodeHasSufficientPID" Sep 09 23:03:50.011587 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:50.011538 2552 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-217.ec2.internal" Sep 09 23:03:50.017038 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:50.017019 2552 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-217.ec2.internal" Sep 09 23:03:50.017094 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:03:50.017047 2552 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-217.ec2.internal\": node \"ip-10-0-142-217.ec2.internal\" not found" Sep 09 23:03:50.026071 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:03:50.026043 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-217.ec2.internal\" not found" Sep 09 23:03:50.032542 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:50.032518 2552 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-217.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-217.ec2.internal"] Sep 09 23:03:50.032597 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:50.032590 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 23:03:50.033503 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:50.033487 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-217.ec2.internal" event="NodeHasSufficientMemory" Sep 09 23:03:50.033575 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:50.033514 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-217.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 23:03:50.033575 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:50.033523 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-217.ec2.internal" event="NodeHasSufficientPID" Sep 09 23:03:50.034843 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:50.034830 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 23:03:50.034976 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:50.034962 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-217.ec2.internal" Sep 09 23:03:50.035014 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:50.034992 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 23:03:50.035603 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:50.035589 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-217.ec2.internal" event="NodeHasSufficientMemory" Sep 09 23:03:50.035663 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:50.035613 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-217.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 23:03:50.035663 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:50.035622 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-217.ec2.internal" event="NodeHasSufficientPID" Sep 09 23:03:50.036277 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:50.036261 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-217.ec2.internal" event="NodeHasSufficientMemory" Sep 09 23:03:50.036337 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:50.036288 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-217.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 23:03:50.036337 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:50.036298 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-217.ec2.internal" event="NodeHasSufficientPID" Sep 09 23:03:50.037017 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:50.037001 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-217.ec2.internal" Sep 09 23:03:50.037060 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:50.037032 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 23:03:50.037713 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:50.037699 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-217.ec2.internal" event="NodeHasSufficientMemory" Sep 09 23:03:50.037787 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:50.037724 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-217.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 23:03:50.037787 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:50.037733 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-217.ec2.internal" event="NodeHasSufficientPID" Sep 09 23:03:50.044004 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:50.043988 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4688dd93c474da243a7e84ff2ba7d54e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-217.ec2.internal\" (UID: \"4688dd93c474da243a7e84ff2ba7d54e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-217.ec2.internal" Sep 09 23:03:50.044077 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:50.044011 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4688dd93c474da243a7e84ff2ba7d54e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-217.ec2.internal\" (UID: \"4688dd93c474da243a7e84ff2ba7d54e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-217.ec2.internal" Sep 09 23:03:50.044077 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:50.044031 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5c308b40366a538734afec8835421dd2-config\") pod \"kube-apiserver-proxy-ip-10-0-142-217.ec2.internal\" (UID: \"5c308b40366a538734afec8835421dd2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-217.ec2.internal" Sep 09 23:03:50.068558 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:03:50.068527 2552 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-217.ec2.internal\" not found" node="ip-10-0-142-217.ec2.internal" Sep 09 23:03:50.073079 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:03:50.073059 2552 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-217.ec2.internal\" not found" node="ip-10-0-142-217.ec2.internal" Sep 09 23:03:50.126499 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:03:50.126467 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-217.ec2.internal\" not found" Sep 09 23:03:50.144883 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:50.144852 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4688dd93c474da243a7e84ff2ba7d54e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-217.ec2.internal\" (UID: \"4688dd93c474da243a7e84ff2ba7d54e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-217.ec2.internal" Sep 09 23:03:50.144883 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:50.144884 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5c308b40366a538734afec8835421dd2-config\") pod \"kube-apiserver-proxy-ip-10-0-142-217.ec2.internal\" (UID: \"5c308b40366a538734afec8835421dd2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-217.ec2.internal" Sep 09 23:03:50.145086 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:50.144903 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4688dd93c474da243a7e84ff2ba7d54e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-217.ec2.internal\" (UID: \"4688dd93c474da243a7e84ff2ba7d54e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-217.ec2.internal" Sep 09 23:03:50.145086 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:50.144960 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4688dd93c474da243a7e84ff2ba7d54e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-217.ec2.internal\" (UID: \"4688dd93c474da243a7e84ff2ba7d54e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-217.ec2.internal" Sep 09 23:03:50.145086 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:50.144983 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5c308b40366a538734afec8835421dd2-config\") pod \"kube-apiserver-proxy-ip-10-0-142-217.ec2.internal\" (UID: \"5c308b40366a538734afec8835421dd2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-217.ec2.internal" Sep 09 23:03:50.145086 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:50.144960 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4688dd93c474da243a7e84ff2ba7d54e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-217.ec2.internal\" (UID: \"4688dd93c474da243a7e84ff2ba7d54e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-217.ec2.internal" Sep 09 23:03:50.227263 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:03:50.227210 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-217.ec2.internal\" not found" Sep 09 23:03:50.328176 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:03:50.328092 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-217.ec2.internal\" not found" Sep 09 23:03:50.370622 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:50.370595 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-217.ec2.internal" Sep 09 23:03:50.375495 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:50.375473 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-217.ec2.internal" Sep 09 23:03:50.429184 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:03:50.429142 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-217.ec2.internal\" not found" Sep 09 23:03:50.529767 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:03:50.529734 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-217.ec2.internal\" not found" Sep 09 23:03:50.630243 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:03:50.630213 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-217.ec2.internal\" not found" Sep 09 23:03:50.730920 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:03:50.730889 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-217.ec2.internal\" not found" Sep 09 23:03:50.780476 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:50.780444 2552 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 09 23:03:50.780948 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:50.780599 2552 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 09 23:03:50.831657 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:03:50.831626 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-217.ec2.internal\" not found" Sep 09 23:03:50.850968 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:50.850934 2552 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-08 22:58:49 +0000 UTC" deadline="2028-02-04 01:17:56.872067434 +0000 UTC" Sep 09 23:03:50.850968 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:50.850963 2552 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12290h14m6.021107271s" Sep 09 23:03:50.858629 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:50.858597 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c308b40366a538734afec8835421dd2.slice/crio-db4139178ad1eaafe474350b50f2776dd8de0e01ef9219192441af1195d7532e WatchSource:0}: Error finding container db4139178ad1eaafe474350b50f2776dd8de0e01ef9219192441af1195d7532e: Status 404 returned error can't find the container with id db4139178ad1eaafe474350b50f2776dd8de0e01ef9219192441af1195d7532e Sep 09 23:03:50.858872 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:50.858852 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4688dd93c474da243a7e84ff2ba7d54e.slice/crio-4ffa7b076e8e9e67ab94e7461353d5abdb6a18231a6664aeffd003c0e302de6b WatchSource:0}: Error finding container 4ffa7b076e8e9e67ab94e7461353d5abdb6a18231a6664aeffd003c0e302de6b: Status 404 returned error can't find the container with id 4ffa7b076e8e9e67ab94e7461353d5abdb6a18231a6664aeffd003c0e302de6b Sep 09 23:03:50.863486 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:50.863470 2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 09 23:03:50.932814 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:03:50.932720 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-217.ec2.internal\" not found" Sep 09 23:03:50.936095 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:50.936044 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-217.ec2.internal" event={"ID":"5c308b40366a538734afec8835421dd2","Type":"ContainerStarted","Data":"db4139178ad1eaafe474350b50f2776dd8de0e01ef9219192441af1195d7532e"} Sep 09 23:03:50.937229 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:50.937205 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-217.ec2.internal" event={"ID":"4688dd93c474da243a7e84ff2ba7d54e","Type":"ContainerStarted","Data":"4ffa7b076e8e9e67ab94e7461353d5abdb6a18231a6664aeffd003c0e302de6b"} Sep 09 23:03:50.985792 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:50.985764 2552 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 23:03:51.033808 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:03:51.033779 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-217.ec2.internal\" not found" Sep 09 23:03:51.125902 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.125871 2552 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 23:03:51.142754 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.142726 2552 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-217.ec2.internal" Sep 09 23:03:51.153225 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.153206 2552 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 09 23:03:51.154389 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.154374 2552 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-217.ec2.internal" Sep 09 23:03:51.161919 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.161903 2552 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 09 23:03:51.303808 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.303725 2552 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 23:03:51.820835 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.820803 2552 apiserver.go:52] "Watching apiserver" Sep 09 23:03:51.828023 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.827967 2552 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 09 23:03:51.830363 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.830331 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-z5jzx","openshift-multus/network-metrics-daemon-5hnn9","openshift-network-diagnostics/network-check-target-h2ql9","openshift-network-operator/iptables-alerter-nvb6q","openshift-ovn-kubernetes/ovnkube-node-6x9hk","kube-system/global-pull-secret-syncer-6fdst","kube-system/konnectivity-agent-x7m6c","kube-system/kube-apiserver-proxy-ip-10-0-142-217.ec2.internal","openshift-cluster-node-tuning-operator/tuned-zkcwq","openshift-dns/node-resolver-khhlr","openshift-image-registry/node-ca-5rtmc","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-217.ec2.internal","openshift-multus/multus-additional-cni-plugins-l9fm4","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l6zcg"] Sep 09 23:03:51.832968 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.832939 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-x7m6c" Sep 09 23:03:51.835156 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.835129 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-l9fm4" Sep 09 23:03:51.835888 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.835865 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 09 23:03:51.835888 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.835879 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 09 23:03:51.836065 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.835862 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-bdx42\"" Sep 09 23:03:51.837240 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.837218 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 09 23:03:51.837402 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.837382 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2ql9" Sep 09 23:03:51.837468 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.837230 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 09 23:03:51.837522 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:03:51.837475 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2ql9" podUID="0416357e-69d3-4301-b431-2b39d7387267" Sep 09 23:03:51.837720 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.837702 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-xxvbn\"" Sep 09 23:03:51.837803 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.837749 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 09 23:03:51.837945 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.837928 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 09 23:03:51.838071 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.838054 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 09 23:03:51.839551 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.839519 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nvb6q" Sep 09 23:03:51.841623 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.841463 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 09 23:03:51.841623 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.841511 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 09 23:03:51.841623 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.841558 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-cq98b\"" Sep 09 23:03:51.841623 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.841569 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 09 23:03:51.841840 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.841649 2552 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 09 23:03:51.842168 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.841944 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6x9hk" Sep 09 23:03:51.844356 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.844336 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 09 23:03:51.844598 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.844579 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 09 23:03:51.844777 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.844757 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 09 23:03:51.844884 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.844875 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 09 23:03:51.844991 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.844953 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 09 23:03:51.845146 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.845127 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6fdst" Sep 09 23:03:51.845253 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:03:51.845204 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6fdst" podUID="ce549cd8-0a7b-44b1-afdb-6d02adf85c7d" Sep 09 23:03:51.845320 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.845261 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 09 23:03:51.845488 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.845468 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-rjx5p\"" Sep 09 23:03:51.847607 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.847511 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zkcwq" Sep 09 23:03:51.849549 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.849528 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 09 23:03:51.849647 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.849605 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-pxz5c\"" Sep 09 23:03:51.850108 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.849872 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-z5jzx" Sep 09 23:03:51.850108 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.849894 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 09 23:03:51.852247 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.852225 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 09 23:03:51.852470 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.852452 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-zq6sg\"" Sep 09 23:03:51.852780 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.852758 2552 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 09 23:03:51.853114 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.853091 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5hnn9" Sep 09 23:03:51.853201 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:03:51.853164 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5hnn9" podUID="be92546e-2796-4680-9b67-4db0dd18a29b" Sep 09 23:03:51.855697 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.855428 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-khhlr" Sep 09 23:03:51.855988 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.855961 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4qs9\" (UniqueName: \"kubernetes.io/projected/a4486a4c-3025-4d07-9d75-d9e774762c4f-kube-api-access-l4qs9\") pod \"multus-additional-cni-plugins-l9fm4\" (UID: \"a4486a4c-3025-4d07-9d75-d9e774762c4f\") " pod="openshift-multus/multus-additional-cni-plugins-l9fm4" Sep 09 23:03:51.856081 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.855993 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c1b384a2-a59e-4bc1-88a1-64c6521d70fd-iptables-alerter-script\") pod \"iptables-alerter-nvb6q\" (UID: \"c1b384a2-a59e-4bc1-88a1-64c6521d70fd\") " pod="openshift-network-operator/iptables-alerter-nvb6q" Sep 09 23:03:51.856081 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.856051 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2f52574e-96c0-4939-9826-4959aeae1c8b-host-kubelet\") pod \"ovnkube-node-6x9hk\" (UID: \"2f52574e-96c0-4939-9826-4959aeae1c8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6x9hk" Sep 09 23:03:51.856081 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.856073 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2f52574e-96c0-4939-9826-4959aeae1c8b-host-run-netns\") pod \"ovnkube-node-6x9hk\" (UID: \"2f52574e-96c0-4939-9826-4959aeae1c8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6x9hk" Sep 09 23:03:51.856237 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.856094 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2f52574e-96c0-4939-9826-4959aeae1c8b-ovnkube-config\") pod \"ovnkube-node-6x9hk\" (UID: \"2f52574e-96c0-4939-9826-4959aeae1c8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6x9hk" Sep 09 23:03:51.856237 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.856122 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2f52574e-96c0-4939-9826-4959aeae1c8b-run-openvswitch\") pod \"ovnkube-node-6x9hk\" (UID: \"2f52574e-96c0-4939-9826-4959aeae1c8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6x9hk" Sep 09 23:03:51.856237 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.856149 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2f52574e-96c0-4939-9826-4959aeae1c8b-run-ovn\") pod \"ovnkube-node-6x9hk\" (UID: \"2f52574e-96c0-4939-9826-4959aeae1c8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6x9hk" Sep 09 23:03:51.856237 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.856185 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a4486a4c-3025-4d07-9d75-d9e774762c4f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-l9fm4\" (UID: \"a4486a4c-3025-4d07-9d75-d9e774762c4f\") " pod="openshift-multus/multus-additional-cni-plugins-l9fm4" Sep 09 23:03:51.856237 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.856208 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2f52574e-96c0-4939-9826-4959aeae1c8b-host-slash\") pod \"ovnkube-node-6x9hk\" (UID: \"2f52574e-96c0-4939-9826-4959aeae1c8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6x9hk" Sep 09 23:03:51.856237 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.856232 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2f52574e-96c0-4939-9826-4959aeae1c8b-host-run-ovn-kubernetes\") pod \"ovnkube-node-6x9hk\" (UID: \"2f52574e-96c0-4939-9826-4959aeae1c8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6x9hk" Sep 09 23:03:51.856517 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.856257 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2f52574e-96c0-4939-9826-4959aeae1c8b-host-cni-bin\") pod \"ovnkube-node-6x9hk\" (UID: \"2f52574e-96c0-4939-9826-4959aeae1c8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6x9hk" Sep 09 23:03:51.856517 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.856280 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a4486a4c-3025-4d07-9d75-d9e774762c4f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-l9fm4\" (UID: \"a4486a4c-3025-4d07-9d75-d9e774762c4f\") " pod="openshift-multus/multus-additional-cni-plugins-l9fm4" Sep 09 23:03:51.856517 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.856302 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24l9f\" (UniqueName: \"kubernetes.io/projected/c1b384a2-a59e-4bc1-88a1-64c6521d70fd-kube-api-access-24l9f\") pod \"iptables-alerter-nvb6q\" (UID: \"c1b384a2-a59e-4bc1-88a1-64c6521d70fd\") " pod="openshift-network-operator/iptables-alerter-nvb6q" Sep 09 23:03:51.856517 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.856327 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2f52574e-96c0-4939-9826-4959aeae1c8b-etc-openvswitch\") pod \"ovnkube-node-6x9hk\" (UID: \"2f52574e-96c0-4939-9826-4959aeae1c8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6x9hk" Sep 09 23:03:51.856517 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.856352 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2f52574e-96c0-4939-9826-4959aeae1c8b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6x9hk\" (UID: \"2f52574e-96c0-4939-9826-4959aeae1c8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6x9hk" Sep 09 23:03:51.856517 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.856388 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbpp2\" (UniqueName: \"kubernetes.io/projected/2f52574e-96c0-4939-9826-4959aeae1c8b-kube-api-access-nbpp2\") pod \"ovnkube-node-6x9hk\" (UID: \"2f52574e-96c0-4939-9826-4959aeae1c8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6x9hk" Sep 09 23:03:51.856517 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.856408 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2f52574e-96c0-4939-9826-4959aeae1c8b-log-socket\") pod \"ovnkube-node-6x9hk\" (UID: \"2f52574e-96c0-4939-9826-4959aeae1c8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6x9hk" Sep 09 23:03:51.856517 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.856431 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c1b384a2-a59e-4bc1-88a1-64c6521d70fd-host-slash\") pod \"iptables-alerter-nvb6q\" (UID: \"c1b384a2-a59e-4bc1-88a1-64c6521d70fd\") " pod="openshift-network-operator/iptables-alerter-nvb6q" Sep 09 23:03:51.856517 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.856460 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a4486a4c-3025-4d07-9d75-d9e774762c4f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-l9fm4\" (UID: \"a4486a4c-3025-4d07-9d75-d9e774762c4f\") " pod="openshift-multus/multus-additional-cni-plugins-l9fm4" Sep 09 23:03:51.856517 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.856484 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2f52574e-96c0-4939-9826-4959aeae1c8b-run-systemd\") pod \"ovnkube-node-6x9hk\" (UID: \"2f52574e-96c0-4939-9826-4959aeae1c8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6x9hk" Sep 09 23:03:51.856517 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.856512 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ce549cd8-0a7b-44b1-afdb-6d02adf85c7d-original-pull-secret\") pod \"global-pull-secret-syncer-6fdst\" (UID: \"ce549cd8-0a7b-44b1-afdb-6d02adf85c7d\") " pod="kube-system/global-pull-secret-syncer-6fdst" Sep 09 23:03:51.857121 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.856535 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2f52574e-96c0-4939-9826-4959aeae1c8b-node-log\") pod \"ovnkube-node-6x9hk\" (UID: \"2f52574e-96c0-4939-9826-4959aeae1c8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6x9hk" Sep 09 23:03:51.857121 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.856558 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2f52574e-96c0-4939-9826-4959aeae1c8b-host-cni-netd\") pod \"ovnkube-node-6x9hk\" (UID: \"2f52574e-96c0-4939-9826-4959aeae1c8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6x9hk" Sep 09 23:03:51.857121 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.856588 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ce549cd8-0a7b-44b1-afdb-6d02adf85c7d-kubelet-config\") pod \"global-pull-secret-syncer-6fdst\" (UID: \"ce549cd8-0a7b-44b1-afdb-6d02adf85c7d\") " pod="kube-system/global-pull-secret-syncer-6fdst" Sep 09 23:03:51.857121 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.856614 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a4486a4c-3025-4d07-9d75-d9e774762c4f-system-cni-dir\") pod \"multus-additional-cni-plugins-l9fm4\" (UID: \"a4486a4c-3025-4d07-9d75-d9e774762c4f\") " pod="openshift-multus/multus-additional-cni-plugins-l9fm4" Sep 09 23:03:51.857121 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.856636 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a4486a4c-3025-4d07-9d75-d9e774762c4f-cnibin\") pod \"multus-additional-cni-plugins-l9fm4\" (UID: \"a4486a4c-3025-4d07-9d75-d9e774762c4f\") " pod="openshift-multus/multus-additional-cni-plugins-l9fm4" Sep 09 23:03:51.857121 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.856659 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2f52574e-96c0-4939-9826-4959aeae1c8b-systemd-units\") pod \"ovnkube-node-6x9hk\" (UID: \"2f52574e-96c0-4939-9826-4959aeae1c8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6x9hk" Sep 09 23:03:51.857121 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.856701 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2f52574e-96c0-4939-9826-4959aeae1c8b-env-overrides\") pod \"ovnkube-node-6x9hk\" (UID: \"2f52574e-96c0-4939-9826-4959aeae1c8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6x9hk" Sep 09 23:03:51.857121 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.856758 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2f52574e-96c0-4939-9826-4959aeae1c8b-ovnkube-script-lib\") pod \"ovnkube-node-6x9hk\" (UID: \"2f52574e-96c0-4939-9826-4959aeae1c8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6x9hk" Sep 09 23:03:51.857121 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.856782 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ce549cd8-0a7b-44b1-afdb-6d02adf85c7d-dbus\") pod \"global-pull-secret-syncer-6fdst\" (UID: \"ce549cd8-0a7b-44b1-afdb-6d02adf85c7d\") " pod="kube-system/global-pull-secret-syncer-6fdst" Sep 09 23:03:51.857121 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.856818 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49qq8\" (UniqueName: \"kubernetes.io/projected/0416357e-69d3-4301-b431-2b39d7387267-kube-api-access-49qq8\") pod \"network-check-target-h2ql9\" (UID: \"0416357e-69d3-4301-b431-2b39d7387267\") " pod="openshift-network-diagnostics/network-check-target-h2ql9" Sep 09 23:03:51.857121 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.856848 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2f52574e-96c0-4939-9826-4959aeae1c8b-ovn-node-metrics-cert\") pod \"ovnkube-node-6x9hk\" (UID: \"2f52574e-96c0-4939-9826-4959aeae1c8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6x9hk" Sep 09 23:03:51.857121 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.856870 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0a516991-cc12-4e02-9916-b451d2ff4571-agent-certs\") pod \"konnectivity-agent-x7m6c\" (UID: \"0a516991-cc12-4e02-9916-b451d2ff4571\") " pod="kube-system/konnectivity-agent-x7m6c" Sep 09 23:03:51.857121 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.856901 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0a516991-cc12-4e02-9916-b451d2ff4571-konnectivity-ca\") pod \"konnectivity-agent-x7m6c\" (UID: \"0a516991-cc12-4e02-9916-b451d2ff4571\") " pod="kube-system/konnectivity-agent-x7m6c" Sep 09 23:03:51.857121 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.856923 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2f52574e-96c0-4939-9826-4959aeae1c8b-var-lib-openvswitch\") pod \"ovnkube-node-6x9hk\" (UID: \"2f52574e-96c0-4939-9826-4959aeae1c8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6x9hk" Sep 09 23:03:51.857121 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.856947 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a4486a4c-3025-4d07-9d75-d9e774762c4f-cni-binary-copy\") pod \"multus-additional-cni-plugins-l9fm4\" (UID: \"a4486a4c-3025-4d07-9d75-d9e774762c4f\") " pod="openshift-multus/multus-additional-cni-plugins-l9fm4" Sep 09 23:03:51.857983 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.857565 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-jmczk\"" Sep 09 23:03:51.857983 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.857620 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 09 23:03:51.858850 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.858825 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5rtmc" Sep 09 23:03:51.859591 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.859566 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 09 23:03:51.861233 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.861211 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 09 23:03:51.861892 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.861545 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 09 23:03:51.861892 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.861738 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-g6vml\"" Sep 09 23:03:51.863975 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.863958 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 09 23:03:51.864871 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.864847 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l6zcg" Sep 09 23:03:51.867789 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.867772 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 09 23:03:51.867996 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.867975 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 09 23:03:51.868201 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.868154 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 09 23:03:51.868394 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.868371 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-9dgfn\"" Sep 09 23:03:51.870562 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.870540 2552 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-vlczt" Sep 09 23:03:51.881109 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.881084 2552 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-vlczt" Sep 09 23:03:51.882072 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.882053 2552 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 23:03:51.943532 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.943500 2552 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 09 23:03:51.957503 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.957469 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3feb7a98-2ac3-453c-8582-340db7bd6b89-etc-sysctl-conf\") pod \"tuned-zkcwq\" (UID: \"3feb7a98-2ac3-453c-8582-340db7bd6b89\") " pod="openshift-cluster-node-tuning-operator/tuned-zkcwq" Sep 09 23:03:51.957744 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.957513 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2f52574e-96c0-4939-9826-4959aeae1c8b-systemd-units\") pod \"ovnkube-node-6x9hk\" (UID: \"2f52574e-96c0-4939-9826-4959aeae1c8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6x9hk" Sep 09 23:03:51.957744 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.957551 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2f52574e-96c0-4939-9826-4959aeae1c8b-env-overrides\") pod \"ovnkube-node-6x9hk\" (UID: \"2f52574e-96c0-4939-9826-4959aeae1c8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6x9hk" Sep 09 23:03:51.957744 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.957571 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3feb7a98-2ac3-453c-8582-340db7bd6b89-etc-sysconfig\") pod \"tuned-zkcwq\" (UID: \"3feb7a98-2ac3-453c-8582-340db7bd6b89\") " pod="openshift-cluster-node-tuning-operator/tuned-zkcwq" Sep 09 23:03:51.957744 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.957589 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3feb7a98-2ac3-453c-8582-340db7bd6b89-tmp\") pod \"tuned-zkcwq\" (UID: \"3feb7a98-2ac3-453c-8582-340db7bd6b89\") " pod="openshift-cluster-node-tuning-operator/tuned-zkcwq" Sep 09 23:03:51.957744 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.957607 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2f52574e-96c0-4939-9826-4959aeae1c8b-ovn-node-metrics-cert\") pod \"ovnkube-node-6x9hk\" (UID: \"2f52574e-96c0-4939-9826-4959aeae1c8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6x9hk" Sep 09 23:03:51.957744 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.957606 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2f52574e-96c0-4939-9826-4959aeae1c8b-systemd-units\") pod \"ovnkube-node-6x9hk\" (UID: \"2f52574e-96c0-4939-9826-4959aeae1c8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6x9hk" Sep 09 23:03:51.957744 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.957622 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0a516991-cc12-4e02-9916-b451d2ff4571-konnectivity-ca\") pod \"konnectivity-agent-x7m6c\" (UID: \"0a516991-cc12-4e02-9916-b451d2ff4571\") " pod="kube-system/konnectivity-agent-x7m6c" Sep 09 23:03:51.957744 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.957636 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be92546e-2796-4680-9b67-4db0dd18a29b-metrics-certs\") pod \"network-metrics-daemon-5hnn9\" (UID: \"be92546e-2796-4680-9b67-4db0dd18a29b\") " pod="openshift-multus/network-metrics-daemon-5hnn9" Sep 09 23:03:51.957744 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.957681 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2cf4f0e4-e4dc-4953-87dd-f1ec9654c3cf-hosts-file\") pod \"node-resolver-khhlr\" (UID: \"2cf4f0e4-e4dc-4953-87dd-f1ec9654c3cf\") " pod="openshift-dns/node-resolver-khhlr" Sep 09 23:03:51.958199 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.957828 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/37940097-f543-48ff-b5db-f04a9ffac70e-host-var-lib-kubelet\") pod \"multus-z5jzx\" (UID: \"37940097-f543-48ff-b5db-f04a9ffac70e\") " pod="openshift-multus/multus-z5jzx" Sep 09 23:03:51.958199 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.957874 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2f52574e-96c0-4939-9826-4959aeae1c8b-var-lib-openvswitch\") pod \"ovnkube-node-6x9hk\" (UID: \"2f52574e-96c0-4939-9826-4959aeae1c8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6x9hk" Sep 09 23:03:51.958199 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.957904 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a4486a4c-3025-4d07-9d75-d9e774762c4f-cni-binary-copy\") pod \"multus-additional-cni-plugins-l9fm4\" (UID: \"a4486a4c-3025-4d07-9d75-d9e774762c4f\") " pod="openshift-multus/multus-additional-cni-plugins-l9fm4" Sep 09 23:03:51.958199 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.957952 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2f52574e-96c0-4939-9826-4959aeae1c8b-host-kubelet\") pod \"ovnkube-node-6x9hk\" (UID: \"2f52574e-96c0-4939-9826-4959aeae1c8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6x9hk" Sep 09 23:03:51.958199 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.957978 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2f52574e-96c0-4939-9826-4959aeae1c8b-ovnkube-config\") pod \"ovnkube-node-6x9hk\" (UID: \"2f52574e-96c0-4939-9826-4959aeae1c8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6x9hk" Sep 09 23:03:51.958199 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.958005 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bffhw\" (UniqueName: \"kubernetes.io/projected/8072e8a5-9862-4c4c-8cbc-5cb98d4b98c3-kube-api-access-bffhw\") pod \"aws-ebs-csi-driver-node-l6zcg\" (UID: \"8072e8a5-9862-4c4c-8cbc-5cb98d4b98c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l6zcg" Sep 09 23:03:51.958199 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.958033 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2f52574e-96c0-4939-9826-4959aeae1c8b-run-ovn\") pod \"ovnkube-node-6x9hk\" (UID: \"2f52574e-96c0-4939-9826-4959aeae1c8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6x9hk" Sep 09 23:03:51.958199 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.958091 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/37940097-f543-48ff-b5db-f04a9ffac70e-etc-kubernetes\") pod \"multus-z5jzx\" (UID: \"37940097-f543-48ff-b5db-f04a9ffac70e\") " pod="openshift-multus/multus-z5jzx" Sep 09 23:03:51.958199 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.958119 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a4486a4c-3025-4d07-9d75-d9e774762c4f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-l9fm4\" (UID: \"a4486a4c-3025-4d07-9d75-d9e774762c4f\") " pod="openshift-multus/multus-additional-cni-plugins-l9fm4" Sep 09 23:03:51.958199 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.958127 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2f52574e-96c0-4939-9826-4959aeae1c8b-env-overrides\") pod \"ovnkube-node-6x9hk\" (UID: \"2f52574e-96c0-4939-9826-4959aeae1c8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6x9hk" Sep 09 23:03:51.958199 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.958143 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2f52574e-96c0-4939-9826-4959aeae1c8b-host-slash\") pod \"ovnkube-node-6x9hk\" (UID: \"2f52574e-96c0-4939-9826-4959aeae1c8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6x9hk" Sep 09 23:03:51.958199 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.958168 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2f52574e-96c0-4939-9826-4959aeae1c8b-host-run-ovn-kubernetes\") pod \"ovnkube-node-6x9hk\" (UID: \"2f52574e-96c0-4939-9826-4959aeae1c8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6x9hk" Sep 09 23:03:51.958199 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.958204 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2f52574e-96c0-4939-9826-4959aeae1c8b-host-cni-bin\") pod \"ovnkube-node-6x9hk\" (UID: \"2f52574e-96c0-4939-9826-4959aeae1c8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6x9hk" Sep 09 23:03:51.958841 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.958228 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bbmc\" (UniqueName: \"kubernetes.io/projected/2cf4f0e4-e4dc-4953-87dd-f1ec9654c3cf-kube-api-access-5bbmc\") pod \"node-resolver-khhlr\" (UID: \"2cf4f0e4-e4dc-4953-87dd-f1ec9654c3cf\") " pod="openshift-dns/node-resolver-khhlr" Sep 09 23:03:51.958841 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.958254 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3feb7a98-2ac3-453c-8582-340db7bd6b89-etc-kubernetes\") pod \"tuned-zkcwq\" (UID: \"3feb7a98-2ac3-453c-8582-340db7bd6b89\") " pod="openshift-cluster-node-tuning-operator/tuned-zkcwq" Sep 09 23:03:51.958841 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.958269 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0a516991-cc12-4e02-9916-b451d2ff4571-konnectivity-ca\") pod \"konnectivity-agent-x7m6c\" (UID: \"0a516991-cc12-4e02-9916-b451d2ff4571\") " pod="kube-system/konnectivity-agent-x7m6c" Sep 09 23:03:51.958841 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.958279 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/37940097-f543-48ff-b5db-f04a9ffac70e-cni-binary-copy\") pod \"multus-z5jzx\" (UID: \"37940097-f543-48ff-b5db-f04a9ffac70e\") " pod="openshift-multus/multus-z5jzx" Sep 09 23:03:51.958841 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.958344 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a4486a4c-3025-4d07-9d75-d9e774762c4f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-l9fm4\" (UID: \"a4486a4c-3025-4d07-9d75-d9e774762c4f\") " pod="openshift-multus/multus-additional-cni-plugins-l9fm4" Sep 09 23:03:51.958841 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.958372 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24l9f\" (UniqueName: \"kubernetes.io/projected/c1b384a2-a59e-4bc1-88a1-64c6521d70fd-kube-api-access-24l9f\") pod \"iptables-alerter-nvb6q\" (UID: \"c1b384a2-a59e-4bc1-88a1-64c6521d70fd\") " pod="openshift-network-operator/iptables-alerter-nvb6q" Sep 09 23:03:51.958841 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.958395 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2f52574e-96c0-4939-9826-4959aeae1c8b-etc-openvswitch\") pod \"ovnkube-node-6x9hk\" (UID: \"2f52574e-96c0-4939-9826-4959aeae1c8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6x9hk" Sep 09 23:03:51.958841 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.958442 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2f52574e-96c0-4939-9826-4959aeae1c8b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6x9hk\" (UID: \"2f52574e-96c0-4939-9826-4959aeae1c8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6x9hk" Sep 09 23:03:51.958841 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.958491 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbpp2\" (UniqueName: \"kubernetes.io/projected/2f52574e-96c0-4939-9826-4959aeae1c8b-kube-api-access-nbpp2\") pod \"ovnkube-node-6x9hk\" (UID: \"2f52574e-96c0-4939-9826-4959aeae1c8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6x9hk" Sep 09 23:03:51.958841 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.958518 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3feb7a98-2ac3-453c-8582-340db7bd6b89-etc-modprobe-d\") pod \"tuned-zkcwq\" (UID: \"3feb7a98-2ac3-453c-8582-340db7bd6b89\") " pod="openshift-cluster-node-tuning-operator/tuned-zkcwq" Sep 09 23:03:51.958841 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.958545 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3feb7a98-2ac3-453c-8582-340db7bd6b89-run\") pod \"tuned-zkcwq\" (UID: \"3feb7a98-2ac3-453c-8582-340db7bd6b89\") " pod="openshift-cluster-node-tuning-operator/tuned-zkcwq" Sep 09 23:03:51.958841 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.958569 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3feb7a98-2ac3-453c-8582-340db7bd6b89-lib-modules\") pod \"tuned-zkcwq\" (UID: \"3feb7a98-2ac3-453c-8582-340db7bd6b89\") " pod="openshift-cluster-node-tuning-operator/tuned-zkcwq" Sep 09 23:03:51.958841 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.958593 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2f52574e-96c0-4939-9826-4959aeae1c8b-log-socket\") pod \"ovnkube-node-6x9hk\" (UID: \"2f52574e-96c0-4939-9826-4959aeae1c8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6x9hk" Sep 09 23:03:51.958841 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.958622 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c1b384a2-a59e-4bc1-88a1-64c6521d70fd-host-slash\") pod \"iptables-alerter-nvb6q\" (UID: \"c1b384a2-a59e-4bc1-88a1-64c6521d70fd\") " pod="openshift-network-operator/iptables-alerter-nvb6q" Sep 09 23:03:51.958841 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.958650 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a4486a4c-3025-4d07-9d75-d9e774762c4f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-l9fm4\" (UID: \"a4486a4c-3025-4d07-9d75-d9e774762c4f\") " pod="openshift-multus/multus-additional-cni-plugins-l9fm4" Sep 09 23:03:51.958841 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.958692 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ce549cd8-0a7b-44b1-afdb-6d02adf85c7d-original-pull-secret\") pod \"global-pull-secret-syncer-6fdst\" (UID: \"ce549cd8-0a7b-44b1-afdb-6d02adf85c7d\") " pod="kube-system/global-pull-secret-syncer-6fdst" Sep 09 23:03:51.958841 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.958716 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3feb7a98-2ac3-453c-8582-340db7bd6b89-var-lib-kubelet\") pod \"tuned-zkcwq\" (UID: \"3feb7a98-2ac3-453c-8582-340db7bd6b89\") " pod="openshift-cluster-node-tuning-operator/tuned-zkcwq" Sep 09 23:03:51.959625 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.958743 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/37940097-f543-48ff-b5db-f04a9ffac70e-multus-cni-dir\") pod \"multus-z5jzx\" (UID: \"37940097-f543-48ff-b5db-f04a9ffac70e\") " pod="openshift-multus/multus-z5jzx" Sep 09 23:03:51.959625 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.958764 2552 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 09 23:03:51.959625 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.958797 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2f52574e-96c0-4939-9826-4959aeae1c8b-ovnkube-config\") pod \"ovnkube-node-6x9hk\" (UID: \"2f52574e-96c0-4939-9826-4959aeae1c8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6x9hk" Sep 09 23:03:51.959625 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.958347 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2f52574e-96c0-4939-9826-4959aeae1c8b-host-run-ovn-kubernetes\") pod \"ovnkube-node-6x9hk\" (UID: \"2f52574e-96c0-4939-9826-4959aeae1c8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6x9hk" Sep 09 23:03:51.959625 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.958846 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2f52574e-96c0-4939-9826-4959aeae1c8b-etc-openvswitch\") pod \"ovnkube-node-6x9hk\" (UID: \"2f52574e-96c0-4939-9826-4959aeae1c8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6x9hk" Sep 09 23:03:51.959625 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.958868 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2f52574e-96c0-4939-9826-4959aeae1c8b-host-cni-bin\") pod \"ovnkube-node-6x9hk\" (UID: \"2f52574e-96c0-4939-9826-4959aeae1c8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6x9hk" Sep 09 23:03:51.959625 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.958901 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2f52574e-96c0-4939-9826-4959aeae1c8b-host-slash\") pod \"ovnkube-node-6x9hk\" (UID: \"2f52574e-96c0-4939-9826-4959aeae1c8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6x9hk" Sep 09 23:03:51.959625 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.958936 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2f52574e-96c0-4939-9826-4959aeae1c8b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6x9hk\" (UID: \"2f52574e-96c0-4939-9826-4959aeae1c8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6x9hk" Sep 09 23:03:51.959625 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.959310 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a4486a4c-3025-4d07-9d75-d9e774762c4f-cni-binary-copy\") pod \"multus-additional-cni-plugins-l9fm4\" (UID: \"a4486a4c-3025-4d07-9d75-d9e774762c4f\") " pod="openshift-multus/multus-additional-cni-plugins-l9fm4" Sep 09 23:03:51.959625 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.959297 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a4486a4c-3025-4d07-9d75-d9e774762c4f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-l9fm4\" (UID: \"a4486a4c-3025-4d07-9d75-d9e774762c4f\") " pod="openshift-multus/multus-additional-cni-plugins-l9fm4" Sep 09 23:03:51.959625 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.959377 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a4486a4c-3025-4d07-9d75-d9e774762c4f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-l9fm4\" (UID: \"a4486a4c-3025-4d07-9d75-d9e774762c4f\") " pod="openshift-multus/multus-additional-cni-plugins-l9fm4" Sep 09 23:03:51.959625 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.959367 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2f52574e-96c0-4939-9826-4959aeae1c8b-run-ovn\") pod \"ovnkube-node-6x9hk\" (UID: \"2f52574e-96c0-4939-9826-4959aeae1c8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6x9hk" Sep 09 23:03:51.959625 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.959411 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2f52574e-96c0-4939-9826-4959aeae1c8b-var-lib-openvswitch\") pod \"ovnkube-node-6x9hk\" (UID: \"2f52574e-96c0-4939-9826-4959aeae1c8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6x9hk" Sep 09 23:03:51.959625 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.959449 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2f52574e-96c0-4939-9826-4959aeae1c8b-host-kubelet\") pod \"ovnkube-node-6x9hk\" (UID: \"2f52574e-96c0-4939-9826-4959aeae1c8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6x9hk" Sep 09 23:03:51.959625 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.959481 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/37940097-f543-48ff-b5db-f04a9ffac70e-cnibin\") pod \"multus-z5jzx\" (UID: \"37940097-f543-48ff-b5db-f04a9ffac70e\") " pod="openshift-multus/multus-z5jzx" Sep 09 23:03:51.959625 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.959509 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/37940097-f543-48ff-b5db-f04a9ffac70e-multus-conf-dir\") pod \"multus-z5jzx\" (UID: \"37940097-f543-48ff-b5db-f04a9ffac70e\") " pod="openshift-multus/multus-z5jzx" Sep 09 23:03:51.959625 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.959516 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2f52574e-96c0-4939-9826-4959aeae1c8b-log-socket\") pod \"ovnkube-node-6x9hk\" (UID: \"2f52574e-96c0-4939-9826-4959aeae1c8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6x9hk" Sep 09 23:03:51.960429 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.959540 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ce549cd8-0a7b-44b1-afdb-6d02adf85c7d-kubelet-config\") pod \"global-pull-secret-syncer-6fdst\" (UID: \"ce549cd8-0a7b-44b1-afdb-6d02adf85c7d\") " pod="kube-system/global-pull-secret-syncer-6fdst" Sep 09 23:03:51.960429 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.959567 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8ed69f2d-7f79-4199-b3ea-9a7a73b02f6d-serviceca\") pod \"node-ca-5rtmc\" (UID: \"8ed69f2d-7f79-4199-b3ea-9a7a73b02f6d\") " pod="openshift-image-registry/node-ca-5rtmc" Sep 09 23:03:51.960429 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:03:51.959585 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 23:03:51.960429 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.959616 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a4486a4c-3025-4d07-9d75-d9e774762c4f-system-cni-dir\") pod \"multus-additional-cni-plugins-l9fm4\" (UID: \"a4486a4c-3025-4d07-9d75-d9e774762c4f\") " pod="openshift-multus/multus-additional-cni-plugins-l9fm4" Sep 09 23:03:51.960429 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.959644 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a4486a4c-3025-4d07-9d75-d9e774762c4f-cnibin\") pod \"multus-additional-cni-plugins-l9fm4\" (UID: \"a4486a4c-3025-4d07-9d75-d9e774762c4f\") " pod="openshift-multus/multus-additional-cni-plugins-l9fm4" Sep 09 23:03:51.960429 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.959645 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c1b384a2-a59e-4bc1-88a1-64c6521d70fd-host-slash\") pod \"iptables-alerter-nvb6q\" (UID: \"c1b384a2-a59e-4bc1-88a1-64c6521d70fd\") " pod="openshift-network-operator/iptables-alerter-nvb6q" Sep 09 23:03:51.960429 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:03:51.959697 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce549cd8-0a7b-44b1-afdb-6d02adf85c7d-original-pull-secret podName:ce549cd8-0a7b-44b1-afdb-6d02adf85c7d nodeName:}" failed. No retries permitted until 2026-09-09 23:03:52.459641723 +0000 UTC m=+2.975372555 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ce549cd8-0a7b-44b1-afdb-6d02adf85c7d-original-pull-secret") pod "global-pull-secret-syncer-6fdst" (UID: "ce549cd8-0a7b-44b1-afdb-6d02adf85c7d") : object "kube-system"/"original-pull-secret" not registered Sep 09 23:03:51.960429 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.959703 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a4486a4c-3025-4d07-9d75-d9e774762c4f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-l9fm4\" (UID: \"a4486a4c-3025-4d07-9d75-d9e774762c4f\") " pod="openshift-multus/multus-additional-cni-plugins-l9fm4" Sep 09 23:03:51.960429 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.959706 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ce549cd8-0a7b-44b1-afdb-6d02adf85c7d-kubelet-config\") pod \"global-pull-secret-syncer-6fdst\" (UID: \"ce549cd8-0a7b-44b1-afdb-6d02adf85c7d\") " pod="kube-system/global-pull-secret-syncer-6fdst" Sep 09 23:03:51.960429 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.959748 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2f52574e-96c0-4939-9826-4959aeae1c8b-ovnkube-script-lib\") pod \"ovnkube-node-6x9hk\" (UID: \"2f52574e-96c0-4939-9826-4959aeae1c8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6x9hk" Sep 09 23:03:51.960429 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.959750 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a4486a4c-3025-4d07-9d75-d9e774762c4f-system-cni-dir\") pod \"multus-additional-cni-plugins-l9fm4\" (UID: \"a4486a4c-3025-4d07-9d75-d9e774762c4f\") " pod="openshift-multus/multus-additional-cni-plugins-l9fm4" Sep 09 23:03:51.960429 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.959776 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a4486a4c-3025-4d07-9d75-d9e774762c4f-cnibin\") pod \"multus-additional-cni-plugins-l9fm4\" (UID: \"a4486a4c-3025-4d07-9d75-d9e774762c4f\") " pod="openshift-multus/multus-additional-cni-plugins-l9fm4" Sep 09 23:03:51.960429 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.959841 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ce549cd8-0a7b-44b1-afdb-6d02adf85c7d-dbus\") pod \"global-pull-secret-syncer-6fdst\" (UID: \"ce549cd8-0a7b-44b1-afdb-6d02adf85c7d\") " pod="kube-system/global-pull-secret-syncer-6fdst" Sep 09 23:03:51.960429 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.959913 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctsb8\" (UniqueName: \"kubernetes.io/projected/8ed69f2d-7f79-4199-b3ea-9a7a73b02f6d-kube-api-access-ctsb8\") pod \"node-ca-5rtmc\" (UID: \"8ed69f2d-7f79-4199-b3ea-9a7a73b02f6d\") " pod="openshift-image-registry/node-ca-5rtmc" Sep 09 23:03:51.960429 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.959931 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ce549cd8-0a7b-44b1-afdb-6d02adf85c7d-dbus\") pod \"global-pull-secret-syncer-6fdst\" (UID: \"ce549cd8-0a7b-44b1-afdb-6d02adf85c7d\") " pod="kube-system/global-pull-secret-syncer-6fdst" Sep 09 23:03:51.960429 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.959977 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/37940097-f543-48ff-b5db-f04a9ffac70e-system-cni-dir\") pod \"multus-z5jzx\" (UID: \"37940097-f543-48ff-b5db-f04a9ffac70e\") " pod="openshift-multus/multus-z5jzx" Sep 09 23:03:51.960429 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.960011 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/37940097-f543-48ff-b5db-f04a9ffac70e-multus-socket-dir-parent\") pod \"multus-z5jzx\" (UID: \"37940097-f543-48ff-b5db-f04a9ffac70e\") " pod="openshift-multus/multus-z5jzx" Sep 09 23:03:51.961279 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.960047 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/37940097-f543-48ff-b5db-f04a9ffac70e-host-run-multus-certs\") pod \"multus-z5jzx\" (UID: \"37940097-f543-48ff-b5db-f04a9ffac70e\") " pod="openshift-multus/multus-z5jzx" Sep 09 23:03:51.961279 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.960077 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3feb7a98-2ac3-453c-8582-340db7bd6b89-etc-sysctl-d\") pod \"tuned-zkcwq\" (UID: \"3feb7a98-2ac3-453c-8582-340db7bd6b89\") " pod="openshift-cluster-node-tuning-operator/tuned-zkcwq" Sep 09 23:03:51.961279 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.960103 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49qq8\" (UniqueName: \"kubernetes.io/projected/0416357e-69d3-4301-b431-2b39d7387267-kube-api-access-49qq8\") pod \"network-check-target-h2ql9\" (UID: \"0416357e-69d3-4301-b431-2b39d7387267\") " pod="openshift-network-diagnostics/network-check-target-h2ql9" Sep 09 23:03:51.961279 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.960136 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0a516991-cc12-4e02-9916-b451d2ff4571-agent-certs\") pod \"konnectivity-agent-x7m6c\" (UID: \"0a516991-cc12-4e02-9916-b451d2ff4571\") " pod="kube-system/konnectivity-agent-x7m6c" Sep 09 23:03:51.961279 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.960163 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/37940097-f543-48ff-b5db-f04a9ffac70e-host-var-lib-cni-multus\") pod \"multus-z5jzx\" (UID: \"37940097-f543-48ff-b5db-f04a9ffac70e\") " pod="openshift-multus/multus-z5jzx" Sep 09 23:03:51.961279 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.960182 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2f52574e-96c0-4939-9826-4959aeae1c8b-ovnkube-script-lib\") pod \"ovnkube-node-6x9hk\" (UID: \"2f52574e-96c0-4939-9826-4959aeae1c8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6x9hk" Sep 09 23:03:51.961279 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.960201 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8072e8a5-9862-4c4c-8cbc-5cb98d4b98c3-device-dir\") pod \"aws-ebs-csi-driver-node-l6zcg\" (UID: \"8072e8a5-9862-4c4c-8cbc-5cb98d4b98c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l6zcg" Sep 09 23:03:51.961279 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.960232 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8072e8a5-9862-4c4c-8cbc-5cb98d4b98c3-etc-selinux\") pod \"aws-ebs-csi-driver-node-l6zcg\" (UID: \"8072e8a5-9862-4c4c-8cbc-5cb98d4b98c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l6zcg" Sep 09 23:03:51.961279 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.960254 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4qs9\" (UniqueName: \"kubernetes.io/projected/a4486a4c-3025-4d07-9d75-d9e774762c4f-kube-api-access-l4qs9\") pod \"multus-additional-cni-plugins-l9fm4\" (UID: \"a4486a4c-3025-4d07-9d75-d9e774762c4f\") " pod="openshift-multus/multus-additional-cni-plugins-l9fm4" Sep 09 23:03:51.961279 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.960270 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c1b384a2-a59e-4bc1-88a1-64c6521d70fd-iptables-alerter-script\") pod \"iptables-alerter-nvb6q\" (UID: \"c1b384a2-a59e-4bc1-88a1-64c6521d70fd\") " pod="openshift-network-operator/iptables-alerter-nvb6q" Sep 09 23:03:51.961279 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.960312 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2f52574e-96c0-4939-9826-4959aeae1c8b-host-run-netns\") pod \"ovnkube-node-6x9hk\" (UID: \"2f52574e-96c0-4939-9826-4959aeae1c8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6x9hk" Sep 09 23:03:51.961279 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.960339 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b857k\" (UniqueName: \"kubernetes.io/projected/be92546e-2796-4680-9b67-4db0dd18a29b-kube-api-access-b857k\") pod \"network-metrics-daemon-5hnn9\" (UID: \"be92546e-2796-4680-9b67-4db0dd18a29b\") " pod="openshift-multus/network-metrics-daemon-5hnn9" Sep 09 23:03:51.961279 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.960366 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2f52574e-96c0-4939-9826-4959aeae1c8b-host-run-netns\") pod \"ovnkube-node-6x9hk\" (UID: \"2f52574e-96c0-4939-9826-4959aeae1c8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6x9hk" Sep 09 23:03:51.961279 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.960400 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3feb7a98-2ac3-453c-8582-340db7bd6b89-host\") pod \"tuned-zkcwq\" (UID: \"3feb7a98-2ac3-453c-8582-340db7bd6b89\") " pod="openshift-cluster-node-tuning-operator/tuned-zkcwq" Sep 09 23:03:51.961279 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.960457 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgk6s\" (UniqueName: \"kubernetes.io/projected/3feb7a98-2ac3-453c-8582-340db7bd6b89-kube-api-access-fgk6s\") pod \"tuned-zkcwq\" (UID: \"3feb7a98-2ac3-453c-8582-340db7bd6b89\") " pod="openshift-cluster-node-tuning-operator/tuned-zkcwq" Sep 09 23:03:51.961279 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.960482 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qkpp\" (UniqueName: \"kubernetes.io/projected/37940097-f543-48ff-b5db-f04a9ffac70e-kube-api-access-4qkpp\") pod \"multus-z5jzx\" (UID: \"37940097-f543-48ff-b5db-f04a9ffac70e\") " pod="openshift-multus/multus-z5jzx" Sep 09 23:03:51.962024 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.960516 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2f52574e-96c0-4939-9826-4959aeae1c8b-run-openvswitch\") pod \"ovnkube-node-6x9hk\" (UID: \"2f52574e-96c0-4939-9826-4959aeae1c8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6x9hk" Sep 09 23:03:51.962024 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.960538 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/37940097-f543-48ff-b5db-f04a9ffac70e-hostroot\") pod \"multus-z5jzx\" (UID: \"37940097-f543-48ff-b5db-f04a9ffac70e\") " pod="openshift-multus/multus-z5jzx" Sep 09 23:03:51.962024 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.960553 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/37940097-f543-48ff-b5db-f04a9ffac70e-multus-daemon-config\") pod \"multus-z5jzx\" (UID: \"37940097-f543-48ff-b5db-f04a9ffac70e\") " pod="openshift-multus/multus-z5jzx" Sep 09 23:03:51.962024 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.960567 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8072e8a5-9862-4c4c-8cbc-5cb98d4b98c3-registration-dir\") pod \"aws-ebs-csi-driver-node-l6zcg\" (UID: \"8072e8a5-9862-4c4c-8cbc-5cb98d4b98c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l6zcg" Sep 09 23:03:51.962024 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.960568 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2f52574e-96c0-4939-9826-4959aeae1c8b-run-openvswitch\") pod \"ovnkube-node-6x9hk\" (UID: \"2f52574e-96c0-4939-9826-4959aeae1c8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6x9hk" Sep 09 23:03:51.962024 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.960588 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8072e8a5-9862-4c4c-8cbc-5cb98d4b98c3-sys-fs\") pod \"aws-ebs-csi-driver-node-l6zcg\" (UID: \"8072e8a5-9862-4c4c-8cbc-5cb98d4b98c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l6zcg" Sep 09 23:03:51.962024 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.960628 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2cf4f0e4-e4dc-4953-87dd-f1ec9654c3cf-tmp-dir\") pod \"node-resolver-khhlr\" (UID: \"2cf4f0e4-e4dc-4953-87dd-f1ec9654c3cf\") " pod="openshift-dns/node-resolver-khhlr" Sep 09 23:03:51.962024 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.960651 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3feb7a98-2ac3-453c-8582-340db7bd6b89-etc-systemd\") pod \"tuned-zkcwq\" (UID: \"3feb7a98-2ac3-453c-8582-340db7bd6b89\") " pod="openshift-cluster-node-tuning-operator/tuned-zkcwq" Sep 09 23:03:51.962024 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.960685 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3feb7a98-2ac3-453c-8582-340db7bd6b89-sys\") pod \"tuned-zkcwq\" (UID: \"3feb7a98-2ac3-453c-8582-340db7bd6b89\") " pod="openshift-cluster-node-tuning-operator/tuned-zkcwq" Sep 09 23:03:51.962024 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.960712 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3feb7a98-2ac3-453c-8582-340db7bd6b89-etc-tuned\") pod \"tuned-zkcwq\" (UID: \"3feb7a98-2ac3-453c-8582-340db7bd6b89\") " pod="openshift-cluster-node-tuning-operator/tuned-zkcwq" Sep 09 23:03:51.962024 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.960736 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/37940097-f543-48ff-b5db-f04a9ffac70e-host-run-k8s-cni-cncf-io\") pod \"multus-z5jzx\" (UID: \"37940097-f543-48ff-b5db-f04a9ffac70e\") " pod="openshift-multus/multus-z5jzx" Sep 09 23:03:51.962024 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.960757 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8072e8a5-9862-4c4c-8cbc-5cb98d4b98c3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-l6zcg\" (UID: \"8072e8a5-9862-4c4c-8cbc-5cb98d4b98c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l6zcg" Sep 09 23:03:51.962024 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.960781 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/37940097-f543-48ff-b5db-f04a9ffac70e-host-var-lib-cni-bin\") pod \"multus-z5jzx\" (UID: \"37940097-f543-48ff-b5db-f04a9ffac70e\") " pod="openshift-multus/multus-z5jzx" Sep 09 23:03:51.962024 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.960802 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2f52574e-96c0-4939-9826-4959aeae1c8b-run-systemd\") pod \"ovnkube-node-6x9hk\" (UID: \"2f52574e-96c0-4939-9826-4959aeae1c8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6x9hk" Sep 09 23:03:51.962024 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.960816 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/37940097-f543-48ff-b5db-f04a9ffac70e-host-run-netns\") pod \"multus-z5jzx\" (UID: \"37940097-f543-48ff-b5db-f04a9ffac70e\") " pod="openshift-multus/multus-z5jzx" Sep 09 23:03:51.962024 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.960836 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8072e8a5-9862-4c4c-8cbc-5cb98d4b98c3-socket-dir\") pod \"aws-ebs-csi-driver-node-l6zcg\" (UID: \"8072e8a5-9862-4c4c-8cbc-5cb98d4b98c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l6zcg" Sep 09 23:03:51.962024 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.960859 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2f52574e-96c0-4939-9826-4959aeae1c8b-node-log\") pod \"ovnkube-node-6x9hk\" (UID: \"2f52574e-96c0-4939-9826-4959aeae1c8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6x9hk" Sep 09 23:03:51.962835 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.960880 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2f52574e-96c0-4939-9826-4959aeae1c8b-host-cni-netd\") pod \"ovnkube-node-6x9hk\" (UID: \"2f52574e-96c0-4939-9826-4959aeae1c8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6x9hk" Sep 09 23:03:51.962835 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.960900 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8ed69f2d-7f79-4199-b3ea-9a7a73b02f6d-host\") pod \"node-ca-5rtmc\" (UID: \"8ed69f2d-7f79-4199-b3ea-9a7a73b02f6d\") " pod="openshift-image-registry/node-ca-5rtmc" Sep 09 23:03:51.962835 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.960927 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2f52574e-96c0-4939-9826-4959aeae1c8b-host-cni-netd\") pod \"ovnkube-node-6x9hk\" (UID: \"2f52574e-96c0-4939-9826-4959aeae1c8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6x9hk" Sep 09 23:03:51.962835 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.960879 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2f52574e-96c0-4939-9826-4959aeae1c8b-run-systemd\") pod \"ovnkube-node-6x9hk\" (UID: \"2f52574e-96c0-4939-9826-4959aeae1c8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6x9hk" Sep 09 23:03:51.962835 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.960972 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2f52574e-96c0-4939-9826-4959aeae1c8b-node-log\") pod \"ovnkube-node-6x9hk\" (UID: \"2f52574e-96c0-4939-9826-4959aeae1c8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6x9hk" Sep 09 23:03:51.962835 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.961028 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c1b384a2-a59e-4bc1-88a1-64c6521d70fd-iptables-alerter-script\") pod \"iptables-alerter-nvb6q\" (UID: \"c1b384a2-a59e-4bc1-88a1-64c6521d70fd\") " pod="openshift-network-operator/iptables-alerter-nvb6q" Sep 09 23:03:51.962835 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.962730 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2f52574e-96c0-4939-9826-4959aeae1c8b-ovn-node-metrics-cert\") pod \"ovnkube-node-6x9hk\" (UID: \"2f52574e-96c0-4939-9826-4959aeae1c8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6x9hk" Sep 09 23:03:51.963230 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.963213 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0a516991-cc12-4e02-9916-b451d2ff4571-agent-certs\") pod \"konnectivity-agent-x7m6c\" (UID: \"0a516991-cc12-4e02-9916-b451d2ff4571\") " pod="kube-system/konnectivity-agent-x7m6c" Sep 09 23:03:51.967595 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.967570 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbpp2\" (UniqueName: \"kubernetes.io/projected/2f52574e-96c0-4939-9826-4959aeae1c8b-kube-api-access-nbpp2\") pod \"ovnkube-node-6x9hk\" (UID: \"2f52574e-96c0-4939-9826-4959aeae1c8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6x9hk" Sep 09 23:03:51.968693 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:03:51.968642 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 23:03:51.968693 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:03:51.968662 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 23:03:51.968693 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:03:51.968691 2552 projected.go:196] Error preparing data for projected volume kube-api-access-49qq8 for pod openshift-network-diagnostics/network-check-target-h2ql9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:03:51.968986 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:03:51.968754 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0416357e-69d3-4301-b431-2b39d7387267-kube-api-access-49qq8 podName:0416357e-69d3-4301-b431-2b39d7387267 nodeName:}" failed. No retries permitted until 2026-09-09 23:03:52.468735573 +0000 UTC m=+2.984466388 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-49qq8" (UniqueName: "kubernetes.io/projected/0416357e-69d3-4301-b431-2b39d7387267-kube-api-access-49qq8") pod "network-check-target-h2ql9" (UID: "0416357e-69d3-4301-b431-2b39d7387267") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:03:51.970449 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.970427 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-24l9f\" (UniqueName: \"kubernetes.io/projected/c1b384a2-a59e-4bc1-88a1-64c6521d70fd-kube-api-access-24l9f\") pod \"iptables-alerter-nvb6q\" (UID: \"c1b384a2-a59e-4bc1-88a1-64c6521d70fd\") " pod="openshift-network-operator/iptables-alerter-nvb6q" Sep 09 23:03:51.971879 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:51.971856 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4qs9\" (UniqueName: \"kubernetes.io/projected/a4486a4c-3025-4d07-9d75-d9e774762c4f-kube-api-access-l4qs9\") pod \"multus-additional-cni-plugins-l9fm4\" (UID: \"a4486a4c-3025-4d07-9d75-d9e774762c4f\") " pod="openshift-multus/multus-additional-cni-plugins-l9fm4" Sep 09 23:03:52.062163 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.062120 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/37940097-f543-48ff-b5db-f04a9ffac70e-host-run-netns\") pod \"multus-z5jzx\" (UID: \"37940097-f543-48ff-b5db-f04a9ffac70e\") " pod="openshift-multus/multus-z5jzx" Sep 09 23:03:52.062163 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.062169 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8072e8a5-9862-4c4c-8cbc-5cb98d4b98c3-socket-dir\") pod \"aws-ebs-csi-driver-node-l6zcg\" (UID: \"8072e8a5-9862-4c4c-8cbc-5cb98d4b98c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l6zcg" Sep 09 23:03:52.062407 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.062253 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/37940097-f543-48ff-b5db-f04a9ffac70e-host-run-netns\") pod \"multus-z5jzx\" (UID: \"37940097-f543-48ff-b5db-f04a9ffac70e\") " pod="openshift-multus/multus-z5jzx" Sep 09 23:03:52.062407 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.062303 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8ed69f2d-7f79-4199-b3ea-9a7a73b02f6d-host\") pod \"node-ca-5rtmc\" (UID: \"8ed69f2d-7f79-4199-b3ea-9a7a73b02f6d\") " pod="openshift-image-registry/node-ca-5rtmc" Sep 09 23:03:52.062407 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.062338 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8072e8a5-9862-4c4c-8cbc-5cb98d4b98c3-socket-dir\") pod \"aws-ebs-csi-driver-node-l6zcg\" (UID: \"8072e8a5-9862-4c4c-8cbc-5cb98d4b98c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l6zcg" Sep 09 23:03:52.062407 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.062343 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3feb7a98-2ac3-453c-8582-340db7bd6b89-etc-sysctl-conf\") pod \"tuned-zkcwq\" (UID: \"3feb7a98-2ac3-453c-8582-340db7bd6b89\") " pod="openshift-cluster-node-tuning-operator/tuned-zkcwq" Sep 09 23:03:52.062407 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.062372 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8ed69f2d-7f79-4199-b3ea-9a7a73b02f6d-host\") pod \"node-ca-5rtmc\" (UID: \"8ed69f2d-7f79-4199-b3ea-9a7a73b02f6d\") " pod="openshift-image-registry/node-ca-5rtmc" Sep 09 23:03:52.062407 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.062387 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3feb7a98-2ac3-453c-8582-340db7bd6b89-etc-sysconfig\") pod \"tuned-zkcwq\" (UID: \"3feb7a98-2ac3-453c-8582-340db7bd6b89\") " pod="openshift-cluster-node-tuning-operator/tuned-zkcwq" Sep 09 23:03:52.062711 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.062414 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3feb7a98-2ac3-453c-8582-340db7bd6b89-tmp\") pod \"tuned-zkcwq\" (UID: \"3feb7a98-2ac3-453c-8582-340db7bd6b89\") " pod="openshift-cluster-node-tuning-operator/tuned-zkcwq" Sep 09 23:03:52.062711 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.062441 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be92546e-2796-4680-9b67-4db0dd18a29b-metrics-certs\") pod \"network-metrics-daemon-5hnn9\" (UID: \"be92546e-2796-4680-9b67-4db0dd18a29b\") " pod="openshift-multus/network-metrics-daemon-5hnn9" Sep 09 23:03:52.062711 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.062465 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2cf4f0e4-e4dc-4953-87dd-f1ec9654c3cf-hosts-file\") pod \"node-resolver-khhlr\" (UID: \"2cf4f0e4-e4dc-4953-87dd-f1ec9654c3cf\") " pod="openshift-dns/node-resolver-khhlr" Sep 09 23:03:52.062711 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.062487 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3feb7a98-2ac3-453c-8582-340db7bd6b89-etc-sysctl-conf\") pod \"tuned-zkcwq\" (UID: \"3feb7a98-2ac3-453c-8582-340db7bd6b89\") " pod="openshift-cluster-node-tuning-operator/tuned-zkcwq" Sep 09 23:03:52.062711 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.062489 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/37940097-f543-48ff-b5db-f04a9ffac70e-host-var-lib-kubelet\") pod \"multus-z5jzx\" (UID: \"37940097-f543-48ff-b5db-f04a9ffac70e\") " pod="openshift-multus/multus-z5jzx" Sep 09 23:03:52.062711 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.062502 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3feb7a98-2ac3-453c-8582-340db7bd6b89-etc-sysconfig\") pod \"tuned-zkcwq\" (UID: \"3feb7a98-2ac3-453c-8582-340db7bd6b89\") " pod="openshift-cluster-node-tuning-operator/tuned-zkcwq" Sep 09 23:03:52.062711 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.062531 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/37940097-f543-48ff-b5db-f04a9ffac70e-host-var-lib-kubelet\") pod \"multus-z5jzx\" (UID: \"37940097-f543-48ff-b5db-f04a9ffac70e\") " pod="openshift-multus/multus-z5jzx" Sep 09 23:03:52.062711 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.062530 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bffhw\" (UniqueName: \"kubernetes.io/projected/8072e8a5-9862-4c4c-8cbc-5cb98d4b98c3-kube-api-access-bffhw\") pod \"aws-ebs-csi-driver-node-l6zcg\" (UID: \"8072e8a5-9862-4c4c-8cbc-5cb98d4b98c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l6zcg" Sep 09 23:03:52.062711 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.062562 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/37940097-f543-48ff-b5db-f04a9ffac70e-etc-kubernetes\") pod \"multus-z5jzx\" (UID: \"37940097-f543-48ff-b5db-f04a9ffac70e\") " pod="openshift-multus/multus-z5jzx" Sep 09 23:03:52.062711 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.062594 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bbmc\" (UniqueName: \"kubernetes.io/projected/2cf4f0e4-e4dc-4953-87dd-f1ec9654c3cf-kube-api-access-5bbmc\") pod \"node-resolver-khhlr\" (UID: \"2cf4f0e4-e4dc-4953-87dd-f1ec9654c3cf\") " pod="openshift-dns/node-resolver-khhlr" Sep 09 23:03:52.062711 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:03:52.062606 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:03:52.062711 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.062619 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3feb7a98-2ac3-453c-8582-340db7bd6b89-etc-kubernetes\") pod \"tuned-zkcwq\" (UID: \"3feb7a98-2ac3-453c-8582-340db7bd6b89\") " pod="openshift-cluster-node-tuning-operator/tuned-zkcwq" Sep 09 23:03:52.062711 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.062643 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/37940097-f543-48ff-b5db-f04a9ffac70e-cni-binary-copy\") pod \"multus-z5jzx\" (UID: \"37940097-f543-48ff-b5db-f04a9ffac70e\") " pod="openshift-multus/multus-z5jzx" Sep 09 23:03:52.062711 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:03:52.062697 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be92546e-2796-4680-9b67-4db0dd18a29b-metrics-certs podName:be92546e-2796-4680-9b67-4db0dd18a29b nodeName:}" failed. No retries permitted until 2026-09-09 23:03:52.562656588 +0000 UTC m=+3.078387406 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/be92546e-2796-4680-9b67-4db0dd18a29b-metrics-certs") pod "network-metrics-daemon-5hnn9" (UID: "be92546e-2796-4680-9b67-4db0dd18a29b") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:03:52.063360 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.062728 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3feb7a98-2ac3-453c-8582-340db7bd6b89-etc-modprobe-d\") pod \"tuned-zkcwq\" (UID: \"3feb7a98-2ac3-453c-8582-340db7bd6b89\") " pod="openshift-cluster-node-tuning-operator/tuned-zkcwq" Sep 09 23:03:52.063360 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.062754 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3feb7a98-2ac3-453c-8582-340db7bd6b89-run\") pod \"tuned-zkcwq\" (UID: \"3feb7a98-2ac3-453c-8582-340db7bd6b89\") " pod="openshift-cluster-node-tuning-operator/tuned-zkcwq" Sep 09 23:03:52.063360 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.062777 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3feb7a98-2ac3-453c-8582-340db7bd6b89-lib-modules\") pod \"tuned-zkcwq\" (UID: \"3feb7a98-2ac3-453c-8582-340db7bd6b89\") " pod="openshift-cluster-node-tuning-operator/tuned-zkcwq" Sep 09 23:03:52.063360 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.062831 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3feb7a98-2ac3-453c-8582-340db7bd6b89-var-lib-kubelet\") pod \"tuned-zkcwq\" (UID: \"3feb7a98-2ac3-453c-8582-340db7bd6b89\") " pod="openshift-cluster-node-tuning-operator/tuned-zkcwq" Sep 09 23:03:52.063360 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.062855 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/37940097-f543-48ff-b5db-f04a9ffac70e-multus-cni-dir\") pod \"multus-z5jzx\" (UID: \"37940097-f543-48ff-b5db-f04a9ffac70e\") " pod="openshift-multus/multus-z5jzx" Sep 09 23:03:52.063360 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.062882 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/37940097-f543-48ff-b5db-f04a9ffac70e-cnibin\") pod \"multus-z5jzx\" (UID: \"37940097-f543-48ff-b5db-f04a9ffac70e\") " pod="openshift-multus/multus-z5jzx" Sep 09 23:03:52.063360 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.062887 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3feb7a98-2ac3-453c-8582-340db7bd6b89-run\") pod \"tuned-zkcwq\" (UID: \"3feb7a98-2ac3-453c-8582-340db7bd6b89\") " pod="openshift-cluster-node-tuning-operator/tuned-zkcwq" Sep 09 23:03:52.063360 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.062906 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/37940097-f543-48ff-b5db-f04a9ffac70e-multus-conf-dir\") pod \"multus-z5jzx\" (UID: \"37940097-f543-48ff-b5db-f04a9ffac70e\") " pod="openshift-multus/multus-z5jzx" Sep 09 23:03:52.063360 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.062944 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8ed69f2d-7f79-4199-b3ea-9a7a73b02f6d-serviceca\") pod \"node-ca-5rtmc\" (UID: \"8ed69f2d-7f79-4199-b3ea-9a7a73b02f6d\") " pod="openshift-image-registry/node-ca-5rtmc" Sep 09 23:03:52.063360 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.062976 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctsb8\" (UniqueName: \"kubernetes.io/projected/8ed69f2d-7f79-4199-b3ea-9a7a73b02f6d-kube-api-access-ctsb8\") pod \"node-ca-5rtmc\" (UID: \"8ed69f2d-7f79-4199-b3ea-9a7a73b02f6d\") " pod="openshift-image-registry/node-ca-5rtmc" Sep 09 23:03:52.063360 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.063001 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/37940097-f543-48ff-b5db-f04a9ffac70e-system-cni-dir\") pod \"multus-z5jzx\" (UID: \"37940097-f543-48ff-b5db-f04a9ffac70e\") " pod="openshift-multus/multus-z5jzx" Sep 09 23:03:52.063360 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.063022 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/37940097-f543-48ff-b5db-f04a9ffac70e-multus-socket-dir-parent\") pod \"multus-z5jzx\" (UID: \"37940097-f543-48ff-b5db-f04a9ffac70e\") " pod="openshift-multus/multus-z5jzx" Sep 09 23:03:52.063360 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.063044 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/37940097-f543-48ff-b5db-f04a9ffac70e-host-run-multus-certs\") pod \"multus-z5jzx\" (UID: \"37940097-f543-48ff-b5db-f04a9ffac70e\") " pod="openshift-multus/multus-z5jzx" Sep 09 23:03:52.063360 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.063050 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3feb7a98-2ac3-453c-8582-340db7bd6b89-var-lib-kubelet\") pod \"tuned-zkcwq\" (UID: \"3feb7a98-2ac3-453c-8582-340db7bd6b89\") " pod="openshift-cluster-node-tuning-operator/tuned-zkcwq" Sep 09 23:03:52.063360 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.063058 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3feb7a98-2ac3-453c-8582-340db7bd6b89-lib-modules\") pod \"tuned-zkcwq\" (UID: \"3feb7a98-2ac3-453c-8582-340db7bd6b89\") " pod="openshift-cluster-node-tuning-operator/tuned-zkcwq" Sep 09 23:03:52.063360 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.063069 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3feb7a98-2ac3-453c-8582-340db7bd6b89-etc-sysctl-d\") pod \"tuned-zkcwq\" (UID: \"3feb7a98-2ac3-453c-8582-340db7bd6b89\") " pod="openshift-cluster-node-tuning-operator/tuned-zkcwq" Sep 09 23:03:52.063360 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.063108 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/37940097-f543-48ff-b5db-f04a9ffac70e-host-var-lib-cni-multus\") pod \"multus-z5jzx\" (UID: \"37940097-f543-48ff-b5db-f04a9ffac70e\") " pod="openshift-multus/multus-z5jzx" Sep 09 23:03:52.063360 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.063110 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/37940097-f543-48ff-b5db-f04a9ffac70e-cnibin\") pod \"multus-z5jzx\" (UID: \"37940097-f543-48ff-b5db-f04a9ffac70e\") " pod="openshift-multus/multus-z5jzx" Sep 09 23:03:52.064244 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.063132 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8072e8a5-9862-4c4c-8cbc-5cb98d4b98c3-device-dir\") pod \"aws-ebs-csi-driver-node-l6zcg\" (UID: \"8072e8a5-9862-4c4c-8cbc-5cb98d4b98c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l6zcg" Sep 09 23:03:52.064244 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.063152 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/37940097-f543-48ff-b5db-f04a9ffac70e-etc-kubernetes\") pod \"multus-z5jzx\" (UID: \"37940097-f543-48ff-b5db-f04a9ffac70e\") " pod="openshift-multus/multus-z5jzx" Sep 09 23:03:52.064244 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.063155 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8072e8a5-9862-4c4c-8cbc-5cb98d4b98c3-etc-selinux\") pod \"aws-ebs-csi-driver-node-l6zcg\" (UID: \"8072e8a5-9862-4c4c-8cbc-5cb98d4b98c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l6zcg" Sep 09 23:03:52.064244 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.063179 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/37940097-f543-48ff-b5db-f04a9ffac70e-cni-binary-copy\") pod \"multus-z5jzx\" (UID: \"37940097-f543-48ff-b5db-f04a9ffac70e\") " pod="openshift-multus/multus-z5jzx" Sep 09 23:03:52.064244 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.063190 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b857k\" (UniqueName: \"kubernetes.io/projected/be92546e-2796-4680-9b67-4db0dd18a29b-kube-api-access-b857k\") pod \"network-metrics-daemon-5hnn9\" (UID: \"be92546e-2796-4680-9b67-4db0dd18a29b\") " pod="openshift-multus/network-metrics-daemon-5hnn9" Sep 09 23:03:52.064244 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.063225 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3feb7a98-2ac3-453c-8582-340db7bd6b89-host\") pod \"tuned-zkcwq\" (UID: \"3feb7a98-2ac3-453c-8582-340db7bd6b89\") " pod="openshift-cluster-node-tuning-operator/tuned-zkcwq" Sep 09 23:03:52.064244 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.063251 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8072e8a5-9862-4c4c-8cbc-5cb98d4b98c3-etc-selinux\") pod \"aws-ebs-csi-driver-node-l6zcg\" (UID: \"8072e8a5-9862-4c4c-8cbc-5cb98d4b98c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l6zcg" Sep 09 23:03:52.064244 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.063252 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgk6s\" (UniqueName: \"kubernetes.io/projected/3feb7a98-2ac3-453c-8582-340db7bd6b89-kube-api-access-fgk6s\") pod \"tuned-zkcwq\" (UID: \"3feb7a98-2ac3-453c-8582-340db7bd6b89\") " pod="openshift-cluster-node-tuning-operator/tuned-zkcwq" Sep 09 23:03:52.064244 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.063292 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qkpp\" (UniqueName: \"kubernetes.io/projected/37940097-f543-48ff-b5db-f04a9ffac70e-kube-api-access-4qkpp\") pod \"multus-z5jzx\" (UID: \"37940097-f543-48ff-b5db-f04a9ffac70e\") " pod="openshift-multus/multus-z5jzx" Sep 09 23:03:52.064244 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.063297 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3feb7a98-2ac3-453c-8582-340db7bd6b89-etc-modprobe-d\") pod \"tuned-zkcwq\" (UID: \"3feb7a98-2ac3-453c-8582-340db7bd6b89\") " pod="openshift-cluster-node-tuning-operator/tuned-zkcwq" Sep 09 23:03:52.064244 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.063320 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/37940097-f543-48ff-b5db-f04a9ffac70e-hostroot\") pod \"multus-z5jzx\" (UID: \"37940097-f543-48ff-b5db-f04a9ffac70e\") " pod="openshift-multus/multus-z5jzx" Sep 09 23:03:52.064244 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.063345 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/37940097-f543-48ff-b5db-f04a9ffac70e-multus-daemon-config\") pod \"multus-z5jzx\" (UID: \"37940097-f543-48ff-b5db-f04a9ffac70e\") " pod="openshift-multus/multus-z5jzx" Sep 09 23:03:52.064244 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.063368 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8072e8a5-9862-4c4c-8cbc-5cb98d4b98c3-registration-dir\") pod \"aws-ebs-csi-driver-node-l6zcg\" (UID: \"8072e8a5-9862-4c4c-8cbc-5cb98d4b98c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l6zcg" Sep 09 23:03:52.064244 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.063392 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8072e8a5-9862-4c4c-8cbc-5cb98d4b98c3-sys-fs\") pod \"aws-ebs-csi-driver-node-l6zcg\" (UID: \"8072e8a5-9862-4c4c-8cbc-5cb98d4b98c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l6zcg" Sep 09 23:03:52.064244 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.063415 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2cf4f0e4-e4dc-4953-87dd-f1ec9654c3cf-tmp-dir\") pod \"node-resolver-khhlr\" (UID: \"2cf4f0e4-e4dc-4953-87dd-f1ec9654c3cf\") " pod="openshift-dns/node-resolver-khhlr" Sep 09 23:03:52.064244 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.063439 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3feb7a98-2ac3-453c-8582-340db7bd6b89-etc-systemd\") pod \"tuned-zkcwq\" (UID: \"3feb7a98-2ac3-453c-8582-340db7bd6b89\") " pod="openshift-cluster-node-tuning-operator/tuned-zkcwq" Sep 09 23:03:52.064244 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.063463 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3feb7a98-2ac3-453c-8582-340db7bd6b89-sys\") pod \"tuned-zkcwq\" (UID: \"3feb7a98-2ac3-453c-8582-340db7bd6b89\") " pod="openshift-cluster-node-tuning-operator/tuned-zkcwq" Sep 09 23:03:52.064886 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.063486 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3feb7a98-2ac3-453c-8582-340db7bd6b89-etc-tuned\") pod \"tuned-zkcwq\" (UID: \"3feb7a98-2ac3-453c-8582-340db7bd6b89\") " pod="openshift-cluster-node-tuning-operator/tuned-zkcwq" Sep 09 23:03:52.064886 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.063507 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2cf4f0e4-e4dc-4953-87dd-f1ec9654c3cf-hosts-file\") pod \"node-resolver-khhlr\" (UID: \"2cf4f0e4-e4dc-4953-87dd-f1ec9654c3cf\") " pod="openshift-dns/node-resolver-khhlr" Sep 09 23:03:52.064886 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.063510 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/37940097-f543-48ff-b5db-f04a9ffac70e-host-run-k8s-cni-cncf-io\") pod \"multus-z5jzx\" (UID: \"37940097-f543-48ff-b5db-f04a9ffac70e\") " pod="openshift-multus/multus-z5jzx" Sep 09 23:03:52.064886 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.063552 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/37940097-f543-48ff-b5db-f04a9ffac70e-host-run-k8s-cni-cncf-io\") pod \"multus-z5jzx\" (UID: \"37940097-f543-48ff-b5db-f04a9ffac70e\") " pod="openshift-multus/multus-z5jzx" Sep 09 23:03:52.064886 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.063580 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8072e8a5-9862-4c4c-8cbc-5cb98d4b98c3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-l6zcg\" (UID: \"8072e8a5-9862-4c4c-8cbc-5cb98d4b98c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l6zcg" Sep 09 23:03:52.064886 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.063599 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/37940097-f543-48ff-b5db-f04a9ffac70e-system-cni-dir\") pod \"multus-z5jzx\" (UID: \"37940097-f543-48ff-b5db-f04a9ffac70e\") " pod="openshift-multus/multus-z5jzx" Sep 09 23:03:52.064886 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.063609 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/37940097-f543-48ff-b5db-f04a9ffac70e-host-var-lib-cni-bin\") pod \"multus-z5jzx\" (UID: \"37940097-f543-48ff-b5db-f04a9ffac70e\") " pod="openshift-multus/multus-z5jzx" Sep 09 23:03:52.064886 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.063599 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3feb7a98-2ac3-453c-8582-340db7bd6b89-etc-kubernetes\") pod \"tuned-zkcwq\" (UID: \"3feb7a98-2ac3-453c-8582-340db7bd6b89\") " pod="openshift-cluster-node-tuning-operator/tuned-zkcwq" Sep 09 23:03:52.064886 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.063024 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/37940097-f543-48ff-b5db-f04a9ffac70e-multus-cni-dir\") pod \"multus-z5jzx\" (UID: \"37940097-f543-48ff-b5db-f04a9ffac70e\") " pod="openshift-multus/multus-z5jzx" Sep 09 23:03:52.064886 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.063632 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8ed69f2d-7f79-4199-b3ea-9a7a73b02f6d-serviceca\") pod \"node-ca-5rtmc\" (UID: \"8ed69f2d-7f79-4199-b3ea-9a7a73b02f6d\") " pod="openshift-image-registry/node-ca-5rtmc" Sep 09 23:03:52.064886 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.063643 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3feb7a98-2ac3-453c-8582-340db7bd6b89-host\") pod \"tuned-zkcwq\" (UID: \"3feb7a98-2ac3-453c-8582-340db7bd6b89\") " pod="openshift-cluster-node-tuning-operator/tuned-zkcwq" Sep 09 23:03:52.064886 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.062944 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/37940097-f543-48ff-b5db-f04a9ffac70e-multus-conf-dir\") pod \"multus-z5jzx\" (UID: \"37940097-f543-48ff-b5db-f04a9ffac70e\") " pod="openshift-multus/multus-z5jzx" Sep 09 23:03:52.064886 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.063719 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8072e8a5-9862-4c4c-8cbc-5cb98d4b98c3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-l6zcg\" (UID: \"8072e8a5-9862-4c4c-8cbc-5cb98d4b98c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l6zcg" Sep 09 23:03:52.064886 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.063738 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3feb7a98-2ac3-453c-8582-340db7bd6b89-sys\") pod \"tuned-zkcwq\" (UID: \"3feb7a98-2ac3-453c-8582-340db7bd6b89\") " pod="openshift-cluster-node-tuning-operator/tuned-zkcwq" Sep 09 23:03:52.064886 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.063748 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3feb7a98-2ac3-453c-8582-340db7bd6b89-etc-sysctl-d\") pod \"tuned-zkcwq\" (UID: \"3feb7a98-2ac3-453c-8582-340db7bd6b89\") " pod="openshift-cluster-node-tuning-operator/tuned-zkcwq" Sep 09 23:03:52.064886 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.063755 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/37940097-f543-48ff-b5db-f04a9ffac70e-hostroot\") pod \"multus-z5jzx\" (UID: \"37940097-f543-48ff-b5db-f04a9ffac70e\") " pod="openshift-multus/multus-z5jzx" Sep 09 23:03:52.064886 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.063789 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/37940097-f543-48ff-b5db-f04a9ffac70e-host-var-lib-cni-bin\") pod \"multus-z5jzx\" (UID: \"37940097-f543-48ff-b5db-f04a9ffac70e\") " pod="openshift-multus/multus-z5jzx" Sep 09 23:03:52.064886 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.063941 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/37940097-f543-48ff-b5db-f04a9ffac70e-host-run-multus-certs\") pod \"multus-z5jzx\" (UID: \"37940097-f543-48ff-b5db-f04a9ffac70e\") " pod="openshift-multus/multus-z5jzx" Sep 09 23:03:52.065521 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.063949 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8072e8a5-9862-4c4c-8cbc-5cb98d4b98c3-sys-fs\") pod \"aws-ebs-csi-driver-node-l6zcg\" (UID: \"8072e8a5-9862-4c4c-8cbc-5cb98d4b98c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l6zcg" Sep 09 23:03:52.065521 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.063975 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/37940097-f543-48ff-b5db-f04a9ffac70e-host-var-lib-cni-multus\") pod \"multus-z5jzx\" (UID: \"37940097-f543-48ff-b5db-f04a9ffac70e\") " pod="openshift-multus/multus-z5jzx" Sep 09 23:03:52.065521 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.063999 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/37940097-f543-48ff-b5db-f04a9ffac70e-multus-socket-dir-parent\") pod \"multus-z5jzx\" (UID: \"37940097-f543-48ff-b5db-f04a9ffac70e\") " pod="openshift-multus/multus-z5jzx" Sep 09 23:03:52.065521 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.064018 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8072e8a5-9862-4c4c-8cbc-5cb98d4b98c3-device-dir\") pod \"aws-ebs-csi-driver-node-l6zcg\" (UID: \"8072e8a5-9862-4c4c-8cbc-5cb98d4b98c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l6zcg" Sep 09 23:03:52.065521 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.064025 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/37940097-f543-48ff-b5db-f04a9ffac70e-multus-daemon-config\") pod \"multus-z5jzx\" (UID: \"37940097-f543-48ff-b5db-f04a9ffac70e\") " pod="openshift-multus/multus-z5jzx" Sep 09 23:03:52.065521 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.064045 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8072e8a5-9862-4c4c-8cbc-5cb98d4b98c3-registration-dir\") pod \"aws-ebs-csi-driver-node-l6zcg\" (UID: \"8072e8a5-9862-4c4c-8cbc-5cb98d4b98c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l6zcg" Sep 09 23:03:52.065521 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.064085 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2cf4f0e4-e4dc-4953-87dd-f1ec9654c3cf-tmp-dir\") pod \"node-resolver-khhlr\" (UID: \"2cf4f0e4-e4dc-4953-87dd-f1ec9654c3cf\") " pod="openshift-dns/node-resolver-khhlr" Sep 09 23:03:52.065521 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.064087 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3feb7a98-2ac3-453c-8582-340db7bd6b89-etc-systemd\") pod \"tuned-zkcwq\" (UID: \"3feb7a98-2ac3-453c-8582-340db7bd6b89\") " pod="openshift-cluster-node-tuning-operator/tuned-zkcwq" Sep 09 23:03:52.065521 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.065307 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3feb7a98-2ac3-453c-8582-340db7bd6b89-tmp\") pod \"tuned-zkcwq\" (UID: \"3feb7a98-2ac3-453c-8582-340db7bd6b89\") " pod="openshift-cluster-node-tuning-operator/tuned-zkcwq" Sep 09 23:03:52.066024 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.066005 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3feb7a98-2ac3-453c-8582-340db7bd6b89-etc-tuned\") pod \"tuned-zkcwq\" (UID: \"3feb7a98-2ac3-453c-8582-340db7bd6b89\") " pod="openshift-cluster-node-tuning-operator/tuned-zkcwq" Sep 09 23:03:52.071438 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.071379 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgk6s\" (UniqueName: \"kubernetes.io/projected/3feb7a98-2ac3-453c-8582-340db7bd6b89-kube-api-access-fgk6s\") pod \"tuned-zkcwq\" (UID: \"3feb7a98-2ac3-453c-8582-340db7bd6b89\") " pod="openshift-cluster-node-tuning-operator/tuned-zkcwq" Sep 09 23:03:52.071438 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.071429 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bffhw\" (UniqueName: \"kubernetes.io/projected/8072e8a5-9862-4c4c-8cbc-5cb98d4b98c3-kube-api-access-bffhw\") pod \"aws-ebs-csi-driver-node-l6zcg\" (UID: \"8072e8a5-9862-4c4c-8cbc-5cb98d4b98c3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l6zcg" Sep 09 23:03:52.071957 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.071936 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bbmc\" (UniqueName: \"kubernetes.io/projected/2cf4f0e4-e4dc-4953-87dd-f1ec9654c3cf-kube-api-access-5bbmc\") pod \"node-resolver-khhlr\" (UID: \"2cf4f0e4-e4dc-4953-87dd-f1ec9654c3cf\") " pod="openshift-dns/node-resolver-khhlr" Sep 09 23:03:52.072101 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.072082 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctsb8\" (UniqueName: \"kubernetes.io/projected/8ed69f2d-7f79-4199-b3ea-9a7a73b02f6d-kube-api-access-ctsb8\") pod \"node-ca-5rtmc\" (UID: \"8ed69f2d-7f79-4199-b3ea-9a7a73b02f6d\") " pod="openshift-image-registry/node-ca-5rtmc" Sep 09 23:03:52.072158 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.072097 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b857k\" (UniqueName: \"kubernetes.io/projected/be92546e-2796-4680-9b67-4db0dd18a29b-kube-api-access-b857k\") pod \"network-metrics-daemon-5hnn9\" (UID: \"be92546e-2796-4680-9b67-4db0dd18a29b\") " pod="openshift-multus/network-metrics-daemon-5hnn9" Sep 09 23:03:52.072903 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.072884 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qkpp\" (UniqueName: \"kubernetes.io/projected/37940097-f543-48ff-b5db-f04a9ffac70e-kube-api-access-4qkpp\") pod \"multus-z5jzx\" (UID: \"37940097-f543-48ff-b5db-f04a9ffac70e\") " pod="openshift-multus/multus-z5jzx" Sep 09 23:03:52.146953 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.146910 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-x7m6c" Sep 09 23:03:52.156203 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.156170 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-l9fm4" Sep 09 23:03:52.166037 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.166012 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nvb6q" Sep 09 23:03:52.173819 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.173796 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6x9hk" Sep 09 23:03:52.182654 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.182628 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l6zcg" Sep 09 23:03:52.190537 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.190509 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zkcwq" Sep 09 23:03:52.197471 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.197441 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-z5jzx" Sep 09 23:03:52.204359 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.204330 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-khhlr" Sep 09 23:03:52.209094 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.209067 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5rtmc" Sep 09 23:03:52.465751 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.465710 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ce549cd8-0a7b-44b1-afdb-6d02adf85c7d-original-pull-secret\") pod \"global-pull-secret-syncer-6fdst\" (UID: \"ce549cd8-0a7b-44b1-afdb-6d02adf85c7d\") " pod="kube-system/global-pull-secret-syncer-6fdst" Sep 09 23:03:52.465933 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:03:52.465902 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 23:03:52.465990 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:03:52.465981 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce549cd8-0a7b-44b1-afdb-6d02adf85c7d-original-pull-secret podName:ce549cd8-0a7b-44b1-afdb-6d02adf85c7d nodeName:}" failed. No retries permitted until 2026-09-09 23:03:53.465959256 +0000 UTC m=+3.981690081 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ce549cd8-0a7b-44b1-afdb-6d02adf85c7d-original-pull-secret") pod "global-pull-secret-syncer-6fdst" (UID: "ce549cd8-0a7b-44b1-afdb-6d02adf85c7d") : object "kube-system"/"original-pull-secret" not registered Sep 09 23:03:52.566524 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.566495 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be92546e-2796-4680-9b67-4db0dd18a29b-metrics-certs\") pod \"network-metrics-daemon-5hnn9\" (UID: \"be92546e-2796-4680-9b67-4db0dd18a29b\") " pod="openshift-multus/network-metrics-daemon-5hnn9" Sep 09 23:03:52.566711 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.566556 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49qq8\" (UniqueName: \"kubernetes.io/projected/0416357e-69d3-4301-b431-2b39d7387267-kube-api-access-49qq8\") pod \"network-check-target-h2ql9\" (UID: \"0416357e-69d3-4301-b431-2b39d7387267\") " pod="openshift-network-diagnostics/network-check-target-h2ql9" Sep 09 23:03:52.566711 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:03:52.566664 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:03:52.566711 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:03:52.566703 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 23:03:52.566876 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:03:52.566719 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 23:03:52.566876 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:03:52.566728 2552 projected.go:196] Error preparing data for projected volume kube-api-access-49qq8 for pod openshift-network-diagnostics/network-check-target-h2ql9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:03:52.566876 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:03:52.566751 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be92546e-2796-4680-9b67-4db0dd18a29b-metrics-certs podName:be92546e-2796-4680-9b67-4db0dd18a29b nodeName:}" failed. No retries permitted until 2026-09-09 23:03:53.56673197 +0000 UTC m=+4.082462796 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/be92546e-2796-4680-9b67-4db0dd18a29b-metrics-certs") pod "network-metrics-daemon-5hnn9" (UID: "be92546e-2796-4680-9b67-4db0dd18a29b") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:03:52.566876 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:03:52.566772 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0416357e-69d3-4301-b431-2b39d7387267-kube-api-access-49qq8 podName:0416357e-69d3-4301-b431-2b39d7387267 nodeName:}" failed. No retries permitted until 2026-09-09 23:03:53.56676164 +0000 UTC m=+4.082492452 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-49qq8" (UniqueName: "kubernetes.io/projected/0416357e-69d3-4301-b431-2b39d7387267-kube-api-access-49qq8") pod "network-check-target-h2ql9" (UID: "0416357e-69d3-4301-b431-2b39d7387267") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:03:52.884581 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.884518 2552 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-08 22:58:51 +0000 UTC" deadline="2028-04-24 14:57:55.064384823 +0000 UTC" Sep 09 23:03:52.884581 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.884576 2552 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14223h54m2.179813248s" Sep 09 23:03:52.922315 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:52.922086 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4486a4c_3025_4d07_9d75_d9e774762c4f.slice/crio-e8de6b5a18575426ce0a0f3f865fcd8eb206ffc22656083cdb3225ee5afbaa9d WatchSource:0}: Error finding container e8de6b5a18575426ce0a0f3f865fcd8eb206ffc22656083cdb3225ee5afbaa9d: Status 404 returned error can't find the container with id e8de6b5a18575426ce0a0f3f865fcd8eb206ffc22656083cdb3225ee5afbaa9d Sep 09 23:03:52.926057 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:52.926035 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a516991_cc12_4e02_9916_b451d2ff4571.slice/crio-3a2527422acf9a028e00c64403826a47429e9e7b35b6db010a66c0075c5e4584 WatchSource:0}: Error finding container 3a2527422acf9a028e00c64403826a47429e9e7b35b6db010a66c0075c5e4584: Status 404 returned error can't find the container with id 3a2527422acf9a028e00c64403826a47429e9e7b35b6db010a66c0075c5e4584 Sep 09 23:03:52.929633 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:52.929539 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1b384a2_a59e_4bc1_88a1_64c6521d70fd.slice/crio-da0f75213ab40578fa3dd7930e76c61ac9df9116179f05f995cf59754a16f635 WatchSource:0}: Error finding container da0f75213ab40578fa3dd7930e76c61ac9df9116179f05f995cf59754a16f635: Status 404 returned error can't find the container with id da0f75213ab40578fa3dd7930e76c61ac9df9116179f05f995cf59754a16f635 Sep 09 23:03:52.931080 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:52.931025 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ed69f2d_7f79_4199_b3ea_9a7a73b02f6d.slice/crio-3f089c9b40e1fa59dbaacf96ac40bd143e617ad0cdf859b9c9513a859a89e4cc WatchSource:0}: Error finding container 3f089c9b40e1fa59dbaacf96ac40bd143e617ad0cdf859b9c9513a859a89e4cc: Status 404 returned error can't find the container with id 3f089c9b40e1fa59dbaacf96ac40bd143e617ad0cdf859b9c9513a859a89e4cc Sep 09 23:03:52.932408 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:52.931952 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f52574e_96c0_4939_9826_4959aeae1c8b.slice/crio-c833103d29624c111697bc66670d25066b7a52bb3e5d6aa1998a62ecdb2d7e4a WatchSource:0}: Error finding container c833103d29624c111697bc66670d25066b7a52bb3e5d6aa1998a62ecdb2d7e4a: Status 404 returned error can't find the container with id c833103d29624c111697bc66670d25066b7a52bb3e5d6aa1998a62ecdb2d7e4a Sep 09 23:03:52.933037 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:52.933011 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37940097_f543_48ff_b5db_f04a9ffac70e.slice/crio-a99124984dd13aa3ffd627712d5f6ebcebd52c968b65f9bf15c9664e91f043d2 WatchSource:0}: Error finding container a99124984dd13aa3ffd627712d5f6ebcebd52c968b65f9bf15c9664e91f043d2: Status 404 returned error can't find the container with id a99124984dd13aa3ffd627712d5f6ebcebd52c968b65f9bf15c9664e91f043d2 Sep 09 23:03:52.934489 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:52.934371 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3feb7a98_2ac3_453c_8582_340db7bd6b89.slice/crio-89d8f2991f3d78906dcb853666e8a55273336323b535ec28b3bbec34e827c524 WatchSource:0}: Error finding container 89d8f2991f3d78906dcb853666e8a55273336323b535ec28b3bbec34e827c524: Status 404 returned error can't find the container with id 89d8f2991f3d78906dcb853666e8a55273336323b535ec28b3bbec34e827c524 Sep 09 23:03:52.935293 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:03:52.935266 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8072e8a5_9862_4c4c_8cbc_5cb98d4b98c3.slice/crio-6217a8aad59ffe7f5fc7752b41116e7c5a21a0cb6d076482b23293abd75e2615 WatchSource:0}: Error finding container 6217a8aad59ffe7f5fc7752b41116e7c5a21a0cb6d076482b23293abd75e2615: Status 404 returned error can't find the container with id 6217a8aad59ffe7f5fc7752b41116e7c5a21a0cb6d076482b23293abd75e2615 Sep 09 23:03:52.942198 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.942167 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l6zcg" event={"ID":"8072e8a5-9862-4c4c-8cbc-5cb98d4b98c3","Type":"ContainerStarted","Data":"6217a8aad59ffe7f5fc7752b41116e7c5a21a0cb6d076482b23293abd75e2615"} Sep 09 23:03:52.943948 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.943920 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zkcwq" event={"ID":"3feb7a98-2ac3-453c-8582-340db7bd6b89","Type":"ContainerStarted","Data":"89d8f2991f3d78906dcb853666e8a55273336323b535ec28b3bbec34e827c524"} Sep 09 23:03:52.945142 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.945116 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-z5jzx" event={"ID":"37940097-f543-48ff-b5db-f04a9ffac70e","Type":"ContainerStarted","Data":"a99124984dd13aa3ffd627712d5f6ebcebd52c968b65f9bf15c9664e91f043d2"} Sep 09 23:03:52.947713 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.947685 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nvb6q" event={"ID":"c1b384a2-a59e-4bc1-88a1-64c6521d70fd","Type":"ContainerStarted","Data":"da0f75213ab40578fa3dd7930e76c61ac9df9116179f05f995cf59754a16f635"} Sep 09 23:03:52.949422 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.949399 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-x7m6c" event={"ID":"0a516991-cc12-4e02-9916-b451d2ff4571","Type":"ContainerStarted","Data":"3a2527422acf9a028e00c64403826a47429e9e7b35b6db010a66c0075c5e4584"} Sep 09 23:03:52.950542 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.950515 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l9fm4" event={"ID":"a4486a4c-3025-4d07-9d75-d9e774762c4f","Type":"ContainerStarted","Data":"e8de6b5a18575426ce0a0f3f865fcd8eb206ffc22656083cdb3225ee5afbaa9d"} Sep 09 23:03:52.952825 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.952802 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6x9hk" event={"ID":"2f52574e-96c0-4939-9826-4959aeae1c8b","Type":"ContainerStarted","Data":"c833103d29624c111697bc66670d25066b7a52bb3e5d6aa1998a62ecdb2d7e4a"} Sep 09 23:03:52.954097 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.954077 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5rtmc" event={"ID":"8ed69f2d-7f79-4199-b3ea-9a7a73b02f6d","Type":"ContainerStarted","Data":"3f089c9b40e1fa59dbaacf96ac40bd143e617ad0cdf859b9c9513a859a89e4cc"} Sep 09 23:03:52.955180 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:52.955163 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-khhlr" event={"ID":"2cf4f0e4-e4dc-4953-87dd-f1ec9654c3cf","Type":"ContainerStarted","Data":"09d22c80f871f70dc085548f223a82cd6f822a0cc2c35f327db863821f04fb44"} Sep 09 23:03:53.471937 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:53.471840 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ce549cd8-0a7b-44b1-afdb-6d02adf85c7d-original-pull-secret\") pod \"global-pull-secret-syncer-6fdst\" (UID: \"ce549cd8-0a7b-44b1-afdb-6d02adf85c7d\") " pod="kube-system/global-pull-secret-syncer-6fdst" Sep 09 23:03:53.472089 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:03:53.472024 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 23:03:53.472089 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:03:53.472084 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce549cd8-0a7b-44b1-afdb-6d02adf85c7d-original-pull-secret podName:ce549cd8-0a7b-44b1-afdb-6d02adf85c7d nodeName:}" failed. No retries permitted until 2026-09-09 23:03:55.472067683 +0000 UTC m=+5.987798505 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ce549cd8-0a7b-44b1-afdb-6d02adf85c7d-original-pull-secret") pod "global-pull-secret-syncer-6fdst" (UID: "ce549cd8-0a7b-44b1-afdb-6d02adf85c7d") : object "kube-system"/"original-pull-secret" not registered Sep 09 23:03:53.572704 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:53.572651 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49qq8\" (UniqueName: \"kubernetes.io/projected/0416357e-69d3-4301-b431-2b39d7387267-kube-api-access-49qq8\") pod \"network-check-target-h2ql9\" (UID: \"0416357e-69d3-4301-b431-2b39d7387267\") " pod="openshift-network-diagnostics/network-check-target-h2ql9" Sep 09 23:03:53.572889 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:53.572734 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be92546e-2796-4680-9b67-4db0dd18a29b-metrics-certs\") pod \"network-metrics-daemon-5hnn9\" (UID: \"be92546e-2796-4680-9b67-4db0dd18a29b\") " pod="openshift-multus/network-metrics-daemon-5hnn9" Sep 09 23:03:53.572889 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:03:53.572874 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:03:53.573002 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:03:53.572940 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be92546e-2796-4680-9b67-4db0dd18a29b-metrics-certs podName:be92546e-2796-4680-9b67-4db0dd18a29b nodeName:}" failed. No retries permitted until 2026-09-09 23:03:55.572920109 +0000 UTC m=+6.088650940 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/be92546e-2796-4680-9b67-4db0dd18a29b-metrics-certs") pod "network-metrics-daemon-5hnn9" (UID: "be92546e-2796-4680-9b67-4db0dd18a29b") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:03:53.573358 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:03:53.573337 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 23:03:53.573450 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:03:53.573366 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 23:03:53.573450 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:03:53.573379 2552 projected.go:196] Error preparing data for projected volume kube-api-access-49qq8 for pod openshift-network-diagnostics/network-check-target-h2ql9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:03:53.573450 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:03:53.573424 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0416357e-69d3-4301-b431-2b39d7387267-kube-api-access-49qq8 podName:0416357e-69d3-4301-b431-2b39d7387267 nodeName:}" failed. No retries permitted until 2026-09-09 23:03:55.573409259 +0000 UTC m=+6.089140089 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-49qq8" (UniqueName: "kubernetes.io/projected/0416357e-69d3-4301-b431-2b39d7387267-kube-api-access-49qq8") pod "network-check-target-h2ql9" (UID: "0416357e-69d3-4301-b431-2b39d7387267") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:03:53.885267 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:53.885200 2552 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-08 22:58:51 +0000 UTC" deadline="2028-04-05 01:36:43.582008283 +0000 UTC" Sep 09 23:03:53.885267 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:53.885261 2552 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13754h32m49.696751617s" Sep 09 23:03:53.935289 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:53.935254 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2ql9" Sep 09 23:03:53.935471 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:03:53.935392 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2ql9" podUID="0416357e-69d3-4301-b431-2b39d7387267" Sep 09 23:03:53.935816 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:53.935797 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6fdst" Sep 09 23:03:53.935917 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:03:53.935898 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6fdst" podUID="ce549cd8-0a7b-44b1-afdb-6d02adf85c7d" Sep 09 23:03:53.935985 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:53.935973 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5hnn9" Sep 09 23:03:53.936074 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:03:53.936058 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5hnn9" podUID="be92546e-2796-4680-9b67-4db0dd18a29b" Sep 09 23:03:53.970976 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:53.970933 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-217.ec2.internal" event={"ID":"5c308b40366a538734afec8835421dd2","Type":"ContainerStarted","Data":"9c502c168ba28822913346b53342aa7100e45ee675ec8797191d7b15f7c9fd3c"} Sep 09 23:03:53.984146 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:53.983766 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-217.ec2.internal" podStartSLOduration=2.983746463 podStartE2EDuration="2.983746463s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:03:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:03:53.983502027 +0000 UTC m=+4.499232855" watchObservedRunningTime="2026-09-09 23:03:53.983746463 +0000 UTC m=+4.499477293" Sep 09 23:03:53.989838 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:53.989802 2552 generic.go:356] "Generic (PLEG): container finished" podID="4688dd93c474da243a7e84ff2ba7d54e" containerID="b795095ead98d44b78f63a9167cc3228cc795827e8059a4bef3b686117234a9d" exitCode=0 Sep 09 23:03:53.990011 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:53.989865 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-217.ec2.internal" event={"ID":"4688dd93c474da243a7e84ff2ba7d54e","Type":"ContainerDied","Data":"b795095ead98d44b78f63a9167cc3228cc795827e8059a4bef3b686117234a9d"} Sep 09 23:03:55.004186 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:55.004152 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-217.ec2.internal" event={"ID":"4688dd93c474da243a7e84ff2ba7d54e","Type":"ContainerStarted","Data":"965c0587f0517604068b941cf6c22346be2f12121b97c2b8b6eecfcd2754018b"} Sep 09 23:03:55.499212 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:55.499167 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ce549cd8-0a7b-44b1-afdb-6d02adf85c7d-original-pull-secret\") pod \"global-pull-secret-syncer-6fdst\" (UID: \"ce549cd8-0a7b-44b1-afdb-6d02adf85c7d\") " pod="kube-system/global-pull-secret-syncer-6fdst" Sep 09 23:03:55.499399 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:03:55.499346 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 23:03:55.499483 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:03:55.499409 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce549cd8-0a7b-44b1-afdb-6d02adf85c7d-original-pull-secret podName:ce549cd8-0a7b-44b1-afdb-6d02adf85c7d nodeName:}" failed. No retries permitted until 2026-09-09 23:03:59.499390289 +0000 UTC m=+10.015121112 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ce549cd8-0a7b-44b1-afdb-6d02adf85c7d-original-pull-secret") pod "global-pull-secret-syncer-6fdst" (UID: "ce549cd8-0a7b-44b1-afdb-6d02adf85c7d") : object "kube-system"/"original-pull-secret" not registered Sep 09 23:03:55.599844 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:55.599798 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be92546e-2796-4680-9b67-4db0dd18a29b-metrics-certs\") pod \"network-metrics-daemon-5hnn9\" (UID: \"be92546e-2796-4680-9b67-4db0dd18a29b\") " pod="openshift-multus/network-metrics-daemon-5hnn9" Sep 09 23:03:55.600057 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:55.599900 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49qq8\" (UniqueName: \"kubernetes.io/projected/0416357e-69d3-4301-b431-2b39d7387267-kube-api-access-49qq8\") pod \"network-check-target-h2ql9\" (UID: \"0416357e-69d3-4301-b431-2b39d7387267\") " pod="openshift-network-diagnostics/network-check-target-h2ql9" Sep 09 23:03:55.600129 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:03:55.600078 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 23:03:55.600129 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:03:55.600103 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 23:03:55.600129 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:03:55.600116 2552 projected.go:196] Error preparing data for projected volume kube-api-access-49qq8 for pod openshift-network-diagnostics/network-check-target-h2ql9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:03:55.600273 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:03:55.600176 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0416357e-69d3-4301-b431-2b39d7387267-kube-api-access-49qq8 podName:0416357e-69d3-4301-b431-2b39d7387267 nodeName:}" failed. No retries permitted until 2026-09-09 23:03:59.600157709 +0000 UTC m=+10.115888536 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-49qq8" (UniqueName: "kubernetes.io/projected/0416357e-69d3-4301-b431-2b39d7387267-kube-api-access-49qq8") pod "network-check-target-h2ql9" (UID: "0416357e-69d3-4301-b431-2b39d7387267") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:03:55.600585 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:03:55.600566 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:03:55.600647 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:03:55.600625 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be92546e-2796-4680-9b67-4db0dd18a29b-metrics-certs podName:be92546e-2796-4680-9b67-4db0dd18a29b nodeName:}" failed. No retries permitted until 2026-09-09 23:03:59.60060792 +0000 UTC m=+10.116338745 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/be92546e-2796-4680-9b67-4db0dd18a29b-metrics-certs") pod "network-metrics-daemon-5hnn9" (UID: "be92546e-2796-4680-9b67-4db0dd18a29b") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:03:55.933930 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:55.933074 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5hnn9" Sep 09 23:03:55.933930 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:03:55.933215 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5hnn9" podUID="be92546e-2796-4680-9b67-4db0dd18a29b" Sep 09 23:03:55.933930 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:55.933653 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2ql9" Sep 09 23:03:55.933930 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:03:55.933763 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2ql9" podUID="0416357e-69d3-4301-b431-2b39d7387267" Sep 09 23:03:55.933930 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:55.933815 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6fdst" Sep 09 23:03:55.933930 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:03:55.933889 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6fdst" podUID="ce549cd8-0a7b-44b1-afdb-6d02adf85c7d" Sep 09 23:03:57.932416 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:57.932385 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6fdst" Sep 09 23:03:57.932917 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:57.932392 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5hnn9" Sep 09 23:03:57.932917 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:03:57.932511 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6fdst" podUID="ce549cd8-0a7b-44b1-afdb-6d02adf85c7d" Sep 09 23:03:57.932917 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:03:57.932692 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5hnn9" podUID="be92546e-2796-4680-9b67-4db0dd18a29b" Sep 09 23:03:57.932917 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:57.932736 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2ql9" Sep 09 23:03:57.932917 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:03:57.932893 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2ql9" podUID="0416357e-69d3-4301-b431-2b39d7387267" Sep 09 23:03:59.534436 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:59.534391 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ce549cd8-0a7b-44b1-afdb-6d02adf85c7d-original-pull-secret\") pod \"global-pull-secret-syncer-6fdst\" (UID: \"ce549cd8-0a7b-44b1-afdb-6d02adf85c7d\") " pod="kube-system/global-pull-secret-syncer-6fdst" Sep 09 23:03:59.534941 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:03:59.534547 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 23:03:59.534941 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:03:59.534633 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce549cd8-0a7b-44b1-afdb-6d02adf85c7d-original-pull-secret podName:ce549cd8-0a7b-44b1-afdb-6d02adf85c7d nodeName:}" failed. No retries permitted until 2026-09-09 23:04:07.534613496 +0000 UTC m=+18.050344328 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ce549cd8-0a7b-44b1-afdb-6d02adf85c7d-original-pull-secret") pod "global-pull-secret-syncer-6fdst" (UID: "ce549cd8-0a7b-44b1-afdb-6d02adf85c7d") : object "kube-system"/"original-pull-secret" not registered Sep 09 23:03:59.635097 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:59.635027 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be92546e-2796-4680-9b67-4db0dd18a29b-metrics-certs\") pod \"network-metrics-daemon-5hnn9\" (UID: \"be92546e-2796-4680-9b67-4db0dd18a29b\") " pod="openshift-multus/network-metrics-daemon-5hnn9" Sep 09 23:03:59.635277 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:59.635116 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49qq8\" (UniqueName: \"kubernetes.io/projected/0416357e-69d3-4301-b431-2b39d7387267-kube-api-access-49qq8\") pod \"network-check-target-h2ql9\" (UID: \"0416357e-69d3-4301-b431-2b39d7387267\") " pod="openshift-network-diagnostics/network-check-target-h2ql9" Sep 09 23:03:59.635358 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:03:59.635279 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:03:59.635358 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:03:59.635343 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 23:03:59.635464 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:03:59.635358 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be92546e-2796-4680-9b67-4db0dd18a29b-metrics-certs podName:be92546e-2796-4680-9b67-4db0dd18a29b nodeName:}" failed. No retries permitted until 2026-09-09 23:04:07.635337943 +0000 UTC m=+18.151068766 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/be92546e-2796-4680-9b67-4db0dd18a29b-metrics-certs") pod "network-metrics-daemon-5hnn9" (UID: "be92546e-2796-4680-9b67-4db0dd18a29b") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:03:59.635464 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:03:59.635363 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 23:03:59.635464 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:03:59.635378 2552 projected.go:196] Error preparing data for projected volume kube-api-access-49qq8 for pod openshift-network-diagnostics/network-check-target-h2ql9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:03:59.635464 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:03:59.635427 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0416357e-69d3-4301-b431-2b39d7387267-kube-api-access-49qq8 podName:0416357e-69d3-4301-b431-2b39d7387267 nodeName:}" failed. No retries permitted until 2026-09-09 23:04:07.635412379 +0000 UTC m=+18.151143197 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-49qq8" (UniqueName: "kubernetes.io/projected/0416357e-69d3-4301-b431-2b39d7387267-kube-api-access-49qq8") pod "network-check-target-h2ql9" (UID: "0416357e-69d3-4301-b431-2b39d7387267") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:03:59.934368 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:59.934127 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2ql9" Sep 09 23:03:59.934535 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:59.934127 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6fdst" Sep 09 23:03:59.934535 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:03:59.934459 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2ql9" podUID="0416357e-69d3-4301-b431-2b39d7387267" Sep 09 23:03:59.934750 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:03:59.934562 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6fdst" podUID="ce549cd8-0a7b-44b1-afdb-6d02adf85c7d" Sep 09 23:03:59.934750 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:03:59.934143 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5hnn9" Sep 09 23:03:59.934750 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:03:59.934664 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5hnn9" podUID="be92546e-2796-4680-9b67-4db0dd18a29b" Sep 09 23:04:01.933644 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:01.933125 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6fdst" Sep 09 23:04:01.933644 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:01.933171 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5hnn9" Sep 09 23:04:01.933644 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:01.933250 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2ql9" Sep 09 23:04:01.933644 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:04:01.933267 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6fdst" podUID="ce549cd8-0a7b-44b1-afdb-6d02adf85c7d" Sep 09 23:04:01.934804 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:04:01.934608 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2ql9" podUID="0416357e-69d3-4301-b431-2b39d7387267" Sep 09 23:04:01.934804 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:04:01.934754 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5hnn9" podUID="be92546e-2796-4680-9b67-4db0dd18a29b" Sep 09 23:04:03.932801 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:03.932764 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6fdst" Sep 09 23:04:03.933248 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:03.932764 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2ql9" Sep 09 23:04:03.933248 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:04:03.932897 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6fdst" podUID="ce549cd8-0a7b-44b1-afdb-6d02adf85c7d" Sep 09 23:04:03.933248 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:04:03.933016 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2ql9" podUID="0416357e-69d3-4301-b431-2b39d7387267" Sep 09 23:04:03.933248 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:03.933076 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5hnn9" Sep 09 23:04:03.933248 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:04:03.933171 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5hnn9" podUID="be92546e-2796-4680-9b67-4db0dd18a29b" Sep 09 23:04:05.932924 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:05.932891 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6fdst" Sep 09 23:04:05.933372 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:05.932891 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5hnn9" Sep 09 23:04:05.933372 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:04:05.933014 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6fdst" podUID="ce549cd8-0a7b-44b1-afdb-6d02adf85c7d" Sep 09 23:04:05.933372 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:05.933028 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2ql9" Sep 09 23:04:05.933372 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:04:05.933152 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5hnn9" podUID="be92546e-2796-4680-9b67-4db0dd18a29b" Sep 09 23:04:05.933372 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:04:05.933240 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2ql9" podUID="0416357e-69d3-4301-b431-2b39d7387267" Sep 09 23:04:07.591053 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:07.591010 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ce549cd8-0a7b-44b1-afdb-6d02adf85c7d-original-pull-secret\") pod \"global-pull-secret-syncer-6fdst\" (UID: \"ce549cd8-0a7b-44b1-afdb-6d02adf85c7d\") " pod="kube-system/global-pull-secret-syncer-6fdst" Sep 09 23:04:07.591506 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:04:07.591183 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 23:04:07.591506 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:04:07.591265 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce549cd8-0a7b-44b1-afdb-6d02adf85c7d-original-pull-secret podName:ce549cd8-0a7b-44b1-afdb-6d02adf85c7d nodeName:}" failed. No retries permitted until 2026-09-09 23:04:23.591243568 +0000 UTC m=+34.106974381 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ce549cd8-0a7b-44b1-afdb-6d02adf85c7d-original-pull-secret") pod "global-pull-secret-syncer-6fdst" (UID: "ce549cd8-0a7b-44b1-afdb-6d02adf85c7d") : object "kube-system"/"original-pull-secret" not registered Sep 09 23:04:07.692040 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:07.691994 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be92546e-2796-4680-9b67-4db0dd18a29b-metrics-certs\") pod \"network-metrics-daemon-5hnn9\" (UID: \"be92546e-2796-4680-9b67-4db0dd18a29b\") " pod="openshift-multus/network-metrics-daemon-5hnn9" Sep 09 23:04:07.692227 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:07.692087 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49qq8\" (UniqueName: \"kubernetes.io/projected/0416357e-69d3-4301-b431-2b39d7387267-kube-api-access-49qq8\") pod \"network-check-target-h2ql9\" (UID: \"0416357e-69d3-4301-b431-2b39d7387267\") " pod="openshift-network-diagnostics/network-check-target-h2ql9" Sep 09 23:04:07.692227 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:04:07.692161 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:04:07.692227 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:04:07.692202 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 23:04:07.692227 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:04:07.692226 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 23:04:07.692445 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:04:07.692236 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be92546e-2796-4680-9b67-4db0dd18a29b-metrics-certs podName:be92546e-2796-4680-9b67-4db0dd18a29b nodeName:}" failed. No retries permitted until 2026-09-09 23:04:23.692214821 +0000 UTC m=+34.207945636 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/be92546e-2796-4680-9b67-4db0dd18a29b-metrics-certs") pod "network-metrics-daemon-5hnn9" (UID: "be92546e-2796-4680-9b67-4db0dd18a29b") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:04:07.692445 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:04:07.692238 2552 projected.go:196] Error preparing data for projected volume kube-api-access-49qq8 for pod openshift-network-diagnostics/network-check-target-h2ql9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:04:07.692445 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:04:07.692272 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0416357e-69d3-4301-b431-2b39d7387267-kube-api-access-49qq8 podName:0416357e-69d3-4301-b431-2b39d7387267 nodeName:}" failed. No retries permitted until 2026-09-09 23:04:23.692266027 +0000 UTC m=+34.207996835 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-49qq8" (UniqueName: "kubernetes.io/projected/0416357e-69d3-4301-b431-2b39d7387267-kube-api-access-49qq8") pod "network-check-target-h2ql9" (UID: "0416357e-69d3-4301-b431-2b39d7387267") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:04:07.932384 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:07.932349 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2ql9" Sep 09 23:04:07.932558 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:07.932349 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6fdst" Sep 09 23:04:07.932558 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:04:07.932479 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2ql9" podUID="0416357e-69d3-4301-b431-2b39d7387267" Sep 09 23:04:07.932558 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:07.932539 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5hnn9" Sep 09 23:04:07.932747 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:04:07.932644 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6fdst" podUID="ce549cd8-0a7b-44b1-afdb-6d02adf85c7d" Sep 09 23:04:07.932800 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:04:07.932747 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5hnn9" podUID="be92546e-2796-4680-9b67-4db0dd18a29b" Sep 09 23:04:09.933378 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:09.933339 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2ql9" Sep 09 23:04:09.933860 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:09.933455 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6fdst" Sep 09 23:04:09.933860 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:04:09.933470 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2ql9" podUID="0416357e-69d3-4301-b431-2b39d7387267" Sep 09 23:04:09.933860 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:09.933585 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5hnn9" Sep 09 23:04:09.933860 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:04:09.933580 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6fdst" podUID="ce549cd8-0a7b-44b1-afdb-6d02adf85c7d" Sep 09 23:04:09.933860 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:04:09.933707 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5hnn9" podUID="be92546e-2796-4680-9b67-4db0dd18a29b" Sep 09 23:04:11.040453 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:11.040415 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5rtmc" event={"ID":"8ed69f2d-7f79-4199-b3ea-9a7a73b02f6d","Type":"ContainerStarted","Data":"6578f8e36f54f15a1a1db43dc69c2c920d705806214f061a19d1f993f200eead"} Sep 09 23:04:11.041901 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:11.041875 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-khhlr" event={"ID":"2cf4f0e4-e4dc-4953-87dd-f1ec9654c3cf","Type":"ContainerStarted","Data":"3d1938dbe1c120795159ba7537c4fa4ef0bbc2e997165975f03a2e3535d49ec8"} Sep 09 23:04:11.046562 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:11.043870 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l6zcg" event={"ID":"8072e8a5-9862-4c4c-8cbc-5cb98d4b98c3","Type":"ContainerStarted","Data":"69dff640657687018d4089d79847eb34231df949fd2d440d3078f175dfdfbd60"} Sep 09 23:04:11.046562 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:11.046029 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zkcwq" event={"ID":"3feb7a98-2ac3-453c-8582-340db7bd6b89","Type":"ContainerStarted","Data":"e892e0d06fdde71cc08d3db2196dae723eef6669293922dd830a6aee518e93a3"} Sep 09 23:04:11.048082 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:11.048014 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-x7m6c" event={"ID":"0a516991-cc12-4e02-9916-b451d2ff4571","Type":"ContainerStarted","Data":"7fdf2fb41a879dcdd014a190785dc3a9283e3907446278677d0bfebe4e1b5702"} Sep 09 23:04:11.050267 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:11.050210 2552 generic.go:356] "Generic (PLEG): container finished" podID="a4486a4c-3025-4d07-9d75-d9e774762c4f" containerID="d2a190475e04083e4d2ffe943fff92ad5fc139d758ac09797fa788c723228866" exitCode=0 Sep 09 23:04:11.050375 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:11.050289 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l9fm4" event={"ID":"a4486a4c-3025-4d07-9d75-d9e774762c4f","Type":"ContainerDied","Data":"d2a190475e04083e4d2ffe943fff92ad5fc139d758ac09797fa788c723228866"} Sep 09 23:04:11.053007 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:11.052974 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6x9hk" event={"ID":"2f52574e-96c0-4939-9826-4959aeae1c8b","Type":"ContainerStarted","Data":"c9bb70bef8614cacc68f42a8266d8d8e7997921a4614258f90b8c09b45ced025"} Sep 09 23:04:11.060215 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:11.060170 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-5rtmc" podStartSLOduration=3.34389741 podStartE2EDuration="21.060155285s" totalImagesPullingTime="17.716257875s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:03:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:04:11.059969776 +0000 UTC m=+21.575700606" watchObservedRunningTime="2026-09-09 23:04:11.060155285 +0000 UTC m=+21.575886115" Sep 09 23:04:11.060358 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:11.060253 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-217.ec2.internal" podStartSLOduration=20.060247711 podStartE2EDuration="20.060247711s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:03:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:03:55.018377856 +0000 UTC m=+5.534108687" watchObservedRunningTime="2026-09-09 23:04:11.060247711 +0000 UTC m=+21.575978543" Sep 09 23:04:11.074262 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:11.074220 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-x7m6c" podStartSLOduration=3.403207327 podStartE2EDuration="21.074204316s" totalImagesPullingTime="17.670996989s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:03:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:04:11.073760736 +0000 UTC m=+21.589491567" watchObservedRunningTime="2026-09-09 23:04:11.074204316 +0000 UTC m=+21.589935147" Sep 09 23:04:11.088260 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:11.088210 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-khhlr" podStartSLOduration=3.363227139 podStartE2EDuration="21.08819449s" totalImagesPullingTime="17.724967351s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:03:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:04:11.087640216 +0000 UTC m=+21.603371047" watchObservedRunningTime="2026-09-09 23:04:11.08819449 +0000 UTC m=+21.603925320" Sep 09 23:04:11.136819 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:11.136773 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-zkcwq" podStartSLOduration=3.422466776 podStartE2EDuration="21.13675694s" totalImagesPullingTime="17.714290164s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:03:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:04:11.136308582 +0000 UTC m=+21.652039413" watchObservedRunningTime="2026-09-09 23:04:11.13675694 +0000 UTC m=+21.652487770" Sep 09 23:04:11.933559 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:11.932942 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2ql9" Sep 09 23:04:11.933559 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:11.932939 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6fdst" Sep 09 23:04:11.933559 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:04:11.933288 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2ql9" podUID="0416357e-69d3-4301-b431-2b39d7387267" Sep 09 23:04:11.933559 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:04:11.933393 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6fdst" podUID="ce549cd8-0a7b-44b1-afdb-6d02adf85c7d" Sep 09 23:04:11.933559 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:11.933059 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5hnn9" Sep 09 23:04:11.933559 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:04:11.933509 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5hnn9" podUID="be92546e-2796-4680-9b67-4db0dd18a29b" Sep 09 23:04:12.057304 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:12.057216 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-z5jzx" event={"ID":"37940097-f543-48ff-b5db-f04a9ffac70e","Type":"ContainerStarted","Data":"7343b819777fad96e0fe6c82afac43493c8f53fc6e42731ea967affedd273ef4"} Sep 09 23:04:12.060736 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:12.060712 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6x9hk_2f52574e-96c0-4939-9826-4959aeae1c8b/ovn-acl-logging/0.log" Sep 09 23:04:12.061138 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:12.061116 2552 generic.go:356] "Generic (PLEG): container finished" podID="2f52574e-96c0-4939-9826-4959aeae1c8b" containerID="5c3615ac9320c4032ef419631cf7a58d457de25b557e155588666eea28ac1b71" exitCode=1 Sep 09 23:04:12.061254 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:12.061232 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6x9hk" event={"ID":"2f52574e-96c0-4939-9826-4959aeae1c8b","Type":"ContainerStarted","Data":"068c832d1f035263585e00c70770113d131ba5f0816a092db04b25f2789e3394"} Sep 09 23:04:12.061355 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:12.061332 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6x9hk" event={"ID":"2f52574e-96c0-4939-9826-4959aeae1c8b","Type":"ContainerStarted","Data":"42bba530fdb8b9357325ce36d3c80edaeccabe4789d4f1eb0edc96a49f0d73a0"} Sep 09 23:04:12.061468 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:12.061388 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6x9hk" event={"ID":"2f52574e-96c0-4939-9826-4959aeae1c8b","Type":"ContainerStarted","Data":"0dfef7c58f03b5ccfa676f0811c6b964d9a3d53ba3e7d5c2261fcbf8a100560b"} Sep 09 23:04:12.061468 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:12.061441 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6x9hk" event={"ID":"2f52574e-96c0-4939-9826-4959aeae1c8b","Type":"ContainerStarted","Data":"bfa34276fda971bd366e067bd2008a8ea3c1dca3a6c7cb782450e722e4d9b67f"} Sep 09 23:04:12.061589 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:12.061488 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6x9hk" event={"ID":"2f52574e-96c0-4939-9826-4959aeae1c8b","Type":"ContainerDied","Data":"5c3615ac9320c4032ef419631cf7a58d457de25b557e155588666eea28ac1b71"} Sep 09 23:04:12.073531 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:12.073481 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-z5jzx" podStartSLOduration=3.841003787 podStartE2EDuration="22.073462642s" totalImagesPullingTime="18.232458855s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:03:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:04:12.073346622 +0000 UTC m=+22.589077454" watchObservedRunningTime="2026-09-09 23:04:12.073462642 +0000 UTC m=+22.589193509" Sep 09 23:04:12.438426 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:12.438252 2552 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 09 23:04:12.567581 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:12.567477 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-x7m6c" Sep 09 23:04:12.568165 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:12.568149 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-x7m6c" Sep 09 23:04:12.922453 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:12.922326 2552 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-09T23:04:12.438418479Z","UUID":"aa50e9c4-b25d-4a74-9a9a-8eb0fc930ba4","Handler":null,"Name":"","Endpoint":""} Sep 09 23:04:12.924467 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:12.924445 2552 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 09 23:04:12.924605 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:12.924477 2552 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 09 23:04:13.066488 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:13.066446 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l6zcg" event={"ID":"8072e8a5-9862-4c4c-8cbc-5cb98d4b98c3","Type":"ContainerStarted","Data":"38850323bad1bf748cbe425a5baf22468c5a554de06ed6b60572329782bde281"} Sep 09 23:04:13.068415 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:13.068379 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nvb6q" event={"ID":"c1b384a2-a59e-4bc1-88a1-64c6521d70fd","Type":"ContainerStarted","Data":"ab910e71faf3328af1a75a6b1d22e355faf5d8f55debcb9d8bffafbda473e794"} Sep 09 23:04:13.068766 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:13.068746 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-x7m6c" Sep 09 23:04:13.069403 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:13.069384 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-x7m6c" Sep 09 23:04:13.085481 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:13.085109 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-nvb6q" podStartSLOduration=5.367741784 podStartE2EDuration="23.085087538s" totalImagesPullingTime="17.717345754s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:03:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:04:13.084740864 +0000 UTC m=+23.600471689" watchObservedRunningTime="2026-09-09 23:04:13.085087538 +0000 UTC m=+23.600818370" Sep 09 23:04:13.933395 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:13.933365 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2ql9" Sep 09 23:04:13.933582 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:13.933440 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5hnn9" Sep 09 23:04:13.933582 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:13.933551 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6fdst" Sep 09 23:04:13.933582 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:04:13.933563 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5hnn9" podUID="be92546e-2796-4680-9b67-4db0dd18a29b" Sep 09 23:04:13.933752 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:04:13.933614 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2ql9" podUID="0416357e-69d3-4301-b431-2b39d7387267" Sep 09 23:04:13.933752 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:04:13.933708 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6fdst" podUID="ce549cd8-0a7b-44b1-afdb-6d02adf85c7d" Sep 09 23:04:14.076304 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:14.076272 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6x9hk_2f52574e-96c0-4939-9826-4959aeae1c8b/ovn-acl-logging/0.log" Sep 09 23:04:14.076831 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:14.076800 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6x9hk" event={"ID":"2f52574e-96c0-4939-9826-4959aeae1c8b","Type":"ContainerStarted","Data":"e6c2687d663f4dc6eefde1be1797823c04c39aaf7ce8027c1450b466b64127ce"} Sep 09 23:04:14.079126 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:14.079098 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l6zcg" event={"ID":"8072e8a5-9862-4c4c-8cbc-5cb98d4b98c3","Type":"ContainerStarted","Data":"7add5150bfbf193060846e8a303f4e99670764f3be1b5bb3152e9d48dbc9d868"} Sep 09 23:04:15.933022 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:15.932958 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2ql9" Sep 09 23:04:15.933546 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:15.932960 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6fdst" Sep 09 23:04:15.933546 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:04:15.933095 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2ql9" podUID="0416357e-69d3-4301-b431-2b39d7387267" Sep 09 23:04:15.933546 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:15.932970 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5hnn9" Sep 09 23:04:15.933546 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:04:15.933171 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6fdst" podUID="ce549cd8-0a7b-44b1-afdb-6d02adf85c7d" Sep 09 23:04:15.933546 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:04:15.933298 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5hnn9" podUID="be92546e-2796-4680-9b67-4db0dd18a29b" Sep 09 23:04:16.087837 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:16.087603 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6x9hk_2f52574e-96c0-4939-9826-4959aeae1c8b/ovn-acl-logging/0.log" Sep 09 23:04:16.088180 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:16.088156 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6x9hk" event={"ID":"2f52574e-96c0-4939-9826-4959aeae1c8b","Type":"ContainerStarted","Data":"89fee2b648e8898b8bffdf0a653f390d340cd3bbf8194252ca81af384d017e04"} Sep 09 23:04:16.088477 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:16.088450 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6x9hk" Sep 09 23:04:16.088608 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:16.088533 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6x9hk" Sep 09 23:04:16.088693 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:16.088661 2552 scope.go:117] "RemoveContainer" containerID="5c3615ac9320c4032ef419631cf7a58d457de25b557e155588666eea28ac1b71" Sep 09 23:04:16.105656 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:16.105635 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6x9hk" Sep 09 23:04:16.106270 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:16.106245 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6x9hk" Sep 09 23:04:16.112982 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:16.112926 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l6zcg" podStartSLOduration=5.980419261 podStartE2EDuration="26.112902809s" totalImagesPullingTime="20.132483548s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:03:50 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:04:14.103161418 +0000 UTC m=+24.618892248" watchObservedRunningTime="2026-09-09 23:04:16.112902809 +0000 UTC m=+26.628633639" Sep 09 23:04:17.091959 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:17.091876 2552 generic.go:356] "Generic (PLEG): container finished" podID="a4486a4c-3025-4d07-9d75-d9e774762c4f" containerID="7d4734cf49b5745f66504727a9e4c5fe009953e25d2340423d643d215af5d033" exitCode=0 Sep 09 23:04:17.092650 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:17.091972 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l9fm4" event={"ID":"a4486a4c-3025-4d07-9d75-d9e774762c4f","Type":"ContainerDied","Data":"7d4734cf49b5745f66504727a9e4c5fe009953e25d2340423d643d215af5d033"} Sep 09 23:04:17.098974 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:17.098954 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6x9hk_2f52574e-96c0-4939-9826-4959aeae1c8b/ovn-acl-logging/0.log" Sep 09 23:04:17.099406 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:17.099368 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6x9hk" event={"ID":"2f52574e-96c0-4939-9826-4959aeae1c8b","Type":"ContainerStarted","Data":"88e6b0929f70bd8b23b17ce438ed6d09ab24f9206af57f6a20e074848616fb4f"} Sep 09 23:04:17.099517 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:17.099493 2552 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 09 23:04:17.134897 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:17.134830 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-6x9hk" podStartSLOduration=9.403168902 podStartE2EDuration="27.134805921s" totalImagesPullingTime="17.731637019s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:03:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:04:17.133893654 +0000 UTC m=+27.649624484" watchObservedRunningTime="2026-09-09 23:04:17.134805921 +0000 UTC m=+27.650536752" Sep 09 23:04:17.788108 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:17.788073 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6fdst"] Sep 09 23:04:17.788288 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:17.788217 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6fdst" Sep 09 23:04:17.788356 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:04:17.788333 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6fdst" podUID="ce549cd8-0a7b-44b1-afdb-6d02adf85c7d" Sep 09 23:04:17.788936 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:17.788897 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-h2ql9"] Sep 09 23:04:17.789042 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:17.789017 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2ql9" Sep 09 23:04:17.789169 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:04:17.789116 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2ql9" podUID="0416357e-69d3-4301-b431-2b39d7387267" Sep 09 23:04:17.790299 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:17.790276 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5hnn9"] Sep 09 23:04:17.790430 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:17.790372 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5hnn9" Sep 09 23:04:17.790490 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:04:17.790474 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5hnn9" podUID="be92546e-2796-4680-9b67-4db0dd18a29b" Sep 09 23:04:18.101478 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:18.101448 2552 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 09 23:04:19.058329 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:19.058136 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6x9hk" Sep 09 23:04:19.106082 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:19.106048 2552 generic.go:356] "Generic (PLEG): container finished" podID="a4486a4c-3025-4d07-9d75-d9e774762c4f" containerID="598a108de86ccec9492352c548dc674cd4dbe894065dc771eb07405773e5eb55" exitCode=0 Sep 09 23:04:19.106525 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:19.106131 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l9fm4" event={"ID":"a4486a4c-3025-4d07-9d75-d9e774762c4f","Type":"ContainerDied","Data":"598a108de86ccec9492352c548dc674cd4dbe894065dc771eb07405773e5eb55"} Sep 09 23:04:19.934050 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:19.933998 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2ql9" Sep 09 23:04:19.934254 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:19.934120 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6fdst" Sep 09 23:04:19.934254 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:19.934181 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5hnn9" Sep 09 23:04:19.934254 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:04:19.934164 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2ql9" podUID="0416357e-69d3-4301-b431-2b39d7387267" Sep 09 23:04:19.934419 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:04:19.934290 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5hnn9" podUID="be92546e-2796-4680-9b67-4db0dd18a29b" Sep 09 23:04:19.934419 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:04:19.934378 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6fdst" podUID="ce549cd8-0a7b-44b1-afdb-6d02adf85c7d" Sep 09 23:04:21.113392 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:21.113358 2552 generic.go:356] "Generic (PLEG): container finished" podID="a4486a4c-3025-4d07-9d75-d9e774762c4f" containerID="ba53f3cf48d74d1cab5792c9d3f33df74345f2dd3d44d6e204eced3fcdba6caa" exitCode=0 Sep 09 23:04:21.113791 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:21.113423 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l9fm4" event={"ID":"a4486a4c-3025-4d07-9d75-d9e774762c4f","Type":"ContainerDied","Data":"ba53f3cf48d74d1cab5792c9d3f33df74345f2dd3d44d6e204eced3fcdba6caa"} Sep 09 23:04:21.932411 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:21.932371 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2ql9" Sep 09 23:04:21.932598 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:21.932421 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5hnn9" Sep 09 23:04:21.932598 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:21.932386 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6fdst" Sep 09 23:04:21.932598 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:04:21.932510 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2ql9" podUID="0416357e-69d3-4301-b431-2b39d7387267" Sep 09 23:04:21.932598 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:04:21.932575 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6fdst" podUID="ce549cd8-0a7b-44b1-afdb-6d02adf85c7d" Sep 09 23:04:21.932823 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:04:21.932715 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5hnn9" podUID="be92546e-2796-4680-9b67-4db0dd18a29b" Sep 09 23:04:23.604915 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:23.604849 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ce549cd8-0a7b-44b1-afdb-6d02adf85c7d-original-pull-secret\") pod \"global-pull-secret-syncer-6fdst\" (UID: \"ce549cd8-0a7b-44b1-afdb-6d02adf85c7d\") " pod="kube-system/global-pull-secret-syncer-6fdst" Sep 09 23:04:23.605307 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:04:23.604997 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 23:04:23.605307 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:04:23.605058 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce549cd8-0a7b-44b1-afdb-6d02adf85c7d-original-pull-secret podName:ce549cd8-0a7b-44b1-afdb-6d02adf85c7d nodeName:}" failed. No retries permitted until 2026-09-09 23:04:55.605041576 +0000 UTC m=+66.120772407 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ce549cd8-0a7b-44b1-afdb-6d02adf85c7d-original-pull-secret") pod "global-pull-secret-syncer-6fdst" (UID: "ce549cd8-0a7b-44b1-afdb-6d02adf85c7d") : object "kube-system"/"original-pull-secret" not registered Sep 09 23:04:23.705686 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:23.705647 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49qq8\" (UniqueName: \"kubernetes.io/projected/0416357e-69d3-4301-b431-2b39d7387267-kube-api-access-49qq8\") pod \"network-check-target-h2ql9\" (UID: \"0416357e-69d3-4301-b431-2b39d7387267\") " pod="openshift-network-diagnostics/network-check-target-h2ql9" Sep 09 23:04:23.705886 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:23.705724 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be92546e-2796-4680-9b67-4db0dd18a29b-metrics-certs\") pod \"network-metrics-daemon-5hnn9\" (UID: \"be92546e-2796-4680-9b67-4db0dd18a29b\") " pod="openshift-multus/network-metrics-daemon-5hnn9" Sep 09 23:04:23.705886 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:04:23.705826 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 23:04:23.705886 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:04:23.705857 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 23:04:23.705886 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:04:23.705867 2552 projected.go:196] Error preparing data for projected volume kube-api-access-49qq8 for pod openshift-network-diagnostics/network-check-target-h2ql9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:04:23.706074 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:04:23.705915 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0416357e-69d3-4301-b431-2b39d7387267-kube-api-access-49qq8 podName:0416357e-69d3-4301-b431-2b39d7387267 nodeName:}" failed. No retries permitted until 2026-09-09 23:04:55.705899919 +0000 UTC m=+66.221630727 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-49qq8" (UniqueName: "kubernetes.io/projected/0416357e-69d3-4301-b431-2b39d7387267-kube-api-access-49qq8") pod "network-check-target-h2ql9" (UID: "0416357e-69d3-4301-b431-2b39d7387267") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:04:23.706074 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:04:23.705836 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:04:23.706074 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:04:23.705995 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be92546e-2796-4680-9b67-4db0dd18a29b-metrics-certs podName:be92546e-2796-4680-9b67-4db0dd18a29b nodeName:}" failed. No retries permitted until 2026-09-09 23:04:55.705975766 +0000 UTC m=+66.221706580 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/be92546e-2796-4680-9b67-4db0dd18a29b-metrics-certs") pod "network-metrics-daemon-5hnn9" (UID: "be92546e-2796-4680-9b67-4db0dd18a29b") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:04:23.778126 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:23.778083 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-217.ec2.internal" event="NodeReady" Sep 09 23:04:23.778313 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:23.778258 2552 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 09 23:04:23.818974 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:23.818886 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-2snpc"] Sep 09 23:04:23.820965 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:23.820934 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2snpc" Sep 09 23:04:23.821581 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:23.821552 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-2p8fh"] Sep 09 23:04:23.823402 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:23.823165 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jj6sk\"" Sep 09 23:04:23.823402 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:23.823172 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 09 23:04:23.823402 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:23.823327 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 09 23:04:23.825391 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:23.823986 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2p8fh" Sep 09 23:04:23.826155 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:23.826123 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 09 23:04:23.826287 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:23.826172 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-cc82g\"" Sep 09 23:04:23.826441 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:23.826402 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 09 23:04:23.826589 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:23.826575 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 09 23:04:23.833260 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:23.832549 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2snpc"] Sep 09 23:04:23.834932 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:23.834902 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2p8fh"] Sep 09 23:04:23.907194 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:23.907156 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e4b08d5d-1afa-4ba8-b544-a2c6d441566e-config-volume\") pod \"dns-default-2snpc\" (UID: \"e4b08d5d-1afa-4ba8-b544-a2c6d441566e\") " pod="openshift-dns/dns-default-2snpc" Sep 09 23:04:23.907367 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:23.907220 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4b08d5d-1afa-4ba8-b544-a2c6d441566e-tmp-dir\") pod \"dns-default-2snpc\" (UID: \"e4b08d5d-1afa-4ba8-b544-a2c6d441566e\") " pod="openshift-dns/dns-default-2snpc" Sep 09 23:04:23.907367 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:23.907249 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8nqlx\" (UniqueName: \"kubernetes.io/projected/9dcefc03-70f9-41ad-a155-f9156e3cdf25-kube-api-access-8nqlx\") pod \"ingress-canary-2p8fh\" (UID: \"9dcefc03-70f9-41ad-a155-f9156e3cdf25\") " pod="openshift-ingress-canary/ingress-canary-2p8fh" Sep 09 23:04:23.907367 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:23.907298 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e4b08d5d-1afa-4ba8-b544-a2c6d441566e-metrics-tls\") pod \"dns-default-2snpc\" (UID: \"e4b08d5d-1afa-4ba8-b544-a2c6d441566e\") " pod="openshift-dns/dns-default-2snpc" Sep 09 23:04:23.907367 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:23.907344 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9dcefc03-70f9-41ad-a155-f9156e3cdf25-cert\") pod \"ingress-canary-2p8fh\" (UID: \"9dcefc03-70f9-41ad-a155-f9156e3cdf25\") " pod="openshift-ingress-canary/ingress-canary-2p8fh" Sep 09 23:04:23.907544 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:23.907388 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njb5p\" (UniqueName: \"kubernetes.io/projected/e4b08d5d-1afa-4ba8-b544-a2c6d441566e-kube-api-access-njb5p\") pod \"dns-default-2snpc\" (UID: \"e4b08d5d-1afa-4ba8-b544-a2c6d441566e\") " pod="openshift-dns/dns-default-2snpc" Sep 09 23:04:23.933366 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:23.933327 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5hnn9" Sep 09 23:04:23.933540 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:23.933327 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6fdst" Sep 09 23:04:23.933626 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:23.933327 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2ql9" Sep 09 23:04:23.935726 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:23.935700 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 09 23:04:23.935998 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:23.935979 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 09 23:04:23.936107 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:23.936069 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 09 23:04:23.936167 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:23.936147 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 09 23:04:23.936221 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:23.936185 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hwds4\"" Sep 09 23:04:23.936319 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:23.936288 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-64srt\"" Sep 09 23:04:24.008618 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:24.008387 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e4b08d5d-1afa-4ba8-b544-a2c6d441566e-metrics-tls\") pod \"dns-default-2snpc\" (UID: \"e4b08d5d-1afa-4ba8-b544-a2c6d441566e\") " pod="openshift-dns/dns-default-2snpc" Sep 09 23:04:24.008820 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:24.008637 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9dcefc03-70f9-41ad-a155-f9156e3cdf25-cert\") pod \"ingress-canary-2p8fh\" (UID: \"9dcefc03-70f9-41ad-a155-f9156e3cdf25\") " pod="openshift-ingress-canary/ingress-canary-2p8fh" Sep 09 23:04:24.008820 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:04:24.008581 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 23:04:24.008820 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:24.008690 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njb5p\" (UniqueName: \"kubernetes.io/projected/e4b08d5d-1afa-4ba8-b544-a2c6d441566e-kube-api-access-njb5p\") pod \"dns-default-2snpc\" (UID: \"e4b08d5d-1afa-4ba8-b544-a2c6d441566e\") " pod="openshift-dns/dns-default-2snpc" Sep 09 23:04:24.008820 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:04:24.008778 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4b08d5d-1afa-4ba8-b544-a2c6d441566e-metrics-tls podName:e4b08d5d-1afa-4ba8-b544-a2c6d441566e nodeName:}" failed. No retries permitted until 2026-09-09 23:04:24.508756989 +0000 UTC m=+35.024487812 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e4b08d5d-1afa-4ba8-b544-a2c6d441566e-metrics-tls") pod "dns-default-2snpc" (UID: "e4b08d5d-1afa-4ba8-b544-a2c6d441566e") : secret "dns-default-metrics-tls" not found Sep 09 23:04:24.009033 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:24.008876 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e4b08d5d-1afa-4ba8-b544-a2c6d441566e-config-volume\") pod \"dns-default-2snpc\" (UID: \"e4b08d5d-1afa-4ba8-b544-a2c6d441566e\") " pod="openshift-dns/dns-default-2snpc" Sep 09 23:04:24.009033 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:24.008927 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4b08d5d-1afa-4ba8-b544-a2c6d441566e-tmp-dir\") pod \"dns-default-2snpc\" (UID: \"e4b08d5d-1afa-4ba8-b544-a2c6d441566e\") " pod="openshift-dns/dns-default-2snpc" Sep 09 23:04:24.009033 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:24.008948 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nqlx\" (UniqueName: \"kubernetes.io/projected/9dcefc03-70f9-41ad-a155-f9156e3cdf25-kube-api-access-8nqlx\") pod \"ingress-canary-2p8fh\" (UID: \"9dcefc03-70f9-41ad-a155-f9156e3cdf25\") " pod="openshift-ingress-canary/ingress-canary-2p8fh" Sep 09 23:04:24.009378 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:24.009360 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4b08d5d-1afa-4ba8-b544-a2c6d441566e-tmp-dir\") pod \"dns-default-2snpc\" (UID: \"e4b08d5d-1afa-4ba8-b544-a2c6d441566e\") " pod="openshift-dns/dns-default-2snpc" Sep 09 23:04:24.009724 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:24.009696 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e4b08d5d-1afa-4ba8-b544-a2c6d441566e-config-volume\") pod \"dns-default-2snpc\" (UID: \"e4b08d5d-1afa-4ba8-b544-a2c6d441566e\") " pod="openshift-dns/dns-default-2snpc" Sep 09 23:04:24.013602 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:24.013580 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9dcefc03-70f9-41ad-a155-f9156e3cdf25-cert\") pod \"ingress-canary-2p8fh\" (UID: \"9dcefc03-70f9-41ad-a155-f9156e3cdf25\") " pod="openshift-ingress-canary/ingress-canary-2p8fh" Sep 09 23:04:24.017323 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:24.017298 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8nqlx\" (UniqueName: \"kubernetes.io/projected/9dcefc03-70f9-41ad-a155-f9156e3cdf25-kube-api-access-8nqlx\") pod \"ingress-canary-2p8fh\" (UID: \"9dcefc03-70f9-41ad-a155-f9156e3cdf25\") " pod="openshift-ingress-canary/ingress-canary-2p8fh" Sep 09 23:04:24.017323 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:24.017356 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-njb5p\" (UniqueName: \"kubernetes.io/projected/e4b08d5d-1afa-4ba8-b544-a2c6d441566e-kube-api-access-njb5p\") pod \"dns-default-2snpc\" (UID: \"e4b08d5d-1afa-4ba8-b544-a2c6d441566e\") " pod="openshift-dns/dns-default-2snpc" Sep 09 23:04:24.144107 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:24.144072 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2p8fh" Sep 09 23:04:24.513012 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:24.512915 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e4b08d5d-1afa-4ba8-b544-a2c6d441566e-metrics-tls\") pod \"dns-default-2snpc\" (UID: \"e4b08d5d-1afa-4ba8-b544-a2c6d441566e\") " pod="openshift-dns/dns-default-2snpc" Sep 09 23:04:24.513178 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:04:24.513110 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 23:04:24.513225 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:04:24.513192 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4b08d5d-1afa-4ba8-b544-a2c6d441566e-metrics-tls podName:e4b08d5d-1afa-4ba8-b544-a2c6d441566e nodeName:}" failed. No retries permitted until 2026-09-09 23:04:25.513170195 +0000 UTC m=+36.028901007 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e4b08d5d-1afa-4ba8-b544-a2c6d441566e-metrics-tls") pod "dns-default-2snpc" (UID: "e4b08d5d-1afa-4ba8-b544-a2c6d441566e") : secret "dns-default-metrics-tls" not found Sep 09 23:04:25.520501 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:25.520462 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e4b08d5d-1afa-4ba8-b544-a2c6d441566e-metrics-tls\") pod \"dns-default-2snpc\" (UID: \"e4b08d5d-1afa-4ba8-b544-a2c6d441566e\") " pod="openshift-dns/dns-default-2snpc" Sep 09 23:04:25.521191 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:04:25.520583 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 23:04:25.521191 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:04:25.520637 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4b08d5d-1afa-4ba8-b544-a2c6d441566e-metrics-tls podName:e4b08d5d-1afa-4ba8-b544-a2c6d441566e nodeName:}" failed. No retries permitted until 2026-09-09 23:04:27.520623264 +0000 UTC m=+38.036354072 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e4b08d5d-1afa-4ba8-b544-a2c6d441566e-metrics-tls") pod "dns-default-2snpc" (UID: "e4b08d5d-1afa-4ba8-b544-a2c6d441566e") : secret "dns-default-metrics-tls" not found Sep 09 23:04:25.623060 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:25.623025 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2p8fh"] Sep 09 23:04:25.633607 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:04:25.633576 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9dcefc03_70f9_41ad_a155_f9156e3cdf25.slice/crio-9ddbf4312bf6d3b4d834293a238ea2b81a04caf0bbb3af0aef8d168dc2528d7e WatchSource:0}: Error finding container 9ddbf4312bf6d3b4d834293a238ea2b81a04caf0bbb3af0aef8d168dc2528d7e: Status 404 returned error can't find the container with id 9ddbf4312bf6d3b4d834293a238ea2b81a04caf0bbb3af0aef8d168dc2528d7e Sep 09 23:04:26.132649 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:26.132610 2552 generic.go:356] "Generic (PLEG): container finished" podID="a4486a4c-3025-4d07-9d75-d9e774762c4f" containerID="cdd72e2e7eb0c2e9ddf97ab16bb85ec3c63bfe346f8ca8b6d1841e7860990b8c" exitCode=0 Sep 09 23:04:26.132858 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:26.132710 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l9fm4" event={"ID":"a4486a4c-3025-4d07-9d75-d9e774762c4f","Type":"ContainerDied","Data":"cdd72e2e7eb0c2e9ddf97ab16bb85ec3c63bfe346f8ca8b6d1841e7860990b8c"} Sep 09 23:04:26.134114 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:26.134070 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2p8fh" event={"ID":"9dcefc03-70f9-41ad-a155-f9156e3cdf25","Type":"ContainerStarted","Data":"9ddbf4312bf6d3b4d834293a238ea2b81a04caf0bbb3af0aef8d168dc2528d7e"} Sep 09 23:04:27.140598 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:27.140562 2552 generic.go:356] "Generic (PLEG): container finished" podID="a4486a4c-3025-4d07-9d75-d9e774762c4f" containerID="2d39d9cee1c2226f8ee1d36b85986f18d3953b4932a94f88a79c61936fac451a" exitCode=0 Sep 09 23:04:27.141054 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:27.140631 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l9fm4" event={"ID":"a4486a4c-3025-4d07-9d75-d9e774762c4f","Type":"ContainerDied","Data":"2d39d9cee1c2226f8ee1d36b85986f18d3953b4932a94f88a79c61936fac451a"} Sep 09 23:04:27.535005 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:27.534881 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e4b08d5d-1afa-4ba8-b544-a2c6d441566e-metrics-tls\") pod \"dns-default-2snpc\" (UID: \"e4b08d5d-1afa-4ba8-b544-a2c6d441566e\") " pod="openshift-dns/dns-default-2snpc" Sep 09 23:04:27.535166 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:04:27.535043 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 23:04:27.535166 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:04:27.535120 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4b08d5d-1afa-4ba8-b544-a2c6d441566e-metrics-tls podName:e4b08d5d-1afa-4ba8-b544-a2c6d441566e nodeName:}" failed. No retries permitted until 2026-09-09 23:04:31.535096967 +0000 UTC m=+42.050827795 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e4b08d5d-1afa-4ba8-b544-a2c6d441566e-metrics-tls") pod "dns-default-2snpc" (UID: "e4b08d5d-1afa-4ba8-b544-a2c6d441566e") : secret "dns-default-metrics-tls" not found Sep 09 23:04:28.146779 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:28.146742 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l9fm4" event={"ID":"a4486a4c-3025-4d07-9d75-d9e774762c4f","Type":"ContainerStarted","Data":"d958ff7e50ad037dba5bcfae5eba2d573c0ff22e70811631b72adb64e735f66f"} Sep 09 23:04:28.167383 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:28.167334 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-l9fm4" podStartSLOduration=8.718673773999999 podStartE2EDuration="38.167317444s" totalImagesPullingTime="29.44864367s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:03:50 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:04:28.166325425 +0000 UTC m=+38.682056254" watchObservedRunningTime="2026-09-09 23:04:28.167317444 +0000 UTC m=+38.683048275" Sep 09 23:04:29.151411 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:29.151372 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2p8fh" event={"ID":"9dcefc03-70f9-41ad-a155-f9156e3cdf25","Type":"ContainerStarted","Data":"ed93873e585e260c76f047cbd86d57c52fee95eaa46e02b2d0536c8ab316beb7"} Sep 09 23:04:29.165799 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:29.165746 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-2p8fh" podStartSLOduration=3.4096374320000002 podStartE2EDuration="6.165729552s" totalImagesPullingTime="2.75609212s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:04:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:04:29.16448849 +0000 UTC m=+39.680219312" watchObservedRunningTime="2026-09-09 23:04:29.165729552 +0000 UTC m=+39.681460381" Sep 09 23:04:31.562078 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:31.562031 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e4b08d5d-1afa-4ba8-b544-a2c6d441566e-metrics-tls\") pod \"dns-default-2snpc\" (UID: \"e4b08d5d-1afa-4ba8-b544-a2c6d441566e\") " pod="openshift-dns/dns-default-2snpc" Sep 09 23:04:31.562459 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:04:31.562157 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 23:04:31.562459 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:04:31.562211 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4b08d5d-1afa-4ba8-b544-a2c6d441566e-metrics-tls podName:e4b08d5d-1afa-4ba8-b544-a2c6d441566e nodeName:}" failed. No retries permitted until 2026-09-09 23:04:39.562196816 +0000 UTC m=+50.077927625 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e4b08d5d-1afa-4ba8-b544-a2c6d441566e-metrics-tls") pod "dns-default-2snpc" (UID: "e4b08d5d-1afa-4ba8-b544-a2c6d441566e") : secret "dns-default-metrics-tls" not found Sep 09 23:04:39.620524 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:39.620479 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e4b08d5d-1afa-4ba8-b544-a2c6d441566e-metrics-tls\") pod \"dns-default-2snpc\" (UID: \"e4b08d5d-1afa-4ba8-b544-a2c6d441566e\") " pod="openshift-dns/dns-default-2snpc" Sep 09 23:04:39.620973 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:04:39.620638 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 23:04:39.620973 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:04:39.620739 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4b08d5d-1afa-4ba8-b544-a2c6d441566e-metrics-tls podName:e4b08d5d-1afa-4ba8-b544-a2c6d441566e nodeName:}" failed. No retries permitted until 2026-09-09 23:04:55.620722296 +0000 UTC m=+66.136453105 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e4b08d5d-1afa-4ba8-b544-a2c6d441566e-metrics-tls") pod "dns-default-2snpc" (UID: "e4b08d5d-1afa-4ba8-b544-a2c6d441566e") : secret "dns-default-metrics-tls" not found Sep 09 23:04:49.128039 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:49.128007 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6x9hk" Sep 09 23:04:55.635292 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:55.635251 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ce549cd8-0a7b-44b1-afdb-6d02adf85c7d-original-pull-secret\") pod \"global-pull-secret-syncer-6fdst\" (UID: \"ce549cd8-0a7b-44b1-afdb-6d02adf85c7d\") " pod="kube-system/global-pull-secret-syncer-6fdst" Sep 09 23:04:55.635763 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:55.635312 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e4b08d5d-1afa-4ba8-b544-a2c6d441566e-metrics-tls\") pod \"dns-default-2snpc\" (UID: \"e4b08d5d-1afa-4ba8-b544-a2c6d441566e\") " pod="openshift-dns/dns-default-2snpc" Sep 09 23:04:55.635763 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:04:55.635413 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 23:04:55.635763 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:04:55.635483 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4b08d5d-1afa-4ba8-b544-a2c6d441566e-metrics-tls podName:e4b08d5d-1afa-4ba8-b544-a2c6d441566e nodeName:}" failed. No retries permitted until 2026-09-09 23:05:27.635465913 +0000 UTC m=+98.151196740 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e4b08d5d-1afa-4ba8-b544-a2c6d441566e-metrics-tls") pod "dns-default-2snpc" (UID: "e4b08d5d-1afa-4ba8-b544-a2c6d441566e") : secret "dns-default-metrics-tls" not found Sep 09 23:04:55.637775 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:55.637755 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 09 23:04:55.648840 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:55.648805 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ce549cd8-0a7b-44b1-afdb-6d02adf85c7d-original-pull-secret\") pod \"global-pull-secret-syncer-6fdst\" (UID: \"ce549cd8-0a7b-44b1-afdb-6d02adf85c7d\") " pod="kube-system/global-pull-secret-syncer-6fdst" Sep 09 23:04:55.736110 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:55.736065 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be92546e-2796-4680-9b67-4db0dd18a29b-metrics-certs\") pod \"network-metrics-daemon-5hnn9\" (UID: \"be92546e-2796-4680-9b67-4db0dd18a29b\") " pod="openshift-multus/network-metrics-daemon-5hnn9" Sep 09 23:04:55.736269 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:55.736133 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49qq8\" (UniqueName: \"kubernetes.io/projected/0416357e-69d3-4301-b431-2b39d7387267-kube-api-access-49qq8\") pod \"network-check-target-h2ql9\" (UID: \"0416357e-69d3-4301-b431-2b39d7387267\") " pod="openshift-network-diagnostics/network-check-target-h2ql9" Sep 09 23:04:55.738356 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:55.738323 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 09 23:04:55.738488 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:55.738438 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 09 23:04:55.746453 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:04:55.746424 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 09 23:04:55.746583 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:04:55.746519 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be92546e-2796-4680-9b67-4db0dd18a29b-metrics-certs podName:be92546e-2796-4680-9b67-4db0dd18a29b nodeName:}" failed. No retries permitted until 2026-09-09 23:05:59.746496701 +0000 UTC m=+130.262227516 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/be92546e-2796-4680-9b67-4db0dd18a29b-metrics-certs") pod "network-metrics-daemon-5hnn9" (UID: "be92546e-2796-4680-9b67-4db0dd18a29b") : secret "metrics-daemon-secret" not found Sep 09 23:04:55.748344 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:55.748325 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 09 23:04:55.752781 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:55.752757 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6fdst" Sep 09 23:04:55.759320 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:55.759297 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-49qq8\" (UniqueName: \"kubernetes.io/projected/0416357e-69d3-4301-b431-2b39d7387267-kube-api-access-49qq8\") pod \"network-check-target-h2ql9\" (UID: \"0416357e-69d3-4301-b431-2b39d7387267\") " pod="openshift-network-diagnostics/network-check-target-h2ql9" Sep 09 23:04:55.761726 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:55.761705 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hwds4\"" Sep 09 23:04:55.770523 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:55.770493 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2ql9" Sep 09 23:04:56.050954 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:56.050879 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6fdst"] Sep 09 23:04:56.054021 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:04:56.053992 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce549cd8_0a7b_44b1_afdb_6d02adf85c7d.slice/crio-f9a17e38c8b31f124287bfafeae3cf72fd0071d1d51dd8200312bc47726fad81 WatchSource:0}: Error finding container f9a17e38c8b31f124287bfafeae3cf72fd0071d1d51dd8200312bc47726fad81: Status 404 returned error can't find the container with id f9a17e38c8b31f124287bfafeae3cf72fd0071d1d51dd8200312bc47726fad81 Sep 09 23:04:56.073238 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:56.073207 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-h2ql9"] Sep 09 23:04:56.077973 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:04:56.077944 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0416357e_69d3_4301_b431_2b39d7387267.slice/crio-4544a8b8ee42bfbae48cf326ba2a139fbe287f7e06277e9c760151b9d08e7a99 WatchSource:0}: Error finding container 4544a8b8ee42bfbae48cf326ba2a139fbe287f7e06277e9c760151b9d08e7a99: Status 404 returned error can't find the container with id 4544a8b8ee42bfbae48cf326ba2a139fbe287f7e06277e9c760151b9d08e7a99 Sep 09 23:04:56.216483 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:56.216449 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-h2ql9" event={"ID":"0416357e-69d3-4301-b431-2b39d7387267","Type":"ContainerStarted","Data":"4544a8b8ee42bfbae48cf326ba2a139fbe287f7e06277e9c760151b9d08e7a99"} Sep 09 23:04:56.217558 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:04:56.217536 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6fdst" event={"ID":"ce549cd8-0a7b-44b1-afdb-6d02adf85c7d","Type":"ContainerStarted","Data":"f9a17e38c8b31f124287bfafeae3cf72fd0071d1d51dd8200312bc47726fad81"} Sep 09 23:05:01.233125 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:05:01.233082 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-h2ql9" event={"ID":"0416357e-69d3-4301-b431-2b39d7387267","Type":"ContainerStarted","Data":"0c94ed85c97e7309698cb3fee58fa200c47cbfad65d2c52064bf24dcd7802fcc"} Sep 09 23:05:01.233635 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:05:01.233259 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-h2ql9" Sep 09 23:05:01.234861 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:05:01.234834 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6fdst" event={"ID":"ce549cd8-0a7b-44b1-afdb-6d02adf85c7d","Type":"ContainerStarted","Data":"0dfed38e603ac43bc24238ef064537d1069ebd82832ddd63edbf779214f06dfb"} Sep 09 23:05:01.248302 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:05:01.248216 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-h2ql9" podStartSLOduration=66.338883991 podStartE2EDuration="1m11.248201376s" totalImagesPullingTime="4.909317385s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:03:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:05:01.246755788 +0000 UTC m=+71.762486619" watchObservedRunningTime="2026-09-09 23:05:01.248201376 +0000 UTC m=+71.763932227" Sep 09 23:05:01.260141 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:05:01.260088 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-6fdst" podStartSLOduration=66.323656061 podStartE2EDuration="1m11.260071262s" totalImagesPullingTime="4.936415201s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:03:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:05:01.259406156 +0000 UTC m=+71.775136998" watchObservedRunningTime="2026-09-09 23:05:01.260071262 +0000 UTC m=+71.775802092" Sep 09 23:05:23.415124 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:05:23.415005 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5887dd946-8kjsl"] Sep 09 23:05:23.417855 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:05:23.417825 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5887dd946-8kjsl" Sep 09 23:05:23.421203 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:05:23.421163 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Sep 09 23:05:23.421203 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:05:23.421196 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 09 23:05:23.421393 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:05:23.421207 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 09 23:05:23.421393 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:05:23.421170 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 09 23:05:23.421393 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:05:23.421172 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-8g2dm\"" Sep 09 23:05:23.427076 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:05:23.427054 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5887dd946-8kjsl"] Sep 09 23:05:23.526138 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:05:23.526100 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/89022866-c968-4481-affd-0175abfa666e-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5887dd946-8kjsl\" (UID: \"89022866-c968-4481-affd-0175abfa666e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5887dd946-8kjsl" Sep 09 23:05:23.526138 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:05:23.526143 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f95tm\" (UniqueName: \"kubernetes.io/projected/89022866-c968-4481-affd-0175abfa666e-kube-api-access-f95tm\") pod \"managed-serviceaccount-addon-agent-5887dd946-8kjsl\" (UID: \"89022866-c968-4481-affd-0175abfa666e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5887dd946-8kjsl" Sep 09 23:05:23.626552 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:05:23.626509 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f95tm\" (UniqueName: \"kubernetes.io/projected/89022866-c968-4481-affd-0175abfa666e-kube-api-access-f95tm\") pod \"managed-serviceaccount-addon-agent-5887dd946-8kjsl\" (UID: \"89022866-c968-4481-affd-0175abfa666e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5887dd946-8kjsl" Sep 09 23:05:23.626749 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:05:23.626592 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/89022866-c968-4481-affd-0175abfa666e-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5887dd946-8kjsl\" (UID: \"89022866-c968-4481-affd-0175abfa666e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5887dd946-8kjsl" Sep 09 23:05:23.629089 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:05:23.629065 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/89022866-c968-4481-affd-0175abfa666e-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5887dd946-8kjsl\" (UID: \"89022866-c968-4481-affd-0175abfa666e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5887dd946-8kjsl" Sep 09 23:05:23.634528 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:05:23.634501 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f95tm\" (UniqueName: \"kubernetes.io/projected/89022866-c968-4481-affd-0175abfa666e-kube-api-access-f95tm\") pod \"managed-serviceaccount-addon-agent-5887dd946-8kjsl\" (UID: \"89022866-c968-4481-affd-0175abfa666e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5887dd946-8kjsl" Sep 09 23:05:23.739905 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:05:23.739819 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5887dd946-8kjsl" Sep 09 23:05:24.003821 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:05:24.003723 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5887dd946-8kjsl"] Sep 09 23:05:24.007381 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:05:24.007348 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod89022866_c968_4481_affd_0175abfa666e.slice/crio-25ce16d3068399a9dc0a460d29fd6814d182a44f4bb341d6e27e1009a69889ec WatchSource:0}: Error finding container 25ce16d3068399a9dc0a460d29fd6814d182a44f4bb341d6e27e1009a69889ec: Status 404 returned error can't find the container with id 25ce16d3068399a9dc0a460d29fd6814d182a44f4bb341d6e27e1009a69889ec Sep 09 23:05:24.293457 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:05:24.293365 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5887dd946-8kjsl" event={"ID":"89022866-c968-4481-affd-0175abfa666e","Type":"ContainerStarted","Data":"25ce16d3068399a9dc0a460d29fd6814d182a44f4bb341d6e27e1009a69889ec"} Sep 09 23:05:27.302920 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:05:27.302887 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5887dd946-8kjsl" event={"ID":"89022866-c968-4481-affd-0175abfa666e","Type":"ContainerStarted","Data":"92af434dbc26afbe205c0f504885c7cce77618c5d52a71b1da0c79dcb9fcd80d"} Sep 09 23:05:27.317188 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:05:27.317136 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5887dd946-8kjsl" podStartSLOduration=1.9573145410000001 podStartE2EDuration="4.317118046s" totalImagesPullingTime="2.359803505s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:05:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:05:27.316503206 +0000 UTC m=+97.832234036" watchObservedRunningTime="2026-09-09 23:05:27.317118046 +0000 UTC m=+97.832848875" Sep 09 23:05:27.656476 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:05:27.656424 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e4b08d5d-1afa-4ba8-b544-a2c6d441566e-metrics-tls\") pod \"dns-default-2snpc\" (UID: \"e4b08d5d-1afa-4ba8-b544-a2c6d441566e\") " pod="openshift-dns/dns-default-2snpc" Sep 09 23:05:27.656640 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:05:27.656581 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 23:05:27.656704 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:05:27.656642 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4b08d5d-1afa-4ba8-b544-a2c6d441566e-metrics-tls podName:e4b08d5d-1afa-4ba8-b544-a2c6d441566e nodeName:}" failed. No retries permitted until 2026-09-09 23:06:31.656625151 +0000 UTC m=+162.172356175 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e4b08d5d-1afa-4ba8-b544-a2c6d441566e-metrics-tls") pod "dns-default-2snpc" (UID: "e4b08d5d-1afa-4ba8-b544-a2c6d441566e") : secret "dns-default-metrics-tls" not found Sep 09 23:05:32.240407 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:05:32.240374 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-h2ql9" Sep 09 23:05:59.775560 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:05:59.775512 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be92546e-2796-4680-9b67-4db0dd18a29b-metrics-certs\") pod \"network-metrics-daemon-5hnn9\" (UID: \"be92546e-2796-4680-9b67-4db0dd18a29b\") " pod="openshift-multus/network-metrics-daemon-5hnn9" Sep 09 23:05:59.776105 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:05:59.775625 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 09 23:05:59.776105 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:05:59.775705 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be92546e-2796-4680-9b67-4db0dd18a29b-metrics-certs podName:be92546e-2796-4680-9b67-4db0dd18a29b nodeName:}" failed. No retries permitted until 2026-09-09 23:08:01.775666383 +0000 UTC m=+252.291397192 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/be92546e-2796-4680-9b67-4db0dd18a29b-metrics-certs") pod "network-metrics-daemon-5hnn9" (UID: "be92546e-2796-4680-9b67-4db0dd18a29b") : secret "metrics-daemon-secret" not found Sep 09 23:06:26.837556 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:06:26.837490 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-2snpc" podUID="e4b08d5d-1afa-4ba8-b544-a2c6d441566e" Sep 09 23:06:26.946068 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:06:26.946025 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-5hnn9" podUID="be92546e-2796-4680-9b67-4db0dd18a29b" Sep 09 23:06:27.450444 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:06:27.450412 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2snpc" Sep 09 23:06:31.708393 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:06:31.708338 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e4b08d5d-1afa-4ba8-b544-a2c6d441566e-metrics-tls\") pod \"dns-default-2snpc\" (UID: \"e4b08d5d-1afa-4ba8-b544-a2c6d441566e\") " pod="openshift-dns/dns-default-2snpc" Sep 09 23:06:31.709042 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:06:31.708531 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 23:06:31.709042 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:06:31.708667 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4b08d5d-1afa-4ba8-b544-a2c6d441566e-metrics-tls podName:e4b08d5d-1afa-4ba8-b544-a2c6d441566e nodeName:}" failed. No retries permitted until 2026-09-09 23:08:33.708644112 +0000 UTC m=+284.224374937 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e4b08d5d-1afa-4ba8-b544-a2c6d441566e-metrics-tls") pod "dns-default-2snpc" (UID: "e4b08d5d-1afa-4ba8-b544-a2c6d441566e") : secret "dns-default-metrics-tls" not found Sep 09 23:06:37.933449 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:06:37.933405 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5hnn9" Sep 09 23:07:26.597086 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:26.597052 2552 generic.go:356] "Generic (PLEG): container finished" podID="89022866-c968-4481-affd-0175abfa666e" containerID="92af434dbc26afbe205c0f504885c7cce77618c5d52a71b1da0c79dcb9fcd80d" exitCode=255 Sep 09 23:07:26.597480 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:26.597105 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5887dd946-8kjsl" event={"ID":"89022866-c968-4481-affd-0175abfa666e","Type":"ContainerDied","Data":"92af434dbc26afbe205c0f504885c7cce77618c5d52a71b1da0c79dcb9fcd80d"} Sep 09 23:07:26.602754 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:26.602729 2552 scope.go:117] "RemoveContainer" containerID="92af434dbc26afbe205c0f504885c7cce77618c5d52a71b1da0c79dcb9fcd80d" Sep 09 23:07:27.601506 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:27.601467 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5887dd946-8kjsl" event={"ID":"89022866-c968-4481-affd-0175abfa666e","Type":"ContainerStarted","Data":"dc413e05220011795325fb5604efc0faab67cdcbd76e2eb5a245e4481a59012a"} Sep 09 23:07:42.734104 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.734055 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-ttc7l"] Sep 09 23:07:42.736981 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.736961 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-j5kg7"] Sep 09 23:07:42.737126 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.737106 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-ttc7l" Sep 09 23:07:42.740886 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.739611 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Sep 09 23:07:42.740886 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.740067 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Sep 09 23:07:42.740886 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.740513 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Sep 09 23:07:42.740886 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.740622 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-6r25n\"" Sep 09 23:07:42.740886 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.740646 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Sep 09 23:07:42.743171 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.743143 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-p76j4"] Sep 09 23:07:42.743307 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.743240 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-j5kg7" Sep 09 23:07:42.745411 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.745385 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-vtzgr\"" Sep 09 23:07:42.746220 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.746181 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 09 23:07:42.746464 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.746440 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-85b454874b-p2dvt"] Sep 09 23:07:42.746585 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.746567 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-p76j4" Sep 09 23:07:42.746769 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.746749 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Sep 09 23:07:42.747338 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.747316 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 09 23:07:42.747461 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.747442 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Sep 09 23:07:42.748946 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.748913 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 09 23:07:42.749462 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.749442 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 09 23:07:42.749551 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.749484 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Sep 09 23:07:42.749620 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.749601 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-fm8v9\"" Sep 09 23:07:42.749742 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.749724 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Sep 09 23:07:42.750353 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.750336 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-ttc7l"] Sep 09 23:07:42.750465 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.750448 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-p2dvt" Sep 09 23:07:42.750618 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.750573 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-j5kg7"] Sep 09 23:07:42.752131 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.752111 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-p2dvt"] Sep 09 23:07:42.752830 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.752791 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-mqcc8\"" Sep 09 23:07:42.753029 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.752847 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Sep 09 23:07:42.753131 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.753107 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Sep 09 23:07:42.753131 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.752881 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Sep 09 23:07:42.753275 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.753239 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Sep 09 23:07:42.755356 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.755288 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Sep 09 23:07:42.759191 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.759168 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Sep 09 23:07:42.763876 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.763852 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-p76j4"] Sep 09 23:07:42.797232 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.797194 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/820c1525-62c1-4181-9a2f-aef3a2157d40-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-j5kg7\" (UID: \"820c1525-62c1-4181-9a2f-aef3a2157d40\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-j5kg7" Sep 09 23:07:42.797232 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.797237 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2571894e-0cd5-4909-ad9e-240e1d667928-config\") pod \"service-ca-operator-859f94c4b-ttc7l\" (UID: \"2571894e-0cd5-4909-ad9e-240e1d667928\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-ttc7l" Sep 09 23:07:42.797441 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.797273 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/820c1525-62c1-4181-9a2f-aef3a2157d40-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-j5kg7\" (UID: \"820c1525-62c1-4181-9a2f-aef3a2157d40\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-j5kg7" Sep 09 23:07:42.797441 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.797312 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h86ph\" (UniqueName: \"kubernetes.io/projected/820c1525-62c1-4181-9a2f-aef3a2157d40-kube-api-access-h86ph\") pod \"cluster-monitoring-operator-6cdcc96965-j5kg7\" (UID: \"820c1525-62c1-4181-9a2f-aef3a2157d40\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-j5kg7" Sep 09 23:07:42.797441 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.797343 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qv97\" (UniqueName: \"kubernetes.io/projected/2571894e-0cd5-4909-ad9e-240e1d667928-kube-api-access-9qv97\") pod \"service-ca-operator-859f94c4b-ttc7l\" (UID: \"2571894e-0cd5-4909-ad9e-240e1d667928\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-ttc7l" Sep 09 23:07:42.797441 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.797388 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2571894e-0cd5-4909-ad9e-240e1d667928-serving-cert\") pod \"service-ca-operator-859f94c4b-ttc7l\" (UID: \"2571894e-0cd5-4909-ad9e-240e1d667928\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-ttc7l" Sep 09 23:07:42.830122 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.830084 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-2cgr6"] Sep 09 23:07:42.832973 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.832945 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-p2sfk"] Sep 09 23:07:42.833151 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.833096 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-2cgr6" Sep 09 23:07:42.835662 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.835638 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Sep 09 23:07:42.835662 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.835654 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Sep 09 23:07:42.835863 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.835657 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-zvw96\"" Sep 09 23:07:42.835863 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.835799 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-6x6jq"] Sep 09 23:07:42.835967 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.835942 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-p2sfk" Sep 09 23:07:42.838146 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.838124 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-lvwjg\"" Sep 09 23:07:42.838632 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.838617 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7d89fb7b67-khjgb"] Sep 09 23:07:42.838777 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.838759 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-6x6jq" Sep 09 23:07:42.841112 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.841096 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Sep 09 23:07:42.841589 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.841572 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d89fb7b67-khjgb" Sep 09 23:07:42.841643 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.841583 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-855mt\"" Sep 09 23:07:42.841643 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.841609 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Sep 09 23:07:42.842128 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.842112 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Sep 09 23:07:42.843538 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.843521 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 09 23:07:42.844103 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.844084 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-699nw\"" Sep 09 23:07:42.844200 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.844084 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 09 23:07:42.844200 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.844180 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 09 23:07:42.844325 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.844209 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-p2sfk"] Sep 09 23:07:42.845331 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.845285 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-2cgr6"] Sep 09 23:07:42.848989 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.848962 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 09 23:07:42.852293 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.852272 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7d89fb7b67-khjgb"] Sep 09 23:07:42.861151 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.861123 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-6x6jq"] Sep 09 23:07:42.897886 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.897851 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f8e95541-01e9-4d65-921c-5ab7bf9593cb-ca-trust-extracted\") pod \"image-registry-7d89fb7b67-khjgb\" (UID: \"f8e95541-01e9-4d65-921c-5ab7bf9593cb\") " pod="openshift-image-registry/image-registry-7d89fb7b67-khjgb" Sep 09 23:07:42.897886 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.897883 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/725fbc90-832a-494f-9852-5532a64baccc-tmp\") pod \"insights-operator-76bcd6ccf5-p76j4\" (UID: \"725fbc90-832a-494f-9852-5532a64baccc\") " pod="openshift-insights/insights-operator-76bcd6ccf5-p76j4" Sep 09 23:07:42.898112 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.897900 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9q87\" (UniqueName: \"kubernetes.io/projected/725fbc90-832a-494f-9852-5532a64baccc-kube-api-access-k9q87\") pod \"insights-operator-76bcd6ccf5-p76j4\" (UID: \"725fbc90-832a-494f-9852-5532a64baccc\") " pod="openshift-insights/insights-operator-76bcd6ccf5-p76j4" Sep 09 23:07:42.898112 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.897918 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f8e95541-01e9-4d65-921c-5ab7bf9593cb-bound-sa-token\") pod \"image-registry-7d89fb7b67-khjgb\" (UID: \"f8e95541-01e9-4d65-921c-5ab7bf9593cb\") " pod="openshift-image-registry/image-registry-7d89fb7b67-khjgb" Sep 09 23:07:42.898112 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.897940 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2pp2\" (UniqueName: \"kubernetes.io/projected/5d1340d6-3378-473e-a317-b8848b2fd4d8-kube-api-access-k2pp2\") pod \"cluster-samples-operator-7cdcfcf76c-6x6jq\" (UID: \"5d1340d6-3378-473e-a317-b8848b2fd4d8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-6x6jq" Sep 09 23:07:42.898112 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.897977 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndp8t\" (UniqueName: \"kubernetes.io/projected/f8e95541-01e9-4d65-921c-5ab7bf9593cb-kube-api-access-ndp8t\") pod \"image-registry-7d89fb7b67-khjgb\" (UID: \"f8e95541-01e9-4d65-921c-5ab7bf9593cb\") " pod="openshift-image-registry/image-registry-7d89fb7b67-khjgb" Sep 09 23:07:42.898112 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.898001 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f8e95541-01e9-4d65-921c-5ab7bf9593cb-trusted-ca\") pod \"image-registry-7d89fb7b67-khjgb\" (UID: \"f8e95541-01e9-4d65-921c-5ab7bf9593cb\") " pod="openshift-image-registry/image-registry-7d89fb7b67-khjgb" Sep 09 23:07:42.898112 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.898041 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4m86\" (UniqueName: \"kubernetes.io/projected/cb0a0a03-0eaa-4cfa-b854-b33b511e321a-kube-api-access-h4m86\") pod \"volume-data-source-validator-695c895bd6-2cgr6\" (UID: \"cb0a0a03-0eaa-4cfa-b854-b33b511e321a\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-2cgr6" Sep 09 23:07:42.898112 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.898071 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/725fbc90-832a-494f-9852-5532a64baccc-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-p76j4\" (UID: \"725fbc90-832a-494f-9852-5532a64baccc\") " pod="openshift-insights/insights-operator-76bcd6ccf5-p76j4" Sep 09 23:07:42.898112 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.898101 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f8e95541-01e9-4d65-921c-5ab7bf9593cb-installation-pull-secrets\") pod \"image-registry-7d89fb7b67-khjgb\" (UID: \"f8e95541-01e9-4d65-921c-5ab7bf9593cb\") " pod="openshift-image-registry/image-registry-7d89fb7b67-khjgb" Sep 09 23:07:42.898388 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.898138 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2571894e-0cd5-4909-ad9e-240e1d667928-config\") pod \"service-ca-operator-859f94c4b-ttc7l\" (UID: \"2571894e-0cd5-4909-ad9e-240e1d667928\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-ttc7l" Sep 09 23:07:42.898388 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.898154 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ac335ac0-a272-420f-a215-b93e03772895-config\") pod \"console-operator-85b454874b-p2dvt\" (UID: \"ac335ac0-a272-420f-a215-b93e03772895\") " pod="openshift-console-operator/console-operator-85b454874b-p2dvt" Sep 09 23:07:42.898388 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.898191 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ac335ac0-a272-420f-a215-b93e03772895-serving-cert\") pod \"console-operator-85b454874b-p2dvt\" (UID: \"ac335ac0-a272-420f-a215-b93e03772895\") " pod="openshift-console-operator/console-operator-85b454874b-p2dvt" Sep 09 23:07:42.902774 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.898234 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/820c1525-62c1-4181-9a2f-aef3a2157d40-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-j5kg7\" (UID: \"820c1525-62c1-4181-9a2f-aef3a2157d40\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-j5kg7" Sep 09 23:07:42.902774 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.898700 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/725fbc90-832a-494f-9852-5532a64baccc-snapshots\") pod \"insights-operator-76bcd6ccf5-p76j4\" (UID: \"725fbc90-832a-494f-9852-5532a64baccc\") " pod="openshift-insights/insights-operator-76bcd6ccf5-p76j4" Sep 09 23:07:42.902774 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:07:42.898730 2552 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 09 23:07:42.902774 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.898748 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h86ph\" (UniqueName: \"kubernetes.io/projected/820c1525-62c1-4181-9a2f-aef3a2157d40-kube-api-access-h86ph\") pod \"cluster-monitoring-operator-6cdcc96965-j5kg7\" (UID: \"820c1525-62c1-4181-9a2f-aef3a2157d40\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-j5kg7" Sep 09 23:07:42.902774 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.898783 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f8e95541-01e9-4d65-921c-5ab7bf9593cb-registry-tls\") pod \"image-registry-7d89fb7b67-khjgb\" (UID: \"f8e95541-01e9-4d65-921c-5ab7bf9593cb\") " pod="openshift-image-registry/image-registry-7d89fb7b67-khjgb" Sep 09 23:07:42.902774 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:07:42.898831 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/820c1525-62c1-4181-9a2f-aef3a2157d40-cluster-monitoring-operator-tls podName:820c1525-62c1-4181-9a2f-aef3a2157d40 nodeName:}" failed. No retries permitted until 2026-09-09 23:07:43.398800888 +0000 UTC m=+233.914531714 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/820c1525-62c1-4181-9a2f-aef3a2157d40-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-j5kg7" (UID: "820c1525-62c1-4181-9a2f-aef3a2157d40") : secret "cluster-monitoring-operator-tls" not found Sep 09 23:07:42.902774 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.898857 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/725fbc90-832a-494f-9852-5532a64baccc-serving-cert\") pod \"insights-operator-76bcd6ccf5-p76j4\" (UID: \"725fbc90-832a-494f-9852-5532a64baccc\") " pod="openshift-insights/insights-operator-76bcd6ccf5-p76j4" Sep 09 23:07:42.902774 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.898898 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4d9q7\" (UniqueName: \"kubernetes.io/projected/936a6e13-148d-4957-8161-0ed8edf9c89e-kube-api-access-4d9q7\") pod \"network-check-source-685456655f-p2sfk\" (UID: \"936a6e13-148d-4957-8161-0ed8edf9c89e\") " pod="openshift-network-diagnostics/network-check-source-685456655f-p2sfk" Sep 09 23:07:42.902774 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.898939 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qv97\" (UniqueName: \"kubernetes.io/projected/2571894e-0cd5-4909-ad9e-240e1d667928-kube-api-access-9qv97\") pod \"service-ca-operator-859f94c4b-ttc7l\" (UID: \"2571894e-0cd5-4909-ad9e-240e1d667928\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-ttc7l" Sep 09 23:07:42.902774 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.898973 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/725fbc90-832a-494f-9852-5532a64baccc-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-p76j4\" (UID: \"725fbc90-832a-494f-9852-5532a64baccc\") " pod="openshift-insights/insights-operator-76bcd6ccf5-p76j4" Sep 09 23:07:42.902774 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.899029 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ac335ac0-a272-420f-a215-b93e03772895-trusted-ca\") pod \"console-operator-85b454874b-p2dvt\" (UID: \"ac335ac0-a272-420f-a215-b93e03772895\") " pod="openshift-console-operator/console-operator-85b454874b-p2dvt" Sep 09 23:07:42.902774 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.899046 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2571894e-0cd5-4909-ad9e-240e1d667928-config\") pod \"service-ca-operator-859f94c4b-ttc7l\" (UID: \"2571894e-0cd5-4909-ad9e-240e1d667928\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-ttc7l" Sep 09 23:07:42.902774 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.899067 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2571894e-0cd5-4909-ad9e-240e1d667928-serving-cert\") pod \"service-ca-operator-859f94c4b-ttc7l\" (UID: \"2571894e-0cd5-4909-ad9e-240e1d667928\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-ttc7l" Sep 09 23:07:42.902774 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.899119 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f8e95541-01e9-4d65-921c-5ab7bf9593cb-image-registry-private-configuration\") pod \"image-registry-7d89fb7b67-khjgb\" (UID: \"f8e95541-01e9-4d65-921c-5ab7bf9593cb\") " pod="openshift-image-registry/image-registry-7d89fb7b67-khjgb" Sep 09 23:07:42.902774 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.899259 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/820c1525-62c1-4181-9a2f-aef3a2157d40-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-j5kg7\" (UID: \"820c1525-62c1-4181-9a2f-aef3a2157d40\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-j5kg7" Sep 09 23:07:42.903588 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.899301 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f8e95541-01e9-4d65-921c-5ab7bf9593cb-registry-certificates\") pod \"image-registry-7d89fb7b67-khjgb\" (UID: \"f8e95541-01e9-4d65-921c-5ab7bf9593cb\") " pod="openshift-image-registry/image-registry-7d89fb7b67-khjgb" Sep 09 23:07:42.903588 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.899330 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5d1340d6-3378-473e-a317-b8848b2fd4d8-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-6x6jq\" (UID: \"5d1340d6-3378-473e-a317-b8848b2fd4d8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-6x6jq" Sep 09 23:07:42.903588 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.899377 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22xjm\" (UniqueName: \"kubernetes.io/projected/ac335ac0-a272-420f-a215-b93e03772895-kube-api-access-22xjm\") pod \"console-operator-85b454874b-p2dvt\" (UID: \"ac335ac0-a272-420f-a215-b93e03772895\") " pod="openshift-console-operator/console-operator-85b454874b-p2dvt" Sep 09 23:07:42.903588 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.900091 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/820c1525-62c1-4181-9a2f-aef3a2157d40-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-j5kg7\" (UID: \"820c1525-62c1-4181-9a2f-aef3a2157d40\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-j5kg7" Sep 09 23:07:42.903588 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.901816 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2571894e-0cd5-4909-ad9e-240e1d667928-serving-cert\") pod \"service-ca-operator-859f94c4b-ttc7l\" (UID: \"2571894e-0cd5-4909-ad9e-240e1d667928\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-ttc7l" Sep 09 23:07:42.910522 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.910491 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h86ph\" (UniqueName: \"kubernetes.io/projected/820c1525-62c1-4181-9a2f-aef3a2157d40-kube-api-access-h86ph\") pod \"cluster-monitoring-operator-6cdcc96965-j5kg7\" (UID: \"820c1525-62c1-4181-9a2f-aef3a2157d40\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-j5kg7" Sep 09 23:07:42.910923 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:42.910903 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qv97\" (UniqueName: \"kubernetes.io/projected/2571894e-0cd5-4909-ad9e-240e1d667928-kube-api-access-9qv97\") pod \"service-ca-operator-859f94c4b-ttc7l\" (UID: \"2571894e-0cd5-4909-ad9e-240e1d667928\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-ttc7l" Sep 09 23:07:43.000843 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:43.000752 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/725fbc90-832a-494f-9852-5532a64baccc-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-p76j4\" (UID: \"725fbc90-832a-494f-9852-5532a64baccc\") " pod="openshift-insights/insights-operator-76bcd6ccf5-p76j4" Sep 09 23:07:43.000843 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:43.000800 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ac335ac0-a272-420f-a215-b93e03772895-trusted-ca\") pod \"console-operator-85b454874b-p2dvt\" (UID: \"ac335ac0-a272-420f-a215-b93e03772895\") " pod="openshift-console-operator/console-operator-85b454874b-p2dvt" Sep 09 23:07:43.000843 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:43.000819 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f8e95541-01e9-4d65-921c-5ab7bf9593cb-image-registry-private-configuration\") pod \"image-registry-7d89fb7b67-khjgb\" (UID: \"f8e95541-01e9-4d65-921c-5ab7bf9593cb\") " pod="openshift-image-registry/image-registry-7d89fb7b67-khjgb" Sep 09 23:07:43.001130 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:43.000851 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f8e95541-01e9-4d65-921c-5ab7bf9593cb-registry-certificates\") pod \"image-registry-7d89fb7b67-khjgb\" (UID: \"f8e95541-01e9-4d65-921c-5ab7bf9593cb\") " pod="openshift-image-registry/image-registry-7d89fb7b67-khjgb" Sep 09 23:07:43.001130 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:43.000869 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5d1340d6-3378-473e-a317-b8848b2fd4d8-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-6x6jq\" (UID: \"5d1340d6-3378-473e-a317-b8848b2fd4d8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-6x6jq" Sep 09 23:07:43.001130 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:43.000903 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22xjm\" (UniqueName: \"kubernetes.io/projected/ac335ac0-a272-420f-a215-b93e03772895-kube-api-access-22xjm\") pod \"console-operator-85b454874b-p2dvt\" (UID: \"ac335ac0-a272-420f-a215-b93e03772895\") " pod="openshift-console-operator/console-operator-85b454874b-p2dvt" Sep 09 23:07:43.001130 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:43.000923 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f8e95541-01e9-4d65-921c-5ab7bf9593cb-ca-trust-extracted\") pod \"image-registry-7d89fb7b67-khjgb\" (UID: \"f8e95541-01e9-4d65-921c-5ab7bf9593cb\") " pod="openshift-image-registry/image-registry-7d89fb7b67-khjgb" Sep 09 23:07:43.001130 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:43.001012 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/725fbc90-832a-494f-9852-5532a64baccc-tmp\") pod \"insights-operator-76bcd6ccf5-p76j4\" (UID: \"725fbc90-832a-494f-9852-5532a64baccc\") " pod="openshift-insights/insights-operator-76bcd6ccf5-p76j4" Sep 09 23:07:43.001130 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:43.001063 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9q87\" (UniqueName: \"kubernetes.io/projected/725fbc90-832a-494f-9852-5532a64baccc-kube-api-access-k9q87\") pod \"insights-operator-76bcd6ccf5-p76j4\" (UID: \"725fbc90-832a-494f-9852-5532a64baccc\") " pod="openshift-insights/insights-operator-76bcd6ccf5-p76j4" Sep 09 23:07:43.001130 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:43.001093 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f8e95541-01e9-4d65-921c-5ab7bf9593cb-bound-sa-token\") pod \"image-registry-7d89fb7b67-khjgb\" (UID: \"f8e95541-01e9-4d65-921c-5ab7bf9593cb\") " pod="openshift-image-registry/image-registry-7d89fb7b67-khjgb" Sep 09 23:07:43.001130 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:43.001121 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2pp2\" (UniqueName: \"kubernetes.io/projected/5d1340d6-3378-473e-a317-b8848b2fd4d8-kube-api-access-k2pp2\") pod \"cluster-samples-operator-7cdcfcf76c-6x6jq\" (UID: \"5d1340d6-3378-473e-a317-b8848b2fd4d8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-6x6jq" Sep 09 23:07:43.001510 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:43.001150 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ndp8t\" (UniqueName: \"kubernetes.io/projected/f8e95541-01e9-4d65-921c-5ab7bf9593cb-kube-api-access-ndp8t\") pod \"image-registry-7d89fb7b67-khjgb\" (UID: \"f8e95541-01e9-4d65-921c-5ab7bf9593cb\") " pod="openshift-image-registry/image-registry-7d89fb7b67-khjgb" Sep 09 23:07:43.001510 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:43.001181 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f8e95541-01e9-4d65-921c-5ab7bf9593cb-trusted-ca\") pod \"image-registry-7d89fb7b67-khjgb\" (UID: \"f8e95541-01e9-4d65-921c-5ab7bf9593cb\") " pod="openshift-image-registry/image-registry-7d89fb7b67-khjgb" Sep 09 23:07:43.001510 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:43.001225 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4m86\" (UniqueName: \"kubernetes.io/projected/cb0a0a03-0eaa-4cfa-b854-b33b511e321a-kube-api-access-h4m86\") pod \"volume-data-source-validator-695c895bd6-2cgr6\" (UID: \"cb0a0a03-0eaa-4cfa-b854-b33b511e321a\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-2cgr6" Sep 09 23:07:43.001510 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:43.001253 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/725fbc90-832a-494f-9852-5532a64baccc-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-p76j4\" (UID: \"725fbc90-832a-494f-9852-5532a64baccc\") " pod="openshift-insights/insights-operator-76bcd6ccf5-p76j4" Sep 09 23:07:43.001510 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:43.001277 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f8e95541-01e9-4d65-921c-5ab7bf9593cb-installation-pull-secrets\") pod \"image-registry-7d89fb7b67-khjgb\" (UID: \"f8e95541-01e9-4d65-921c-5ab7bf9593cb\") " pod="openshift-image-registry/image-registry-7d89fb7b67-khjgb" Sep 09 23:07:43.001510 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:43.001314 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ac335ac0-a272-420f-a215-b93e03772895-config\") pod \"console-operator-85b454874b-p2dvt\" (UID: \"ac335ac0-a272-420f-a215-b93e03772895\") " pod="openshift-console-operator/console-operator-85b454874b-p2dvt" Sep 09 23:07:43.001510 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:43.001326 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f8e95541-01e9-4d65-921c-5ab7bf9593cb-ca-trust-extracted\") pod \"image-registry-7d89fb7b67-khjgb\" (UID: \"f8e95541-01e9-4d65-921c-5ab7bf9593cb\") " pod="openshift-image-registry/image-registry-7d89fb7b67-khjgb" Sep 09 23:07:43.001510 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:43.001338 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ac335ac0-a272-420f-a215-b93e03772895-serving-cert\") pod \"console-operator-85b454874b-p2dvt\" (UID: \"ac335ac0-a272-420f-a215-b93e03772895\") " pod="openshift-console-operator/console-operator-85b454874b-p2dvt" Sep 09 23:07:43.001510 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:43.001393 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/725fbc90-832a-494f-9852-5532a64baccc-snapshots\") pod \"insights-operator-76bcd6ccf5-p76j4\" (UID: \"725fbc90-832a-494f-9852-5532a64baccc\") " pod="openshift-insights/insights-operator-76bcd6ccf5-p76j4" Sep 09 23:07:43.001510 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:43.001417 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/725fbc90-832a-494f-9852-5532a64baccc-tmp\") pod \"insights-operator-76bcd6ccf5-p76j4\" (UID: \"725fbc90-832a-494f-9852-5532a64baccc\") " pod="openshift-insights/insights-operator-76bcd6ccf5-p76j4" Sep 09 23:07:43.001510 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:43.001425 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f8e95541-01e9-4d65-921c-5ab7bf9593cb-registry-tls\") pod \"image-registry-7d89fb7b67-khjgb\" (UID: \"f8e95541-01e9-4d65-921c-5ab7bf9593cb\") " pod="openshift-image-registry/image-registry-7d89fb7b67-khjgb" Sep 09 23:07:43.001510 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:43.001461 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/725fbc90-832a-494f-9852-5532a64baccc-serving-cert\") pod \"insights-operator-76bcd6ccf5-p76j4\" (UID: \"725fbc90-832a-494f-9852-5532a64baccc\") " pod="openshift-insights/insights-operator-76bcd6ccf5-p76j4" Sep 09 23:07:43.001510 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:43.001491 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4d9q7\" (UniqueName: \"kubernetes.io/projected/936a6e13-148d-4957-8161-0ed8edf9c89e-kube-api-access-4d9q7\") pod \"network-check-source-685456655f-p2sfk\" (UID: \"936a6e13-148d-4957-8161-0ed8edf9c89e\") " pod="openshift-network-diagnostics/network-check-source-685456655f-p2sfk" Sep 09 23:07:43.002244 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:43.001530 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f8e95541-01e9-4d65-921c-5ab7bf9593cb-registry-certificates\") pod \"image-registry-7d89fb7b67-khjgb\" (UID: \"f8e95541-01e9-4d65-921c-5ab7bf9593cb\") " pod="openshift-image-registry/image-registry-7d89fb7b67-khjgb" Sep 09 23:07:43.002244 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:43.001490 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/725fbc90-832a-494f-9852-5532a64baccc-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-p76j4\" (UID: \"725fbc90-832a-494f-9852-5532a64baccc\") " pod="openshift-insights/insights-operator-76bcd6ccf5-p76j4" Sep 09 23:07:43.002244 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:43.001800 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ac335ac0-a272-420f-a215-b93e03772895-trusted-ca\") pod \"console-operator-85b454874b-p2dvt\" (UID: \"ac335ac0-a272-420f-a215-b93e03772895\") " pod="openshift-console-operator/console-operator-85b454874b-p2dvt" Sep 09 23:07:43.002244 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:43.001996 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/725fbc90-832a-494f-9852-5532a64baccc-snapshots\") pod \"insights-operator-76bcd6ccf5-p76j4\" (UID: \"725fbc90-832a-494f-9852-5532a64baccc\") " pod="openshift-insights/insights-operator-76bcd6ccf5-p76j4" Sep 09 23:07:43.002244 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:07:43.002081 2552 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 09 23:07:43.002244 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:07:43.002095 2552 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d89fb7b67-khjgb: secret "image-registry-tls" not found Sep 09 23:07:43.002244 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:07:43.002156 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f8e95541-01e9-4d65-921c-5ab7bf9593cb-registry-tls podName:f8e95541-01e9-4d65-921c-5ab7bf9593cb nodeName:}" failed. No retries permitted until 2026-09-09 23:07:43.502138472 +0000 UTC m=+234.017869282 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f8e95541-01e9-4d65-921c-5ab7bf9593cb-registry-tls") pod "image-registry-7d89fb7b67-khjgb" (UID: "f8e95541-01e9-4d65-921c-5ab7bf9593cb") : secret "image-registry-tls" not found Sep 09 23:07:43.002611 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:43.002320 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f8e95541-01e9-4d65-921c-5ab7bf9593cb-trusted-ca\") pod \"image-registry-7d89fb7b67-khjgb\" (UID: \"f8e95541-01e9-4d65-921c-5ab7bf9593cb\") " pod="openshift-image-registry/image-registry-7d89fb7b67-khjgb" Sep 09 23:07:43.002611 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:07:43.002340 2552 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 09 23:07:43.002611 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:07:43.002416 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d1340d6-3378-473e-a317-b8848b2fd4d8-samples-operator-tls podName:5d1340d6-3378-473e-a317-b8848b2fd4d8 nodeName:}" failed. No retries permitted until 2026-09-09 23:07:43.502398452 +0000 UTC m=+234.018129264 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5d1340d6-3378-473e-a317-b8848b2fd4d8-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-6x6jq" (UID: "5d1340d6-3378-473e-a317-b8848b2fd4d8") : secret "samples-operator-tls" not found Sep 09 23:07:43.002906 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:43.002882 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/725fbc90-832a-494f-9852-5532a64baccc-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-p76j4\" (UID: \"725fbc90-832a-494f-9852-5532a64baccc\") " pod="openshift-insights/insights-operator-76bcd6ccf5-p76j4" Sep 09 23:07:43.002976 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:43.002964 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ac335ac0-a272-420f-a215-b93e03772895-config\") pod \"console-operator-85b454874b-p2dvt\" (UID: \"ac335ac0-a272-420f-a215-b93e03772895\") " pod="openshift-console-operator/console-operator-85b454874b-p2dvt" Sep 09 23:07:43.003925 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:43.003891 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f8e95541-01e9-4d65-921c-5ab7bf9593cb-image-registry-private-configuration\") pod \"image-registry-7d89fb7b67-khjgb\" (UID: \"f8e95541-01e9-4d65-921c-5ab7bf9593cb\") " pod="openshift-image-registry/image-registry-7d89fb7b67-khjgb" Sep 09 23:07:43.004045 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:43.003927 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ac335ac0-a272-420f-a215-b93e03772895-serving-cert\") pod \"console-operator-85b454874b-p2dvt\" (UID: \"ac335ac0-a272-420f-a215-b93e03772895\") " pod="openshift-console-operator/console-operator-85b454874b-p2dvt" Sep 09 23:07:43.004333 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:43.004312 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/725fbc90-832a-494f-9852-5532a64baccc-serving-cert\") pod \"insights-operator-76bcd6ccf5-p76j4\" (UID: \"725fbc90-832a-494f-9852-5532a64baccc\") " pod="openshift-insights/insights-operator-76bcd6ccf5-p76j4" Sep 09 23:07:43.004386 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:43.004318 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f8e95541-01e9-4d65-921c-5ab7bf9593cb-installation-pull-secrets\") pod \"image-registry-7d89fb7b67-khjgb\" (UID: \"f8e95541-01e9-4d65-921c-5ab7bf9593cb\") " pod="openshift-image-registry/image-registry-7d89fb7b67-khjgb" Sep 09 23:07:43.010976 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:43.010944 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-22xjm\" (UniqueName: \"kubernetes.io/projected/ac335ac0-a272-420f-a215-b93e03772895-kube-api-access-22xjm\") pod \"console-operator-85b454874b-p2dvt\" (UID: \"ac335ac0-a272-420f-a215-b93e03772895\") " pod="openshift-console-operator/console-operator-85b454874b-p2dvt" Sep 09 23:07:43.011405 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:43.011345 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndp8t\" (UniqueName: \"kubernetes.io/projected/f8e95541-01e9-4d65-921c-5ab7bf9593cb-kube-api-access-ndp8t\") pod \"image-registry-7d89fb7b67-khjgb\" (UID: \"f8e95541-01e9-4d65-921c-5ab7bf9593cb\") " pod="openshift-image-registry/image-registry-7d89fb7b67-khjgb" Sep 09 23:07:43.011625 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:43.011563 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9q87\" (UniqueName: \"kubernetes.io/projected/725fbc90-832a-494f-9852-5532a64baccc-kube-api-access-k9q87\") pod \"insights-operator-76bcd6ccf5-p76j4\" (UID: \"725fbc90-832a-494f-9852-5532a64baccc\") " pod="openshift-insights/insights-operator-76bcd6ccf5-p76j4" Sep 09 23:07:43.011625 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:43.011583 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4m86\" (UniqueName: \"kubernetes.io/projected/cb0a0a03-0eaa-4cfa-b854-b33b511e321a-kube-api-access-h4m86\") pod \"volume-data-source-validator-695c895bd6-2cgr6\" (UID: \"cb0a0a03-0eaa-4cfa-b854-b33b511e321a\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-2cgr6" Sep 09 23:07:43.011832 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:43.011759 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4d9q7\" (UniqueName: \"kubernetes.io/projected/936a6e13-148d-4957-8161-0ed8edf9c89e-kube-api-access-4d9q7\") pod \"network-check-source-685456655f-p2sfk\" (UID: \"936a6e13-148d-4957-8161-0ed8edf9c89e\") " pod="openshift-network-diagnostics/network-check-source-685456655f-p2sfk" Sep 09 23:07:43.011891 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:43.011859 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f8e95541-01e9-4d65-921c-5ab7bf9593cb-bound-sa-token\") pod \"image-registry-7d89fb7b67-khjgb\" (UID: \"f8e95541-01e9-4d65-921c-5ab7bf9593cb\") " pod="openshift-image-registry/image-registry-7d89fb7b67-khjgb" Sep 09 23:07:43.012009 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:43.011987 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2pp2\" (UniqueName: \"kubernetes.io/projected/5d1340d6-3378-473e-a317-b8848b2fd4d8-kube-api-access-k2pp2\") pod \"cluster-samples-operator-7cdcfcf76c-6x6jq\" (UID: \"5d1340d6-3378-473e-a317-b8848b2fd4d8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-6x6jq" Sep 09 23:07:43.050819 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:43.050766 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-ttc7l" Sep 09 23:07:43.067224 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:43.067193 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-p76j4" Sep 09 23:07:43.071400 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:43.071384 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-p2dvt" Sep 09 23:07:43.144043 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:43.144014 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-2cgr6" Sep 09 23:07:43.153181 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:43.153080 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-p2sfk" Sep 09 23:07:43.322794 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:43.322717 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-ttc7l"] Sep 09 23:07:43.326145 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:07:43.326117 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2571894e_0cd5_4909_ad9e_240e1d667928.slice/crio-63a6eece7f3d77dd7f3de5e6da4dd4925e5576b92cf199950977a0b699904803 WatchSource:0}: Error finding container 63a6eece7f3d77dd7f3de5e6da4dd4925e5576b92cf199950977a0b699904803: Status 404 returned error can't find the container with id 63a6eece7f3d77dd7f3de5e6da4dd4925e5576b92cf199950977a0b699904803 Sep 09 23:07:43.345245 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:43.345212 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-p76j4"] Sep 09 23:07:43.348349 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:07:43.348320 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod725fbc90_832a_494f_9852_5532a64baccc.slice/crio-e193532199ea63bee472097c6bc697e74302fc002f62b7e61d487d03c98335e2 WatchSource:0}: Error finding container e193532199ea63bee472097c6bc697e74302fc002f62b7e61d487d03c98335e2: Status 404 returned error can't find the container with id e193532199ea63bee472097c6bc697e74302fc002f62b7e61d487d03c98335e2 Sep 09 23:07:43.355510 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:43.355450 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-p2dvt"] Sep 09 23:07:43.359189 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:07:43.359165 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac335ac0_a272_420f_a215_b93e03772895.slice/crio-c7e4dd466740f59b1b51e4f63287907444700e6beb1c4dd4f3500ad20b093a24 WatchSource:0}: Error finding container c7e4dd466740f59b1b51e4f63287907444700e6beb1c4dd4f3500ad20b093a24: Status 404 returned error can't find the container with id c7e4dd466740f59b1b51e4f63287907444700e6beb1c4dd4f3500ad20b093a24 Sep 09 23:07:43.406823 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:43.406789 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/820c1525-62c1-4181-9a2f-aef3a2157d40-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-j5kg7\" (UID: \"820c1525-62c1-4181-9a2f-aef3a2157d40\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-j5kg7" Sep 09 23:07:43.406972 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:07:43.406933 2552 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 09 23:07:43.407015 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:07:43.406996 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/820c1525-62c1-4181-9a2f-aef3a2157d40-cluster-monitoring-operator-tls podName:820c1525-62c1-4181-9a2f-aef3a2157d40 nodeName:}" failed. No retries permitted until 2026-09-09 23:07:44.40698196 +0000 UTC m=+234.922712768 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/820c1525-62c1-4181-9a2f-aef3a2157d40-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-j5kg7" (UID: "820c1525-62c1-4181-9a2f-aef3a2157d40") : secret "cluster-monitoring-operator-tls" not found Sep 09 23:07:43.418018 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:43.417984 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-2cgr6"] Sep 09 23:07:43.421051 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:07:43.421031 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb0a0a03_0eaa_4cfa_b854_b33b511e321a.slice/crio-1fd6ff57297635cf8ee81cddde4ee668152d04bd060a618dc3426d9d4509ead2 WatchSource:0}: Error finding container 1fd6ff57297635cf8ee81cddde4ee668152d04bd060a618dc3426d9d4509ead2: Status 404 returned error can't find the container with id 1fd6ff57297635cf8ee81cddde4ee668152d04bd060a618dc3426d9d4509ead2 Sep 09 23:07:43.440131 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:43.440098 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-p2sfk"] Sep 09 23:07:43.442578 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:07:43.442551 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod936a6e13_148d_4957_8161_0ed8edf9c89e.slice/crio-c55cebfdf78e816ac915abc5efb2fd0fa72148f1964ab23619da8f3e32f5c77d WatchSource:0}: Error finding container c55cebfdf78e816ac915abc5efb2fd0fa72148f1964ab23619da8f3e32f5c77d: Status 404 returned error can't find the container with id c55cebfdf78e816ac915abc5efb2fd0fa72148f1964ab23619da8f3e32f5c77d Sep 09 23:07:43.507908 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:43.507877 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f8e95541-01e9-4d65-921c-5ab7bf9593cb-registry-tls\") pod \"image-registry-7d89fb7b67-khjgb\" (UID: \"f8e95541-01e9-4d65-921c-5ab7bf9593cb\") " pod="openshift-image-registry/image-registry-7d89fb7b67-khjgb" Sep 09 23:07:43.508066 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:43.507940 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5d1340d6-3378-473e-a317-b8848b2fd4d8-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-6x6jq\" (UID: \"5d1340d6-3378-473e-a317-b8848b2fd4d8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-6x6jq" Sep 09 23:07:43.508066 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:07:43.508034 2552 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 09 23:07:43.508066 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:07:43.508054 2552 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d89fb7b67-khjgb: secret "image-registry-tls" not found Sep 09 23:07:43.508066 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:07:43.508056 2552 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 09 23:07:43.508210 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:07:43.508103 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f8e95541-01e9-4d65-921c-5ab7bf9593cb-registry-tls podName:f8e95541-01e9-4d65-921c-5ab7bf9593cb nodeName:}" failed. No retries permitted until 2026-09-09 23:07:44.508086518 +0000 UTC m=+235.023817326 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f8e95541-01e9-4d65-921c-5ab7bf9593cb-registry-tls") pod "image-registry-7d89fb7b67-khjgb" (UID: "f8e95541-01e9-4d65-921c-5ab7bf9593cb") : secret "image-registry-tls" not found Sep 09 23:07:43.508210 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:07:43.508119 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d1340d6-3378-473e-a317-b8848b2fd4d8-samples-operator-tls podName:5d1340d6-3378-473e-a317-b8848b2fd4d8 nodeName:}" failed. No retries permitted until 2026-09-09 23:07:44.508111498 +0000 UTC m=+235.023842306 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5d1340d6-3378-473e-a317-b8848b2fd4d8-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-6x6jq" (UID: "5d1340d6-3378-473e-a317-b8848b2fd4d8") : secret "samples-operator-tls" not found Sep 09 23:07:43.647406 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:43.647361 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-p76j4" event={"ID":"725fbc90-832a-494f-9852-5532a64baccc","Type":"ContainerStarted","Data":"e193532199ea63bee472097c6bc697e74302fc002f62b7e61d487d03c98335e2"} Sep 09 23:07:43.648654 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:43.648620 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-ttc7l" event={"ID":"2571894e-0cd5-4909-ad9e-240e1d667928","Type":"ContainerStarted","Data":"63a6eece7f3d77dd7f3de5e6da4dd4925e5576b92cf199950977a0b699904803"} Sep 09 23:07:43.649791 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:43.649759 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-2cgr6" event={"ID":"cb0a0a03-0eaa-4cfa-b854-b33b511e321a","Type":"ContainerStarted","Data":"1fd6ff57297635cf8ee81cddde4ee668152d04bd060a618dc3426d9d4509ead2"} Sep 09 23:07:43.651301 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:43.651272 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-p2sfk" event={"ID":"936a6e13-148d-4957-8161-0ed8edf9c89e","Type":"ContainerStarted","Data":"42afdf61f82b9af6c1515d0b931cf12dcfac2a4e5acd6a63e339a00743e3e31b"} Sep 09 23:07:43.651426 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:43.651319 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-p2sfk" event={"ID":"936a6e13-148d-4957-8161-0ed8edf9c89e","Type":"ContainerStarted","Data":"c55cebfdf78e816ac915abc5efb2fd0fa72148f1964ab23619da8f3e32f5c77d"} Sep 09 23:07:43.652367 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:43.652342 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-p2dvt" event={"ID":"ac335ac0-a272-420f-a215-b93e03772895","Type":"ContainerStarted","Data":"c7e4dd466740f59b1b51e4f63287907444700e6beb1c4dd4f3500ad20b093a24"} Sep 09 23:07:43.666196 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:43.666139 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-685456655f-p2sfk" podStartSLOduration=1.6661238919999999 podStartE2EDuration="1.666123892s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:07:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:07:43.665341598 +0000 UTC m=+234.181072430" watchObservedRunningTime="2026-09-09 23:07:43.666123892 +0000 UTC m=+234.181854713" Sep 09 23:07:44.414940 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:44.414313 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/820c1525-62c1-4181-9a2f-aef3a2157d40-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-j5kg7\" (UID: \"820c1525-62c1-4181-9a2f-aef3a2157d40\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-j5kg7" Sep 09 23:07:44.414940 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:07:44.414482 2552 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 09 23:07:44.414940 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:07:44.414545 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/820c1525-62c1-4181-9a2f-aef3a2157d40-cluster-monitoring-operator-tls podName:820c1525-62c1-4181-9a2f-aef3a2157d40 nodeName:}" failed. No retries permitted until 2026-09-09 23:07:46.414526005 +0000 UTC m=+236.930256818 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/820c1525-62c1-4181-9a2f-aef3a2157d40-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-j5kg7" (UID: "820c1525-62c1-4181-9a2f-aef3a2157d40") : secret "cluster-monitoring-operator-tls" not found Sep 09 23:07:44.515955 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:44.515552 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5d1340d6-3378-473e-a317-b8848b2fd4d8-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-6x6jq\" (UID: \"5d1340d6-3378-473e-a317-b8848b2fd4d8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-6x6jq" Sep 09 23:07:44.515955 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:44.515683 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f8e95541-01e9-4d65-921c-5ab7bf9593cb-registry-tls\") pod \"image-registry-7d89fb7b67-khjgb\" (UID: \"f8e95541-01e9-4d65-921c-5ab7bf9593cb\") " pod="openshift-image-registry/image-registry-7d89fb7b67-khjgb" Sep 09 23:07:44.515955 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:07:44.515840 2552 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 09 23:07:44.515955 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:07:44.515858 2552 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d89fb7b67-khjgb: secret "image-registry-tls" not found Sep 09 23:07:44.515955 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:07:44.515879 2552 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 09 23:07:44.515955 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:07:44.515914 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f8e95541-01e9-4d65-921c-5ab7bf9593cb-registry-tls podName:f8e95541-01e9-4d65-921c-5ab7bf9593cb nodeName:}" failed. No retries permitted until 2026-09-09 23:07:46.515896972 +0000 UTC m=+237.031627798 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f8e95541-01e9-4d65-921c-5ab7bf9593cb-registry-tls") pod "image-registry-7d89fb7b67-khjgb" (UID: "f8e95541-01e9-4d65-921c-5ab7bf9593cb") : secret "image-registry-tls" not found Sep 09 23:07:44.515955 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:07:44.515932 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d1340d6-3378-473e-a317-b8848b2fd4d8-samples-operator-tls podName:5d1340d6-3378-473e-a317-b8848b2fd4d8 nodeName:}" failed. No retries permitted until 2026-09-09 23:07:46.515923135 +0000 UTC m=+237.031653945 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5d1340d6-3378-473e-a317-b8848b2fd4d8-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-6x6jq" (UID: "5d1340d6-3378-473e-a317-b8848b2fd4d8") : secret "samples-operator-tls" not found Sep 09 23:07:45.663632 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:45.663595 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-2cgr6" event={"ID":"cb0a0a03-0eaa-4cfa-b854-b33b511e321a","Type":"ContainerStarted","Data":"bbaa392106d8b7191df9170cc2d9249e5ac471fe5722f08c478a1ba7652681cc"} Sep 09 23:07:45.686118 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:45.686045 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-2cgr6" podStartSLOduration=2.105139625 podStartE2EDuration="3.686020354s" totalImagesPullingTime="1.580880729s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:07:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:07:45.678909455 +0000 UTC m=+236.194640296" watchObservedRunningTime="2026-09-09 23:07:45.686020354 +0000 UTC m=+236.201751187" Sep 09 23:07:46.433729 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:46.433656 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/820c1525-62c1-4181-9a2f-aef3a2157d40-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-j5kg7\" (UID: \"820c1525-62c1-4181-9a2f-aef3a2157d40\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-j5kg7" Sep 09 23:07:46.433906 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:07:46.433819 2552 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 09 23:07:46.433962 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:07:46.433908 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/820c1525-62c1-4181-9a2f-aef3a2157d40-cluster-monitoring-operator-tls podName:820c1525-62c1-4181-9a2f-aef3a2157d40 nodeName:}" failed. No retries permitted until 2026-09-09 23:07:50.433892066 +0000 UTC m=+240.949622874 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/820c1525-62c1-4181-9a2f-aef3a2157d40-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-j5kg7" (UID: "820c1525-62c1-4181-9a2f-aef3a2157d40") : secret "cluster-monitoring-operator-tls" not found Sep 09 23:07:46.535085 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:46.535044 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5d1340d6-3378-473e-a317-b8848b2fd4d8-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-6x6jq\" (UID: \"5d1340d6-3378-473e-a317-b8848b2fd4d8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-6x6jq" Sep 09 23:07:46.535257 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:46.535141 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f8e95541-01e9-4d65-921c-5ab7bf9593cb-registry-tls\") pod \"image-registry-7d89fb7b67-khjgb\" (UID: \"f8e95541-01e9-4d65-921c-5ab7bf9593cb\") " pod="openshift-image-registry/image-registry-7d89fb7b67-khjgb" Sep 09 23:07:46.535257 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:07:46.535246 2552 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 09 23:07:46.535380 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:07:46.535261 2552 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d89fb7b67-khjgb: secret "image-registry-tls" not found Sep 09 23:07:46.535380 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:07:46.535321 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f8e95541-01e9-4d65-921c-5ab7bf9593cb-registry-tls podName:f8e95541-01e9-4d65-921c-5ab7bf9593cb nodeName:}" failed. No retries permitted until 2026-09-09 23:07:50.535303745 +0000 UTC m=+241.051034554 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f8e95541-01e9-4d65-921c-5ab7bf9593cb-registry-tls") pod "image-registry-7d89fb7b67-khjgb" (UID: "f8e95541-01e9-4d65-921c-5ab7bf9593cb") : secret "image-registry-tls" not found Sep 09 23:07:46.535380 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:07:46.535245 2552 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 09 23:07:46.535529 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:07:46.535420 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d1340d6-3378-473e-a317-b8848b2fd4d8-samples-operator-tls podName:5d1340d6-3378-473e-a317-b8848b2fd4d8 nodeName:}" failed. No retries permitted until 2026-09-09 23:07:50.535398989 +0000 UTC m=+241.051129799 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5d1340d6-3378-473e-a317-b8848b2fd4d8-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-6x6jq" (UID: "5d1340d6-3378-473e-a317-b8848b2fd4d8") : secret "samples-operator-tls" not found Sep 09 23:07:47.655505 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:47.655472 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-9pglj"] Sep 09 23:07:47.658790 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:47.658770 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9pglj" Sep 09 23:07:47.660937 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:47.660907 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 09 23:07:47.661063 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:47.660907 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 09 23:07:47.661063 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:47.660947 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6xppp\"" Sep 09 23:07:47.668538 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:47.668514 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9pglj"] Sep 09 23:07:47.672446 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:47.672412 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-p2dvt_ac335ac0-a272-420f-a215-b93e03772895/console-operator/0.log" Sep 09 23:07:47.672619 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:47.672469 2552 generic.go:356] "Generic (PLEG): container finished" podID="ac335ac0-a272-420f-a215-b93e03772895" containerID="50bd5916d365cce314c6e1c3a22fceaa1357958d3d994f1f8095a9ff6c1b3ac5" exitCode=255 Sep 09 23:07:47.672619 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:47.672564 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-p2dvt" event={"ID":"ac335ac0-a272-420f-a215-b93e03772895","Type":"ContainerDied","Data":"50bd5916d365cce314c6e1c3a22fceaa1357958d3d994f1f8095a9ff6c1b3ac5"} Sep 09 23:07:47.672882 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:47.672861 2552 scope.go:117] "RemoveContainer" containerID="50bd5916d365cce314c6e1c3a22fceaa1357958d3d994f1f8095a9ff6c1b3ac5" Sep 09 23:07:47.675012 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:47.674981 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-p76j4" event={"ID":"725fbc90-832a-494f-9852-5532a64baccc","Type":"ContainerStarted","Data":"0c0fb037edb0c5d224630e40be26a77c0d21c34095509e5c56ccf68056bc3364"} Sep 09 23:07:47.676712 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:47.676656 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-ttc7l" event={"ID":"2571894e-0cd5-4909-ad9e-240e1d667928","Type":"ContainerStarted","Data":"3002e349bcb7985c33a4c1d9f0b3a4c836642c8d0d80c430e30bbe915ce765ea"} Sep 09 23:07:47.712398 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:47.712352 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-76bcd6ccf5-p76j4" podStartSLOduration=2.386776363 podStartE2EDuration="5.71232991s" totalImagesPullingTime="3.325553547s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:07:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:07:47.711559385 +0000 UTC m=+238.227290216" watchObservedRunningTime="2026-09-09 23:07:47.71232991 +0000 UTC m=+238.228060734" Sep 09 23:07:47.728607 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:47.728549 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-ttc7l" podStartSLOduration=2.382745973 podStartE2EDuration="5.728527039s" totalImagesPullingTime="3.345781066s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:07:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:07:47.728284198 +0000 UTC m=+238.244015039" watchObservedRunningTime="2026-09-09 23:07:47.728527039 +0000 UTC m=+238.244257869" Sep 09 23:07:47.744869 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:47.744827 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/061f6ffa-34f9-499c-97f8-b1bc0febefdd-data-volume\") pod \"insights-runtime-extractor-9pglj\" (UID: \"061f6ffa-34f9-499c-97f8-b1bc0febefdd\") " pod="openshift-insights/insights-runtime-extractor-9pglj" Sep 09 23:07:47.745004 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:47.744906 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/061f6ffa-34f9-499c-97f8-b1bc0febefdd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9pglj\" (UID: \"061f6ffa-34f9-499c-97f8-b1bc0febefdd\") " pod="openshift-insights/insights-runtime-extractor-9pglj" Sep 09 23:07:47.745004 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:47.744970 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/061f6ffa-34f9-499c-97f8-b1bc0febefdd-crio-socket\") pod \"insights-runtime-extractor-9pglj\" (UID: \"061f6ffa-34f9-499c-97f8-b1bc0febefdd\") " pod="openshift-insights/insights-runtime-extractor-9pglj" Sep 09 23:07:47.745646 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:47.745468 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/061f6ffa-34f9-499c-97f8-b1bc0febefdd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9pglj\" (UID: \"061f6ffa-34f9-499c-97f8-b1bc0febefdd\") " pod="openshift-insights/insights-runtime-extractor-9pglj" Sep 09 23:07:47.745646 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:47.745609 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48hnj\" (UniqueName: \"kubernetes.io/projected/061f6ffa-34f9-499c-97f8-b1bc0febefdd-kube-api-access-48hnj\") pod \"insights-runtime-extractor-9pglj\" (UID: \"061f6ffa-34f9-499c-97f8-b1bc0febefdd\") " pod="openshift-insights/insights-runtime-extractor-9pglj" Sep 09 23:07:47.846141 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:47.846098 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/061f6ffa-34f9-499c-97f8-b1bc0febefdd-crio-socket\") pod \"insights-runtime-extractor-9pglj\" (UID: \"061f6ffa-34f9-499c-97f8-b1bc0febefdd\") " pod="openshift-insights/insights-runtime-extractor-9pglj" Sep 09 23:07:47.846337 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:47.846192 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/061f6ffa-34f9-499c-97f8-b1bc0febefdd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9pglj\" (UID: \"061f6ffa-34f9-499c-97f8-b1bc0febefdd\") " pod="openshift-insights/insights-runtime-extractor-9pglj" Sep 09 23:07:47.846337 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:47.846256 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/061f6ffa-34f9-499c-97f8-b1bc0febefdd-crio-socket\") pod \"insights-runtime-extractor-9pglj\" (UID: \"061f6ffa-34f9-499c-97f8-b1bc0febefdd\") " pod="openshift-insights/insights-runtime-extractor-9pglj" Sep 09 23:07:47.846337 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:47.846283 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48hnj\" (UniqueName: \"kubernetes.io/projected/061f6ffa-34f9-499c-97f8-b1bc0febefdd-kube-api-access-48hnj\") pod \"insights-runtime-extractor-9pglj\" (UID: \"061f6ffa-34f9-499c-97f8-b1bc0febefdd\") " pod="openshift-insights/insights-runtime-extractor-9pglj" Sep 09 23:07:47.846337 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:47.846331 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/061f6ffa-34f9-499c-97f8-b1bc0febefdd-data-volume\") pod \"insights-runtime-extractor-9pglj\" (UID: \"061f6ffa-34f9-499c-97f8-b1bc0febefdd\") " pod="openshift-insights/insights-runtime-extractor-9pglj" Sep 09 23:07:47.846549 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:07:47.846369 2552 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 09 23:07:47.846549 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:47.846382 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/061f6ffa-34f9-499c-97f8-b1bc0febefdd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9pglj\" (UID: \"061f6ffa-34f9-499c-97f8-b1bc0febefdd\") " pod="openshift-insights/insights-runtime-extractor-9pglj" Sep 09 23:07:47.846549 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:07:47.846449 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/061f6ffa-34f9-499c-97f8-b1bc0febefdd-insights-runtime-extractor-tls podName:061f6ffa-34f9-499c-97f8-b1bc0febefdd nodeName:}" failed. No retries permitted until 2026-09-09 23:07:48.346427596 +0000 UTC m=+238.862158408 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/061f6ffa-34f9-499c-97f8-b1bc0febefdd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9pglj" (UID: "061f6ffa-34f9-499c-97f8-b1bc0febefdd") : secret "insights-runtime-extractor-tls" not found Sep 09 23:07:47.846549 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:07:47.846479 2552 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 09 23:07:47.846549 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:07:47.846533 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/061f6ffa-34f9-499c-97f8-b1bc0febefdd-kube-rbac-proxy-cm podName:061f6ffa-34f9-499c-97f8-b1bc0febefdd nodeName:}" failed. No retries permitted until 2026-09-09 23:07:48.346516865 +0000 UTC m=+238.862247680 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/061f6ffa-34f9-499c-97f8-b1bc0febefdd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9pglj" (UID: "061f6ffa-34f9-499c-97f8-b1bc0febefdd") : configmap "kube-rbac-proxy" not found Sep 09 23:07:47.846917 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:47.846898 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/061f6ffa-34f9-499c-97f8-b1bc0febefdd-data-volume\") pod \"insights-runtime-extractor-9pglj\" (UID: \"061f6ffa-34f9-499c-97f8-b1bc0febefdd\") " pod="openshift-insights/insights-runtime-extractor-9pglj" Sep 09 23:07:47.853965 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:47.853938 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-48hnj\" (UniqueName: \"kubernetes.io/projected/061f6ffa-34f9-499c-97f8-b1bc0febefdd-kube-api-access-48hnj\") pod \"insights-runtime-extractor-9pglj\" (UID: \"061f6ffa-34f9-499c-97f8-b1bc0febefdd\") " pod="openshift-insights/insights-runtime-extractor-9pglj" Sep 09 23:07:48.350488 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:48.350442 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/061f6ffa-34f9-499c-97f8-b1bc0febefdd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9pglj\" (UID: \"061f6ffa-34f9-499c-97f8-b1bc0febefdd\") " pod="openshift-insights/insights-runtime-extractor-9pglj" Sep 09 23:07:48.350695 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:48.350517 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/061f6ffa-34f9-499c-97f8-b1bc0febefdd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9pglj\" (UID: \"061f6ffa-34f9-499c-97f8-b1bc0febefdd\") " pod="openshift-insights/insights-runtime-extractor-9pglj" Sep 09 23:07:48.350695 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:07:48.350567 2552 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 09 23:07:48.350695 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:07:48.350637 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/061f6ffa-34f9-499c-97f8-b1bc0febefdd-kube-rbac-proxy-cm podName:061f6ffa-34f9-499c-97f8-b1bc0febefdd nodeName:}" failed. No retries permitted until 2026-09-09 23:07:49.35061967 +0000 UTC m=+239.866350494 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/061f6ffa-34f9-499c-97f8-b1bc0febefdd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9pglj" (UID: "061f6ffa-34f9-499c-97f8-b1bc0febefdd") : configmap "kube-rbac-proxy" not found Sep 09 23:07:48.350695 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:07:48.350660 2552 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 09 23:07:48.350846 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:07:48.350735 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/061f6ffa-34f9-499c-97f8-b1bc0febefdd-insights-runtime-extractor-tls podName:061f6ffa-34f9-499c-97f8-b1bc0febefdd nodeName:}" failed. No retries permitted until 2026-09-09 23:07:49.350721295 +0000 UTC m=+239.866452108 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/061f6ffa-34f9-499c-97f8-b1bc0febefdd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9pglj" (UID: "061f6ffa-34f9-499c-97f8-b1bc0febefdd") : secret "insights-runtime-extractor-tls" not found Sep 09 23:07:48.681569 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:48.681537 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-p2dvt_ac335ac0-a272-420f-a215-b93e03772895/console-operator/1.log" Sep 09 23:07:48.682030 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:48.682014 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-p2dvt_ac335ac0-a272-420f-a215-b93e03772895/console-operator/0.log" Sep 09 23:07:48.682086 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:48.682068 2552 generic.go:356] "Generic (PLEG): container finished" podID="ac335ac0-a272-420f-a215-b93e03772895" containerID="998bfbed9c944492881000786ef11192f665ffb5b1d1632673f6ad513af08b90" exitCode=255 Sep 09 23:07:48.682176 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:48.682147 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-p2dvt" event={"ID":"ac335ac0-a272-420f-a215-b93e03772895","Type":"ContainerDied","Data":"998bfbed9c944492881000786ef11192f665ffb5b1d1632673f6ad513af08b90"} Sep 09 23:07:48.682239 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:48.682209 2552 scope.go:117] "RemoveContainer" containerID="50bd5916d365cce314c6e1c3a22fceaa1357958d3d994f1f8095a9ff6c1b3ac5" Sep 09 23:07:48.682445 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:48.682418 2552 scope.go:117] "RemoveContainer" containerID="998bfbed9c944492881000786ef11192f665ffb5b1d1632673f6ad513af08b90" Sep 09 23:07:48.682643 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:07:48.682621 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-p2dvt_openshift-console-operator(ac335ac0-a272-420f-a215-b93e03772895)\"" pod="openshift-console-operator/console-operator-85b454874b-p2dvt" podUID="ac335ac0-a272-420f-a215-b93e03772895" Sep 09 23:07:49.360194 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:49.360149 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/061f6ffa-34f9-499c-97f8-b1bc0febefdd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9pglj\" (UID: \"061f6ffa-34f9-499c-97f8-b1bc0febefdd\") " pod="openshift-insights/insights-runtime-extractor-9pglj" Sep 09 23:07:49.360399 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:07:49.360222 2552 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 09 23:07:49.360399 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:49.360260 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/061f6ffa-34f9-499c-97f8-b1bc0febefdd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9pglj\" (UID: \"061f6ffa-34f9-499c-97f8-b1bc0febefdd\") " pod="openshift-insights/insights-runtime-extractor-9pglj" Sep 09 23:07:49.360399 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:07:49.360295 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/061f6ffa-34f9-499c-97f8-b1bc0febefdd-kube-rbac-proxy-cm podName:061f6ffa-34f9-499c-97f8-b1bc0febefdd nodeName:}" failed. No retries permitted until 2026-09-09 23:07:51.360276296 +0000 UTC m=+241.876007104 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/061f6ffa-34f9-499c-97f8-b1bc0febefdd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9pglj" (UID: "061f6ffa-34f9-499c-97f8-b1bc0febefdd") : configmap "kube-rbac-proxy" not found Sep 09 23:07:49.360399 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:07:49.360340 2552 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 09 23:07:49.360399 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:07:49.360395 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/061f6ffa-34f9-499c-97f8-b1bc0febefdd-insights-runtime-extractor-tls podName:061f6ffa-34f9-499c-97f8-b1bc0febefdd nodeName:}" failed. No retries permitted until 2026-09-09 23:07:51.360383883 +0000 UTC m=+241.876114695 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/061f6ffa-34f9-499c-97f8-b1bc0febefdd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9pglj" (UID: "061f6ffa-34f9-499c-97f8-b1bc0febefdd") : secret "insights-runtime-extractor-tls" not found Sep 09 23:07:49.686352 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:49.686319 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-p2dvt_ac335ac0-a272-420f-a215-b93e03772895/console-operator/1.log" Sep 09 23:07:49.686740 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:49.686651 2552 scope.go:117] "RemoveContainer" containerID="998bfbed9c944492881000786ef11192f665ffb5b1d1632673f6ad513af08b90" Sep 09 23:07:49.686848 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:07:49.686828 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-p2dvt_openshift-console-operator(ac335ac0-a272-420f-a215-b93e03772895)\"" pod="openshift-console-operator/console-operator-85b454874b-p2dvt" podUID="ac335ac0-a272-420f-a215-b93e03772895" Sep 09 23:07:50.470689 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:50.470639 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/820c1525-62c1-4181-9a2f-aef3a2157d40-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-j5kg7\" (UID: \"820c1525-62c1-4181-9a2f-aef3a2157d40\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-j5kg7" Sep 09 23:07:50.470863 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:07:50.470806 2552 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 09 23:07:50.470908 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:07:50.470869 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/820c1525-62c1-4181-9a2f-aef3a2157d40-cluster-monitoring-operator-tls podName:820c1525-62c1-4181-9a2f-aef3a2157d40 nodeName:}" failed. No retries permitted until 2026-09-09 23:07:58.470853934 +0000 UTC m=+248.986584742 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/820c1525-62c1-4181-9a2f-aef3a2157d40-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-j5kg7" (UID: "820c1525-62c1-4181-9a2f-aef3a2157d40") : secret "cluster-monitoring-operator-tls" not found Sep 09 23:07:50.571580 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:50.571541 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5d1340d6-3378-473e-a317-b8848b2fd4d8-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-6x6jq\" (UID: \"5d1340d6-3378-473e-a317-b8848b2fd4d8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-6x6jq" Sep 09 23:07:50.571753 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:50.571626 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f8e95541-01e9-4d65-921c-5ab7bf9593cb-registry-tls\") pod \"image-registry-7d89fb7b67-khjgb\" (UID: \"f8e95541-01e9-4d65-921c-5ab7bf9593cb\") " pod="openshift-image-registry/image-registry-7d89fb7b67-khjgb" Sep 09 23:07:50.571753 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:07:50.571727 2552 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 09 23:07:50.571844 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:07:50.571765 2552 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 09 23:07:50.571844 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:07:50.571785 2552 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d89fb7b67-khjgb: secret "image-registry-tls" not found Sep 09 23:07:50.571844 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:07:50.571801 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d1340d6-3378-473e-a317-b8848b2fd4d8-samples-operator-tls podName:5d1340d6-3378-473e-a317-b8848b2fd4d8 nodeName:}" failed. No retries permitted until 2026-09-09 23:07:58.571785106 +0000 UTC m=+249.087515915 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5d1340d6-3378-473e-a317-b8848b2fd4d8-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-6x6jq" (UID: "5d1340d6-3378-473e-a317-b8848b2fd4d8") : secret "samples-operator-tls" not found Sep 09 23:07:50.571844 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:07:50.571824 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f8e95541-01e9-4d65-921c-5ab7bf9593cb-registry-tls podName:f8e95541-01e9-4d65-921c-5ab7bf9593cb nodeName:}" failed. No retries permitted until 2026-09-09 23:07:58.571812232 +0000 UTC m=+249.087543043 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f8e95541-01e9-4d65-921c-5ab7bf9593cb-registry-tls") pod "image-registry-7d89fb7b67-khjgb" (UID: "f8e95541-01e9-4d65-921c-5ab7bf9593cb") : secret "image-registry-tls" not found Sep 09 23:07:50.613821 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:50.613792 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-khhlr_2cf4f0e4-e4dc-4953-87dd-f1ec9654c3cf/dns-node-resolver/0.log" Sep 09 23:07:51.213908 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:51.213879 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5rtmc_8ed69f2d-7f79-4199-b3ea-9a7a73b02f6d/node-ca/0.log" Sep 09 23:07:51.379514 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:51.379480 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/061f6ffa-34f9-499c-97f8-b1bc0febefdd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9pglj\" (UID: \"061f6ffa-34f9-499c-97f8-b1bc0febefdd\") " pod="openshift-insights/insights-runtime-extractor-9pglj" Sep 09 23:07:51.379693 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:51.379569 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/061f6ffa-34f9-499c-97f8-b1bc0febefdd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9pglj\" (UID: \"061f6ffa-34f9-499c-97f8-b1bc0febefdd\") " pod="openshift-insights/insights-runtime-extractor-9pglj" Sep 09 23:07:51.379693 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:07:51.379624 2552 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 09 23:07:51.379693 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:07:51.379657 2552 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 09 23:07:51.379804 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:07:51.379705 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/061f6ffa-34f9-499c-97f8-b1bc0febefdd-insights-runtime-extractor-tls podName:061f6ffa-34f9-499c-97f8-b1bc0febefdd nodeName:}" failed. No retries permitted until 2026-09-09 23:07:55.379689377 +0000 UTC m=+245.895420198 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/061f6ffa-34f9-499c-97f8-b1bc0febefdd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9pglj" (UID: "061f6ffa-34f9-499c-97f8-b1bc0febefdd") : secret "insights-runtime-extractor-tls" not found Sep 09 23:07:51.379804 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:07:51.379720 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/061f6ffa-34f9-499c-97f8-b1bc0febefdd-kube-rbac-proxy-cm podName:061f6ffa-34f9-499c-97f8-b1bc0febefdd nodeName:}" failed. No retries permitted until 2026-09-09 23:07:55.379714264 +0000 UTC m=+245.895445072 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/061f6ffa-34f9-499c-97f8-b1bc0febefdd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9pglj" (UID: "061f6ffa-34f9-499c-97f8-b1bc0febefdd") : configmap "kube-rbac-proxy" not found Sep 09 23:07:52.014453 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:52.014419 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2p8fh_9dcefc03-70f9-41ad-a155-f9156e3cdf25/serve-healthcheck-canary/0.log" Sep 09 23:07:53.072120 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:53.072082 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-p2dvt" Sep 09 23:07:53.072510 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:53.072136 2552 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-85b454874b-p2dvt" Sep 09 23:07:53.072510 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:53.072457 2552 scope.go:117] "RemoveContainer" containerID="998bfbed9c944492881000786ef11192f665ffb5b1d1632673f6ad513af08b90" Sep 09 23:07:53.072625 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:07:53.072604 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-p2dvt_openshift-console-operator(ac335ac0-a272-420f-a215-b93e03772895)\"" pod="openshift-console-operator/console-operator-85b454874b-p2dvt" podUID="ac335ac0-a272-420f-a215-b93e03772895" Sep 09 23:07:55.414131 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:55.414090 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/061f6ffa-34f9-499c-97f8-b1bc0febefdd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9pglj\" (UID: \"061f6ffa-34f9-499c-97f8-b1bc0febefdd\") " pod="openshift-insights/insights-runtime-extractor-9pglj" Sep 09 23:07:55.414537 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:55.414180 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/061f6ffa-34f9-499c-97f8-b1bc0febefdd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9pglj\" (UID: \"061f6ffa-34f9-499c-97f8-b1bc0febefdd\") " pod="openshift-insights/insights-runtime-extractor-9pglj" Sep 09 23:07:55.414537 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:07:55.414221 2552 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 09 23:07:55.414537 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:07:55.414290 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/061f6ffa-34f9-499c-97f8-b1bc0febefdd-kube-rbac-proxy-cm podName:061f6ffa-34f9-499c-97f8-b1bc0febefdd nodeName:}" failed. No retries permitted until 2026-09-09 23:08:03.414272488 +0000 UTC m=+253.930003323 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/061f6ffa-34f9-499c-97f8-b1bc0febefdd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9pglj" (UID: "061f6ffa-34f9-499c-97f8-b1bc0febefdd") : configmap "kube-rbac-proxy" not found Sep 09 23:07:55.414537 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:07:55.414320 2552 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 09 23:07:55.414537 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:07:55.414385 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/061f6ffa-34f9-499c-97f8-b1bc0febefdd-insights-runtime-extractor-tls podName:061f6ffa-34f9-499c-97f8-b1bc0febefdd nodeName:}" failed. No retries permitted until 2026-09-09 23:08:03.414370294 +0000 UTC m=+253.930101103 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/061f6ffa-34f9-499c-97f8-b1bc0febefdd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9pglj" (UID: "061f6ffa-34f9-499c-97f8-b1bc0febefdd") : secret "insights-runtime-extractor-tls" not found Sep 09 23:07:58.540410 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:58.540370 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/820c1525-62c1-4181-9a2f-aef3a2157d40-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-j5kg7\" (UID: \"820c1525-62c1-4181-9a2f-aef3a2157d40\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-j5kg7" Sep 09 23:07:58.540940 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:07:58.540529 2552 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 09 23:07:58.540940 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:07:58.540596 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/820c1525-62c1-4181-9a2f-aef3a2157d40-cluster-monitoring-operator-tls podName:820c1525-62c1-4181-9a2f-aef3a2157d40 nodeName:}" failed. No retries permitted until 2026-09-09 23:08:14.540579946 +0000 UTC m=+265.056310759 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/820c1525-62c1-4181-9a2f-aef3a2157d40-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-j5kg7" (UID: "820c1525-62c1-4181-9a2f-aef3a2157d40") : secret "cluster-monitoring-operator-tls" not found Sep 09 23:07:58.640806 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:58.640773 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5d1340d6-3378-473e-a317-b8848b2fd4d8-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-6x6jq\" (UID: \"5d1340d6-3378-473e-a317-b8848b2fd4d8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-6x6jq" Sep 09 23:07:58.640985 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:58.640852 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f8e95541-01e9-4d65-921c-5ab7bf9593cb-registry-tls\") pod \"image-registry-7d89fb7b67-khjgb\" (UID: \"f8e95541-01e9-4d65-921c-5ab7bf9593cb\") " pod="openshift-image-registry/image-registry-7d89fb7b67-khjgb" Sep 09 23:07:58.643161 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:58.643130 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5d1340d6-3378-473e-a317-b8848b2fd4d8-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-6x6jq\" (UID: \"5d1340d6-3378-473e-a317-b8848b2fd4d8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-6x6jq" Sep 09 23:07:58.643266 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:58.643197 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f8e95541-01e9-4d65-921c-5ab7bf9593cb-registry-tls\") pod \"image-registry-7d89fb7b67-khjgb\" (UID: \"f8e95541-01e9-4d65-921c-5ab7bf9593cb\") " pod="openshift-image-registry/image-registry-7d89fb7b67-khjgb" Sep 09 23:07:58.760960 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:58.760923 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-855mt\"" Sep 09 23:07:58.767560 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:58.767537 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-699nw\"" Sep 09 23:07:58.769104 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:58.769085 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-6x6jq" Sep 09 23:07:58.775843 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:58.775827 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d89fb7b67-khjgb" Sep 09 23:07:59.050258 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:59.050228 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-6x6jq"] Sep 09 23:07:59.053019 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:59.052945 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7d89fb7b67-khjgb"] Sep 09 23:07:59.055540 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:07:59.055510 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8e95541_01e9_4d65_921c_5ab7bf9593cb.slice/crio-e7208b0513a5827bd26cc610dba950a77b0adecefba26d2941f5b0733fde668e WatchSource:0}: Error finding container e7208b0513a5827bd26cc610dba950a77b0adecefba26d2941f5b0733fde668e: Status 404 returned error can't find the container with id e7208b0513a5827bd26cc610dba950a77b0adecefba26d2941f5b0733fde668e Sep 09 23:07:59.719424 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:59.719383 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-6x6jq" event={"ID":"5d1340d6-3378-473e-a317-b8848b2fd4d8","Type":"ContainerStarted","Data":"3a001f9892cad088376970b79d1f99bb3288c4c4facffe32b2066e2e4bdce8db"} Sep 09 23:07:59.720928 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:59.720896 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7d89fb7b67-khjgb" event={"ID":"f8e95541-01e9-4d65-921c-5ab7bf9593cb","Type":"ContainerStarted","Data":"f2d3b2db7000bfb69f7036cd624bbfb7c70506dac598806ecc77d27875ae0576"} Sep 09 23:07:59.721050 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:59.720948 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7d89fb7b67-khjgb" event={"ID":"f8e95541-01e9-4d65-921c-5ab7bf9593cb","Type":"ContainerStarted","Data":"e7208b0513a5827bd26cc610dba950a77b0adecefba26d2941f5b0733fde668e"} Sep 09 23:07:59.721050 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:59.721020 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7d89fb7b67-khjgb" Sep 09 23:07:59.739695 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:07:59.739535 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7d89fb7b67-khjgb" podStartSLOduration=17.739516408 podStartE2EDuration="17.739516408s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:07:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:07:59.739311616 +0000 UTC m=+250.255042461" watchObservedRunningTime="2026-09-09 23:07:59.739516408 +0000 UTC m=+250.255247239" Sep 09 23:08:01.730316 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:01.730222 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-6x6jq" event={"ID":"5d1340d6-3378-473e-a317-b8848b2fd4d8","Type":"ContainerStarted","Data":"ad8a510629b80540811f1978e4e723f5ff42fc2903870c4671a7a6eb64319e51"} Sep 09 23:08:01.730316 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:01.730277 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-6x6jq" event={"ID":"5d1340d6-3378-473e-a317-b8848b2fd4d8","Type":"ContainerStarted","Data":"fab900b78272c50f362e9ce2e6fc55118ab9722f374b1b4116e0f509ddaff6fe"} Sep 09 23:08:01.749056 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:01.749003 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-6x6jq" podStartSLOduration=17.438326356 podStartE2EDuration="19.748986499s" totalImagesPullingTime="2.310660143s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:07:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:08:01.747795987 +0000 UTC m=+252.263526819" watchObservedRunningTime="2026-09-09 23:08:01.748986499 +0000 UTC m=+252.264717329" Sep 09 23:08:01.866392 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:01.866351 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be92546e-2796-4680-9b67-4db0dd18a29b-metrics-certs\") pod \"network-metrics-daemon-5hnn9\" (UID: \"be92546e-2796-4680-9b67-4db0dd18a29b\") " pod="openshift-multus/network-metrics-daemon-5hnn9" Sep 09 23:08:01.868711 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:01.868664 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be92546e-2796-4680-9b67-4db0dd18a29b-metrics-certs\") pod \"network-metrics-daemon-5hnn9\" (UID: \"be92546e-2796-4680-9b67-4db0dd18a29b\") " pod="openshift-multus/network-metrics-daemon-5hnn9" Sep 09 23:08:01.936776 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:01.936746 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-64srt\"" Sep 09 23:08:01.944636 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:01.944613 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5hnn9" Sep 09 23:08:02.213506 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:02.213467 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5hnn9"] Sep 09 23:08:02.216328 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:08:02.216298 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe92546e_2796_4680_9b67_4db0dd18a29b.slice/crio-c72d2ab468c7d78a6ce1731891503971ab6fdf27fbcabec426783b20d3a8e25f WatchSource:0}: Error finding container c72d2ab468c7d78a6ce1731891503971ab6fdf27fbcabec426783b20d3a8e25f: Status 404 returned error can't find the container with id c72d2ab468c7d78a6ce1731891503971ab6fdf27fbcabec426783b20d3a8e25f Sep 09 23:08:02.734716 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:02.734660 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5hnn9" event={"ID":"be92546e-2796-4680-9b67-4db0dd18a29b","Type":"ContainerStarted","Data":"c72d2ab468c7d78a6ce1731891503971ab6fdf27fbcabec426783b20d3a8e25f"} Sep 09 23:08:03.479245 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:03.479201 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/061f6ffa-34f9-499c-97f8-b1bc0febefdd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9pglj\" (UID: \"061f6ffa-34f9-499c-97f8-b1bc0febefdd\") " pod="openshift-insights/insights-runtime-extractor-9pglj" Sep 09 23:08:03.479433 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:03.479310 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/061f6ffa-34f9-499c-97f8-b1bc0febefdd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9pglj\" (UID: \"061f6ffa-34f9-499c-97f8-b1bc0febefdd\") " pod="openshift-insights/insights-runtime-extractor-9pglj" Sep 09 23:08:03.479521 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:08:03.479496 2552 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 09 23:08:03.479684 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:08:03.479578 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/061f6ffa-34f9-499c-97f8-b1bc0febefdd-insights-runtime-extractor-tls podName:061f6ffa-34f9-499c-97f8-b1bc0febefdd nodeName:}" failed. No retries permitted until 2026-09-09 23:08:19.479556443 +0000 UTC m=+269.995287256 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/061f6ffa-34f9-499c-97f8-b1bc0febefdd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9pglj" (UID: "061f6ffa-34f9-499c-97f8-b1bc0febefdd") : secret "insights-runtime-extractor-tls" not found Sep 09 23:08:03.479858 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:03.479833 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/061f6ffa-34f9-499c-97f8-b1bc0febefdd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9pglj\" (UID: \"061f6ffa-34f9-499c-97f8-b1bc0febefdd\") " pod="openshift-insights/insights-runtime-extractor-9pglj" Sep 09 23:08:03.739580 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:03.739546 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5hnn9" event={"ID":"be92546e-2796-4680-9b67-4db0dd18a29b","Type":"ContainerStarted","Data":"bfbf3d233f8613522d081a229f81543033bd85a40f22847f604974f31d334847"} Sep 09 23:08:04.744609 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:04.744567 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5hnn9" event={"ID":"be92546e-2796-4680-9b67-4db0dd18a29b","Type":"ContainerStarted","Data":"7612cd0e774875ffc1961c3e3e1e802ee4e98ccfa9a52cb8b421abe1f63cadb3"} Sep 09 23:08:04.760215 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:04.760164 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-5hnn9" podStartSLOduration=253.407020429 podStartE2EDuration="4m14.760147592s" totalImagesPullingTime="1.353127163s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:03:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:08:04.759548733 +0000 UTC m=+255.275279562" watchObservedRunningTime="2026-09-09 23:08:04.760147592 +0000 UTC m=+255.275878421" Sep 09 23:08:07.933056 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:07.933012 2552 scope.go:117] "RemoveContainer" containerID="998bfbed9c944492881000786ef11192f665ffb5b1d1632673f6ad513af08b90" Sep 09 23:08:08.761920 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:08.760737 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-p2dvt_ac335ac0-a272-420f-a215-b93e03772895/console-operator/1.log" Sep 09 23:08:08.761920 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:08.760829 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-p2dvt" event={"ID":"ac335ac0-a272-420f-a215-b93e03772895","Type":"ContainerStarted","Data":"0f441790ed932dd401c64818c648787bd155b90536df8d66bf00a1d964da720b"} Sep 09 23:08:08.762188 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:08.761967 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-p2dvt" Sep 09 23:08:08.766988 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:08.766959 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-85b454874b-p2dvt" Sep 09 23:08:08.779869 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:08.779803 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-85b454874b-p2dvt" podStartSLOduration=23.462415586 podStartE2EDuration="26.779778229s" totalImagesPullingTime="3.317362643s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:07:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:08:08.778608086 +0000 UTC m=+259.294338933" watchObservedRunningTime="2026-09-09 23:08:08.779778229 +0000 UTC m=+259.295509057" Sep 09 23:08:10.954444 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:10.954410 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7d89fb7b67-khjgb"] Sep 09 23:08:10.961198 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:10.961166 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-85d98c998f-rc9rd"] Sep 09 23:08:10.963400 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:10.963377 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-rc9rd" Sep 09 23:08:10.965609 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:10.965587 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-n5q4f\"" Sep 09 23:08:10.965832 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:10.965816 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 09 23:08:10.965897 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:10.965865 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 09 23:08:10.974817 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:10.974786 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-rc9rd"] Sep 09 23:08:11.037993 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:11.037956 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tjfp\" (UniqueName: \"kubernetes.io/projected/916272e3-b151-462e-95e3-551c2cc28347-kube-api-access-8tjfp\") pod \"downloads-85d98c998f-rc9rd\" (UID: \"916272e3-b151-462e-95e3-551c2cc28347\") " pod="openshift-console/downloads-85d98c998f-rc9rd" Sep 09 23:08:11.139185 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:11.139147 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tjfp\" (UniqueName: \"kubernetes.io/projected/916272e3-b151-462e-95e3-551c2cc28347-kube-api-access-8tjfp\") pod \"downloads-85d98c998f-rc9rd\" (UID: \"916272e3-b151-462e-95e3-551c2cc28347\") " pod="openshift-console/downloads-85d98c998f-rc9rd" Sep 09 23:08:11.146905 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:11.146873 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tjfp\" (UniqueName: \"kubernetes.io/projected/916272e3-b151-462e-95e3-551c2cc28347-kube-api-access-8tjfp\") pod \"downloads-85d98c998f-rc9rd\" (UID: \"916272e3-b151-462e-95e3-551c2cc28347\") " pod="openshift-console/downloads-85d98c998f-rc9rd" Sep 09 23:08:11.273619 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:11.273519 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-rc9rd" Sep 09 23:08:11.545755 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:11.545547 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-rc9rd"] Sep 09 23:08:11.548215 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:08:11.548185 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod916272e3_b151_462e_95e3_551c2cc28347.slice/crio-7cca0722f4e9e5b13d2eef01b60d464777cb74d8bbbd25800a8d97d0cec0df4c WatchSource:0}: Error finding container 7cca0722f4e9e5b13d2eef01b60d464777cb74d8bbbd25800a8d97d0cec0df4c: Status 404 returned error can't find the container with id 7cca0722f4e9e5b13d2eef01b60d464777cb74d8bbbd25800a8d97d0cec0df4c Sep 09 23:08:11.772998 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:11.772960 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-rc9rd" event={"ID":"916272e3-b151-462e-95e3-551c2cc28347","Type":"ContainerStarted","Data":"7cca0722f4e9e5b13d2eef01b60d464777cb74d8bbbd25800a8d97d0cec0df4c"} Sep 09 23:08:14.567304 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:14.567201 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/820c1525-62c1-4181-9a2f-aef3a2157d40-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-j5kg7\" (UID: \"820c1525-62c1-4181-9a2f-aef3a2157d40\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-j5kg7" Sep 09 23:08:14.570000 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:14.569970 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/820c1525-62c1-4181-9a2f-aef3a2157d40-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-j5kg7\" (UID: \"820c1525-62c1-4181-9a2f-aef3a2157d40\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-j5kg7" Sep 09 23:08:14.861804 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:14.861724 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-vtzgr\"" Sep 09 23:08:14.869617 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:14.869582 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-j5kg7" Sep 09 23:08:15.152314 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:15.152276 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-j5kg7"] Sep 09 23:08:15.156922 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:08:15.156853 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod820c1525_62c1_4181_9a2f_aef3a2157d40.slice/crio-57b49096765cce19eb2003953d7451d1e9f5012470ced4237e07074e7cdb3713 WatchSource:0}: Error finding container 57b49096765cce19eb2003953d7451d1e9f5012470ced4237e07074e7cdb3713: Status 404 returned error can't find the container with id 57b49096765cce19eb2003953d7451d1e9f5012470ced4237e07074e7cdb3713 Sep 09 23:08:15.791045 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:15.791005 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-j5kg7" event={"ID":"820c1525-62c1-4181-9a2f-aef3a2157d40","Type":"ContainerStarted","Data":"57b49096765cce19eb2003953d7451d1e9f5012470ced4237e07074e7cdb3713"} Sep 09 23:08:17.616313 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:17.616274 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-w9k7n"] Sep 09 23:08:17.618623 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:17.618596 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-w9k7n" Sep 09 23:08:17.620687 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:17.620655 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Sep 09 23:08:17.621067 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:17.621046 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-f5p8k\"" Sep 09 23:08:17.627991 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:17.627748 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-w9k7n"] Sep 09 23:08:17.695037 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:17.694990 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ae7d2ce4-8f63-496a-a973-42c0ce951319-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-w9k7n\" (UID: \"ae7d2ce4-8f63-496a-a973-42c0ce951319\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-w9k7n" Sep 09 23:08:17.795642 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:17.795590 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ae7d2ce4-8f63-496a-a973-42c0ce951319-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-w9k7n\" (UID: \"ae7d2ce4-8f63-496a-a973-42c0ce951319\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-w9k7n" Sep 09 23:08:17.801793 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:17.801757 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ae7d2ce4-8f63-496a-a973-42c0ce951319-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-w9k7n\" (UID: \"ae7d2ce4-8f63-496a-a973-42c0ce951319\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-w9k7n" Sep 09 23:08:17.805100 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:17.805026 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-j5kg7" event={"ID":"820c1525-62c1-4181-9a2f-aef3a2157d40","Type":"ContainerStarted","Data":"a100c322e2d62f7b97935fd7c2539f6ef0eba78f2c37d1c65eb16d518108d8fb"} Sep 09 23:08:17.820757 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:17.820707 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-j5kg7" podStartSLOduration=33.865986673 podStartE2EDuration="35.82069023s" totalImagesPullingTime="1.954703557s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:07:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:08:17.818989126 +0000 UTC m=+268.334719969" watchObservedRunningTime="2026-09-09 23:08:17.82069023 +0000 UTC m=+268.336421121" Sep 09 23:08:17.931175 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:17.931134 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-w9k7n" Sep 09 23:08:18.211173 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:18.211083 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-w9k7n"] Sep 09 23:08:18.214592 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:08:18.214557 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae7d2ce4_8f63_496a_a973_42c0ce951319.slice/crio-d79954eac1d8fad62e93708172c1cb17241871c6e52f542768ebf3cc84aa336a WatchSource:0}: Error finding container d79954eac1d8fad62e93708172c1cb17241871c6e52f542768ebf3cc84aa336a: Status 404 returned error can't find the container with id d79954eac1d8fad62e93708172c1cb17241871c6e52f542768ebf3cc84aa336a Sep 09 23:08:18.266779 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:18.266737 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7cdc48478d-z95ns"] Sep 09 23:08:18.269831 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:18.269804 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cdc48478d-z95ns" Sep 09 23:08:18.272623 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:18.272402 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 09 23:08:18.272623 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:18.272435 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 09 23:08:18.272623 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:18.272436 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 09 23:08:18.272623 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:18.272543 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 09 23:08:18.273149 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:18.273126 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-28x98\"" Sep 09 23:08:18.273250 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:18.273158 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 09 23:08:18.279774 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:18.279217 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7cdc48478d-z95ns"] Sep 09 23:08:18.400492 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:18.400456 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2b72cf56-1dd3-40a6-90e4-a332fbe85424-oauth-serving-cert\") pod \"console-7cdc48478d-z95ns\" (UID: \"2b72cf56-1dd3-40a6-90e4-a332fbe85424\") " pod="openshift-console/console-7cdc48478d-z95ns" Sep 09 23:08:18.400690 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:18.400500 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2b72cf56-1dd3-40a6-90e4-a332fbe85424-console-config\") pod \"console-7cdc48478d-z95ns\" (UID: \"2b72cf56-1dd3-40a6-90e4-a332fbe85424\") " pod="openshift-console/console-7cdc48478d-z95ns" Sep 09 23:08:18.400690 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:18.400528 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52ngb\" (UniqueName: \"kubernetes.io/projected/2b72cf56-1dd3-40a6-90e4-a332fbe85424-kube-api-access-52ngb\") pod \"console-7cdc48478d-z95ns\" (UID: \"2b72cf56-1dd3-40a6-90e4-a332fbe85424\") " pod="openshift-console/console-7cdc48478d-z95ns" Sep 09 23:08:18.400690 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:18.400569 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2b72cf56-1dd3-40a6-90e4-a332fbe85424-console-serving-cert\") pod \"console-7cdc48478d-z95ns\" (UID: \"2b72cf56-1dd3-40a6-90e4-a332fbe85424\") " pod="openshift-console/console-7cdc48478d-z95ns" Sep 09 23:08:18.400690 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:18.400637 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2b72cf56-1dd3-40a6-90e4-a332fbe85424-service-ca\") pod \"console-7cdc48478d-z95ns\" (UID: \"2b72cf56-1dd3-40a6-90e4-a332fbe85424\") " pod="openshift-console/console-7cdc48478d-z95ns" Sep 09 23:08:18.400885 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:18.400706 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2b72cf56-1dd3-40a6-90e4-a332fbe85424-console-oauth-config\") pod \"console-7cdc48478d-z95ns\" (UID: \"2b72cf56-1dd3-40a6-90e4-a332fbe85424\") " pod="openshift-console/console-7cdc48478d-z95ns" Sep 09 23:08:18.501927 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:18.501844 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2b72cf56-1dd3-40a6-90e4-a332fbe85424-console-serving-cert\") pod \"console-7cdc48478d-z95ns\" (UID: \"2b72cf56-1dd3-40a6-90e4-a332fbe85424\") " pod="openshift-console/console-7cdc48478d-z95ns" Sep 09 23:08:18.501927 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:18.501895 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2b72cf56-1dd3-40a6-90e4-a332fbe85424-service-ca\") pod \"console-7cdc48478d-z95ns\" (UID: \"2b72cf56-1dd3-40a6-90e4-a332fbe85424\") " pod="openshift-console/console-7cdc48478d-z95ns" Sep 09 23:08:18.502161 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:18.501958 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2b72cf56-1dd3-40a6-90e4-a332fbe85424-console-oauth-config\") pod \"console-7cdc48478d-z95ns\" (UID: \"2b72cf56-1dd3-40a6-90e4-a332fbe85424\") " pod="openshift-console/console-7cdc48478d-z95ns" Sep 09 23:08:18.502161 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:18.502019 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2b72cf56-1dd3-40a6-90e4-a332fbe85424-oauth-serving-cert\") pod \"console-7cdc48478d-z95ns\" (UID: \"2b72cf56-1dd3-40a6-90e4-a332fbe85424\") " pod="openshift-console/console-7cdc48478d-z95ns" Sep 09 23:08:18.502161 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:18.502044 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2b72cf56-1dd3-40a6-90e4-a332fbe85424-console-config\") pod \"console-7cdc48478d-z95ns\" (UID: \"2b72cf56-1dd3-40a6-90e4-a332fbe85424\") " pod="openshift-console/console-7cdc48478d-z95ns" Sep 09 23:08:18.502161 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:18.502072 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52ngb\" (UniqueName: \"kubernetes.io/projected/2b72cf56-1dd3-40a6-90e4-a332fbe85424-kube-api-access-52ngb\") pod \"console-7cdc48478d-z95ns\" (UID: \"2b72cf56-1dd3-40a6-90e4-a332fbe85424\") " pod="openshift-console/console-7cdc48478d-z95ns" Sep 09 23:08:18.504526 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:18.503204 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2b72cf56-1dd3-40a6-90e4-a332fbe85424-console-config\") pod \"console-7cdc48478d-z95ns\" (UID: \"2b72cf56-1dd3-40a6-90e4-a332fbe85424\") " pod="openshift-console/console-7cdc48478d-z95ns" Sep 09 23:08:18.504526 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:18.503573 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2b72cf56-1dd3-40a6-90e4-a332fbe85424-service-ca\") pod \"console-7cdc48478d-z95ns\" (UID: \"2b72cf56-1dd3-40a6-90e4-a332fbe85424\") " pod="openshift-console/console-7cdc48478d-z95ns" Sep 09 23:08:18.504526 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:18.503891 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2b72cf56-1dd3-40a6-90e4-a332fbe85424-oauth-serving-cert\") pod \"console-7cdc48478d-z95ns\" (UID: \"2b72cf56-1dd3-40a6-90e4-a332fbe85424\") " pod="openshift-console/console-7cdc48478d-z95ns" Sep 09 23:08:18.507868 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:18.505424 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2b72cf56-1dd3-40a6-90e4-a332fbe85424-console-serving-cert\") pod \"console-7cdc48478d-z95ns\" (UID: \"2b72cf56-1dd3-40a6-90e4-a332fbe85424\") " pod="openshift-console/console-7cdc48478d-z95ns" Sep 09 23:08:18.508861 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:18.508830 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2b72cf56-1dd3-40a6-90e4-a332fbe85424-console-oauth-config\") pod \"console-7cdc48478d-z95ns\" (UID: \"2b72cf56-1dd3-40a6-90e4-a332fbe85424\") " pod="openshift-console/console-7cdc48478d-z95ns" Sep 09 23:08:18.511613 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:18.511590 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-52ngb\" (UniqueName: \"kubernetes.io/projected/2b72cf56-1dd3-40a6-90e4-a332fbe85424-kube-api-access-52ngb\") pod \"console-7cdc48478d-z95ns\" (UID: \"2b72cf56-1dd3-40a6-90e4-a332fbe85424\") " pod="openshift-console/console-7cdc48478d-z95ns" Sep 09 23:08:18.582615 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:18.582567 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cdc48478d-z95ns" Sep 09 23:08:18.810854 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:18.810765 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-w9k7n" event={"ID":"ae7d2ce4-8f63-496a-a973-42c0ce951319","Type":"ContainerStarted","Data":"d79954eac1d8fad62e93708172c1cb17241871c6e52f542768ebf3cc84aa336a"} Sep 09 23:08:18.866302 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:18.866263 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7cdc48478d-z95ns"] Sep 09 23:08:18.869566 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:08:18.869528 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b72cf56_1dd3_40a6_90e4_a332fbe85424.slice/crio-02a6bedae8181a291484cbccb0f970cf69856c7dc12fc9fd29d6c059d486950d WatchSource:0}: Error finding container 02a6bedae8181a291484cbccb0f970cf69856c7dc12fc9fd29d6c059d486950d: Status 404 returned error can't find the container with id 02a6bedae8181a291484cbccb0f970cf69856c7dc12fc9fd29d6c059d486950d Sep 09 23:08:19.512757 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:19.512697 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/061f6ffa-34f9-499c-97f8-b1bc0febefdd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9pglj\" (UID: \"061f6ffa-34f9-499c-97f8-b1bc0febefdd\") " pod="openshift-insights/insights-runtime-extractor-9pglj" Sep 09 23:08:19.516410 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:19.516338 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/061f6ffa-34f9-499c-97f8-b1bc0febefdd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9pglj\" (UID: \"061f6ffa-34f9-499c-97f8-b1bc0febefdd\") " pod="openshift-insights/insights-runtime-extractor-9pglj" Sep 09 23:08:19.770726 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:19.770640 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6xppp\"" Sep 09 23:08:19.778892 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:19.778821 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9pglj" Sep 09 23:08:19.819629 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:19.819534 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cdc48478d-z95ns" event={"ID":"2b72cf56-1dd3-40a6-90e4-a332fbe85424","Type":"ContainerStarted","Data":"02a6bedae8181a291484cbccb0f970cf69856c7dc12fc9fd29d6c059d486950d"} Sep 09 23:08:20.076901 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:20.076864 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9pglj"] Sep 09 23:08:20.080205 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:08:20.080166 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod061f6ffa_34f9_499c_97f8_b1bc0febefdd.slice/crio-dd66bb8e710e0b78fb898c9769198df34fdb72cd8a71fbf505666308269dc0be WatchSource:0}: Error finding container dd66bb8e710e0b78fb898c9769198df34fdb72cd8a71fbf505666308269dc0be: Status 404 returned error can't find the container with id dd66bb8e710e0b78fb898c9769198df34fdb72cd8a71fbf505666308269dc0be Sep 09 23:08:20.826477 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:20.826433 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-w9k7n" event={"ID":"ae7d2ce4-8f63-496a-a973-42c0ce951319","Type":"ContainerStarted","Data":"995e7f8a798348e3e8791baf3635a628529b8499896d0e173f0733132cb60b62"} Sep 09 23:08:20.826926 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:20.826835 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-w9k7n" Sep 09 23:08:20.830204 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:20.830144 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9pglj" event={"ID":"061f6ffa-34f9-499c-97f8-b1bc0febefdd","Type":"ContainerStarted","Data":"33791fd28878d3745c115f29779eec4a3ed5231e4732ca508effe3888ca512a4"} Sep 09 23:08:20.830367 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:20.830232 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9pglj" event={"ID":"061f6ffa-34f9-499c-97f8-b1bc0febefdd","Type":"ContainerStarted","Data":"6c92774a0044bc5bc21459bfb5d8492379d752ea12cfde08b8dda8b86ad5013c"} Sep 09 23:08:20.830367 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:20.830263 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9pglj" event={"ID":"061f6ffa-34f9-499c-97f8-b1bc0febefdd","Type":"ContainerStarted","Data":"dd66bb8e710e0b78fb898c9769198df34fdb72cd8a71fbf505666308269dc0be"} Sep 09 23:08:20.833007 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:20.832978 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-w9k7n" Sep 09 23:08:20.841063 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:20.841003 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-w9k7n" podStartSLOduration=2.2813430439999998 podStartE2EDuration="3.840979679s" totalImagesPullingTime="1.559636635s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:08:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:08:20.839872686 +0000 UTC m=+271.355603517" watchObservedRunningTime="2026-09-09 23:08:20.840979679 +0000 UTC m=+271.356710513" Sep 09 23:08:20.962310 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:20.962224 2552 patch_prober.go:28] interesting pod/image-registry-7d89fb7b67-khjgb container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 09 23:08:20.962310 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:20.962294 2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7d89fb7b67-khjgb" podUID="f8e95541-01e9-4d65-921c-5ab7bf9593cb" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 09 23:08:26.070131 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:26.070091 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-bwllv"] Sep 09 23:08:26.072744 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:26.072704 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-bwllv" Sep 09 23:08:26.074994 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:26.074969 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-8bcjh\"" Sep 09 23:08:26.074994 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:26.074981 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Sep 09 23:08:26.075446 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:26.075339 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Sep 09 23:08:26.077226 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:26.077205 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 09 23:08:26.091829 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:26.091793 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-bwllv"] Sep 09 23:08:26.103433 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:26.103361 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-7jqqc"] Sep 09 23:08:26.106263 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:26.106235 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7jqqc" Sep 09 23:08:26.109379 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:26.109187 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 09 23:08:26.109379 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:26.109187 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-dg28d\"" Sep 09 23:08:26.109688 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:26.109430 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 09 23:08:26.110143 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:26.110117 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 09 23:08:26.173501 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:26.173463 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ea8fd004-8b78-4b2b-86e1-91132f154174-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-bwllv\" (UID: \"ea8fd004-8b78-4b2b-86e1-91132f154174\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-bwllv" Sep 09 23:08:26.173501 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:26.173508 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlvwt\" (UniqueName: \"kubernetes.io/projected/ea8fd004-8b78-4b2b-86e1-91132f154174-kube-api-access-jlvwt\") pod \"openshift-state-metrics-657fd6c54-bwllv\" (UID: \"ea8fd004-8b78-4b2b-86e1-91132f154174\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-bwllv" Sep 09 23:08:26.173799 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:26.173542 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b810b4cc-b59e-485b-a9d2-bc05b1f9f22f-sys\") pod \"node-exporter-7jqqc\" (UID: \"b810b4cc-b59e-485b-a9d2-bc05b1f9f22f\") " pod="openshift-monitoring/node-exporter-7jqqc" Sep 09 23:08:26.173799 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:26.173565 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfxhq\" (UniqueName: \"kubernetes.io/projected/b810b4cc-b59e-485b-a9d2-bc05b1f9f22f-kube-api-access-rfxhq\") pod \"node-exporter-7jqqc\" (UID: \"b810b4cc-b59e-485b-a9d2-bc05b1f9f22f\") " pod="openshift-monitoring/node-exporter-7jqqc" Sep 09 23:08:26.173799 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:26.173642 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b810b4cc-b59e-485b-a9d2-bc05b1f9f22f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7jqqc\" (UID: \"b810b4cc-b59e-485b-a9d2-bc05b1f9f22f\") " pod="openshift-monitoring/node-exporter-7jqqc" Sep 09 23:08:26.173799 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:26.173715 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b810b4cc-b59e-485b-a9d2-bc05b1f9f22f-metrics-client-ca\") pod \"node-exporter-7jqqc\" (UID: \"b810b4cc-b59e-485b-a9d2-bc05b1f9f22f\") " pod="openshift-monitoring/node-exporter-7jqqc" Sep 09 23:08:26.173799 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:26.173743 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b810b4cc-b59e-485b-a9d2-bc05b1f9f22f-root\") pod \"node-exporter-7jqqc\" (UID: \"b810b4cc-b59e-485b-a9d2-bc05b1f9f22f\") " pod="openshift-monitoring/node-exporter-7jqqc" Sep 09 23:08:26.173799 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:26.173774 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b810b4cc-b59e-485b-a9d2-bc05b1f9f22f-node-exporter-accelerators-collector-config\") pod \"node-exporter-7jqqc\" (UID: \"b810b4cc-b59e-485b-a9d2-bc05b1f9f22f\") " pod="openshift-monitoring/node-exporter-7jqqc" Sep 09 23:08:26.174051 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:26.173855 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b810b4cc-b59e-485b-a9d2-bc05b1f9f22f-node-exporter-textfile\") pod \"node-exporter-7jqqc\" (UID: \"b810b4cc-b59e-485b-a9d2-bc05b1f9f22f\") " pod="openshift-monitoring/node-exporter-7jqqc" Sep 09 23:08:26.174051 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:26.173897 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b810b4cc-b59e-485b-a9d2-bc05b1f9f22f-node-exporter-tls\") pod \"node-exporter-7jqqc\" (UID: \"b810b4cc-b59e-485b-a9d2-bc05b1f9f22f\") " pod="openshift-monitoring/node-exporter-7jqqc" Sep 09 23:08:26.174051 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:26.173962 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ea8fd004-8b78-4b2b-86e1-91132f154174-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-bwllv\" (UID: \"ea8fd004-8b78-4b2b-86e1-91132f154174\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-bwllv" Sep 09 23:08:26.174051 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:26.174012 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b810b4cc-b59e-485b-a9d2-bc05b1f9f22f-node-exporter-wtmp\") pod \"node-exporter-7jqqc\" (UID: \"b810b4cc-b59e-485b-a9d2-bc05b1f9f22f\") " pod="openshift-monitoring/node-exporter-7jqqc" Sep 09 23:08:26.174231 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:26.174078 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ea8fd004-8b78-4b2b-86e1-91132f154174-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-bwllv\" (UID: \"ea8fd004-8b78-4b2b-86e1-91132f154174\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-bwllv" Sep 09 23:08:26.275376 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:26.275334 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ea8fd004-8b78-4b2b-86e1-91132f154174-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-bwllv\" (UID: \"ea8fd004-8b78-4b2b-86e1-91132f154174\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-bwllv" Sep 09 23:08:26.275547 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:26.275468 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b810b4cc-b59e-485b-a9d2-bc05b1f9f22f-node-exporter-wtmp\") pod \"node-exporter-7jqqc\" (UID: \"b810b4cc-b59e-485b-a9d2-bc05b1f9f22f\") " pod="openshift-monitoring/node-exporter-7jqqc" Sep 09 23:08:26.275547 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:26.275496 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ea8fd004-8b78-4b2b-86e1-91132f154174-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-bwllv\" (UID: \"ea8fd004-8b78-4b2b-86e1-91132f154174\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-bwllv" Sep 09 23:08:26.275547 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:26.275540 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ea8fd004-8b78-4b2b-86e1-91132f154174-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-bwllv\" (UID: \"ea8fd004-8b78-4b2b-86e1-91132f154174\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-bwllv" Sep 09 23:08:26.275759 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:26.275565 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlvwt\" (UniqueName: \"kubernetes.io/projected/ea8fd004-8b78-4b2b-86e1-91132f154174-kube-api-access-jlvwt\") pod \"openshift-state-metrics-657fd6c54-bwllv\" (UID: \"ea8fd004-8b78-4b2b-86e1-91132f154174\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-bwllv" Sep 09 23:08:26.275759 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:26.275667 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b810b4cc-b59e-485b-a9d2-bc05b1f9f22f-node-exporter-wtmp\") pod \"node-exporter-7jqqc\" (UID: \"b810b4cc-b59e-485b-a9d2-bc05b1f9f22f\") " pod="openshift-monitoring/node-exporter-7jqqc" Sep 09 23:08:26.275759 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:26.275738 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b810b4cc-b59e-485b-a9d2-bc05b1f9f22f-sys\") pod \"node-exporter-7jqqc\" (UID: \"b810b4cc-b59e-485b-a9d2-bc05b1f9f22f\") " pod="openshift-monitoring/node-exporter-7jqqc" Sep 09 23:08:26.275909 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:26.275769 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfxhq\" (UniqueName: \"kubernetes.io/projected/b810b4cc-b59e-485b-a9d2-bc05b1f9f22f-kube-api-access-rfxhq\") pod \"node-exporter-7jqqc\" (UID: \"b810b4cc-b59e-485b-a9d2-bc05b1f9f22f\") " pod="openshift-monitoring/node-exporter-7jqqc" Sep 09 23:08:26.275909 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:26.275813 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b810b4cc-b59e-485b-a9d2-bc05b1f9f22f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7jqqc\" (UID: \"b810b4cc-b59e-485b-a9d2-bc05b1f9f22f\") " pod="openshift-monitoring/node-exporter-7jqqc" Sep 09 23:08:26.275909 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:26.275850 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b810b4cc-b59e-485b-a9d2-bc05b1f9f22f-metrics-client-ca\") pod \"node-exporter-7jqqc\" (UID: \"b810b4cc-b59e-485b-a9d2-bc05b1f9f22f\") " pod="openshift-monitoring/node-exporter-7jqqc" Sep 09 23:08:26.275909 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:26.275854 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b810b4cc-b59e-485b-a9d2-bc05b1f9f22f-sys\") pod \"node-exporter-7jqqc\" (UID: \"b810b4cc-b59e-485b-a9d2-bc05b1f9f22f\") " pod="openshift-monitoring/node-exporter-7jqqc" Sep 09 23:08:26.275909 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:26.275875 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b810b4cc-b59e-485b-a9d2-bc05b1f9f22f-root\") pod \"node-exporter-7jqqc\" (UID: \"b810b4cc-b59e-485b-a9d2-bc05b1f9f22f\") " pod="openshift-monitoring/node-exporter-7jqqc" Sep 09 23:08:26.275909 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:26.275905 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b810b4cc-b59e-485b-a9d2-bc05b1f9f22f-node-exporter-accelerators-collector-config\") pod \"node-exporter-7jqqc\" (UID: \"b810b4cc-b59e-485b-a9d2-bc05b1f9f22f\") " pod="openshift-monitoring/node-exporter-7jqqc" Sep 09 23:08:26.276202 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:26.275941 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b810b4cc-b59e-485b-a9d2-bc05b1f9f22f-node-exporter-textfile\") pod \"node-exporter-7jqqc\" (UID: \"b810b4cc-b59e-485b-a9d2-bc05b1f9f22f\") " pod="openshift-monitoring/node-exporter-7jqqc" Sep 09 23:08:26.276202 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:26.275961 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b810b4cc-b59e-485b-a9d2-bc05b1f9f22f-node-exporter-tls\") pod \"node-exporter-7jqqc\" (UID: \"b810b4cc-b59e-485b-a9d2-bc05b1f9f22f\") " pod="openshift-monitoring/node-exporter-7jqqc" Sep 09 23:08:26.276202 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:26.276074 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b810b4cc-b59e-485b-a9d2-bc05b1f9f22f-root\") pod \"node-exporter-7jqqc\" (UID: \"b810b4cc-b59e-485b-a9d2-bc05b1f9f22f\") " pod="openshift-monitoring/node-exporter-7jqqc" Sep 09 23:08:26.276202 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:08:26.276146 2552 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Sep 09 23:08:26.276202 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:08:26.276202 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b810b4cc-b59e-485b-a9d2-bc05b1f9f22f-node-exporter-tls podName:b810b4cc-b59e-485b-a9d2-bc05b1f9f22f nodeName:}" failed. No retries permitted until 2026-09-09 23:08:26.776183223 +0000 UTC m=+277.291914037 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/b810b4cc-b59e-485b-a9d2-bc05b1f9f22f-node-exporter-tls") pod "node-exporter-7jqqc" (UID: "b810b4cc-b59e-485b-a9d2-bc05b1f9f22f") : secret "node-exporter-tls" not found Sep 09 23:08:26.276429 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:26.276337 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ea8fd004-8b78-4b2b-86e1-91132f154174-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-bwllv\" (UID: \"ea8fd004-8b78-4b2b-86e1-91132f154174\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-bwllv" Sep 09 23:08:26.276714 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:26.276641 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b810b4cc-b59e-485b-a9d2-bc05b1f9f22f-metrics-client-ca\") pod \"node-exporter-7jqqc\" (UID: \"b810b4cc-b59e-485b-a9d2-bc05b1f9f22f\") " pod="openshift-monitoring/node-exporter-7jqqc" Sep 09 23:08:26.277059 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:26.276843 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b810b4cc-b59e-485b-a9d2-bc05b1f9f22f-node-exporter-textfile\") pod \"node-exporter-7jqqc\" (UID: \"b810b4cc-b59e-485b-a9d2-bc05b1f9f22f\") " pod="openshift-monitoring/node-exporter-7jqqc" Sep 09 23:08:26.277470 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:26.277414 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b810b4cc-b59e-485b-a9d2-bc05b1f9f22f-node-exporter-accelerators-collector-config\") pod \"node-exporter-7jqqc\" (UID: \"b810b4cc-b59e-485b-a9d2-bc05b1f9f22f\") " pod="openshift-monitoring/node-exporter-7jqqc" Sep 09 23:08:26.278636 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:26.278610 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ea8fd004-8b78-4b2b-86e1-91132f154174-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-bwllv\" (UID: \"ea8fd004-8b78-4b2b-86e1-91132f154174\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-bwllv" Sep 09 23:08:26.278778 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:26.278759 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b810b4cc-b59e-485b-a9d2-bc05b1f9f22f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7jqqc\" (UID: \"b810b4cc-b59e-485b-a9d2-bc05b1f9f22f\") " pod="openshift-monitoring/node-exporter-7jqqc" Sep 09 23:08:26.278778 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:26.278772 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ea8fd004-8b78-4b2b-86e1-91132f154174-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-bwllv\" (UID: \"ea8fd004-8b78-4b2b-86e1-91132f154174\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-bwllv" Sep 09 23:08:26.288777 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:26.288736 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfxhq\" (UniqueName: \"kubernetes.io/projected/b810b4cc-b59e-485b-a9d2-bc05b1f9f22f-kube-api-access-rfxhq\") pod \"node-exporter-7jqqc\" (UID: \"b810b4cc-b59e-485b-a9d2-bc05b1f9f22f\") " pod="openshift-monitoring/node-exporter-7jqqc" Sep 09 23:08:26.288973 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:26.288911 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlvwt\" (UniqueName: \"kubernetes.io/projected/ea8fd004-8b78-4b2b-86e1-91132f154174-kube-api-access-jlvwt\") pod \"openshift-state-metrics-657fd6c54-bwllv\" (UID: \"ea8fd004-8b78-4b2b-86e1-91132f154174\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-bwllv" Sep 09 23:08:26.385479 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:26.385442 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-bwllv" Sep 09 23:08:26.779427 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:26.779332 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b810b4cc-b59e-485b-a9d2-bc05b1f9f22f-node-exporter-tls\") pod \"node-exporter-7jqqc\" (UID: \"b810b4cc-b59e-485b-a9d2-bc05b1f9f22f\") " pod="openshift-monitoring/node-exporter-7jqqc" Sep 09 23:08:26.782086 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:26.782058 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b810b4cc-b59e-485b-a9d2-bc05b1f9f22f-node-exporter-tls\") pod \"node-exporter-7jqqc\" (UID: \"b810b4cc-b59e-485b-a9d2-bc05b1f9f22f\") " pod="openshift-monitoring/node-exporter-7jqqc" Sep 09 23:08:27.018249 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:27.018205 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7jqqc" Sep 09 23:08:29.048185 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:29.048148 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-795bdd954b-n5xsr"] Sep 09 23:08:29.050612 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:29.050586 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-795bdd954b-n5xsr" Sep 09 23:08:29.053066 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:29.053015 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Sep 09 23:08:29.053066 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:29.053034 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Sep 09 23:08:29.053270 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:29.053172 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Sep 09 23:08:29.053335 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:29.053267 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-t6czn\"" Sep 09 23:08:29.053335 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:29.053314 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Sep 09 23:08:29.053437 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:29.053329 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Sep 09 23:08:29.053437 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:29.053405 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-c2lamgb7ov3b6\"" Sep 09 23:08:29.064249 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:29.064221 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-795bdd954b-n5xsr"] Sep 09 23:08:29.091418 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:08:29.091388 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb810b4cc_b59e_485b_a9d2_bc05b1f9f22f.slice/crio-377a2d310971b8fa6ee313eec671614639d68b3a1fa1918bf69da4a55b649317 WatchSource:0}: Error finding container 377a2d310971b8fa6ee313eec671614639d68b3a1fa1918bf69da4a55b649317: Status 404 returned error can't find the container with id 377a2d310971b8fa6ee313eec671614639d68b3a1fa1918bf69da4a55b649317 Sep 09 23:08:29.201082 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:29.200965 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/e1f3b0b2-13d5-4aaf-a3d6-187ca3ddd115-secret-thanos-querier-tls\") pod \"thanos-querier-795bdd954b-n5xsr\" (UID: \"e1f3b0b2-13d5-4aaf-a3d6-187ca3ddd115\") " pod="openshift-monitoring/thanos-querier-795bdd954b-n5xsr" Sep 09 23:08:29.201082 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:29.201006 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/e1f3b0b2-13d5-4aaf-a3d6-187ca3ddd115-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-795bdd954b-n5xsr\" (UID: \"e1f3b0b2-13d5-4aaf-a3d6-187ca3ddd115\") " pod="openshift-monitoring/thanos-querier-795bdd954b-n5xsr" Sep 09 23:08:29.201082 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:29.201036 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/e1f3b0b2-13d5-4aaf-a3d6-187ca3ddd115-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-795bdd954b-n5xsr\" (UID: \"e1f3b0b2-13d5-4aaf-a3d6-187ca3ddd115\") " pod="openshift-monitoring/thanos-querier-795bdd954b-n5xsr" Sep 09 23:08:29.201363 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:29.201142 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e1f3b0b2-13d5-4aaf-a3d6-187ca3ddd115-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-795bdd954b-n5xsr\" (UID: \"e1f3b0b2-13d5-4aaf-a3d6-187ca3ddd115\") " pod="openshift-monitoring/thanos-querier-795bdd954b-n5xsr" Sep 09 23:08:29.201363 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:29.201176 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e1f3b0b2-13d5-4aaf-a3d6-187ca3ddd115-secret-grpc-tls\") pod \"thanos-querier-795bdd954b-n5xsr\" (UID: \"e1f3b0b2-13d5-4aaf-a3d6-187ca3ddd115\") " pod="openshift-monitoring/thanos-querier-795bdd954b-n5xsr" Sep 09 23:08:29.201363 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:29.201228 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lddg\" (UniqueName: \"kubernetes.io/projected/e1f3b0b2-13d5-4aaf-a3d6-187ca3ddd115-kube-api-access-4lddg\") pod \"thanos-querier-795bdd954b-n5xsr\" (UID: \"e1f3b0b2-13d5-4aaf-a3d6-187ca3ddd115\") " pod="openshift-monitoring/thanos-querier-795bdd954b-n5xsr" Sep 09 23:08:29.201363 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:29.201267 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e1f3b0b2-13d5-4aaf-a3d6-187ca3ddd115-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-795bdd954b-n5xsr\" (UID: \"e1f3b0b2-13d5-4aaf-a3d6-187ca3ddd115\") " pod="openshift-monitoring/thanos-querier-795bdd954b-n5xsr" Sep 09 23:08:29.201363 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:29.201305 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e1f3b0b2-13d5-4aaf-a3d6-187ca3ddd115-metrics-client-ca\") pod \"thanos-querier-795bdd954b-n5xsr\" (UID: \"e1f3b0b2-13d5-4aaf-a3d6-187ca3ddd115\") " pod="openshift-monitoring/thanos-querier-795bdd954b-n5xsr" Sep 09 23:08:29.302081 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:29.301995 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e1f3b0b2-13d5-4aaf-a3d6-187ca3ddd115-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-795bdd954b-n5xsr\" (UID: \"e1f3b0b2-13d5-4aaf-a3d6-187ca3ddd115\") " pod="openshift-monitoring/thanos-querier-795bdd954b-n5xsr" Sep 09 23:08:29.302081 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:29.302039 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e1f3b0b2-13d5-4aaf-a3d6-187ca3ddd115-secret-grpc-tls\") pod \"thanos-querier-795bdd954b-n5xsr\" (UID: \"e1f3b0b2-13d5-4aaf-a3d6-187ca3ddd115\") " pod="openshift-monitoring/thanos-querier-795bdd954b-n5xsr" Sep 09 23:08:29.302260 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:29.302113 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lddg\" (UniqueName: \"kubernetes.io/projected/e1f3b0b2-13d5-4aaf-a3d6-187ca3ddd115-kube-api-access-4lddg\") pod \"thanos-querier-795bdd954b-n5xsr\" (UID: \"e1f3b0b2-13d5-4aaf-a3d6-187ca3ddd115\") " pod="openshift-monitoring/thanos-querier-795bdd954b-n5xsr" Sep 09 23:08:29.302260 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:29.302168 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e1f3b0b2-13d5-4aaf-a3d6-187ca3ddd115-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-795bdd954b-n5xsr\" (UID: \"e1f3b0b2-13d5-4aaf-a3d6-187ca3ddd115\") " pod="openshift-monitoring/thanos-querier-795bdd954b-n5xsr" Sep 09 23:08:29.302260 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:29.302197 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e1f3b0b2-13d5-4aaf-a3d6-187ca3ddd115-metrics-client-ca\") pod \"thanos-querier-795bdd954b-n5xsr\" (UID: \"e1f3b0b2-13d5-4aaf-a3d6-187ca3ddd115\") " pod="openshift-monitoring/thanos-querier-795bdd954b-n5xsr" Sep 09 23:08:29.302260 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:29.302225 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/e1f3b0b2-13d5-4aaf-a3d6-187ca3ddd115-secret-thanos-querier-tls\") pod \"thanos-querier-795bdd954b-n5xsr\" (UID: \"e1f3b0b2-13d5-4aaf-a3d6-187ca3ddd115\") " pod="openshift-monitoring/thanos-querier-795bdd954b-n5xsr" Sep 09 23:08:29.302260 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:29.302255 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/e1f3b0b2-13d5-4aaf-a3d6-187ca3ddd115-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-795bdd954b-n5xsr\" (UID: \"e1f3b0b2-13d5-4aaf-a3d6-187ca3ddd115\") " pod="openshift-monitoring/thanos-querier-795bdd954b-n5xsr" Sep 09 23:08:29.302509 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:29.302295 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/e1f3b0b2-13d5-4aaf-a3d6-187ca3ddd115-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-795bdd954b-n5xsr\" (UID: \"e1f3b0b2-13d5-4aaf-a3d6-187ca3ddd115\") " pod="openshift-monitoring/thanos-querier-795bdd954b-n5xsr" Sep 09 23:08:29.303019 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:29.302968 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e1f3b0b2-13d5-4aaf-a3d6-187ca3ddd115-metrics-client-ca\") pod \"thanos-querier-795bdd954b-n5xsr\" (UID: \"e1f3b0b2-13d5-4aaf-a3d6-187ca3ddd115\") " pod="openshift-monitoring/thanos-querier-795bdd954b-n5xsr" Sep 09 23:08:29.304994 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:29.304963 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/e1f3b0b2-13d5-4aaf-a3d6-187ca3ddd115-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-795bdd954b-n5xsr\" (UID: \"e1f3b0b2-13d5-4aaf-a3d6-187ca3ddd115\") " pod="openshift-monitoring/thanos-querier-795bdd954b-n5xsr" Sep 09 23:08:29.305181 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:29.305133 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e1f3b0b2-13d5-4aaf-a3d6-187ca3ddd115-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-795bdd954b-n5xsr\" (UID: \"e1f3b0b2-13d5-4aaf-a3d6-187ca3ddd115\") " pod="openshift-monitoring/thanos-querier-795bdd954b-n5xsr" Sep 09 23:08:29.305256 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:29.305186 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e1f3b0b2-13d5-4aaf-a3d6-187ca3ddd115-secret-grpc-tls\") pod \"thanos-querier-795bdd954b-n5xsr\" (UID: \"e1f3b0b2-13d5-4aaf-a3d6-187ca3ddd115\") " pod="openshift-monitoring/thanos-querier-795bdd954b-n5xsr" Sep 09 23:08:29.305256 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:29.305234 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/e1f3b0b2-13d5-4aaf-a3d6-187ca3ddd115-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-795bdd954b-n5xsr\" (UID: \"e1f3b0b2-13d5-4aaf-a3d6-187ca3ddd115\") " pod="openshift-monitoring/thanos-querier-795bdd954b-n5xsr" Sep 09 23:08:29.305336 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:29.305305 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/e1f3b0b2-13d5-4aaf-a3d6-187ca3ddd115-secret-thanos-querier-tls\") pod \"thanos-querier-795bdd954b-n5xsr\" (UID: \"e1f3b0b2-13d5-4aaf-a3d6-187ca3ddd115\") " pod="openshift-monitoring/thanos-querier-795bdd954b-n5xsr" Sep 09 23:08:29.305442 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:29.305425 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e1f3b0b2-13d5-4aaf-a3d6-187ca3ddd115-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-795bdd954b-n5xsr\" (UID: \"e1f3b0b2-13d5-4aaf-a3d6-187ca3ddd115\") " pod="openshift-monitoring/thanos-querier-795bdd954b-n5xsr" Sep 09 23:08:29.312987 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:29.312962 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lddg\" (UniqueName: \"kubernetes.io/projected/e1f3b0b2-13d5-4aaf-a3d6-187ca3ddd115-kube-api-access-4lddg\") pod \"thanos-querier-795bdd954b-n5xsr\" (UID: \"e1f3b0b2-13d5-4aaf-a3d6-187ca3ddd115\") " pod="openshift-monitoring/thanos-querier-795bdd954b-n5xsr" Sep 09 23:08:29.361330 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:29.360685 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-795bdd954b-n5xsr" Sep 09 23:08:29.362944 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:29.362848 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-bwllv"] Sep 09 23:08:29.367050 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:08:29.367016 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea8fd004_8b78_4b2b_86e1_91132f154174.slice/crio-74d68f6324b4893cf16de3473b66e4eef7fbecaca5120439abb89f8b87b9d5c6 WatchSource:0}: Error finding container 74d68f6324b4893cf16de3473b66e4eef7fbecaca5120439abb89f8b87b9d5c6: Status 404 returned error can't find the container with id 74d68f6324b4893cf16de3473b66e4eef7fbecaca5120439abb89f8b87b9d5c6 Sep 09 23:08:29.671841 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:29.671808 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-795bdd954b-n5xsr"] Sep 09 23:08:29.679395 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:08:29.679359 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1f3b0b2_13d5_4aaf_a3d6_187ca3ddd115.slice/crio-227f8f541f8602e1621c9dba73d567bab521722203175f42c311706c04e5112b WatchSource:0}: Error finding container 227f8f541f8602e1621c9dba73d567bab521722203175f42c311706c04e5112b: Status 404 returned error can't find the container with id 227f8f541f8602e1621c9dba73d567bab521722203175f42c311706c04e5112b Sep 09 23:08:29.877240 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:29.877146 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cdc48478d-z95ns" event={"ID":"2b72cf56-1dd3-40a6-90e4-a332fbe85424","Type":"ContainerStarted","Data":"cabedd607e1b13f18ac2630c878e5de84b48c6bc9cfe1bc92ecbb503c80bbc78"} Sep 09 23:08:29.880224 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:29.880181 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7jqqc" event={"ID":"b810b4cc-b59e-485b-a9d2-bc05b1f9f22f","Type":"ContainerStarted","Data":"377a2d310971b8fa6ee313eec671614639d68b3a1fa1918bf69da4a55b649317"} Sep 09 23:08:29.884034 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:29.883500 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-rc9rd" event={"ID":"916272e3-b151-462e-95e3-551c2cc28347","Type":"ContainerStarted","Data":"da64005549b85bc15d3663859f9503abefb18f616794cc8908dc98caa2b5e7d6"} Sep 09 23:08:29.884034 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:29.883564 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-85d98c998f-rc9rd" Sep 09 23:08:29.886497 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:29.886408 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-795bdd954b-n5xsr" event={"ID":"e1f3b0b2-13d5-4aaf-a3d6-187ca3ddd115","Type":"ContainerStarted","Data":"227f8f541f8602e1621c9dba73d567bab521722203175f42c311706c04e5112b"} Sep 09 23:08:29.889407 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:29.889293 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-bwllv" event={"ID":"ea8fd004-8b78-4b2b-86e1-91132f154174","Type":"ContainerStarted","Data":"c3033c57de3ec8508d29a542d89db073175c33f0de029f56fe9e13b3499e1fd6"} Sep 09 23:08:29.889407 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:29.889353 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-bwllv" event={"ID":"ea8fd004-8b78-4b2b-86e1-91132f154174","Type":"ContainerStarted","Data":"b2be432ed34087892c5919f127b1c1f28e5103cf8ac3d58afca92bfd9ac03ade"} Sep 09 23:08:29.889407 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:29.889379 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-bwllv" event={"ID":"ea8fd004-8b78-4b2b-86e1-91132f154174","Type":"ContainerStarted","Data":"74d68f6324b4893cf16de3473b66e4eef7fbecaca5120439abb89f8b87b9d5c6"} Sep 09 23:08:29.895324 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:29.894954 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7cdc48478d-z95ns" podStartSLOduration=1.676560716 podStartE2EDuration="11.894933357s" totalImagesPullingTime="10.218372641s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:08:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:08:29.894730427 +0000 UTC m=+280.410461257" watchObservedRunningTime="2026-09-09 23:08:29.894933357 +0000 UTC m=+280.410664257" Sep 09 23:08:29.896533 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:29.896474 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-85d98c998f-rc9rd" Sep 09 23:08:29.912655 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:29.912592 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-85d98c998f-rc9rd" podStartSLOduration=2.31461237 podStartE2EDuration="19.912567326s" totalImagesPullingTime="17.597954956s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:08:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:08:29.911169614 +0000 UTC m=+280.426900448" watchObservedRunningTime="2026-09-09 23:08:29.912567326 +0000 UTC m=+280.428298159" Sep 09 23:08:30.451041 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:08:30.450988 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-2snpc" podUID="e4b08d5d-1afa-4ba8-b544-a2c6d441566e" Sep 09 23:08:30.898867 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:30.898826 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2snpc" Sep 09 23:08:30.959768 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:30.959727 2552 patch_prober.go:28] interesting pod/image-registry-7d89fb7b67-khjgb container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 09 23:08:30.959952 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:30.959802 2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7d89fb7b67-khjgb" podUID="f8e95541-01e9-4d65-921c-5ab7bf9593cb" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 09 23:08:31.907895 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:31.907848 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9pglj" event={"ID":"061f6ffa-34f9-499c-97f8-b1bc0febefdd","Type":"ContainerStarted","Data":"924ac77f6e1f4e25b5b87fea99fba3bea159e9d4787252b8eacfde887bd04833"} Sep 09 23:08:31.911577 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:31.911473 2552 generic.go:356] "Generic (PLEG): container finished" podID="b810b4cc-b59e-485b-a9d2-bc05b1f9f22f" containerID="6d045a4761d71a2c05aa4e16fcec4521e656b5d6a0e6f247ab6700dfb8612fc3" exitCode=0 Sep 09 23:08:31.911577 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:31.911523 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7jqqc" event={"ID":"b810b4cc-b59e-485b-a9d2-bc05b1f9f22f","Type":"ContainerDied","Data":"6d045a4761d71a2c05aa4e16fcec4521e656b5d6a0e6f247ab6700dfb8612fc3"} Sep 09 23:08:31.927401 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:31.927336 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-9pglj" podStartSLOduration=34.026636317 podStartE2EDuration="44.927312248s" totalImagesPullingTime="10.900675931s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:07:47 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:08:31.924437433 +0000 UTC m=+282.440168264" watchObservedRunningTime="2026-09-09 23:08:31.927312248 +0000 UTC m=+282.443043079" Sep 09 23:08:32.652547 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:32.652504 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7cdc48478d-z95ns"] Sep 09 23:08:32.681041 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:32.681002 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5444c9fb4c-hh6tq"] Sep 09 23:08:32.715961 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:32.715919 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5444c9fb4c-hh6tq"] Sep 09 23:08:32.716164 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:32.716068 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5444c9fb4c-hh6tq" Sep 09 23:08:32.724105 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:32.723899 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 09 23:08:32.843961 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:32.843919 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/12815e46-6cce-4ec1-9232-c4d3e9a38680-oauth-serving-cert\") pod \"console-5444c9fb4c-hh6tq\" (UID: \"12815e46-6cce-4ec1-9232-c4d3e9a38680\") " pod="openshift-console/console-5444c9fb4c-hh6tq" Sep 09 23:08:32.844185 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:32.843973 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/12815e46-6cce-4ec1-9232-c4d3e9a38680-service-ca\") pod \"console-5444c9fb4c-hh6tq\" (UID: \"12815e46-6cce-4ec1-9232-c4d3e9a38680\") " pod="openshift-console/console-5444c9fb4c-hh6tq" Sep 09 23:08:32.844185 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:32.844097 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/12815e46-6cce-4ec1-9232-c4d3e9a38680-trusted-ca-bundle\") pod \"console-5444c9fb4c-hh6tq\" (UID: \"12815e46-6cce-4ec1-9232-c4d3e9a38680\") " pod="openshift-console/console-5444c9fb4c-hh6tq" Sep 09 23:08:32.844185 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:32.844161 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/12815e46-6cce-4ec1-9232-c4d3e9a38680-console-oauth-config\") pod \"console-5444c9fb4c-hh6tq\" (UID: \"12815e46-6cce-4ec1-9232-c4d3e9a38680\") " pod="openshift-console/console-5444c9fb4c-hh6tq" Sep 09 23:08:32.844362 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:32.844299 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/12815e46-6cce-4ec1-9232-c4d3e9a38680-console-config\") pod \"console-5444c9fb4c-hh6tq\" (UID: \"12815e46-6cce-4ec1-9232-c4d3e9a38680\") " pod="openshift-console/console-5444c9fb4c-hh6tq" Sep 09 23:08:32.844419 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:32.844356 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w22ks\" (UniqueName: \"kubernetes.io/projected/12815e46-6cce-4ec1-9232-c4d3e9a38680-kube-api-access-w22ks\") pod \"console-5444c9fb4c-hh6tq\" (UID: \"12815e46-6cce-4ec1-9232-c4d3e9a38680\") " pod="openshift-console/console-5444c9fb4c-hh6tq" Sep 09 23:08:32.844419 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:32.844411 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/12815e46-6cce-4ec1-9232-c4d3e9a38680-console-serving-cert\") pod \"console-5444c9fb4c-hh6tq\" (UID: \"12815e46-6cce-4ec1-9232-c4d3e9a38680\") " pod="openshift-console/console-5444c9fb4c-hh6tq" Sep 09 23:08:32.920123 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:32.919999 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7jqqc" event={"ID":"b810b4cc-b59e-485b-a9d2-bc05b1f9f22f","Type":"ContainerStarted","Data":"95673eb440bfa4843146bc8536b729eb3fdf462dacf351a1ce1f4d49eb745bf5"} Sep 09 23:08:32.946023 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:32.945976 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/12815e46-6cce-4ec1-9232-c4d3e9a38680-oauth-serving-cert\") pod \"console-5444c9fb4c-hh6tq\" (UID: \"12815e46-6cce-4ec1-9232-c4d3e9a38680\") " pod="openshift-console/console-5444c9fb4c-hh6tq" Sep 09 23:08:32.946228 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:32.946041 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/12815e46-6cce-4ec1-9232-c4d3e9a38680-service-ca\") pod \"console-5444c9fb4c-hh6tq\" (UID: \"12815e46-6cce-4ec1-9232-c4d3e9a38680\") " pod="openshift-console/console-5444c9fb4c-hh6tq" Sep 09 23:08:32.946228 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:32.946072 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/12815e46-6cce-4ec1-9232-c4d3e9a38680-trusted-ca-bundle\") pod \"console-5444c9fb4c-hh6tq\" (UID: \"12815e46-6cce-4ec1-9232-c4d3e9a38680\") " pod="openshift-console/console-5444c9fb4c-hh6tq" Sep 09 23:08:32.946228 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:32.946103 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/12815e46-6cce-4ec1-9232-c4d3e9a38680-console-oauth-config\") pod \"console-5444c9fb4c-hh6tq\" (UID: \"12815e46-6cce-4ec1-9232-c4d3e9a38680\") " pod="openshift-console/console-5444c9fb4c-hh6tq" Sep 09 23:08:32.946228 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:32.946173 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/12815e46-6cce-4ec1-9232-c4d3e9a38680-console-config\") pod \"console-5444c9fb4c-hh6tq\" (UID: \"12815e46-6cce-4ec1-9232-c4d3e9a38680\") " pod="openshift-console/console-5444c9fb4c-hh6tq" Sep 09 23:08:32.946228 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:32.946211 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w22ks\" (UniqueName: \"kubernetes.io/projected/12815e46-6cce-4ec1-9232-c4d3e9a38680-kube-api-access-w22ks\") pod \"console-5444c9fb4c-hh6tq\" (UID: \"12815e46-6cce-4ec1-9232-c4d3e9a38680\") " pod="openshift-console/console-5444c9fb4c-hh6tq" Sep 09 23:08:32.946510 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:32.946270 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/12815e46-6cce-4ec1-9232-c4d3e9a38680-console-serving-cert\") pod \"console-5444c9fb4c-hh6tq\" (UID: \"12815e46-6cce-4ec1-9232-c4d3e9a38680\") " pod="openshift-console/console-5444c9fb4c-hh6tq" Sep 09 23:08:32.946908 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:32.946840 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/12815e46-6cce-4ec1-9232-c4d3e9a38680-oauth-serving-cert\") pod \"console-5444c9fb4c-hh6tq\" (UID: \"12815e46-6cce-4ec1-9232-c4d3e9a38680\") " pod="openshift-console/console-5444c9fb4c-hh6tq" Sep 09 23:08:32.947269 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:32.947036 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/12815e46-6cce-4ec1-9232-c4d3e9a38680-trusted-ca-bundle\") pod \"console-5444c9fb4c-hh6tq\" (UID: \"12815e46-6cce-4ec1-9232-c4d3e9a38680\") " pod="openshift-console/console-5444c9fb4c-hh6tq" Sep 09 23:08:32.947391 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:32.947271 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/12815e46-6cce-4ec1-9232-c4d3e9a38680-console-config\") pod \"console-5444c9fb4c-hh6tq\" (UID: \"12815e46-6cce-4ec1-9232-c4d3e9a38680\") " pod="openshift-console/console-5444c9fb4c-hh6tq" Sep 09 23:08:32.947653 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:32.947610 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/12815e46-6cce-4ec1-9232-c4d3e9a38680-service-ca\") pod \"console-5444c9fb4c-hh6tq\" (UID: \"12815e46-6cce-4ec1-9232-c4d3e9a38680\") " pod="openshift-console/console-5444c9fb4c-hh6tq" Sep 09 23:08:32.949627 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:32.949593 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/12815e46-6cce-4ec1-9232-c4d3e9a38680-console-serving-cert\") pod \"console-5444c9fb4c-hh6tq\" (UID: \"12815e46-6cce-4ec1-9232-c4d3e9a38680\") " pod="openshift-console/console-5444c9fb4c-hh6tq" Sep 09 23:08:32.955555 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:32.955522 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w22ks\" (UniqueName: \"kubernetes.io/projected/12815e46-6cce-4ec1-9232-c4d3e9a38680-kube-api-access-w22ks\") pod \"console-5444c9fb4c-hh6tq\" (UID: \"12815e46-6cce-4ec1-9232-c4d3e9a38680\") " pod="openshift-console/console-5444c9fb4c-hh6tq" Sep 09 23:08:32.956309 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:32.956285 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/12815e46-6cce-4ec1-9232-c4d3e9a38680-console-oauth-config\") pod \"console-5444c9fb4c-hh6tq\" (UID: \"12815e46-6cce-4ec1-9232-c4d3e9a38680\") " pod="openshift-console/console-5444c9fb4c-hh6tq" Sep 09 23:08:33.030280 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:33.030245 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5444c9fb4c-hh6tq" Sep 09 23:08:33.380346 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:33.380150 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5444c9fb4c-hh6tq"] Sep 09 23:08:33.479731 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:08:33.479627 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12815e46_6cce_4ec1_9232_c4d3e9a38680.slice/crio-dae07947f6c2216484c92390d62e6720313ce9bacef9ea191e4460bd19a47196 WatchSource:0}: Error finding container dae07947f6c2216484c92390d62e6720313ce9bacef9ea191e4460bd19a47196: Status 404 returned error can't find the container with id dae07947f6c2216484c92390d62e6720313ce9bacef9ea191e4460bd19a47196 Sep 09 23:08:33.754525 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:33.754479 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e4b08d5d-1afa-4ba8-b544-a2c6d441566e-metrics-tls\") pod \"dns-default-2snpc\" (UID: \"e4b08d5d-1afa-4ba8-b544-a2c6d441566e\") " pod="openshift-dns/dns-default-2snpc" Sep 09 23:08:33.757215 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:33.757183 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e4b08d5d-1afa-4ba8-b544-a2c6d441566e-metrics-tls\") pod \"dns-default-2snpc\" (UID: \"e4b08d5d-1afa-4ba8-b544-a2c6d441566e\") " pod="openshift-dns/dns-default-2snpc" Sep 09 23:08:33.902580 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:33.902545 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jj6sk\"" Sep 09 23:08:33.911470 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:33.911373 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2snpc" Sep 09 23:08:33.928317 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:33.928278 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-795bdd954b-n5xsr" event={"ID":"e1f3b0b2-13d5-4aaf-a3d6-187ca3ddd115","Type":"ContainerStarted","Data":"c8daf26b41bb72e4cc4e8ae2a8427c56642940db68bc23209f7656d8758468ee"} Sep 09 23:08:33.928750 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:33.928415 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-795bdd954b-n5xsr" event={"ID":"e1f3b0b2-13d5-4aaf-a3d6-187ca3ddd115","Type":"ContainerStarted","Data":"5f5dc1ed46195168ab0d4a2684204c96c8073c4ac450438402d6143bad4aeaa8"} Sep 09 23:08:33.928750 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:33.928465 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-795bdd954b-n5xsr" event={"ID":"e1f3b0b2-13d5-4aaf-a3d6-187ca3ddd115","Type":"ContainerStarted","Data":"197f6380bf06e14ff9a9b80388ee574cac1d80588dc4f874406016c497779560"} Sep 09 23:08:33.941512 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:33.941360 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-bwllv" event={"ID":"ea8fd004-8b78-4b2b-86e1-91132f154174","Type":"ContainerStarted","Data":"e8f69d53c8500f6c851488821f100a66f231f047f4ce19db99499e2daddae0f5"} Sep 09 23:08:33.941512 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:33.941424 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5444c9fb4c-hh6tq" event={"ID":"12815e46-6cce-4ec1-9232-c4d3e9a38680","Type":"ContainerStarted","Data":"2423122a8da07d274b0b1383c6ef8c5c4986ad8909ee624115b9a499aafa5ef6"} Sep 09 23:08:33.941512 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:33.941447 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5444c9fb4c-hh6tq" event={"ID":"12815e46-6cce-4ec1-9232-c4d3e9a38680","Type":"ContainerStarted","Data":"dae07947f6c2216484c92390d62e6720313ce9bacef9ea191e4460bd19a47196"} Sep 09 23:08:33.941512 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:33.941467 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7jqqc" event={"ID":"b810b4cc-b59e-485b-a9d2-bc05b1f9f22f","Type":"ContainerStarted","Data":"17e28dc63150a0e826a0654e24fe3af769cada62359940c734abf18a14db7686"} Sep 09 23:08:33.951831 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:33.950786 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-bwllv" podStartSLOduration=4.387578632 podStartE2EDuration="7.950763486s" totalImagesPullingTime="3.563184854s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:08:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:08:33.94857376 +0000 UTC m=+284.464304614" watchObservedRunningTime="2026-09-09 23:08:33.950763486 +0000 UTC m=+284.466494318" Sep 09 23:08:33.966849 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:33.966786 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-7jqqc" podStartSLOduration=5.824497665 podStartE2EDuration="7.966761431s" totalImagesPullingTime="2.023095897s" totalInitContainerRuntime="119.167869ms" isStatefulPod=true podCreationTimestamp="2026-09-09 23:08:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:08:33.964588868 +0000 UTC m=+284.480319700" watchObservedRunningTime="2026-09-09 23:08:33.966761431 +0000 UTC m=+284.482492262" Sep 09 23:08:33.981152 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:33.981084 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5444c9fb4c-hh6tq" podStartSLOduration=1.9810597460000001 podStartE2EDuration="1.981059746s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:08:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:08:33.979526155 +0000 UTC m=+284.495256997" watchObservedRunningTime="2026-09-09 23:08:33.981059746 +0000 UTC m=+284.496790578" Sep 09 23:08:34.216770 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:34.216361 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2snpc"] Sep 09 23:08:34.219733 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:08:34.219696 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4b08d5d_1afa_4ba8_b544_a2c6d441566e.slice/crio-359ddae27700a904431aa6f3255f869b5c079e2a7e2839dd0c7c7bf9174b9fe5 WatchSource:0}: Error finding container 359ddae27700a904431aa6f3255f869b5c079e2a7e2839dd0c7c7bf9174b9fe5: Status 404 returned error can't find the container with id 359ddae27700a904431aa6f3255f869b5c079e2a7e2839dd0c7c7bf9174b9fe5 Sep 09 23:08:34.946713 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:34.946501 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2snpc" event={"ID":"e4b08d5d-1afa-4ba8-b544-a2c6d441566e","Type":"ContainerStarted","Data":"359ddae27700a904431aa6f3255f869b5c079e2a7e2839dd0c7c7bf9174b9fe5"} Sep 09 23:08:35.956870 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:35.956819 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-795bdd954b-n5xsr" event={"ID":"e1f3b0b2-13d5-4aaf-a3d6-187ca3ddd115","Type":"ContainerStarted","Data":"e46c141d64ccab1020a6bb5f42e315891f6c19faf8acbea0bb15c84ab7bbc586"} Sep 09 23:08:35.957489 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:35.956910 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-795bdd954b-n5xsr" event={"ID":"e1f3b0b2-13d5-4aaf-a3d6-187ca3ddd115","Type":"ContainerStarted","Data":"ad046d59dfeb207b61bfe7abe2bbee70111f01d860d322f08dba3f8ca935bae9"} Sep 09 23:08:35.957489 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:35.956952 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-795bdd954b-n5xsr" event={"ID":"e1f3b0b2-13d5-4aaf-a3d6-187ca3ddd115","Type":"ContainerStarted","Data":"25c4a271fae02142282055dd2c7662e305ff9298f94ef4e45cfc3c548dd08c0f"} Sep 09 23:08:35.957489 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:35.957098 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-795bdd954b-n5xsr" Sep 09 23:08:35.975645 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:35.975593 2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7d89fb7b67-khjgb" podUID="f8e95541-01e9-4d65-921c-5ab7bf9593cb" containerName="registry" containerID="cri-o://f2d3b2db7000bfb69f7036cd624bbfb7c70506dac598806ecc77d27875ae0576" gracePeriod=30 Sep 09 23:08:35.980183 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:35.979981 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-795bdd954b-n5xsr" podStartSLOduration=1.781705621 podStartE2EDuration="6.97995614s" totalImagesPullingTime="5.198250519s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:08:29 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:08:35.977727938 +0000 UTC m=+286.493458769" watchObservedRunningTime="2026-09-09 23:08:35.97995614 +0000 UTC m=+286.495686973" Sep 09 23:08:36.481813 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:36.481773 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d89fb7b67-khjgb" Sep 09 23:08:36.580409 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:36.580335 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f8e95541-01e9-4d65-921c-5ab7bf9593cb-trusted-ca\") pod \"f8e95541-01e9-4d65-921c-5ab7bf9593cb\" (UID: \"f8e95541-01e9-4d65-921c-5ab7bf9593cb\") " Sep 09 23:08:36.580409 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:36.580384 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f8e95541-01e9-4d65-921c-5ab7bf9593cb-registry-tls\") pod \"f8e95541-01e9-4d65-921c-5ab7bf9593cb\" (UID: \"f8e95541-01e9-4d65-921c-5ab7bf9593cb\") " Sep 09 23:08:36.580409 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:36.580418 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f8e95541-01e9-4d65-921c-5ab7bf9593cb-installation-pull-secrets\") pod \"f8e95541-01e9-4d65-921c-5ab7bf9593cb\" (UID: \"f8e95541-01e9-4d65-921c-5ab7bf9593cb\") " Sep 09 23:08:36.580778 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:36.580440 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f8e95541-01e9-4d65-921c-5ab7bf9593cb-image-registry-private-configuration\") pod \"f8e95541-01e9-4d65-921c-5ab7bf9593cb\" (UID: \"f8e95541-01e9-4d65-921c-5ab7bf9593cb\") " Sep 09 23:08:36.580778 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:36.580563 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f8e95541-01e9-4d65-921c-5ab7bf9593cb-bound-sa-token\") pod \"f8e95541-01e9-4d65-921c-5ab7bf9593cb\" (UID: \"f8e95541-01e9-4d65-921c-5ab7bf9593cb\") " Sep 09 23:08:36.580778 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:36.580640 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f8e95541-01e9-4d65-921c-5ab7bf9593cb-registry-certificates\") pod \"f8e95541-01e9-4d65-921c-5ab7bf9593cb\" (UID: \"f8e95541-01e9-4d65-921c-5ab7bf9593cb\") " Sep 09 23:08:36.580778 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:36.580711 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ndp8t\" (UniqueName: \"kubernetes.io/projected/f8e95541-01e9-4d65-921c-5ab7bf9593cb-kube-api-access-ndp8t\") pod \"f8e95541-01e9-4d65-921c-5ab7bf9593cb\" (UID: \"f8e95541-01e9-4d65-921c-5ab7bf9593cb\") " Sep 09 23:08:36.580778 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:36.580744 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f8e95541-01e9-4d65-921c-5ab7bf9593cb-ca-trust-extracted\") pod \"f8e95541-01e9-4d65-921c-5ab7bf9593cb\" (UID: \"f8e95541-01e9-4d65-921c-5ab7bf9593cb\") " Sep 09 23:08:36.581029 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:36.580824 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8e95541-01e9-4d65-921c-5ab7bf9593cb-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "f8e95541-01e9-4d65-921c-5ab7bf9593cb" (UID: "f8e95541-01e9-4d65-921c-5ab7bf9593cb"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:08:36.581089 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:36.581041 2552 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f8e95541-01e9-4d65-921c-5ab7bf9593cb-trusted-ca\") on node \"ip-10-0-142-217.ec2.internal\" DevicePath \"\"" Sep 09 23:08:36.583700 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:36.581481 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8e95541-01e9-4d65-921c-5ab7bf9593cb-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "f8e95541-01e9-4d65-921c-5ab7bf9593cb" (UID: "f8e95541-01e9-4d65-921c-5ab7bf9593cb"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:08:36.583912 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:36.583879 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8e95541-01e9-4d65-921c-5ab7bf9593cb-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "f8e95541-01e9-4d65-921c-5ab7bf9593cb" (UID: "f8e95541-01e9-4d65-921c-5ab7bf9593cb"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:08:36.584030 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:36.583884 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8e95541-01e9-4d65-921c-5ab7bf9593cb-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "f8e95541-01e9-4d65-921c-5ab7bf9593cb" (UID: "f8e95541-01e9-4d65-921c-5ab7bf9593cb"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:08:36.584369 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:36.584343 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8e95541-01e9-4d65-921c-5ab7bf9593cb-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "f8e95541-01e9-4d65-921c-5ab7bf9593cb" (UID: "f8e95541-01e9-4d65-921c-5ab7bf9593cb"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:08:36.584867 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:36.584838 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8e95541-01e9-4d65-921c-5ab7bf9593cb-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "f8e95541-01e9-4d65-921c-5ab7bf9593cb" (UID: "f8e95541-01e9-4d65-921c-5ab7bf9593cb"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:08:36.586402 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:36.586361 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8e95541-01e9-4d65-921c-5ab7bf9593cb-kube-api-access-ndp8t" (OuterVolumeSpecName: "kube-api-access-ndp8t") pod "f8e95541-01e9-4d65-921c-5ab7bf9593cb" (UID: "f8e95541-01e9-4d65-921c-5ab7bf9593cb"). InnerVolumeSpecName "kube-api-access-ndp8t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:08:36.593650 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:36.593618 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8e95541-01e9-4d65-921c-5ab7bf9593cb-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "f8e95541-01e9-4d65-921c-5ab7bf9593cb" (UID: "f8e95541-01e9-4d65-921c-5ab7bf9593cb"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:08:36.682443 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:36.682416 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ndp8t\" (UniqueName: \"kubernetes.io/projected/f8e95541-01e9-4d65-921c-5ab7bf9593cb-kube-api-access-ndp8t\") on node \"ip-10-0-142-217.ec2.internal\" DevicePath \"\"" Sep 09 23:08:36.682585 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:36.682445 2552 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f8e95541-01e9-4d65-921c-5ab7bf9593cb-ca-trust-extracted\") on node \"ip-10-0-142-217.ec2.internal\" DevicePath \"\"" Sep 09 23:08:36.682585 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:36.682461 2552 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f8e95541-01e9-4d65-921c-5ab7bf9593cb-registry-tls\") on node \"ip-10-0-142-217.ec2.internal\" DevicePath \"\"" Sep 09 23:08:36.682585 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:36.682473 2552 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f8e95541-01e9-4d65-921c-5ab7bf9593cb-installation-pull-secrets\") on node \"ip-10-0-142-217.ec2.internal\" DevicePath \"\"" Sep 09 23:08:36.682585 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:36.682486 2552 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f8e95541-01e9-4d65-921c-5ab7bf9593cb-image-registry-private-configuration\") on node \"ip-10-0-142-217.ec2.internal\" DevicePath \"\"" Sep 09 23:08:36.682585 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:36.682500 2552 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f8e95541-01e9-4d65-921c-5ab7bf9593cb-bound-sa-token\") on node \"ip-10-0-142-217.ec2.internal\" DevicePath \"\"" Sep 09 23:08:36.682585 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:36.682513 2552 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f8e95541-01e9-4d65-921c-5ab7bf9593cb-registry-certificates\") on node \"ip-10-0-142-217.ec2.internal\" DevicePath \"\"" Sep 09 23:08:36.963288 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:36.963247 2552 generic.go:356] "Generic (PLEG): container finished" podID="f8e95541-01e9-4d65-921c-5ab7bf9593cb" containerID="f2d3b2db7000bfb69f7036cd624bbfb7c70506dac598806ecc77d27875ae0576" exitCode=0 Sep 09 23:08:36.963787 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:36.963316 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d89fb7b67-khjgb" Sep 09 23:08:36.963787 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:36.963334 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7d89fb7b67-khjgb" event={"ID":"f8e95541-01e9-4d65-921c-5ab7bf9593cb","Type":"ContainerDied","Data":"f2d3b2db7000bfb69f7036cd624bbfb7c70506dac598806ecc77d27875ae0576"} Sep 09 23:08:36.963787 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:36.963403 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7d89fb7b67-khjgb" event={"ID":"f8e95541-01e9-4d65-921c-5ab7bf9593cb","Type":"ContainerDied","Data":"e7208b0513a5827bd26cc610dba950a77b0adecefba26d2941f5b0733fde668e"} Sep 09 23:08:36.963787 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:36.963423 2552 scope.go:117] "RemoveContainer" containerID="f2d3b2db7000bfb69f7036cd624bbfb7c70506dac598806ecc77d27875ae0576" Sep 09 23:08:36.965733 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:36.965644 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2snpc" event={"ID":"e4b08d5d-1afa-4ba8-b544-a2c6d441566e","Type":"ContainerStarted","Data":"2438b24e3a881858331b89b00c590b91a82c01439fc8508e3b9c375ff5a5698d"} Sep 09 23:08:36.974199 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:36.974141 2552 scope.go:117] "RemoveContainer" containerID="f2d3b2db7000bfb69f7036cd624bbfb7c70506dac598806ecc77d27875ae0576" Sep 09 23:08:36.974600 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:08:36.974567 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f2d3b2db7000bfb69f7036cd624bbfb7c70506dac598806ecc77d27875ae0576\": container with ID starting with f2d3b2db7000bfb69f7036cd624bbfb7c70506dac598806ecc77d27875ae0576 not found: ID does not exist" containerID="f2d3b2db7000bfb69f7036cd624bbfb7c70506dac598806ecc77d27875ae0576" Sep 09 23:08:36.974737 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:36.974609 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2d3b2db7000bfb69f7036cd624bbfb7c70506dac598806ecc77d27875ae0576"} err="failed to get container status \"f2d3b2db7000bfb69f7036cd624bbfb7c70506dac598806ecc77d27875ae0576\": rpc error: code = NotFound desc = could not find container \"f2d3b2db7000bfb69f7036cd624bbfb7c70506dac598806ecc77d27875ae0576\": container with ID starting with f2d3b2db7000bfb69f7036cd624bbfb7c70506dac598806ecc77d27875ae0576 not found: ID does not exist" Sep 09 23:08:36.986832 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:36.986793 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7d89fb7b67-khjgb"] Sep 09 23:08:36.990479 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:36.990444 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7d89fb7b67-khjgb"] Sep 09 23:08:37.939008 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:37.938974 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8e95541-01e9-4d65-921c-5ab7bf9593cb" path="/var/lib/kubelet/pods/f8e95541-01e9-4d65-921c-5ab7bf9593cb/volumes" Sep 09 23:08:37.973708 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:37.973656 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2snpc" event={"ID":"e4b08d5d-1afa-4ba8-b544-a2c6d441566e","Type":"ContainerStarted","Data":"31954d20663addc8e449b1f857531b5eafbfdbd4d0ba64201b1ee9e045a1d256"} Sep 09 23:08:37.974178 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:37.973758 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-2snpc" Sep 09 23:08:37.991908 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:37.991841 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-2snpc" podStartSLOduration=252.552054319 podStartE2EDuration="4m14.991821731s" totalImagesPullingTime="2.439767412s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:04:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:08:37.991062834 +0000 UTC m=+288.506793677" watchObservedRunningTime="2026-09-09 23:08:37.991821731 +0000 UTC m=+288.507552562" Sep 09 23:08:38.582958 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:38.582912 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7cdc48478d-z95ns" Sep 09 23:08:41.972068 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:41.972038 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-795bdd954b-n5xsr" Sep 09 23:08:43.030992 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:43.030952 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5444c9fb4c-hh6tq" Sep 09 23:08:43.031380 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:43.031060 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5444c9fb4c-hh6tq" Sep 09 23:08:43.035701 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:43.035658 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5444c9fb4c-hh6tq" Sep 09 23:08:44.000727 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:44.000697 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5444c9fb4c-hh6tq" Sep 09 23:08:47.980478 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:47.980448 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-2snpc" Sep 09 23:08:49.867275 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:49.867248 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-p2dvt_ac335ac0-a272-420f-a215-b93e03772895/console-operator/1.log" Sep 09 23:08:49.868292 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:49.868265 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-p2dvt_ac335ac0-a272-420f-a215-b93e03772895/console-operator/1.log" Sep 09 23:08:49.873125 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:49.873100 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6x9hk_2f52574e-96c0-4939-9826-4959aeae1c8b/ovn-acl-logging/0.log" Sep 09 23:08:49.874316 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:49.874297 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6x9hk_2f52574e-96c0-4939-9826-4959aeae1c8b/ovn-acl-logging/0.log" Sep 09 23:08:49.880603 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:49.880582 2552 kubelet.go:1648] "Image garbage collection succeeded" Sep 09 23:08:57.682080 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:57.682013 2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7cdc48478d-z95ns" podUID="2b72cf56-1dd3-40a6-90e4-a332fbe85424" containerName="console" containerID="cri-o://cabedd607e1b13f18ac2630c878e5de84b48c6bc9cfe1bc92ecbb503c80bbc78" gracePeriod=15 Sep 09 23:08:57.925092 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:57.925065 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cdc48478d-z95ns" Sep 09 23:08:57.955104 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:57.954996 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2b72cf56-1dd3-40a6-90e4-a332fbe85424-console-config\") pod \"2b72cf56-1dd3-40a6-90e4-a332fbe85424\" (UID: \"2b72cf56-1dd3-40a6-90e4-a332fbe85424\") " Sep 09 23:08:57.955104 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:57.955075 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2b72cf56-1dd3-40a6-90e4-a332fbe85424-console-oauth-config\") pod \"2b72cf56-1dd3-40a6-90e4-a332fbe85424\" (UID: \"2b72cf56-1dd3-40a6-90e4-a332fbe85424\") " Sep 09 23:08:57.955370 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:57.955179 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2b72cf56-1dd3-40a6-90e4-a332fbe85424-console-serving-cert\") pod \"2b72cf56-1dd3-40a6-90e4-a332fbe85424\" (UID: \"2b72cf56-1dd3-40a6-90e4-a332fbe85424\") " Sep 09 23:08:57.955370 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:57.955244 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2b72cf56-1dd3-40a6-90e4-a332fbe85424-service-ca\") pod \"2b72cf56-1dd3-40a6-90e4-a332fbe85424\" (UID: \"2b72cf56-1dd3-40a6-90e4-a332fbe85424\") " Sep 09 23:08:57.955476 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:57.955416 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-52ngb\" (UniqueName: \"kubernetes.io/projected/2b72cf56-1dd3-40a6-90e4-a332fbe85424-kube-api-access-52ngb\") pod \"2b72cf56-1dd3-40a6-90e4-a332fbe85424\" (UID: \"2b72cf56-1dd3-40a6-90e4-a332fbe85424\") " Sep 09 23:08:57.955531 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:57.955476 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2b72cf56-1dd3-40a6-90e4-a332fbe85424-oauth-serving-cert\") pod \"2b72cf56-1dd3-40a6-90e4-a332fbe85424\" (UID: \"2b72cf56-1dd3-40a6-90e4-a332fbe85424\") " Sep 09 23:08:57.955531 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:57.955478 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b72cf56-1dd3-40a6-90e4-a332fbe85424-console-config" (OuterVolumeSpecName: "console-config") pod "2b72cf56-1dd3-40a6-90e4-a332fbe85424" (UID: "2b72cf56-1dd3-40a6-90e4-a332fbe85424"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:08:57.955638 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:57.955583 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b72cf56-1dd3-40a6-90e4-a332fbe85424-service-ca" (OuterVolumeSpecName: "service-ca") pod "2b72cf56-1dd3-40a6-90e4-a332fbe85424" (UID: "2b72cf56-1dd3-40a6-90e4-a332fbe85424"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:08:57.955752 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:57.955734 2552 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2b72cf56-1dd3-40a6-90e4-a332fbe85424-console-config\") on node \"ip-10-0-142-217.ec2.internal\" DevicePath \"\"" Sep 09 23:08:57.955816 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:57.955753 2552 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2b72cf56-1dd3-40a6-90e4-a332fbe85424-service-ca\") on node \"ip-10-0-142-217.ec2.internal\" DevicePath \"\"" Sep 09 23:08:57.956028 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:57.955997 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b72cf56-1dd3-40a6-90e4-a332fbe85424-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2b72cf56-1dd3-40a6-90e4-a332fbe85424" (UID: "2b72cf56-1dd3-40a6-90e4-a332fbe85424"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:08:57.957495 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:57.957465 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b72cf56-1dd3-40a6-90e4-a332fbe85424-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2b72cf56-1dd3-40a6-90e4-a332fbe85424" (UID: "2b72cf56-1dd3-40a6-90e4-a332fbe85424"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:08:57.957495 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:57.957482 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b72cf56-1dd3-40a6-90e4-a332fbe85424-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2b72cf56-1dd3-40a6-90e4-a332fbe85424" (UID: "2b72cf56-1dd3-40a6-90e4-a332fbe85424"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:08:57.957627 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:57.957531 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b72cf56-1dd3-40a6-90e4-a332fbe85424-kube-api-access-52ngb" (OuterVolumeSpecName: "kube-api-access-52ngb") pod "2b72cf56-1dd3-40a6-90e4-a332fbe85424" (UID: "2b72cf56-1dd3-40a6-90e4-a332fbe85424"). InnerVolumeSpecName "kube-api-access-52ngb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:08:58.053299 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:58.053258 2552 generic.go:356] "Generic (PLEG): container finished" podID="2b72cf56-1dd3-40a6-90e4-a332fbe85424" containerID="cabedd607e1b13f18ac2630c878e5de84b48c6bc9cfe1bc92ecbb503c80bbc78" exitCode=0 Sep 09 23:08:58.053473 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:58.053321 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cdc48478d-z95ns" event={"ID":"2b72cf56-1dd3-40a6-90e4-a332fbe85424","Type":"ContainerDied","Data":"cabedd607e1b13f18ac2630c878e5de84b48c6bc9cfe1bc92ecbb503c80bbc78"} Sep 09 23:08:58.053473 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:58.053352 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cdc48478d-z95ns" Sep 09 23:08:58.053473 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:58.053362 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cdc48478d-z95ns" event={"ID":"2b72cf56-1dd3-40a6-90e4-a332fbe85424","Type":"ContainerDied","Data":"02a6bedae8181a291484cbccb0f970cf69856c7dc12fc9fd29d6c059d486950d"} Sep 09 23:08:58.053473 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:58.053381 2552 scope.go:117] "RemoveContainer" containerID="cabedd607e1b13f18ac2630c878e5de84b48c6bc9cfe1bc92ecbb503c80bbc78" Sep 09 23:08:58.056200 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:58.056171 2552 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2b72cf56-1dd3-40a6-90e4-a332fbe85424-console-oauth-config\") on node \"ip-10-0-142-217.ec2.internal\" DevicePath \"\"" Sep 09 23:08:58.056200 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:58.056195 2552 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2b72cf56-1dd3-40a6-90e4-a332fbe85424-console-serving-cert\") on node \"ip-10-0-142-217.ec2.internal\" DevicePath \"\"" Sep 09 23:08:58.056333 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:58.056211 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-52ngb\" (UniqueName: \"kubernetes.io/projected/2b72cf56-1dd3-40a6-90e4-a332fbe85424-kube-api-access-52ngb\") on node \"ip-10-0-142-217.ec2.internal\" DevicePath \"\"" Sep 09 23:08:58.056333 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:58.056225 2552 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2b72cf56-1dd3-40a6-90e4-a332fbe85424-oauth-serving-cert\") on node \"ip-10-0-142-217.ec2.internal\" DevicePath \"\"" Sep 09 23:08:58.062692 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:58.062654 2552 scope.go:117] "RemoveContainer" containerID="cabedd607e1b13f18ac2630c878e5de84b48c6bc9cfe1bc92ecbb503c80bbc78" Sep 09 23:08:58.063023 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:08:58.063003 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cabedd607e1b13f18ac2630c878e5de84b48c6bc9cfe1bc92ecbb503c80bbc78\": container with ID starting with cabedd607e1b13f18ac2630c878e5de84b48c6bc9cfe1bc92ecbb503c80bbc78 not found: ID does not exist" containerID="cabedd607e1b13f18ac2630c878e5de84b48c6bc9cfe1bc92ecbb503c80bbc78" Sep 09 23:08:58.063095 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:58.063034 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cabedd607e1b13f18ac2630c878e5de84b48c6bc9cfe1bc92ecbb503c80bbc78"} err="failed to get container status \"cabedd607e1b13f18ac2630c878e5de84b48c6bc9cfe1bc92ecbb503c80bbc78\": rpc error: code = NotFound desc = could not find container \"cabedd607e1b13f18ac2630c878e5de84b48c6bc9cfe1bc92ecbb503c80bbc78\": container with ID starting with cabedd607e1b13f18ac2630c878e5de84b48c6bc9cfe1bc92ecbb503c80bbc78 not found: ID does not exist" Sep 09 23:08:58.074897 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:58.074868 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7cdc48478d-z95ns"] Sep 09 23:08:58.080864 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:58.080832 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7cdc48478d-z95ns"] Sep 09 23:08:59.937716 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:08:59.937656 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b72cf56-1dd3-40a6-90e4-a332fbe85424" path="/var/lib/kubelet/pods/2b72cf56-1dd3-40a6-90e4-a332fbe85424/volumes" Sep 09 23:09:03.075025 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:09:03.074990 2552 generic.go:356] "Generic (PLEG): container finished" podID="725fbc90-832a-494f-9852-5532a64baccc" containerID="0c0fb037edb0c5d224630e40be26a77c0d21c34095509e5c56ccf68056bc3364" exitCode=0 Sep 09 23:09:03.075460 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:09:03.075067 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-p76j4" event={"ID":"725fbc90-832a-494f-9852-5532a64baccc","Type":"ContainerDied","Data":"0c0fb037edb0c5d224630e40be26a77c0d21c34095509e5c56ccf68056bc3364"} Sep 09 23:09:03.075460 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:09:03.075441 2552 scope.go:117] "RemoveContainer" containerID="0c0fb037edb0c5d224630e40be26a77c0d21c34095509e5c56ccf68056bc3364" Sep 09 23:09:04.081450 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:09:04.081412 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-p76j4" event={"ID":"725fbc90-832a-494f-9852-5532a64baccc","Type":"ContainerStarted","Data":"02fe80e42285f90f13aef7dfb986576d90761444640c8db33b15633fef41eb07"} Sep 09 23:09:08.098821 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:09:08.098781 2552 generic.go:356] "Generic (PLEG): container finished" podID="2571894e-0cd5-4909-ad9e-240e1d667928" containerID="3002e349bcb7985c33a4c1d9f0b3a4c836642c8d0d80c430e30bbe915ce765ea" exitCode=0 Sep 09 23:09:08.099470 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:09:08.098861 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-ttc7l" event={"ID":"2571894e-0cd5-4909-ad9e-240e1d667928","Type":"ContainerDied","Data":"3002e349bcb7985c33a4c1d9f0b3a4c836642c8d0d80c430e30bbe915ce765ea"} Sep 09 23:09:08.099470 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:09:08.099228 2552 scope.go:117] "RemoveContainer" containerID="3002e349bcb7985c33a4c1d9f0b3a4c836642c8d0d80c430e30bbe915ce765ea" Sep 09 23:09:09.105488 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:09:09.105454 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-ttc7l" event={"ID":"2571894e-0cd5-4909-ad9e-240e1d667928","Type":"ContainerStarted","Data":"a9fc80f7e47490d2314add6623df1f61a33fe8143716a484309016c1b9903345"} Sep 09 23:09:53.217745 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:09:53.217701 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7894c8d785-w4f86"] Sep 09 23:09:53.218163 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:09:53.218008 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8e95541-01e9-4d65-921c-5ab7bf9593cb" containerName="registry" Sep 09 23:09:53.218163 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:09:53.218021 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8e95541-01e9-4d65-921c-5ab7bf9593cb" containerName="registry" Sep 09 23:09:53.218163 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:09:53.218041 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b72cf56-1dd3-40a6-90e4-a332fbe85424" containerName="console" Sep 09 23:09:53.218163 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:09:53.218046 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b72cf56-1dd3-40a6-90e4-a332fbe85424" containerName="console" Sep 09 23:09:53.218163 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:09:53.218097 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8e95541-01e9-4d65-921c-5ab7bf9593cb" containerName="registry" Sep 09 23:09:53.218163 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:09:53.218106 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b72cf56-1dd3-40a6-90e4-a332fbe85424" containerName="console" Sep 09 23:09:53.220779 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:09:53.220749 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7894c8d785-w4f86" Sep 09 23:09:53.231499 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:09:53.231470 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7894c8d785-w4f86"] Sep 09 23:09:53.309615 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:09:53.309573 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e0d9decd-18ca-4147-9cfb-ffba5adbda3e-console-oauth-config\") pod \"console-7894c8d785-w4f86\" (UID: \"e0d9decd-18ca-4147-9cfb-ffba5adbda3e\") " pod="openshift-console/console-7894c8d785-w4f86" Sep 09 23:09:53.309615 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:09:53.309622 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e0d9decd-18ca-4147-9cfb-ffba5adbda3e-service-ca\") pod \"console-7894c8d785-w4f86\" (UID: \"e0d9decd-18ca-4147-9cfb-ffba5adbda3e\") " pod="openshift-console/console-7894c8d785-w4f86" Sep 09 23:09:53.309868 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:09:53.309737 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e0d9decd-18ca-4147-9cfb-ffba5adbda3e-console-config\") pod \"console-7894c8d785-w4f86\" (UID: \"e0d9decd-18ca-4147-9cfb-ffba5adbda3e\") " pod="openshift-console/console-7894c8d785-w4f86" Sep 09 23:09:53.309868 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:09:53.309758 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e0d9decd-18ca-4147-9cfb-ffba5adbda3e-oauth-serving-cert\") pod \"console-7894c8d785-w4f86\" (UID: \"e0d9decd-18ca-4147-9cfb-ffba5adbda3e\") " pod="openshift-console/console-7894c8d785-w4f86" Sep 09 23:09:53.309868 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:09:53.309778 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e0d9decd-18ca-4147-9cfb-ffba5adbda3e-console-serving-cert\") pod \"console-7894c8d785-w4f86\" (UID: \"e0d9decd-18ca-4147-9cfb-ffba5adbda3e\") " pod="openshift-console/console-7894c8d785-w4f86" Sep 09 23:09:53.309868 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:09:53.309810 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0d9decd-18ca-4147-9cfb-ffba5adbda3e-trusted-ca-bundle\") pod \"console-7894c8d785-w4f86\" (UID: \"e0d9decd-18ca-4147-9cfb-ffba5adbda3e\") " pod="openshift-console/console-7894c8d785-w4f86" Sep 09 23:09:53.309868 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:09:53.309847 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m77z7\" (UniqueName: \"kubernetes.io/projected/e0d9decd-18ca-4147-9cfb-ffba5adbda3e-kube-api-access-m77z7\") pod \"console-7894c8d785-w4f86\" (UID: \"e0d9decd-18ca-4147-9cfb-ffba5adbda3e\") " pod="openshift-console/console-7894c8d785-w4f86" Sep 09 23:09:53.411268 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:09:53.411229 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e0d9decd-18ca-4147-9cfb-ffba5adbda3e-service-ca\") pod \"console-7894c8d785-w4f86\" (UID: \"e0d9decd-18ca-4147-9cfb-ffba5adbda3e\") " pod="openshift-console/console-7894c8d785-w4f86" Sep 09 23:09:53.411454 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:09:53.411279 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e0d9decd-18ca-4147-9cfb-ffba5adbda3e-console-config\") pod \"console-7894c8d785-w4f86\" (UID: \"e0d9decd-18ca-4147-9cfb-ffba5adbda3e\") " pod="openshift-console/console-7894c8d785-w4f86" Sep 09 23:09:53.411454 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:09:53.411389 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e0d9decd-18ca-4147-9cfb-ffba5adbda3e-oauth-serving-cert\") pod \"console-7894c8d785-w4f86\" (UID: \"e0d9decd-18ca-4147-9cfb-ffba5adbda3e\") " pod="openshift-console/console-7894c8d785-w4f86" Sep 09 23:09:53.411454 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:09:53.411432 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e0d9decd-18ca-4147-9cfb-ffba5adbda3e-console-serving-cert\") pod \"console-7894c8d785-w4f86\" (UID: \"e0d9decd-18ca-4147-9cfb-ffba5adbda3e\") " pod="openshift-console/console-7894c8d785-w4f86" Sep 09 23:09:53.411454 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:09:53.411448 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0d9decd-18ca-4147-9cfb-ffba5adbda3e-trusted-ca-bundle\") pod \"console-7894c8d785-w4f86\" (UID: \"e0d9decd-18ca-4147-9cfb-ffba5adbda3e\") " pod="openshift-console/console-7894c8d785-w4f86" Sep 09 23:09:53.411723 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:09:53.411581 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m77z7\" (UniqueName: \"kubernetes.io/projected/e0d9decd-18ca-4147-9cfb-ffba5adbda3e-kube-api-access-m77z7\") pod \"console-7894c8d785-w4f86\" (UID: \"e0d9decd-18ca-4147-9cfb-ffba5adbda3e\") " pod="openshift-console/console-7894c8d785-w4f86" Sep 09 23:09:53.411723 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:09:53.411715 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e0d9decd-18ca-4147-9cfb-ffba5adbda3e-console-oauth-config\") pod \"console-7894c8d785-w4f86\" (UID: \"e0d9decd-18ca-4147-9cfb-ffba5adbda3e\") " pod="openshift-console/console-7894c8d785-w4f86" Sep 09 23:09:53.412396 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:09:53.412366 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e0d9decd-18ca-4147-9cfb-ffba5adbda3e-oauth-serving-cert\") pod \"console-7894c8d785-w4f86\" (UID: \"e0d9decd-18ca-4147-9cfb-ffba5adbda3e\") " pod="openshift-console/console-7894c8d785-w4f86" Sep 09 23:09:53.412575 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:09:53.412456 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e0d9decd-18ca-4147-9cfb-ffba5adbda3e-service-ca\") pod \"console-7894c8d785-w4f86\" (UID: \"e0d9decd-18ca-4147-9cfb-ffba5adbda3e\") " pod="openshift-console/console-7894c8d785-w4f86" Sep 09 23:09:53.412704 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:09:53.412559 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e0d9decd-18ca-4147-9cfb-ffba5adbda3e-console-config\") pod \"console-7894c8d785-w4f86\" (UID: \"e0d9decd-18ca-4147-9cfb-ffba5adbda3e\") " pod="openshift-console/console-7894c8d785-w4f86" Sep 09 23:09:53.412830 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:09:53.412716 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0d9decd-18ca-4147-9cfb-ffba5adbda3e-trusted-ca-bundle\") pod \"console-7894c8d785-w4f86\" (UID: \"e0d9decd-18ca-4147-9cfb-ffba5adbda3e\") " pod="openshift-console/console-7894c8d785-w4f86" Sep 09 23:09:53.419025 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:09:53.418992 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e0d9decd-18ca-4147-9cfb-ffba5adbda3e-console-serving-cert\") pod \"console-7894c8d785-w4f86\" (UID: \"e0d9decd-18ca-4147-9cfb-ffba5adbda3e\") " pod="openshift-console/console-7894c8d785-w4f86" Sep 09 23:09:53.419155 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:09:53.419069 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e0d9decd-18ca-4147-9cfb-ffba5adbda3e-console-oauth-config\") pod \"console-7894c8d785-w4f86\" (UID: \"e0d9decd-18ca-4147-9cfb-ffba5adbda3e\") " pod="openshift-console/console-7894c8d785-w4f86" Sep 09 23:09:53.421012 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:09:53.420985 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m77z7\" (UniqueName: \"kubernetes.io/projected/e0d9decd-18ca-4147-9cfb-ffba5adbda3e-kube-api-access-m77z7\") pod \"console-7894c8d785-w4f86\" (UID: \"e0d9decd-18ca-4147-9cfb-ffba5adbda3e\") " pod="openshift-console/console-7894c8d785-w4f86" Sep 09 23:09:53.532003 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:09:53.531903 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7894c8d785-w4f86" Sep 09 23:09:53.811079 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:09:53.810990 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7894c8d785-w4f86"] Sep 09 23:09:53.814182 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:09:53.814143 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0d9decd_18ca_4147_9cfb_ffba5adbda3e.slice/crio-7d46ebb80a1cdb0423cad71f4e8c521cbbd3b56ec2da16dc9bea5c14f3efa1bf WatchSource:0}: Error finding container 7d46ebb80a1cdb0423cad71f4e8c521cbbd3b56ec2da16dc9bea5c14f3efa1bf: Status 404 returned error can't find the container with id 7d46ebb80a1cdb0423cad71f4e8c521cbbd3b56ec2da16dc9bea5c14f3efa1bf Sep 09 23:09:54.293594 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:09:54.293557 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7894c8d785-w4f86" event={"ID":"e0d9decd-18ca-4147-9cfb-ffba5adbda3e","Type":"ContainerStarted","Data":"c31bc7155a9789bfbb21d092d10c472d921415e3a0e4086b88e4cc08ef5ce9dc"} Sep 09 23:09:54.294028 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:09:54.293612 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7894c8d785-w4f86" event={"ID":"e0d9decd-18ca-4147-9cfb-ffba5adbda3e","Type":"ContainerStarted","Data":"7d46ebb80a1cdb0423cad71f4e8c521cbbd3b56ec2da16dc9bea5c14f3efa1bf"} Sep 09 23:09:54.311197 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:09:54.311134 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7894c8d785-w4f86" podStartSLOduration=1.3111179769999999 podStartE2EDuration="1.311117977s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:09:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:09:54.309154276 +0000 UTC m=+364.824885107" watchObservedRunningTime="2026-09-09 23:09:54.311117977 +0000 UTC m=+364.826848806" Sep 09 23:10:03.532990 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:10:03.532949 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7894c8d785-w4f86" Sep 09 23:10:03.533511 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:10:03.533025 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7894c8d785-w4f86" Sep 09 23:10:03.537702 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:10:03.537664 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7894c8d785-w4f86" Sep 09 23:10:04.335313 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:10:04.335282 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7894c8d785-w4f86" Sep 09 23:10:04.375370 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:10:04.375334 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5444c9fb4c-hh6tq"] Sep 09 23:10:29.399255 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:10:29.399214 2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5444c9fb4c-hh6tq" podUID="12815e46-6cce-4ec1-9232-c4d3e9a38680" containerName="console" containerID="cri-o://2423122a8da07d274b0b1383c6ef8c5c4986ad8909ee624115b9a499aafa5ef6" gracePeriod=15 Sep 09 23:10:29.642043 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:10:29.642018 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5444c9fb4c-hh6tq" Sep 09 23:10:29.710423 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:10:29.710323 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/12815e46-6cce-4ec1-9232-c4d3e9a38680-console-config\") pod \"12815e46-6cce-4ec1-9232-c4d3e9a38680\" (UID: \"12815e46-6cce-4ec1-9232-c4d3e9a38680\") " Sep 09 23:10:29.710423 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:10:29.710382 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/12815e46-6cce-4ec1-9232-c4d3e9a38680-service-ca\") pod \"12815e46-6cce-4ec1-9232-c4d3e9a38680\" (UID: \"12815e46-6cce-4ec1-9232-c4d3e9a38680\") " Sep 09 23:10:29.710423 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:10:29.710401 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/12815e46-6cce-4ec1-9232-c4d3e9a38680-trusted-ca-bundle\") pod \"12815e46-6cce-4ec1-9232-c4d3e9a38680\" (UID: \"12815e46-6cce-4ec1-9232-c4d3e9a38680\") " Sep 09 23:10:29.710423 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:10:29.710421 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w22ks\" (UniqueName: \"kubernetes.io/projected/12815e46-6cce-4ec1-9232-c4d3e9a38680-kube-api-access-w22ks\") pod \"12815e46-6cce-4ec1-9232-c4d3e9a38680\" (UID: \"12815e46-6cce-4ec1-9232-c4d3e9a38680\") " Sep 09 23:10:29.710778 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:10:29.710549 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/12815e46-6cce-4ec1-9232-c4d3e9a38680-console-oauth-config\") pod \"12815e46-6cce-4ec1-9232-c4d3e9a38680\" (UID: \"12815e46-6cce-4ec1-9232-c4d3e9a38680\") " Sep 09 23:10:29.710778 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:10:29.710635 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/12815e46-6cce-4ec1-9232-c4d3e9a38680-oauth-serving-cert\") pod \"12815e46-6cce-4ec1-9232-c4d3e9a38680\" (UID: \"12815e46-6cce-4ec1-9232-c4d3e9a38680\") " Sep 09 23:10:29.710778 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:10:29.710722 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/12815e46-6cce-4ec1-9232-c4d3e9a38680-console-serving-cert\") pod \"12815e46-6cce-4ec1-9232-c4d3e9a38680\" (UID: \"12815e46-6cce-4ec1-9232-c4d3e9a38680\") " Sep 09 23:10:29.710935 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:10:29.710785 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12815e46-6cce-4ec1-9232-c4d3e9a38680-console-config" (OuterVolumeSpecName: "console-config") pod "12815e46-6cce-4ec1-9232-c4d3e9a38680" (UID: "12815e46-6cce-4ec1-9232-c4d3e9a38680"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:10:29.710935 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:10:29.710839 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12815e46-6cce-4ec1-9232-c4d3e9a38680-service-ca" (OuterVolumeSpecName: "service-ca") pod "12815e46-6cce-4ec1-9232-c4d3e9a38680" (UID: "12815e46-6cce-4ec1-9232-c4d3e9a38680"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:10:29.711030 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:10:29.710971 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12815e46-6cce-4ec1-9232-c4d3e9a38680-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "12815e46-6cce-4ec1-9232-c4d3e9a38680" (UID: "12815e46-6cce-4ec1-9232-c4d3e9a38680"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:10:29.711030 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:10:29.710984 2552 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/12815e46-6cce-4ec1-9232-c4d3e9a38680-console-config\") on node \"ip-10-0-142-217.ec2.internal\" DevicePath \"\"" Sep 09 23:10:29.711030 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:10:29.710992 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12815e46-6cce-4ec1-9232-c4d3e9a38680-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "12815e46-6cce-4ec1-9232-c4d3e9a38680" (UID: "12815e46-6cce-4ec1-9232-c4d3e9a38680"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:10:29.711030 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:10:29.711005 2552 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/12815e46-6cce-4ec1-9232-c4d3e9a38680-service-ca\") on node \"ip-10-0-142-217.ec2.internal\" DevicePath \"\"" Sep 09 23:10:29.712681 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:10:29.712646 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12815e46-6cce-4ec1-9232-c4d3e9a38680-kube-api-access-w22ks" (OuterVolumeSpecName: "kube-api-access-w22ks") pod "12815e46-6cce-4ec1-9232-c4d3e9a38680" (UID: "12815e46-6cce-4ec1-9232-c4d3e9a38680"). InnerVolumeSpecName "kube-api-access-w22ks". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:10:29.712761 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:10:29.712717 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12815e46-6cce-4ec1-9232-c4d3e9a38680-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "12815e46-6cce-4ec1-9232-c4d3e9a38680" (UID: "12815e46-6cce-4ec1-9232-c4d3e9a38680"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:10:29.712815 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:10:29.712797 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12815e46-6cce-4ec1-9232-c4d3e9a38680-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "12815e46-6cce-4ec1-9232-c4d3e9a38680" (UID: "12815e46-6cce-4ec1-9232-c4d3e9a38680"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:10:29.812077 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:10:29.812020 2552 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/12815e46-6cce-4ec1-9232-c4d3e9a38680-console-serving-cert\") on node \"ip-10-0-142-217.ec2.internal\" DevicePath \"\"" Sep 09 23:10:29.812077 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:10:29.812070 2552 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/12815e46-6cce-4ec1-9232-c4d3e9a38680-trusted-ca-bundle\") on node \"ip-10-0-142-217.ec2.internal\" DevicePath \"\"" Sep 09 23:10:29.812077 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:10:29.812079 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w22ks\" (UniqueName: \"kubernetes.io/projected/12815e46-6cce-4ec1-9232-c4d3e9a38680-kube-api-access-w22ks\") on node \"ip-10-0-142-217.ec2.internal\" DevicePath \"\"" Sep 09 23:10:29.812077 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:10:29.812088 2552 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/12815e46-6cce-4ec1-9232-c4d3e9a38680-console-oauth-config\") on node \"ip-10-0-142-217.ec2.internal\" DevicePath \"\"" Sep 09 23:10:29.812077 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:10:29.812097 2552 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/12815e46-6cce-4ec1-9232-c4d3e9a38680-oauth-serving-cert\") on node \"ip-10-0-142-217.ec2.internal\" DevicePath \"\"" Sep 09 23:10:30.438722 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:10:30.438663 2552 generic.go:356] "Generic (PLEG): container finished" podID="12815e46-6cce-4ec1-9232-c4d3e9a38680" containerID="2423122a8da07d274b0b1383c6ef8c5c4986ad8909ee624115b9a499aafa5ef6" exitCode=0 Sep 09 23:10:30.438722 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:10:30.438699 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5444c9fb4c-hh6tq" event={"ID":"12815e46-6cce-4ec1-9232-c4d3e9a38680","Type":"ContainerDied","Data":"2423122a8da07d274b0b1383c6ef8c5c4986ad8909ee624115b9a499aafa5ef6"} Sep 09 23:10:30.438722 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:10:30.438720 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5444c9fb4c-hh6tq" Sep 09 23:10:30.439214 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:10:30.438761 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5444c9fb4c-hh6tq" event={"ID":"12815e46-6cce-4ec1-9232-c4d3e9a38680","Type":"ContainerDied","Data":"dae07947f6c2216484c92390d62e6720313ce9bacef9ea191e4460bd19a47196"} Sep 09 23:10:30.439214 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:10:30.438788 2552 scope.go:117] "RemoveContainer" containerID="2423122a8da07d274b0b1383c6ef8c5c4986ad8909ee624115b9a499aafa5ef6" Sep 09 23:10:30.447462 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:10:30.447440 2552 scope.go:117] "RemoveContainer" containerID="2423122a8da07d274b0b1383c6ef8c5c4986ad8909ee624115b9a499aafa5ef6" Sep 09 23:10:30.447827 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:10:30.447807 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2423122a8da07d274b0b1383c6ef8c5c4986ad8909ee624115b9a499aafa5ef6\": container with ID starting with 2423122a8da07d274b0b1383c6ef8c5c4986ad8909ee624115b9a499aafa5ef6 not found: ID does not exist" containerID="2423122a8da07d274b0b1383c6ef8c5c4986ad8909ee624115b9a499aafa5ef6" Sep 09 23:10:30.447877 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:10:30.447836 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2423122a8da07d274b0b1383c6ef8c5c4986ad8909ee624115b9a499aafa5ef6"} err="failed to get container status \"2423122a8da07d274b0b1383c6ef8c5c4986ad8909ee624115b9a499aafa5ef6\": rpc error: code = NotFound desc = could not find container \"2423122a8da07d274b0b1383c6ef8c5c4986ad8909ee624115b9a499aafa5ef6\": container with ID starting with 2423122a8da07d274b0b1383c6ef8c5c4986ad8909ee624115b9a499aafa5ef6 not found: ID does not exist" Sep 09 23:10:30.453639 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:10:30.453610 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5444c9fb4c-hh6tq"] Sep 09 23:10:30.456971 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:10:30.456946 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5444c9fb4c-hh6tq"] Sep 09 23:10:31.937883 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:10:31.937845 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12815e46-6cce-4ec1-9232-c4d3e9a38680" path="/var/lib/kubelet/pods/12815e46-6cce-4ec1-9232-c4d3e9a38680/volumes" Sep 09 23:11:08.534386 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:11:08.534347 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-75b5d6d49b-fj7x2"] Sep 09 23:11:08.534969 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:11:08.534894 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12815e46-6cce-4ec1-9232-c4d3e9a38680" containerName="console" Sep 09 23:11:08.534969 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:11:08.534916 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="12815e46-6cce-4ec1-9232-c4d3e9a38680" containerName="console" Sep 09 23:11:08.535084 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:11:08.534991 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="12815e46-6cce-4ec1-9232-c4d3e9a38680" containerName="console" Sep 09 23:11:08.538067 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:11:08.538039 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75b5d6d49b-fj7x2" Sep 09 23:11:08.561345 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:11:08.561311 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75b5d6d49b-fj7x2"] Sep 09 23:11:08.616306 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:11:08.616265 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5510cba3-f65e-41ea-a8e7-569989903c88-console-oauth-config\") pod \"console-75b5d6d49b-fj7x2\" (UID: \"5510cba3-f65e-41ea-a8e7-569989903c88\") " pod="openshift-console/console-75b5d6d49b-fj7x2" Sep 09 23:11:08.616306 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:11:08.616306 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5510cba3-f65e-41ea-a8e7-569989903c88-trusted-ca-bundle\") pod \"console-75b5d6d49b-fj7x2\" (UID: \"5510cba3-f65e-41ea-a8e7-569989903c88\") " pod="openshift-console/console-75b5d6d49b-fj7x2" Sep 09 23:11:08.616605 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:11:08.616333 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5510cba3-f65e-41ea-a8e7-569989903c88-service-ca\") pod \"console-75b5d6d49b-fj7x2\" (UID: \"5510cba3-f65e-41ea-a8e7-569989903c88\") " pod="openshift-console/console-75b5d6d49b-fj7x2" Sep 09 23:11:08.616605 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:11:08.616383 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5510cba3-f65e-41ea-a8e7-569989903c88-oauth-serving-cert\") pod \"console-75b5d6d49b-fj7x2\" (UID: \"5510cba3-f65e-41ea-a8e7-569989903c88\") " pod="openshift-console/console-75b5d6d49b-fj7x2" Sep 09 23:11:08.616605 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:11:08.616443 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5510cba3-f65e-41ea-a8e7-569989903c88-console-serving-cert\") pod \"console-75b5d6d49b-fj7x2\" (UID: \"5510cba3-f65e-41ea-a8e7-569989903c88\") " pod="openshift-console/console-75b5d6d49b-fj7x2" Sep 09 23:11:08.616605 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:11:08.616461 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqjw8\" (UniqueName: \"kubernetes.io/projected/5510cba3-f65e-41ea-a8e7-569989903c88-kube-api-access-nqjw8\") pod \"console-75b5d6d49b-fj7x2\" (UID: \"5510cba3-f65e-41ea-a8e7-569989903c88\") " pod="openshift-console/console-75b5d6d49b-fj7x2" Sep 09 23:11:08.616605 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:11:08.616483 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5510cba3-f65e-41ea-a8e7-569989903c88-console-config\") pod \"console-75b5d6d49b-fj7x2\" (UID: \"5510cba3-f65e-41ea-a8e7-569989903c88\") " pod="openshift-console/console-75b5d6d49b-fj7x2" Sep 09 23:11:08.717554 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:11:08.717512 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5510cba3-f65e-41ea-a8e7-569989903c88-console-oauth-config\") pod \"console-75b5d6d49b-fj7x2\" (UID: \"5510cba3-f65e-41ea-a8e7-569989903c88\") " pod="openshift-console/console-75b5d6d49b-fj7x2" Sep 09 23:11:08.717554 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:11:08.717557 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5510cba3-f65e-41ea-a8e7-569989903c88-trusted-ca-bundle\") pod \"console-75b5d6d49b-fj7x2\" (UID: \"5510cba3-f65e-41ea-a8e7-569989903c88\") " pod="openshift-console/console-75b5d6d49b-fj7x2" Sep 09 23:11:08.717867 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:11:08.717593 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5510cba3-f65e-41ea-a8e7-569989903c88-service-ca\") pod \"console-75b5d6d49b-fj7x2\" (UID: \"5510cba3-f65e-41ea-a8e7-569989903c88\") " pod="openshift-console/console-75b5d6d49b-fj7x2" Sep 09 23:11:08.717867 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:11:08.717614 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5510cba3-f65e-41ea-a8e7-569989903c88-oauth-serving-cert\") pod \"console-75b5d6d49b-fj7x2\" (UID: \"5510cba3-f65e-41ea-a8e7-569989903c88\") " pod="openshift-console/console-75b5d6d49b-fj7x2" Sep 09 23:11:08.717867 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:11:08.717645 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5510cba3-f65e-41ea-a8e7-569989903c88-console-serving-cert\") pod \"console-75b5d6d49b-fj7x2\" (UID: \"5510cba3-f65e-41ea-a8e7-569989903c88\") " pod="openshift-console/console-75b5d6d49b-fj7x2" Sep 09 23:11:08.717867 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:11:08.717667 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqjw8\" (UniqueName: \"kubernetes.io/projected/5510cba3-f65e-41ea-a8e7-569989903c88-kube-api-access-nqjw8\") pod \"console-75b5d6d49b-fj7x2\" (UID: \"5510cba3-f65e-41ea-a8e7-569989903c88\") " pod="openshift-console/console-75b5d6d49b-fj7x2" Sep 09 23:11:08.717867 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:11:08.717738 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5510cba3-f65e-41ea-a8e7-569989903c88-console-config\") pod \"console-75b5d6d49b-fj7x2\" (UID: \"5510cba3-f65e-41ea-a8e7-569989903c88\") " pod="openshift-console/console-75b5d6d49b-fj7x2" Sep 09 23:11:08.718495 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:11:08.718440 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5510cba3-f65e-41ea-a8e7-569989903c88-oauth-serving-cert\") pod \"console-75b5d6d49b-fj7x2\" (UID: \"5510cba3-f65e-41ea-a8e7-569989903c88\") " pod="openshift-console/console-75b5d6d49b-fj7x2" Sep 09 23:11:08.718604 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:11:08.718562 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5510cba3-f65e-41ea-a8e7-569989903c88-console-config\") pod \"console-75b5d6d49b-fj7x2\" (UID: \"5510cba3-f65e-41ea-a8e7-569989903c88\") " pod="openshift-console/console-75b5d6d49b-fj7x2" Sep 09 23:11:08.718604 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:11:08.718588 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5510cba3-f65e-41ea-a8e7-569989903c88-service-ca\") pod \"console-75b5d6d49b-fj7x2\" (UID: \"5510cba3-f65e-41ea-a8e7-569989903c88\") " pod="openshift-console/console-75b5d6d49b-fj7x2" Sep 09 23:11:08.718713 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:11:08.718695 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5510cba3-f65e-41ea-a8e7-569989903c88-trusted-ca-bundle\") pod \"console-75b5d6d49b-fj7x2\" (UID: \"5510cba3-f65e-41ea-a8e7-569989903c88\") " pod="openshift-console/console-75b5d6d49b-fj7x2" Sep 09 23:11:08.720322 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:11:08.720293 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5510cba3-f65e-41ea-a8e7-569989903c88-console-serving-cert\") pod \"console-75b5d6d49b-fj7x2\" (UID: \"5510cba3-f65e-41ea-a8e7-569989903c88\") " pod="openshift-console/console-75b5d6d49b-fj7x2" Sep 09 23:11:08.720407 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:11:08.720385 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5510cba3-f65e-41ea-a8e7-569989903c88-console-oauth-config\") pod \"console-75b5d6d49b-fj7x2\" (UID: \"5510cba3-f65e-41ea-a8e7-569989903c88\") " pod="openshift-console/console-75b5d6d49b-fj7x2" Sep 09 23:11:08.725207 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:11:08.725185 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqjw8\" (UniqueName: \"kubernetes.io/projected/5510cba3-f65e-41ea-a8e7-569989903c88-kube-api-access-nqjw8\") pod \"console-75b5d6d49b-fj7x2\" (UID: \"5510cba3-f65e-41ea-a8e7-569989903c88\") " pod="openshift-console/console-75b5d6d49b-fj7x2" Sep 09 23:11:08.849095 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:11:08.849004 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75b5d6d49b-fj7x2" Sep 09 23:11:09.118867 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:11:09.118737 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75b5d6d49b-fj7x2"] Sep 09 23:11:09.121763 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:11:09.121728 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5510cba3_f65e_41ea_a8e7_569989903c88.slice/crio-36ce827d3098f1c3f4b1bcb0948a7c7b3289835fdee68be59d24883e4ee74351 WatchSource:0}: Error finding container 36ce827d3098f1c3f4b1bcb0948a7c7b3289835fdee68be59d24883e4ee74351: Status 404 returned error can't find the container with id 36ce827d3098f1c3f4b1bcb0948a7c7b3289835fdee68be59d24883e4ee74351 Sep 09 23:11:09.597659 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:11:09.597618 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75b5d6d49b-fj7x2" event={"ID":"5510cba3-f65e-41ea-a8e7-569989903c88","Type":"ContainerStarted","Data":"eaa37fd30044cd3d6fff259d2367e5db18f68fa5570120dd55d15507cb67ce44"} Sep 09 23:11:09.598117 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:11:09.597696 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75b5d6d49b-fj7x2" event={"ID":"5510cba3-f65e-41ea-a8e7-569989903c88","Type":"ContainerStarted","Data":"36ce827d3098f1c3f4b1bcb0948a7c7b3289835fdee68be59d24883e4ee74351"} Sep 09 23:11:09.612945 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:11:09.612888 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-75b5d6d49b-fj7x2" podStartSLOduration=1.612870924 podStartE2EDuration="1.612870924s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:11:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:11:09.611427516 +0000 UTC m=+440.127158346" watchObservedRunningTime="2026-09-09 23:11:09.612870924 +0000 UTC m=+440.128601758" Sep 09 23:11:18.849762 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:11:18.849655 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-75b5d6d49b-fj7x2" Sep 09 23:11:18.849762 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:11:18.849744 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-75b5d6d49b-fj7x2" Sep 09 23:11:18.854870 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:11:18.854840 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-75b5d6d49b-fj7x2" Sep 09 23:11:19.642392 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:11:19.642360 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-75b5d6d49b-fj7x2" Sep 09 23:11:19.681057 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:11:19.681023 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7894c8d785-w4f86"] Sep 09 23:11:44.701974 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:11:44.701926 2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7894c8d785-w4f86" podUID="e0d9decd-18ca-4147-9cfb-ffba5adbda3e" containerName="console" containerID="cri-o://c31bc7155a9789bfbb21d092d10c472d921415e3a0e4086b88e4cc08ef5ce9dc" gracePeriod=15 Sep 09 23:11:44.947943 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:11:44.947915 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7894c8d785-w4f86" Sep 09 23:11:45.122442 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:11:45.122410 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0d9decd-18ca-4147-9cfb-ffba5adbda3e-trusted-ca-bundle\") pod \"e0d9decd-18ca-4147-9cfb-ffba5adbda3e\" (UID: \"e0d9decd-18ca-4147-9cfb-ffba5adbda3e\") " Sep 09 23:11:45.122594 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:11:45.122477 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m77z7\" (UniqueName: \"kubernetes.io/projected/e0d9decd-18ca-4147-9cfb-ffba5adbda3e-kube-api-access-m77z7\") pod \"e0d9decd-18ca-4147-9cfb-ffba5adbda3e\" (UID: \"e0d9decd-18ca-4147-9cfb-ffba5adbda3e\") " Sep 09 23:11:45.122594 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:11:45.122497 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e0d9decd-18ca-4147-9cfb-ffba5adbda3e-console-config\") pod \"e0d9decd-18ca-4147-9cfb-ffba5adbda3e\" (UID: \"e0d9decd-18ca-4147-9cfb-ffba5adbda3e\") " Sep 09 23:11:45.122594 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:11:45.122518 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e0d9decd-18ca-4147-9cfb-ffba5adbda3e-service-ca\") pod \"e0d9decd-18ca-4147-9cfb-ffba5adbda3e\" (UID: \"e0d9decd-18ca-4147-9cfb-ffba5adbda3e\") " Sep 09 23:11:45.122594 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:11:45.122537 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e0d9decd-18ca-4147-9cfb-ffba5adbda3e-console-oauth-config\") pod \"e0d9decd-18ca-4147-9cfb-ffba5adbda3e\" (UID: \"e0d9decd-18ca-4147-9cfb-ffba5adbda3e\") " Sep 09 23:11:45.122594 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:11:45.122564 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e0d9decd-18ca-4147-9cfb-ffba5adbda3e-console-serving-cert\") pod \"e0d9decd-18ca-4147-9cfb-ffba5adbda3e\" (UID: \"e0d9decd-18ca-4147-9cfb-ffba5adbda3e\") " Sep 09 23:11:45.122594 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:11:45.122592 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e0d9decd-18ca-4147-9cfb-ffba5adbda3e-oauth-serving-cert\") pod \"e0d9decd-18ca-4147-9cfb-ffba5adbda3e\" (UID: \"e0d9decd-18ca-4147-9cfb-ffba5adbda3e\") " Sep 09 23:11:45.122943 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:11:45.122909 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0d9decd-18ca-4147-9cfb-ffba5adbda3e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e0d9decd-18ca-4147-9cfb-ffba5adbda3e" (UID: "e0d9decd-18ca-4147-9cfb-ffba5adbda3e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:11:45.123035 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:11:45.122999 2552 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0d9decd-18ca-4147-9cfb-ffba5adbda3e-trusted-ca-bundle\") on node \"ip-10-0-142-217.ec2.internal\" DevicePath \"\"" Sep 09 23:11:45.123093 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:11:45.123023 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0d9decd-18ca-4147-9cfb-ffba5adbda3e-service-ca" (OuterVolumeSpecName: "service-ca") pod "e0d9decd-18ca-4147-9cfb-ffba5adbda3e" (UID: "e0d9decd-18ca-4147-9cfb-ffba5adbda3e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:11:45.123093 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:11:45.123029 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0d9decd-18ca-4147-9cfb-ffba5adbda3e-console-config" (OuterVolumeSpecName: "console-config") pod "e0d9decd-18ca-4147-9cfb-ffba5adbda3e" (UID: "e0d9decd-18ca-4147-9cfb-ffba5adbda3e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:11:45.123204 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:11:45.123158 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0d9decd-18ca-4147-9cfb-ffba5adbda3e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e0d9decd-18ca-4147-9cfb-ffba5adbda3e" (UID: "e0d9decd-18ca-4147-9cfb-ffba5adbda3e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:11:45.124817 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:11:45.124790 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0d9decd-18ca-4147-9cfb-ffba5adbda3e-kube-api-access-m77z7" (OuterVolumeSpecName: "kube-api-access-m77z7") pod "e0d9decd-18ca-4147-9cfb-ffba5adbda3e" (UID: "e0d9decd-18ca-4147-9cfb-ffba5adbda3e"). InnerVolumeSpecName "kube-api-access-m77z7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:11:45.124923 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:11:45.124834 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0d9decd-18ca-4147-9cfb-ffba5adbda3e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e0d9decd-18ca-4147-9cfb-ffba5adbda3e" (UID: "e0d9decd-18ca-4147-9cfb-ffba5adbda3e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:11:45.130503 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:11:45.124870 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0d9decd-18ca-4147-9cfb-ffba5adbda3e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e0d9decd-18ca-4147-9cfb-ffba5adbda3e" (UID: "e0d9decd-18ca-4147-9cfb-ffba5adbda3e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:11:45.223792 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:11:45.223743 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m77z7\" (UniqueName: \"kubernetes.io/projected/e0d9decd-18ca-4147-9cfb-ffba5adbda3e-kube-api-access-m77z7\") on node \"ip-10-0-142-217.ec2.internal\" DevicePath \"\"" Sep 09 23:11:45.223792 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:11:45.223784 2552 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e0d9decd-18ca-4147-9cfb-ffba5adbda3e-console-config\") on node \"ip-10-0-142-217.ec2.internal\" DevicePath \"\"" Sep 09 23:11:45.223792 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:11:45.223796 2552 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e0d9decd-18ca-4147-9cfb-ffba5adbda3e-service-ca\") on node \"ip-10-0-142-217.ec2.internal\" DevicePath \"\"" Sep 09 23:11:45.223792 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:11:45.223803 2552 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e0d9decd-18ca-4147-9cfb-ffba5adbda3e-console-oauth-config\") on node \"ip-10-0-142-217.ec2.internal\" DevicePath \"\"" Sep 09 23:11:45.224054 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:11:45.223813 2552 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e0d9decd-18ca-4147-9cfb-ffba5adbda3e-console-serving-cert\") on node \"ip-10-0-142-217.ec2.internal\" DevicePath \"\"" Sep 09 23:11:45.224054 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:11:45.223823 2552 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e0d9decd-18ca-4147-9cfb-ffba5adbda3e-oauth-serving-cert\") on node \"ip-10-0-142-217.ec2.internal\" DevicePath \"\"" Sep 09 23:11:45.745290 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:11:45.745252 2552 generic.go:356] "Generic (PLEG): container finished" podID="e0d9decd-18ca-4147-9cfb-ffba5adbda3e" containerID="c31bc7155a9789bfbb21d092d10c472d921415e3a0e4086b88e4cc08ef5ce9dc" exitCode=0 Sep 09 23:11:45.745791 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:11:45.745297 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7894c8d785-w4f86" event={"ID":"e0d9decd-18ca-4147-9cfb-ffba5adbda3e","Type":"ContainerDied","Data":"c31bc7155a9789bfbb21d092d10c472d921415e3a0e4086b88e4cc08ef5ce9dc"} Sep 09 23:11:45.745791 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:11:45.745311 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7894c8d785-w4f86" Sep 09 23:11:45.745791 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:11:45.745364 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7894c8d785-w4f86" event={"ID":"e0d9decd-18ca-4147-9cfb-ffba5adbda3e","Type":"ContainerDied","Data":"7d46ebb80a1cdb0423cad71f4e8c521cbbd3b56ec2da16dc9bea5c14f3efa1bf"} Sep 09 23:11:45.745791 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:11:45.745384 2552 scope.go:117] "RemoveContainer" containerID="c31bc7155a9789bfbb21d092d10c472d921415e3a0e4086b88e4cc08ef5ce9dc" Sep 09 23:11:45.755260 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:11:45.755235 2552 scope.go:117] "RemoveContainer" containerID="c31bc7155a9789bfbb21d092d10c472d921415e3a0e4086b88e4cc08ef5ce9dc" Sep 09 23:11:45.755591 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:11:45.755572 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c31bc7155a9789bfbb21d092d10c472d921415e3a0e4086b88e4cc08ef5ce9dc\": container with ID starting with c31bc7155a9789bfbb21d092d10c472d921415e3a0e4086b88e4cc08ef5ce9dc not found: ID does not exist" containerID="c31bc7155a9789bfbb21d092d10c472d921415e3a0e4086b88e4cc08ef5ce9dc" Sep 09 23:11:45.755650 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:11:45.755600 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c31bc7155a9789bfbb21d092d10c472d921415e3a0e4086b88e4cc08ef5ce9dc"} err="failed to get container status \"c31bc7155a9789bfbb21d092d10c472d921415e3a0e4086b88e4cc08ef5ce9dc\": rpc error: code = NotFound desc = could not find container \"c31bc7155a9789bfbb21d092d10c472d921415e3a0e4086b88e4cc08ef5ce9dc\": container with ID starting with c31bc7155a9789bfbb21d092d10c472d921415e3a0e4086b88e4cc08ef5ce9dc not found: ID does not exist" Sep 09 23:11:45.767347 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:11:45.767316 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7894c8d785-w4f86"] Sep 09 23:11:45.770804 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:11:45.770779 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7894c8d785-w4f86"] Sep 09 23:11:45.937978 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:11:45.937935 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0d9decd-18ca-4147-9cfb-ffba5adbda3e" path="/var/lib/kubelet/pods/e0d9decd-18ca-4147-9cfb-ffba5adbda3e/volumes" Sep 09 23:12:01.764430 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:01.764390 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r86lg"] Sep 09 23:12:01.764921 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:01.764696 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0d9decd-18ca-4147-9cfb-ffba5adbda3e" containerName="console" Sep 09 23:12:01.764921 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:01.764708 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0d9decd-18ca-4147-9cfb-ffba5adbda3e" containerName="console" Sep 09 23:12:01.764921 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:01.764765 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0d9decd-18ca-4147-9cfb-ffba5adbda3e" containerName="console" Sep 09 23:12:01.767520 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:01.767500 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r86lg" Sep 09 23:12:01.769835 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:01.769810 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 09 23:12:01.770554 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:01.770534 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 09 23:12:01.770664 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:01.770541 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-q2nl8\"" Sep 09 23:12:01.773644 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:01.773619 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r86lg"] Sep 09 23:12:01.847849 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:01.847808 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrtdv\" (UniqueName: \"kubernetes.io/projected/bc78eb6e-e37d-4928-be85-1a1a06e05c8f-kube-api-access-jrtdv\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r86lg\" (UID: \"bc78eb6e-e37d-4928-be85-1a1a06e05c8f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r86lg" Sep 09 23:12:01.848029 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:01.847890 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bc78eb6e-e37d-4928-be85-1a1a06e05c8f-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r86lg\" (UID: \"bc78eb6e-e37d-4928-be85-1a1a06e05c8f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r86lg" Sep 09 23:12:01.848029 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:01.847926 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bc78eb6e-e37d-4928-be85-1a1a06e05c8f-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r86lg\" (UID: \"bc78eb6e-e37d-4928-be85-1a1a06e05c8f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r86lg" Sep 09 23:12:01.948782 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:01.948743 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bc78eb6e-e37d-4928-be85-1a1a06e05c8f-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r86lg\" (UID: \"bc78eb6e-e37d-4928-be85-1a1a06e05c8f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r86lg" Sep 09 23:12:01.948974 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:01.948789 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrtdv\" (UniqueName: \"kubernetes.io/projected/bc78eb6e-e37d-4928-be85-1a1a06e05c8f-kube-api-access-jrtdv\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r86lg\" (UID: \"bc78eb6e-e37d-4928-be85-1a1a06e05c8f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r86lg" Sep 09 23:12:01.948974 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:01.948857 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bc78eb6e-e37d-4928-be85-1a1a06e05c8f-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r86lg\" (UID: \"bc78eb6e-e37d-4928-be85-1a1a06e05c8f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r86lg" Sep 09 23:12:01.949181 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:01.949163 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bc78eb6e-e37d-4928-be85-1a1a06e05c8f-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r86lg\" (UID: \"bc78eb6e-e37d-4928-be85-1a1a06e05c8f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r86lg" Sep 09 23:12:01.949251 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:01.949200 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bc78eb6e-e37d-4928-be85-1a1a06e05c8f-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r86lg\" (UID: \"bc78eb6e-e37d-4928-be85-1a1a06e05c8f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r86lg" Sep 09 23:12:01.956960 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:01.956933 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrtdv\" (UniqueName: \"kubernetes.io/projected/bc78eb6e-e37d-4928-be85-1a1a06e05c8f-kube-api-access-jrtdv\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r86lg\" (UID: \"bc78eb6e-e37d-4928-be85-1a1a06e05c8f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r86lg" Sep 09 23:12:02.077797 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:02.077706 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r86lg" Sep 09 23:12:02.345550 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:02.345471 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r86lg"] Sep 09 23:12:02.348633 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:12:02.348605 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc78eb6e_e37d_4928_be85_1a1a06e05c8f.slice/crio-b1a9f400fb56a716d13a5fd7c665838a3d3ed295010921f76f2ea6de97e2e36e WatchSource:0}: Error finding container b1a9f400fb56a716d13a5fd7c665838a3d3ed295010921f76f2ea6de97e2e36e: Status 404 returned error can't find the container with id b1a9f400fb56a716d13a5fd7c665838a3d3ed295010921f76f2ea6de97e2e36e Sep 09 23:12:02.350739 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:02.350721 2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 09 23:12:02.815098 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:02.815064 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r86lg" event={"ID":"bc78eb6e-e37d-4928-be85-1a1a06e05c8f","Type":"ContainerStarted","Data":"b1a9f400fb56a716d13a5fd7c665838a3d3ed295010921f76f2ea6de97e2e36e"} Sep 09 23:12:09.846953 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:09.846914 2552 generic.go:356] "Generic (PLEG): container finished" podID="bc78eb6e-e37d-4928-be85-1a1a06e05c8f" containerID="364985e4fc3ce61643986c3ac066dc3c0b88c749225249f5fe62ce2a1d9baf34" exitCode=0 Sep 09 23:12:09.847419 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:09.847015 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r86lg" event={"ID":"bc78eb6e-e37d-4928-be85-1a1a06e05c8f","Type":"ContainerDied","Data":"364985e4fc3ce61643986c3ac066dc3c0b88c749225249f5fe62ce2a1d9baf34"} Sep 09 23:12:12.866534 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:12.866494 2552 generic.go:356] "Generic (PLEG): container finished" podID="bc78eb6e-e37d-4928-be85-1a1a06e05c8f" containerID="aefba95c289722f835cd50d71689487a62a83c705bce5cd49f8a74207c657d1d" exitCode=0 Sep 09 23:12:12.866934 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:12.866575 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r86lg" event={"ID":"bc78eb6e-e37d-4928-be85-1a1a06e05c8f","Type":"ContainerDied","Data":"aefba95c289722f835cd50d71689487a62a83c705bce5cd49f8a74207c657d1d"} Sep 09 23:12:19.900926 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:19.900887 2552 generic.go:356] "Generic (PLEG): container finished" podID="bc78eb6e-e37d-4928-be85-1a1a06e05c8f" containerID="108af9a45093ccf45ef3a1aa69be37b88af271e684fc3964c8b38c5b61f7c7e4" exitCode=0 Sep 09 23:12:19.901354 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:19.900948 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r86lg" event={"ID":"bc78eb6e-e37d-4928-be85-1a1a06e05c8f","Type":"ContainerDied","Data":"108af9a45093ccf45ef3a1aa69be37b88af271e684fc3964c8b38c5b61f7c7e4"} Sep 09 23:12:21.041119 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:21.041089 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r86lg" Sep 09 23:12:21.116381 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:21.116341 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bc78eb6e-e37d-4928-be85-1a1a06e05c8f-bundle\") pod \"bc78eb6e-e37d-4928-be85-1a1a06e05c8f\" (UID: \"bc78eb6e-e37d-4928-be85-1a1a06e05c8f\") " Sep 09 23:12:21.116583 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:21.116446 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jrtdv\" (UniqueName: \"kubernetes.io/projected/bc78eb6e-e37d-4928-be85-1a1a06e05c8f-kube-api-access-jrtdv\") pod \"bc78eb6e-e37d-4928-be85-1a1a06e05c8f\" (UID: \"bc78eb6e-e37d-4928-be85-1a1a06e05c8f\") " Sep 09 23:12:21.116583 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:21.116475 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bc78eb6e-e37d-4928-be85-1a1a06e05c8f-util\") pod \"bc78eb6e-e37d-4928-be85-1a1a06e05c8f\" (UID: \"bc78eb6e-e37d-4928-be85-1a1a06e05c8f\") " Sep 09 23:12:21.117177 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:21.117146 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc78eb6e-e37d-4928-be85-1a1a06e05c8f-bundle" (OuterVolumeSpecName: "bundle") pod "bc78eb6e-e37d-4928-be85-1a1a06e05c8f" (UID: "bc78eb6e-e37d-4928-be85-1a1a06e05c8f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:12:21.118727 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:21.118700 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc78eb6e-e37d-4928-be85-1a1a06e05c8f-kube-api-access-jrtdv" (OuterVolumeSpecName: "kube-api-access-jrtdv") pod "bc78eb6e-e37d-4928-be85-1a1a06e05c8f" (UID: "bc78eb6e-e37d-4928-be85-1a1a06e05c8f"). InnerVolumeSpecName "kube-api-access-jrtdv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:12:21.121043 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:21.121014 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc78eb6e-e37d-4928-be85-1a1a06e05c8f-util" (OuterVolumeSpecName: "util") pod "bc78eb6e-e37d-4928-be85-1a1a06e05c8f" (UID: "bc78eb6e-e37d-4928-be85-1a1a06e05c8f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:12:21.218120 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:21.218046 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jrtdv\" (UniqueName: \"kubernetes.io/projected/bc78eb6e-e37d-4928-be85-1a1a06e05c8f-kube-api-access-jrtdv\") on node \"ip-10-0-142-217.ec2.internal\" DevicePath \"\"" Sep 09 23:12:21.218120 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:21.218075 2552 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bc78eb6e-e37d-4928-be85-1a1a06e05c8f-util\") on node \"ip-10-0-142-217.ec2.internal\" DevicePath \"\"" Sep 09 23:12:21.218120 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:21.218086 2552 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bc78eb6e-e37d-4928-be85-1a1a06e05c8f-bundle\") on node \"ip-10-0-142-217.ec2.internal\" DevicePath \"\"" Sep 09 23:12:21.911010 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:21.910979 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r86lg" Sep 09 23:12:21.911175 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:21.911012 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540r86lg" event={"ID":"bc78eb6e-e37d-4928-be85-1a1a06e05c8f","Type":"ContainerDied","Data":"b1a9f400fb56a716d13a5fd7c665838a3d3ed295010921f76f2ea6de97e2e36e"} Sep 09 23:12:21.911175 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:21.911064 2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b1a9f400fb56a716d13a5fd7c665838a3d3ed295010921f76f2ea6de97e2e36e" Sep 09 23:12:29.671816 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:29.671770 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cwksh"] Sep 09 23:12:29.672392 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:29.672212 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc78eb6e-e37d-4928-be85-1a1a06e05c8f" containerName="util" Sep 09 23:12:29.672392 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:29.672231 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc78eb6e-e37d-4928-be85-1a1a06e05c8f" containerName="util" Sep 09 23:12:29.672392 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:29.672249 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc78eb6e-e37d-4928-be85-1a1a06e05c8f" containerName="pull" Sep 09 23:12:29.672392 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:29.672257 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc78eb6e-e37d-4928-be85-1a1a06e05c8f" containerName="pull" Sep 09 23:12:29.672392 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:29.672277 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc78eb6e-e37d-4928-be85-1a1a06e05c8f" containerName="extract" Sep 09 23:12:29.672392 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:29.672286 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc78eb6e-e37d-4928-be85-1a1a06e05c8f" containerName="extract" Sep 09 23:12:29.672392 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:29.672358 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc78eb6e-e37d-4928-be85-1a1a06e05c8f" containerName="extract" Sep 09 23:12:29.675924 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:29.675900 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cwksh" Sep 09 23:12:29.679290 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:29.679268 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-m8s9r\"" Sep 09 23:12:29.679538 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:29.679521 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Sep 09 23:12:29.679637 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:29.679595 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Sep 09 23:12:29.693912 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:29.693875 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cwksh"] Sep 09 23:12:29.791518 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:29.791477 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwrsz\" (UniqueName: \"kubernetes.io/projected/88ee8b6e-9ec6-4909-b911-1de502cc226c-kube-api-access-jwrsz\") pod \"cert-manager-operator-controller-manager-55c444bf86-cwksh\" (UID: \"88ee8b6e-9ec6-4909-b911-1de502cc226c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cwksh" Sep 09 23:12:29.791739 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:29.791572 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/88ee8b6e-9ec6-4909-b911-1de502cc226c-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-cwksh\" (UID: \"88ee8b6e-9ec6-4909-b911-1de502cc226c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cwksh" Sep 09 23:12:29.892943 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:29.892903 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwrsz\" (UniqueName: \"kubernetes.io/projected/88ee8b6e-9ec6-4909-b911-1de502cc226c-kube-api-access-jwrsz\") pod \"cert-manager-operator-controller-manager-55c444bf86-cwksh\" (UID: \"88ee8b6e-9ec6-4909-b911-1de502cc226c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cwksh" Sep 09 23:12:29.893107 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:29.892975 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/88ee8b6e-9ec6-4909-b911-1de502cc226c-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-cwksh\" (UID: \"88ee8b6e-9ec6-4909-b911-1de502cc226c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cwksh" Sep 09 23:12:29.893337 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:29.893318 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/88ee8b6e-9ec6-4909-b911-1de502cc226c-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-cwksh\" (UID: \"88ee8b6e-9ec6-4909-b911-1de502cc226c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cwksh" Sep 09 23:12:29.913868 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:29.913834 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwrsz\" (UniqueName: \"kubernetes.io/projected/88ee8b6e-9ec6-4909-b911-1de502cc226c-kube-api-access-jwrsz\") pod \"cert-manager-operator-controller-manager-55c444bf86-cwksh\" (UID: \"88ee8b6e-9ec6-4909-b911-1de502cc226c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cwksh" Sep 09 23:12:29.985185 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:29.985098 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cwksh" Sep 09 23:12:30.262452 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:30.262356 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cwksh"] Sep 09 23:12:30.266036 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:12:30.266004 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88ee8b6e_9ec6_4909_b911_1de502cc226c.slice/crio-71e1e316879f5950c2525b5eee73f912a1eedbbfddca8762a5dee321bd658577 WatchSource:0}: Error finding container 71e1e316879f5950c2525b5eee73f912a1eedbbfddca8762a5dee321bd658577: Status 404 returned error can't find the container with id 71e1e316879f5950c2525b5eee73f912a1eedbbfddca8762a5dee321bd658577 Sep 09 23:12:30.951562 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:30.951512 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cwksh" event={"ID":"88ee8b6e-9ec6-4909-b911-1de502cc226c","Type":"ContainerStarted","Data":"71e1e316879f5950c2525b5eee73f912a1eedbbfddca8762a5dee321bd658577"} Sep 09 23:12:31.958199 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:31.958162 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cwksh" event={"ID":"88ee8b6e-9ec6-4909-b911-1de502cc226c","Type":"ContainerStarted","Data":"ab19f9c6f2818fa179717a3cb80fe559098abc8481d937bae44ea5b40250c6bb"} Sep 09 23:12:31.977259 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:31.977203 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cwksh" podStartSLOduration=1.464524297 podStartE2EDuration="2.977179624s" totalImagesPullingTime="1.512655327s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:12:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:12:31.976242407 +0000 UTC m=+522.491973237" watchObservedRunningTime="2026-09-09 23:12:31.977179624 +0000 UTC m=+522.492910453" Sep 09 23:12:33.186636 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:33.186599 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnnqg4"] Sep 09 23:12:33.189167 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:33.189150 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnnqg4" Sep 09 23:12:33.191465 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:33.191444 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 09 23:12:33.191561 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:33.191474 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-q2nl8\"" Sep 09 23:12:33.192296 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:33.192275 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 09 23:12:33.196360 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:33.196011 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnnqg4"] Sep 09 23:12:33.324529 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:33.324487 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0808299c-fe60-4e98-b0a5-ee18882423e8-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnnqg4\" (UID: \"0808299c-fe60-4e98-b0a5-ee18882423e8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnnqg4" Sep 09 23:12:33.324750 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:33.324596 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0808299c-fe60-4e98-b0a5-ee18882423e8-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnnqg4\" (UID: \"0808299c-fe60-4e98-b0a5-ee18882423e8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnnqg4" Sep 09 23:12:33.324750 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:33.324634 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6d8j2\" (UniqueName: \"kubernetes.io/projected/0808299c-fe60-4e98-b0a5-ee18882423e8-kube-api-access-6d8j2\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnnqg4\" (UID: \"0808299c-fe60-4e98-b0a5-ee18882423e8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnnqg4" Sep 09 23:12:33.425486 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:33.425443 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0808299c-fe60-4e98-b0a5-ee18882423e8-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnnqg4\" (UID: \"0808299c-fe60-4e98-b0a5-ee18882423e8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnnqg4" Sep 09 23:12:33.425486 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:33.425486 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6d8j2\" (UniqueName: \"kubernetes.io/projected/0808299c-fe60-4e98-b0a5-ee18882423e8-kube-api-access-6d8j2\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnnqg4\" (UID: \"0808299c-fe60-4e98-b0a5-ee18882423e8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnnqg4" Sep 09 23:12:33.425714 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:33.425540 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0808299c-fe60-4e98-b0a5-ee18882423e8-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnnqg4\" (UID: \"0808299c-fe60-4e98-b0a5-ee18882423e8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnnqg4" Sep 09 23:12:33.425964 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:33.425943 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0808299c-fe60-4e98-b0a5-ee18882423e8-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnnqg4\" (UID: \"0808299c-fe60-4e98-b0a5-ee18882423e8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnnqg4" Sep 09 23:12:33.425964 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:33.425956 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0808299c-fe60-4e98-b0a5-ee18882423e8-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnnqg4\" (UID: \"0808299c-fe60-4e98-b0a5-ee18882423e8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnnqg4" Sep 09 23:12:33.437189 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:33.437108 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6d8j2\" (UniqueName: \"kubernetes.io/projected/0808299c-fe60-4e98-b0a5-ee18882423e8-kube-api-access-6d8j2\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnnqg4\" (UID: \"0808299c-fe60-4e98-b0a5-ee18882423e8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnnqg4" Sep 09 23:12:33.499600 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:33.499557 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnnqg4" Sep 09 23:12:33.748502 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:33.748422 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-p5f5t"] Sep 09 23:12:33.750859 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:33.750839 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-p5f5t" Sep 09 23:12:33.753306 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:33.753282 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-sr29s\"" Sep 09 23:12:33.754142 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:33.754112 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Sep 09 23:12:33.754531 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:33.754513 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Sep 09 23:12:33.760264 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:33.760239 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-p5f5t"] Sep 09 23:12:33.773272 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:33.773236 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnnqg4"] Sep 09 23:12:33.777604 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:12:33.777576 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0808299c_fe60_4e98_b0a5_ee18882423e8.slice/crio-cf62b70ce4ef6fd71987e10c70807b1b10ef68c186940fe80821621a142645f9 WatchSource:0}: Error finding container cf62b70ce4ef6fd71987e10c70807b1b10ef68c186940fe80821621a142645f9: Status 404 returned error can't find the container with id cf62b70ce4ef6fd71987e10c70807b1b10ef68c186940fe80821621a142645f9 Sep 09 23:12:33.828256 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:33.828230 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzs9x\" (UniqueName: \"kubernetes.io/projected/48ed7225-7bb2-4184-9d17-ec43858e4e20-kube-api-access-rzs9x\") pod \"cert-manager-webhook-6486ffd997-p5f5t\" (UID: \"48ed7225-7bb2-4184-9d17-ec43858e4e20\") " pod="cert-manager/cert-manager-webhook-6486ffd997-p5f5t" Sep 09 23:12:33.828396 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:33.828281 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/48ed7225-7bb2-4184-9d17-ec43858e4e20-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-p5f5t\" (UID: \"48ed7225-7bb2-4184-9d17-ec43858e4e20\") " pod="cert-manager/cert-manager-webhook-6486ffd997-p5f5t" Sep 09 23:12:33.929791 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:33.929747 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzs9x\" (UniqueName: \"kubernetes.io/projected/48ed7225-7bb2-4184-9d17-ec43858e4e20-kube-api-access-rzs9x\") pod \"cert-manager-webhook-6486ffd997-p5f5t\" (UID: \"48ed7225-7bb2-4184-9d17-ec43858e4e20\") " pod="cert-manager/cert-manager-webhook-6486ffd997-p5f5t" Sep 09 23:12:33.929970 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:33.929809 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/48ed7225-7bb2-4184-9d17-ec43858e4e20-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-p5f5t\" (UID: \"48ed7225-7bb2-4184-9d17-ec43858e4e20\") " pod="cert-manager/cert-manager-webhook-6486ffd997-p5f5t" Sep 09 23:12:33.937284 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:33.937256 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/48ed7225-7bb2-4184-9d17-ec43858e4e20-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-p5f5t\" (UID: \"48ed7225-7bb2-4184-9d17-ec43858e4e20\") " pod="cert-manager/cert-manager-webhook-6486ffd997-p5f5t" Sep 09 23:12:33.937458 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:33.937438 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzs9x\" (UniqueName: \"kubernetes.io/projected/48ed7225-7bb2-4184-9d17-ec43858e4e20-kube-api-access-rzs9x\") pod \"cert-manager-webhook-6486ffd997-p5f5t\" (UID: \"48ed7225-7bb2-4184-9d17-ec43858e4e20\") " pod="cert-manager/cert-manager-webhook-6486ffd997-p5f5t" Sep 09 23:12:33.974129 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:33.974091 2552 generic.go:356] "Generic (PLEG): container finished" podID="0808299c-fe60-4e98-b0a5-ee18882423e8" containerID="a3a6e74ba4cd071699ecc58ed280a5da5dde1152eb72b12f93cbcbb66f4c9a6a" exitCode=0 Sep 09 23:12:33.974312 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:33.974176 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnnqg4" event={"ID":"0808299c-fe60-4e98-b0a5-ee18882423e8","Type":"ContainerDied","Data":"a3a6e74ba4cd071699ecc58ed280a5da5dde1152eb72b12f93cbcbb66f4c9a6a"} Sep 09 23:12:33.974312 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:33.974262 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnnqg4" event={"ID":"0808299c-fe60-4e98-b0a5-ee18882423e8","Type":"ContainerStarted","Data":"cf62b70ce4ef6fd71987e10c70807b1b10ef68c186940fe80821621a142645f9"} Sep 09 23:12:34.061984 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:34.061887 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-p5f5t" Sep 09 23:12:34.331551 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:34.331480 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-p5f5t"] Sep 09 23:12:34.333719 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:12:34.333695 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod48ed7225_7bb2_4184_9d17_ec43858e4e20.slice/crio-ee2e84549c2f3b26152e2072188e61dba79f3da7b083c53b817ed6b7ee54b3f8 WatchSource:0}: Error finding container ee2e84549c2f3b26152e2072188e61dba79f3da7b083c53b817ed6b7ee54b3f8: Status 404 returned error can't find the container with id ee2e84549c2f3b26152e2072188e61dba79f3da7b083c53b817ed6b7ee54b3f8 Sep 09 23:12:34.980680 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:34.980626 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-p5f5t" event={"ID":"48ed7225-7bb2-4184-9d17-ec43858e4e20","Type":"ContainerStarted","Data":"ee2e84549c2f3b26152e2072188e61dba79f3da7b083c53b817ed6b7ee54b3f8"} Sep 09 23:12:37.998023 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:37.997974 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-p5f5t" event={"ID":"48ed7225-7bb2-4184-9d17-ec43858e4e20","Type":"ContainerStarted","Data":"b6f00a0909d3b09a5da8738b1d46b3e648876efc1dcfc5d5d6ea46c65feb28a5"} Sep 09 23:12:37.998507 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:37.998042 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-p5f5t" Sep 09 23:12:37.999779 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:37.999755 2552 generic.go:356] "Generic (PLEG): container finished" podID="0808299c-fe60-4e98-b0a5-ee18882423e8" containerID="e246bf71543feea4add917b638280b59bada9bc08fda01ec9d5f730eedba1d1f" exitCode=0 Sep 09 23:12:37.999864 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:37.999800 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnnqg4" event={"ID":"0808299c-fe60-4e98-b0a5-ee18882423e8","Type":"ContainerDied","Data":"e246bf71543feea4add917b638280b59bada9bc08fda01ec9d5f730eedba1d1f"} Sep 09 23:12:38.017914 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:38.017868 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-p5f5t" podStartSLOduration=2.205202804 podStartE2EDuration="5.017850992s" totalImagesPullingTime="2.812648188s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:12:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:12:38.017020945 +0000 UTC m=+528.532751777" watchObservedRunningTime="2026-09-09 23:12:38.017850992 +0000 UTC m=+528.533581821" Sep 09 23:12:39.006211 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:39.006174 2552 generic.go:356] "Generic (PLEG): container finished" podID="0808299c-fe60-4e98-b0a5-ee18882423e8" containerID="97760c07dec1da475e2ff6f7416fbe2aa3aabb54785bbe0b47991887dfa27d8a" exitCode=0 Sep 09 23:12:39.006644 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:39.006255 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnnqg4" event={"ID":"0808299c-fe60-4e98-b0a5-ee18882423e8","Type":"ContainerDied","Data":"97760c07dec1da475e2ff6f7416fbe2aa3aabb54785bbe0b47991887dfa27d8a"} Sep 09 23:12:40.150587 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:40.150553 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnnqg4" Sep 09 23:12:40.284102 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:40.283996 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0808299c-fe60-4e98-b0a5-ee18882423e8-bundle\") pod \"0808299c-fe60-4e98-b0a5-ee18882423e8\" (UID: \"0808299c-fe60-4e98-b0a5-ee18882423e8\") " Sep 09 23:12:40.284102 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:40.284093 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6d8j2\" (UniqueName: \"kubernetes.io/projected/0808299c-fe60-4e98-b0a5-ee18882423e8-kube-api-access-6d8j2\") pod \"0808299c-fe60-4e98-b0a5-ee18882423e8\" (UID: \"0808299c-fe60-4e98-b0a5-ee18882423e8\") " Sep 09 23:12:40.284340 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:40.284116 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0808299c-fe60-4e98-b0a5-ee18882423e8-util\") pod \"0808299c-fe60-4e98-b0a5-ee18882423e8\" (UID: \"0808299c-fe60-4e98-b0a5-ee18882423e8\") " Sep 09 23:12:40.284457 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:40.284429 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0808299c-fe60-4e98-b0a5-ee18882423e8-bundle" (OuterVolumeSpecName: "bundle") pod "0808299c-fe60-4e98-b0a5-ee18882423e8" (UID: "0808299c-fe60-4e98-b0a5-ee18882423e8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:12:40.286273 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:40.286243 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0808299c-fe60-4e98-b0a5-ee18882423e8-kube-api-access-6d8j2" (OuterVolumeSpecName: "kube-api-access-6d8j2") pod "0808299c-fe60-4e98-b0a5-ee18882423e8" (UID: "0808299c-fe60-4e98-b0a5-ee18882423e8"). InnerVolumeSpecName "kube-api-access-6d8j2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:12:40.289077 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:40.289045 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0808299c-fe60-4e98-b0a5-ee18882423e8-util" (OuterVolumeSpecName: "util") pod "0808299c-fe60-4e98-b0a5-ee18882423e8" (UID: "0808299c-fe60-4e98-b0a5-ee18882423e8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:12:40.384962 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:40.384921 2552 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0808299c-fe60-4e98-b0a5-ee18882423e8-bundle\") on node \"ip-10-0-142-217.ec2.internal\" DevicePath \"\"" Sep 09 23:12:40.384962 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:40.384955 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6d8j2\" (UniqueName: \"kubernetes.io/projected/0808299c-fe60-4e98-b0a5-ee18882423e8-kube-api-access-6d8j2\") on node \"ip-10-0-142-217.ec2.internal\" DevicePath \"\"" Sep 09 23:12:40.384962 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:40.384966 2552 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0808299c-fe60-4e98-b0a5-ee18882423e8-util\") on node \"ip-10-0-142-217.ec2.internal\" DevicePath \"\"" Sep 09 23:12:41.017555 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:41.017517 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnnqg4" event={"ID":"0808299c-fe60-4e98-b0a5-ee18882423e8","Type":"ContainerDied","Data":"cf62b70ce4ef6fd71987e10c70807b1b10ef68c186940fe80821621a142645f9"} Sep 09 23:12:41.017555 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:41.017553 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnnqg4" Sep 09 23:12:41.017796 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:41.017566 2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cf62b70ce4ef6fd71987e10c70807b1b10ef68c186940fe80821621a142645f9" Sep 09 23:12:44.009585 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:44.009502 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-p5f5t" Sep 09 23:12:46.018710 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:46.018661 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-wswjm"] Sep 09 23:12:46.019176 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:46.019136 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0808299c-fe60-4e98-b0a5-ee18882423e8" containerName="util" Sep 09 23:12:46.019176 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:46.019156 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="0808299c-fe60-4e98-b0a5-ee18882423e8" containerName="util" Sep 09 23:12:46.019304 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:46.019192 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0808299c-fe60-4e98-b0a5-ee18882423e8" containerName="pull" Sep 09 23:12:46.019304 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:46.019202 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="0808299c-fe60-4e98-b0a5-ee18882423e8" containerName="pull" Sep 09 23:12:46.019304 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:46.019217 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0808299c-fe60-4e98-b0a5-ee18882423e8" containerName="extract" Sep 09 23:12:46.019304 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:46.019225 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="0808299c-fe60-4e98-b0a5-ee18882423e8" containerName="extract" Sep 09 23:12:46.019485 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:46.019305 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="0808299c-fe60-4e98-b0a5-ee18882423e8" containerName="extract" Sep 09 23:12:46.024211 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:46.024178 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-wswjm" Sep 09 23:12:46.027337 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:46.027309 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-96q8p\"" Sep 09 23:12:46.028842 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:46.028815 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-wswjm"] Sep 09 23:12:46.135309 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:46.135271 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45qrj\" (UniqueName: \"kubernetes.io/projected/912245f2-017c-4c5d-9727-8b25a052e8d6-kube-api-access-45qrj\") pod \"cert-manager-55b4d954d5-wswjm\" (UID: \"912245f2-017c-4c5d-9727-8b25a052e8d6\") " pod="cert-manager/cert-manager-55b4d954d5-wswjm" Sep 09 23:12:46.135493 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:46.135347 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/912245f2-017c-4c5d-9727-8b25a052e8d6-bound-sa-token\") pod \"cert-manager-55b4d954d5-wswjm\" (UID: \"912245f2-017c-4c5d-9727-8b25a052e8d6\") " pod="cert-manager/cert-manager-55b4d954d5-wswjm" Sep 09 23:12:46.236782 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:46.236742 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/912245f2-017c-4c5d-9727-8b25a052e8d6-bound-sa-token\") pod \"cert-manager-55b4d954d5-wswjm\" (UID: \"912245f2-017c-4c5d-9727-8b25a052e8d6\") " pod="cert-manager/cert-manager-55b4d954d5-wswjm" Sep 09 23:12:46.237005 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:46.236802 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45qrj\" (UniqueName: \"kubernetes.io/projected/912245f2-017c-4c5d-9727-8b25a052e8d6-kube-api-access-45qrj\") pod \"cert-manager-55b4d954d5-wswjm\" (UID: \"912245f2-017c-4c5d-9727-8b25a052e8d6\") " pod="cert-manager/cert-manager-55b4d954d5-wswjm" Sep 09 23:12:46.244449 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:46.244409 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/912245f2-017c-4c5d-9727-8b25a052e8d6-bound-sa-token\") pod \"cert-manager-55b4d954d5-wswjm\" (UID: \"912245f2-017c-4c5d-9727-8b25a052e8d6\") " pod="cert-manager/cert-manager-55b4d954d5-wswjm" Sep 09 23:12:46.244579 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:46.244468 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-45qrj\" (UniqueName: \"kubernetes.io/projected/912245f2-017c-4c5d-9727-8b25a052e8d6-kube-api-access-45qrj\") pod \"cert-manager-55b4d954d5-wswjm\" (UID: \"912245f2-017c-4c5d-9727-8b25a052e8d6\") " pod="cert-manager/cert-manager-55b4d954d5-wswjm" Sep 09 23:12:46.335651 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:46.335555 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-wswjm" Sep 09 23:12:46.629248 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:46.629223 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-wswjm"] Sep 09 23:12:46.631926 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:12:46.631891 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod912245f2_017c_4c5d_9727_8b25a052e8d6.slice/crio-5bd96707dc48ffb212b1cd45b3beb7eee23735de59961cc006917b7960782d1c WatchSource:0}: Error finding container 5bd96707dc48ffb212b1cd45b3beb7eee23735de59961cc006917b7960782d1c: Status 404 returned error can't find the container with id 5bd96707dc48ffb212b1cd45b3beb7eee23735de59961cc006917b7960782d1c Sep 09 23:12:47.049297 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:47.049210 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-wswjm" event={"ID":"912245f2-017c-4c5d-9727-8b25a052e8d6","Type":"ContainerStarted","Data":"7691a5e07c1a7c975dec55b0371ddbdfa1eae4f6f0b13f346920076af27accec"} Sep 09 23:12:47.049297 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:47.049256 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-wswjm" event={"ID":"912245f2-017c-4c5d-9727-8b25a052e8d6","Type":"ContainerStarted","Data":"5bd96707dc48ffb212b1cd45b3beb7eee23735de59961cc006917b7960782d1c"} Sep 09 23:12:47.064971 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:47.064914 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-wswjm" podStartSLOduration=1.064897013 podStartE2EDuration="1.064897013s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:12:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:12:47.063545488 +0000 UTC m=+537.579276320" watchObservedRunningTime="2026-09-09 23:12:47.064897013 +0000 UTC m=+537.580627842" Sep 09 23:12:53.212385 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:53.212339 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpbclt"] Sep 09 23:12:53.215321 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:53.215302 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpbclt" Sep 09 23:12:53.217512 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:53.217488 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 09 23:12:53.217722 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:53.217708 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-q2nl8\"" Sep 09 23:12:53.218346 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:53.218332 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 09 23:12:53.223207 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:53.223185 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpbclt"] Sep 09 23:12:53.294559 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:53.294520 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e5c407fc-0636-4118-9111-1c2431aca0a3-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpbclt\" (UID: \"e5c407fc-0636-4118-9111-1c2431aca0a3\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpbclt" Sep 09 23:12:53.294763 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:53.294562 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svp9s\" (UniqueName: \"kubernetes.io/projected/e5c407fc-0636-4118-9111-1c2431aca0a3-kube-api-access-svp9s\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpbclt\" (UID: \"e5c407fc-0636-4118-9111-1c2431aca0a3\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpbclt" Sep 09 23:12:53.294763 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:53.294622 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e5c407fc-0636-4118-9111-1c2431aca0a3-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpbclt\" (UID: \"e5c407fc-0636-4118-9111-1c2431aca0a3\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpbclt" Sep 09 23:12:53.395877 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:53.395821 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e5c407fc-0636-4118-9111-1c2431aca0a3-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpbclt\" (UID: \"e5c407fc-0636-4118-9111-1c2431aca0a3\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpbclt" Sep 09 23:12:53.395877 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:53.395878 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svp9s\" (UniqueName: \"kubernetes.io/projected/e5c407fc-0636-4118-9111-1c2431aca0a3-kube-api-access-svp9s\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpbclt\" (UID: \"e5c407fc-0636-4118-9111-1c2431aca0a3\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpbclt" Sep 09 23:12:53.396141 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:53.395905 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e5c407fc-0636-4118-9111-1c2431aca0a3-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpbclt\" (UID: \"e5c407fc-0636-4118-9111-1c2431aca0a3\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpbclt" Sep 09 23:12:53.396254 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:53.396231 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e5c407fc-0636-4118-9111-1c2431aca0a3-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpbclt\" (UID: \"e5c407fc-0636-4118-9111-1c2431aca0a3\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpbclt" Sep 09 23:12:53.396317 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:53.396258 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e5c407fc-0636-4118-9111-1c2431aca0a3-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpbclt\" (UID: \"e5c407fc-0636-4118-9111-1c2431aca0a3\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpbclt" Sep 09 23:12:53.403842 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:53.403800 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-svp9s\" (UniqueName: \"kubernetes.io/projected/e5c407fc-0636-4118-9111-1c2431aca0a3-kube-api-access-svp9s\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpbclt\" (UID: \"e5c407fc-0636-4118-9111-1c2431aca0a3\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpbclt" Sep 09 23:12:53.526557 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:53.526461 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpbclt" Sep 09 23:12:53.795836 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:53.795689 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpbclt"] Sep 09 23:12:53.798608 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:12:53.798570 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5c407fc_0636_4118_9111_1c2431aca0a3.slice/crio-e3a6b41d5753907b6d803de3771c440c807cd91f31b2bfd28332774a6d2399ff WatchSource:0}: Error finding container e3a6b41d5753907b6d803de3771c440c807cd91f31b2bfd28332774a6d2399ff: Status 404 returned error can't find the container with id e3a6b41d5753907b6d803de3771c440c807cd91f31b2bfd28332774a6d2399ff Sep 09 23:12:54.080939 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:54.080846 2552 generic.go:356] "Generic (PLEG): container finished" podID="e5c407fc-0636-4118-9111-1c2431aca0a3" containerID="96db3c74e7bf95000ec388f0d6375061e4b61d96a45df0ff35b563381f9e1de3" exitCode=0 Sep 09 23:12:54.080939 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:54.080905 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpbclt" event={"ID":"e5c407fc-0636-4118-9111-1c2431aca0a3","Type":"ContainerDied","Data":"96db3c74e7bf95000ec388f0d6375061e4b61d96a45df0ff35b563381f9e1de3"} Sep 09 23:12:54.080939 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:54.080940 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpbclt" event={"ID":"e5c407fc-0636-4118-9111-1c2431aca0a3","Type":"ContainerStarted","Data":"e3a6b41d5753907b6d803de3771c440c807cd91f31b2bfd28332774a6d2399ff"} Sep 09 23:12:55.087076 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:55.086986 2552 generic.go:356] "Generic (PLEG): container finished" podID="e5c407fc-0636-4118-9111-1c2431aca0a3" containerID="8daa18704e81e7732642a6d5b8761f115299f3980a3710d141cb6397e9cd678f" exitCode=0 Sep 09 23:12:55.087449 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:55.087071 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpbclt" event={"ID":"e5c407fc-0636-4118-9111-1c2431aca0a3","Type":"ContainerDied","Data":"8daa18704e81e7732642a6d5b8761f115299f3980a3710d141cb6397e9cd678f"} Sep 09 23:12:56.094280 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:56.094242 2552 generic.go:356] "Generic (PLEG): container finished" podID="e5c407fc-0636-4118-9111-1c2431aca0a3" containerID="9b50d1d109096d212b1e142027283c5a9d6f883b63b7175c6bec9939601d5db5" exitCode=0 Sep 09 23:12:56.094656 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:56.094330 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpbclt" event={"ID":"e5c407fc-0636-4118-9111-1c2431aca0a3","Type":"ContainerDied","Data":"9b50d1d109096d212b1e142027283c5a9d6f883b63b7175c6bec9939601d5db5"} Sep 09 23:12:57.223338 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:57.223311 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpbclt" Sep 09 23:12:57.329887 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:57.329849 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-svp9s\" (UniqueName: \"kubernetes.io/projected/e5c407fc-0636-4118-9111-1c2431aca0a3-kube-api-access-svp9s\") pod \"e5c407fc-0636-4118-9111-1c2431aca0a3\" (UID: \"e5c407fc-0636-4118-9111-1c2431aca0a3\") " Sep 09 23:12:57.330069 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:57.329907 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e5c407fc-0636-4118-9111-1c2431aca0a3-bundle\") pod \"e5c407fc-0636-4118-9111-1c2431aca0a3\" (UID: \"e5c407fc-0636-4118-9111-1c2431aca0a3\") " Sep 09 23:12:57.330069 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:57.329960 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e5c407fc-0636-4118-9111-1c2431aca0a3-util\") pod \"e5c407fc-0636-4118-9111-1c2431aca0a3\" (UID: \"e5c407fc-0636-4118-9111-1c2431aca0a3\") " Sep 09 23:12:57.330708 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:57.330651 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5c407fc-0636-4118-9111-1c2431aca0a3-bundle" (OuterVolumeSpecName: "bundle") pod "e5c407fc-0636-4118-9111-1c2431aca0a3" (UID: "e5c407fc-0636-4118-9111-1c2431aca0a3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:12:57.331994 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:57.331969 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5c407fc-0636-4118-9111-1c2431aca0a3-kube-api-access-svp9s" (OuterVolumeSpecName: "kube-api-access-svp9s") pod "e5c407fc-0636-4118-9111-1c2431aca0a3" (UID: "e5c407fc-0636-4118-9111-1c2431aca0a3"). InnerVolumeSpecName "kube-api-access-svp9s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:12:57.336168 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:57.336137 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5c407fc-0636-4118-9111-1c2431aca0a3-util" (OuterVolumeSpecName: "util") pod "e5c407fc-0636-4118-9111-1c2431aca0a3" (UID: "e5c407fc-0636-4118-9111-1c2431aca0a3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:12:57.430545 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:57.430494 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-svp9s\" (UniqueName: \"kubernetes.io/projected/e5c407fc-0636-4118-9111-1c2431aca0a3-kube-api-access-svp9s\") on node \"ip-10-0-142-217.ec2.internal\" DevicePath \"\"" Sep 09 23:12:57.430545 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:57.430537 2552 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e5c407fc-0636-4118-9111-1c2431aca0a3-bundle\") on node \"ip-10-0-142-217.ec2.internal\" DevicePath \"\"" Sep 09 23:12:57.430545 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:57.430549 2552 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e5c407fc-0636-4118-9111-1c2431aca0a3-util\") on node \"ip-10-0-142-217.ec2.internal\" DevicePath \"\"" Sep 09 23:12:58.107826 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:58.107794 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpbclt" Sep 09 23:12:58.107826 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:58.107808 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpbclt" event={"ID":"e5c407fc-0636-4118-9111-1c2431aca0a3","Type":"ContainerDied","Data":"e3a6b41d5753907b6d803de3771c440c807cd91f31b2bfd28332774a6d2399ff"} Sep 09 23:12:58.108023 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:12:58.107851 2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e3a6b41d5753907b6d803de3771c440c807cd91f31b2bfd28332774a6d2399ff" Sep 09 23:13:04.032413 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:04.032373 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hg5rk"] Sep 09 23:13:04.032841 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:04.032699 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5c407fc-0636-4118-9111-1c2431aca0a3" containerName="extract" Sep 09 23:13:04.032841 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:04.032711 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5c407fc-0636-4118-9111-1c2431aca0a3" containerName="extract" Sep 09 23:13:04.032841 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:04.032726 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5c407fc-0636-4118-9111-1c2431aca0a3" containerName="util" Sep 09 23:13:04.032841 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:04.032732 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5c407fc-0636-4118-9111-1c2431aca0a3" containerName="util" Sep 09 23:13:04.032841 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:04.032744 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5c407fc-0636-4118-9111-1c2431aca0a3" containerName="pull" Sep 09 23:13:04.032841 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:04.032749 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5c407fc-0636-4118-9111-1c2431aca0a3" containerName="pull" Sep 09 23:13:04.032841 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:04.032801 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5c407fc-0636-4118-9111-1c2431aca0a3" containerName="extract" Sep 09 23:13:04.034999 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:04.034981 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hg5rk" Sep 09 23:13:04.037351 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:04.037325 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 09 23:13:04.037351 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:04.037326 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 09 23:13:04.037540 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:04.037354 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-q2nl8\"" Sep 09 23:13:04.043763 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:04.043738 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hg5rk"] Sep 09 23:13:04.082459 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:04.082419 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/05ea9268-d162-42c7-b350-9d9715211758-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hg5rk\" (UID: \"05ea9268-d162-42c7-b350-9d9715211758\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hg5rk" Sep 09 23:13:04.082459 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:04.082465 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqjm5\" (UniqueName: \"kubernetes.io/projected/05ea9268-d162-42c7-b350-9d9715211758-kube-api-access-rqjm5\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hg5rk\" (UID: \"05ea9268-d162-42c7-b350-9d9715211758\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hg5rk" Sep 09 23:13:04.082767 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:04.082515 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/05ea9268-d162-42c7-b350-9d9715211758-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hg5rk\" (UID: \"05ea9268-d162-42c7-b350-9d9715211758\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hg5rk" Sep 09 23:13:04.183896 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:04.183853 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/05ea9268-d162-42c7-b350-9d9715211758-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hg5rk\" (UID: \"05ea9268-d162-42c7-b350-9d9715211758\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hg5rk" Sep 09 23:13:04.184114 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:04.183905 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqjm5\" (UniqueName: \"kubernetes.io/projected/05ea9268-d162-42c7-b350-9d9715211758-kube-api-access-rqjm5\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hg5rk\" (UID: \"05ea9268-d162-42c7-b350-9d9715211758\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hg5rk" Sep 09 23:13:04.184114 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:04.183941 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/05ea9268-d162-42c7-b350-9d9715211758-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hg5rk\" (UID: \"05ea9268-d162-42c7-b350-9d9715211758\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hg5rk" Sep 09 23:13:04.184342 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:04.184317 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/05ea9268-d162-42c7-b350-9d9715211758-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hg5rk\" (UID: \"05ea9268-d162-42c7-b350-9d9715211758\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hg5rk" Sep 09 23:13:04.184342 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:04.184333 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/05ea9268-d162-42c7-b350-9d9715211758-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hg5rk\" (UID: \"05ea9268-d162-42c7-b350-9d9715211758\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hg5rk" Sep 09 23:13:04.208248 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:04.208218 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqjm5\" (UniqueName: \"kubernetes.io/projected/05ea9268-d162-42c7-b350-9d9715211758-kube-api-access-rqjm5\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hg5rk\" (UID: \"05ea9268-d162-42c7-b350-9d9715211758\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hg5rk" Sep 09 23:13:04.345768 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:04.345650 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hg5rk" Sep 09 23:13:04.613868 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:04.613839 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hg5rk"] Sep 09 23:13:04.616344 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:13:04.616318 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05ea9268_d162_42c7_b350_9d9715211758.slice/crio-71113c55c900e69d88322a886e59b7c00d28f2f5a3fe729ee2eed3f5bc80ba07 WatchSource:0}: Error finding container 71113c55c900e69d88322a886e59b7c00d28f2f5a3fe729ee2eed3f5bc80ba07: Status 404 returned error can't find the container with id 71113c55c900e69d88322a886e59b7c00d28f2f5a3fe729ee2eed3f5bc80ba07 Sep 09 23:13:05.139511 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:05.139470 2552 generic.go:356] "Generic (PLEG): container finished" podID="05ea9268-d162-42c7-b350-9d9715211758" containerID="af0e56367a720cf23a65def4dc3472cc60cbc4265d3418a1bffbb4df792d9c98" exitCode=0 Sep 09 23:13:05.139966 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:05.139525 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hg5rk" event={"ID":"05ea9268-d162-42c7-b350-9d9715211758","Type":"ContainerDied","Data":"af0e56367a720cf23a65def4dc3472cc60cbc4265d3418a1bffbb4df792d9c98"} Sep 09 23:13:05.139966 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:05.139564 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hg5rk" event={"ID":"05ea9268-d162-42c7-b350-9d9715211758","Type":"ContainerStarted","Data":"71113c55c900e69d88322a886e59b7c00d28f2f5a3fe729ee2eed3f5bc80ba07"} Sep 09 23:13:05.645209 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:05.645172 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-76cbb89f58-d8bwp"] Sep 09 23:13:05.647484 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:05.647466 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-76cbb89f58-d8bwp" Sep 09 23:13:05.650310 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:05.650288 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 09 23:13:05.650436 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:05.650311 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Sep 09 23:13:05.650565 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:05.650544 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Sep 09 23:13:05.650637 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:05.650571 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 09 23:13:05.650850 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:05.650831 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-jprld\"" Sep 09 23:13:05.681977 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:05.680704 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-76cbb89f58-d8bwp"] Sep 09 23:13:05.699353 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:05.699317 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9e630d24-2acd-4d80-86b4-99e0e4707509-webhook-cert\") pod \"opendatahub-operator-controller-manager-76cbb89f58-d8bwp\" (UID: \"9e630d24-2acd-4d80-86b4-99e0e4707509\") " pod="opendatahub/opendatahub-operator-controller-manager-76cbb89f58-d8bwp" Sep 09 23:13:05.699519 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:05.699401 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brt54\" (UniqueName: \"kubernetes.io/projected/9e630d24-2acd-4d80-86b4-99e0e4707509-kube-api-access-brt54\") pod \"opendatahub-operator-controller-manager-76cbb89f58-d8bwp\" (UID: \"9e630d24-2acd-4d80-86b4-99e0e4707509\") " pod="opendatahub/opendatahub-operator-controller-manager-76cbb89f58-d8bwp" Sep 09 23:13:05.699519 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:05.699454 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9e630d24-2acd-4d80-86b4-99e0e4707509-tmp\") pod \"opendatahub-operator-controller-manager-76cbb89f58-d8bwp\" (UID: \"9e630d24-2acd-4d80-86b4-99e0e4707509\") " pod="opendatahub/opendatahub-operator-controller-manager-76cbb89f58-d8bwp" Sep 09 23:13:05.699603 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:05.699521 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9e630d24-2acd-4d80-86b4-99e0e4707509-manifests\") pod \"opendatahub-operator-controller-manager-76cbb89f58-d8bwp\" (UID: \"9e630d24-2acd-4d80-86b4-99e0e4707509\") " pod="opendatahub/opendatahub-operator-controller-manager-76cbb89f58-d8bwp" Sep 09 23:13:05.699603 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:05.699563 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9e630d24-2acd-4d80-86b4-99e0e4707509-apiservice-cert\") pod \"opendatahub-operator-controller-manager-76cbb89f58-d8bwp\" (UID: \"9e630d24-2acd-4d80-86b4-99e0e4707509\") " pod="opendatahub/opendatahub-operator-controller-manager-76cbb89f58-d8bwp" Sep 09 23:13:05.800740 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:05.800709 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9e630d24-2acd-4d80-86b4-99e0e4707509-manifests\") pod \"opendatahub-operator-controller-manager-76cbb89f58-d8bwp\" (UID: \"9e630d24-2acd-4d80-86b4-99e0e4707509\") " pod="opendatahub/opendatahub-operator-controller-manager-76cbb89f58-d8bwp" Sep 09 23:13:05.800901 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:05.800760 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9e630d24-2acd-4d80-86b4-99e0e4707509-apiservice-cert\") pod \"opendatahub-operator-controller-manager-76cbb89f58-d8bwp\" (UID: \"9e630d24-2acd-4d80-86b4-99e0e4707509\") " pod="opendatahub/opendatahub-operator-controller-manager-76cbb89f58-d8bwp" Sep 09 23:13:05.800901 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:05.800869 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9e630d24-2acd-4d80-86b4-99e0e4707509-webhook-cert\") pod \"opendatahub-operator-controller-manager-76cbb89f58-d8bwp\" (UID: \"9e630d24-2acd-4d80-86b4-99e0e4707509\") " pod="opendatahub/opendatahub-operator-controller-manager-76cbb89f58-d8bwp" Sep 09 23:13:05.801028 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:05.800904 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brt54\" (UniqueName: \"kubernetes.io/projected/9e630d24-2acd-4d80-86b4-99e0e4707509-kube-api-access-brt54\") pod \"opendatahub-operator-controller-manager-76cbb89f58-d8bwp\" (UID: \"9e630d24-2acd-4d80-86b4-99e0e4707509\") " pod="opendatahub/opendatahub-operator-controller-manager-76cbb89f58-d8bwp" Sep 09 23:13:05.801028 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:05.800937 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9e630d24-2acd-4d80-86b4-99e0e4707509-tmp\") pod \"opendatahub-operator-controller-manager-76cbb89f58-d8bwp\" (UID: \"9e630d24-2acd-4d80-86b4-99e0e4707509\") " pod="opendatahub/opendatahub-operator-controller-manager-76cbb89f58-d8bwp" Sep 09 23:13:05.801160 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:05.801135 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9e630d24-2acd-4d80-86b4-99e0e4707509-manifests\") pod \"opendatahub-operator-controller-manager-76cbb89f58-d8bwp\" (UID: \"9e630d24-2acd-4d80-86b4-99e0e4707509\") " pod="opendatahub/opendatahub-operator-controller-manager-76cbb89f58-d8bwp" Sep 09 23:13:05.803328 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:05.803302 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9e630d24-2acd-4d80-86b4-99e0e4707509-apiservice-cert\") pod \"opendatahub-operator-controller-manager-76cbb89f58-d8bwp\" (UID: \"9e630d24-2acd-4d80-86b4-99e0e4707509\") " pod="opendatahub/opendatahub-operator-controller-manager-76cbb89f58-d8bwp" Sep 09 23:13:05.803438 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:05.803307 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9e630d24-2acd-4d80-86b4-99e0e4707509-tmp\") pod \"opendatahub-operator-controller-manager-76cbb89f58-d8bwp\" (UID: \"9e630d24-2acd-4d80-86b4-99e0e4707509\") " pod="opendatahub/opendatahub-operator-controller-manager-76cbb89f58-d8bwp" Sep 09 23:13:05.803438 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:05.803362 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9e630d24-2acd-4d80-86b4-99e0e4707509-webhook-cert\") pod \"opendatahub-operator-controller-manager-76cbb89f58-d8bwp\" (UID: \"9e630d24-2acd-4d80-86b4-99e0e4707509\") " pod="opendatahub/opendatahub-operator-controller-manager-76cbb89f58-d8bwp" Sep 09 23:13:05.808470 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:05.808395 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-brt54\" (UniqueName: \"kubernetes.io/projected/9e630d24-2acd-4d80-86b4-99e0e4707509-kube-api-access-brt54\") pod \"opendatahub-operator-controller-manager-76cbb89f58-d8bwp\" (UID: \"9e630d24-2acd-4d80-86b4-99e0e4707509\") " pod="opendatahub/opendatahub-operator-controller-manager-76cbb89f58-d8bwp" Sep 09 23:13:05.957798 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:05.957709 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-76cbb89f58-d8bwp" Sep 09 23:13:06.149821 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:06.149782 2552 generic.go:356] "Generic (PLEG): container finished" podID="05ea9268-d162-42c7-b350-9d9715211758" containerID="e9d8b00ff4cd971b7fd69543a49d7a0907575e30eac9b708b2201c244c10aa43" exitCode=0 Sep 09 23:13:06.150197 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:06.149841 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hg5rk" event={"ID":"05ea9268-d162-42c7-b350-9d9715211758","Type":"ContainerDied","Data":"e9d8b00ff4cd971b7fd69543a49d7a0907575e30eac9b708b2201c244c10aa43"} Sep 09 23:13:06.234025 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:06.233879 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-76cbb89f58-d8bwp"] Sep 09 23:13:06.236389 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:13:06.236361 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e630d24_2acd_4d80_86b4_99e0e4707509.slice/crio-f8d63155c530b05a22b3875b46a49d20b7c4df5eaf5b864d0557cc7cfcdc3ae7 WatchSource:0}: Error finding container f8d63155c530b05a22b3875b46a49d20b7c4df5eaf5b864d0557cc7cfcdc3ae7: Status 404 returned error can't find the container with id f8d63155c530b05a22b3875b46a49d20b7c4df5eaf5b864d0557cc7cfcdc3ae7 Sep 09 23:13:07.157788 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:07.157743 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-76cbb89f58-d8bwp" event={"ID":"9e630d24-2acd-4d80-86b4-99e0e4707509","Type":"ContainerStarted","Data":"f8d63155c530b05a22b3875b46a49d20b7c4df5eaf5b864d0557cc7cfcdc3ae7"} Sep 09 23:13:07.160923 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:07.160880 2552 generic.go:356] "Generic (PLEG): container finished" podID="05ea9268-d162-42c7-b350-9d9715211758" containerID="7ff518749c6e2ac75e853da807e1accc3e20b829d78ac9f12831204f9f7453f5" exitCode=0 Sep 09 23:13:07.161085 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:07.160961 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hg5rk" event={"ID":"05ea9268-d162-42c7-b350-9d9715211758","Type":"ContainerDied","Data":"7ff518749c6e2ac75e853da807e1accc3e20b829d78ac9f12831204f9f7453f5"} Sep 09 23:13:09.559044 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:09.559017 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hg5rk" Sep 09 23:13:09.633833 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:09.633803 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rqjm5\" (UniqueName: \"kubernetes.io/projected/05ea9268-d162-42c7-b350-9d9715211758-kube-api-access-rqjm5\") pod \"05ea9268-d162-42c7-b350-9d9715211758\" (UID: \"05ea9268-d162-42c7-b350-9d9715211758\") " Sep 09 23:13:09.633954 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:09.633904 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/05ea9268-d162-42c7-b350-9d9715211758-util\") pod \"05ea9268-d162-42c7-b350-9d9715211758\" (UID: \"05ea9268-d162-42c7-b350-9d9715211758\") " Sep 09 23:13:09.633954 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:09.633939 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/05ea9268-d162-42c7-b350-9d9715211758-bundle\") pod \"05ea9268-d162-42c7-b350-9d9715211758\" (UID: \"05ea9268-d162-42c7-b350-9d9715211758\") " Sep 09 23:13:09.634655 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:09.634631 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05ea9268-d162-42c7-b350-9d9715211758-bundle" (OuterVolumeSpecName: "bundle") pod "05ea9268-d162-42c7-b350-9d9715211758" (UID: "05ea9268-d162-42c7-b350-9d9715211758"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:13:09.635837 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:09.635800 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05ea9268-d162-42c7-b350-9d9715211758-kube-api-access-rqjm5" (OuterVolumeSpecName: "kube-api-access-rqjm5") pod "05ea9268-d162-42c7-b350-9d9715211758" (UID: "05ea9268-d162-42c7-b350-9d9715211758"). InnerVolumeSpecName "kube-api-access-rqjm5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:13:09.644483 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:09.644452 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05ea9268-d162-42c7-b350-9d9715211758-util" (OuterVolumeSpecName: "util") pod "05ea9268-d162-42c7-b350-9d9715211758" (UID: "05ea9268-d162-42c7-b350-9d9715211758"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:13:09.735065 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:09.735023 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rqjm5\" (UniqueName: \"kubernetes.io/projected/05ea9268-d162-42c7-b350-9d9715211758-kube-api-access-rqjm5\") on node \"ip-10-0-142-217.ec2.internal\" DevicePath \"\"" Sep 09 23:13:09.735065 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:09.735058 2552 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/05ea9268-d162-42c7-b350-9d9715211758-util\") on node \"ip-10-0-142-217.ec2.internal\" DevicePath \"\"" Sep 09 23:13:09.735065 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:09.735070 2552 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/05ea9268-d162-42c7-b350-9d9715211758-bundle\") on node \"ip-10-0-142-217.ec2.internal\" DevicePath \"\"" Sep 09 23:13:10.179664 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:10.179626 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-76cbb89f58-d8bwp" event={"ID":"9e630d24-2acd-4d80-86b4-99e0e4707509","Type":"ContainerStarted","Data":"941de2556c0fff4bcbad014541af42f0e87ed8dfaa861395402af13bbeedc879"} Sep 09 23:13:10.181567 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:10.181539 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hg5rk" event={"ID":"05ea9268-d162-42c7-b350-9d9715211758","Type":"ContainerDied","Data":"71113c55c900e69d88322a886e59b7c00d28f2f5a3fe729ee2eed3f5bc80ba07"} Sep 09 23:13:10.181754 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:10.181581 2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="71113c55c900e69d88322a886e59b7c00d28f2f5a3fe729ee2eed3f5bc80ba07" Sep 09 23:13:10.181754 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:10.181601 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0hg5rk" Sep 09 23:13:11.187899 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:11.187858 2552 generic.go:356] "Generic (PLEG): container finished" podID="9e630d24-2acd-4d80-86b4-99e0e4707509" containerID="941de2556c0fff4bcbad014541af42f0e87ed8dfaa861395402af13bbeedc879" exitCode=0 Sep 09 23:13:11.188331 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:11.187943 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-76cbb89f58-d8bwp" event={"ID":"9e630d24-2acd-4d80-86b4-99e0e4707509","Type":"ContainerDied","Data":"941de2556c0fff4bcbad014541af42f0e87ed8dfaa861395402af13bbeedc879"} Sep 09 23:13:12.195158 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:12.195112 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-76cbb89f58-d8bwp" event={"ID":"9e630d24-2acd-4d80-86b4-99e0e4707509","Type":"ContainerStarted","Data":"1f08ef096fd989118e079224735273ff25404d4f27f11febd1b634308f8710a7"} Sep 09 23:13:12.195544 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:12.195269 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-76cbb89f58-d8bwp" Sep 09 23:13:12.215549 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:12.215484 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-76cbb89f58-d8bwp" podStartSLOduration=2.277351672 podStartE2EDuration="7.215462781s" totalImagesPullingTime="3.746821491s" totalInitContainerRuntime="1.191289618s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:13:05 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:13:12.213590104 +0000 UTC m=+562.729320935" watchObservedRunningTime="2026-09-09 23:13:12.215462781 +0000 UTC m=+562.731193611" Sep 09 23:13:20.613196 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:20.613156 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-fdc8df8cb-4s4fl"] Sep 09 23:13:20.613756 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:20.613731 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05ea9268-d162-42c7-b350-9d9715211758" containerName="util" Sep 09 23:13:20.613867 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:20.613758 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="05ea9268-d162-42c7-b350-9d9715211758" containerName="util" Sep 09 23:13:20.613867 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:20.613785 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05ea9268-d162-42c7-b350-9d9715211758" containerName="extract" Sep 09 23:13:20.613867 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:20.613793 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="05ea9268-d162-42c7-b350-9d9715211758" containerName="extract" Sep 09 23:13:20.613867 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:20.613817 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05ea9268-d162-42c7-b350-9d9715211758" containerName="pull" Sep 09 23:13:20.613867 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:20.613826 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="05ea9268-d162-42c7-b350-9d9715211758" containerName="pull" Sep 09 23:13:20.614094 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:20.613918 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="05ea9268-d162-42c7-b350-9d9715211758" containerName="extract" Sep 09 23:13:20.623946 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:20.623917 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fdc8df8cb-4s4fl" Sep 09 23:13:20.625697 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:20.625615 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-fdc8df8cb-4s4fl"] Sep 09 23:13:20.726462 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:20.726422 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/af8a1e9a-bdbd-4a44-bd1f-df89bd0484b9-console-config\") pod \"console-fdc8df8cb-4s4fl\" (UID: \"af8a1e9a-bdbd-4a44-bd1f-df89bd0484b9\") " pod="openshift-console/console-fdc8df8cb-4s4fl" Sep 09 23:13:20.726462 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:20.726462 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/af8a1e9a-bdbd-4a44-bd1f-df89bd0484b9-console-serving-cert\") pod \"console-fdc8df8cb-4s4fl\" (UID: \"af8a1e9a-bdbd-4a44-bd1f-df89bd0484b9\") " pod="openshift-console/console-fdc8df8cb-4s4fl" Sep 09 23:13:20.726695 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:20.726567 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/af8a1e9a-bdbd-4a44-bd1f-df89bd0484b9-service-ca\") pod \"console-fdc8df8cb-4s4fl\" (UID: \"af8a1e9a-bdbd-4a44-bd1f-df89bd0484b9\") " pod="openshift-console/console-fdc8df8cb-4s4fl" Sep 09 23:13:20.726695 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:20.726595 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af8a1e9a-bdbd-4a44-bd1f-df89bd0484b9-trusted-ca-bundle\") pod \"console-fdc8df8cb-4s4fl\" (UID: \"af8a1e9a-bdbd-4a44-bd1f-df89bd0484b9\") " pod="openshift-console/console-fdc8df8cb-4s4fl" Sep 09 23:13:20.726695 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:20.726616 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/af8a1e9a-bdbd-4a44-bd1f-df89bd0484b9-oauth-serving-cert\") pod \"console-fdc8df8cb-4s4fl\" (UID: \"af8a1e9a-bdbd-4a44-bd1f-df89bd0484b9\") " pod="openshift-console/console-fdc8df8cb-4s4fl" Sep 09 23:13:20.726819 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:20.726665 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/af8a1e9a-bdbd-4a44-bd1f-df89bd0484b9-console-oauth-config\") pod \"console-fdc8df8cb-4s4fl\" (UID: \"af8a1e9a-bdbd-4a44-bd1f-df89bd0484b9\") " pod="openshift-console/console-fdc8df8cb-4s4fl" Sep 09 23:13:20.726819 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:20.726766 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfgrs\" (UniqueName: \"kubernetes.io/projected/af8a1e9a-bdbd-4a44-bd1f-df89bd0484b9-kube-api-access-nfgrs\") pod \"console-fdc8df8cb-4s4fl\" (UID: \"af8a1e9a-bdbd-4a44-bd1f-df89bd0484b9\") " pod="openshift-console/console-fdc8df8cb-4s4fl" Sep 09 23:13:20.827938 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:20.827898 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfgrs\" (UniqueName: \"kubernetes.io/projected/af8a1e9a-bdbd-4a44-bd1f-df89bd0484b9-kube-api-access-nfgrs\") pod \"console-fdc8df8cb-4s4fl\" (UID: \"af8a1e9a-bdbd-4a44-bd1f-df89bd0484b9\") " pod="openshift-console/console-fdc8df8cb-4s4fl" Sep 09 23:13:20.827938 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:20.827949 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/af8a1e9a-bdbd-4a44-bd1f-df89bd0484b9-console-config\") pod \"console-fdc8df8cb-4s4fl\" (UID: \"af8a1e9a-bdbd-4a44-bd1f-df89bd0484b9\") " pod="openshift-console/console-fdc8df8cb-4s4fl" Sep 09 23:13:20.828207 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:20.827968 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/af8a1e9a-bdbd-4a44-bd1f-df89bd0484b9-console-serving-cert\") pod \"console-fdc8df8cb-4s4fl\" (UID: \"af8a1e9a-bdbd-4a44-bd1f-df89bd0484b9\") " pod="openshift-console/console-fdc8df8cb-4s4fl" Sep 09 23:13:20.828207 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:20.828001 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/af8a1e9a-bdbd-4a44-bd1f-df89bd0484b9-service-ca\") pod \"console-fdc8df8cb-4s4fl\" (UID: \"af8a1e9a-bdbd-4a44-bd1f-df89bd0484b9\") " pod="openshift-console/console-fdc8df8cb-4s4fl" Sep 09 23:13:20.828207 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:20.828023 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af8a1e9a-bdbd-4a44-bd1f-df89bd0484b9-trusted-ca-bundle\") pod \"console-fdc8df8cb-4s4fl\" (UID: \"af8a1e9a-bdbd-4a44-bd1f-df89bd0484b9\") " pod="openshift-console/console-fdc8df8cb-4s4fl" Sep 09 23:13:20.828207 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:20.828046 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/af8a1e9a-bdbd-4a44-bd1f-df89bd0484b9-oauth-serving-cert\") pod \"console-fdc8df8cb-4s4fl\" (UID: \"af8a1e9a-bdbd-4a44-bd1f-df89bd0484b9\") " pod="openshift-console/console-fdc8df8cb-4s4fl" Sep 09 23:13:20.828207 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:20.828199 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/af8a1e9a-bdbd-4a44-bd1f-df89bd0484b9-console-oauth-config\") pod \"console-fdc8df8cb-4s4fl\" (UID: \"af8a1e9a-bdbd-4a44-bd1f-df89bd0484b9\") " pod="openshift-console/console-fdc8df8cb-4s4fl" Sep 09 23:13:20.828890 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:20.828860 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/af8a1e9a-bdbd-4a44-bd1f-df89bd0484b9-console-config\") pod \"console-fdc8df8cb-4s4fl\" (UID: \"af8a1e9a-bdbd-4a44-bd1f-df89bd0484b9\") " pod="openshift-console/console-fdc8df8cb-4s4fl" Sep 09 23:13:20.829009 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:20.828895 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/af8a1e9a-bdbd-4a44-bd1f-df89bd0484b9-service-ca\") pod \"console-fdc8df8cb-4s4fl\" (UID: \"af8a1e9a-bdbd-4a44-bd1f-df89bd0484b9\") " pod="openshift-console/console-fdc8df8cb-4s4fl" Sep 09 23:13:20.829009 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:20.828924 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af8a1e9a-bdbd-4a44-bd1f-df89bd0484b9-trusted-ca-bundle\") pod \"console-fdc8df8cb-4s4fl\" (UID: \"af8a1e9a-bdbd-4a44-bd1f-df89bd0484b9\") " pod="openshift-console/console-fdc8df8cb-4s4fl" Sep 09 23:13:20.829115 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:20.829084 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/af8a1e9a-bdbd-4a44-bd1f-df89bd0484b9-oauth-serving-cert\") pod \"console-fdc8df8cb-4s4fl\" (UID: \"af8a1e9a-bdbd-4a44-bd1f-df89bd0484b9\") " pod="openshift-console/console-fdc8df8cb-4s4fl" Sep 09 23:13:20.830632 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:20.830599 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/af8a1e9a-bdbd-4a44-bd1f-df89bd0484b9-console-serving-cert\") pod \"console-fdc8df8cb-4s4fl\" (UID: \"af8a1e9a-bdbd-4a44-bd1f-df89bd0484b9\") " pod="openshift-console/console-fdc8df8cb-4s4fl" Sep 09 23:13:20.830946 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:20.830925 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/af8a1e9a-bdbd-4a44-bd1f-df89bd0484b9-console-oauth-config\") pod \"console-fdc8df8cb-4s4fl\" (UID: \"af8a1e9a-bdbd-4a44-bd1f-df89bd0484b9\") " pod="openshift-console/console-fdc8df8cb-4s4fl" Sep 09 23:13:20.836024 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:20.835999 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfgrs\" (UniqueName: \"kubernetes.io/projected/af8a1e9a-bdbd-4a44-bd1f-df89bd0484b9-kube-api-access-nfgrs\") pod \"console-fdc8df8cb-4s4fl\" (UID: \"af8a1e9a-bdbd-4a44-bd1f-df89bd0484b9\") " pod="openshift-console/console-fdc8df8cb-4s4fl" Sep 09 23:13:20.936416 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:20.936371 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fdc8df8cb-4s4fl" Sep 09 23:13:21.210422 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:21.210398 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-fdc8df8cb-4s4fl"] Sep 09 23:13:21.212809 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:13:21.212775 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf8a1e9a_bdbd_4a44_bd1f_df89bd0484b9.slice/crio-5905c74628e1b265f59af742f65d71595229e1e6e6fa9f466de345448d63148f WatchSource:0}: Error finding container 5905c74628e1b265f59af742f65d71595229e1e6e6fa9f466de345448d63148f: Status 404 returned error can't find the container with id 5905c74628e1b265f59af742f65d71595229e1e6e6fa9f466de345448d63148f Sep 09 23:13:21.240438 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:21.240406 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fdc8df8cb-4s4fl" event={"ID":"af8a1e9a-bdbd-4a44-bd1f-df89bd0484b9","Type":"ContainerStarted","Data":"5905c74628e1b265f59af742f65d71595229e1e6e6fa9f466de345448d63148f"} Sep 09 23:13:22.246473 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:22.246433 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fdc8df8cb-4s4fl" event={"ID":"af8a1e9a-bdbd-4a44-bd1f-df89bd0484b9","Type":"ContainerStarted","Data":"44a39b16e0dcab0f6394f97193bcad6a3aff68f054cf4990b7bbfb748eee39a6"} Sep 09 23:13:22.265114 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:22.265051 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-fdc8df8cb-4s4fl" podStartSLOduration=2.2650357 podStartE2EDuration="2.2650357s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:13:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:13:22.263270991 +0000 UTC m=+572.779001823" watchObservedRunningTime="2026-09-09 23:13:22.2650357 +0000 UTC m=+572.780766530" Sep 09 23:13:22.900025 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:22.899987 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-758bd7d86f-dg882"] Sep 09 23:13:22.907483 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:22.907164 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-758bd7d86f-dg882" Sep 09 23:13:22.909947 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:22.909919 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Sep 09 23:13:22.910122 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:22.910021 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Sep 09 23:13:22.910949 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:22.910915 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Sep 09 23:13:22.911199 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:22.911157 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Sep 09 23:13:22.911340 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:22.911220 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Sep 09 23:13:22.913224 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:22.913197 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-758bd7d86f-dg882"] Sep 09 23:13:22.913536 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:22.913517 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-s2fvs\"" Sep 09 23:13:23.047364 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:23.047329 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6de2084d-26de-475b-a324-023accf768c9-cert\") pod \"lws-controller-manager-758bd7d86f-dg882\" (UID: \"6de2084d-26de-475b-a324-023accf768c9\") " pod="openshift-lws-operator/lws-controller-manager-758bd7d86f-dg882" Sep 09 23:13:23.047364 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:23.047364 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6de2084d-26de-475b-a324-023accf768c9-metrics-cert\") pod \"lws-controller-manager-758bd7d86f-dg882\" (UID: \"6de2084d-26de-475b-a324-023accf768c9\") " pod="openshift-lws-operator/lws-controller-manager-758bd7d86f-dg882" Sep 09 23:13:23.047602 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:23.047394 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6de2084d-26de-475b-a324-023accf768c9-manager-config\") pod \"lws-controller-manager-758bd7d86f-dg882\" (UID: \"6de2084d-26de-475b-a324-023accf768c9\") " pod="openshift-lws-operator/lws-controller-manager-758bd7d86f-dg882" Sep 09 23:13:23.047602 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:23.047494 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4928x\" (UniqueName: \"kubernetes.io/projected/6de2084d-26de-475b-a324-023accf768c9-kube-api-access-4928x\") pod \"lws-controller-manager-758bd7d86f-dg882\" (UID: \"6de2084d-26de-475b-a324-023accf768c9\") " pod="openshift-lws-operator/lws-controller-manager-758bd7d86f-dg882" Sep 09 23:13:23.150100 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:23.149126 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4928x\" (UniqueName: \"kubernetes.io/projected/6de2084d-26de-475b-a324-023accf768c9-kube-api-access-4928x\") pod \"lws-controller-manager-758bd7d86f-dg882\" (UID: \"6de2084d-26de-475b-a324-023accf768c9\") " pod="openshift-lws-operator/lws-controller-manager-758bd7d86f-dg882" Sep 09 23:13:23.150100 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:23.149331 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6de2084d-26de-475b-a324-023accf768c9-cert\") pod \"lws-controller-manager-758bd7d86f-dg882\" (UID: \"6de2084d-26de-475b-a324-023accf768c9\") " pod="openshift-lws-operator/lws-controller-manager-758bd7d86f-dg882" Sep 09 23:13:23.150100 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:23.149382 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6de2084d-26de-475b-a324-023accf768c9-metrics-cert\") pod \"lws-controller-manager-758bd7d86f-dg882\" (UID: \"6de2084d-26de-475b-a324-023accf768c9\") " pod="openshift-lws-operator/lws-controller-manager-758bd7d86f-dg882" Sep 09 23:13:23.150100 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:23.149440 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6de2084d-26de-475b-a324-023accf768c9-manager-config\") pod \"lws-controller-manager-758bd7d86f-dg882\" (UID: \"6de2084d-26de-475b-a324-023accf768c9\") " pod="openshift-lws-operator/lws-controller-manager-758bd7d86f-dg882" Sep 09 23:13:23.150703 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:23.150650 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6de2084d-26de-475b-a324-023accf768c9-manager-config\") pod \"lws-controller-manager-758bd7d86f-dg882\" (UID: \"6de2084d-26de-475b-a324-023accf768c9\") " pod="openshift-lws-operator/lws-controller-manager-758bd7d86f-dg882" Sep 09 23:13:23.153533 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:23.153494 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6de2084d-26de-475b-a324-023accf768c9-metrics-cert\") pod \"lws-controller-manager-758bd7d86f-dg882\" (UID: \"6de2084d-26de-475b-a324-023accf768c9\") " pod="openshift-lws-operator/lws-controller-manager-758bd7d86f-dg882" Sep 09 23:13:23.154263 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:23.154240 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6de2084d-26de-475b-a324-023accf768c9-cert\") pod \"lws-controller-manager-758bd7d86f-dg882\" (UID: \"6de2084d-26de-475b-a324-023accf768c9\") " pod="openshift-lws-operator/lws-controller-manager-758bd7d86f-dg882" Sep 09 23:13:23.157560 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:23.157536 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4928x\" (UniqueName: \"kubernetes.io/projected/6de2084d-26de-475b-a324-023accf768c9-kube-api-access-4928x\") pod \"lws-controller-manager-758bd7d86f-dg882\" (UID: \"6de2084d-26de-475b-a324-023accf768c9\") " pod="openshift-lws-operator/lws-controller-manager-758bd7d86f-dg882" Sep 09 23:13:23.202472 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:23.202438 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-76cbb89f58-d8bwp" Sep 09 23:13:23.218826 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:23.218797 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-758bd7d86f-dg882" Sep 09 23:13:23.503057 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:23.503029 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-758bd7d86f-dg882"] Sep 09 23:13:23.505484 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:13:23.505455 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6de2084d_26de_475b_a324_023accf768c9.slice/crio-a522d57dded2cf05de46c6ffd5afc40e618aad2896b5eae715e75042dd8854f5 WatchSource:0}: Error finding container a522d57dded2cf05de46c6ffd5afc40e618aad2896b5eae715e75042dd8854f5: Status 404 returned error can't find the container with id a522d57dded2cf05de46c6ffd5afc40e618aad2896b5eae715e75042dd8854f5 Sep 09 23:13:24.259950 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:24.259903 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-758bd7d86f-dg882" event={"ID":"6de2084d-26de-475b-a324-023accf768c9","Type":"ContainerStarted","Data":"a522d57dded2cf05de46c6ffd5afc40e618aad2896b5eae715e75042dd8854f5"} Sep 09 23:13:25.267425 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:25.267329 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-758bd7d86f-dg882" event={"ID":"6de2084d-26de-475b-a324-023accf768c9","Type":"ContainerStarted","Data":"e5cee768f83a146f332d00c1d7285ef42665a907e43e506e7c1c158b564181c3"} Sep 09 23:13:25.267861 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:25.267465 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-758bd7d86f-dg882" Sep 09 23:13:25.291521 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:25.291466 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-758bd7d86f-dg882" podStartSLOduration=1.8751650359999998 podStartE2EDuration="3.291450015s" totalImagesPullingTime="1.416284979s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:13:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:13:25.289794318 +0000 UTC m=+575.805525162" watchObservedRunningTime="2026-09-09 23:13:25.291450015 +0000 UTC m=+575.807180844" Sep 09 23:13:30.937460 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:30.937412 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-fdc8df8cb-4s4fl" Sep 09 23:13:30.937888 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:30.937484 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-fdc8df8cb-4s4fl" Sep 09 23:13:30.942253 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:30.942223 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-fdc8df8cb-4s4fl" Sep 09 23:13:31.300323 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:31.300291 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-fdc8df8cb-4s4fl" Sep 09 23:13:31.339850 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:31.339813 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-75b5d6d49b-fj7x2"] Sep 09 23:13:31.509071 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:31.509032 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq"] Sep 09 23:13:31.512843 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:31.512821 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq" Sep 09 23:13:31.515108 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:31.515072 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 09 23:13:31.515263 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:31.515145 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Sep 09 23:13:31.515263 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:31.515201 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 09 23:13:31.515263 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:31.515199 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-dcpxf\"" Sep 09 23:13:31.524478 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:31.524439 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq"] Sep 09 23:13:31.630414 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:31.630380 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4113cbc-3fc0-4c1a-afcb-6cac827f7f71-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq\" (UID: \"d4113cbc-3fc0-4c1a-afcb-6cac827f7f71\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq" Sep 09 23:13:31.630606 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:31.630429 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4113cbc-3fc0-4c1a-afcb-6cac827f7f71-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq\" (UID: \"d4113cbc-3fc0-4c1a-afcb-6cac827f7f71\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq" Sep 09 23:13:31.630606 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:31.630457 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4113cbc-3fc0-4c1a-afcb-6cac827f7f71-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq\" (UID: \"d4113cbc-3fc0-4c1a-afcb-6cac827f7f71\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq" Sep 09 23:13:31.630606 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:31.630524 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4113cbc-3fc0-4c1a-afcb-6cac827f7f71-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq\" (UID: \"d4113cbc-3fc0-4c1a-afcb-6cac827f7f71\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq" Sep 09 23:13:31.630744 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:31.630602 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4113cbc-3fc0-4c1a-afcb-6cac827f7f71-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq\" (UID: \"d4113cbc-3fc0-4c1a-afcb-6cac827f7f71\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq" Sep 09 23:13:31.630744 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:31.630633 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4113cbc-3fc0-4c1a-afcb-6cac827f7f71-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq\" (UID: \"d4113cbc-3fc0-4c1a-afcb-6cac827f7f71\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq" Sep 09 23:13:31.630744 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:31.630723 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4113cbc-3fc0-4c1a-afcb-6cac827f7f71-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq\" (UID: \"d4113cbc-3fc0-4c1a-afcb-6cac827f7f71\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq" Sep 09 23:13:31.630841 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:31.630751 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4113cbc-3fc0-4c1a-afcb-6cac827f7f71-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq\" (UID: \"d4113cbc-3fc0-4c1a-afcb-6cac827f7f71\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq" Sep 09 23:13:31.630841 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:31.630768 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlxgg\" (UniqueName: \"kubernetes.io/projected/d4113cbc-3fc0-4c1a-afcb-6cac827f7f71-kube-api-access-wlxgg\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq\" (UID: \"d4113cbc-3fc0-4c1a-afcb-6cac827f7f71\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq" Sep 09 23:13:31.732128 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:31.732071 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4113cbc-3fc0-4c1a-afcb-6cac827f7f71-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq\" (UID: \"d4113cbc-3fc0-4c1a-afcb-6cac827f7f71\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq" Sep 09 23:13:31.732330 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:31.732140 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4113cbc-3fc0-4c1a-afcb-6cac827f7f71-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq\" (UID: \"d4113cbc-3fc0-4c1a-afcb-6cac827f7f71\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq" Sep 09 23:13:31.732330 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:31.732171 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4113cbc-3fc0-4c1a-afcb-6cac827f7f71-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq\" (UID: \"d4113cbc-3fc0-4c1a-afcb-6cac827f7f71\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq" Sep 09 23:13:31.732330 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:31.732199 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4113cbc-3fc0-4c1a-afcb-6cac827f7f71-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq\" (UID: \"d4113cbc-3fc0-4c1a-afcb-6cac827f7f71\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq" Sep 09 23:13:31.732330 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:31.732233 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4113cbc-3fc0-4c1a-afcb-6cac827f7f71-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq\" (UID: \"d4113cbc-3fc0-4c1a-afcb-6cac827f7f71\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq" Sep 09 23:13:31.732330 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:31.732263 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4113cbc-3fc0-4c1a-afcb-6cac827f7f71-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq\" (UID: \"d4113cbc-3fc0-4c1a-afcb-6cac827f7f71\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq" Sep 09 23:13:31.732330 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:31.732315 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4113cbc-3fc0-4c1a-afcb-6cac827f7f71-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq\" (UID: \"d4113cbc-3fc0-4c1a-afcb-6cac827f7f71\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq" Sep 09 23:13:31.732657 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:31.732349 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4113cbc-3fc0-4c1a-afcb-6cac827f7f71-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq\" (UID: \"d4113cbc-3fc0-4c1a-afcb-6cac827f7f71\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq" Sep 09 23:13:31.732657 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:31.732373 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlxgg\" (UniqueName: \"kubernetes.io/projected/d4113cbc-3fc0-4c1a-afcb-6cac827f7f71-kube-api-access-wlxgg\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq\" (UID: \"d4113cbc-3fc0-4c1a-afcb-6cac827f7f71\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq" Sep 09 23:13:31.732830 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:31.732712 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4113cbc-3fc0-4c1a-afcb-6cac827f7f71-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq\" (UID: \"d4113cbc-3fc0-4c1a-afcb-6cac827f7f71\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq" Sep 09 23:13:31.732958 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:31.732935 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4113cbc-3fc0-4c1a-afcb-6cac827f7f71-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq\" (UID: \"d4113cbc-3fc0-4c1a-afcb-6cac827f7f71\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq" Sep 09 23:13:31.733097 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:31.732980 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4113cbc-3fc0-4c1a-afcb-6cac827f7f71-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq\" (UID: \"d4113cbc-3fc0-4c1a-afcb-6cac827f7f71\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq" Sep 09 23:13:31.733097 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:31.733027 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4113cbc-3fc0-4c1a-afcb-6cac827f7f71-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq\" (UID: \"d4113cbc-3fc0-4c1a-afcb-6cac827f7f71\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq" Sep 09 23:13:31.733266 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:31.733248 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4113cbc-3fc0-4c1a-afcb-6cac827f7f71-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq\" (UID: \"d4113cbc-3fc0-4c1a-afcb-6cac827f7f71\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq" Sep 09 23:13:31.734501 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:31.734480 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4113cbc-3fc0-4c1a-afcb-6cac827f7f71-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq\" (UID: \"d4113cbc-3fc0-4c1a-afcb-6cac827f7f71\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq" Sep 09 23:13:31.734818 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:31.734799 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4113cbc-3fc0-4c1a-afcb-6cac827f7f71-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq\" (UID: \"d4113cbc-3fc0-4c1a-afcb-6cac827f7f71\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq" Sep 09 23:13:31.739829 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:31.739798 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4113cbc-3fc0-4c1a-afcb-6cac827f7f71-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq\" (UID: \"d4113cbc-3fc0-4c1a-afcb-6cac827f7f71\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq" Sep 09 23:13:31.739990 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:31.739974 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlxgg\" (UniqueName: \"kubernetes.io/projected/d4113cbc-3fc0-4c1a-afcb-6cac827f7f71-kube-api-access-wlxgg\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq\" (UID: \"d4113cbc-3fc0-4c1a-afcb-6cac827f7f71\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq" Sep 09 23:13:31.830296 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:31.830255 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq" Sep 09 23:13:32.103635 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:32.103607 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq"] Sep 09 23:13:32.105317 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:13:32.105292 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4113cbc_3fc0_4c1a_afcb_6cac827f7f71.slice/crio-05f469f23eda38112153c3f02a66a7cecd006cf04fbc757575e0dd43733ce13d WatchSource:0}: Error finding container 05f469f23eda38112153c3f02a66a7cecd006cf04fbc757575e0dd43733ce13d: Status 404 returned error can't find the container with id 05f469f23eda38112153c3f02a66a7cecd006cf04fbc757575e0dd43733ce13d Sep 09 23:13:32.302513 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:32.302427 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq" event={"ID":"d4113cbc-3fc0-4c1a-afcb-6cac827f7f71","Type":"ContainerStarted","Data":"05f469f23eda38112153c3f02a66a7cecd006cf04fbc757575e0dd43733ce13d"} Sep 09 23:13:34.966884 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:34.966841 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 09 23:13:34.967265 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:34.966933 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 09 23:13:34.967265 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:34.966985 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 09 23:13:35.323599 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:35.323498 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq" event={"ID":"d4113cbc-3fc0-4c1a-afcb-6cac827f7f71","Type":"ContainerStarted","Data":"f5f07c40a1f814a84974c40723d2cdbd6f751ec972bf8f250b91b998d5c2121b"} Sep 09 23:13:35.341295 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:35.341228 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq" podStartSLOduration=1.482143588 podStartE2EDuration="4.341204578s" totalImagesPullingTime="2.85906099s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:13:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:13:35.339463257 +0000 UTC m=+585.855194087" watchObservedRunningTime="2026-09-09 23:13:35.341204578 +0000 UTC m=+585.856935409" Sep 09 23:13:35.830396 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:35.830331 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq" Sep 09 23:13:36.115432 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:36.115341 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-tvlj6"] Sep 09 23:13:36.119073 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:36.119049 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-tvlj6" Sep 09 23:13:36.121401 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:36.121376 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Sep 09 23:13:36.121557 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:36.121541 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-9cgqn\"" Sep 09 23:13:36.131239 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:36.130564 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-tvlj6"] Sep 09 23:13:36.272152 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:36.272108 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b75a2c8e-3759-44fc-9531-360fec86d829-cert\") pod \"odh-model-controller-7998c67dc4-tvlj6\" (UID: \"b75a2c8e-3759-44fc-9531-360fec86d829\") " pod="opendatahub/odh-model-controller-7998c67dc4-tvlj6" Sep 09 23:13:36.272340 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:36.272197 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgwjb\" (UniqueName: \"kubernetes.io/projected/b75a2c8e-3759-44fc-9531-360fec86d829-kube-api-access-dgwjb\") pod \"odh-model-controller-7998c67dc4-tvlj6\" (UID: \"b75a2c8e-3759-44fc-9531-360fec86d829\") " pod="opendatahub/odh-model-controller-7998c67dc4-tvlj6" Sep 09 23:13:36.274082 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:36.274057 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-758bd7d86f-dg882" Sep 09 23:13:36.373245 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:36.373207 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgwjb\" (UniqueName: \"kubernetes.io/projected/b75a2c8e-3759-44fc-9531-360fec86d829-kube-api-access-dgwjb\") pod \"odh-model-controller-7998c67dc4-tvlj6\" (UID: \"b75a2c8e-3759-44fc-9531-360fec86d829\") " pod="opendatahub/odh-model-controller-7998c67dc4-tvlj6" Sep 09 23:13:36.373436 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:36.373310 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b75a2c8e-3759-44fc-9531-360fec86d829-cert\") pod \"odh-model-controller-7998c67dc4-tvlj6\" (UID: \"b75a2c8e-3759-44fc-9531-360fec86d829\") " pod="opendatahub/odh-model-controller-7998c67dc4-tvlj6" Sep 09 23:13:36.373512 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:13:36.373466 2552 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Sep 09 23:13:36.373564 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:13:36.373526 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b75a2c8e-3759-44fc-9531-360fec86d829-cert podName:b75a2c8e-3759-44fc-9531-360fec86d829 nodeName:}" failed. No retries permitted until 2026-09-09 23:13:36.873510713 +0000 UTC m=+587.389241520 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b75a2c8e-3759-44fc-9531-360fec86d829-cert") pod "odh-model-controller-7998c67dc4-tvlj6" (UID: "b75a2c8e-3759-44fc-9531-360fec86d829") : secret "odh-model-controller-webhook-cert" not found Sep 09 23:13:36.381577 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:36.381547 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgwjb\" (UniqueName: \"kubernetes.io/projected/b75a2c8e-3759-44fc-9531-360fec86d829-kube-api-access-dgwjb\") pod \"odh-model-controller-7998c67dc4-tvlj6\" (UID: \"b75a2c8e-3759-44fc-9531-360fec86d829\") " pod="opendatahub/odh-model-controller-7998c67dc4-tvlj6" Sep 09 23:13:36.717884 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:36.717799 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-5lsl2"] Sep 09 23:13:36.721576 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:36.721550 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-5lsl2" Sep 09 23:13:36.723605 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:36.723581 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Sep 09 23:13:36.730615 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:36.730589 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-5lsl2"] Sep 09 23:13:36.839512 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:36.839479 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq" Sep 09 23:13:36.877747 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:36.877699 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b75a2c8e-3759-44fc-9531-360fec86d829-cert\") pod \"odh-model-controller-7998c67dc4-tvlj6\" (UID: \"b75a2c8e-3759-44fc-9531-360fec86d829\") " pod="opendatahub/odh-model-controller-7998c67dc4-tvlj6" Sep 09 23:13:36.877933 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:36.877765 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a6bdc14-4696-4086-b4a8-ad03f50fdb2b-tls-certs\") pod \"model-serving-api-54d89bd5fc-5lsl2\" (UID: \"2a6bdc14-4696-4086-b4a8-ad03f50fdb2b\") " pod="opendatahub/model-serving-api-54d89bd5fc-5lsl2" Sep 09 23:13:36.877933 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:36.877809 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whcqf\" (UniqueName: \"kubernetes.io/projected/2a6bdc14-4696-4086-b4a8-ad03f50fdb2b-kube-api-access-whcqf\") pod \"model-serving-api-54d89bd5fc-5lsl2\" (UID: \"2a6bdc14-4696-4086-b4a8-ad03f50fdb2b\") " pod="opendatahub/model-serving-api-54d89bd5fc-5lsl2" Sep 09 23:13:36.880197 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:36.880170 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b75a2c8e-3759-44fc-9531-360fec86d829-cert\") pod \"odh-model-controller-7998c67dc4-tvlj6\" (UID: \"b75a2c8e-3759-44fc-9531-360fec86d829\") " pod="opendatahub/odh-model-controller-7998c67dc4-tvlj6" Sep 09 23:13:36.978392 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:36.978291 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a6bdc14-4696-4086-b4a8-ad03f50fdb2b-tls-certs\") pod \"model-serving-api-54d89bd5fc-5lsl2\" (UID: \"2a6bdc14-4696-4086-b4a8-ad03f50fdb2b\") " pod="opendatahub/model-serving-api-54d89bd5fc-5lsl2" Sep 09 23:13:36.978392 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:36.978361 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whcqf\" (UniqueName: \"kubernetes.io/projected/2a6bdc14-4696-4086-b4a8-ad03f50fdb2b-kube-api-access-whcqf\") pod \"model-serving-api-54d89bd5fc-5lsl2\" (UID: \"2a6bdc14-4696-4086-b4a8-ad03f50fdb2b\") " pod="opendatahub/model-serving-api-54d89bd5fc-5lsl2" Sep 09 23:13:36.980770 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:36.980748 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a6bdc14-4696-4086-b4a8-ad03f50fdb2b-tls-certs\") pod \"model-serving-api-54d89bd5fc-5lsl2\" (UID: \"2a6bdc14-4696-4086-b4a8-ad03f50fdb2b\") " pod="opendatahub/model-serving-api-54d89bd5fc-5lsl2" Sep 09 23:13:36.985244 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:36.985223 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whcqf\" (UniqueName: \"kubernetes.io/projected/2a6bdc14-4696-4086-b4a8-ad03f50fdb2b-kube-api-access-whcqf\") pod \"model-serving-api-54d89bd5fc-5lsl2\" (UID: \"2a6bdc14-4696-4086-b4a8-ad03f50fdb2b\") " pod="opendatahub/model-serving-api-54d89bd5fc-5lsl2" Sep 09 23:13:37.029102 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:37.029067 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-tvlj6" Sep 09 23:13:37.033229 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:37.033206 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-5lsl2" Sep 09 23:13:37.301603 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:37.301571 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-tvlj6"] Sep 09 23:13:37.304425 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:13:37.304399 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb75a2c8e_3759_44fc_9531_360fec86d829.slice/crio-1947e55b5adde41b3653eec80d2a1e90e8bd60f90a050da5779a464598a115af WatchSource:0}: Error finding container 1947e55b5adde41b3653eec80d2a1e90e8bd60f90a050da5779a464598a115af: Status 404 returned error can't find the container with id 1947e55b5adde41b3653eec80d2a1e90e8bd60f90a050da5779a464598a115af Sep 09 23:13:37.311186 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:37.311161 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-5lsl2"] Sep 09 23:13:37.313335 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:13:37.313310 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a6bdc14_4696_4086_b4a8_ad03f50fdb2b.slice/crio-5a00d3f00d54c4bbee6fc9fea6c88ea128272ce10e1c05f454d483f63871b862 WatchSource:0}: Error finding container 5a00d3f00d54c4bbee6fc9fea6c88ea128272ce10e1c05f454d483f63871b862: Status 404 returned error can't find the container with id 5a00d3f00d54c4bbee6fc9fea6c88ea128272ce10e1c05f454d483f63871b862 Sep 09 23:13:37.335882 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:37.335847 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-5lsl2" event={"ID":"2a6bdc14-4696-4086-b4a8-ad03f50fdb2b","Type":"ContainerStarted","Data":"5a00d3f00d54c4bbee6fc9fea6c88ea128272ce10e1c05f454d483f63871b862"} Sep 09 23:13:37.337048 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:37.337018 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-tvlj6" event={"ID":"b75a2c8e-3759-44fc-9531-360fec86d829","Type":"ContainerStarted","Data":"1947e55b5adde41b3653eec80d2a1e90e8bd60f90a050da5779a464598a115af"} Sep 09 23:13:37.337280 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:37.337261 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq" Sep 09 23:13:37.338162 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:37.338145 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq" Sep 09 23:13:41.362816 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:41.362707 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-5lsl2" event={"ID":"2a6bdc14-4696-4086-b4a8-ad03f50fdb2b","Type":"ContainerStarted","Data":"da396a209d1c0e189e51c178cdfa0bdb98b355de895c9e279e5e532c5815f998"} Sep 09 23:13:41.362816 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:41.362784 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-5lsl2" Sep 09 23:13:41.364284 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:41.364254 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-tvlj6" event={"ID":"b75a2c8e-3759-44fc-9531-360fec86d829","Type":"ContainerStarted","Data":"5f242caa7106aeb60f4c69b0206c8e94737eddcaed2b36c8f0e7b5a2991085e7"} Sep 09 23:13:41.364416 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:41.364386 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-tvlj6" Sep 09 23:13:41.382520 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:41.382464 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-5lsl2" podStartSLOduration=1.635577639 podStartE2EDuration="5.382449038s" totalImagesPullingTime="3.746871399s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:13:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:13:41.381444016 +0000 UTC m=+591.897174861" watchObservedRunningTime="2026-09-09 23:13:41.382449038 +0000 UTC m=+591.898179867" Sep 09 23:13:41.398485 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:41.398421 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-tvlj6" podStartSLOduration=1.682565663 podStartE2EDuration="5.398405533s" totalImagesPullingTime="3.71583987s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:13:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:13:41.396758803 +0000 UTC m=+591.912489635" watchObservedRunningTime="2026-09-09 23:13:41.398405533 +0000 UTC m=+591.914136363" Sep 09 23:13:45.061259 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:45.061223 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-mbpl5"] Sep 09 23:13:45.065135 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:45.065109 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-mbpl5" Sep 09 23:13:45.067338 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:45.067313 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Sep 09 23:13:45.067490 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:45.067358 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-h6x6p\"" Sep 09 23:13:45.078072 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:45.078046 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-mbpl5"] Sep 09 23:13:45.086882 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:45.086847 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-dpgmr"] Sep 09 23:13:45.091034 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:45.091008 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dpgmr" Sep 09 23:13:45.093331 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:45.093303 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-t7gnx\"" Sep 09 23:13:45.093450 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:45.093431 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Sep 09 23:13:45.099725 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:45.099700 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-dpgmr"] Sep 09 23:13:45.155101 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:45.155066 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qp7fx\" (UniqueName: \"kubernetes.io/projected/ae9a732a-8855-4e82-b4b8-22ad624f4bea-kube-api-access-qp7fx\") pod \"kserve-controller-manager-d6f4b65b8-mbpl5\" (UID: \"ae9a732a-8855-4e82-b4b8-22ad624f4bea\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-mbpl5" Sep 09 23:13:45.155243 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:45.155114 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ae9a732a-8855-4e82-b4b8-22ad624f4bea-cert\") pod \"kserve-controller-manager-d6f4b65b8-mbpl5\" (UID: \"ae9a732a-8855-4e82-b4b8-22ad624f4bea\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-mbpl5" Sep 09 23:13:45.256478 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:45.256437 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qp7fx\" (UniqueName: \"kubernetes.io/projected/ae9a732a-8855-4e82-b4b8-22ad624f4bea-kube-api-access-qp7fx\") pod \"kserve-controller-manager-d6f4b65b8-mbpl5\" (UID: \"ae9a732a-8855-4e82-b4b8-22ad624f4bea\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-mbpl5" Sep 09 23:13:45.256697 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:45.256493 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4c3b6801-892f-49d3-a974-72cebbbe9b07-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-dpgmr\" (UID: \"4c3b6801-892f-49d3-a974-72cebbbe9b07\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dpgmr" Sep 09 23:13:45.256697 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:45.256514 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ae9a732a-8855-4e82-b4b8-22ad624f4bea-cert\") pod \"kserve-controller-manager-d6f4b65b8-mbpl5\" (UID: \"ae9a732a-8855-4e82-b4b8-22ad624f4bea\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-mbpl5" Sep 09 23:13:45.256697 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:45.256536 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fpxl\" (UniqueName: \"kubernetes.io/projected/4c3b6801-892f-49d3-a974-72cebbbe9b07-kube-api-access-2fpxl\") pod \"llmisvc-controller-manager-777c6bd7d5-dpgmr\" (UID: \"4c3b6801-892f-49d3-a974-72cebbbe9b07\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dpgmr" Sep 09 23:13:45.259146 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:45.259120 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ae9a732a-8855-4e82-b4b8-22ad624f4bea-cert\") pod \"kserve-controller-manager-d6f4b65b8-mbpl5\" (UID: \"ae9a732a-8855-4e82-b4b8-22ad624f4bea\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-mbpl5" Sep 09 23:13:45.278575 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:45.278541 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qp7fx\" (UniqueName: \"kubernetes.io/projected/ae9a732a-8855-4e82-b4b8-22ad624f4bea-kube-api-access-qp7fx\") pod \"kserve-controller-manager-d6f4b65b8-mbpl5\" (UID: \"ae9a732a-8855-4e82-b4b8-22ad624f4bea\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-mbpl5" Sep 09 23:13:45.357434 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:45.357342 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fpxl\" (UniqueName: \"kubernetes.io/projected/4c3b6801-892f-49d3-a974-72cebbbe9b07-kube-api-access-2fpxl\") pod \"llmisvc-controller-manager-777c6bd7d5-dpgmr\" (UID: \"4c3b6801-892f-49d3-a974-72cebbbe9b07\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dpgmr" Sep 09 23:13:45.357584 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:45.357441 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4c3b6801-892f-49d3-a974-72cebbbe9b07-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-dpgmr\" (UID: \"4c3b6801-892f-49d3-a974-72cebbbe9b07\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dpgmr" Sep 09 23:13:45.359896 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:45.359872 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4c3b6801-892f-49d3-a974-72cebbbe9b07-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-dpgmr\" (UID: \"4c3b6801-892f-49d3-a974-72cebbbe9b07\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dpgmr" Sep 09 23:13:45.365415 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:45.365388 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fpxl\" (UniqueName: \"kubernetes.io/projected/4c3b6801-892f-49d3-a974-72cebbbe9b07-kube-api-access-2fpxl\") pod \"llmisvc-controller-manager-777c6bd7d5-dpgmr\" (UID: \"4c3b6801-892f-49d3-a974-72cebbbe9b07\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dpgmr" Sep 09 23:13:45.376278 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:45.376247 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-mbpl5" Sep 09 23:13:45.402732 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:45.402698 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dpgmr" Sep 09 23:13:45.675918 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:45.675890 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-mbpl5"] Sep 09 23:13:45.678299 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:13:45.678272 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae9a732a_8855_4e82_b4b8_22ad624f4bea.slice/crio-0e722b8f698dbea9d0da3a182bef3ca440784dae84c76203b920b15152758f93 WatchSource:0}: Error finding container 0e722b8f698dbea9d0da3a182bef3ca440784dae84c76203b920b15152758f93: Status 404 returned error can't find the container with id 0e722b8f698dbea9d0da3a182bef3ca440784dae84c76203b920b15152758f93 Sep 09 23:13:45.706540 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:45.706507 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-dpgmr"] Sep 09 23:13:45.708468 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:13:45.708438 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod4c3b6801_892f_49d3_a974_72cebbbe9b07.slice/crio-564bf2444812d6dffd07e15c4bd4bb18ff241f6d387e7d9e9073ee7c0de44b7e WatchSource:0}: Error finding container 564bf2444812d6dffd07e15c4bd4bb18ff241f6d387e7d9e9073ee7c0de44b7e: Status 404 returned error can't find the container with id 564bf2444812d6dffd07e15c4bd4bb18ff241f6d387e7d9e9073ee7c0de44b7e Sep 09 23:13:46.395987 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:46.395942 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-mbpl5" event={"ID":"ae9a732a-8855-4e82-b4b8-22ad624f4bea","Type":"ContainerStarted","Data":"0e722b8f698dbea9d0da3a182bef3ca440784dae84c76203b920b15152758f93"} Sep 09 23:13:46.397662 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:46.397629 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dpgmr" event={"ID":"4c3b6801-892f-49d3-a974-72cebbbe9b07","Type":"ContainerStarted","Data":"564bf2444812d6dffd07e15c4bd4bb18ff241f6d387e7d9e9073ee7c0de44b7e"} Sep 09 23:13:49.418016 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:49.417970 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-mbpl5" event={"ID":"ae9a732a-8855-4e82-b4b8-22ad624f4bea","Type":"ContainerStarted","Data":"e764d99b43baaa1ca797e5278a2de7eb9d665636510dac7edc13a728c24cf9e0"} Sep 09 23:13:49.418505 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:49.418043 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-mbpl5" Sep 09 23:13:49.419734 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:49.419704 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dpgmr" event={"ID":"4c3b6801-892f-49d3-a974-72cebbbe9b07","Type":"ContainerStarted","Data":"08fec2322f68e66a0cd08b4fdb79afa141f1cd326ded415654c7fa4821fd0434"} Sep 09 23:13:49.419859 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:49.419821 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dpgmr" Sep 09 23:13:49.447416 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:49.447357 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-mbpl5" podStartSLOduration=1.756189979 podStartE2EDuration="4.447336174s" totalImagesPullingTime="2.691146195s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:13:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:13:49.44543283 +0000 UTC m=+599.961163660" watchObservedRunningTime="2026-09-09 23:13:49.447336174 +0000 UTC m=+599.963067007" Sep 09 23:13:49.473713 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:49.473642 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dpgmr" podStartSLOduration=1.808020196 podStartE2EDuration="4.473623258s" totalImagesPullingTime="2.665603062s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:13:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:13:49.471727006 +0000 UTC m=+599.987457835" watchObservedRunningTime="2026-09-09 23:13:49.473623258 +0000 UTC m=+599.989354087" Sep 09 23:13:49.907657 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:49.907626 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-p2dvt_ac335ac0-a272-420f-a215-b93e03772895/console-operator/1.log" Sep 09 23:13:49.907657 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:49.907640 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-p2dvt_ac335ac0-a272-420f-a215-b93e03772895/console-operator/1.log" Sep 09 23:13:49.913867 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:49.913842 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6x9hk_2f52574e-96c0-4939-9826-4959aeae1c8b/ovn-acl-logging/0.log" Sep 09 23:13:49.914030 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:49.913847 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6x9hk_2f52574e-96c0-4939-9826-4959aeae1c8b/ovn-acl-logging/0.log" Sep 09 23:13:52.372797 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:52.372763 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-tvlj6" Sep 09 23:13:52.374974 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:52.374947 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-5lsl2" Sep 09 23:13:56.361957 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:56.361913 2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-75b5d6d49b-fj7x2" podUID="5510cba3-f65e-41ea-a8e7-569989903c88" containerName="console" containerID="cri-o://eaa37fd30044cd3d6fff259d2367e5db18f68fa5570120dd55d15507cb67ce44" gracePeriod=15 Sep 09 23:13:56.607727 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:56.607696 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75b5d6d49b-fj7x2" Sep 09 23:13:56.654953 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:56.654914 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5510cba3-f65e-41ea-a8e7-569989903c88-console-serving-cert\") pod \"5510cba3-f65e-41ea-a8e7-569989903c88\" (UID: \"5510cba3-f65e-41ea-a8e7-569989903c88\") " Sep 09 23:13:56.655156 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:56.654976 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5510cba3-f65e-41ea-a8e7-569989903c88-oauth-serving-cert\") pod \"5510cba3-f65e-41ea-a8e7-569989903c88\" (UID: \"5510cba3-f65e-41ea-a8e7-569989903c88\") " Sep 09 23:13:56.655156 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:56.655007 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5510cba3-f65e-41ea-a8e7-569989903c88-console-oauth-config\") pod \"5510cba3-f65e-41ea-a8e7-569989903c88\" (UID: \"5510cba3-f65e-41ea-a8e7-569989903c88\") " Sep 09 23:13:56.655156 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:56.655116 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5510cba3-f65e-41ea-a8e7-569989903c88-console-config\") pod \"5510cba3-f65e-41ea-a8e7-569989903c88\" (UID: \"5510cba3-f65e-41ea-a8e7-569989903c88\") " Sep 09 23:13:56.655338 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:56.655172 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nqjw8\" (UniqueName: \"kubernetes.io/projected/5510cba3-f65e-41ea-a8e7-569989903c88-kube-api-access-nqjw8\") pod \"5510cba3-f65e-41ea-a8e7-569989903c88\" (UID: \"5510cba3-f65e-41ea-a8e7-569989903c88\") " Sep 09 23:13:56.655338 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:56.655218 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5510cba3-f65e-41ea-a8e7-569989903c88-service-ca\") pod \"5510cba3-f65e-41ea-a8e7-569989903c88\" (UID: \"5510cba3-f65e-41ea-a8e7-569989903c88\") " Sep 09 23:13:56.655338 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:56.655276 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5510cba3-f65e-41ea-a8e7-569989903c88-trusted-ca-bundle\") pod \"5510cba3-f65e-41ea-a8e7-569989903c88\" (UID: \"5510cba3-f65e-41ea-a8e7-569989903c88\") " Sep 09 23:13:56.655506 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:56.655419 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5510cba3-f65e-41ea-a8e7-569989903c88-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5510cba3-f65e-41ea-a8e7-569989903c88" (UID: "5510cba3-f65e-41ea-a8e7-569989903c88"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:13:56.655567 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:56.655469 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5510cba3-f65e-41ea-a8e7-569989903c88-console-config" (OuterVolumeSpecName: "console-config") pod "5510cba3-f65e-41ea-a8e7-569989903c88" (UID: "5510cba3-f65e-41ea-a8e7-569989903c88"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:13:56.655686 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:56.655642 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5510cba3-f65e-41ea-a8e7-569989903c88-service-ca" (OuterVolumeSpecName: "service-ca") pod "5510cba3-f65e-41ea-a8e7-569989903c88" (UID: "5510cba3-f65e-41ea-a8e7-569989903c88"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:13:56.655686 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:56.655666 2552 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5510cba3-f65e-41ea-a8e7-569989903c88-oauth-serving-cert\") on node \"ip-10-0-142-217.ec2.internal\" DevicePath \"\"" Sep 09 23:13:56.655871 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:56.655700 2552 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5510cba3-f65e-41ea-a8e7-569989903c88-console-config\") on node \"ip-10-0-142-217.ec2.internal\" DevicePath \"\"" Sep 09 23:13:56.655871 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:56.655755 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5510cba3-f65e-41ea-a8e7-569989903c88-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "5510cba3-f65e-41ea-a8e7-569989903c88" (UID: "5510cba3-f65e-41ea-a8e7-569989903c88"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:13:56.657289 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:56.657264 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5510cba3-f65e-41ea-a8e7-569989903c88-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5510cba3-f65e-41ea-a8e7-569989903c88" (UID: "5510cba3-f65e-41ea-a8e7-569989903c88"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:13:56.657399 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:56.657291 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5510cba3-f65e-41ea-a8e7-569989903c88-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5510cba3-f65e-41ea-a8e7-569989903c88" (UID: "5510cba3-f65e-41ea-a8e7-569989903c88"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:13:56.657399 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:56.657372 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5510cba3-f65e-41ea-a8e7-569989903c88-kube-api-access-nqjw8" (OuterVolumeSpecName: "kube-api-access-nqjw8") pod "5510cba3-f65e-41ea-a8e7-569989903c88" (UID: "5510cba3-f65e-41ea-a8e7-569989903c88"). InnerVolumeSpecName "kube-api-access-nqjw8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:13:56.756733 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:56.756666 2552 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5510cba3-f65e-41ea-a8e7-569989903c88-console-oauth-config\") on node \"ip-10-0-142-217.ec2.internal\" DevicePath \"\"" Sep 09 23:13:56.756733 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:56.756729 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nqjw8\" (UniqueName: \"kubernetes.io/projected/5510cba3-f65e-41ea-a8e7-569989903c88-kube-api-access-nqjw8\") on node \"ip-10-0-142-217.ec2.internal\" DevicePath \"\"" Sep 09 23:13:56.756733 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:56.756741 2552 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5510cba3-f65e-41ea-a8e7-569989903c88-service-ca\") on node \"ip-10-0-142-217.ec2.internal\" DevicePath \"\"" Sep 09 23:13:56.756971 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:56.756750 2552 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5510cba3-f65e-41ea-a8e7-569989903c88-trusted-ca-bundle\") on node \"ip-10-0-142-217.ec2.internal\" DevicePath \"\"" Sep 09 23:13:56.756971 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:56.756759 2552 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5510cba3-f65e-41ea-a8e7-569989903c88-console-serving-cert\") on node \"ip-10-0-142-217.ec2.internal\" DevicePath \"\"" Sep 09 23:13:57.463818 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:57.463780 2552 generic.go:356] "Generic (PLEG): container finished" podID="5510cba3-f65e-41ea-a8e7-569989903c88" containerID="eaa37fd30044cd3d6fff259d2367e5db18f68fa5570120dd55d15507cb67ce44" exitCode=0 Sep 09 23:13:57.464222 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:57.463844 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75b5d6d49b-fj7x2" event={"ID":"5510cba3-f65e-41ea-a8e7-569989903c88","Type":"ContainerDied","Data":"eaa37fd30044cd3d6fff259d2367e5db18f68fa5570120dd55d15507cb67ce44"} Sep 09 23:13:57.464222 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:57.463849 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75b5d6d49b-fj7x2" Sep 09 23:13:57.464222 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:57.463883 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75b5d6d49b-fj7x2" event={"ID":"5510cba3-f65e-41ea-a8e7-569989903c88","Type":"ContainerDied","Data":"36ce827d3098f1c3f4b1bcb0948a7c7b3289835fdee68be59d24883e4ee74351"} Sep 09 23:13:57.464222 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:57.463903 2552 scope.go:117] "RemoveContainer" containerID="eaa37fd30044cd3d6fff259d2367e5db18f68fa5570120dd55d15507cb67ce44" Sep 09 23:13:57.474083 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:57.474062 2552 scope.go:117] "RemoveContainer" containerID="eaa37fd30044cd3d6fff259d2367e5db18f68fa5570120dd55d15507cb67ce44" Sep 09 23:13:57.474407 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:13:57.474386 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eaa37fd30044cd3d6fff259d2367e5db18f68fa5570120dd55d15507cb67ce44\": container with ID starting with eaa37fd30044cd3d6fff259d2367e5db18f68fa5570120dd55d15507cb67ce44 not found: ID does not exist" containerID="eaa37fd30044cd3d6fff259d2367e5db18f68fa5570120dd55d15507cb67ce44" Sep 09 23:13:57.474460 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:57.474416 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eaa37fd30044cd3d6fff259d2367e5db18f68fa5570120dd55d15507cb67ce44"} err="failed to get container status \"eaa37fd30044cd3d6fff259d2367e5db18f68fa5570120dd55d15507cb67ce44\": rpc error: code = NotFound desc = could not find container \"eaa37fd30044cd3d6fff259d2367e5db18f68fa5570120dd55d15507cb67ce44\": container with ID starting with eaa37fd30044cd3d6fff259d2367e5db18f68fa5570120dd55d15507cb67ce44 not found: ID does not exist" Sep 09 23:13:57.488020 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:57.487981 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-75b5d6d49b-fj7x2"] Sep 09 23:13:57.489957 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:57.489933 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-75b5d6d49b-fj7x2"] Sep 09 23:13:57.938782 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:13:57.938740 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5510cba3-f65e-41ea-a8e7-569989903c88" path="/var/lib/kubelet/pods/5510cba3-f65e-41ea-a8e7-569989903c88/volumes" Sep 09 23:14:20.426950 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:20.426863 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dpgmr" Sep 09 23:14:20.430413 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:20.430384 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-mbpl5" Sep 09 23:14:40.360354 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:40.360317 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6qtxtz"] Sep 09 23:14:40.360783 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:40.360694 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5510cba3-f65e-41ea-a8e7-569989903c88" containerName="console" Sep 09 23:14:40.360783 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:40.360707 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="5510cba3-f65e-41ea-a8e7-569989903c88" containerName="console" Sep 09 23:14:40.360783 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:40.360767 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="5510cba3-f65e-41ea-a8e7-569989903c88" containerName="console" Sep 09 23:14:40.365721 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:40.365697 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6qtxtz" Sep 09 23:14:40.368094 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:40.368068 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 09 23:14:40.368866 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:40.368841 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-q2nl8\"" Sep 09 23:14:40.369144 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:40.369124 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 09 23:14:40.371768 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:40.371743 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6qtxtz"] Sep 09 23:14:40.446734 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:40.446663 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b538fd45-d744-49ca-94b5-86943050e168-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6qtxtz\" (UID: \"b538fd45-d744-49ca-94b5-86943050e168\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6qtxtz" Sep 09 23:14:40.446923 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:40.446804 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-926vf\" (UniqueName: \"kubernetes.io/projected/b538fd45-d744-49ca-94b5-86943050e168-kube-api-access-926vf\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6qtxtz\" (UID: \"b538fd45-d744-49ca-94b5-86943050e168\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6qtxtz" Sep 09 23:14:40.446923 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:40.446849 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b538fd45-d744-49ca-94b5-86943050e168-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6qtxtz\" (UID: \"b538fd45-d744-49ca-94b5-86943050e168\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6qtxtz" Sep 09 23:14:40.459823 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:40.459786 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar56bs"] Sep 09 23:14:40.462599 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:40.462581 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar56bs" Sep 09 23:14:40.471230 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:40.471201 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar56bs"] Sep 09 23:14:40.547538 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:40.547503 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b538fd45-d744-49ca-94b5-86943050e168-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6qtxtz\" (UID: \"b538fd45-d744-49ca-94b5-86943050e168\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6qtxtz" Sep 09 23:14:40.547773 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:40.547558 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c5ef5eee-0044-4738-9a24-edd6a8bde823-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar56bs\" (UID: \"c5ef5eee-0044-4738-9a24-edd6a8bde823\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar56bs" Sep 09 23:14:40.547773 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:40.547617 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-926vf\" (UniqueName: \"kubernetes.io/projected/b538fd45-d744-49ca-94b5-86943050e168-kube-api-access-926vf\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6qtxtz\" (UID: \"b538fd45-d744-49ca-94b5-86943050e168\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6qtxtz" Sep 09 23:14:40.547773 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:40.547639 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c5ef5eee-0044-4738-9a24-edd6a8bde823-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar56bs\" (UID: \"c5ef5eee-0044-4738-9a24-edd6a8bde823\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar56bs" Sep 09 23:14:40.547773 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:40.547658 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b538fd45-d744-49ca-94b5-86943050e168-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6qtxtz\" (UID: \"b538fd45-d744-49ca-94b5-86943050e168\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6qtxtz" Sep 09 23:14:40.547979 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:40.547811 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzcch\" (UniqueName: \"kubernetes.io/projected/c5ef5eee-0044-4738-9a24-edd6a8bde823-kube-api-access-mzcch\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar56bs\" (UID: \"c5ef5eee-0044-4738-9a24-edd6a8bde823\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar56bs" Sep 09 23:14:40.547979 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:40.547966 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b538fd45-d744-49ca-94b5-86943050e168-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6qtxtz\" (UID: \"b538fd45-d744-49ca-94b5-86943050e168\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6qtxtz" Sep 09 23:14:40.548080 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:40.548010 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b538fd45-d744-49ca-94b5-86943050e168-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6qtxtz\" (UID: \"b538fd45-d744-49ca-94b5-86943050e168\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6qtxtz" Sep 09 23:14:40.556707 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:40.556655 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-926vf\" (UniqueName: \"kubernetes.io/projected/b538fd45-d744-49ca-94b5-86943050e168-kube-api-access-926vf\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6qtxtz\" (UID: \"b538fd45-d744-49ca-94b5-86943050e168\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6qtxtz" Sep 09 23:14:40.562015 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:40.561982 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7crspl"] Sep 09 23:14:40.565417 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:40.565395 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7crspl" Sep 09 23:14:40.571727 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:40.571697 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7crspl"] Sep 09 23:14:40.648645 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:40.648606 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c5ef5eee-0044-4738-9a24-edd6a8bde823-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar56bs\" (UID: \"c5ef5eee-0044-4738-9a24-edd6a8bde823\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar56bs" Sep 09 23:14:40.648846 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:40.648663 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4dd7a889-0b53-4ccb-8de0-861359fad310-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7crspl\" (UID: \"4dd7a889-0b53-4ccb-8de0-861359fad310\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7crspl" Sep 09 23:14:40.648846 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:40.648725 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c5ef5eee-0044-4738-9a24-edd6a8bde823-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar56bs\" (UID: \"c5ef5eee-0044-4738-9a24-edd6a8bde823\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar56bs" Sep 09 23:14:40.648846 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:40.648744 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ht7hn\" (UniqueName: \"kubernetes.io/projected/4dd7a889-0b53-4ccb-8de0-861359fad310-kube-api-access-ht7hn\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7crspl\" (UID: \"4dd7a889-0b53-4ccb-8de0-861359fad310\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7crspl" Sep 09 23:14:40.648966 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:40.648943 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzcch\" (UniqueName: \"kubernetes.io/projected/c5ef5eee-0044-4738-9a24-edd6a8bde823-kube-api-access-mzcch\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar56bs\" (UID: \"c5ef5eee-0044-4738-9a24-edd6a8bde823\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar56bs" Sep 09 23:14:40.649039 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:40.649020 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4dd7a889-0b53-4ccb-8de0-861359fad310-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7crspl\" (UID: \"4dd7a889-0b53-4ccb-8de0-861359fad310\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7crspl" Sep 09 23:14:40.649117 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:40.649101 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c5ef5eee-0044-4738-9a24-edd6a8bde823-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar56bs\" (UID: \"c5ef5eee-0044-4738-9a24-edd6a8bde823\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar56bs" Sep 09 23:14:40.649159 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:40.649120 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c5ef5eee-0044-4738-9a24-edd6a8bde823-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar56bs\" (UID: \"c5ef5eee-0044-4738-9a24-edd6a8bde823\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar56bs" Sep 09 23:14:40.658841 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:40.658809 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzcch\" (UniqueName: \"kubernetes.io/projected/c5ef5eee-0044-4738-9a24-edd6a8bde823-kube-api-access-mzcch\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar56bs\" (UID: \"c5ef5eee-0044-4738-9a24-edd6a8bde823\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar56bs" Sep 09 23:14:40.666172 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:40.666138 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5jncr"] Sep 09 23:14:40.668880 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:40.668862 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5jncr" Sep 09 23:14:40.677336 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:40.677308 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6qtxtz" Sep 09 23:14:40.681834 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:40.681804 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5jncr"] Sep 09 23:14:40.750589 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:40.750546 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4dd7a889-0b53-4ccb-8de0-861359fad310-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7crspl\" (UID: \"4dd7a889-0b53-4ccb-8de0-861359fad310\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7crspl" Sep 09 23:14:40.750748 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:40.750605 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ht7hn\" (UniqueName: \"kubernetes.io/projected/4dd7a889-0b53-4ccb-8de0-861359fad310-kube-api-access-ht7hn\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7crspl\" (UID: \"4dd7a889-0b53-4ccb-8de0-861359fad310\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7crspl" Sep 09 23:14:40.750748 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:40.750651 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3e795867-9433-4ec0-8d06-06cd95f72962-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5jncr\" (UID: \"3e795867-9433-4ec0-8d06-06cd95f72962\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5jncr" Sep 09 23:14:40.750748 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:40.750711 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3e795867-9433-4ec0-8d06-06cd95f72962-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5jncr\" (UID: \"3e795867-9433-4ec0-8d06-06cd95f72962\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5jncr" Sep 09 23:14:40.750748 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:40.750737 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56x77\" (UniqueName: \"kubernetes.io/projected/3e795867-9433-4ec0-8d06-06cd95f72962-kube-api-access-56x77\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5jncr\" (UID: \"3e795867-9433-4ec0-8d06-06cd95f72962\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5jncr" Sep 09 23:14:40.750909 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:40.750829 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4dd7a889-0b53-4ccb-8de0-861359fad310-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7crspl\" (UID: \"4dd7a889-0b53-4ccb-8de0-861359fad310\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7crspl" Sep 09 23:14:40.750948 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:40.750928 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4dd7a889-0b53-4ccb-8de0-861359fad310-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7crspl\" (UID: \"4dd7a889-0b53-4ccb-8de0-861359fad310\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7crspl" Sep 09 23:14:40.751180 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:40.751161 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4dd7a889-0b53-4ccb-8de0-861359fad310-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7crspl\" (UID: \"4dd7a889-0b53-4ccb-8de0-861359fad310\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7crspl" Sep 09 23:14:40.760659 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:40.760625 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ht7hn\" (UniqueName: \"kubernetes.io/projected/4dd7a889-0b53-4ccb-8de0-861359fad310-kube-api-access-ht7hn\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7crspl\" (UID: \"4dd7a889-0b53-4ccb-8de0-861359fad310\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7crspl" Sep 09 23:14:40.773199 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:40.773162 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar56bs" Sep 09 23:14:40.852033 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:40.851999 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3e795867-9433-4ec0-8d06-06cd95f72962-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5jncr\" (UID: \"3e795867-9433-4ec0-8d06-06cd95f72962\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5jncr" Sep 09 23:14:40.852213 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:40.852044 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3e795867-9433-4ec0-8d06-06cd95f72962-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5jncr\" (UID: \"3e795867-9433-4ec0-8d06-06cd95f72962\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5jncr" Sep 09 23:14:40.852213 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:40.852073 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56x77\" (UniqueName: \"kubernetes.io/projected/3e795867-9433-4ec0-8d06-06cd95f72962-kube-api-access-56x77\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5jncr\" (UID: \"3e795867-9433-4ec0-8d06-06cd95f72962\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5jncr" Sep 09 23:14:40.852478 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:40.852444 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3e795867-9433-4ec0-8d06-06cd95f72962-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5jncr\" (UID: \"3e795867-9433-4ec0-8d06-06cd95f72962\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5jncr" Sep 09 23:14:40.852606 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:40.852494 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3e795867-9433-4ec0-8d06-06cd95f72962-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5jncr\" (UID: \"3e795867-9433-4ec0-8d06-06cd95f72962\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5jncr" Sep 09 23:14:40.861958 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:40.861925 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-56x77\" (UniqueName: \"kubernetes.io/projected/3e795867-9433-4ec0-8d06-06cd95f72962-kube-api-access-56x77\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5jncr\" (UID: \"3e795867-9433-4ec0-8d06-06cd95f72962\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5jncr" Sep 09 23:14:40.876720 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:40.876663 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7crspl" Sep 09 23:14:40.955297 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:40.955255 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6qtxtz"] Sep 09 23:14:40.956897 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:14:40.956869 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb538fd45_d744_49ca_94b5_86943050e168.slice/crio-432b4549e3560b7bce61d68fa6ee4aca9fff59d738bb1867c6a32a5a787eb5df WatchSource:0}: Error finding container 432b4549e3560b7bce61d68fa6ee4aca9fff59d738bb1867c6a32a5a787eb5df: Status 404 returned error can't find the container with id 432b4549e3560b7bce61d68fa6ee4aca9fff59d738bb1867c6a32a5a787eb5df Sep 09 23:14:40.978111 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:40.978087 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5jncr" Sep 09 23:14:41.043735 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:41.043704 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar56bs"] Sep 09 23:14:41.045335 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:14:41.045304 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5ef5eee_0044_4738_9a24_edd6a8bde823.slice/crio-12f6574e791c5b939e977c662f9bda6041ab3fce9b494b9a24641183b98aae58 WatchSource:0}: Error finding container 12f6574e791c5b939e977c662f9bda6041ab3fce9b494b9a24641183b98aae58: Status 404 returned error can't find the container with id 12f6574e791c5b939e977c662f9bda6041ab3fce9b494b9a24641183b98aae58 Sep 09 23:14:41.147594 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:41.147557 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7crspl"] Sep 09 23:14:41.157831 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:14:41.157800 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4dd7a889_0b53_4ccb_8de0_861359fad310.slice/crio-b9817c6b936981e18d7e696e9fc0bfa24fe435a3aa1c3a18b346b7de8a347e64 WatchSource:0}: Error finding container b9817c6b936981e18d7e696e9fc0bfa24fe435a3aa1c3a18b346b7de8a347e64: Status 404 returned error can't find the container with id b9817c6b936981e18d7e696e9fc0bfa24fe435a3aa1c3a18b346b7de8a347e64 Sep 09 23:14:41.253923 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:41.253763 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5jncr"] Sep 09 23:14:41.286724 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:14:41.286681 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e795867_9433_4ec0_8d06_06cd95f72962.slice/crio-4da40d4b24a02a4c8e48957505d97a7f2a54192cabb46c201c004ec3c76db85a WatchSource:0}: Error finding container 4da40d4b24a02a4c8e48957505d97a7f2a54192cabb46c201c004ec3c76db85a: Status 404 returned error can't find the container with id 4da40d4b24a02a4c8e48957505d97a7f2a54192cabb46c201c004ec3c76db85a Sep 09 23:14:41.692811 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:41.692769 2552 generic.go:356] "Generic (PLEG): container finished" podID="c5ef5eee-0044-4738-9a24-edd6a8bde823" containerID="371aedc14e382c60b8e391a3bff21e52c18dfa0ba3af12d80789b89dd0afe296" exitCode=0 Sep 09 23:14:41.693323 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:41.692855 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar56bs" event={"ID":"c5ef5eee-0044-4738-9a24-edd6a8bde823","Type":"ContainerDied","Data":"371aedc14e382c60b8e391a3bff21e52c18dfa0ba3af12d80789b89dd0afe296"} Sep 09 23:14:41.693323 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:41.692939 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar56bs" event={"ID":"c5ef5eee-0044-4738-9a24-edd6a8bde823","Type":"ContainerStarted","Data":"12f6574e791c5b939e977c662f9bda6041ab3fce9b494b9a24641183b98aae58"} Sep 09 23:14:41.694688 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:41.694646 2552 generic.go:356] "Generic (PLEG): container finished" podID="3e795867-9433-4ec0-8d06-06cd95f72962" containerID="491db04b7f8c2f921cab6c0818e22f1042c75b5d6dc85ae0f07a294a2d1f4452" exitCode=0 Sep 09 23:14:41.694794 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:41.694702 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5jncr" event={"ID":"3e795867-9433-4ec0-8d06-06cd95f72962","Type":"ContainerDied","Data":"491db04b7f8c2f921cab6c0818e22f1042c75b5d6dc85ae0f07a294a2d1f4452"} Sep 09 23:14:41.694794 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:41.694753 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5jncr" event={"ID":"3e795867-9433-4ec0-8d06-06cd95f72962","Type":"ContainerStarted","Data":"4da40d4b24a02a4c8e48957505d97a7f2a54192cabb46c201c004ec3c76db85a"} Sep 09 23:14:41.696547 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:41.696521 2552 generic.go:356] "Generic (PLEG): container finished" podID="4dd7a889-0b53-4ccb-8de0-861359fad310" containerID="ce9074537770d7b17c641ff3421a990168865c210299f5484326c66601527b5c" exitCode=0 Sep 09 23:14:41.696637 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:41.696600 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7crspl" event={"ID":"4dd7a889-0b53-4ccb-8de0-861359fad310","Type":"ContainerDied","Data":"ce9074537770d7b17c641ff3421a990168865c210299f5484326c66601527b5c"} Sep 09 23:14:41.696787 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:41.696658 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7crspl" event={"ID":"4dd7a889-0b53-4ccb-8de0-861359fad310","Type":"ContainerStarted","Data":"b9817c6b936981e18d7e696e9fc0bfa24fe435a3aa1c3a18b346b7de8a347e64"} Sep 09 23:14:41.698380 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:41.698359 2552 generic.go:356] "Generic (PLEG): container finished" podID="b538fd45-d744-49ca-94b5-86943050e168" containerID="1f621a7219e18805c16cfaeda202d958153ace0929c8c1cce6cf3ac1a243dbc8" exitCode=0 Sep 09 23:14:41.698476 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:41.698440 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6qtxtz" event={"ID":"b538fd45-d744-49ca-94b5-86943050e168","Type":"ContainerDied","Data":"1f621a7219e18805c16cfaeda202d958153ace0929c8c1cce6cf3ac1a243dbc8"} Sep 09 23:14:41.698551 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:41.698483 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6qtxtz" event={"ID":"b538fd45-d744-49ca-94b5-86943050e168","Type":"ContainerStarted","Data":"432b4549e3560b7bce61d68fa6ee4aca9fff59d738bb1867c6a32a5a787eb5df"} Sep 09 23:14:42.711427 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:42.711337 2552 generic.go:356] "Generic (PLEG): container finished" podID="b538fd45-d744-49ca-94b5-86943050e168" containerID="d1fcbcf6151cde696728c52bd270912074fced3908898d2ce629c9d5cb4b5912" exitCode=0 Sep 09 23:14:42.711825 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:42.711418 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6qtxtz" event={"ID":"b538fd45-d744-49ca-94b5-86943050e168","Type":"ContainerDied","Data":"d1fcbcf6151cde696728c52bd270912074fced3908898d2ce629c9d5cb4b5912"} Sep 09 23:14:43.724301 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:43.724263 2552 generic.go:356] "Generic (PLEG): container finished" podID="c5ef5eee-0044-4738-9a24-edd6a8bde823" containerID="0c9d26cc13cd4e01c9a51ef21f4d105f3a337a7341ccd7dd6b81d79fbba4aadd" exitCode=0 Sep 09 23:14:43.724771 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:43.724347 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar56bs" event={"ID":"c5ef5eee-0044-4738-9a24-edd6a8bde823","Type":"ContainerDied","Data":"0c9d26cc13cd4e01c9a51ef21f4d105f3a337a7341ccd7dd6b81d79fbba4aadd"} Sep 09 23:14:43.726350 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:43.726327 2552 generic.go:356] "Generic (PLEG): container finished" podID="3e795867-9433-4ec0-8d06-06cd95f72962" containerID="7e4e9fd2f813cb6f7008b8ea286201f7f13ead1d9dd45a7abfbe54bbc7cdf0e5" exitCode=0 Sep 09 23:14:43.726445 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:43.726423 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5jncr" event={"ID":"3e795867-9433-4ec0-8d06-06cd95f72962","Type":"ContainerDied","Data":"7e4e9fd2f813cb6f7008b8ea286201f7f13ead1d9dd45a7abfbe54bbc7cdf0e5"} Sep 09 23:14:43.728426 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:43.728404 2552 generic.go:356] "Generic (PLEG): container finished" podID="4dd7a889-0b53-4ccb-8de0-861359fad310" containerID="5906707ec03942b76b76e249d5a438a77db8e60aa79bb5076deed731b088b9ef" exitCode=0 Sep 09 23:14:43.728501 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:43.728469 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7crspl" event={"ID":"4dd7a889-0b53-4ccb-8de0-861359fad310","Type":"ContainerDied","Data":"5906707ec03942b76b76e249d5a438a77db8e60aa79bb5076deed731b088b9ef"} Sep 09 23:14:43.730819 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:43.730796 2552 generic.go:356] "Generic (PLEG): container finished" podID="b538fd45-d744-49ca-94b5-86943050e168" containerID="ceade079e8d50dae52f3e8ad66453aa97f88bfc0e122a3354dc31b94275d88df" exitCode=0 Sep 09 23:14:43.730925 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:43.730868 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6qtxtz" event={"ID":"b538fd45-d744-49ca-94b5-86943050e168","Type":"ContainerDied","Data":"ceade079e8d50dae52f3e8ad66453aa97f88bfc0e122a3354dc31b94275d88df"} Sep 09 23:14:44.739232 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:44.739196 2552 generic.go:356] "Generic (PLEG): container finished" podID="c5ef5eee-0044-4738-9a24-edd6a8bde823" containerID="b657db8845fffa405b6f2f7548c00b80b088be5c83fed4f1e6c4c431d21a682d" exitCode=0 Sep 09 23:14:44.739720 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:44.739288 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar56bs" event={"ID":"c5ef5eee-0044-4738-9a24-edd6a8bde823","Type":"ContainerDied","Data":"b657db8845fffa405b6f2f7548c00b80b088be5c83fed4f1e6c4c431d21a682d"} Sep 09 23:14:44.741552 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:44.741526 2552 generic.go:356] "Generic (PLEG): container finished" podID="3e795867-9433-4ec0-8d06-06cd95f72962" containerID="4e59e405497f38b11f86b804af72b8241cc49fa3f47fea9850a691df44014a30" exitCode=0 Sep 09 23:14:44.741705 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:44.741607 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5jncr" event={"ID":"3e795867-9433-4ec0-8d06-06cd95f72962","Type":"ContainerDied","Data":"4e59e405497f38b11f86b804af72b8241cc49fa3f47fea9850a691df44014a30"} Sep 09 23:14:44.743896 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:44.743873 2552 generic.go:356] "Generic (PLEG): container finished" podID="4dd7a889-0b53-4ccb-8de0-861359fad310" containerID="55e922ff38e6020b8117cb6da9fd8e0a89b4039e2e5dfd1c7f7e016f457ef516" exitCode=0 Sep 09 23:14:44.743996 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:44.743953 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7crspl" event={"ID":"4dd7a889-0b53-4ccb-8de0-861359fad310","Type":"ContainerDied","Data":"55e922ff38e6020b8117cb6da9fd8e0a89b4039e2e5dfd1c7f7e016f457ef516"} Sep 09 23:14:44.878229 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:44.878200 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6qtxtz" Sep 09 23:14:44.988374 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:44.988315 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b538fd45-d744-49ca-94b5-86943050e168-util\") pod \"b538fd45-d744-49ca-94b5-86943050e168\" (UID: \"b538fd45-d744-49ca-94b5-86943050e168\") " Sep 09 23:14:44.988583 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:44.988407 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b538fd45-d744-49ca-94b5-86943050e168-bundle\") pod \"b538fd45-d744-49ca-94b5-86943050e168\" (UID: \"b538fd45-d744-49ca-94b5-86943050e168\") " Sep 09 23:14:44.988583 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:44.988446 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-926vf\" (UniqueName: \"kubernetes.io/projected/b538fd45-d744-49ca-94b5-86943050e168-kube-api-access-926vf\") pod \"b538fd45-d744-49ca-94b5-86943050e168\" (UID: \"b538fd45-d744-49ca-94b5-86943050e168\") " Sep 09 23:14:44.989033 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:44.989001 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b538fd45-d744-49ca-94b5-86943050e168-bundle" (OuterVolumeSpecName: "bundle") pod "b538fd45-d744-49ca-94b5-86943050e168" (UID: "b538fd45-d744-49ca-94b5-86943050e168"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:14:44.990827 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:44.990765 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b538fd45-d744-49ca-94b5-86943050e168-kube-api-access-926vf" (OuterVolumeSpecName: "kube-api-access-926vf") pod "b538fd45-d744-49ca-94b5-86943050e168" (UID: "b538fd45-d744-49ca-94b5-86943050e168"). InnerVolumeSpecName "kube-api-access-926vf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:14:44.994706 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:44.994654 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b538fd45-d744-49ca-94b5-86943050e168-util" (OuterVolumeSpecName: "util") pod "b538fd45-d744-49ca-94b5-86943050e168" (UID: "b538fd45-d744-49ca-94b5-86943050e168"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:14:45.090095 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:45.090042 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-926vf\" (UniqueName: \"kubernetes.io/projected/b538fd45-d744-49ca-94b5-86943050e168-kube-api-access-926vf\") on node \"ip-10-0-142-217.ec2.internal\" DevicePath \"\"" Sep 09 23:14:45.090095 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:45.090088 2552 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b538fd45-d744-49ca-94b5-86943050e168-util\") on node \"ip-10-0-142-217.ec2.internal\" DevicePath \"\"" Sep 09 23:14:45.090095 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:45.090100 2552 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b538fd45-d744-49ca-94b5-86943050e168-bundle\") on node \"ip-10-0-142-217.ec2.internal\" DevicePath \"\"" Sep 09 23:14:45.751379 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:45.751352 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6qtxtz" Sep 09 23:14:45.751866 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:45.751386 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6qtxtz" event={"ID":"b538fd45-d744-49ca-94b5-86943050e168","Type":"ContainerDied","Data":"432b4549e3560b7bce61d68fa6ee4aca9fff59d738bb1867c6a32a5a787eb5df"} Sep 09 23:14:45.751866 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:45.751434 2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="432b4549e3560b7bce61d68fa6ee4aca9fff59d738bb1867c6a32a5a787eb5df" Sep 09 23:14:45.938390 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:45.938355 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar56bs" Sep 09 23:14:45.940745 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:45.940725 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5jncr" Sep 09 23:14:45.945160 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:45.945137 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7crspl" Sep 09 23:14:45.998547 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:45.998512 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-56x77\" (UniqueName: \"kubernetes.io/projected/3e795867-9433-4ec0-8d06-06cd95f72962-kube-api-access-56x77\") pod \"3e795867-9433-4ec0-8d06-06cd95f72962\" (UID: \"3e795867-9433-4ec0-8d06-06cd95f72962\") " Sep 09 23:14:45.998547 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:45.998563 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ht7hn\" (UniqueName: \"kubernetes.io/projected/4dd7a889-0b53-4ccb-8de0-861359fad310-kube-api-access-ht7hn\") pod \"4dd7a889-0b53-4ccb-8de0-861359fad310\" (UID: \"4dd7a889-0b53-4ccb-8de0-861359fad310\") " Sep 09 23:14:45.998840 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:45.998585 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4dd7a889-0b53-4ccb-8de0-861359fad310-util\") pod \"4dd7a889-0b53-4ccb-8de0-861359fad310\" (UID: \"4dd7a889-0b53-4ccb-8de0-861359fad310\") " Sep 09 23:14:45.998840 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:45.998711 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mzcch\" (UniqueName: \"kubernetes.io/projected/c5ef5eee-0044-4738-9a24-edd6a8bde823-kube-api-access-mzcch\") pod \"c5ef5eee-0044-4738-9a24-edd6a8bde823\" (UID: \"c5ef5eee-0044-4738-9a24-edd6a8bde823\") " Sep 09 23:14:45.998840 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:45.998753 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3e795867-9433-4ec0-8d06-06cd95f72962-util\") pod \"3e795867-9433-4ec0-8d06-06cd95f72962\" (UID: \"3e795867-9433-4ec0-8d06-06cd95f72962\") " Sep 09 23:14:45.998840 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:45.998787 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3e795867-9433-4ec0-8d06-06cd95f72962-bundle\") pod \"3e795867-9433-4ec0-8d06-06cd95f72962\" (UID: \"3e795867-9433-4ec0-8d06-06cd95f72962\") " Sep 09 23:14:45.999051 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:45.998870 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4dd7a889-0b53-4ccb-8de0-861359fad310-bundle\") pod \"4dd7a889-0b53-4ccb-8de0-861359fad310\" (UID: \"4dd7a889-0b53-4ccb-8de0-861359fad310\") " Sep 09 23:14:45.999051 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:45.998907 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c5ef5eee-0044-4738-9a24-edd6a8bde823-util\") pod \"c5ef5eee-0044-4738-9a24-edd6a8bde823\" (UID: \"c5ef5eee-0044-4738-9a24-edd6a8bde823\") " Sep 09 23:14:45.999051 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:45.998931 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c5ef5eee-0044-4738-9a24-edd6a8bde823-bundle\") pod \"c5ef5eee-0044-4738-9a24-edd6a8bde823\" (UID: \"c5ef5eee-0044-4738-9a24-edd6a8bde823\") " Sep 09 23:14:46.000078 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:46.000031 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5ef5eee-0044-4738-9a24-edd6a8bde823-bundle" (OuterVolumeSpecName: "bundle") pod "c5ef5eee-0044-4738-9a24-edd6a8bde823" (UID: "c5ef5eee-0044-4738-9a24-edd6a8bde823"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:14:46.000528 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:46.000481 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4dd7a889-0b53-4ccb-8de0-861359fad310-bundle" (OuterVolumeSpecName: "bundle") pod "4dd7a889-0b53-4ccb-8de0-861359fad310" (UID: "4dd7a889-0b53-4ccb-8de0-861359fad310"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:14:46.000778 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:46.000740 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e795867-9433-4ec0-8d06-06cd95f72962-bundle" (OuterVolumeSpecName: "bundle") pod "3e795867-9433-4ec0-8d06-06cd95f72962" (UID: "3e795867-9433-4ec0-8d06-06cd95f72962"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:14:46.001450 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:46.001351 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e795867-9433-4ec0-8d06-06cd95f72962-kube-api-access-56x77" (OuterVolumeSpecName: "kube-api-access-56x77") pod "3e795867-9433-4ec0-8d06-06cd95f72962" (UID: "3e795867-9433-4ec0-8d06-06cd95f72962"). InnerVolumeSpecName "kube-api-access-56x77". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:14:46.001450 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:46.001438 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4dd7a889-0b53-4ccb-8de0-861359fad310-kube-api-access-ht7hn" (OuterVolumeSpecName: "kube-api-access-ht7hn") pod "4dd7a889-0b53-4ccb-8de0-861359fad310" (UID: "4dd7a889-0b53-4ccb-8de0-861359fad310"). InnerVolumeSpecName "kube-api-access-ht7hn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:14:46.002469 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:46.002446 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5ef5eee-0044-4738-9a24-edd6a8bde823-kube-api-access-mzcch" (OuterVolumeSpecName: "kube-api-access-mzcch") pod "c5ef5eee-0044-4738-9a24-edd6a8bde823" (UID: "c5ef5eee-0044-4738-9a24-edd6a8bde823"). InnerVolumeSpecName "kube-api-access-mzcch". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:14:46.005811 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:46.005778 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e795867-9433-4ec0-8d06-06cd95f72962-util" (OuterVolumeSpecName: "util") pod "3e795867-9433-4ec0-8d06-06cd95f72962" (UID: "3e795867-9433-4ec0-8d06-06cd95f72962"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:14:46.005982 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:46.005958 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4dd7a889-0b53-4ccb-8de0-861359fad310-util" (OuterVolumeSpecName: "util") pod "4dd7a889-0b53-4ccb-8de0-861359fad310" (UID: "4dd7a889-0b53-4ccb-8de0-861359fad310"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:14:46.006291 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:46.006268 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5ef5eee-0044-4738-9a24-edd6a8bde823-util" (OuterVolumeSpecName: "util") pod "c5ef5eee-0044-4738-9a24-edd6a8bde823" (UID: "c5ef5eee-0044-4738-9a24-edd6a8bde823"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:14:46.100797 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:46.100754 2552 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4dd7a889-0b53-4ccb-8de0-861359fad310-bundle\") on node \"ip-10-0-142-217.ec2.internal\" DevicePath \"\"" Sep 09 23:14:46.100797 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:46.100796 2552 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c5ef5eee-0044-4738-9a24-edd6a8bde823-util\") on node \"ip-10-0-142-217.ec2.internal\" DevicePath \"\"" Sep 09 23:14:46.100983 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:46.100810 2552 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c5ef5eee-0044-4738-9a24-edd6a8bde823-bundle\") on node \"ip-10-0-142-217.ec2.internal\" DevicePath \"\"" Sep 09 23:14:46.100983 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:46.100825 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-56x77\" (UniqueName: \"kubernetes.io/projected/3e795867-9433-4ec0-8d06-06cd95f72962-kube-api-access-56x77\") on node \"ip-10-0-142-217.ec2.internal\" DevicePath \"\"" Sep 09 23:14:46.100983 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:46.100842 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ht7hn\" (UniqueName: \"kubernetes.io/projected/4dd7a889-0b53-4ccb-8de0-861359fad310-kube-api-access-ht7hn\") on node \"ip-10-0-142-217.ec2.internal\" DevicePath \"\"" Sep 09 23:14:46.100983 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:46.100857 2552 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4dd7a889-0b53-4ccb-8de0-861359fad310-util\") on node \"ip-10-0-142-217.ec2.internal\" DevicePath \"\"" Sep 09 23:14:46.100983 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:46.100869 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mzcch\" (UniqueName: \"kubernetes.io/projected/c5ef5eee-0044-4738-9a24-edd6a8bde823-kube-api-access-mzcch\") on node \"ip-10-0-142-217.ec2.internal\" DevicePath \"\"" Sep 09 23:14:46.100983 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:46.100883 2552 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3e795867-9433-4ec0-8d06-06cd95f72962-util\") on node \"ip-10-0-142-217.ec2.internal\" DevicePath \"\"" Sep 09 23:14:46.100983 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:46.100896 2552 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3e795867-9433-4ec0-8d06-06cd95f72962-bundle\") on node \"ip-10-0-142-217.ec2.internal\" DevicePath \"\"" Sep 09 23:14:46.759020 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:46.758988 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar56bs" Sep 09 23:14:46.759430 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:46.758980 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ar56bs" event={"ID":"c5ef5eee-0044-4738-9a24-edd6a8bde823","Type":"ContainerDied","Data":"12f6574e791c5b939e977c662f9bda6041ab3fce9b494b9a24641183b98aae58"} Sep 09 23:14:46.759430 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:46.759156 2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="12f6574e791c5b939e977c662f9bda6041ab3fce9b494b9a24641183b98aae58" Sep 09 23:14:46.761146 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:46.761118 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5jncr" Sep 09 23:14:46.761146 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:46.761125 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5jncr" event={"ID":"3e795867-9433-4ec0-8d06-06cd95f72962","Type":"ContainerDied","Data":"4da40d4b24a02a4c8e48957505d97a7f2a54192cabb46c201c004ec3c76db85a"} Sep 09 23:14:46.761331 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:46.761168 2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4da40d4b24a02a4c8e48957505d97a7f2a54192cabb46c201c004ec3c76db85a" Sep 09 23:14:46.763351 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:46.763326 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7crspl" Sep 09 23:14:46.763351 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:46.763340 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7crspl" event={"ID":"4dd7a889-0b53-4ccb-8de0-861359fad310","Type":"ContainerDied","Data":"b9817c6b936981e18d7e696e9fc0bfa24fe435a3aa1c3a18b346b7de8a347e64"} Sep 09 23:14:46.763484 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:14:46.763385 2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b9817c6b936981e18d7e696e9fc0bfa24fe435a3aa1c3a18b346b7de8a347e64" Sep 09 23:15:01.183056 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:15:01.183012 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-2h5tf"] Sep 09 23:15:01.183455 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:15:01.183374 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b538fd45-d744-49ca-94b5-86943050e168" containerName="pull" Sep 09 23:15:01.183455 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:15:01.183385 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="b538fd45-d744-49ca-94b5-86943050e168" containerName="pull" Sep 09 23:15:01.183455 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:15:01.183398 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e795867-9433-4ec0-8d06-06cd95f72962" containerName="extract" Sep 09 23:15:01.183455 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:15:01.183404 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e795867-9433-4ec0-8d06-06cd95f72962" containerName="extract" Sep 09 23:15:01.183455 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:15:01.183412 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e795867-9433-4ec0-8d06-06cd95f72962" containerName="util" Sep 09 23:15:01.183455 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:15:01.183418 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e795867-9433-4ec0-8d06-06cd95f72962" containerName="util" Sep 09 23:15:01.183455 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:15:01.183430 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b538fd45-d744-49ca-94b5-86943050e168" containerName="extract" Sep 09 23:15:01.183455 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:15:01.183435 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="b538fd45-d744-49ca-94b5-86943050e168" containerName="extract" Sep 09 23:15:01.183455 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:15:01.183441 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5ef5eee-0044-4738-9a24-edd6a8bde823" containerName="pull" Sep 09 23:15:01.183455 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:15:01.183447 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5ef5eee-0044-4738-9a24-edd6a8bde823" containerName="pull" Sep 09 23:15:01.183455 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:15:01.183454 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5ef5eee-0044-4738-9a24-edd6a8bde823" containerName="extract" Sep 09 23:15:01.183455 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:15:01.183460 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5ef5eee-0044-4738-9a24-edd6a8bde823" containerName="extract" Sep 09 23:15:01.183831 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:15:01.183467 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b538fd45-d744-49ca-94b5-86943050e168" containerName="util" Sep 09 23:15:01.183831 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:15:01.183472 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="b538fd45-d744-49ca-94b5-86943050e168" containerName="util" Sep 09 23:15:01.183831 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:15:01.183477 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e795867-9433-4ec0-8d06-06cd95f72962" containerName="pull" Sep 09 23:15:01.183831 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:15:01.183482 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e795867-9433-4ec0-8d06-06cd95f72962" containerName="pull" Sep 09 23:15:01.183831 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:15:01.183489 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4dd7a889-0b53-4ccb-8de0-861359fad310" containerName="pull" Sep 09 23:15:01.183831 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:15:01.183494 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="4dd7a889-0b53-4ccb-8de0-861359fad310" containerName="pull" Sep 09 23:15:01.183831 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:15:01.183499 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5ef5eee-0044-4738-9a24-edd6a8bde823" containerName="util" Sep 09 23:15:01.183831 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:15:01.183504 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5ef5eee-0044-4738-9a24-edd6a8bde823" containerName="util" Sep 09 23:15:01.183831 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:15:01.183511 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4dd7a889-0b53-4ccb-8de0-861359fad310" containerName="extract" Sep 09 23:15:01.183831 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:15:01.183515 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="4dd7a889-0b53-4ccb-8de0-861359fad310" containerName="extract" Sep 09 23:15:01.183831 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:15:01.183522 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4dd7a889-0b53-4ccb-8de0-861359fad310" containerName="util" Sep 09 23:15:01.183831 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:15:01.183527 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="4dd7a889-0b53-4ccb-8de0-861359fad310" containerName="util" Sep 09 23:15:01.183831 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:15:01.183583 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="4dd7a889-0b53-4ccb-8de0-861359fad310" containerName="extract" Sep 09 23:15:01.183831 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:15:01.183592 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5ef5eee-0044-4738-9a24-edd6a8bde823" containerName="extract" Sep 09 23:15:01.183831 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:15:01.183599 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e795867-9433-4ec0-8d06-06cd95f72962" containerName="extract" Sep 09 23:15:01.183831 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:15:01.183605 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="b538fd45-d744-49ca-94b5-86943050e168" containerName="extract" Sep 09 23:15:01.188155 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:15:01.188135 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-2h5tf" Sep 09 23:15:01.190451 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:15:01.190426 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-cpfb8\"" Sep 09 23:15:01.190577 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:15:01.190425 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Sep 09 23:15:01.191244 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:15:01.191227 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Sep 09 23:15:01.198346 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:15:01.198315 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-2h5tf"] Sep 09 23:15:01.344185 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:15:01.344147 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbdkb\" (UniqueName: \"kubernetes.io/projected/b05c7f13-22b6-4a89-abb9-1e30e8c991b2-kube-api-access-lbdkb\") pod \"authorino-operator-76b478bd78-2h5tf\" (UID: \"b05c7f13-22b6-4a89-abb9-1e30e8c991b2\") " pod="kuadrant-system/authorino-operator-76b478bd78-2h5tf" Sep 09 23:15:01.444805 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:15:01.444694 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbdkb\" (UniqueName: \"kubernetes.io/projected/b05c7f13-22b6-4a89-abb9-1e30e8c991b2-kube-api-access-lbdkb\") pod \"authorino-operator-76b478bd78-2h5tf\" (UID: \"b05c7f13-22b6-4a89-abb9-1e30e8c991b2\") " pod="kuadrant-system/authorino-operator-76b478bd78-2h5tf" Sep 09 23:15:01.452496 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:15:01.452462 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbdkb\" (UniqueName: \"kubernetes.io/projected/b05c7f13-22b6-4a89-abb9-1e30e8c991b2-kube-api-access-lbdkb\") pod \"authorino-operator-76b478bd78-2h5tf\" (UID: \"b05c7f13-22b6-4a89-abb9-1e30e8c991b2\") " pod="kuadrant-system/authorino-operator-76b478bd78-2h5tf" Sep 09 23:15:01.500553 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:15:01.500512 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-2h5tf" Sep 09 23:15:01.774798 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:15:01.774768 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-2h5tf"] Sep 09 23:15:01.776767 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:15:01.776742 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb05c7f13_22b6_4a89_abb9_1e30e8c991b2.slice/crio-2a960adb5f5b412c94ae89306a9848df4eb88beb932e2a041bfeda909d4b481d WatchSource:0}: Error finding container 2a960adb5f5b412c94ae89306a9848df4eb88beb932e2a041bfeda909d4b481d: Status 404 returned error can't find the container with id 2a960adb5f5b412c94ae89306a9848df4eb88beb932e2a041bfeda909d4b481d Sep 09 23:15:01.852074 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:15:01.852033 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-2h5tf" event={"ID":"b05c7f13-22b6-4a89-abb9-1e30e8c991b2","Type":"ContainerStarted","Data":"2a960adb5f5b412c94ae89306a9848df4eb88beb932e2a041bfeda909d4b481d"} Sep 09 23:15:04.874815 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:15:04.874775 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-2h5tf" event={"ID":"b05c7f13-22b6-4a89-abb9-1e30e8c991b2","Type":"ContainerStarted","Data":"c003744fa19eeb3849bf97ccc5530b22d2915956820accb816aa39e0b6f7b437"} Sep 09 23:15:04.875284 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:15:04.874835 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-76b478bd78-2h5tf" Sep 09 23:15:04.890476 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:15:04.890422 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-76b478bd78-2h5tf" podStartSLOduration=1.181105634 podStartE2EDuration="3.890405995s" totalImagesPullingTime="2.709300361s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:15:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:15:04.888942903 +0000 UTC m=+675.404673735" watchObservedRunningTime="2026-09-09 23:15:04.890405995 +0000 UTC m=+675.406136824" Sep 09 23:15:15.883168 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:15:15.883134 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-76b478bd78-2h5tf" Sep 09 23:15:45.877454 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:15:45.877367 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2r2l5"] Sep 09 23:15:45.880815 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:15:45.880792 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2r2l5" Sep 09 23:15:45.883072 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:15:45.883036 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-hdc8q\"" Sep 09 23:15:45.892267 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:15:45.892232 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2r2l5"] Sep 09 23:15:46.037265 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:15:46.037215 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzz42\" (UniqueName: \"kubernetes.io/projected/1a434206-4afc-46b6-aff6-d4f5a2ff28fb-kube-api-access-rzz42\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2r2l5\" (UID: \"1a434206-4afc-46b6-aff6-d4f5a2ff28fb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2r2l5" Sep 09 23:15:46.037265 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:15:46.037268 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1a434206-4afc-46b6-aff6-d4f5a2ff28fb-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2r2l5\" (UID: \"1a434206-4afc-46b6-aff6-d4f5a2ff28fb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2r2l5" Sep 09 23:15:46.037501 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:15:46.037396 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1a434206-4afc-46b6-aff6-d4f5a2ff28fb-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2r2l5\" (UID: \"1a434206-4afc-46b6-aff6-d4f5a2ff28fb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2r2l5" Sep 09 23:15:46.037501 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:15:46.037425 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a434206-4afc-46b6-aff6-d4f5a2ff28fb-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2r2l5\" (UID: \"1a434206-4afc-46b6-aff6-d4f5a2ff28fb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2r2l5" Sep 09 23:15:46.037501 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:15:46.037446 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a434206-4afc-46b6-aff6-d4f5a2ff28fb-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2r2l5\" (UID: \"1a434206-4afc-46b6-aff6-d4f5a2ff28fb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2r2l5" Sep 09 23:15:46.037626 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:15:46.037505 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a434206-4afc-46b6-aff6-d4f5a2ff28fb-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2r2l5\" (UID: \"1a434206-4afc-46b6-aff6-d4f5a2ff28fb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2r2l5" Sep 09 23:15:46.037626 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:15:46.037525 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1a434206-4afc-46b6-aff6-d4f5a2ff28fb-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2r2l5\" (UID: \"1a434206-4afc-46b6-aff6-d4f5a2ff28fb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2r2l5" Sep 09 23:15:46.037626 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:15:46.037542 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a434206-4afc-46b6-aff6-d4f5a2ff28fb-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2r2l5\" (UID: \"1a434206-4afc-46b6-aff6-d4f5a2ff28fb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2r2l5" Sep 09 23:15:46.037626 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:15:46.037562 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1a434206-4afc-46b6-aff6-d4f5a2ff28fb-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2r2l5\" (UID: \"1a434206-4afc-46b6-aff6-d4f5a2ff28fb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2r2l5" Sep 09 23:15:46.138798 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:15:46.138666 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a434206-4afc-46b6-aff6-d4f5a2ff28fb-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2r2l5\" (UID: \"1a434206-4afc-46b6-aff6-d4f5a2ff28fb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2r2l5" Sep 09 23:15:46.138798 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:15:46.138772 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a434206-4afc-46b6-aff6-d4f5a2ff28fb-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2r2l5\" (UID: \"1a434206-4afc-46b6-aff6-d4f5a2ff28fb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2r2l5" Sep 09 23:15:46.138798 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:15:46.138805 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1a434206-4afc-46b6-aff6-d4f5a2ff28fb-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2r2l5\" (UID: \"1a434206-4afc-46b6-aff6-d4f5a2ff28fb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2r2l5" Sep 09 23:15:46.139082 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:15:46.138830 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a434206-4afc-46b6-aff6-d4f5a2ff28fb-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2r2l5\" (UID: \"1a434206-4afc-46b6-aff6-d4f5a2ff28fb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2r2l5" Sep 09 23:15:46.139082 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:15:46.138855 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1a434206-4afc-46b6-aff6-d4f5a2ff28fb-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2r2l5\" (UID: \"1a434206-4afc-46b6-aff6-d4f5a2ff28fb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2r2l5" Sep 09 23:15:46.139082 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:15:46.138911 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzz42\" (UniqueName: \"kubernetes.io/projected/1a434206-4afc-46b6-aff6-d4f5a2ff28fb-kube-api-access-rzz42\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2r2l5\" (UID: \"1a434206-4afc-46b6-aff6-d4f5a2ff28fb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2r2l5" Sep 09 23:15:46.139082 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:15:46.138938 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1a434206-4afc-46b6-aff6-d4f5a2ff28fb-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2r2l5\" (UID: \"1a434206-4afc-46b6-aff6-d4f5a2ff28fb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2r2l5" Sep 09 23:15:46.139082 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:15:46.139034 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1a434206-4afc-46b6-aff6-d4f5a2ff28fb-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2r2l5\" (UID: \"1a434206-4afc-46b6-aff6-d4f5a2ff28fb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2r2l5" Sep 09 23:15:46.139082 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:15:46.139063 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a434206-4afc-46b6-aff6-d4f5a2ff28fb-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2r2l5\" (UID: \"1a434206-4afc-46b6-aff6-d4f5a2ff28fb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2r2l5" Sep 09 23:15:46.139359 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:15:46.139144 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a434206-4afc-46b6-aff6-d4f5a2ff28fb-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2r2l5\" (UID: \"1a434206-4afc-46b6-aff6-d4f5a2ff28fb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2r2l5" Sep 09 23:15:46.139359 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:15:46.139194 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1a434206-4afc-46b6-aff6-d4f5a2ff28fb-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2r2l5\" (UID: \"1a434206-4afc-46b6-aff6-d4f5a2ff28fb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2r2l5" Sep 09 23:15:46.139359 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:15:46.139276 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a434206-4afc-46b6-aff6-d4f5a2ff28fb-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2r2l5\" (UID: \"1a434206-4afc-46b6-aff6-d4f5a2ff28fb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2r2l5" Sep 09 23:15:46.139579 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:15:46.139527 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a434206-4afc-46b6-aff6-d4f5a2ff28fb-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2r2l5\" (UID: \"1a434206-4afc-46b6-aff6-d4f5a2ff28fb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2r2l5" Sep 09 23:15:46.140137 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:15:46.140111 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1a434206-4afc-46b6-aff6-d4f5a2ff28fb-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2r2l5\" (UID: \"1a434206-4afc-46b6-aff6-d4f5a2ff28fb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2r2l5" Sep 09 23:15:46.141264 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:15:46.141232 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1a434206-4afc-46b6-aff6-d4f5a2ff28fb-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2r2l5\" (UID: \"1a434206-4afc-46b6-aff6-d4f5a2ff28fb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2r2l5" Sep 09 23:15:46.141568 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:15:46.141542 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1a434206-4afc-46b6-aff6-d4f5a2ff28fb-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2r2l5\" (UID: \"1a434206-4afc-46b6-aff6-d4f5a2ff28fb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2r2l5" Sep 09 23:15:46.147244 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:15:46.147216 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a434206-4afc-46b6-aff6-d4f5a2ff28fb-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2r2l5\" (UID: \"1a434206-4afc-46b6-aff6-d4f5a2ff28fb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2r2l5" Sep 09 23:15:46.147373 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:15:46.147354 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzz42\" (UniqueName: \"kubernetes.io/projected/1a434206-4afc-46b6-aff6-d4f5a2ff28fb-kube-api-access-rzz42\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2r2l5\" (UID: \"1a434206-4afc-46b6-aff6-d4f5a2ff28fb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2r2l5" Sep 09 23:15:46.194422 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:15:46.194376 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2r2l5" Sep 09 23:15:46.470134 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:15:46.470101 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2r2l5"] Sep 09 23:15:46.471938 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:15:46.471911 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a434206_4afc_46b6_aff6_d4f5a2ff28fb.slice/crio-0cc01a209a8e19733501a04ae332ca0b8fb2520fc2014f14e36c0ea6cee45e35 WatchSource:0}: Error finding container 0cc01a209a8e19733501a04ae332ca0b8fb2520fc2014f14e36c0ea6cee45e35: Status 404 returned error can't find the container with id 0cc01a209a8e19733501a04ae332ca0b8fb2520fc2014f14e36c0ea6cee45e35 Sep 09 23:15:46.474046 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:15:46.474003 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 09 23:15:46.474141 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:15:46.474099 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 09 23:15:46.474141 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:15:46.474133 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 09 23:15:47.118337 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:15:47.118302 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2r2l5" event={"ID":"1a434206-4afc-46b6-aff6-d4f5a2ff28fb","Type":"ContainerStarted","Data":"32b9e6f6322ba4a2bcb4b88b01617d2d9d9e3193e26be3731bfae41a495fb3bc"} Sep 09 23:15:47.118735 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:15:47.118365 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2r2l5" event={"ID":"1a434206-4afc-46b6-aff6-d4f5a2ff28fb","Type":"ContainerStarted","Data":"0cc01a209a8e19733501a04ae332ca0b8fb2520fc2014f14e36c0ea6cee45e35"} Sep 09 23:15:47.138222 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:15:47.138152 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2r2l5" podStartSLOduration=2.1381362409999998 podStartE2EDuration="2.138136241s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:15:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:15:47.135810432 +0000 UTC m=+717.651541274" watchObservedRunningTime="2026-09-09 23:15:47.138136241 +0000 UTC m=+717.653867071" Sep 09 23:15:47.195276 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:15:47.195230 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2r2l5" Sep 09 23:15:47.200102 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:15:47.200073 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2r2l5" Sep 09 23:15:48.123770 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:15:48.123738 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2r2l5" Sep 09 23:15:48.124860 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:15:48.124838 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2r2l5" Sep 09 23:16:00.421479 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:00.421439 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-s9249"] Sep 09 23:16:00.424982 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:00.424961 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-s9249" Sep 09 23:16:00.427060 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:00.427036 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-ffljt\"" Sep 09 23:16:00.431882 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:00.431855 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-s9249"] Sep 09 23:16:00.572991 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:00.572948 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5vxx\" (UniqueName: \"kubernetes.io/projected/076d7a0b-ea4a-486f-91d3-bf3a3d95dffe-kube-api-access-g5vxx\") pod \"authorino-7bcfd8f9cd-s9249\" (UID: \"076d7a0b-ea4a-486f-91d3-bf3a3d95dffe\") " pod="kuadrant-system/authorino-7bcfd8f9cd-s9249" Sep 09 23:16:00.673971 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:00.673871 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5vxx\" (UniqueName: \"kubernetes.io/projected/076d7a0b-ea4a-486f-91d3-bf3a3d95dffe-kube-api-access-g5vxx\") pod \"authorino-7bcfd8f9cd-s9249\" (UID: \"076d7a0b-ea4a-486f-91d3-bf3a3d95dffe\") " pod="kuadrant-system/authorino-7bcfd8f9cd-s9249" Sep 09 23:16:00.683490 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:00.683453 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5vxx\" (UniqueName: \"kubernetes.io/projected/076d7a0b-ea4a-486f-91d3-bf3a3d95dffe-kube-api-access-g5vxx\") pod \"authorino-7bcfd8f9cd-s9249\" (UID: \"076d7a0b-ea4a-486f-91d3-bf3a3d95dffe\") " pod="kuadrant-system/authorino-7bcfd8f9cd-s9249" Sep 09 23:16:00.736644 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:00.736607 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-s9249" Sep 09 23:16:01.007805 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:01.007775 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-s9249"] Sep 09 23:16:01.009968 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:16:01.009928 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod076d7a0b_ea4a_486f_91d3_bf3a3d95dffe.slice/crio-68e0829530bc464d6fceb73cb8138c07e77da3c8abde02df22b386b4ce0c4983 WatchSource:0}: Error finding container 68e0829530bc464d6fceb73cb8138c07e77da3c8abde02df22b386b4ce0c4983: Status 404 returned error can't find the container with id 68e0829530bc464d6fceb73cb8138c07e77da3c8abde02df22b386b4ce0c4983 Sep 09 23:16:01.200786 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:01.200745 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-s9249" event={"ID":"076d7a0b-ea4a-486f-91d3-bf3a3d95dffe","Type":"ContainerStarted","Data":"68e0829530bc464d6fceb73cb8138c07e77da3c8abde02df22b386b4ce0c4983"} Sep 09 23:16:03.214785 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:03.214745 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-s9249" event={"ID":"076d7a0b-ea4a-486f-91d3-bf3a3d95dffe","Type":"ContainerStarted","Data":"16a89b018fe559ca14c5eec33c46b0cf3123988aa7cb690e5c4d9c112b610b11"} Sep 09 23:16:03.229622 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:03.229568 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7bcfd8f9cd-s9249" podStartSLOduration=1.377974642 podStartE2EDuration="3.22955037s" totalImagesPullingTime="1.851575728s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:16:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:16:03.227549647 +0000 UTC m=+733.743280484" watchObservedRunningTime="2026-09-09 23:16:03.22955037 +0000 UTC m=+733.745281199" Sep 09 23:16:03.479733 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:03.479621 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-s9249"] Sep 09 23:16:05.226143 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:05.226101 2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7bcfd8f9cd-s9249" podUID="076d7a0b-ea4a-486f-91d3-bf3a3d95dffe" containerName="authorino" containerID="cri-o://16a89b018fe559ca14c5eec33c46b0cf3123988aa7cb690e5c4d9c112b610b11" gracePeriod=30 Sep 09 23:16:05.482560 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:05.482490 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-s9249" Sep 09 23:16:05.517814 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:05.517775 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g5vxx\" (UniqueName: \"kubernetes.io/projected/076d7a0b-ea4a-486f-91d3-bf3a3d95dffe-kube-api-access-g5vxx\") pod \"076d7a0b-ea4a-486f-91d3-bf3a3d95dffe\" (UID: \"076d7a0b-ea4a-486f-91d3-bf3a3d95dffe\") " Sep 09 23:16:05.520011 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:05.519979 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/076d7a0b-ea4a-486f-91d3-bf3a3d95dffe-kube-api-access-g5vxx" (OuterVolumeSpecName: "kube-api-access-g5vxx") pod "076d7a0b-ea4a-486f-91d3-bf3a3d95dffe" (UID: "076d7a0b-ea4a-486f-91d3-bf3a3d95dffe"). InnerVolumeSpecName "kube-api-access-g5vxx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:16:05.618648 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:05.618602 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g5vxx\" (UniqueName: \"kubernetes.io/projected/076d7a0b-ea4a-486f-91d3-bf3a3d95dffe-kube-api-access-g5vxx\") on node \"ip-10-0-142-217.ec2.internal\" DevicePath \"\"" Sep 09 23:16:06.232935 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:06.232838 2552 generic.go:356] "Generic (PLEG): container finished" podID="076d7a0b-ea4a-486f-91d3-bf3a3d95dffe" containerID="16a89b018fe559ca14c5eec33c46b0cf3123988aa7cb690e5c4d9c112b610b11" exitCode=0 Sep 09 23:16:06.232935 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:06.232877 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-s9249" Sep 09 23:16:06.233436 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:06.232926 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-s9249" event={"ID":"076d7a0b-ea4a-486f-91d3-bf3a3d95dffe","Type":"ContainerDied","Data":"16a89b018fe559ca14c5eec33c46b0cf3123988aa7cb690e5c4d9c112b610b11"} Sep 09 23:16:06.233436 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:06.232973 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-s9249" event={"ID":"076d7a0b-ea4a-486f-91d3-bf3a3d95dffe","Type":"ContainerDied","Data":"68e0829530bc464d6fceb73cb8138c07e77da3c8abde02df22b386b4ce0c4983"} Sep 09 23:16:06.233436 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:06.232997 2552 scope.go:117] "RemoveContainer" containerID="16a89b018fe559ca14c5eec33c46b0cf3123988aa7cb690e5c4d9c112b610b11" Sep 09 23:16:06.242125 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:06.242094 2552 scope.go:117] "RemoveContainer" containerID="16a89b018fe559ca14c5eec33c46b0cf3123988aa7cb690e5c4d9c112b610b11" Sep 09 23:16:06.242461 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:16:06.242441 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16a89b018fe559ca14c5eec33c46b0cf3123988aa7cb690e5c4d9c112b610b11\": container with ID starting with 16a89b018fe559ca14c5eec33c46b0cf3123988aa7cb690e5c4d9c112b610b11 not found: ID does not exist" containerID="16a89b018fe559ca14c5eec33c46b0cf3123988aa7cb690e5c4d9c112b610b11" Sep 09 23:16:06.242527 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:06.242471 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16a89b018fe559ca14c5eec33c46b0cf3123988aa7cb690e5c4d9c112b610b11"} err="failed to get container status \"16a89b018fe559ca14c5eec33c46b0cf3123988aa7cb690e5c4d9c112b610b11\": rpc error: code = NotFound desc = could not find container \"16a89b018fe559ca14c5eec33c46b0cf3123988aa7cb690e5c4d9c112b610b11\": container with ID starting with 16a89b018fe559ca14c5eec33c46b0cf3123988aa7cb690e5c4d9c112b610b11 not found: ID does not exist" Sep 09 23:16:06.248107 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:06.248083 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-s9249"] Sep 09 23:16:06.250293 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:06.250271 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-s9249"] Sep 09 23:16:07.940535 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:07.940497 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="076d7a0b-ea4a-486f-91d3-bf3a3d95dffe" path="/var/lib/kubelet/pods/076d7a0b-ea4a-486f-91d3-bf3a3d95dffe/volumes" Sep 09 23:16:26.088196 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:26.088154 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-557f876f69-5w2gm"] Sep 09 23:16:26.088762 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:26.088743 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="076d7a0b-ea4a-486f-91d3-bf3a3d95dffe" containerName="authorino" Sep 09 23:16:26.088819 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:26.088763 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="076d7a0b-ea4a-486f-91d3-bf3a3d95dffe" containerName="authorino" Sep 09 23:16:26.088874 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:26.088864 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="076d7a0b-ea4a-486f-91d3-bf3a3d95dffe" containerName="authorino" Sep 09 23:16:26.094113 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:26.094072 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-5w2gm" Sep 09 23:16:26.096418 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:26.096349 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-ffljt\"" Sep 09 23:16:26.097516 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:26.097466 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-557f876f69-5w2gm"] Sep 09 23:16:26.201082 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:26.201044 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-589l6\" (UniqueName: \"kubernetes.io/projected/b338ea66-00d5-49cb-9159-92bd3c96add8-kube-api-access-589l6\") pod \"authorino-557f876f69-5w2gm\" (UID: \"b338ea66-00d5-49cb-9159-92bd3c96add8\") " pod="kuadrant-system/authorino-557f876f69-5w2gm" Sep 09 23:16:26.231174 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:26.231129 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-5w2gm"] Sep 09 23:16:26.231476 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:16:26.231449 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-589l6], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-557f876f69-5w2gm" podUID="b338ea66-00d5-49cb-9159-92bd3c96add8" Sep 09 23:16:26.254269 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:26.254228 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-tfxjd"] Sep 09 23:16:26.257907 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:26.257886 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-tfxjd" Sep 09 23:16:26.259930 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:26.259905 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Sep 09 23:16:26.264118 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:26.264091 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-tfxjd"] Sep 09 23:16:26.302476 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:26.302443 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-589l6\" (UniqueName: \"kubernetes.io/projected/b338ea66-00d5-49cb-9159-92bd3c96add8-kube-api-access-589l6\") pod \"authorino-557f876f69-5w2gm\" (UID: \"b338ea66-00d5-49cb-9159-92bd3c96add8\") " pod="kuadrant-system/authorino-557f876f69-5w2gm" Sep 09 23:16:26.311604 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:26.311570 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-589l6\" (UniqueName: \"kubernetes.io/projected/b338ea66-00d5-49cb-9159-92bd3c96add8-kube-api-access-589l6\") pod \"authorino-557f876f69-5w2gm\" (UID: \"b338ea66-00d5-49cb-9159-92bd3c96add8\") " pod="kuadrant-system/authorino-557f876f69-5w2gm" Sep 09 23:16:26.330266 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:26.330228 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-tfxjd"] Sep 09 23:16:26.330569 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:16:26.330544 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-rtvpx tls-cert], unattached volumes=[], failed to process volumes=[kube-api-access-rtvpx tls-cert]: context canceled" pod="kuadrant-system/authorino-6d4dfc649f-tfxjd" podUID="2f45d710-61e7-42ec-9d42-c76684533784" Sep 09 23:16:26.354007 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:26.353917 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-tfxjd" Sep 09 23:16:26.354007 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:26.353926 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-5w2gm" Sep 09 23:16:26.362199 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:26.362174 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-tfxjd" Sep 09 23:16:26.365133 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:26.365109 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-5w2gm" Sep 09 23:16:26.504336 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:26.504299 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-589l6\" (UniqueName: \"kubernetes.io/projected/b338ea66-00d5-49cb-9159-92bd3c96add8-kube-api-access-589l6\") pod \"b338ea66-00d5-49cb-9159-92bd3c96add8\" (UID: \"b338ea66-00d5-49cb-9159-92bd3c96add8\") " Sep 09 23:16:26.506523 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:26.506494 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b338ea66-00d5-49cb-9159-92bd3c96add8-kube-api-access-589l6" (OuterVolumeSpecName: "kube-api-access-589l6") pod "b338ea66-00d5-49cb-9159-92bd3c96add8" (UID: "b338ea66-00d5-49cb-9159-92bd3c96add8"). InnerVolumeSpecName "kube-api-access-589l6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:16:26.605532 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:26.605438 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-589l6\" (UniqueName: \"kubernetes.io/projected/b338ea66-00d5-49cb-9159-92bd3c96add8-kube-api-access-589l6\") on node \"ip-10-0-142-217.ec2.internal\" DevicePath \"\"" Sep 09 23:16:27.359883 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:27.359841 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-tfxjd" Sep 09 23:16:27.360373 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:27.359841 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-5w2gm" Sep 09 23:16:27.390942 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:27.390908 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-5w2gm"] Sep 09 23:16:27.394907 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:27.394878 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-557f876f69-5w2gm"] Sep 09 23:16:27.411479 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:27.411443 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-tfxjd"] Sep 09 23:16:27.413665 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:27.413640 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-tfxjd"] Sep 09 23:16:27.939213 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:27.939175 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f45d710-61e7-42ec-9d42-c76684533784" path="/var/lib/kubelet/pods/2f45d710-61e7-42ec-9d42-c76684533784/volumes" Sep 09 23:16:27.939409 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:27.939397 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b338ea66-00d5-49cb-9159-92bd3c96add8" path="/var/lib/kubelet/pods/b338ea66-00d5-49cb-9159-92bd3c96add8/volumes" Sep 09 23:16:33.377143 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:33.377100 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5d79dbff6d-ll9nd"] Sep 09 23:16:33.381279 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:33.381252 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5d79dbff6d-ll9nd" Sep 09 23:16:33.384386 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:33.384355 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\"" Sep 09 23:16:33.384540 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:33.384360 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-pmbwb\"" Sep 09 23:16:33.384540 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:33.384404 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Sep 09 23:16:33.384540 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:33.384360 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Sep 09 23:16:33.394392 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:33.394360 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5d79dbff6d-ll9nd"] Sep 09 23:16:33.470061 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:33.470022 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/df522543-f27e-41f7-b5f5-09be6ec64e31-webhook-cert\") pod \"maas-controller-5d79dbff6d-ll9nd\" (UID: \"df522543-f27e-41f7-b5f5-09be6ec64e31\") " pod="opendatahub/maas-controller-5d79dbff6d-ll9nd" Sep 09 23:16:33.470061 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:33.470067 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/df522543-f27e-41f7-b5f5-09be6ec64e31-metrics-certs\") pod \"maas-controller-5d79dbff6d-ll9nd\" (UID: \"df522543-f27e-41f7-b5f5-09be6ec64e31\") " pod="opendatahub/maas-controller-5d79dbff6d-ll9nd" Sep 09 23:16:33.470289 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:33.470145 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lz44\" (UniqueName: \"kubernetes.io/projected/df522543-f27e-41f7-b5f5-09be6ec64e31-kube-api-access-8lz44\") pod \"maas-controller-5d79dbff6d-ll9nd\" (UID: \"df522543-f27e-41f7-b5f5-09be6ec64e31\") " pod="opendatahub/maas-controller-5d79dbff6d-ll9nd" Sep 09 23:16:33.569189 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:33.569146 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5d8d86686c-hbkw4"] Sep 09 23:16:33.570975 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:33.570947 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/df522543-f27e-41f7-b5f5-09be6ec64e31-webhook-cert\") pod \"maas-controller-5d79dbff6d-ll9nd\" (UID: \"df522543-f27e-41f7-b5f5-09be6ec64e31\") " pod="opendatahub/maas-controller-5d79dbff6d-ll9nd" Sep 09 23:16:33.571150 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:33.570979 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/df522543-f27e-41f7-b5f5-09be6ec64e31-metrics-certs\") pod \"maas-controller-5d79dbff6d-ll9nd\" (UID: \"df522543-f27e-41f7-b5f5-09be6ec64e31\") " pod="opendatahub/maas-controller-5d79dbff6d-ll9nd" Sep 09 23:16:33.571150 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:33.571019 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lz44\" (UniqueName: \"kubernetes.io/projected/df522543-f27e-41f7-b5f5-09be6ec64e31-kube-api-access-8lz44\") pod \"maas-controller-5d79dbff6d-ll9nd\" (UID: \"df522543-f27e-41f7-b5f5-09be6ec64e31\") " pod="opendatahub/maas-controller-5d79dbff6d-ll9nd" Sep 09 23:16:33.573032 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:33.573006 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5d8d86686c-hbkw4" Sep 09 23:16:33.573590 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:33.573570 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/df522543-f27e-41f7-b5f5-09be6ec64e31-webhook-cert\") pod \"maas-controller-5d79dbff6d-ll9nd\" (UID: \"df522543-f27e-41f7-b5f5-09be6ec64e31\") " pod="opendatahub/maas-controller-5d79dbff6d-ll9nd" Sep 09 23:16:33.573734 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:33.573714 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/df522543-f27e-41f7-b5f5-09be6ec64e31-metrics-certs\") pod \"maas-controller-5d79dbff6d-ll9nd\" (UID: \"df522543-f27e-41f7-b5f5-09be6ec64e31\") " pod="opendatahub/maas-controller-5d79dbff6d-ll9nd" Sep 09 23:16:33.581147 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:33.581113 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5d8d86686c-hbkw4"] Sep 09 23:16:33.581659 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:33.581624 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lz44\" (UniqueName: \"kubernetes.io/projected/df522543-f27e-41f7-b5f5-09be6ec64e31-kube-api-access-8lz44\") pod \"maas-controller-5d79dbff6d-ll9nd\" (UID: \"df522543-f27e-41f7-b5f5-09be6ec64e31\") " pod="opendatahub/maas-controller-5d79dbff6d-ll9nd" Sep 09 23:16:33.672484 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:33.672384 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1234d6c6-e69b-4932-bd90-bbd70450890c-metrics-certs\") pod \"maas-controller-5d8d86686c-hbkw4\" (UID: \"1234d6c6-e69b-4932-bd90-bbd70450890c\") " pod="opendatahub/maas-controller-5d8d86686c-hbkw4" Sep 09 23:16:33.672484 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:33.672442 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bllbb\" (UniqueName: \"kubernetes.io/projected/1234d6c6-e69b-4932-bd90-bbd70450890c-kube-api-access-bllbb\") pod \"maas-controller-5d8d86686c-hbkw4\" (UID: \"1234d6c6-e69b-4932-bd90-bbd70450890c\") " pod="opendatahub/maas-controller-5d8d86686c-hbkw4" Sep 09 23:16:33.672758 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:33.672570 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1234d6c6-e69b-4932-bd90-bbd70450890c-webhook-cert\") pod \"maas-controller-5d8d86686c-hbkw4\" (UID: \"1234d6c6-e69b-4932-bd90-bbd70450890c\") " pod="opendatahub/maas-controller-5d8d86686c-hbkw4" Sep 09 23:16:33.694351 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:33.694315 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5d79dbff6d-ll9nd" Sep 09 23:16:33.773468 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:33.773420 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1234d6c6-e69b-4932-bd90-bbd70450890c-webhook-cert\") pod \"maas-controller-5d8d86686c-hbkw4\" (UID: \"1234d6c6-e69b-4932-bd90-bbd70450890c\") " pod="opendatahub/maas-controller-5d8d86686c-hbkw4" Sep 09 23:16:33.773468 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:33.773472 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1234d6c6-e69b-4932-bd90-bbd70450890c-metrics-certs\") pod \"maas-controller-5d8d86686c-hbkw4\" (UID: \"1234d6c6-e69b-4932-bd90-bbd70450890c\") " pod="opendatahub/maas-controller-5d8d86686c-hbkw4" Sep 09 23:16:33.773761 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:33.773503 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bllbb\" (UniqueName: \"kubernetes.io/projected/1234d6c6-e69b-4932-bd90-bbd70450890c-kube-api-access-bllbb\") pod \"maas-controller-5d8d86686c-hbkw4\" (UID: \"1234d6c6-e69b-4932-bd90-bbd70450890c\") " pod="opendatahub/maas-controller-5d8d86686c-hbkw4" Sep 09 23:16:33.776883 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:33.776846 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1234d6c6-e69b-4932-bd90-bbd70450890c-metrics-certs\") pod \"maas-controller-5d8d86686c-hbkw4\" (UID: \"1234d6c6-e69b-4932-bd90-bbd70450890c\") " pod="opendatahub/maas-controller-5d8d86686c-hbkw4" Sep 09 23:16:33.776883 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:33.776861 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1234d6c6-e69b-4932-bd90-bbd70450890c-webhook-cert\") pod \"maas-controller-5d8d86686c-hbkw4\" (UID: \"1234d6c6-e69b-4932-bd90-bbd70450890c\") " pod="opendatahub/maas-controller-5d8d86686c-hbkw4" Sep 09 23:16:33.780572 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:33.780538 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bllbb\" (UniqueName: \"kubernetes.io/projected/1234d6c6-e69b-4932-bd90-bbd70450890c-kube-api-access-bllbb\") pod \"maas-controller-5d8d86686c-hbkw4\" (UID: \"1234d6c6-e69b-4932-bd90-bbd70450890c\") " pod="opendatahub/maas-controller-5d8d86686c-hbkw4" Sep 09 23:16:33.910484 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:33.910447 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5d8d86686c-hbkw4" Sep 09 23:16:33.977594 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:33.972037 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5d79dbff6d-ll9nd"] Sep 09 23:16:33.978500 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:16:33.978471 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf522543_f27e_41f7_b5f5_09be6ec64e31.slice/crio-d0514e162af267e3b6ff06d88fd319916ca3c6f7ed2b76515d1b9c55c4007294 WatchSource:0}: Error finding container d0514e162af267e3b6ff06d88fd319916ca3c6f7ed2b76515d1b9c55c4007294: Status 404 returned error can't find the container with id d0514e162af267e3b6ff06d88fd319916ca3c6f7ed2b76515d1b9c55c4007294 Sep 09 23:16:34.186210 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:34.186181 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5d8d86686c-hbkw4"] Sep 09 23:16:34.187786 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:16:34.187755 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1234d6c6_e69b_4932_bd90_bbd70450890c.slice/crio-41008411ec16b42c3a1d5b45a03dbdce5dad083e967affe621b2a298ca82d6c1 WatchSource:0}: Error finding container 41008411ec16b42c3a1d5b45a03dbdce5dad083e967affe621b2a298ca82d6c1: Status 404 returned error can't find the container with id 41008411ec16b42c3a1d5b45a03dbdce5dad083e967affe621b2a298ca82d6c1 Sep 09 23:16:34.403833 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:34.403795 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5d79dbff6d-ll9nd" event={"ID":"df522543-f27e-41f7-b5f5-09be6ec64e31","Type":"ContainerStarted","Data":"d0514e162af267e3b6ff06d88fd319916ca3c6f7ed2b76515d1b9c55c4007294"} Sep 09 23:16:34.405081 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:34.405052 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5d8d86686c-hbkw4" event={"ID":"1234d6c6-e69b-4932-bd90-bbd70450890c","Type":"ContainerStarted","Data":"41008411ec16b42c3a1d5b45a03dbdce5dad083e967affe621b2a298ca82d6c1"} Sep 09 23:16:37.431634 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:37.431594 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5d8d86686c-hbkw4" event={"ID":"1234d6c6-e69b-4932-bd90-bbd70450890c","Type":"ContainerStarted","Data":"8ab6eeb62510e282dc037720226c7d597e3467f0a9bf9102083869b239821b2e"} Sep 09 23:16:37.432148 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:37.431767 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5d8d86686c-hbkw4" Sep 09 23:16:37.433374 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:37.433343 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5d79dbff6d-ll9nd" event={"ID":"df522543-f27e-41f7-b5f5-09be6ec64e31","Type":"ContainerStarted","Data":"512cd703753d5da6c54e1c9259e43f83e77ad5b9612b4bd0d209ef191b71331d"} Sep 09 23:16:37.433486 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:37.433469 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5d79dbff6d-ll9nd" Sep 09 23:16:37.451726 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:37.451649 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5d8d86686c-hbkw4" podStartSLOduration=1.899030684 podStartE2EDuration="4.451627638s" totalImagesPullingTime="2.552596954s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:16:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:16:37.44865495 +0000 UTC m=+767.964385780" watchObservedRunningTime="2026-09-09 23:16:37.451627638 +0000 UTC m=+767.967358467" Sep 09 23:16:37.467919 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:37.467856 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5d79dbff6d-ll9nd" podStartSLOduration=1.713875688 podStartE2EDuration="4.467839051s" totalImagesPullingTime="2.753963363s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:16:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:16:37.465429421 +0000 UTC m=+767.981160250" watchObservedRunningTime="2026-09-09 23:16:37.467839051 +0000 UTC m=+767.983569881" Sep 09 23:16:48.442103 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:48.442068 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5d79dbff6d-ll9nd" Sep 09 23:16:48.442535 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:48.442151 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5d8d86686c-hbkw4" Sep 09 23:16:48.500517 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:48.500473 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5d79dbff6d-ll9nd"] Sep 09 23:16:48.511255 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:48.511179 2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5d79dbff6d-ll9nd" podUID="df522543-f27e-41f7-b5f5-09be6ec64e31" containerName="manager" containerID="cri-o://512cd703753d5da6c54e1c9259e43f83e77ad5b9612b4bd0d209ef191b71331d" gracePeriod=30 Sep 09 23:16:48.762159 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:48.762123 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5d79dbff6d-ll9nd" Sep 09 23:16:48.812114 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:48.812074 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/df522543-f27e-41f7-b5f5-09be6ec64e31-metrics-certs\") pod \"df522543-f27e-41f7-b5f5-09be6ec64e31\" (UID: \"df522543-f27e-41f7-b5f5-09be6ec64e31\") " Sep 09 23:16:48.812315 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:48.812126 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/df522543-f27e-41f7-b5f5-09be6ec64e31-webhook-cert\") pod \"df522543-f27e-41f7-b5f5-09be6ec64e31\" (UID: \"df522543-f27e-41f7-b5f5-09be6ec64e31\") " Sep 09 23:16:48.812315 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:48.812160 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8lz44\" (UniqueName: \"kubernetes.io/projected/df522543-f27e-41f7-b5f5-09be6ec64e31-kube-api-access-8lz44\") pod \"df522543-f27e-41f7-b5f5-09be6ec64e31\" (UID: \"df522543-f27e-41f7-b5f5-09be6ec64e31\") " Sep 09 23:16:48.814384 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:48.814347 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/df522543-f27e-41f7-b5f5-09be6ec64e31-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "df522543-f27e-41f7-b5f5-09be6ec64e31" (UID: "df522543-f27e-41f7-b5f5-09be6ec64e31"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:16:48.814384 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:48.814366 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/df522543-f27e-41f7-b5f5-09be6ec64e31-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "df522543-f27e-41f7-b5f5-09be6ec64e31" (UID: "df522543-f27e-41f7-b5f5-09be6ec64e31"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:16:48.814555 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:48.814364 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df522543-f27e-41f7-b5f5-09be6ec64e31-kube-api-access-8lz44" (OuterVolumeSpecName: "kube-api-access-8lz44") pod "df522543-f27e-41f7-b5f5-09be6ec64e31" (UID: "df522543-f27e-41f7-b5f5-09be6ec64e31"). InnerVolumeSpecName "kube-api-access-8lz44". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:16:48.913573 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:48.913540 2552 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/df522543-f27e-41f7-b5f5-09be6ec64e31-metrics-certs\") on node \"ip-10-0-142-217.ec2.internal\" DevicePath \"\"" Sep 09 23:16:48.913573 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:48.913567 2552 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/df522543-f27e-41f7-b5f5-09be6ec64e31-webhook-cert\") on node \"ip-10-0-142-217.ec2.internal\" DevicePath \"\"" Sep 09 23:16:48.913573 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:48.913577 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8lz44\" (UniqueName: \"kubernetes.io/projected/df522543-f27e-41f7-b5f5-09be6ec64e31-kube-api-access-8lz44\") on node \"ip-10-0-142-217.ec2.internal\" DevicePath \"\"" Sep 09 23:16:49.517733 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:49.517665 2552 generic.go:356] "Generic (PLEG): container finished" podID="df522543-f27e-41f7-b5f5-09be6ec64e31" containerID="512cd703753d5da6c54e1c9259e43f83e77ad5b9612b4bd0d209ef191b71331d" exitCode=0 Sep 09 23:16:49.517733 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:49.517711 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5d79dbff6d-ll9nd" event={"ID":"df522543-f27e-41f7-b5f5-09be6ec64e31","Type":"ContainerDied","Data":"512cd703753d5da6c54e1c9259e43f83e77ad5b9612b4bd0d209ef191b71331d"} Sep 09 23:16:49.518213 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:49.517742 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5d79dbff6d-ll9nd" Sep 09 23:16:49.518213 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:49.517769 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5d79dbff6d-ll9nd" event={"ID":"df522543-f27e-41f7-b5f5-09be6ec64e31","Type":"ContainerDied","Data":"d0514e162af267e3b6ff06d88fd319916ca3c6f7ed2b76515d1b9c55c4007294"} Sep 09 23:16:49.518213 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:49.517795 2552 scope.go:117] "RemoveContainer" containerID="512cd703753d5da6c54e1c9259e43f83e77ad5b9612b4bd0d209ef191b71331d" Sep 09 23:16:49.528164 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:49.528143 2552 scope.go:117] "RemoveContainer" containerID="512cd703753d5da6c54e1c9259e43f83e77ad5b9612b4bd0d209ef191b71331d" Sep 09 23:16:49.528471 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:16:49.528450 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"512cd703753d5da6c54e1c9259e43f83e77ad5b9612b4bd0d209ef191b71331d\": container with ID starting with 512cd703753d5da6c54e1c9259e43f83e77ad5b9612b4bd0d209ef191b71331d not found: ID does not exist" containerID="512cd703753d5da6c54e1c9259e43f83e77ad5b9612b4bd0d209ef191b71331d" Sep 09 23:16:49.528539 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:49.528481 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"512cd703753d5da6c54e1c9259e43f83e77ad5b9612b4bd0d209ef191b71331d"} err="failed to get container status \"512cd703753d5da6c54e1c9259e43f83e77ad5b9612b4bd0d209ef191b71331d\": rpc error: code = NotFound desc = could not find container \"512cd703753d5da6c54e1c9259e43f83e77ad5b9612b4bd0d209ef191b71331d\": container with ID starting with 512cd703753d5da6c54e1c9259e43f83e77ad5b9612b4bd0d209ef191b71331d not found: ID does not exist" Sep 09 23:16:49.539157 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:49.539125 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5d79dbff6d-ll9nd"] Sep 09 23:16:49.542220 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:49.542194 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5d79dbff6d-ll9nd"] Sep 09 23:16:49.945648 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:16:49.945603 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df522543-f27e-41f7-b5f5-09be6ec64e31" path="/var/lib/kubelet/pods/df522543-f27e-41f7-b5f5-09be6ec64e31/volumes" Sep 09 23:17:10.586858 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:10.586808 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-7f6697c9f6-8l6dw"] Sep 09 23:17:10.587356 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:10.587209 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df522543-f27e-41f7-b5f5-09be6ec64e31" containerName="manager" Sep 09 23:17:10.587356 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:10.587236 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="df522543-f27e-41f7-b5f5-09be6ec64e31" containerName="manager" Sep 09 23:17:10.587356 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:10.587308 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="df522543-f27e-41f7-b5f5-09be6ec64e31" containerName="manager" Sep 09 23:17:10.593373 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:10.593340 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7f6697c9f6-8l6dw" Sep 09 23:17:10.595576 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:10.595548 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\"" Sep 09 23:17:10.595767 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:10.595551 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-pmjlm\"" Sep 09 23:17:10.595767 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:10.595551 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Sep 09 23:17:10.596439 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:10.596418 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Sep 09 23:17:10.596597 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:10.596429 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Sep 09 23:17:10.600797 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:10.600770 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7f6697c9f6-8l6dw"] Sep 09 23:17:10.711026 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:10.710982 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pd7dj\" (UniqueName: \"kubernetes.io/projected/9cac82dd-e2a9-476c-83ff-c8473044fea8-kube-api-access-pd7dj\") pod \"maas-api-7f6697c9f6-8l6dw\" (UID: \"9cac82dd-e2a9-476c-83ff-c8473044fea8\") " pod="odh-ai-gateway-infra/maas-api-7f6697c9f6-8l6dw" Sep 09 23:17:10.711181 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:10.711063 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9cac82dd-e2a9-476c-83ff-c8473044fea8-openshift-service-ca\") pod \"maas-api-7f6697c9f6-8l6dw\" (UID: \"9cac82dd-e2a9-476c-83ff-c8473044fea8\") " pod="odh-ai-gateway-infra/maas-api-7f6697c9f6-8l6dw" Sep 09 23:17:10.711181 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:10.711086 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9cac82dd-e2a9-476c-83ff-c8473044fea8-metrics-certs\") pod \"maas-api-7f6697c9f6-8l6dw\" (UID: \"9cac82dd-e2a9-476c-83ff-c8473044fea8\") " pod="odh-ai-gateway-infra/maas-api-7f6697c9f6-8l6dw" Sep 09 23:17:10.711181 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:10.711114 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9cac82dd-e2a9-476c-83ff-c8473044fea8-maas-api-tls\") pod \"maas-api-7f6697c9f6-8l6dw\" (UID: \"9cac82dd-e2a9-476c-83ff-c8473044fea8\") " pod="odh-ai-gateway-infra/maas-api-7f6697c9f6-8l6dw" Sep 09 23:17:10.812470 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:10.812414 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9cac82dd-e2a9-476c-83ff-c8473044fea8-openshift-service-ca\") pod \"maas-api-7f6697c9f6-8l6dw\" (UID: \"9cac82dd-e2a9-476c-83ff-c8473044fea8\") " pod="odh-ai-gateway-infra/maas-api-7f6697c9f6-8l6dw" Sep 09 23:17:10.812470 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:10.812474 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9cac82dd-e2a9-476c-83ff-c8473044fea8-metrics-certs\") pod \"maas-api-7f6697c9f6-8l6dw\" (UID: \"9cac82dd-e2a9-476c-83ff-c8473044fea8\") " pod="odh-ai-gateway-infra/maas-api-7f6697c9f6-8l6dw" Sep 09 23:17:10.812779 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:10.812504 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9cac82dd-e2a9-476c-83ff-c8473044fea8-maas-api-tls\") pod \"maas-api-7f6697c9f6-8l6dw\" (UID: \"9cac82dd-e2a9-476c-83ff-c8473044fea8\") " pod="odh-ai-gateway-infra/maas-api-7f6697c9f6-8l6dw" Sep 09 23:17:10.812779 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:10.812555 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pd7dj\" (UniqueName: \"kubernetes.io/projected/9cac82dd-e2a9-476c-83ff-c8473044fea8-kube-api-access-pd7dj\") pod \"maas-api-7f6697c9f6-8l6dw\" (UID: \"9cac82dd-e2a9-476c-83ff-c8473044fea8\") " pod="odh-ai-gateway-infra/maas-api-7f6697c9f6-8l6dw" Sep 09 23:17:10.813284 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:10.813258 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9cac82dd-e2a9-476c-83ff-c8473044fea8-openshift-service-ca\") pod \"maas-api-7f6697c9f6-8l6dw\" (UID: \"9cac82dd-e2a9-476c-83ff-c8473044fea8\") " pod="odh-ai-gateway-infra/maas-api-7f6697c9f6-8l6dw" Sep 09 23:17:10.815169 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:10.815139 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9cac82dd-e2a9-476c-83ff-c8473044fea8-metrics-certs\") pod \"maas-api-7f6697c9f6-8l6dw\" (UID: \"9cac82dd-e2a9-476c-83ff-c8473044fea8\") " pod="odh-ai-gateway-infra/maas-api-7f6697c9f6-8l6dw" Sep 09 23:17:10.815266 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:10.815205 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9cac82dd-e2a9-476c-83ff-c8473044fea8-maas-api-tls\") pod \"maas-api-7f6697c9f6-8l6dw\" (UID: \"9cac82dd-e2a9-476c-83ff-c8473044fea8\") " pod="odh-ai-gateway-infra/maas-api-7f6697c9f6-8l6dw" Sep 09 23:17:10.819866 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:10.819844 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pd7dj\" (UniqueName: \"kubernetes.io/projected/9cac82dd-e2a9-476c-83ff-c8473044fea8-kube-api-access-pd7dj\") pod \"maas-api-7f6697c9f6-8l6dw\" (UID: \"9cac82dd-e2a9-476c-83ff-c8473044fea8\") " pod="odh-ai-gateway-infra/maas-api-7f6697c9f6-8l6dw" Sep 09 23:17:10.906970 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:10.906930 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7f6697c9f6-8l6dw" Sep 09 23:17:11.189824 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:11.189794 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7f6697c9f6-8l6dw"] Sep 09 23:17:11.191814 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:17:11.191785 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cac82dd_e2a9_476c_83ff_c8473044fea8.slice/crio-f9c17d4d96630f81b0c160c95e7fa6ba1f8b78bbded19836321b1a5b4813e078 WatchSource:0}: Error finding container f9c17d4d96630f81b0c160c95e7fa6ba1f8b78bbded19836321b1a5b4813e078: Status 404 returned error can't find the container with id f9c17d4d96630f81b0c160c95e7fa6ba1f8b78bbded19836321b1a5b4813e078 Sep 09 23:17:11.193243 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:11.193223 2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 09 23:17:11.207849 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:11.207815 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-ksm7w"] Sep 09 23:17:11.211585 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:11.211565 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-ksm7w" Sep 09 23:17:11.213742 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:11.213658 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-4cdmw\"" Sep 09 23:17:11.213742 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:11.213721 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Sep 09 23:17:11.218974 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:11.218946 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-ksm7w"] Sep 09 23:17:11.318637 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:11.318600 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6mkk\" (UniqueName: \"kubernetes.io/projected/bf6f1fd6-ac3e-472d-a1cc-aafcb78f707a-kube-api-access-t6mkk\") pod \"payload-processing-5b54b7fbb7-ksm7w\" (UID: \"bf6f1fd6-ac3e-472d-a1cc-aafcb78f707a\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-ksm7w" Sep 09 23:17:11.318819 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:11.318691 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bf6f1fd6-ac3e-472d-a1cc-aafcb78f707a-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-ksm7w\" (UID: \"bf6f1fd6-ac3e-472d-a1cc-aafcb78f707a\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-ksm7w" Sep 09 23:17:11.419438 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:11.419392 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bf6f1fd6-ac3e-472d-a1cc-aafcb78f707a-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-ksm7w\" (UID: \"bf6f1fd6-ac3e-472d-a1cc-aafcb78f707a\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-ksm7w" Sep 09 23:17:11.419614 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:11.419473 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6mkk\" (UniqueName: \"kubernetes.io/projected/bf6f1fd6-ac3e-472d-a1cc-aafcb78f707a-kube-api-access-t6mkk\") pod \"payload-processing-5b54b7fbb7-ksm7w\" (UID: \"bf6f1fd6-ac3e-472d-a1cc-aafcb78f707a\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-ksm7w" Sep 09 23:17:11.420233 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:11.420213 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bf6f1fd6-ac3e-472d-a1cc-aafcb78f707a-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-ksm7w\" (UID: \"bf6f1fd6-ac3e-472d-a1cc-aafcb78f707a\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-ksm7w" Sep 09 23:17:11.426985 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:11.426959 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6mkk\" (UniqueName: \"kubernetes.io/projected/bf6f1fd6-ac3e-472d-a1cc-aafcb78f707a-kube-api-access-t6mkk\") pod \"payload-processing-5b54b7fbb7-ksm7w\" (UID: \"bf6f1fd6-ac3e-472d-a1cc-aafcb78f707a\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-ksm7w" Sep 09 23:17:11.525305 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:11.525199 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-ksm7w" Sep 09 23:17:11.643657 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:11.643618 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7f6697c9f6-8l6dw" event={"ID":"9cac82dd-e2a9-476c-83ff-c8473044fea8","Type":"ContainerStarted","Data":"f9c17d4d96630f81b0c160c95e7fa6ba1f8b78bbded19836321b1a5b4813e078"} Sep 09 23:17:11.802564 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:11.802529 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-ksm7w"] Sep 09 23:17:11.804473 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:17:11.804446 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf6f1fd6_ac3e_472d_a1cc_aafcb78f707a.slice/crio-c381ed014082dc8a9dac936e9e8ac519a358762bc6c1ab822ccc702a68fb1f99 WatchSource:0}: Error finding container c381ed014082dc8a9dac936e9e8ac519a358762bc6c1ab822ccc702a68fb1f99: Status 404 returned error can't find the container with id c381ed014082dc8a9dac936e9e8ac519a358762bc6c1ab822ccc702a68fb1f99 Sep 09 23:17:12.667120 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:12.667075 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-ksm7w" event={"ID":"bf6f1fd6-ac3e-472d-a1cc-aafcb78f707a","Type":"ContainerStarted","Data":"c381ed014082dc8a9dac936e9e8ac519a358762bc6c1ab822ccc702a68fb1f99"} Sep 09 23:17:13.677223 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:13.677174 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7f6697c9f6-8l6dw" event={"ID":"9cac82dd-e2a9-476c-83ff-c8473044fea8","Type":"ContainerStarted","Data":"d2aa03d208548e51dc8001841688a735ece5ad3c464eaa0310af397735daa2ac"} Sep 09 23:17:13.677737 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:13.677314 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-7f6697c9f6-8l6dw" Sep 09 23:17:13.693086 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:13.693030 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-7f6697c9f6-8l6dw" podStartSLOduration=1.567102859 podStartE2EDuration="3.693006959s" totalImagesPullingTime="2.1259041s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:17:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:17:13.691416581 +0000 UTC m=+804.207147402" watchObservedRunningTime="2026-09-09 23:17:13.693006959 +0000 UTC m=+804.208737791" Sep 09 23:17:14.685951 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:14.685915 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-ksm7w" event={"ID":"bf6f1fd6-ac3e-472d-a1cc-aafcb78f707a","Type":"ContainerStarted","Data":"cccaedbd9a982260f2b2031f164e7e5c66a526e500c228500508a95727ab531f"} Sep 09 23:17:14.686389 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:14.685993 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-ksm7w" Sep 09 23:17:14.702936 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:14.702877 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-ksm7w" podStartSLOduration=1.6005092539999999 podStartE2EDuration="3.702860563s" totalImagesPullingTime="2.102351309s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:17:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:17:14.69984134 +0000 UTC m=+805.215572173" watchObservedRunningTime="2026-09-09 23:17:14.702860563 +0000 UTC m=+805.218591393" Sep 09 23:17:19.165864 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:19.165818 2552 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-2r2l5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Sep 09 23:17:19.166338 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:19.165885 2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2r2l5" podUID="1a434206-4afc-46b6-aff6-d4f5a2ff28fb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Sep 09 23:17:19.693031 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:19.693000 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-7f6697c9f6-8l6dw" Sep 09 23:17:21.731121 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:21.731083 2552 generic.go:356] "Generic (PLEG): container finished" podID="1a434206-4afc-46b6-aff6-d4f5a2ff28fb" containerID="32b9e6f6322ba4a2bcb4b88b01617d2d9d9e3193e26be3731bfae41a495fb3bc" exitCode=0 Sep 09 23:17:21.731659 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:21.731162 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2r2l5" event={"ID":"1a434206-4afc-46b6-aff6-d4f5a2ff28fb","Type":"ContainerDied","Data":"32b9e6f6322ba4a2bcb4b88b01617d2d9d9e3193e26be3731bfae41a495fb3bc"} Sep 09 23:17:21.731785 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:21.731726 2552 scope.go:117] "RemoveContainer" containerID="32b9e6f6322ba4a2bcb4b88b01617d2d9d9e3193e26be3731bfae41a495fb3bc" Sep 09 23:17:21.732826 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:21.732796 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 09 23:17:21.732908 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:21.732867 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 09 23:17:21.732908 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:21.732900 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 09 23:17:22.760989 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:22.749790 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2r2l5" event={"ID":"1a434206-4afc-46b6-aff6-d4f5a2ff28fb","Type":"ContainerStarted","Data":"f0bb86ec7b63438422e2c7a6b95c5f96c4b35137a7a47ba75e08f7fda4587eb1"} Sep 09 23:17:23.195034 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:23.194988 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2r2l5" Sep 09 23:17:23.195256 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:23.195230 2552 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-2r2l5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body= Sep 09 23:17:23.195340 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:23.195295 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2r2l5" podUID="1a434206-4afc-46b6-aff6-d4f5a2ff28fb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" Sep 09 23:17:24.195167 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:24.195128 2552 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-2r2l5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body= Sep 09 23:17:24.195583 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:24.195204 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2r2l5" podUID="1a434206-4afc-46b6-aff6-d4f5a2ff28fb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" Sep 09 23:17:25.195730 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:25.195662 2552 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-2r2l5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body= Sep 09 23:17:25.196127 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:25.195755 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2r2l5" podUID="1a434206-4afc-46b6-aff6-d4f5a2ff28fb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" Sep 09 23:17:25.695365 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:25.695335 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-ksm7w" Sep 09 23:17:26.195343 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:26.195304 2552 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-2r2l5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body= Sep 09 23:17:26.195522 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:26.195367 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2r2l5" podUID="1a434206-4afc-46b6-aff6-d4f5a2ff28fb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" Sep 09 23:17:27.194974 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:27.194927 2552 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-2r2l5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body= Sep 09 23:17:27.195369 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:27.194999 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2r2l5" podUID="1a434206-4afc-46b6-aff6-d4f5a2ff28fb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" Sep 09 23:17:28.198912 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:28.198879 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2r2l5" Sep 09 23:17:28.199299 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:28.199142 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2r2l5" Sep 09 23:17:28.200004 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:28.199985 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2r2l5" Sep 09 23:17:57.686689 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:57.686633 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-6685d86975-2b8vd"] Sep 09 23:17:57.690506 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:57.690486 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-6685d86975-2b8vd" Sep 09 23:17:57.693565 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:57.693537 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Sep 09 23:17:57.693750 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:57.693538 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Sep 09 23:17:57.693750 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:57.693542 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-jr9l5\"" Sep 09 23:17:57.693750 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:57.693547 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Sep 09 23:17:57.697506 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:57.697477 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-6685d86975-2b8vd"] Sep 09 23:17:57.784638 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:57.784601 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e78acce9-b9e7-41cb-bdff-ca8a1114e16b-model-cache\") pod \"e2e-distinct-simulated-kserve-6685d86975-2b8vd\" (UID: \"e78acce9-b9e7-41cb-bdff-ca8a1114e16b\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-2b8vd" Sep 09 23:17:57.784859 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:57.784655 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e78acce9-b9e7-41cb-bdff-ca8a1114e16b-tmp-dir\") pod \"e2e-distinct-simulated-kserve-6685d86975-2b8vd\" (UID: \"e78acce9-b9e7-41cb-bdff-ca8a1114e16b\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-2b8vd" Sep 09 23:17:57.784859 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:57.784754 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e78acce9-b9e7-41cb-bdff-ca8a1114e16b-dshm\") pod \"e2e-distinct-simulated-kserve-6685d86975-2b8vd\" (UID: \"e78acce9-b9e7-41cb-bdff-ca8a1114e16b\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-2b8vd" Sep 09 23:17:57.784859 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:57.784820 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e78acce9-b9e7-41cb-bdff-ca8a1114e16b-tls-certs\") pod \"e2e-distinct-simulated-kserve-6685d86975-2b8vd\" (UID: \"e78acce9-b9e7-41cb-bdff-ca8a1114e16b\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-2b8vd" Sep 09 23:17:57.785032 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:57.784875 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4lcw\" (UniqueName: \"kubernetes.io/projected/e78acce9-b9e7-41cb-bdff-ca8a1114e16b-kube-api-access-j4lcw\") pod \"e2e-distinct-simulated-kserve-6685d86975-2b8vd\" (UID: \"e78acce9-b9e7-41cb-bdff-ca8a1114e16b\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-2b8vd" Sep 09 23:17:57.785032 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:57.784930 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e78acce9-b9e7-41cb-bdff-ca8a1114e16b-home\") pod \"e2e-distinct-simulated-kserve-6685d86975-2b8vd\" (UID: \"e78acce9-b9e7-41cb-bdff-ca8a1114e16b\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-2b8vd" Sep 09 23:17:57.885426 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:57.885381 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e78acce9-b9e7-41cb-bdff-ca8a1114e16b-tmp-dir\") pod \"e2e-distinct-simulated-kserve-6685d86975-2b8vd\" (UID: \"e78acce9-b9e7-41cb-bdff-ca8a1114e16b\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-2b8vd" Sep 09 23:17:57.885629 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:57.885439 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e78acce9-b9e7-41cb-bdff-ca8a1114e16b-dshm\") pod \"e2e-distinct-simulated-kserve-6685d86975-2b8vd\" (UID: \"e78acce9-b9e7-41cb-bdff-ca8a1114e16b\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-2b8vd" Sep 09 23:17:57.885629 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:57.885486 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e78acce9-b9e7-41cb-bdff-ca8a1114e16b-tls-certs\") pod \"e2e-distinct-simulated-kserve-6685d86975-2b8vd\" (UID: \"e78acce9-b9e7-41cb-bdff-ca8a1114e16b\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-2b8vd" Sep 09 23:17:57.885629 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:57.885531 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4lcw\" (UniqueName: \"kubernetes.io/projected/e78acce9-b9e7-41cb-bdff-ca8a1114e16b-kube-api-access-j4lcw\") pod \"e2e-distinct-simulated-kserve-6685d86975-2b8vd\" (UID: \"e78acce9-b9e7-41cb-bdff-ca8a1114e16b\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-2b8vd" Sep 09 23:17:57.885629 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:57.885586 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e78acce9-b9e7-41cb-bdff-ca8a1114e16b-home\") pod \"e2e-distinct-simulated-kserve-6685d86975-2b8vd\" (UID: \"e78acce9-b9e7-41cb-bdff-ca8a1114e16b\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-2b8vd" Sep 09 23:17:57.885629 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:57.885628 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e78acce9-b9e7-41cb-bdff-ca8a1114e16b-model-cache\") pod \"e2e-distinct-simulated-kserve-6685d86975-2b8vd\" (UID: \"e78acce9-b9e7-41cb-bdff-ca8a1114e16b\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-2b8vd" Sep 09 23:17:57.885992 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:57.885936 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e78acce9-b9e7-41cb-bdff-ca8a1114e16b-tmp-dir\") pod \"e2e-distinct-simulated-kserve-6685d86975-2b8vd\" (UID: \"e78acce9-b9e7-41cb-bdff-ca8a1114e16b\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-2b8vd" Sep 09 23:17:57.886051 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:57.886003 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e78acce9-b9e7-41cb-bdff-ca8a1114e16b-model-cache\") pod \"e2e-distinct-simulated-kserve-6685d86975-2b8vd\" (UID: \"e78acce9-b9e7-41cb-bdff-ca8a1114e16b\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-2b8vd" Sep 09 23:17:57.886051 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:57.886032 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e78acce9-b9e7-41cb-bdff-ca8a1114e16b-home\") pod \"e2e-distinct-simulated-kserve-6685d86975-2b8vd\" (UID: \"e78acce9-b9e7-41cb-bdff-ca8a1114e16b\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-2b8vd" Sep 09 23:17:57.887888 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:57.887864 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e78acce9-b9e7-41cb-bdff-ca8a1114e16b-dshm\") pod \"e2e-distinct-simulated-kserve-6685d86975-2b8vd\" (UID: \"e78acce9-b9e7-41cb-bdff-ca8a1114e16b\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-2b8vd" Sep 09 23:17:57.888111 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:57.888091 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e78acce9-b9e7-41cb-bdff-ca8a1114e16b-tls-certs\") pod \"e2e-distinct-simulated-kserve-6685d86975-2b8vd\" (UID: \"e78acce9-b9e7-41cb-bdff-ca8a1114e16b\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-2b8vd" Sep 09 23:17:57.892432 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:57.892406 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4lcw\" (UniqueName: \"kubernetes.io/projected/e78acce9-b9e7-41cb-bdff-ca8a1114e16b-kube-api-access-j4lcw\") pod \"e2e-distinct-simulated-kserve-6685d86975-2b8vd\" (UID: \"e78acce9-b9e7-41cb-bdff-ca8a1114e16b\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-2b8vd" Sep 09 23:17:58.002936 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:58.002834 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-6685d86975-2b8vd" Sep 09 23:17:58.279198 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:58.279162 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-6685d86975-2b8vd"] Sep 09 23:17:58.281833 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:17:58.281803 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode78acce9_b9e7_41cb_bdff_ca8a1114e16b.slice/crio-ba221135d93bad4dd5ebfdb9d33119e037df41c111e09a7c53e64c53e5f785a0 WatchSource:0}: Error finding container ba221135d93bad4dd5ebfdb9d33119e037df41c111e09a7c53e64c53e5f785a0: Status 404 returned error can't find the container with id ba221135d93bad4dd5ebfdb9d33119e037df41c111e09a7c53e64c53e5f785a0 Sep 09 23:17:58.963017 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:58.962980 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-2b8vd" event={"ID":"e78acce9-b9e7-41cb-bdff-ca8a1114e16b","Type":"ContainerStarted","Data":"ba221135d93bad4dd5ebfdb9d33119e037df41c111e09a7c53e64c53e5f785a0"} Sep 09 23:17:59.969933 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:59.969889 2552 generic.go:356] "Generic (PLEG): container finished" podID="e78acce9-b9e7-41cb-bdff-ca8a1114e16b" containerID="3d962a291ed5ccace877cb6792d8d82c2e89ed9a25ffe39de7a16c6b0b4282d9" exitCode=0 Sep 09 23:17:59.970371 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:59.969979 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-2b8vd" event={"ID":"e78acce9-b9e7-41cb-bdff-ca8a1114e16b","Type":"ContainerDied","Data":"3d962a291ed5ccace877cb6792d8d82c2e89ed9a25ffe39de7a16c6b0b4282d9"} Sep 09 23:17:59.970371 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:17:59.970200 2552 scope.go:117] "RemoveContainer" containerID="3d962a291ed5ccace877cb6792d8d82c2e89ed9a25ffe39de7a16c6b0b4282d9" Sep 09 23:18:00.977494 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:18:00.977455 2552 generic.go:356] "Generic (PLEG): container finished" podID="e78acce9-b9e7-41cb-bdff-ca8a1114e16b" containerID="4d32d33e546e402f47a5c6dbf69416076bd4e117e23ca25c3d6a16c6b4591f85" exitCode=0 Sep 09 23:18:00.977915 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:18:00.977542 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-2b8vd" event={"ID":"e78acce9-b9e7-41cb-bdff-ca8a1114e16b","Type":"ContainerDied","Data":"4d32d33e546e402f47a5c6dbf69416076bd4e117e23ca25c3d6a16c6b4591f85"} Sep 09 23:18:00.977915 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:18:00.977617 2552 scope.go:117] "RemoveContainer" containerID="3d962a291ed5ccace877cb6792d8d82c2e89ed9a25ffe39de7a16c6b0b4282d9" Sep 09 23:18:00.978008 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:18:00.977953 2552 scope.go:117] "RemoveContainer" containerID="4d32d33e546e402f47a5c6dbf69416076bd4e117e23ca25c3d6a16c6b4591f85" Sep 09 23:18:00.978202 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:18:00.978183 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-2b8vd_llm(e78acce9-b9e7-41cb-bdff-ca8a1114e16b)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-2b8vd" podUID="e78acce9-b9e7-41cb-bdff-ca8a1114e16b" Sep 09 23:18:01.985971 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:18:01.985937 2552 scope.go:117] "RemoveContainer" containerID="4d32d33e546e402f47a5c6dbf69416076bd4e117e23ca25c3d6a16c6b4591f85" Sep 09 23:18:01.986370 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:18:01.986153 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-2b8vd_llm(e78acce9-b9e7-41cb-bdff-ca8a1114e16b)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-2b8vd" podUID="e78acce9-b9e7-41cb-bdff-ca8a1114e16b" Sep 09 23:18:08.002953 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:18:08.002907 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-6685d86975-2b8vd" Sep 09 23:18:08.003415 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:18:08.002980 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-2b8vd" Sep 09 23:18:08.003415 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:18:08.002998 2552 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-2b8vd" Sep 09 23:18:08.003415 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:18:08.003011 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-2b8vd" Sep 09 23:18:08.003531 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:18:08.003476 2552 scope.go:117] "RemoveContainer" containerID="4d32d33e546e402f47a5c6dbf69416076bd4e117e23ca25c3d6a16c6b4591f85" Sep 09 23:18:08.003757 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:18:08.003731 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-2b8vd_llm(e78acce9-b9e7-41cb-bdff-ca8a1114e16b)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-2b8vd" podUID="e78acce9-b9e7-41cb-bdff-ca8a1114e16b" Sep 09 23:18:08.023740 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:18:08.023707 2552 scope.go:117] "RemoveContainer" containerID="4d32d33e546e402f47a5c6dbf69416076bd4e117e23ca25c3d6a16c6b4591f85" Sep 09 23:18:08.024099 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:18:08.024069 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-2b8vd_llm(e78acce9-b9e7-41cb-bdff-ca8a1114e16b)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-2b8vd" podUID="e78acce9-b9e7-41cb-bdff-ca8a1114e16b" Sep 09 23:18:18.933118 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:18:18.933085 2552 scope.go:117] "RemoveContainer" containerID="4d32d33e546e402f47a5c6dbf69416076bd4e117e23ca25c3d6a16c6b4591f85" Sep 09 23:18:20.095434 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:18:20.095401 2552 generic.go:356] "Generic (PLEG): container finished" podID="e78acce9-b9e7-41cb-bdff-ca8a1114e16b" containerID="cc8a9c3dde331afbd90babaabcd9ddfd1798a47cf258f9e08047fe7e5993c35c" exitCode=0 Sep 09 23:18:20.095925 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:18:20.095477 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-2b8vd" event={"ID":"e78acce9-b9e7-41cb-bdff-ca8a1114e16b","Type":"ContainerDied","Data":"cc8a9c3dde331afbd90babaabcd9ddfd1798a47cf258f9e08047fe7e5993c35c"} Sep 09 23:18:20.095925 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:18:20.095541 2552 scope.go:117] "RemoveContainer" containerID="4d32d33e546e402f47a5c6dbf69416076bd4e117e23ca25c3d6a16c6b4591f85" Sep 09 23:18:20.096060 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:18:20.095935 2552 scope.go:117] "RemoveContainer" containerID="cc8a9c3dde331afbd90babaabcd9ddfd1798a47cf258f9e08047fe7e5993c35c" Sep 09 23:18:20.096148 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:18:20.096125 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-2b8vd_llm(e78acce9-b9e7-41cb-bdff-ca8a1114e16b)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-2b8vd" podUID="e78acce9-b9e7-41cb-bdff-ca8a1114e16b" Sep 09 23:18:28.003898 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:18:28.003844 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-6685d86975-2b8vd" Sep 09 23:18:28.004343 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:18:28.003928 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-2b8vd" Sep 09 23:18:28.004343 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:18:28.003946 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-2b8vd" Sep 09 23:18:28.004343 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:18:28.003959 2552 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-2b8vd" Sep 09 23:18:28.004443 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:18:28.004357 2552 scope.go:117] "RemoveContainer" containerID="cc8a9c3dde331afbd90babaabcd9ddfd1798a47cf258f9e08047fe7e5993c35c" Sep 09 23:18:28.004571 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:18:28.004551 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-2b8vd_llm(e78acce9-b9e7-41cb-bdff-ca8a1114e16b)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-2b8vd" podUID="e78acce9-b9e7-41cb-bdff-ca8a1114e16b" Sep 09 23:18:38.933129 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:18:38.933093 2552 scope.go:117] "RemoveContainer" containerID="cc8a9c3dde331afbd90babaabcd9ddfd1798a47cf258f9e08047fe7e5993c35c" Sep 09 23:18:38.933558 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:18:38.933271 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-2b8vd_llm(e78acce9-b9e7-41cb-bdff-ca8a1114e16b)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-2b8vd" podUID="e78acce9-b9e7-41cb-bdff-ca8a1114e16b" Sep 09 23:18:49.954344 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:18:49.954311 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-p2dvt_ac335ac0-a272-420f-a215-b93e03772895/console-operator/1.log" Sep 09 23:18:49.954344 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:18:49.954329 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-p2dvt_ac335ac0-a272-420f-a215-b93e03772895/console-operator/1.log" Sep 09 23:18:49.960658 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:18:49.960632 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6x9hk_2f52574e-96c0-4939-9826-4959aeae1c8b/ovn-acl-logging/0.log" Sep 09 23:18:49.960844 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:18:49.960716 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6x9hk_2f52574e-96c0-4939-9826-4959aeae1c8b/ovn-acl-logging/0.log" Sep 09 23:18:50.933035 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:18:50.933002 2552 scope.go:117] "RemoveContainer" containerID="cc8a9c3dde331afbd90babaabcd9ddfd1798a47cf258f9e08047fe7e5993c35c" Sep 09 23:18:51.299812 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:18:51.299780 2552 generic.go:356] "Generic (PLEG): container finished" podID="e78acce9-b9e7-41cb-bdff-ca8a1114e16b" containerID="654eca86de544ccd5d6a11397c2c24265ae8638bc6da26d5bfbfc05a322dd491" exitCode=0 Sep 09 23:18:51.300248 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:18:51.299865 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-2b8vd" event={"ID":"e78acce9-b9e7-41cb-bdff-ca8a1114e16b","Type":"ContainerDied","Data":"654eca86de544ccd5d6a11397c2c24265ae8638bc6da26d5bfbfc05a322dd491"} Sep 09 23:18:51.300248 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:18:51.299945 2552 scope.go:117] "RemoveContainer" containerID="cc8a9c3dde331afbd90babaabcd9ddfd1798a47cf258f9e08047fe7e5993c35c" Sep 09 23:18:51.300375 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:18:51.300360 2552 scope.go:117] "RemoveContainer" containerID="654eca86de544ccd5d6a11397c2c24265ae8638bc6da26d5bfbfc05a322dd491" Sep 09 23:18:51.300587 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:18:51.300563 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-2b8vd_llm(e78acce9-b9e7-41cb-bdff-ca8a1114e16b)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-2b8vd" podUID="e78acce9-b9e7-41cb-bdff-ca8a1114e16b" Sep 09 23:18:58.003369 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:18:58.003317 2552 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-2b8vd" Sep 09 23:18:58.003914 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:18:58.003393 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-6685d86975-2b8vd" Sep 09 23:18:58.003914 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:18:58.003410 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-2b8vd" Sep 09 23:18:58.003914 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:18:58.003425 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-2b8vd" Sep 09 23:18:58.003914 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:18:58.003856 2552 scope.go:117] "RemoveContainer" containerID="654eca86de544ccd5d6a11397c2c24265ae8638bc6da26d5bfbfc05a322dd491" Sep 09 23:18:58.004059 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:18:58.004037 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-2b8vd_llm(e78acce9-b9e7-41cb-bdff-ca8a1114e16b)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-2b8vd" podUID="e78acce9-b9e7-41cb-bdff-ca8a1114e16b" Sep 09 23:19:10.933168 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:19:10.933135 2552 scope.go:117] "RemoveContainer" containerID="654eca86de544ccd5d6a11397c2c24265ae8638bc6da26d5bfbfc05a322dd491" Sep 09 23:19:10.934018 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:19:10.933327 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-2b8vd_llm(e78acce9-b9e7-41cb-bdff-ca8a1114e16b)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-2b8vd" podUID="e78acce9-b9e7-41cb-bdff-ca8a1114e16b" Sep 09 23:19:22.933658 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:19:22.933622 2552 scope.go:117] "RemoveContainer" containerID="654eca86de544ccd5d6a11397c2c24265ae8638bc6da26d5bfbfc05a322dd491" Sep 09 23:19:22.934223 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:19:22.933872 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-2b8vd_llm(e78acce9-b9e7-41cb-bdff-ca8a1114e16b)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-2b8vd" podUID="e78acce9-b9e7-41cb-bdff-ca8a1114e16b" Sep 09 23:19:37.932940 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:19:37.932908 2552 scope.go:117] "RemoveContainer" containerID="654eca86de544ccd5d6a11397c2c24265ae8638bc6da26d5bfbfc05a322dd491" Sep 09 23:19:38.584703 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:19:38.584592 2552 generic.go:356] "Generic (PLEG): container finished" podID="e78acce9-b9e7-41cb-bdff-ca8a1114e16b" containerID="144cff70afbd25ec6850ab9966743944244f21316cb86472dba3d25eff6f7c61" exitCode=0 Sep 09 23:19:38.584703 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:19:38.584665 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-2b8vd" event={"ID":"e78acce9-b9e7-41cb-bdff-ca8a1114e16b","Type":"ContainerDied","Data":"144cff70afbd25ec6850ab9966743944244f21316cb86472dba3d25eff6f7c61"} Sep 09 23:19:38.584894 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:19:38.584765 2552 scope.go:117] "RemoveContainer" containerID="654eca86de544ccd5d6a11397c2c24265ae8638bc6da26d5bfbfc05a322dd491" Sep 09 23:19:38.585201 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:19:38.585178 2552 scope.go:117] "RemoveContainer" containerID="144cff70afbd25ec6850ab9966743944244f21316cb86472dba3d25eff6f7c61" Sep 09 23:19:38.585429 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:19:38.585406 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-2b8vd_llm(e78acce9-b9e7-41cb-bdff-ca8a1114e16b)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-2b8vd" podUID="e78acce9-b9e7-41cb-bdff-ca8a1114e16b" Sep 09 23:19:48.003258 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:19:48.003208 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-2b8vd" Sep 09 23:19:48.003733 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:19:48.003278 2552 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-2b8vd" Sep 09 23:19:48.003733 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:19:48.003295 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-2b8vd" Sep 09 23:19:48.003733 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:19:48.003311 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-6685d86975-2b8vd" Sep 09 23:19:48.003854 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:19:48.003736 2552 scope.go:117] "RemoveContainer" containerID="144cff70afbd25ec6850ab9966743944244f21316cb86472dba3d25eff6f7c61" Sep 09 23:19:48.003952 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:19:48.003932 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-2b8vd_llm(e78acce9-b9e7-41cb-bdff-ca8a1114e16b)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-2b8vd" podUID="e78acce9-b9e7-41cb-bdff-ca8a1114e16b" Sep 09 23:19:59.936627 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:19:59.936592 2552 scope.go:117] "RemoveContainer" containerID="144cff70afbd25ec6850ab9966743944244f21316cb86472dba3d25eff6f7c61" Sep 09 23:19:59.937113 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:19:59.936824 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-2b8vd_llm(e78acce9-b9e7-41cb-bdff-ca8a1114e16b)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-2b8vd" podUID="e78acce9-b9e7-41cb-bdff-ca8a1114e16b" Sep 09 23:20:14.932933 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:20:14.932853 2552 scope.go:117] "RemoveContainer" containerID="144cff70afbd25ec6850ab9966743944244f21316cb86472dba3d25eff6f7c61" Sep 09 23:20:14.933387 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:20:14.933073 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-2b8vd_llm(e78acce9-b9e7-41cb-bdff-ca8a1114e16b)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-2b8vd" podUID="e78acce9-b9e7-41cb-bdff-ca8a1114e16b" Sep 09 23:20:25.933459 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:20:25.933425 2552 scope.go:117] "RemoveContainer" containerID="144cff70afbd25ec6850ab9966743944244f21316cb86472dba3d25eff6f7c61" Sep 09 23:20:25.934021 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:20:25.933585 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-2b8vd_llm(e78acce9-b9e7-41cb-bdff-ca8a1114e16b)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-2b8vd" podUID="e78acce9-b9e7-41cb-bdff-ca8a1114e16b" Sep 09 23:20:39.937163 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:20:39.937130 2552 scope.go:117] "RemoveContainer" containerID="144cff70afbd25ec6850ab9966743944244f21316cb86472dba3d25eff6f7c61" Sep 09 23:20:39.937548 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:20:39.937325 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-2b8vd_llm(e78acce9-b9e7-41cb-bdff-ca8a1114e16b)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-2b8vd" podUID="e78acce9-b9e7-41cb-bdff-ca8a1114e16b" Sep 09 23:20:54.933043 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:20:54.933007 2552 scope.go:117] "RemoveContainer" containerID="144cff70afbd25ec6850ab9966743944244f21316cb86472dba3d25eff6f7c61" Sep 09 23:20:54.933540 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:20:54.933212 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-2b8vd_llm(e78acce9-b9e7-41cb-bdff-ca8a1114e16b)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-2b8vd" podUID="e78acce9-b9e7-41cb-bdff-ca8a1114e16b" Sep 09 23:21:05.933250 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:21:05.933204 2552 scope.go:117] "RemoveContainer" containerID="144cff70afbd25ec6850ab9966743944244f21316cb86472dba3d25eff6f7c61" Sep 09 23:21:07.110210 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:21:07.110176 2552 generic.go:356] "Generic (PLEG): container finished" podID="e78acce9-b9e7-41cb-bdff-ca8a1114e16b" containerID="59bcd21c6e79ee6e861baa21f4e1d5a922c3da693746d86c2b918506ef0f38a9" exitCode=0 Sep 09 23:21:07.110624 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:21:07.110245 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-2b8vd" event={"ID":"e78acce9-b9e7-41cb-bdff-ca8a1114e16b","Type":"ContainerDied","Data":"59bcd21c6e79ee6e861baa21f4e1d5a922c3da693746d86c2b918506ef0f38a9"} Sep 09 23:21:07.110624 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:21:07.110311 2552 scope.go:117] "RemoveContainer" containerID="144cff70afbd25ec6850ab9966743944244f21316cb86472dba3d25eff6f7c61" Sep 09 23:21:07.110760 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:21:07.110744 2552 scope.go:117] "RemoveContainer" containerID="59bcd21c6e79ee6e861baa21f4e1d5a922c3da693746d86c2b918506ef0f38a9" Sep 09 23:21:07.110986 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:21:07.110968 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-2b8vd_llm(e78acce9-b9e7-41cb-bdff-ca8a1114e16b)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-2b8vd" podUID="e78acce9-b9e7-41cb-bdff-ca8a1114e16b" Sep 09 23:21:08.002952 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:21:08.002903 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-6685d86975-2b8vd" Sep 09 23:21:08.003134 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:21:08.003020 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-2b8vd" Sep 09 23:21:08.003134 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:21:08.003049 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-2b8vd" Sep 09 23:21:08.003134 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:21:08.003070 2552 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-2b8vd" Sep 09 23:21:08.118023 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:21:08.117993 2552 scope.go:117] "RemoveContainer" containerID="59bcd21c6e79ee6e861baa21f4e1d5a922c3da693746d86c2b918506ef0f38a9" Sep 09 23:21:08.118396 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:21:08.118186 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-2b8vd_llm(e78acce9-b9e7-41cb-bdff-ca8a1114e16b)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-2b8vd" podUID="e78acce9-b9e7-41cb-bdff-ca8a1114e16b" Sep 09 23:21:09.126065 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:21:09.126027 2552 scope.go:117] "RemoveContainer" containerID="59bcd21c6e79ee6e861baa21f4e1d5a922c3da693746d86c2b918506ef0f38a9" Sep 09 23:21:09.126530 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:21:09.126246 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-2b8vd_llm(e78acce9-b9e7-41cb-bdff-ca8a1114e16b)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-2b8vd" podUID="e78acce9-b9e7-41cb-bdff-ca8a1114e16b" Sep 09 23:21:21.933283 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:21:21.933240 2552 scope.go:117] "RemoveContainer" containerID="59bcd21c6e79ee6e861baa21f4e1d5a922c3da693746d86c2b918506ef0f38a9" Sep 09 23:21:21.933838 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:21:21.933448 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-2b8vd_llm(e78acce9-b9e7-41cb-bdff-ca8a1114e16b)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-2b8vd" podUID="e78acce9-b9e7-41cb-bdff-ca8a1114e16b" Sep 09 23:21:35.933364 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:21:35.933323 2552 scope.go:117] "RemoveContainer" containerID="59bcd21c6e79ee6e861baa21f4e1d5a922c3da693746d86c2b918506ef0f38a9" Sep 09 23:21:35.934030 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:21:35.933522 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-2b8vd_llm(e78acce9-b9e7-41cb-bdff-ca8a1114e16b)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-2b8vd" podUID="e78acce9-b9e7-41cb-bdff-ca8a1114e16b" Sep 09 23:21:47.933007 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:21:47.932973 2552 scope.go:117] "RemoveContainer" containerID="59bcd21c6e79ee6e861baa21f4e1d5a922c3da693746d86c2b918506ef0f38a9" Sep 09 23:21:47.933523 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:21:47.933178 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-2b8vd_llm(e78acce9-b9e7-41cb-bdff-ca8a1114e16b)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-2b8vd" podUID="e78acce9-b9e7-41cb-bdff-ca8a1114e16b" Sep 09 23:21:59.936873 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:21:59.936833 2552 scope.go:117] "RemoveContainer" containerID="59bcd21c6e79ee6e861baa21f4e1d5a922c3da693746d86c2b918506ef0f38a9" Sep 09 23:21:59.937245 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:21:59.937089 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-2b8vd_llm(e78acce9-b9e7-41cb-bdff-ca8a1114e16b)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-2b8vd" podUID="e78acce9-b9e7-41cb-bdff-ca8a1114e16b" Sep 09 23:22:13.933779 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:13.933748 2552 scope.go:117] "RemoveContainer" containerID="59bcd21c6e79ee6e861baa21f4e1d5a922c3da693746d86c2b918506ef0f38a9" Sep 09 23:22:13.934214 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:22:13.933942 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-2b8vd_llm(e78acce9-b9e7-41cb-bdff-ca8a1114e16b)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-2b8vd" podUID="e78acce9-b9e7-41cb-bdff-ca8a1114e16b" Sep 09 23:22:27.932907 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:27.932868 2552 scope.go:117] "RemoveContainer" containerID="59bcd21c6e79ee6e861baa21f4e1d5a922c3da693746d86c2b918506ef0f38a9" Sep 09 23:22:27.942102 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:22:27.933125 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-2b8vd_llm(e78acce9-b9e7-41cb-bdff-ca8a1114e16b)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-2b8vd" podUID="e78acce9-b9e7-41cb-bdff-ca8a1114e16b" Sep 09 23:22:30.456299 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:30.456259 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-mbpl5_ae9a732a-8855-4e82-b4b8-22ad624f4bea/manager/0.log" Sep 09 23:22:30.575258 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:30.575219 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-dpgmr_4c3b6801-892f-49d3-a974-72cebbbe9b07/manager/0.log" Sep 09 23:22:30.696939 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:30.696908 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5d8d86686c-hbkw4_1234d6c6-e69b-4932-bd90-bbd70450890c/manager/0.log" Sep 09 23:22:30.802995 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:30.802919 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-5lsl2_2a6bdc14-4696-4086-b4a8-ad03f50fdb2b/server/0.log" Sep 09 23:22:30.927927 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:30.927877 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-tvlj6_b75a2c8e-3759-44fc-9531-360fec86d829/manager/0.log" Sep 09 23:22:31.038354 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:31.038321 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-76cbb89f58-d8bwp_9e630d24-2acd-4d80-86b4-99e0e4707509/copy-manifests/0.log" Sep 09 23:22:31.044473 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:31.044441 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-76cbb89f58-d8bwp_9e630d24-2acd-4d80-86b4-99e0e4707509/manager/0.log" Sep 09 23:22:31.623375 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:31.623344 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-7f6697c9f6-8l6dw_9cac82dd-e2a9-476c-83ff-c8473044fea8/maas-api/0.log" Sep 09 23:22:32.606058 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:32.606013 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-2h5tf_b05c7f13-22b6-4a89-abb9-1e30e8c991b2/manager/0.log" Sep 09 23:22:33.499924 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:33.499891 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq_d4113cbc-3fc0-4c1a-afcb-6cac827f7f71/istio-proxy/0.log" Sep 09 23:22:33.929653 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:33.929616 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-2r2l5_1a434206-4afc-46b6-aff6-d4f5a2ff28fb/istio-proxy/1.log" Sep 09 23:22:34.148770 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:34.148731 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-ksm7w_bf6f1fd6-ac3e-472d-a1cc-aafcb78f707a/payload-processing/0.log" Sep 09 23:22:34.692288 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:34.692254 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-6685d86975-2b8vd_e78acce9-b9e7-41cb-bdff-ca8a1114e16b/main/5.log" Sep 09 23:22:40.925791 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:40.925751 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4rw5c/must-gather-x2rlh"] Sep 09 23:22:40.929791 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:40.929763 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4rw5c/must-gather-x2rlh" Sep 09 23:22:40.932704 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:40.932655 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4rw5c\"/\"openshift-service-ca.crt\"" Sep 09 23:22:40.932704 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:40.932692 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-4rw5c\"/\"default-dockercfg-ltxmt\"" Sep 09 23:22:40.932911 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:40.932684 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4rw5c\"/\"kube-root-ca.crt\"" Sep 09 23:22:40.933051 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:40.933036 2552 scope.go:117] "RemoveContainer" containerID="59bcd21c6e79ee6e861baa21f4e1d5a922c3da693746d86c2b918506ef0f38a9" Sep 09 23:22:40.933261 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:22:40.933203 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-2b8vd_llm(e78acce9-b9e7-41cb-bdff-ca8a1114e16b)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-2b8vd" podUID="e78acce9-b9e7-41cb-bdff-ca8a1114e16b" Sep 09 23:22:40.936793 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:40.936767 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4rw5c/must-gather-x2rlh"] Sep 09 23:22:41.078208 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:41.078157 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lb6b\" (UniqueName: \"kubernetes.io/projected/2bd2b2f2-d76f-4754-a158-2b61a1544d30-kube-api-access-4lb6b\") pod \"must-gather-x2rlh\" (UID: \"2bd2b2f2-d76f-4754-a158-2b61a1544d30\") " pod="openshift-must-gather-4rw5c/must-gather-x2rlh" Sep 09 23:22:41.078411 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:41.078252 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2bd2b2f2-d76f-4754-a158-2b61a1544d30-must-gather-output\") pod \"must-gather-x2rlh\" (UID: \"2bd2b2f2-d76f-4754-a158-2b61a1544d30\") " pod="openshift-must-gather-4rw5c/must-gather-x2rlh" Sep 09 23:22:41.179092 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:41.178997 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lb6b\" (UniqueName: \"kubernetes.io/projected/2bd2b2f2-d76f-4754-a158-2b61a1544d30-kube-api-access-4lb6b\") pod \"must-gather-x2rlh\" (UID: \"2bd2b2f2-d76f-4754-a158-2b61a1544d30\") " pod="openshift-must-gather-4rw5c/must-gather-x2rlh" Sep 09 23:22:41.179092 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:41.179062 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2bd2b2f2-d76f-4754-a158-2b61a1544d30-must-gather-output\") pod \"must-gather-x2rlh\" (UID: \"2bd2b2f2-d76f-4754-a158-2b61a1544d30\") " pod="openshift-must-gather-4rw5c/must-gather-x2rlh" Sep 09 23:22:41.179364 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:41.179347 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2bd2b2f2-d76f-4754-a158-2b61a1544d30-must-gather-output\") pod \"must-gather-x2rlh\" (UID: \"2bd2b2f2-d76f-4754-a158-2b61a1544d30\") " pod="openshift-must-gather-4rw5c/must-gather-x2rlh" Sep 09 23:22:41.189789 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:41.189757 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lb6b\" (UniqueName: \"kubernetes.io/projected/2bd2b2f2-d76f-4754-a158-2b61a1544d30-kube-api-access-4lb6b\") pod \"must-gather-x2rlh\" (UID: \"2bd2b2f2-d76f-4754-a158-2b61a1544d30\") " pod="openshift-must-gather-4rw5c/must-gather-x2rlh" Sep 09 23:22:41.240959 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:41.240914 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4rw5c/must-gather-x2rlh" Sep 09 23:22:41.513948 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:41.513919 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4rw5c/must-gather-x2rlh"] Sep 09 23:22:41.515464 ip-10-0-142-217 kubenswrapper[2552]: W0909 23:22:41.515435 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2bd2b2f2_d76f_4754_a158_2b61a1544d30.slice/crio-f1fe1e37eca1b3dc76556630c3f4e723a89d28b2d76576303e2da4529f526d00 WatchSource:0}: Error finding container f1fe1e37eca1b3dc76556630c3f4e723a89d28b2d76576303e2da4529f526d00: Status 404 returned error can't find the container with id f1fe1e37eca1b3dc76556630c3f4e723a89d28b2d76576303e2da4529f526d00 Sep 09 23:22:41.517482 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:41.517466 2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 09 23:22:41.660206 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:41.660165 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4rw5c/must-gather-x2rlh" event={"ID":"2bd2b2f2-d76f-4754-a158-2b61a1544d30","Type":"ContainerStarted","Data":"f1fe1e37eca1b3dc76556630c3f4e723a89d28b2d76576303e2da4529f526d00"} Sep 09 23:22:42.668043 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:42.667998 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4rw5c/must-gather-x2rlh" event={"ID":"2bd2b2f2-d76f-4754-a158-2b61a1544d30","Type":"ContainerStarted","Data":"00efd0aad9d69fe436ef076e9cdb750bd99b2131fe0a63f857815d20b0588111"} Sep 09 23:22:42.668414 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:42.668060 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4rw5c/must-gather-x2rlh" event={"ID":"2bd2b2f2-d76f-4754-a158-2b61a1544d30","Type":"ContainerStarted","Data":"7dc6221c1107c8ded43b353f323f0e91a6fe9358f4b1fa3d35bed9300d2dc91e"} Sep 09 23:22:42.685984 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:42.685911 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-4rw5c/must-gather-x2rlh" podStartSLOduration=1.9390293509999998 podStartE2EDuration="2.685885301s" totalImagesPullingTime="746.85595ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:22:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:22:42.681540612 +0000 UTC m=+1133.197271442" watchObservedRunningTime="2026-09-09 23:22:42.685885301 +0000 UTC m=+1133.201616132" Sep 09 23:22:43.824176 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:43.824138 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-6fdst_ce549cd8-0a7b-44b1-afdb-6d02adf85c7d/global-pull-secret-syncer/0.log" Sep 09 23:22:43.952801 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:43.952770 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-x7m6c_0a516991-cc12-4e02-9916-b451d2ff4571/konnectivity-agent/0.log" Sep 09 23:22:44.029540 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:44.029510 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-217.ec2.internal_5c308b40366a538734afec8835421dd2/haproxy/0.log" Sep 09 23:22:48.061010 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:48.060969 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-2h5tf_b05c7f13-22b6-4a89-abb9-1e30e8c991b2/manager/0.log" Sep 09 23:22:50.351026 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:50.350764 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cdcc96965-j5kg7_820c1525-62c1-4181-9a2f-aef3a2157d40/cluster-monitoring-operator/0.log" Sep 09 23:22:50.644224 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:50.644191 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7jqqc_b810b4cc-b59e-485b-a9d2-bc05b1f9f22f/node-exporter/0.log" Sep 09 23:22:50.663405 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:50.663363 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7jqqc_b810b4cc-b59e-485b-a9d2-bc05b1f9f22f/kube-rbac-proxy/0.log" Sep 09 23:22:50.687370 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:50.687337 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7jqqc_b810b4cc-b59e-485b-a9d2-bc05b1f9f22f/init-textfile/0.log" Sep 09 23:22:50.801929 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:50.801893 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-bwllv_ea8fd004-8b78-4b2b-86e1-91132f154174/kube-rbac-proxy-main/0.log" Sep 09 23:22:50.825307 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:50.825275 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-bwllv_ea8fd004-8b78-4b2b-86e1-91132f154174/kube-rbac-proxy-self/0.log" Sep 09 23:22:50.848035 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:50.847981 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-bwllv_ea8fd004-8b78-4b2b-86e1-91132f154174/openshift-state-metrics/0.log" Sep 09 23:22:51.081288 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:51.081259 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-78f599db79-w9k7n_ae7d2ce4-8f63-496a-a973-42c0ce951319/prometheus-operator-admission-webhook/0.log" Sep 09 23:22:51.208226 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:51.208133 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-795bdd954b-n5xsr_e1f3b0b2-13d5-4aaf-a3d6-187ca3ddd115/thanos-query/0.log" Sep 09 23:22:51.229744 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:51.229711 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-795bdd954b-n5xsr_e1f3b0b2-13d5-4aaf-a3d6-187ca3ddd115/kube-rbac-proxy-web/0.log" Sep 09 23:22:51.260116 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:51.260064 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-795bdd954b-n5xsr_e1f3b0b2-13d5-4aaf-a3d6-187ca3ddd115/kube-rbac-proxy/0.log" Sep 09 23:22:51.281921 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:51.281886 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-795bdd954b-n5xsr_e1f3b0b2-13d5-4aaf-a3d6-187ca3ddd115/prom-label-proxy/0.log" Sep 09 23:22:51.305475 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:51.305416 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-795bdd954b-n5xsr_e1f3b0b2-13d5-4aaf-a3d6-187ca3ddd115/kube-rbac-proxy-rules/0.log" Sep 09 23:22:51.341005 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:51.340974 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-795bdd954b-n5xsr_e1f3b0b2-13d5-4aaf-a3d6-187ca3ddd115/kube-rbac-proxy-metrics/0.log" Sep 09 23:22:53.509860 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:53.509830 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-p2dvt_ac335ac0-a272-420f-a215-b93e03772895/console-operator/1.log" Sep 09 23:22:53.519379 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:53.519344 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-p2dvt_ac335ac0-a272-420f-a215-b93e03772895/console-operator/2.log" Sep 09 23:22:53.934280 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:53.934244 2552 scope.go:117] "RemoveContainer" containerID="59bcd21c6e79ee6e861baa21f4e1d5a922c3da693746d86c2b918506ef0f38a9" Sep 09 23:22:53.934814 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:22:53.934781 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-2b8vd_llm(e78acce9-b9e7-41cb-bdff-ca8a1114e16b)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-2b8vd" podUID="e78acce9-b9e7-41cb-bdff-ca8a1114e16b" Sep 09 23:22:54.060998 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:54.060960 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-fdc8df8cb-4s4fl_af8a1e9a-bdbd-4a44-bd1f-df89bd0484b9/console/0.log" Sep 09 23:22:54.094270 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:54.094238 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-85d98c998f-rc9rd_916272e3-b151-462e-95e3-551c2cc28347/download-server/0.log" Sep 09 23:22:54.721091 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:54.721051 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4rw5c/perf-node-gather-daemonset-v2jsm"] Sep 09 23:22:54.727364 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:54.727333 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4rw5c/perf-node-gather-daemonset-v2jsm" Sep 09 23:22:54.733545 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:54.733516 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4rw5c/perf-node-gather-daemonset-v2jsm"] Sep 09 23:22:54.751160 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:54.751058 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d8dad9e1-4195-44ea-94a7-3691d63c171f-lib-modules\") pod \"perf-node-gather-daemonset-v2jsm\" (UID: \"d8dad9e1-4195-44ea-94a7-3691d63c171f\") " pod="openshift-must-gather-4rw5c/perf-node-gather-daemonset-v2jsm" Sep 09 23:22:54.751160 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:54.751107 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlw7r\" (UniqueName: \"kubernetes.io/projected/d8dad9e1-4195-44ea-94a7-3691d63c171f-kube-api-access-hlw7r\") pod \"perf-node-gather-daemonset-v2jsm\" (UID: \"d8dad9e1-4195-44ea-94a7-3691d63c171f\") " pod="openshift-must-gather-4rw5c/perf-node-gather-daemonset-v2jsm" Sep 09 23:22:54.751418 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:54.751244 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d8dad9e1-4195-44ea-94a7-3691d63c171f-proc\") pod \"perf-node-gather-daemonset-v2jsm\" (UID: \"d8dad9e1-4195-44ea-94a7-3691d63c171f\") " pod="openshift-must-gather-4rw5c/perf-node-gather-daemonset-v2jsm" Sep 09 23:22:54.751418 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:54.751296 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d8dad9e1-4195-44ea-94a7-3691d63c171f-podres\") pod \"perf-node-gather-daemonset-v2jsm\" (UID: \"d8dad9e1-4195-44ea-94a7-3691d63c171f\") " pod="openshift-must-gather-4rw5c/perf-node-gather-daemonset-v2jsm" Sep 09 23:22:54.751418 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:54.751353 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d8dad9e1-4195-44ea-94a7-3691d63c171f-sys\") pod \"perf-node-gather-daemonset-v2jsm\" (UID: \"d8dad9e1-4195-44ea-94a7-3691d63c171f\") " pod="openshift-must-gather-4rw5c/perf-node-gather-daemonset-v2jsm" Sep 09 23:22:54.783603 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:54.783561 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-695c895bd6-2cgr6_cb0a0a03-0eaa-4cfa-b854-b33b511e321a/volume-data-source-validator/0.log" Sep 09 23:22:54.852414 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:54.852370 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d8dad9e1-4195-44ea-94a7-3691d63c171f-sys\") pod \"perf-node-gather-daemonset-v2jsm\" (UID: \"d8dad9e1-4195-44ea-94a7-3691d63c171f\") " pod="openshift-must-gather-4rw5c/perf-node-gather-daemonset-v2jsm" Sep 09 23:22:54.852836 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:54.852813 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d8dad9e1-4195-44ea-94a7-3691d63c171f-lib-modules\") pod \"perf-node-gather-daemonset-v2jsm\" (UID: \"d8dad9e1-4195-44ea-94a7-3691d63c171f\") " pod="openshift-must-gather-4rw5c/perf-node-gather-daemonset-v2jsm" Sep 09 23:22:54.853630 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:54.853584 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlw7r\" (UniqueName: \"kubernetes.io/projected/d8dad9e1-4195-44ea-94a7-3691d63c171f-kube-api-access-hlw7r\") pod \"perf-node-gather-daemonset-v2jsm\" (UID: \"d8dad9e1-4195-44ea-94a7-3691d63c171f\") " pod="openshift-must-gather-4rw5c/perf-node-gather-daemonset-v2jsm" Sep 09 23:22:54.854003 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:54.853977 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d8dad9e1-4195-44ea-94a7-3691d63c171f-proc\") pod \"perf-node-gather-daemonset-v2jsm\" (UID: \"d8dad9e1-4195-44ea-94a7-3691d63c171f\") " pod="openshift-must-gather-4rw5c/perf-node-gather-daemonset-v2jsm" Sep 09 23:22:54.854167 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:54.854152 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d8dad9e1-4195-44ea-94a7-3691d63c171f-podres\") pod \"perf-node-gather-daemonset-v2jsm\" (UID: \"d8dad9e1-4195-44ea-94a7-3691d63c171f\") " pod="openshift-must-gather-4rw5c/perf-node-gather-daemonset-v2jsm" Sep 09 23:22:54.854355 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:54.853070 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d8dad9e1-4195-44ea-94a7-3691d63c171f-lib-modules\") pod \"perf-node-gather-daemonset-v2jsm\" (UID: \"d8dad9e1-4195-44ea-94a7-3691d63c171f\") " pod="openshift-must-gather-4rw5c/perf-node-gather-daemonset-v2jsm" Sep 09 23:22:54.854510 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:54.852729 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d8dad9e1-4195-44ea-94a7-3691d63c171f-sys\") pod \"perf-node-gather-daemonset-v2jsm\" (UID: \"d8dad9e1-4195-44ea-94a7-3691d63c171f\") " pod="openshift-must-gather-4rw5c/perf-node-gather-daemonset-v2jsm" Sep 09 23:22:54.854635 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:54.854537 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d8dad9e1-4195-44ea-94a7-3691d63c171f-podres\") pod \"perf-node-gather-daemonset-v2jsm\" (UID: \"d8dad9e1-4195-44ea-94a7-3691d63c171f\") " pod="openshift-must-gather-4rw5c/perf-node-gather-daemonset-v2jsm" Sep 09 23:22:54.854724 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:54.854647 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d8dad9e1-4195-44ea-94a7-3691d63c171f-proc\") pod \"perf-node-gather-daemonset-v2jsm\" (UID: \"d8dad9e1-4195-44ea-94a7-3691d63c171f\") " pod="openshift-must-gather-4rw5c/perf-node-gather-daemonset-v2jsm" Sep 09 23:22:54.868722 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:54.868685 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlw7r\" (UniqueName: \"kubernetes.io/projected/d8dad9e1-4195-44ea-94a7-3691d63c171f-kube-api-access-hlw7r\") pod \"perf-node-gather-daemonset-v2jsm\" (UID: \"d8dad9e1-4195-44ea-94a7-3691d63c171f\") " pod="openshift-must-gather-4rw5c/perf-node-gather-daemonset-v2jsm" Sep 09 23:22:55.047108 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:55.047009 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4rw5c/perf-node-gather-daemonset-v2jsm" Sep 09 23:22:55.358074 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:55.351756 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4rw5c/perf-node-gather-daemonset-v2jsm"] Sep 09 23:22:55.783928 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:55.783889 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4rw5c/perf-node-gather-daemonset-v2jsm" event={"ID":"d8dad9e1-4195-44ea-94a7-3691d63c171f","Type":"ContainerStarted","Data":"10dc3e2c40aa8b5bec90919333be85d58f2384dc02f59e59fada6dc2f34041bd"} Sep 09 23:22:55.784378 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:55.783948 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4rw5c/perf-node-gather-daemonset-v2jsm" event={"ID":"d8dad9e1-4195-44ea-94a7-3691d63c171f","Type":"ContainerStarted","Data":"62a8fe16a8a93860174abbddcab34756611b2c64c27d6cb2400927d6d807309e"} Sep 09 23:22:55.784378 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:55.783993 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-4rw5c/perf-node-gather-daemonset-v2jsm" Sep 09 23:22:55.801551 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:55.800012 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-4rw5c/perf-node-gather-daemonset-v2jsm" podStartSLOduration=1.799988972 podStartE2EDuration="1.799988972s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:22:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:22:55.798070234 +0000 UTC m=+1146.313801065" watchObservedRunningTime="2026-09-09 23:22:55.799988972 +0000 UTC m=+1146.315719803" Sep 09 23:22:55.913728 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:55.913699 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2snpc_e4b08d5d-1afa-4ba8-b544-a2c6d441566e/dns/0.log" Sep 09 23:22:55.933844 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:55.933810 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2snpc_e4b08d5d-1afa-4ba8-b544-a2c6d441566e/kube-rbac-proxy/0.log" Sep 09 23:22:56.087661 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:56.087558 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-khhlr_2cf4f0e4-e4dc-4953-87dd-f1ec9654c3cf/dns-node-resolver/0.log" Sep 09 23:22:56.597108 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:56.597065 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5rtmc_8ed69f2d-7f79-4199-b3ea-9a7a73b02f6d/node-ca/0.log" Sep 09 23:22:57.532714 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:57.532664 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq_d4113cbc-3fc0-4c1a-afcb-6cac827f7f71/istio-proxy/0.log" Sep 09 23:22:57.643063 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:57.643034 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-2r2l5_1a434206-4afc-46b6-aff6-d4f5a2ff28fb/istio-proxy/1.log" Sep 09 23:22:57.643652 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:57.643620 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-2r2l5_1a434206-4afc-46b6-aff6-d4f5a2ff28fb/istio-proxy/0.log" Sep 09 23:22:57.689982 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:57.689950 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-ksm7w_bf6f1fd6-ac3e-472d-a1cc-aafcb78f707a/payload-processing/0.log" Sep 09 23:22:58.320134 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:58.320103 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2p8fh_9dcefc03-70f9-41ad-a155-f9156e3cdf25/serve-healthcheck-canary/0.log" Sep 09 23:22:58.814649 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:58.814613 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-p76j4_725fbc90-832a-494f-9852-5532a64baccc/insights-operator/1.log" Sep 09 23:22:58.815150 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:58.814864 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-p76j4_725fbc90-832a-494f-9852-5532a64baccc/insights-operator/0.log" Sep 09 23:22:58.836472 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:58.836441 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9pglj_061f6ffa-34f9-499c-97f8-b1bc0febefdd/kube-rbac-proxy/0.log" Sep 09 23:22:58.856720 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:58.856689 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9pglj_061f6ffa-34f9-499c-97f8-b1bc0febefdd/exporter/0.log" Sep 09 23:22:58.880578 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:22:58.880526 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9pglj_061f6ffa-34f9-499c-97f8-b1bc0febefdd/extractor/0.log" Sep 09 23:23:01.128130 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:23:01.128100 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-mbpl5_ae9a732a-8855-4e82-b4b8-22ad624f4bea/manager/0.log" Sep 09 23:23:01.168150 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:23:01.168106 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-dpgmr_4c3b6801-892f-49d3-a974-72cebbbe9b07/manager/0.log" Sep 09 23:23:01.203853 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:23:01.203818 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5d8d86686c-hbkw4_1234d6c6-e69b-4932-bd90-bbd70450890c/manager/0.log" Sep 09 23:23:01.228656 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:23:01.228623 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-5lsl2_2a6bdc14-4696-4086-b4a8-ad03f50fdb2b/server/0.log" Sep 09 23:23:01.295793 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:23:01.295758 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-tvlj6_b75a2c8e-3759-44fc-9531-360fec86d829/manager/0.log" Sep 09 23:23:01.317390 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:23:01.317358 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-76cbb89f58-d8bwp_9e630d24-2acd-4d80-86b4-99e0e4707509/manager/0.log" Sep 09 23:23:01.335459 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:23:01.335431 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-76cbb89f58-d8bwp_9e630d24-2acd-4d80-86b4-99e0e4707509/copy-manifests/0.log" Sep 09 23:23:01.802561 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:23:01.802530 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-4rw5c/perf-node-gather-daemonset-v2jsm" Sep 09 23:23:02.549168 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:23:02.549137 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-758bd7d86f-dg882_6de2084d-26de-475b-a324-023accf768c9/manager/0.log" Sep 09 23:23:05.352968 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:23:05.352884 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq_d4113cbc-3fc0-4c1a-afcb-6cac827f7f71/istio-proxy/0.log" Sep 09 23:23:05.432349 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:23:05.432313 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-2r2l5_1a434206-4afc-46b6-aff6-d4f5a2ff28fb/istio-proxy/1.log" Sep 09 23:23:05.433148 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:23:05.433117 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-2r2l5_1a434206-4afc-46b6-aff6-d4f5a2ff28fb/istio-proxy/0.log" Sep 09 23:23:05.457780 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:23:05.457750 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-ksm7w_bf6f1fd6-ac3e-472d-a1cc-aafcb78f707a/payload-processing/0.log" Sep 09 23:23:06.715557 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:23:06.715523 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-wpdwq_d4113cbc-3fc0-4c1a-afcb-6cac827f7f71/istio-proxy/0.log" Sep 09 23:23:06.808125 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:23:06.808031 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-2r2l5_1a434206-4afc-46b6-aff6-d4f5a2ff28fb/istio-proxy/1.log" Sep 09 23:23:06.808937 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:23:06.808910 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-2r2l5_1a434206-4afc-46b6-aff6-d4f5a2ff28fb/istio-proxy/0.log" Sep 09 23:23:06.848252 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:23:06.848214 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-ksm7w_bf6f1fd6-ac3e-472d-a1cc-aafcb78f707a/payload-processing/0.log" Sep 09 23:23:06.933628 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:23:06.933593 2552 scope.go:117] "RemoveContainer" containerID="59bcd21c6e79ee6e861baa21f4e1d5a922c3da693746d86c2b918506ef0f38a9" Sep 09 23:23:06.934102 ip-10-0-142-217 kubenswrapper[2552]: E0909 23:23:06.934076 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-2b8vd_llm(e78acce9-b9e7-41cb-bdff-ca8a1114e16b)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-2b8vd" podUID="e78acce9-b9e7-41cb-bdff-ca8a1114e16b" Sep 09 23:23:09.596314 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:23:09.596276 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l9fm4_a4486a4c-3025-4d07-9d75-d9e774762c4f/kube-multus-additional-cni-plugins/0.log" Sep 09 23:23:09.614510 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:23:09.614480 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l9fm4_a4486a4c-3025-4d07-9d75-d9e774762c4f/egress-router-binary-copy/0.log" Sep 09 23:23:09.632287 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:23:09.632259 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l9fm4_a4486a4c-3025-4d07-9d75-d9e774762c4f/cni-plugins/0.log" Sep 09 23:23:09.653978 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:23:09.653948 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l9fm4_a4486a4c-3025-4d07-9d75-d9e774762c4f/bond-cni-plugin/0.log" Sep 09 23:23:09.672236 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:23:09.672204 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l9fm4_a4486a4c-3025-4d07-9d75-d9e774762c4f/routeoverride-cni/0.log" Sep 09 23:23:09.690450 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:23:09.690420 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l9fm4_a4486a4c-3025-4d07-9d75-d9e774762c4f/whereabouts-cni-bincopy/0.log" Sep 09 23:23:09.708349 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:23:09.708323 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l9fm4_a4486a4c-3025-4d07-9d75-d9e774762c4f/whereabouts-cni/0.log" Sep 09 23:23:09.937168 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:23:09.937030 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-z5jzx_37940097-f543-48ff-b5db-f04a9ffac70e/kube-multus/0.log" Sep 09 23:23:09.958106 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:23:09.958075 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5hnn9_be92546e-2796-4680-9b67-4db0dd18a29b/network-metrics-daemon/0.log" Sep 09 23:23:09.974357 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:23:09.974324 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5hnn9_be92546e-2796-4680-9b67-4db0dd18a29b/kube-rbac-proxy/0.log" Sep 09 23:23:10.862264 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:23:10.862221 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6x9hk_2f52574e-96c0-4939-9826-4959aeae1c8b/ovn-controller/0.log" Sep 09 23:23:10.879487 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:23:10.879451 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6x9hk_2f52574e-96c0-4939-9826-4959aeae1c8b/ovn-acl-logging/1.log" Sep 09 23:23:10.879487 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:23:10.879449 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6x9hk_2f52574e-96c0-4939-9826-4959aeae1c8b/ovn-acl-logging/0.log" Sep 09 23:23:10.903440 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:23:10.903386 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6x9hk_2f52574e-96c0-4939-9826-4959aeae1c8b/kube-rbac-proxy-node/0.log" Sep 09 23:23:10.927415 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:23:10.927365 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6x9hk_2f52574e-96c0-4939-9826-4959aeae1c8b/kube-rbac-proxy-ovn-metrics/0.log" Sep 09 23:23:10.942626 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:23:10.942598 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6x9hk_2f52574e-96c0-4939-9826-4959aeae1c8b/northd/0.log" Sep 09 23:23:10.960332 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:23:10.960303 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6x9hk_2f52574e-96c0-4939-9826-4959aeae1c8b/nbdb/0.log" Sep 09 23:23:10.978756 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:23:10.978720 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6x9hk_2f52574e-96c0-4939-9826-4959aeae1c8b/sbdb/0.log" Sep 09 23:23:11.036492 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:23:11.036455 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6x9hk_2f52574e-96c0-4939-9826-4959aeae1c8b/ovnkube-controller/0.log" Sep 09 23:23:12.435428 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:23:12.435388 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-685456655f-p2sfk_936a6e13-148d-4957-8161-0ed8edf9c89e/check-endpoints/0.log" Sep 09 23:23:12.459156 ip-10-0-142-217 kubenswrapper[2552]: I0909 23:23:12.459126 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-h2ql9_0416357e-69d3-4301-b431-2b39d7387267/network-check-target-container/0.log"